From: Andrea Cornell Date: Thu, 21 Sep 2023 20:40:01 +0000 (-0400) Subject: some changles to sidebot X-Git-Url: https://jcornell.net/gitweb/gitweb.cgi?a=commitdiff_plain;h=69e9eced3a32fb9f44f04ca48a42e6da0a46e201;p=counting.git some changles to sidebot however, please note that sidebot definitely doesn't work correctly at the moment: - I noticed incorrect behavior when a single run retrieves enough pages that multiple entries should be added to the sidebar lists - One time, bingus crashed and I found continuous messages about OOM killing sidebot processes. So, check the possibility of significant memory usage, or at least make sure that the number of concurrent sidebot processes is limited (btw, sidebot probably can't handle multiple sidebots running concurrently, so idk why I thought it would be okay to use cron for this in the first place) - sidebot is disabled until these can be addressed lmao --- diff --git a/sidebot/deploy b/sidebot/deploy index fc70ed8..20fca30 100755 --- a/sidebot/deploy +++ b/sidebot/deploy @@ -3,4 +3,4 @@ VERS=0.1.0 python3 -m build --no-isolation -tar c dist/sidebot-$VERS-py3-none-any.whl | ssh anders@bingus.internet6.net. tar x --strip-components=1 \&\& pip3 install --no-deps ./sidebot-$VERS-py3-none-any.whl +tar c dist/sidebot-$VERS-py3-none-any.whl | ssh anders@bingus.acorn.ignorelist.com. tar x --strip-components=1 \&\& pip3 install --no-deps ./sidebot-$VERS-py3-none-any.whl diff --git a/sidebot/sidebot/main.py b/sidebot/sidebot/main.py index d9fcf6f..6915476 100644 --- a/sidebot/sidebot/main.py +++ b/sidebot/sidebot/main.py @@ -17,7 +17,7 @@ def main(): args = parser.parse_args() USER_AGENT = 'sidebot/0.1.0' - MAX_PAGES = 3 + MAX_PAGES = 30 dbconn = psycopg2.connect('') db = dbconn.cursor()