โ Logs
social_media_monitor_2026-08-28.log
2026-08-28 20:30:12,665 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-08-28 20:30:12,754 - GitHubScraper - INFO - Found 255 GitHub repositories for term: paperclip
2026-08-28 20:30:12,903 - GitHubScraper - INFO - Total GitHub results found: 6
2026-08-28 20:30:15,371 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"
2026-08-28 20:30:15,797 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:15,800 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:15,840 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:15,881 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:16,141 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:16,191 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:16,205 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:16,308 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yitzih97/torahtale/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:16,574 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-28 20:30:16,598 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-28 20:30:16,642 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/tatyesod/talmud-tora-web/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:16,954 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:16,997 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:17,020 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:17,052 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:17,251 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:17,358 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:17,518 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:17,585 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/sikmenedowai-a11y/savetube-stream-kit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:17,831 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:17,833 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:17,883 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:17,945 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:18,174 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:18,186 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:18,198 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:18,355 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:18,563 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:18,653 - YouTubeIntelScraper - INFO - YouTube Intel found 43 candidates and 9 new videos
2026-08-28 20:30:18,658 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:18,801 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:18,832 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:18,914 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:19,060 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:19,321 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:19,435 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:19,527 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:19,530 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:19,782 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:19,930 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:20,024 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:20,068 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:20,076 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:20,355 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-28 20:30:20,384 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:20,494 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:20,586 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:20,754 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:20,894 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:20,935 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:20,998 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:21,032 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:21,177 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:21,386 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:21,437 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:21,479 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:21,512 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-28 20:30:21,806 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:21,822 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:21,906 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:22,054 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:22,285 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:22,338 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:22,455 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:22,464 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:22,605 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:22,703 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:22,806 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:22,846 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:22,919 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:23,045 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:23,202 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:23,240 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:23,251 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:23,407 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:23,582 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:23,613 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:23,672 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:23,716 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:23,868 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:24,062 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:24,093 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yeled-tov/filtertube-android/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:24,109 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:24,214 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:24,397 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:24,527 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:24,529 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-tfilah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:24,610 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:24,725 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/ShireiShabbat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:24,888 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:24,929 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:24,951 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:25,118 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:25,194 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:25,252 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:25,310 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:25,461 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:25,494 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:25,635 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:25,672 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:25,811 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akshatasatmar/WeatherServiceApi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 20:30:25,842 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=252 account_new=0 list_repos=100 list_new=0 private_new=0 total_new=0
2026-08-28 20:30:25,843 - __main__ - INFO - Scraper reddit completed: 4 results
2026-08-28 20:30:25,844 - __main__ - INFO - Scraper github completed: 6 results
2026-08-28 20:30:25,844 - __main__ - INFO - Scraper github_feed completed: 0 results
2026-08-28 20:30:25,844 - __main__ - INFO - Scraper youtube_intel completed: 9 results
2026-08-28 20:30:26,611 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-08-28 20:30:26.611184
2026-08-28 20:30:26,611 - __main__ - INFO - Email sent successfully
2026-08-28 20:30:26,611 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-08-28 20:30:26,611 - __main__ - INFO - Monitor complete. Found 19 total results: 4 new reddit results, 6 new github results, 9 new youtube intel results.
2026-08-28 20:30:26,611 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-08-28 20:30:26,611 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-28 20:30:26,730 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-08-28 20:30:26,730 - __main__ - INFO - Closed all database connections
2026-08-28 20:30:26,734 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-28 20:30:26,734 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-08-28 21:00:01,904 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-08-28.log
2026-08-28 21:00:01,904 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-08-28.log
2026-08-28 21:00:01,904 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-08-28.log
2026-08-28 21:00:01,905 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-08-28 21:00:01,931 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-08-28 21:00:01,931 - __main__ - INFO - Configuration loaded and validated successfully
2026-08-28 21:00:01,934 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-08-28 21:00:01,934 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-08-28 21:00:01,949 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-08-28 21:00:01,949 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-08-28 21:00:01,954 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='linux:SocialMediaMonitor:1.0 (by /u/abeperl)')
2026-08-28 21:00:01,956 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-08-28 21:00:01,956 - __main__ - INFO - RSS scraper initialized and enabled
2026-08-28 21:00:01,962 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-08-28 21:00:01,962 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-08-28 21:00:01,963 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-08-28 21:00:01,969 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-08-28 21:00:01,979 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-08-28 21:00:01,979 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-08-28 21:00:01,983 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-08-28 21:00:01,983 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-08-28 21:00:01,984 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-08-28 21:00:01,987 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-08-28 21:00:01,988 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-08-28 21:00:01,988 - __main__ - INFO - Running 3 scrapers concurrently...
2026-08-28 21:00:01,988 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-08-28 21:00:02,077 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-08-28 21:00:02,081 - IveltScraper - INFO - Loaded 181 include, 4 exclude filters from DB topic_filters
2026-08-28 21:00:02,081 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-08-28 21:00:02,083 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-08-28 21:00:02,404 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-08-28 21:00:06,404 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-08-28 21:00:06,607 - Yiddish24Scraper - INFO - Received response with 430600 characters
2026-08-28 21:00:06,610 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (287439 chars)
2026-08-28 21:00:06,613 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-08-28 21:00:06,703 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-08-28 21:00:06,743 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-08-28 21:00:06,743 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-08-28 21:00:06,807 - Yiddish24Scraper - INFO - Term 'ืฉืืขืืฆืขืจ' matched in DESCRIPTION: 'ืืจื ืืืขืืืื ืฉืืขืืฆืขืจ'
2026-08-28 21:00:06,807 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ืืื ืืขืจืืืื: ืืืืื ืืืื"ืจืื ืืจืืฉื ืืฉืืืืช ืคืื ื ืื ืื
2026-08-28 21:00:07,327 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/KM_N114_145_1787950093.mp3
2026-08-28 21:00:07,414 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_KM_N114_145_1787950093.mp3 (431.8 KB)
2026-08-28 21:00:07,415 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-08-28 21:00:07,421 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_KM_N114_145_1787950093.mp3: title, artist, album, comment, source_url, genre, publisher
2026-08-28 21:00:07,421 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2_KM_N114_145_1787950093_ืฉืืขืืฆืขืจ.mp3
2026-08-28 21:00:07,454 - Yiddish24Scraper - INFO - Term 'ืคืื ืื ืืืื'ืก ืืืฉื' matched in DESCRIPTION: 'ืคืื ืื ืืืื'ืก ืืืฉื - ืืขืจ ืื ืคืื ืืืื ืงืืคืืื'
2026-08-28 21:00:07,454 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ืืื ืืื
2026-08-28 21:00:08,327 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/______________260_260828044216.mp3
2026-08-28 21:00:09,453 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_______________260_260828044216.mp3 (9.1 MB)
2026-08-28 21:00:09,453 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-08-28 21:00:09,465 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_______________260_260828044216.mp3: title, artist, album, comment, source_url, genre, publisher
2026-08-28 21:00:09,466 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2_______________260_260828044216_ืคืื_ืื_ืืืื_ืก_ืืืฉื.mp3
2026-08-28 21:00:09,511 - Yiddish24Scraper - INFO - Term 'ื ืืื ืืืืจื' matched in DESCRIPTION: 'ื ืืื ืืืืจื - ืื ืืืื ืืื, ืฉืืืืื'
2026-08-28 21:00:09,511 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ืืื ืืื
2026-08-28 21:00:10,011 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/_________260_260828040229.mp3
2026-08-28 21:00:11,065 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2__________260_260828040229.mp3 (4.6 MB)
2026-08-28 21:00:11,065 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-08-28 21:00:11,070 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2__________260_260828040229.mp3: title, artist, album, comment, source_url, genre, publisher
2026-08-28 21:00:11,070 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2__________260_260828040229_ื_ืืื_ืืืืจื.mp3
2026-08-28 21:00:11,697 - Yiddish24Scraper - INFO - Page 1 summary: 13 new out of 100 total articles
2026-08-28 21:00:11,698 - Yiddish24Scraper - INFO - Page 1: 13/100 new items
2026-08-28 21:00:11,698 - Yiddish24Scraper - INFO - Low new item ratio (13.0%), stopping pagination
2026-08-28 21:00:11,698 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 13
2026-08-28 21:00:14,238 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-08-28 21:00:24,370 - IveltScraper - INFO - Filtering post containing exclude term: '*ืืืืข ืืืื ืืืืขืจ ืืืืื ืฆื ืืืจืืืื ืงืจืื ืืข ื ืืืขืก*'
2026-08-28 21:00:31,734 - IveltScraper - INFO - ivelt scrape complete. Checked 5 topics.
2026-08-28 21:00:31,734 - IveltScraper - INFO - All forums scrape complete. Found 7 new posts.
2026-08-28 21:00:31,734 - __main__ - INFO - Scraper rss completed: 0 results
2026-08-28 21:00:31,734 - __main__ - INFO - Scraper yiddish24 completed: 13 results
2026-08-28 21:00:31,735 - __main__ - INFO - Scraper ivelt completed: 7 results
2026-08-28 21:00:32,764 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-08-28 21:00:32.764621
2026-08-28 21:00:32,765 - __main__ - INFO - Email sent successfully
2026-08-28 21:00:32,765 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-08-28 21:00:32,765 - __main__ - INFO - Monitor complete. Found 20 total results: 13 new yiddish24 results, 7 new ivelt results.
2026-08-28 21:00:32,765 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-08-28 21:00:32,765 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-28 21:00:32,937 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-08-28 21:00:32,937 - __main__ - INFO - Closed all database connections
2026-08-28 21:00:32,939 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-28 21:00:32,939 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-08-28 22:00:02,000 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-08-28.log
2026-08-28 22:00:02,000 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-08-28.log
2026-08-28 22:00:02,000 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-08-28.log
2026-08-28 22:00:02,000 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-08-28 22:00:02,026 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-08-28 22:00:02,026 - __main__ - INFO - Configuration loaded and validated successfully
2026-08-28 22:00:02,028 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-08-28 22:00:02,029 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-08-28 22:00:02,060 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-08-28 22:00:02,060 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-08-28 22:00:02,105 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='linux:SocialMediaMonitor:1.0 (by /u/abeperl)')
2026-08-28 22:00:02,106 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-08-28 22:00:02,106 - __main__ - INFO - RSS scraper initialized and enabled
2026-08-28 22:00:02,109 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-08-28 22:00:02,110 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-08-28 22:00:02,110 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-08-28 22:00:02,112 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-08-28 22:00:02,116 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-08-28 22:00:02,116 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-08-28 22:00:02,118 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-08-28 22:00:02,118 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-08-28 22:00:02,118 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-08-28 22:00:02,121 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-08-28 22:00:02,121 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-08-28 22:00:02,121 - __main__ - INFO - Running 3 scrapers concurrently...
2026-08-28 22:00:02,121 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-08-28 22:00:02,207 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-08-28 22:00:02,211 - IveltScraper - INFO - Loaded 181 include, 4 exclude filters from DB topic_filters
2026-08-28 22:00:02,211 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-08-28 22:00:02,214 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-08-28 22:00:02,463 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-08-28 22:00:04,961 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-08-28 22:00:05,170 - Yiddish24Scraper - INFO - Received response with 438616 characters
2026-08-28 22:00:05,173 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (293422 chars)
2026-08-28 22:00:05,176 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-08-28 22:00:05,262 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-08-28 22:00:05,301 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-08-28 22:00:05,301 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-08-28 22:00:05,378 - Yiddish24Scraper - INFO - Term 'ืฉืืื' matched in TITLE: 'ืืื"ืฆ ืจ' ืืืืืื ืืืืขืจืืื ืฉืืื"ื'
2026-08-28 22:00:05,378 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ืืื"ืฆ ืจ' ืืืืืื ืืืืขืจืืื ืฉืืื"ื
2026-08-28 22:00:05,901 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/__140_1787948782073_18_0_260828045258_0_2_773577442.mp3
2026-08-28 22:00:07,366 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2___140_1787948782073_18_0_260828045258_0_2_773577442.mp3 (17.1 MB)
2026-08-28 22:00:07,367 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-08-28 22:00:07,386 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2___140_1787948782073_18_0_260828045258_0_2_773577442.mp3: title, artist, album, comment, source_url, genre, publisher
2026-08-28 22:00:07,386 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2___140_1787948782073_18_0_260828045258_0_2_773577442_ืฉืืื.mp3
2026-08-28 22:00:08,054 - Yiddish24Scraper - INFO - Page 1 summary: 7 new out of 100 total articles
2026-08-28 22:00:08,055 - Yiddish24Scraper - INFO - Page 1: 7/100 new items
2026-08-28 22:00:08,055 - Yiddish24Scraper - INFO - Low new item ratio (7.0%), stopping pagination
2026-08-28 22:00:08,055 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 7
2026-08-28 22:00:14,382 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-08-28 22:00:23,838 - IveltScraper - INFO - ivelt scrape complete. Checked 2 topics.
2026-08-28 22:00:23,838 - IveltScraper - INFO - All forums scrape complete. Found 1 new posts.
2026-08-28 22:00:23,838 - __main__ - INFO - Scraper rss completed: 0 results
2026-08-28 22:00:23,839 - __main__ - INFO - Scraper yiddish24 completed: 7 results
2026-08-28 22:00:23,839 - __main__ - INFO - Scraper ivelt completed: 1 results
2026-08-28 22:00:24,544 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-08-28 22:00:24.543980
2026-08-28 22:00:24,544 - __main__ - INFO - Email sent successfully
2026-08-28 22:00:24,544 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-08-28 22:00:24,544 - __main__ - INFO - Monitor complete. Found 8 total results: 7 new yiddish24 results, 1 new ivelt results.
2026-08-28 22:00:24,544 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-08-28 22:00:24,544 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-28 22:00:24,660 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-08-28 22:00:24,661 - __main__ - INFO - Closed all database connections
2026-08-28 22:00:24,663 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-28 22:00:24,663 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-08-28 22:30:01,982 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-08-28.log
2026-08-28 22:30:01,983 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-08-28.log
2026-08-28 22:30:01,983 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-08-28.log
2026-08-28 22:30:01,983 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-08-28 22:30:02,010 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-08-28 22:30:02,010 - __main__ - INFO - Configuration loaded and validated successfully
2026-08-28 22:30:02,012 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-08-28 22:30:02,013 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-08-28 22:30:02,026 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-08-28 22:30:02,026 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-08-28 22:30:02,029 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='linux:SocialMediaMonitor:1.0 (by /u/abeperl)')
2026-08-28 22:30:02,029 - __main__ - INFO - Reddit scraper initialized and enabled
2026-08-28 22:30:02,029 - __main__ - INFO - GitHub scraper initialized and enabled
2026-08-28 22:30:02,029 - __main__ - INFO - GitHub feed scraper initialized and enabled
2026-08-28 22:30:02,030 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-08-28 22:30:02,032 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-08-28 22:30:02,032 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-08-28 22:30:02,035 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-08-28 22:30:02,039 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-08-28 22:30:02,039 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-08-28 22:30:02,041 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-08-28 22:30:02,041 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-08-28 22:30:02,041 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-08-28 22:30:02,043 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-08-28 22:30:02,044 - __main__ - INFO - YouTube Intel scraper initialized and enabled
2026-08-28 22:30:02,044 - __main__ - INFO - Running 4 scrapers concurrently...
2026-08-28 22:30:02,044 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit search monitoring enabled. Running search with terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-08-28 22:30:02,044 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit (PRAW) for terms: ['"Hermes Agent"']
2026-08-28 22:30:02,878 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit PRAW search: 25 entries for term '"Hermes Agent"'
2026-08-28 22:30:02,892 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Hermes Agentโs constant โhuman gatesโ are defeating the whole point of
2026-08-28 22:30:02,906 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: What have you said to the Index recently?
2026-08-28 22:30:04,112 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit search results found: 2
2026-08-28 22:30:04,113 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'paperclip' restricted to subreddits: ['PaperClip_AI', 'PaperclipAI']
2026-08-28 22:30:04,113 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit (PRAW) for terms: ['paperclip'] within r/PaperClip_AI+PaperclipAI
2026-08-28 22:30:04,901 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit PRAW search: 25 entries for term 'paperclip'
2026-08-28 22:30:06,085 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit search results found: 0
2026-08-28 22:30:06,086 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'multica' restricted to subreddits: ['hermesagent', 'HermesAI']
2026-08-28 22:30:06,086 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit (PRAW) for terms: ['multica'] within r/hermesagent+HermesAI
2026-08-28 22:30:06,322 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit PRAW search: 0 entries for term 'multica'
2026-08-28 22:30:07,323 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit search results found: 0
2026-08-28 22:30:07,323 - GitHubScraper - INFO - Searching GitHub for terms: ['"Hermes Agent"', '"claude code"', '"prime agent"', 'paperclip']
2026-08-28 22:30:07,776 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"
2026-08-28 22:30:07,777 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)
2026-08-28 22:30:08,642 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"
2026-08-28 22:30:09,005 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-08-28 22:30:09,101 - GitHubScraper - INFO - Found 563 GitHub repositories for term: "Hermes Agent"
2026-08-28 22:30:09,479 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"
2026-08-28 22:30:10,304 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22claude+code%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-08-28 22:30:10,397 - GitHubScraper - INFO - Found 8230 GitHub repositories for term: "claude code"
2026-08-28 22:30:10,466 - GitHubScraper - INFO - Added new GitHub repository: ai-dial-chat
2026-08-28 22:30:10,493 - GitHubScraper - INFO - Added new GitHub repository: open-knowledge
2026-08-28 22:30:10,534 - GitHubScraper - INFO - Added new GitHub repository: CrispASR
2026-08-28 22:30:10,544 - GitHubScraper - INFO - Added new GitHub repository: mesh-llm
2026-08-28 22:30:10,710 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 200 OK"
2026-08-28 22:30:11,329 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22prime+agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-08-28 22:30:11,333 - GitHubScraper - INFO - Found 34 GitHub repositories for term: "prime agent"
2026-08-28 22:30:12,572 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-08-28 22:30:12,573 - GitHubScraper - INFO - Found 255 GitHub repositories for term: paperclip
2026-08-28 22:30:12,702 - GitHubScraper - INFO - Total GitHub results found: 4
2026-08-28 22:30:13,950 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"
2026-08-28 22:30:14,316 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:14,389 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:14,394 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:14,424 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-28 22:30:14,645 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:14,778 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:14,793 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:14,907 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yitzih97/torahtale/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:15,162 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-28 22:30:15,164 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:15,391 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/tatyesod/talmud-tora-web/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:15,449 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:15,466 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:15,502 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-28 22:30:15,662 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:15,731 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:15,895 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:16,060 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:16,080 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:16,196 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/sikmenedowai-a11y/savetube-stream-kit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:16,403 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:16,442 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:16,522 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:16,526 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-28 22:30:16,787 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:16,852 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:16,879 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:16,892 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:17,010 - YouTubeIntelScraper - INFO - YouTube Intel found 42 candidates and 5 new videos
2026-08-28 22:30:17,243 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:17,265 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:17,267 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:17,555 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:17,595 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:17,898 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:17,912 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-28 22:30:17,917 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:17,938 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:18,181 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:18,357 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-28 22:30:18,405 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-28 22:30:18,596 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:18,650 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:18,814 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:19,084 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:19,106 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:19,200 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:19,310 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:19,479 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:19,586 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-28 22:30:19,634 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:19,668 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:19,835 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:20,032 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:20,046 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:20,072 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-28 22:30:20,172 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:20,407 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:20,548 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:20,603 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:20,875 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:20,893 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:20,996 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:21,150 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:21,234 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:21,328 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:21,381 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:21,605 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:21,703 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:21,711 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:21,913 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:21,968 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:22,061 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:22,086 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:22,283 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:22,330 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:22,487 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:22,514 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:22,547 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:22,605 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:22,857 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:22,929 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:22,943 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yeled-tov/filtertube-android/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:22,950 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:23,242 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:23,255 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-28 22:30:23,265 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:23,294 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-tfilah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:23,554 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/ShireiShabbat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:23,576 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:23,619 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:23,831 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:23,854 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:23,961 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:23,973 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-28 22:30:24,141 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:24,180 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:24,305 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:24,393 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:24,535 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akshatasatmar/WeatherServiceApi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:24,586 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-28 22:30:24,691 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=252 account_new=0 list_repos=100 list_new=1 private_new=0 total_new=1
2026-08-28 22:30:24,693 - __main__ - INFO - Scraper reddit completed: 2 results
2026-08-28 22:30:24,693 - __main__ - INFO - Scraper github completed: 4 results
2026-08-28 22:30:24,693 - __main__ - INFO - Scraper github_feed completed: 1 results
2026-08-28 22:30:24,693 - __main__ - INFO - Scraper youtube_intel completed: 5 results
2026-08-28 22:30:25,410 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-08-28 22:30:25.410036
2026-08-28 22:30:25,410 - __main__ - INFO - Email sent successfully
2026-08-28 22:30:25,420 - __main__ - INFO - GitHub feed delivery acknowledged: 1 stored, 0 failed
2026-08-28 22:30:25,421 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-08-28 22:30:25,421 - __main__ - INFO - Monitor complete. Found 12 total results: 2 new reddit results, 4 new github results, 1 new github feed results, 5 new youtube intel results.
2026-08-28 22:30:25,421 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-08-28 22:30:25,421 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-28 22:30:25,482 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-08-28 22:30:25,482 - __main__ - INFO - Closed all database connections
2026-08-28 22:30:25,485 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-28 22:30:25,486 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-08-28 23:00:02,029 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-08-28.log
2026-08-28 23:00:02,029 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-08-28.log
2026-08-28 23:00:02,029 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-08-28.log
2026-08-28 23:00:02,029 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-08-28 23:00:02,054 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-08-28 23:00:02,054 - __main__ - INFO - Configuration loaded and validated successfully
2026-08-28 23:00:02,056 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-08-28 23:00:02,057 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-08-28 23:00:02,075 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-08-28 23:00:02,075 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-08-28 23:00:02,078 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='linux:SocialMediaMonitor:1.0 (by /u/abeperl)')
2026-08-28 23:00:02,079 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-08-28 23:00:02,079 - __main__ - INFO - RSS scraper initialized and enabled
2026-08-28 23:00:02,081 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-08-28 23:00:02,081 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-08-28 23:00:02,082 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-08-28 23:00:02,084 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-08-28 23:00:02,088 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-08-28 23:00:02,088 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-08-28 23:00:02,090 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-08-28 23:00:02,091 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-08-28 23:00:02,091 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-08-28 23:00:02,093 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-08-28 23:00:02,093 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-08-28 23:00:02,093 - __main__ - INFO - Running 3 scrapers concurrently...
2026-08-28 23:00:02,093 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-08-28 23:00:02,182 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-08-28 23:00:02,186 - IveltScraper - INFO - Loaded 181 include, 4 exclude filters from DB topic_filters
2026-08-28 23:00:02,186 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-08-28 23:00:02,190 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-08-28 23:00:02,430 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-08-28 23:00:03,828 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-08-28 23:00:04,039 - Yiddish24Scraper - INFO - Received response with 443003 characters
2026-08-28 23:00:04,043 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (295325 chars)
2026-08-28 23:00:04,046 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-08-28 23:00:04,133 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-08-28 23:00:04,173 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-08-28 23:00:04,173 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-08-28 23:00:05,332 - Yiddish24Scraper - INFO - Page 1 summary: 1 new out of 100 total articles
2026-08-28 23:00:05,332 - Yiddish24Scraper - INFO - Page 1: 1/100 new items
2026-08-28 23:00:05,332 - Yiddish24Scraper - INFO - Low new item ratio (1.0%), stopping pagination
2026-08-28 23:00:05,333 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 1
2026-08-28 23:00:14,223 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-08-28 23:00:17,887 - IveltScraper - INFO - ivelt scrape complete. Checked 1 topics.
2026-08-28 23:00:17,888 - IveltScraper - INFO - All forums scrape complete. Found 2 new posts.
2026-08-28 23:00:17,888 - __main__ - INFO - Scraper rss completed: 0 results
2026-08-28 23:00:17,888 - __main__ - INFO - Scraper yiddish24 completed: 1 results
2026-08-28 23:00:17,888 - __main__ - INFO - Scraper ivelt completed: 2 results
2026-08-28 23:00:18,591 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-08-28 23:00:18.591916
2026-08-28 23:00:18,592 - __main__ - INFO - Email sent successfully
2026-08-28 23:00:18,592 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-08-28 23:00:18,592 - __main__ - INFO - Monitor complete. Found 3 total results: 1 new yiddish24 results, 2 new ivelt results.
2026-08-28 23:00:18,592 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-08-28 23:00:18,592 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-28 23:00:18,670 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-08-28 23:00:18,671 - __main__ - INFO - Closed all database connections
2026-08-28 23:00:18,672 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-28 23:00:18,673 - social_media_monitor.database.connection - INFO - Closed 0 database connections
Live tail active โ waiting for new lines...