โ† Logs

social_media_monitor_2026-08-30.log

2026-08-30 20:30:09,592 - GitHubScraper - INFO - Added new GitHub repository: grok-build-vscode
2026-08-30 20:30:09,600 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"
2026-08-30 20:30:10,384 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22prime+agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-08-30 20:30:10,389 - GitHubScraper - INFO - Found 36 GitHub repositories for term: "prime agent"
2026-08-30 20:30:10,625 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 200 OK"
2026-08-30 20:30:11,525 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-08-30 20:30:11,529 - GitHubScraper - INFO - Found 255 GitHub repositories for term: paperclip
2026-08-30 20:30:11,663 - GitHubScraper - INFO - Total GitHub results found: 2
2026-08-30 20:30:13,350 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"
2026-08-30 20:30:13,750 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-30 20:30:13,760 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:13,789 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:13,811 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:14,135 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:14,138 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yitzih97/torahtale/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-30 20:30:14,152 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:14,191 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:14,468 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:14,542 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/tatyesod/talmud-tora-web/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-30 20:30:14,547 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-30 20:30:14,798 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:14,893 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:14,894 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:14,896 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:15,098 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:15,282 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:15,370 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:15,433 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/sikmenedowai-a11y/savetube-stream-kit/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-30 20:30:15,642 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:15,770 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:15,780 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:15,844 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:15,977 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:16,079 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:16,161 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:16,370 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:16,420 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:16,574 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:16,665 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:16,710 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:16,754 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:16,974 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:17,093 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:17,269 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:17,307 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:17,336 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:17,442 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:17,561 - YouTubeIntelScraper - INFO - YouTube Intel found 44 candidates and 8 new videos
2026-08-30 20:30:17,759 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:17,794 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:17,816 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-30 20:30:17,844 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:18,192 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:18,243 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-30 20:30:18,311 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:18,313 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-30 20:30:18,591 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:18,656 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-30 20:30:18,717 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:18,731 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:18,948 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:18,995 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:19,110 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:19,151 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:19,244 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:19,446 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-30 20:30:19,522 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:19,565 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:19,693 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:19,883 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:20,050 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:20,087 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:20,153 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:20,314 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:20,366 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:20,415 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:20,508 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:20,664 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:20,851 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-30 20:30:20,905 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:20,915 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:21,046 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:21,180 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:21,278 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:21,297 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:21,439 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:21,595 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:21,622 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:21,655 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:21,834 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yeled-tov/filtertube-android/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:21,941 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:21,958 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:21,995 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:22,228 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:22,276 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:22,302 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-tfilah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:22,355 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:22,575 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/ShireiShabbat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:22,609 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:22,648 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:22,718 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:22,919 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:22,947 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:22,965 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:22,994 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:23,220 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:23,292 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:23,298 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:23,323 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:23,481 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akshatasatmar/WeatherServiceApi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 20:30:23,551 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=249 account_new=0 list_repos=100 list_new=0 private_new=0 total_new=0
2026-08-30 20:30:23,552 - __main__ - INFO - Scraper reddit completed: 5 results
2026-08-30 20:30:23,553 - __main__ - INFO - Scraper github completed: 2 results
2026-08-30 20:30:23,553 - __main__ - INFO - Scraper github_feed completed: 0 results
2026-08-30 20:30:23,553 - __main__ - INFO - Scraper youtube_intel completed: 8 results
2026-08-30 20:30:24,517 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-08-30 20:30:24.517333
2026-08-30 20:30:24,517 - __main__ - INFO - Email sent successfully
2026-08-30 20:30:24,518 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-08-30 20:30:24,518 - __main__ - INFO - Monitor complete. Found 15 total results: 5 new reddit results, 2 new github results, 8 new youtube intel results.
2026-08-30 20:30:24,518 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-08-30 20:30:24,518 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-30 20:30:24,559 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-08-30 20:30:24,559 - __main__ - INFO - Closed all database connections
2026-08-30 20:30:24,562 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-30 20:30:24,563 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-08-30 21:00:02,611 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-08-30.log
2026-08-30 21:00:02,611 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-08-30.log
2026-08-30 21:00:02,611 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-08-30.log
2026-08-30 21:00:02,611 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-08-30 21:00:02,638 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-08-30 21:00:02,638 - __main__ - INFO - Configuration loaded and validated successfully
2026-08-30 21:00:02,640 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-08-30 21:00:02,641 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-08-30 21:00:02,657 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-08-30 21:00:02,657 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-08-30 21:00:02,715 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='linux:SocialMediaMonitor:1.0 (by /u/abeperl)')
2026-08-30 21:00:02,717 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-08-30 21:00:02,718 - __main__ - INFO - RSS scraper initialized and enabled
2026-08-30 21:00:02,725 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-08-30 21:00:02,725 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-08-30 21:00:02,726 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-08-30 21:00:02,731 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-08-30 21:00:02,740 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-08-30 21:00:02,740 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-08-30 21:00:02,742 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-08-30 21:00:02,742 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-08-30 21:00:02,742 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-08-30 21:00:02,745 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-08-30 21:00:02,745 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-08-30 21:00:02,745 - __main__ - INFO - Running 3 scrapers concurrently...
2026-08-30 21:00:02,745 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-08-30 21:00:02,839 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-08-30 21:00:02,843 - IveltScraper - INFO - Loaded 181 include, 4 exclude filters from DB topic_filters
2026-08-30 21:00:02,843 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-08-30 21:00:02,844 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-08-30 21:00:03,185 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-08-30 21:00:03,618 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-08-30 21:00:03,838 - Yiddish24Scraper - INFO - Received response with 454726 characters
2026-08-30 21:00:03,842 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (300763 chars)
2026-08-30 21:00:03,845 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-08-30 21:00:03,930 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-08-30 21:00:03,969 - Yiddish24Scraper - INFO - Page 1 extraction: 99 successful, 1 failed out of 100 elements
2026-08-30 21:00:03,969 - Yiddish24Scraper - INFO - Parsed 99 articles from HTML on page 1
2026-08-30 21:00:04,651 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 99 total articles
2026-08-30 21:00:04,652 - Yiddish24Scraper - INFO - Page 1: 0/99 new items
2026-08-30 21:00:04,652 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination
2026-08-30 21:00:04,652 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0
2026-08-30 21:00:14,845 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-08-30 21:00:32,487 - IveltScraper - INFO - Filtering post containing exclude term: '*ื‘ื™ื˜ืข ืžืื›ื˜ ื–ื™ื›ืขืจ ื‘ืœื•ื™ื– ืฆื• ื‘ืืจื™ื›ื˜ืŸ ืงืจืื ื˜ืข ื ื™ื™ืขืก*'
2026-08-30 21:01:34,444 - IveltScraper - INFO - ivelt scrape complete. Checked 7 topics.
2026-08-30 21:01:34,445 - IveltScraper - INFO - All forums scrape complete. Found 67 new posts.
2026-08-30 21:01:34,445 - __main__ - INFO - Scraper rss completed: 0 results
2026-08-30 21:01:34,445 - __main__ - INFO - Scraper yiddish24 completed: 0 results
2026-08-30 21:01:34,445 - __main__ - INFO - Scraper ivelt completed: 67 results
2026-08-30 21:01:35,367 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-08-30 21:01:35.367334
2026-08-30 21:01:35,367 - __main__ - INFO - Email sent successfully
2026-08-30 21:01:35,368 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-08-30 21:01:35,368 - __main__ - INFO - Monitor complete. Found 67 total results: 67 new ivelt results.
2026-08-30 21:01:35,368 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-08-30 21:01:35,368 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-30 21:01:35,532 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-08-30 21:01:35,532 - __main__ - INFO - Closed all database connections
2026-08-30 21:01:35,534 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-30 21:01:35,534 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-08-30 22:00:02,056 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-08-30.log
2026-08-30 22:00:02,056 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-08-30.log
2026-08-30 22:00:02,056 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-08-30.log
2026-08-30 22:00:02,056 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-08-30 22:00:02,081 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-08-30 22:00:02,082 - __main__ - INFO - Configuration loaded and validated successfully
2026-08-30 22:00:02,084 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-08-30 22:00:02,084 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-08-30 22:00:02,107 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-08-30 22:00:02,107 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-08-30 22:00:02,115 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='linux:SocialMediaMonitor:1.0 (by /u/abeperl)')
2026-08-30 22:00:02,118 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-08-30 22:00:02,118 - __main__ - INFO - RSS scraper initialized and enabled
2026-08-30 22:00:02,127 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-08-30 22:00:02,127 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-08-30 22:00:02,127 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-08-30 22:00:02,138 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-08-30 22:00:02,150 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-08-30 22:00:02,150 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-08-30 22:00:02,153 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-08-30 22:00:02,153 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-08-30 22:00:02,154 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-08-30 22:00:02,157 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-08-30 22:00:02,157 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-08-30 22:00:02,157 - __main__ - INFO - Running 3 scrapers concurrently...
2026-08-30 22:00:02,157 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-08-30 22:00:02,257 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-08-30 22:00:02,262 - IveltScraper - INFO - Loaded 181 include, 4 exclude filters from DB topic_filters
2026-08-30 22:00:02,262 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-08-30 22:00:02,263 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-08-30 22:00:02,553 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-08-30 22:00:05,436 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-08-30 22:00:05,653 - Yiddish24Scraper - INFO - Received response with 491789 characters
2026-08-30 22:00:05,656 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (315587 chars)
2026-08-30 22:00:05,659 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-08-30 22:00:05,751 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-08-30 22:00:05,790 - Yiddish24Scraper - INFO - Page 1 extraction: 99 successful, 1 failed out of 100 elements
2026-08-30 22:00:05,790 - Yiddish24Scraper - INFO - Parsed 99 articles from HTML on page 1
2026-08-30 22:00:05,800 - Yiddish24Scraper - INFO - Term 'ืžืขืจืงื•ื•ื™ืจื“ื™ื’ -' matched in DESCRIPTION: 'ืžืขืจืงื•ื•ื™ืจื“ื™ื’ - ืœืขื‘ืŸ ืžื™ื˜ ื ืฉืžื—ื” ืฉืœ ืžืฆื•ื”'
2026-08-30 22:00:05,800 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ื”ื›ืœ ื‘ื›ืœ
2026-08-30 22:00:06,301 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/_____________260_260830031506.mp3
2026-08-30 22:00:07,715 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2______________260_260830031506.mp3 (19.7 MB)
2026-08-30 22:00:07,716 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-08-30 22:00:07,734 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2______________260_260830031506.mp3: title, artist, album, comment, source_url, genre, publisher
2026-08-30 22:00:07,735 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2______________260_260830031506_ืžืขืจืงื•ื•ื™ืจื“ื™ื’_-.mp3
2026-08-30 22:00:07,853 - Yiddish24Scraper - INFO - Term 'ืื™ื ื˜ืขืจืขืกืื ื˜ืก -' matched in DESCRIPTION: 'ืื™ื ื˜ืขืจืขืกืื ื˜ืก - ื’ืขื˜ืจืืคืŸ ื ื’ืืœื“ืŸ ื’ืจื•ื‘'
2026-08-30 22:00:07,853 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ื”ื›ืœ ื‘ื›ืœ
2026-08-30 22:00:08,354 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/_______________260_260830032024.mp3
2026-08-30 22:00:08,614 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2________________260_260830032024.mp3 (10.9 MB)
2026-08-30 22:00:08,614 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-08-30 22:00:08,619 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2________________260_260830032024.mp3: title, artist, album, comment, source_url, genre, publisher
2026-08-30 22:00:08,619 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2________________260_260830032024_ืื™ื ื˜ืขืจืขืกืื ื˜ืก_-.mp3
2026-08-30 22:00:08,628 - Yiddish24Scraper - INFO - Term 'ืื™ื ืกืคื™ืจืืฆื™ืข -' matched in DESCRIPTION: 'ืื™ื ืกืคื™ืจืืฆื™ืข - ืงื•ืง ื•ื•ื™ืคื™ืœ ืขืจ ืฉื˜ื™ื™ื’ื˜'
2026-08-30 22:00:08,628 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ื”ื›ืœ ื‘ื›ืœ
2026-08-30 22:00:09,354 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/_____________260_260830031104.mp3
2026-08-30 22:00:09,503 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2______________260_260830031104.mp3 (17.2 MB)
2026-08-30 22:00:09,504 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-08-30 22:00:09,513 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2______________260_260830031104.mp3: title, artist, album, comment, source_url, genre, publisher
2026-08-30 22:00:09,513 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2______________260_260830031104_ืื™ื ืกืคื™ืจืืฆื™ืข_-.mp3
2026-08-30 22:00:10,366 - Yiddish24Scraper - INFO - Page 1 summary: 17 new out of 99 total articles
2026-08-30 22:00:10,366 - Yiddish24Scraper - INFO - Page 1: 17/99 new items
2026-08-30 22:00:10,366 - Yiddish24Scraper - INFO - Low new item ratio (17.2%), stopping pagination
2026-08-30 22:00:10,367 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 17
2026-08-30 22:00:15,296 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-08-30 22:00:18,622 - IveltScraper - INFO - Filtering post containing exclude term: '*ื‘ื™ื˜ืข ืžืื›ื˜ ื–ื™ื›ืขืจ ื‘ืœื•ื™ื– ืฆื• ื‘ืืจื™ื›ื˜ืŸ ืงืจืื ื˜ืข ื ื™ื™ืขืก*'
2026-08-30 22:00:25,563 - IveltScraper - INFO - Filtering post containing exclude term: '*ื‘ื™ื˜ืข ืžืื›ื˜ ื–ื™ื›ืขืจ ื‘ืœื•ื™ื– ืฆื• ื‘ืืจื™ื›ื˜ืŸ ืงืจืื ื˜ืข ื ื™ื™ืขืก*'
2026-08-30 22:00:29,679 - IveltScraper - INFO - ivelt scrape complete. Checked 1 topics.
2026-08-30 22:00:29,679 - IveltScraper - INFO - All forums scrape complete. Found 10 new posts.
2026-08-30 22:00:29,680 - __main__ - INFO - Scraper rss completed: 0 results
2026-08-30 22:00:29,680 - __main__ - INFO - Scraper yiddish24 completed: 17 results
2026-08-30 22:00:29,680 - __main__ - INFO - Scraper ivelt completed: 10 results
2026-08-30 22:00:30,481 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-08-30 22:00:30.481759
2026-08-30 22:00:30,482 - __main__ - INFO - Email sent successfully
2026-08-30 22:00:30,482 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-08-30 22:00:30,482 - __main__ - INFO - Monitor complete. Found 27 total results: 17 new yiddish24 results, 10 new ivelt results.
2026-08-30 22:00:30,482 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-08-30 22:00:30,482 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-30 22:00:30,591 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-08-30 22:00:30,591 - __main__ - INFO - Closed all database connections
2026-08-30 22:00:30,593 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-30 22:00:30,593 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-08-30 22:30:02,513 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-08-30.log
2026-08-30 22:30:02,513 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-08-30.log
2026-08-30 22:30:02,513 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-08-30.log
2026-08-30 22:30:02,513 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-08-30 22:30:02,539 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-08-30 22:30:02,539 - __main__ - INFO - Configuration loaded and validated successfully
2026-08-30 22:30:02,541 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-08-30 22:30:02,542 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-08-30 22:30:02,555 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-08-30 22:30:02,555 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-08-30 22:30:02,600 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='linux:SocialMediaMonitor:1.0 (by /u/abeperl)')
2026-08-30 22:30:02,600 - __main__ - INFO - Reddit scraper initialized and enabled
2026-08-30 22:30:02,601 - __main__ - INFO - GitHub scraper initialized and enabled
2026-08-30 22:30:02,601 - __main__ - INFO - GitHub feed scraper initialized and enabled
2026-08-30 22:30:02,601 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-08-30 22:30:02,604 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-08-30 22:30:02,604 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-08-30 22:30:02,607 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-08-30 22:30:02,611 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-08-30 22:30:02,611 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-08-30 22:30:02,613 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-08-30 22:30:02,613 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-08-30 22:30:02,614 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-08-30 22:30:02,616 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-08-30 22:30:02,616 - __main__ - INFO - YouTube Intel scraper initialized and enabled
2026-08-30 22:30:02,616 - __main__ - INFO - Running 4 scrapers concurrently...
2026-08-30 22:30:02,616 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit search monitoring enabled. Running search with terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-08-30 22:30:02,616 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit (PRAW) for terms: ['"Hermes Agent"']
2026-08-30 22:30:03,787 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit PRAW search: 25 entries for term '"Hermes Agent"'
2026-08-30 22:30:03,801 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Why can't Bot Mode just work across all messaging channels?
2026-08-30 22:30:03,816 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: I am planning to setup hermes agent on vps, that will manage my daily
2026-08-30 22:30:04,983 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit search results found: 2
2026-08-30 22:30:04,984 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'paperclip' restricted to subreddits: ['PaperClip_AI', 'PaperclipAI']
2026-08-30 22:30:04,984 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit (PRAW) for terms: ['paperclip'] within r/PaperClip_AI+PaperclipAI
2026-08-30 22:30:05,667 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit PRAW search: 25 entries for term 'paperclip'
2026-08-30 22:30:06,872 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit search results found: 0
2026-08-30 22:30:06,873 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'multica' restricted to subreddits: ['hermesagent', 'HermesAI']
2026-08-30 22:30:06,873 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit (PRAW) for terms: ['multica'] within r/hermesagent+HermesAI
2026-08-30 22:30:07,117 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit PRAW search: 0 entries for term 'multica'
2026-08-30 22:30:08,117 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit search results found: 0
2026-08-30 22:30:08,117 - GitHubScraper - INFO - Searching GitHub for terms: ['"Hermes Agent"', '"claude code"', '"prime agent"', 'paperclip']
2026-08-30 22:30:08,543 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"
2026-08-30 22:30:08,544 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)
2026-08-30 22:30:09,200 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-08-30 22:30:09,226 - GitHubScraper - INFO - Found 565 GitHub repositories for term: "Hermes Agent"
2026-08-30 22:30:09,367 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"
2026-08-30 22:30:10,133 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"
2026-08-30 22:30:10,142 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22claude+code%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-08-30 22:30:10,144 - GitHubScraper - INFO - Found 8286 GitHub repositories for term: "claude code"
2026-08-30 22:30:10,157 - GitHubScraper - INFO - Added new GitHub repository: claude-code-tips
2026-08-30 22:30:10,203 - GitHubScraper - INFO - Added new GitHub repository: Embody
2026-08-30 22:30:10,249 - GitHubScraper - INFO - Added new GitHub repository: nodeterm
2026-08-30 22:30:10,273 - GitHubScraper - INFO - Added new GitHub repository: MCP-Packet-Tracer
2026-08-30 22:30:11,033 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 200 OK"
2026-08-30 22:30:11,252 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22prime+agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-08-30 22:30:11,256 - GitHubScraper - INFO - Found 36 GitHub repositories for term: "prime agent"
2026-08-30 22:30:12,233 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-08-30 22:30:12,236 - GitHubScraper - INFO - Found 255 GitHub repositories for term: paperclip
2026-08-30 22:30:12,385 - GitHubScraper - INFO - Total GitHub results found: 4
2026-08-30 22:30:14,868 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"
2026-08-30 22:30:15,263 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-30 22:30:15,295 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:15,317 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:15,323 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:15,639 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:15,663 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:15,685 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:15,792 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yitzih97/torahtale/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-30 22:30:15,994 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:16,107 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:16,168 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/tatyesod/talmud-tora-web/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-30 22:30:16,309 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:16,338 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:16,484 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:16,497 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:16,636 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:16,646 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:16,874 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:17,009 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:17,027 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/sikmenedowai-a11y/savetube-stream-kit/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-30 22:30:17,106 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-30 22:30:17,223 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:17,347 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:17,441 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-30 22:30:17,510 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:17,562 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:17,702 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:17,829 - YouTubeIntelScraper - INFO - YouTube Intel found 45 candidates and 8 new videos
2026-08-30 22:30:17,838 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:17,910 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:17,994 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:18,165 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:18,168 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:18,236 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:18,511 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:18,588 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:18,622 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:18,769 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:18,799 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:19,090 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:19,105 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:19,112 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:19,318 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:19,537 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:19,634 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:19,641 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:19,666 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:19,921 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-30 22:30:19,998 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:20,036 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:20,134 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:20,256 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:20,389 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:20,448 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:20,512 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:20,627 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:20,788 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:20,849 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-30 22:30:20,913 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:21,121 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:21,234 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:21,331 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:21,414 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:21,567 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:21,600 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:21,691 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:21,706 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:21,876 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:21,878 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:22,024 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:22,061 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:22,185 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:22,194 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:22,424 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:22,465 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:22,483 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:22,579 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:22,759 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:22,797 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:22,801 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:23,018 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yeled-tov/filtertube-android/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:23,077 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:23,088 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:23,122 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:23,408 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:23,422 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-tfilah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:23,473 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:23,509 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:23,695 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:23,740 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/ShireiShabbat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:23,794 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:23,803 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:24,033 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:24,081 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:24,102 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:24,128 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:24,372 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:24,408 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:24,462 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:24,516 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:24,639 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akshatasatmar/WeatherServiceApi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-30 22:30:24,704 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=249 account_new=0 list_repos=100 list_new=0 private_new=0 total_new=0
2026-08-30 22:30:24,705 - __main__ - INFO - Scraper reddit completed: 2 results
2026-08-30 22:30:24,705 - __main__ - INFO - Scraper github completed: 4 results
2026-08-30 22:30:24,705 - __main__ - INFO - Scraper github_feed completed: 0 results
2026-08-30 22:30:24,705 - __main__ - INFO - Scraper youtube_intel completed: 8 results
2026-08-30 22:30:25,360 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-08-30 22:30:25.360123
2026-08-30 22:30:25,360 - __main__ - INFO - Email sent successfully
2026-08-30 22:30:25,360 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-08-30 22:30:25,360 - __main__ - INFO - Monitor complete. Found 14 total results: 2 new reddit results, 4 new github results, 8 new youtube intel results.
2026-08-30 22:30:25,360 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-08-30 22:30:25,360 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-30 22:30:25,465 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-08-30 22:30:25,465 - __main__ - INFO - Closed all database connections
2026-08-30 22:30:25,468 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-30 22:30:25,469 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-08-30 23:00:01,926 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-08-30.log
2026-08-30 23:00:01,927 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-08-30.log
2026-08-30 23:00:01,927 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-08-30.log
2026-08-30 23:00:01,927 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-08-30 23:00:01,952 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-08-30 23:00:01,952 - __main__ - INFO - Configuration loaded and validated successfully
2026-08-30 23:00:01,955 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-08-30 23:00:01,955 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-08-30 23:00:01,973 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-08-30 23:00:01,973 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-08-30 23:00:01,975 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='linux:SocialMediaMonitor:1.0 (by /u/abeperl)')
2026-08-30 23:00:01,976 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-08-30 23:00:01,976 - __main__ - INFO - RSS scraper initialized and enabled
2026-08-30 23:00:01,979 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-08-30 23:00:01,979 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-08-30 23:00:01,979 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-08-30 23:00:01,982 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-08-30 23:00:01,986 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-08-30 23:00:01,986 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-08-30 23:00:01,988 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-08-30 23:00:01,988 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-08-30 23:00:01,989 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-08-30 23:00:01,991 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-08-30 23:00:01,991 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-08-30 23:00:01,991 - __main__ - INFO - Running 3 scrapers concurrently...
2026-08-30 23:00:01,991 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-08-30 23:00:02,084 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-08-30 23:00:02,089 - IveltScraper - INFO - Loaded 181 include, 4 exclude filters from DB topic_filters
2026-08-30 23:00:02,089 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-08-30 23:00:02,090 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-08-30 23:00:02,340 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-08-30 23:00:05,621 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-08-30 23:00:05,833 - Yiddish24Scraper - INFO - Received response with 478634 characters
2026-08-30 23:00:05,836 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (310992 chars)
2026-08-30 23:00:05,839 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-08-30 23:00:05,924 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-08-30 23:00:05,963 - Yiddish24Scraper - INFO - Page 1 extraction: 99 successful, 1 failed out of 100 elements
2026-08-30 23:00:05,964 - Yiddish24Scraper - INFO - Parsed 99 articles from HTML on page 1
2026-08-30 23:00:06,870 - Yiddish24Scraper - INFO - Page 1 summary: 4 new out of 99 total articles
2026-08-30 23:00:06,870 - Yiddish24Scraper - INFO - Page 1: 4/99 new items
2026-08-30 23:00:06,870 - Yiddish24Scraper - INFO - Low new item ratio (4.0%), stopping pagination
2026-08-30 23:00:06,871 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 4
2026-08-30 23:00:14,348 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-08-30 23:00:18,466 - IveltScraper - INFO - Filtering post containing exclude term: '*ื‘ื™ื˜ืข ืžืื›ื˜ ื–ื™ื›ืขืจ ื‘ืœื•ื™ื– ืฆื• ื‘ืืจื™ื›ื˜ืŸ ืงืจืื ื˜ืข ื ื™ื™ืขืก*'
2026-08-30 23:00:33,441 - IveltScraper - INFO - ivelt scrape complete. Checked 4 topics.
2026-08-30 23:00:33,441 - IveltScraper - INFO - All forums scrape complete. Found 21 new posts.
2026-08-30 23:00:33,441 - __main__ - INFO - Scraper rss completed: 0 results
2026-08-30 23:00:33,441 - __main__ - INFO - Scraper yiddish24 completed: 4 results
2026-08-30 23:00:33,441 - __main__ - INFO - Scraper ivelt completed: 21 results
2026-08-30 23:00:34,153 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-08-30 23:00:34.153489
2026-08-30 23:00:34,153 - __main__ - INFO - Email sent successfully
2026-08-30 23:00:34,154 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-08-30 23:00:34,154 - __main__ - INFO - Monitor complete. Found 25 total results: 4 new yiddish24 results, 21 new ivelt results.
2026-08-30 23:00:34,154 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-08-30 23:00:34,154 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-30 23:00:34,247 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-08-30 23:00:34,248 - __main__ - INFO - Closed all database connections
2026-08-30 23:00:34,250 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-30 23:00:34,250 - social_media_monitor.database.connection - INFO - Closed 0 database connections