โ Logs
social_media_monitor_2026-09-16.log
2026-09-16 20:30:05,242 - GitHubScraper - INFO - Added new GitHub repository: mac_messages_mcp
2026-09-16 20:30:05,312 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"
2026-09-16 20:30:06,108 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22prime+agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-16 20:30:06,112 - GitHubScraper - INFO - Found 41 GitHub repositories for term: "prime agent"
2026-09-16 20:30:06,405 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 200 OK"
2026-09-16 20:30:07,226 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-16 20:30:07,232 - GitHubScraper - INFO - Found 261 GitHub repositories for term: paperclip
2026-09-16 20:30:07,391 - GitHubScraper - INFO - Total GitHub results found: 6
2026-09-16 20:30:10,527 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"
2026-09-16 20:30:10,873 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:10,919 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:10,935 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:11,008 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:11,290 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:11,310 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:11,331 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:11,344 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:11,636 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:11,670 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:11,688 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:11,689 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:11,991 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:12,050 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:12,090 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:12,197 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:12,433 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/sikmenedowai-a11y/savetube-stream-kit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:12,456 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:12,536 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-16 20:30:12,589 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:12,823 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:12,885 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:12,900 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:12,933 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:13,142 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:13,327 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:13,332 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:13,546 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:13,620 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:13,635 - YouTubeIntelScraper - INFO - YouTube Intel found 41 candidates and 10 new videos
2026-09-16 20:30:13,636 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:13,721 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:13,922 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:14,052 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:14,122 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:14,168 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:14,209 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:14,596 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:14,645 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:14,712 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:14,791 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:15,043 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:15,166 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:15,169 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:15,221 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-16 20:30:15,420 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:15,577 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:15,580 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-16 20:30:15,614 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:15,778 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:15,925 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:15,933 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:16,061 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:16,285 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:16,394 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:16,445 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:16,803 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:16,996 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:16,997 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:17,223 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:17,250 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-16 20:30:17,378 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:17,514 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:17,613 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:17,636 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:17,806 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:17,884 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:17,906 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:18,103 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:18,218 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:18,276 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:18,452 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:18,502 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:18,602 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:18,697 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:18,904 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:18,918 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:18,939 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:19,232 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:19,318 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yeled-tov/filtertube-android/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-16 20:30:19,336 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:19,339 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:19,539 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:19,705 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:19,738 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:19,795 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-tfilah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:19,826 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:20,050 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:20,184 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:20,213 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:20,381 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:20,497 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:20,539 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:20,754 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:20,879 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:20,883 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:21,073 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akshatasatmar/WeatherServiceApi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:21,123 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:21,210 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elchunenfreund/satmar-matzos-app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:21,246 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmaribianca05-eng/AFSD-Satmari-Bianca/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:21,489 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/Sefaria-Export/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 20:30:21,546 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=300 account_new=0 list_repos=100 list_new=2 private_new=0 total_new=2
2026-09-16 20:30:21,547 - __main__ - INFO - Scraper github completed: 6 results
2026-09-16 20:30:21,547 - __main__ - INFO - Scraper github_feed completed: 2 results
2026-09-16 20:30:21,547 - __main__ - INFO - Scraper youtube_intel completed: 10 results
2026-09-16 20:30:22,302 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-16 20:30:22.302136
2026-09-16 20:30:22,302 - __main__ - INFO - Email sent successfully
2026-09-16 20:30:22,321 - __main__ - INFO - GitHub feed delivery acknowledged: 2 stored, 0 failed
2026-09-16 20:30:22,321 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-16 20:30:22,321 - __main__ - INFO - Monitor complete. Found 18 total results: 6 new github results, 2 new github feed results, 10 new youtube intel results.
2026-09-16 20:30:22,321 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-16 20:30:22,321 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-16 20:30:22,357 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-16 20:30:22,357 - __main__ - INFO - Closed all database connections
2026-09-16 20:30:22,359 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-16 20:30:22,359 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-16 21:00:02,614 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-16.log
2026-09-16 21:00:02,614 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-16.log
2026-09-16 21:00:02,614 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-16.log
2026-09-16 21:00:02,614 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-16 21:00:02,643 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-16 21:00:02,643 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-16 21:00:02,645 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-16 21:00:02,646 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-16 21:00:02,666 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-16 21:00:02,667 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-16 21:00:02,724 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-16 21:00:02,726 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-16 21:00:02,726 - __main__ - INFO - RSS scraper initialized and enabled
2026-09-16 21:00:02,734 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-16 21:00:02,735 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-16 21:00:02,735 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-09-16 21:00:02,739 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-16 21:00:02,745 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-16 21:00:02,745 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-16 21:00:02,748 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-16 21:00:02,748 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-16 21:00:02,748 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-16 21:00:02,750 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-16 21:00:02,750 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-09-16 21:00:02,751 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-16 21:00:02,751 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-09-16 21:00:02,841 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-09-16 21:00:02,845 - IveltScraper - INFO - Loaded 181 include, 4 exclude filters from DB topic_filters
2026-09-16 21:00:02,845 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-09-16 21:00:02,847 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-09-16 21:00:03,211 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-09-16 21:00:05,936 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-09-16 21:00:06,162 - Yiddish24Scraper - INFO - Received response with 476639 characters
2026-09-16 21:00:06,164 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (308424 chars)
2026-09-16 21:00:06,167 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-09-16 21:00:06,248 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-09-16 21:00:06,307 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-09-16 21:00:06,307 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-09-16 21:00:06,314 - Yiddish24Scraper - INFO - Term 'ืขื ืื ืื ืฉืื ืื' matched in DESCRIPTION: 'ืขื ืื ืื ืฉืื ืื - ืืชืจืืืื ืืขืืืฉื ืืื ืื ืืขืจืข ืคืจืืื'
2026-09-16 21:00:06,314 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ืืื ืืื
2026-09-16 21:00:06,815 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/_Estrogen__Gordon_260_260916033306.mp3
2026-09-16 21:00:09,186 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2__Estrogen__Gordon_260_260916033306.mp3 (58.3 MB)
2026-09-16 21:00:09,186 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-09-16 21:00:09,206 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2__Estrogen__Gordon_260_260916033306.mp3: title, artist, album, comment, source_url, genre, publisher
2026-09-16 21:00:09,207 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2__Estrogen__Gordon_260_260916033306_ืขื ืื ืื_ืฉืื ืื.mp3
2026-09-16 21:00:09,289 - Yiddish24Scraper - INFO - Term 'ืฉืืื' matched in TITLE: 'ืืื"ืฆ ืจ' ืืืืืื ืืืืขืจืืื ืฉืืื"ื'
2026-09-16 21:00:09,289 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ืืื"ืฆ ืจ' ืืืืืื ืืืืขืจืืื ืฉืืื"ื
2026-09-16 21:00:09,789 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/____140_1789589022720_965_0_260916041519__783135531.mp3
2026-09-16 21:00:14,112 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_____140_1789589022720_965_0_260916041519__783135531.mp3 (121.7 MB)
2026-09-16 21:00:14,113 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-09-16 21:00:14,163 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_____140_1789589022720_965_0_260916041519__783135531.mp3: title, artist, album, comment, source_url, genre, publisher
2026-09-16 21:00:14,164 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2_____140_1789589022720_965_0_260916041519__783135531_ืฉืืื.mp3
2026-09-16 21:00:14,179 - Yiddish24Scraper - INFO - Term 'ืฆืื ืคืื ืื -' matched in DESCRIPTION: 'ืฆืื ืคืื ืื - ืืืืก ื ืื ืงืขื ืขื ืืืจ ืืื ืืขืจื ืขื ืคืื ืื ืืืืื ืืืื ืคืจืขืืืืขื ื'
2026-09-16 21:00:14,180 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ืืื ืืื
2026-09-16 21:00:14,680 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/Brayer_D_260_260916031047.mp3
2026-09-16 21:00:15,731 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_Brayer_D_260_260916031047.mp3 (5.7 MB)
2026-09-16 21:00:15,731 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-09-16 21:00:15,736 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_Brayer_D_260_260916031047.mp3: title, artist, album, comment, source_url, genre, publisher
2026-09-16 21:00:15,736 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2_Brayer_D_260_260916031047_ืฆืื_ืคืื ืื_-.mp3
2026-09-16 21:00:16,837 - Yiddish24Scraper - INFO - Page 1 summary: 12 new out of 100 total articles
2026-09-16 21:00:16,838 - Yiddish24Scraper - INFO - Page 1: 12/100 new items
2026-09-16 21:00:16,838 - Yiddish24Scraper - INFO - Low new item ratio (12.0%), stopping pagination
2026-09-16 21:00:16,838 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 12
2026-09-16 21:02:09,419 - IveltScraper - INFO - FlareSolverr error: Error: Error solving the challenge. Timeout after 120.0 seconds. (attempt 1)
2026-09-16 21:02:09,420 - IveltScraper - INFO - Retrying in 3s...
2026-09-16 21:04:13,109 - IveltScraper - ERROR - FlareSolverr error: Error: Error solving the challenge. Timeout after 120.0 seconds. (attempt 2)
2026-09-16 21:04:13,110 - IveltScraper - INFO - FlareSolverr failed, trying curl_cffi cookie fallback...
2026-09-16 21:04:13,110 - IveltScraper - WARNING - No cf_clearance cookie set โ skipping curl_cffi fallback
2026-09-16 21:04:13,110 - IveltScraper - ERROR - Failed to fetch ivelt active topics page
2026-09-16 21:04:13,111 - IveltScraper - INFO - All forums scrape complete. Found 0 new posts.
2026-09-16 21:04:13,111 - __main__ - INFO - Scraper rss completed: 0 results
2026-09-16 21:04:13,111 - __main__ - INFO - Scraper yiddish24 completed: 12 results
2026-09-16 21:04:13,111 - __main__ - INFO - Scraper ivelt completed: 0 results
2026-09-16 21:04:13,806 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-16 21:04:13.806302
2026-09-16 21:04:13,806 - __main__ - INFO - Email sent successfully
2026-09-16 21:04:13,806 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-16 21:04:13,807 - __main__ - INFO - Monitor complete. Found 12 total results: 12 new yiddish24 results.
2026-09-16 21:04:13,807 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-16 21:04:13,807 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-16 21:04:13,873 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-16 21:04:13,874 - __main__ - INFO - Closed all database connections
2026-09-16 21:04:13,876 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-16 21:04:13,876 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-16 22:00:01,873 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-16.log
2026-09-16 22:00:01,874 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-16.log
2026-09-16 22:00:01,874 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-16.log
2026-09-16 22:00:01,874 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-16 22:00:01,902 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-16 22:00:01,903 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-16 22:00:01,905 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-16 22:00:01,905 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-16 22:00:01,919 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-16 22:00:01,919 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-16 22:00:01,925 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-16 22:00:01,928 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-16 22:00:01,928 - __main__ - INFO - RSS scraper initialized and enabled
2026-09-16 22:00:01,935 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-16 22:00:01,935 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-16 22:00:01,936 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-09-16 22:00:01,942 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-16 22:00:01,949 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-16 22:00:01,949 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-16 22:00:01,952 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-16 22:00:01,952 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-16 22:00:01,952 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-16 22:00:01,954 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-16 22:00:01,954 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-09-16 22:00:01,955 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-16 22:00:01,955 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-09-16 22:00:02,052 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-09-16 22:00:02,058 - IveltScraper - INFO - Loaded 181 include, 4 exclude filters from DB topic_filters
2026-09-16 22:00:02,058 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-09-16 22:00:02,060 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-09-16 22:00:02,401 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-09-16 22:00:04,480 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-09-16 22:00:04,704 - Yiddish24Scraper - INFO - Received response with 477012 characters
2026-09-16 22:00:04,706 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (308504 chars)
2026-09-16 22:00:04,708 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-09-16 22:00:04,787 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-09-16 22:00:04,827 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-09-16 22:00:04,827 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-09-16 22:00:06,118 - Yiddish24Scraper - INFO - Page 1 summary: 1 new out of 100 total articles
2026-09-16 22:00:06,118 - Yiddish24Scraper - INFO - Page 1: 1/100 new items
2026-09-16 22:00:06,118 - Yiddish24Scraper - INFO - Low new item ratio (1.0%), stopping pagination
2026-09-16 22:00:06,119 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 1
2026-09-16 22:00:13,912 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-09-16 22:00:20,549 - IveltScraper - INFO - Filtering post containing exclude term: '*ืืืืข ืืืื ืืืืขืจ ืืืืื ืฆื ืืืจืืืื ืงืจืื ืืข ื ืืืขืก*'
2026-09-16 22:00:35,130 - IveltScraper - INFO - ivelt scrape complete. Checked 5 topics.
2026-09-16 22:00:35,130 - IveltScraper - INFO - All forums scrape complete. Found 18 new posts.
2026-09-16 22:00:35,130 - __main__ - INFO - Scraper rss completed: 0 results
2026-09-16 22:00:35,130 - __main__ - INFO - Scraper yiddish24 completed: 1 results
2026-09-16 22:00:35,130 - __main__ - INFO - Scraper ivelt completed: 18 results
2026-09-16 22:00:35,881 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-16 22:00:35.881103
2026-09-16 22:00:35,881 - __main__ - INFO - Email sent successfully
2026-09-16 22:00:35,881 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-16 22:00:35,881 - __main__ - INFO - Monitor complete. Found 19 total results: 1 new yiddish24 results, 18 new ivelt results.
2026-09-16 22:00:35,881 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-16 22:00:35,881 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-16 22:00:35,984 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-16 22:00:35,985 - __main__ - INFO - Closed all database connections
2026-09-16 22:00:35,987 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-16 22:00:35,987 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-16 22:30:02,407 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-16.log
2026-09-16 22:30:02,407 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-16.log
2026-09-16 22:30:02,407 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-16.log
2026-09-16 22:30:02,407 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-16 22:30:02,437 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-16 22:30:02,437 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-16 22:30:02,439 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-16 22:30:02,440 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-16 22:30:02,453 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-16 22:30:02,453 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-16 22:30:02,511 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-16 22:30:02,512 - __main__ - INFO - GitHub scraper initialized and enabled
2026-09-16 22:30:02,513 - __main__ - INFO - GitHub feed scraper initialized and enabled
2026-09-16 22:30:02,513 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-16 22:30:02,519 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-16 22:30:02,520 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-16 22:30:02,524 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-16 22:30:02,531 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-16 22:30:02,531 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-16 22:30:02,533 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-16 22:30:02,533 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-16 22:30:02,533 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-16 22:30:02,536 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-16 22:30:02,536 - __main__ - INFO - YouTube Intel scraper initialized and enabled
2026-09-16 22:30:02,536 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-16 22:30:02,536 - GitHubScraper - INFO - Searching GitHub for terms: ['"Hermes Agent"', '"claude code"', '"prime agent"', 'paperclip']
2026-09-16 22:30:02,941 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"
2026-09-16 22:30:02,942 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)
2026-09-16 22:30:03,621 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-16 22:30:03,648 - GitHubScraper - INFO - Found 618 GitHub repositories for term: "Hermes Agent"
2026-09-16 22:30:03,716 - GitHubScraper - INFO - Added new GitHub repository: caliper
2026-09-16 22:30:04,224 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"
2026-09-16 22:30:04,849 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22claude+code%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-16 22:30:04,937 - GitHubScraper - INFO - Found 8810 GitHub repositories for term: "claude code"
2026-09-16 22:30:04,945 - GitHubScraper - INFO - Added new GitHub repository: langserver
2026-09-16 22:30:04,965 - GitHubScraper - INFO - Added new GitHub repository: ai-sdlc
2026-09-16 22:30:04,978 - GitHubScraper - INFO - Added new GitHub repository: Cecil
2026-09-16 22:30:04,997 - GitHubScraper - INFO - Added new GitHub repository: dsh-memory
2026-09-16 22:30:05,113 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"
2026-09-16 22:30:06,036 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 200 OK"
2026-09-16 22:30:06,056 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22prime+agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-16 22:30:06,059 - GitHubScraper - INFO - Found 41 GitHub repositories for term: "prime agent"
2026-09-16 22:30:07,116 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-16 22:30:07,211 - GitHubScraper - INFO - Found 260 GitHub repositories for term: paperclip
2026-09-16 22:30:07,346 - GitHubScraper - INFO - Total GitHub results found: 5
2026-09-16 22:30:09,553 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"
2026-09-16 22:30:09,951 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:09,967 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:09,979 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:10,027 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:10,279 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:10,373 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:10,377 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:10,390 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:10,668 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:10,762 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:10,767 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:10,791 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:10,963 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:11,053 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:11,078 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:11,250 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:11,366 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:11,532 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/sikmenedowai-a11y/savetube-stream-kit/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-16 22:30:11,537 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:11,602 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-16 22:30:11,860 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:11,930 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:11,947 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:11,985 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:12,240 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:12,451 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:12,500 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-16 22:30:12,621 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:12,752 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:12,863 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:12,865 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:12,918 - YouTubeIntelScraper - INFO - YouTube Intel found 41 candidates and 9 new videos
2026-09-16 22:30:13,163 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:13,186 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:13,216 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:13,314 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:13,472 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:13,762 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:13,764 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:13,768 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:13,901 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:14,160 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:14,235 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-16 22:30:14,308 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-16 22:30:14,313 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:14,579 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:14,634 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:14,701 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:14,769 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:14,863 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:14,998 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:15,080 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:15,113 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:15,236 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:15,367 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:15,425 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:15,471 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:15,610 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:15,955 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:15,983 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:16,208 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:16,224 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:16,331 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:16,390 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:16,538 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:16,588 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:16,601 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:16,753 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:16,862 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:16,963 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:17,041 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:17,043 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:17,306 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:17,345 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:17,431 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:17,454 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:17,675 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:17,743 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:17,813 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:18,015 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:18,100 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:18,131 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yeled-tov/filtertube-android/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-16 22:30:18,265 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:18,291 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:18,516 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-tfilah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:18,569 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:18,629 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:18,670 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:18,867 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:18,892 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:18,912 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:19,140 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:19,266 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:19,269 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:19,294 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:19,494 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:19,530 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akshatasatmar/WeatherServiceApi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:19,594 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:19,634 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elchunenfreund/satmar-matzos-app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:19,831 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmaribianca05-eng/AFSD-Satmari-Bianca/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:19,985 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/Sefaria-Export/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-16 22:30:20,065 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=300 account_new=0 list_repos=100 list_new=0 private_new=0 total_new=0
2026-09-16 22:30:20,066 - __main__ - INFO - Scraper github completed: 5 results
2026-09-16 22:30:20,067 - __main__ - INFO - Scraper github_feed completed: 0 results
2026-09-16 22:30:20,067 - __main__ - INFO - Scraper youtube_intel completed: 9 results
2026-09-16 22:30:20,751 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-16 22:30:20.751804
2026-09-16 22:30:20,752 - __main__ - INFO - Email sent successfully
2026-09-16 22:30:20,752 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-16 22:30:20,752 - __main__ - INFO - Monitor complete. Found 14 total results: 5 new github results, 9 new youtube intel results.
2026-09-16 22:30:20,752 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-16 22:30:20,752 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-16 22:30:20,786 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-16 22:30:20,786 - __main__ - INFO - Closed all database connections
2026-09-16 22:30:20,788 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-16 22:30:20,788 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-16 23:00:02,097 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-16.log
2026-09-16 23:00:02,097 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-16.log
2026-09-16 23:00:02,098 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-16.log
2026-09-16 23:00:02,098 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-16 23:00:02,128 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-16 23:00:02,128 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-16 23:00:02,130 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-16 23:00:02,131 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-16 23:00:02,146 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-16 23:00:02,146 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-16 23:00:02,150 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-16 23:00:02,152 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-16 23:00:02,152 - __main__ - INFO - RSS scraper initialized and enabled
2026-09-16 23:00:02,157 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-16 23:00:02,157 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-16 23:00:02,157 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-09-16 23:00:02,163 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-16 23:00:02,169 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-16 23:00:02,169 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-16 23:00:02,172 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-16 23:00:02,172 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-16 23:00:02,172 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-16 23:00:02,174 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-16 23:00:02,174 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-09-16 23:00:02,174 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-16 23:00:02,175 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-09-16 23:00:02,264 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-09-16 23:00:02,268 - IveltScraper - INFO - Loaded 181 include, 4 exclude filters from DB topic_filters
2026-09-16 23:00:02,268 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-09-16 23:00:02,271 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-09-16 23:00:02,642 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-09-16 23:00:04,881 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-09-16 23:00:05,109 - Yiddish24Scraper - INFO - Received response with 480996 characters
2026-09-16 23:00:05,112 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (309247 chars)
2026-09-16 23:00:05,115 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-09-16 23:00:05,209 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-09-16 23:00:05,250 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-09-16 23:00:05,250 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-09-16 23:00:05,267 - Yiddish24Scraper - INFO - Term 'ืงืืจืฅ ืืื ืฉืืจืฃ -' matched in DESCRIPTION: 'ืงืืจืฅ ืืื ืฉืืจืฃ - ืก'ืืื ื ืืฉื ืืขืจ ืืขื ืืฉ'
2026-09-16 23:00:05,267 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ืืื ืืื
2026-09-16 23:00:05,767 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/__________________________________1760832_304429986.mp3
2026-09-16 23:00:06,890 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2___________________________________1760832_304429986.mp3 (7.9 MB)
2026-09-16 23:00:06,890 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-09-16 23:00:06,900 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2___________________________________1760832_304429986.mp3: title, artist, album, comment, source_url, genre, publisher
2026-09-16 23:00:06,900 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2___________________________________1760832_304429986_ืงืืจืฅ_ืืื_ืฉืืจืฃ_-.mp3
2026-09-16 23:00:06,909 - Yiddish24Scraper - INFO - Term 'ืขืจืฉืืืื ืืื' matched in DESCRIPTION: 'ืขืจืฉืืืื ืืื - ืืืืืืื ืื ืืืงืื ืืข ืฉืืขืืจ ืืื ืฆืืฉืืื ื ืืขืงืืืขื'
2026-09-16 23:00:06,909 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ืืื ืืื
2026-09-16 23:00:07,409 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/Reb_Yoely_Lebovits__whatapod_EP__16_d_260_945445502.mp3
2026-09-16 23:00:08,975 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_Reb_Yoely_Lebovits__whatapod_EP__16_d_260_945445502.mp3 (26.2 MB)
2026-09-16 23:00:08,975 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-09-16 23:00:08,992 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_Reb_Yoely_Lebovits__whatapod_EP__16_d_260_945445502.mp3: title, artist, album, comment, source_url, genre, publisher
2026-09-16 23:00:08,992 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2_Reb_Yoely_Lebovits__whatapod_EP__16_d_260_945445502_ืขืจืฉืืืื ืืื.mp3
2026-09-16 23:00:09,931 - Yiddish24Scraper - INFO - Page 1 summary: 3 new out of 100 total articles
2026-09-16 23:00:09,932 - Yiddish24Scraper - INFO - Page 1: 3/100 new items
2026-09-16 23:00:09,932 - Yiddish24Scraper - INFO - Low new item ratio (3.0%), stopping pagination
2026-09-16 23:00:09,932 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 3
2026-09-16 23:00:14,642 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-09-16 23:00:39,719 - IveltScraper - INFO - ivelt scrape complete. Checked 5 topics.
2026-09-16 23:00:39,719 - IveltScraper - INFO - All forums scrape complete. Found 16 new posts.
2026-09-16 23:00:39,719 - __main__ - INFO - Scraper rss completed: 0 results
2026-09-16 23:00:39,719 - __main__ - INFO - Scraper yiddish24 completed: 3 results
2026-09-16 23:00:39,719 - __main__ - INFO - Scraper ivelt completed: 16 results
2026-09-16 23:00:40,381 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-16 23:00:40.381538
2026-09-16 23:00:40,381 - __main__ - INFO - Email sent successfully
2026-09-16 23:00:40,382 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-16 23:00:40,382 - __main__ - INFO - Monitor complete. Found 19 total results: 3 new yiddish24 results, 16 new ivelt results.
2026-09-16 23:00:40,382 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-16 23:00:40,382 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-16 23:00:40,499 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-16 23:00:40,500 - __main__ - INFO - Closed all database connections
2026-09-16 23:00:40,502 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-16 23:00:40,502 - social_media_monitor.database.connection - INFO - Closed 0 database connections
Live tail active โ waiting for new lines...