โ† Logs

social_media_monitor_2026-09-24.log

2026-09-24 20:30:02,565 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-24 20:30:02,565 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-24 20:30:02,565 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-24 20:30:02,567 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-24 20:30:02,568 - __main__ - INFO - YouTube Intel scraper initialized and enabled
2026-09-24 20:30:02,568 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-24 20:30:02,568 - GitHubScraper - INFO - Searching GitHub for terms: ['"Hermes Agent"', '"grok bot OR grokbot"', '"muse NOT music NOT museum"', '"prime agent"', 'paperclip']
2026-09-24 20:30:03,002 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"
2026-09-24 20:30:03,003 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)
2026-09-24 20:30:03,627 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-24 20:30:03,723 - GitHubScraper - INFO - Found 641 GitHub repositories for term: "Hermes Agent"
2026-09-24 20:30:03,931 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"
2026-09-24 20:30:04,241 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22grok+bot+OR+grokbot%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-24 20:30:04,241 - GitHubScraper - INFO - Found 0 GitHub repositories for term: "grok bot OR grokbot"
2026-09-24 20:30:05,019 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"
2026-09-24 20:30:05,247 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22muse+NOT+music+NOT+museum%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-24 20:30:05,248 - GitHubScraper - INFO - Found 0 GitHub repositories for term: "muse NOT music NOT museum"
2026-09-24 20:30:06,347 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:06,348 - GitHubFeedScraper - INFO - GitHub account feed page 3 unchanged (ETag)
2026-09-24 20:30:06,713 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22prime+agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-24 20:30:06,715 - GitHubScraper - INFO - Found 41 GitHub repositories for term: "prime agent"
2026-09-24 20:30:07,863 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-24 20:30:07,866 - GitHubScraper - INFO - Found 261 GitHub repositories for term: paperclip
2026-09-24 20:30:08,014 - GitHubScraper - INFO - Total GitHub results found: 0
2026-09-24 20:30:09,530 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"
2026-09-24 20:30:09,953 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-24 20:30:09,963 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:10,020 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:10,186 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:10,325 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:10,366 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:10,400 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:10,569 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:10,696 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:10,770 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:10,792 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:10,968 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:10,992 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:11,183 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:11,255 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:11,491 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:11,503 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/sikmenedowai-a11y/savetube-stream-kit/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-24 20:30:11,618 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:11,784 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:11,849 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-24 20:30:11,879 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:12,066 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:12,144 - YouTubeIntelScraper - INFO - YouTube Intel found 30 candidates and 8 new videos
2026-09-24 20:30:12,154 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:12,206 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:12,334 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:12,625 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:12,690 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:12,791 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:12,929 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:12,975 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:13,034 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:13,327 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:13,347 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:13,379 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:13,456 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-24 20:30:13,666 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:13,805 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:13,846 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:13,880 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:14,018 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:14,260 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:14,338 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:14,358 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:14,403 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:14,704 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:14,781 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:14,808 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:15,042 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:15,050 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:15,199 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:15,270 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:15,378 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:15,433 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:15,611 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:15,651 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:15,668 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:15,889 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:16,106 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-24 20:30:16,308 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-24 20:30:16,320 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:16,365 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:16,497 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:16,651 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:16,724 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:16,749 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:16,788 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:16,967 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:17,120 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:17,161 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:17,201 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:17,273 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:17,466 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:17,538 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:17,550 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:17,712 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:17,820 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:17,933 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:17,937 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:18,092 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:18,240 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:18,312 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:18,357 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-24 20:30:18,559 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:18,582 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-tfilah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:18,620 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:18,737 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:18,905 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:18,924 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:19,029 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:19,110 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:19,266 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:19,311 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:19,439 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:19,482 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:19,630 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:19,660 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akshatasatmar/WeatherServiceApi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:19,730 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elchunenfreund/satmar-matzos-app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:19,886 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmaribianca05-eng/AFSD-Satmari-Bianca/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:20,130 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/Sefaria-Export/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:20,262 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-es6/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 20:30:20,312 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=200 account_new=0 list_repos=100 list_new=0 private_new=0 total_new=0
2026-09-24 20:30:20,313 - __main__ - INFO - Scraper github completed: 0 results
2026-09-24 20:30:20,313 - __main__ - INFO - Scraper github_feed completed: 0 results
2026-09-24 20:30:20,313 - __main__ - INFO - Scraper youtube_intel completed: 8 results
2026-09-24 20:30:21,054 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-24 20:30:21.054439
2026-09-24 20:30:21,054 - __main__ - INFO - Email sent successfully
2026-09-24 20:30:21,055 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-24 20:30:21,055 - __main__ - INFO - Monitor complete. Found 8 total results: 8 new youtube intel results.
2026-09-24 20:30:21,055 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-24 20:30:21,055 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-24 20:30:21,085 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-24 20:30:21,085 - __main__ - INFO - Closed all database connections
2026-09-24 20:30:21,087 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-24 20:30:21,087 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-24 21:00:02,044 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-24.log
2026-09-24 21:00:02,045 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-24.log
2026-09-24 21:00:02,045 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-24.log
2026-09-24 21:00:02,045 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-24 21:00:02,076 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-24 21:00:02,076 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-24 21:00:02,078 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-24 21:00:02,079 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-24 21:00:02,093 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-24 21:00:02,094 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-24 21:00:02,156 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-24 21:00:02,158 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-24 21:00:02,158 - __main__ - INFO - RSS scraper initialized and enabled
2026-09-24 21:00:02,165 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-24 21:00:02,165 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-24 21:00:02,165 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-09-24 21:00:02,170 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-24 21:00:02,174 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-24 21:00:02,175 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-24 21:00:02,177 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-24 21:00:02,177 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-24 21:00:02,177 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-24 21:00:02,180 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-24 21:00:02,180 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-09-24 21:00:02,180 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-24 21:00:02,180 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-09-24 21:00:02,268 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-09-24 21:00:02,272 - IveltScraper - INFO - Loaded 182 include, 4 exclude filters from DB topic_filters
2026-09-24 21:00:02,272 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-09-24 21:00:02,274 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-09-24 21:00:02,352 - social_media_monitor.database.connection - WARNING - Empty content or source provided to is_duplicate
2026-09-24 21:00:02,353 - social_media_monitor.database.connection - WARNING - Empty item_hash or source provided to store_sent_item
2026-09-24 21:00:02,512 - RSSFeedScraper - INFO - Total RSS/HTML results: 1
2026-09-24 21:00:03,972 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-09-24 21:00:04,203 - Yiddish24Scraper - INFO - Received response with 527043 characters
2026-09-24 21:00:04,206 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (327459 chars)
2026-09-24 21:00:04,209 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-09-24 21:00:04,290 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-09-24 21:00:04,333 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-09-24 21:00:04,334 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-09-24 21:00:04,420 - Yiddish24Scraper - INFO - Term 'ืžืขืฉื”' matched in TITLE: 'ืื•ืงืจื™ื™ื ื™ืฉืข ืžื™ืœื™ื˜ืขืจ ื•ื•ืขื˜ ืœืžืขืฉื” ืืจื™ื™ื ืฆื•ื•ื™ื ื’ืขืŸ ื“ืขื 49 ื™ืขืจื™ื’ืขืจ ืื™ื“ ืคื•ืŸ ื‘ื™ืชืจ-ืขื™ืœื™ืช ืืœืก ื ืžื™ืœื™ื˜ืขืจื™ืฉืขืจ ื“ืืงื˜ืขืจ ืื•ื™ืคืŸ ืคืจืื ื˜'
2026-09-24 21:00:04,421 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ืื•ืงืจื™ื™ื ื™ืฉืข ืžื™ืœื™ื˜ืขืจ ื•ื•ืขื˜ ืœืžืขืฉื” ืืจื™ื™ื ืฆื•ื•ื™ื ื’ืขืŸ ื“ืขื 49
2026-09-24 21:00:04,958 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/KM_N113_51_1790281563.mp3
2026-09-24 21:00:05,068 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_KM_N113_51_1790281563.mp3 (147.6 KB)
2026-09-24 21:00:05,095 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-09-24 21:00:05,101 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_KM_N113_51_1790281563.mp3: title, artist, album, comment, source_url, genre, publisher
2026-09-24 21:00:05,101 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2_KM_N113_51_1790281563_ืžืขืฉื”.mp3
2026-09-24 21:00:05,779 - Yiddish24Scraper - INFO - Page 1 summary: 8 new out of 100 total articles
2026-09-24 21:00:05,779 - Yiddish24Scraper - INFO - Page 1: 8/100 new items
2026-09-24 21:00:05,779 - Yiddish24Scraper - INFO - Low new item ratio (8.0%), stopping pagination
2026-09-24 21:00:05,780 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 8
2026-09-24 21:00:14,681 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-09-24 21:00:22,241 - IveltScraper - INFO - ivelt scrape complete. Checked 2 topics.
2026-09-24 21:00:22,241 - IveltScraper - INFO - All forums scrape complete. Found 5 new posts.
2026-09-24 21:00:22,242 - __main__ - INFO - Scraper rss completed: 1 results
2026-09-24 21:00:22,242 - __main__ - INFO - Scraper yiddish24 completed: 8 results
2026-09-24 21:00:22,242 - __main__ - INFO - Scraper ivelt completed: 5 results
2026-09-24 21:00:22,927 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-24 21:00:22.927694
2026-09-24 21:00:22,927 - __main__ - INFO - Email sent successfully
2026-09-24 21:00:22,928 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-24 21:00:22,928 - __main__ - INFO - Monitor complete. Found 14 total results: 1 new rss results, 8 new yiddish24 results, 5 new ivelt results.
2026-09-24 21:00:22,928 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-24 21:00:22,928 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-24 21:00:23,013 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-24 21:00:23,014 - __main__ - INFO - Closed all database connections
2026-09-24 21:00:23,015 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-24 21:00:23,015 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-24 22:00:01,904 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-24.log
2026-09-24 22:00:01,904 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-24.log
2026-09-24 22:00:01,904 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-24.log
2026-09-24 22:00:01,904 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-24 22:00:01,934 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-24 22:00:01,934 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-24 22:00:01,936 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-24 22:00:01,937 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-24 22:00:01,951 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-24 22:00:01,951 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-24 22:00:01,955 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-24 22:00:01,956 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-24 22:00:01,957 - __main__ - INFO - RSS scraper initialized and enabled
2026-09-24 22:00:01,961 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-24 22:00:01,961 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-24 22:00:01,961 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-09-24 22:00:01,965 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-24 22:00:01,972 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-24 22:00:01,972 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-24 22:00:01,975 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-24 22:00:01,975 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-24 22:00:01,975 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-24 22:00:01,978 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-24 22:00:01,978 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-09-24 22:00:01,978 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-24 22:00:01,978 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-09-24 22:00:02,078 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-09-24 22:00:02,083 - IveltScraper - INFO - Loaded 182 include, 4 exclude filters from DB topic_filters
2026-09-24 22:00:02,083 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-09-24 22:00:02,085 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-09-24 22:00:02,172 - social_media_monitor.database.connection - WARNING - Empty content or source provided to is_duplicate
2026-09-24 22:00:02,173 - social_media_monitor.database.connection - WARNING - Empty item_hash or source provided to store_sent_item
2026-09-24 22:00:02,331 - RSSFeedScraper - INFO - Total RSS/HTML results: 1
2026-09-24 22:00:04,747 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-09-24 22:00:04,963 - Yiddish24Scraper - INFO - Received response with 526485 characters
2026-09-24 22:00:04,967 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (326276 chars)
2026-09-24 22:00:04,970 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-09-24 22:00:05,048 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-09-24 22:00:05,097 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-09-24 22:00:05,097 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-09-24 22:00:05,872 - Yiddish24Scraper - INFO - Page 1 summary: 3 new out of 100 total articles
2026-09-24 22:00:05,872 - Yiddish24Scraper - INFO - Page 1: 3/100 new items
2026-09-24 22:00:05,872 - Yiddish24Scraper - INFO - Low new item ratio (3.0%), stopping pagination
2026-09-24 22:00:05,873 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 3
2026-09-24 22:00:14,646 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-09-24 22:00:34,835 - IveltScraper - INFO - ivelt scrape complete. Checked 5 topics.
2026-09-24 22:00:34,835 - IveltScraper - INFO - All forums scrape complete. Found 27 new posts.
2026-09-24 22:00:34,836 - __main__ - INFO - Scraper rss completed: 1 results
2026-09-24 22:00:34,836 - __main__ - INFO - Scraper yiddish24 completed: 3 results
2026-09-24 22:00:34,836 - __main__ - INFO - Scraper ivelt completed: 27 results
2026-09-24 22:00:36,414 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-24 22:00:36.414603
2026-09-24 22:00:36,414 - __main__ - INFO - Email sent successfully
2026-09-24 22:00:36,415 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-24 22:00:36,415 - __main__ - INFO - Monitor complete. Found 31 total results: 1 new rss results, 3 new yiddish24 results, 27 new ivelt results.
2026-09-24 22:00:36,415 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-24 22:00:36,415 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-24 22:00:36,777 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-24 22:00:36,777 - __main__ - INFO - Closed all database connections
2026-09-24 22:00:36,779 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-24 22:00:36,779 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-24 22:30:01,679 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-24.log
2026-09-24 22:30:01,680 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-24.log
2026-09-24 22:30:01,680 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-24.log
2026-09-24 22:30:01,680 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-24 22:30:01,708 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-24 22:30:01,708 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-24 22:30:01,711 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-24 22:30:01,711 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-24 22:30:01,732 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-24 22:30:01,733 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-24 22:30:01,788 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-24 22:30:01,789 - __main__ - INFO - GitHub scraper initialized and enabled
2026-09-24 22:30:01,789 - __main__ - INFO - GitHub feed scraper initialized and enabled
2026-09-24 22:30:01,790 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-24 22:30:01,797 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-24 22:30:01,797 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-24 22:30:01,802 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-24 22:30:01,810 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-24 22:30:01,810 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-24 22:30:01,812 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-24 22:30:01,812 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-24 22:30:01,812 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-24 22:30:01,814 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-24 22:30:01,815 - __main__ - INFO - YouTube Intel scraper initialized and enabled
2026-09-24 22:30:01,815 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-24 22:30:01,815 - GitHubScraper - INFO - Searching GitHub for terms: ['"Hermes Agent"', '"grok bot OR grokbot"', '"muse NOT music NOT museum"', '"prime agent"', 'paperclip']
2026-09-24 22:30:02,226 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"
2026-09-24 22:30:02,227 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)
2026-09-24 22:30:02,901 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-24 22:30:02,933 - GitHubScraper - INFO - Found 641 GitHub repositories for term: "Hermes Agent"
2026-09-24 22:30:03,267 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"
2026-09-24 22:30:03,559 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22grok+bot+OR+grokbot%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-24 22:30:03,560 - GitHubScraper - INFO - Found 0 GitHub repositories for term: "grok bot OR grokbot"
2026-09-24 22:30:04,319 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"
2026-09-24 22:30:04,655 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22muse+NOT+music+NOT+museum%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-24 22:30:04,656 - GitHubScraper - INFO - Found 0 GitHub repositories for term: "muse NOT music NOT museum"
2026-09-24 22:30:05,331 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:05,331 - GitHubFeedScraper - INFO - GitHub account feed page 3 unchanged (ETag)
2026-09-24 22:30:06,198 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22prime+agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-24 22:30:06,203 - GitHubScraper - INFO - Found 41 GitHub repositories for term: "prime agent"
2026-09-24 22:30:07,339 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-24 22:30:07,342 - GitHubScraper - INFO - Found 261 GitHub repositories for term: paperclip
2026-09-24 22:30:07,497 - GitHubScraper - INFO - Total GitHub results found: 0
2026-09-24 22:30:08,703 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"
2026-09-24 22:30:09,115 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:09,142 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-24 22:30:09,318 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:09,347 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:09,436 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:09,550 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:09,662 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:09,747 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:09,807 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:09,925 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:09,959 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:10,087 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:10,149 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:10,266 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:10,305 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:10,618 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:10,640 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:10,697 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/sikmenedowai-a11y/savetube-stream-kit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:10,834 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-24 22:30:10,934 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:10,951 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:11,134 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-24 22:30:11,261 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:11,288 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:11,327 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:11,529 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:11,549 - YouTubeIntelScraper - INFO - YouTube Intel found 30 candidates and 3 new videos
2026-09-24 22:30:11,671 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:11,771 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:11,869 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:11,891 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:12,046 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:12,155 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:12,381 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:12,399 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:12,581 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:12,587 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:12,767 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-24 22:30:12,847 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:12,922 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:13,042 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:13,258 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:13,309 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:13,313 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:13,396 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:13,590 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:13,751 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:13,760 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:13,895 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:14,063 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:14,090 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:14,205 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-24 22:30:14,280 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:14,360 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:14,509 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:14,600 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:14,644 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:14,807 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:15,088 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:15,133 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:15,144 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:15,287 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:15,474 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:15,496 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:15,519 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:15,687 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:15,817 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:15,836 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:15,917 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:16,014 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:16,127 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:16,129 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:16,313 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:16,384 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:16,494 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:16,578 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:16,647 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:16,671 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:16,833 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:16,926 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:16,992 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:17,099 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:17,161 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:17,294 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-tfilah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:17,364 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:17,443 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:17,547 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:17,659 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:17,725 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:17,777 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:17,887 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:17,931 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:18,042 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:18,103 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:18,212 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:18,405 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akshatasatmar/WeatherServiceApi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:18,459 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elchunenfreund/satmar-matzos-app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:18,492 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmaribianca05-eng/AFSD-Satmari-Bianca/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:18,528 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:18,895 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/Sefaria-Export/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:19,020 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-es6/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-24 22:30:19,061 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=200 account_new=0 list_repos=100 list_new=0 private_new=0 total_new=0
2026-09-24 22:30:19,062 - __main__ - INFO - Scraper github completed: 0 results
2026-09-24 22:30:19,063 - __main__ - INFO - Scraper github_feed completed: 0 results
2026-09-24 22:30:19,063 - __main__ - INFO - Scraper youtube_intel completed: 3 results
2026-09-24 22:30:19,626 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-24 22:30:19.626652
2026-09-24 22:30:19,627 - __main__ - INFO - Email sent successfully
2026-09-24 22:30:19,627 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-24 22:30:19,627 - __main__ - INFO - Monitor complete. Found 3 total results: 3 new youtube intel results.
2026-09-24 22:30:19,627 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-24 22:30:19,627 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-24 22:30:19,667 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-24 22:30:19,667 - __main__ - INFO - Closed all database connections
2026-09-24 22:30:19,669 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-24 22:30:19,669 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-24 23:00:02,479 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-24.log
2026-09-24 23:00:02,479 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-24.log
2026-09-24 23:00:02,479 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-24.log
2026-09-24 23:00:02,479 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-24 23:00:02,508 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-24 23:00:02,508 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-24 23:00:02,511 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-24 23:00:02,511 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-24 23:00:02,528 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-24 23:00:02,528 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-24 23:00:02,533 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-24 23:00:02,534 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-24 23:00:02,534 - __main__ - INFO - RSS scraper initialized and enabled
2026-09-24 23:00:02,536 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-24 23:00:02,537 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-24 23:00:02,537 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-09-24 23:00:02,539 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-24 23:00:02,544 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-24 23:00:02,544 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-24 23:00:02,546 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-24 23:00:02,546 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-24 23:00:02,547 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-24 23:00:02,549 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-24 23:00:02,549 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-09-24 23:00:02,549 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-24 23:00:02,550 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-09-24 23:00:02,662 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-09-24 23:00:02,667 - IveltScraper - INFO - Loaded 182 include, 4 exclude filters from DB topic_filters
2026-09-24 23:00:02,667 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-09-24 23:00:02,671 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-09-24 23:00:02,774 - social_media_monitor.database.connection - WARNING - Empty content or source provided to is_duplicate
2026-09-24 23:00:02,774 - social_media_monitor.database.connection - WARNING - Empty item_hash or source provided to store_sent_item
2026-09-24 23:00:03,000 - RSSFeedScraper - INFO - Total RSS/HTML results: 1
2026-09-24 23:00:03,412 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-09-24 23:00:03,624 - Yiddish24Scraper - INFO - Received response with 517679 characters
2026-09-24 23:00:03,625 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (323610 chars)
2026-09-24 23:00:03,627 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-09-24 23:00:03,699 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-09-24 23:00:03,741 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-09-24 23:00:03,741 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-09-24 23:00:03,754 - Yiddish24Scraper - INFO - Term 'ืคื•ืŸ ื“ื™ ืžื’ื™ื“'ืก ื˜ื™ืฉืœ' matched in DESCRIPTION: 'ืคื•ืŸ ื“ื™ ืžื’ื™ื“'ืก ื˜ื™ืฉืœ - ืฆืขืŸ ื—ื“ืฉื™ื ืื™ื– ืขืจ ื’ืขื•ื•ืขืŸ ื ื’ื•ื˜ืข ื˜ื™ื’ืขืจ'
2026-09-24 23:00:03,754 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ื”ื›ืœ ื‘ื›ืœ
2026-09-24 23:00:04,254 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/____________________1MALACH_2_260_260924051118.mp3
2026-09-24 23:00:06,741 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_____________________1MALACH_2_260_260924051118.mp3 (54.0 MB)
2026-09-24 23:00:06,743 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-09-24 23:00:06,776 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_____________________1MALACH_2_260_260924051118.mp3: title, artist, album, comment, source_url, genre, publisher
2026-09-24 23:00:06,778 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2_____________________1MALACH_2_260_260924051118_ืคื•ืŸ_ื“ื™_ืžื’ื™ื“_ืก_ื˜ื™ืฉืœ.mp3
2026-09-24 23:00:07,209 - Yiddish24Scraper - INFO - Term 'ื—ืง ืœื™ืฉืจืืœ' matched in TITLE: 'ื—ืง ืœื™ืฉืจืืœ - ื”ืจื‘ ื™ื•ืืœ ืœืขื‘ืื•ื•ื™ื˜ืฉ'
2026-09-24 23:00:07,209 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ื—ืง ืœื™ืฉืจืืœ - ื”ืจื‘ ื™ื•ืืœ ืœืขื‘ืื•ื•ื™ื˜ืฉ
2026-09-24 23:00:07,710 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/20260924054053-167896.mp3
2026-09-24 23:00:09,812 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_20260924054053-167896.mp3 (49.9 MB)
2026-09-24 23:00:09,813 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-09-24 23:00:09,830 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_20260924054053-167896.mp3: title, artist, album, comment, source_url, genre, publisher
2026-09-24 23:00:09,831 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2_20260924054053-167896_ื—ืง_ืœื™ืฉืจืืœ.mp3
2026-09-24 23:00:10,301 - Yiddish24Scraper - INFO - Page 1 summary: 5 new out of 100 total articles
2026-09-24 23:00:10,302 - Yiddish24Scraper - INFO - Page 1: 5/100 new items
2026-09-24 23:00:10,302 - Yiddish24Scraper - INFO - Low new item ratio (5.0%), stopping pagination
2026-09-24 23:00:10,302 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 5
2026-09-24 23:00:14,714 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-09-24 23:00:32,405 - IveltScraper - INFO - ivelt scrape complete. Checked 5 topics.
2026-09-24 23:00:32,406 - IveltScraper - INFO - All forums scrape complete. Found 14 new posts.
2026-09-24 23:00:32,406 - __main__ - INFO - Scraper rss completed: 1 results
2026-09-24 23:00:32,406 - __main__ - INFO - Scraper yiddish24 completed: 5 results
2026-09-24 23:00:32,406 - __main__ - INFO - Scraper ivelt completed: 14 results
2026-09-24 23:00:33,096 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-24 23:00:33.096115
2026-09-24 23:00:33,096 - __main__ - INFO - Email sent successfully
2026-09-24 23:00:33,096 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-24 23:00:33,096 - __main__ - INFO - Monitor complete. Found 20 total results: 1 new rss results, 5 new yiddish24 results, 14 new ivelt results.
2026-09-24 23:00:33,097 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-24 23:00:33,097 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-24 23:00:33,210 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-24 23:00:33,210 - __main__ - INFO - Closed all database connections
2026-09-24 23:00:33,211 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-24 23:00:33,211 - social_media_monitor.database.connection - INFO - Closed 0 database connections