โ† Logs

social_media_monitor_2026-09-09.log

2026-09-09 20:30:01,770 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-09 20:30:01,785 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-09 20:30:01,786 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-09 20:30:01,791 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-09 20:30:01,793 - __main__ - INFO - GitHub scraper initialized and enabled
2026-09-09 20:30:01,793 - __main__ - INFO - GitHub feed scraper initialized and enabled
2026-09-09 20:30:01,793 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-09 20:30:01,798 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-09 20:30:01,799 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-09 20:30:01,804 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-09 20:30:01,808 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-09 20:30:01,809 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-09 20:30:01,811 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-09 20:30:01,811 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-09 20:30:01,811 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-09 20:30:01,814 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-09 20:30:01,814 - __main__ - INFO - YouTube Intel scraper initialized and enabled
2026-09-09 20:30:01,814 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-09 20:30:01,814 - GitHubScraper - INFO - Searching GitHub for terms: ['"Hermes Agent"', '"claude code"', '"prime agent"', 'paperclip']
2026-09-09 20:30:02,251 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"
2026-09-09 20:30:02,253 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)
2026-09-09 20:30:03,070 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-09 20:30:03,094 - GitHubScraper - INFO - Found 594 GitHub repositories for term: "Hermes Agent"
2026-09-09 20:30:03,252 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"
2026-09-09 20:30:04,214 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22claude+code%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-09 20:30:04,217 - GitHubScraper - INFO - Found 8610 GitHub repositories for term: "claude code"
2026-09-09 20:30:04,260 - GitHubScraper - INFO - Added new GitHub repository: open-codex-computer-use
2026-09-09 20:30:04,287 - GitHubScraper - INFO - Added new GitHub repository: ToolJet
2026-09-09 20:30:04,323 - GitHubScraper - INFO - Added new GitHub repository: agent-toolkit
2026-09-09 20:30:04,363 - GitHubScraper - INFO - Added new GitHub repository: SkillSpector
2026-09-09 20:30:04,384 - GitHubScraper - INFO - Added new GitHub repository: prism-insight
2026-09-09 20:30:04,393 - GitHubScraper - INFO - Added new GitHub repository: apple-design-skill
2026-09-09 20:30:04,395 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"
2026-09-09 20:30:05,292 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22prime+agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-09 20:30:05,295 - GitHubScraper - INFO - Found 39 GitHub repositories for term: "prime agent"
2026-09-09 20:30:05,738 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:05,739 - GitHubFeedScraper - INFO - GitHub account feed page 3 unchanged (ETag)
2026-09-09 20:30:06,424 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-09 20:30:06,427 - GitHubScraper - INFO - Found 259 GitHub repositories for term: paperclip
2026-09-09 20:30:06,683 - GitHubScraper - INFO - Total GitHub results found: 6
2026-09-09 20:30:09,288 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"
2026-09-09 20:30:09,643 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:09,740 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:09,786 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:09,812 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:10,111 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:10,166 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:10,193 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:10,212 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:10,520 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:10,582 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:10,593 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:10,777 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:10,840 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:10,915 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:10,930 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:11,218 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:11,347 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-09 20:30:11,384 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/sikmenedowai-a11y/savetube-stream-kit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:11,527 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-09 20:30:11,587 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:11,718 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:11,818 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:11,867 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:11,994 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:12,106 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:12,243 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-09 20:30:12,361 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:12,521 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:12,660 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:12,677 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-09 20:30:12,763 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:13,073 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:13,084 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:13,150 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:13,171 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:13,593 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:13,622 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:13,664 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:13,678 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-09 20:30:13,984 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:13,985 - YouTubeIntelScraper - INFO - YouTube Intel found 54 candidates and 9 new videos
2026-09-09 20:30:14,147 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:14,278 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-09 20:30:14,297 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-09 20:30:14,304 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:14,596 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:14,656 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:14,755 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:14,798 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:15,025 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:15,030 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:15,276 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:15,296 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:15,395 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:15,441 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-09 20:30:15,654 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:15,746 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:15,928 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:16,101 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:16,190 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-09 20:30:16,226 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:16,512 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:16,527 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-09 20:30:16,584 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:16,613 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:16,813 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:16,968 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:16,972 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:17,014 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:17,203 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:17,344 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:17,358 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:17,454 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:17,582 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:17,735 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:17,785 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:17,788 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:17,885 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:18,161 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:18,219 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:18,326 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yeled-tov/filtertube-android/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-09 20:30:18,340 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:18,571 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:18,608 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:18,731 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:18,877 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:18,956 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:18,997 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-tfilah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:19,089 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:19,316 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:19,369 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:19,390 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:19,424 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:19,686 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:19,729 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:19,864 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:19,978 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:20,058 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akshatasatmar/WeatherServiceApi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:20,098 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elchunenfreund/satmar-matzos-app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:20,262 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmaribianca05-eng/AFSD-Satmari-Bianca/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:20,521 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/Sefaria-Export/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 20:30:20,627 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=200 account_new=0 list_repos=100 list_new=4 private_new=0 total_new=4
2026-09-09 20:30:20,629 - __main__ - INFO - Scraper github completed: 6 results
2026-09-09 20:30:20,629 - __main__ - INFO - Scraper github_feed completed: 4 results
2026-09-09 20:30:20,629 - __main__ - INFO - Scraper youtube_intel completed: 9 results
2026-09-09 20:30:21,591 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-09 20:30:21.591581
2026-09-09 20:30:21,591 - __main__ - INFO - Email sent successfully
2026-09-09 20:30:21,630 - __main__ - INFO - GitHub feed delivery acknowledged: 4 stored, 0 failed
2026-09-09 20:30:21,630 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-09 20:30:21,630 - __main__ - INFO - Monitor complete. Found 19 total results: 6 new github results, 4 new github feed results, 9 new youtube intel results.
2026-09-09 20:30:21,630 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-09 20:30:21,630 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-09 20:30:21,661 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-09 20:30:21,661 - __main__ - INFO - Closed all database connections
2026-09-09 20:30:21,663 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-09 20:30:21,663 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-09 21:00:02,239 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-09.log
2026-09-09 21:00:02,239 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-09.log
2026-09-09 21:00:02,240 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-09.log
2026-09-09 21:00:02,240 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-09 21:00:02,269 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-09 21:00:02,269 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-09 21:00:02,272 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-09 21:00:02,272 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-09 21:00:02,286 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-09 21:00:02,286 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-09 21:00:02,291 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-09 21:00:02,293 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-09 21:00:02,293 - __main__ - INFO - RSS scraper initialized and enabled
2026-09-09 21:00:02,302 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-09 21:00:02,302 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-09 21:00:02,302 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-09-09 21:00:02,308 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-09 21:00:02,315 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-09 21:00:02,315 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-09 21:00:02,317 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-09 21:00:02,317 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-09 21:00:02,318 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-09 21:00:02,320 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-09 21:00:02,320 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-09-09 21:00:02,320 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-09 21:00:02,320 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-09-09 21:00:02,419 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-09-09 21:00:02,424 - IveltScraper - INFO - Loaded 181 include, 4 exclude filters from DB topic_filters
2026-09-09 21:00:02,424 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-09-09 21:00:02,425 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-09-09 21:00:03,065 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-09-09 21:00:04,635 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-09-09 21:00:04,859 - Yiddish24Scraper - INFO - Received response with 505861 characters
2026-09-09 21:00:04,863 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (317252 chars)
2026-09-09 21:00:04,867 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-09-09 21:00:04,950 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-09-09 21:00:04,989 - Yiddish24Scraper - INFO - Page 1 extraction: 99 successful, 1 failed out of 100 elements
2026-09-09 21:00:04,990 - Yiddish24Scraper - INFO - Parsed 99 articles from HTML on page 1
2026-09-09 21:00:06,047 - Yiddish24Scraper - INFO - Page 1 summary: 5 new out of 99 total articles
2026-09-09 21:00:06,047 - Yiddish24Scraper - INFO - Page 1: 5/99 new items
2026-09-09 21:00:06,047 - Yiddish24Scraper - INFO - Low new item ratio (5.1%), stopping pagination
2026-09-09 21:00:06,047 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 5
2026-09-09 21:00:14,571 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-09-09 21:00:43,348 - IveltScraper - INFO - ivelt scrape complete. Checked 5 topics.
2026-09-09 21:00:43,349 - IveltScraper - INFO - All forums scrape complete. Found 17 new posts.
2026-09-09 21:00:43,349 - __main__ - INFO - Scraper rss completed: 0 results
2026-09-09 21:00:43,349 - __main__ - INFO - Scraper yiddish24 completed: 5 results
2026-09-09 21:00:43,349 - __main__ - INFO - Scraper ivelt completed: 17 results
2026-09-09 21:00:44,579 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-09 21:00:44.579638
2026-09-09 21:00:44,579 - __main__ - INFO - Email sent successfully
2026-09-09 21:00:44,580 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-09 21:00:44,580 - __main__ - INFO - Monitor complete. Found 22 total results: 5 new yiddish24 results, 17 new ivelt results.
2026-09-09 21:00:44,580 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-09 21:00:44,580 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-09 21:00:44,688 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-09 21:00:44,688 - __main__ - INFO - Closed all database connections
2026-09-09 21:00:44,691 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-09 21:00:44,691 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-09 22:00:01,846 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-09.log
2026-09-09 22:00:01,846 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-09.log
2026-09-09 22:00:01,846 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-09.log
2026-09-09 22:00:01,846 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-09 22:00:01,875 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-09 22:00:01,875 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-09 22:00:01,877 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-09 22:00:01,878 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-09 22:00:01,895 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-09 22:00:01,895 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-09 22:00:01,955 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-09 22:00:01,957 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-09 22:00:01,957 - __main__ - INFO - RSS scraper initialized and enabled
2026-09-09 22:00:01,962 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-09 22:00:01,962 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-09 22:00:01,962 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-09-09 22:00:01,966 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-09 22:00:01,974 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-09 22:00:01,974 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-09 22:00:01,977 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-09 22:00:01,977 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-09 22:00:01,978 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-09 22:00:01,981 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-09 22:00:01,981 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-09-09 22:00:01,982 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-09 22:00:01,982 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-09-09 22:00:02,079 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-09-09 22:00:02,084 - IveltScraper - INFO - Loaded 181 include, 4 exclude filters from DB topic_filters
2026-09-09 22:00:02,084 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-09-09 22:00:02,085 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-09-09 22:00:02,316 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-09-09 22:00:04,824 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-09-09 22:00:05,051 - Yiddish24Scraper - INFO - Received response with 493978 characters
2026-09-09 22:00:05,052 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (311576 chars)
2026-09-09 22:00:05,054 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-09-09 22:00:05,128 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-09-09 22:00:05,175 - Yiddish24Scraper - INFO - Page 1 extraction: 99 successful, 1 failed out of 100 elements
2026-09-09 22:00:05,175 - Yiddish24Scraper - INFO - Parsed 99 articles from HTML on page 1
2026-09-09 22:00:05,907 - Yiddish24Scraper - INFO - Page 1 summary: 3 new out of 99 total articles
2026-09-09 22:00:05,907 - Yiddish24Scraper - INFO - Page 1: 3/99 new items
2026-09-09 22:00:05,908 - Yiddish24Scraper - INFO - Low new item ratio (3.0%), stopping pagination
2026-09-09 22:00:05,908 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 3
2026-09-09 22:00:14,019 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-09-09 22:00:44,730 - IveltScraper - INFO - Filtering post containing exclude term: '*ื‘ื™ื˜ืข ืžืื›ื˜ ื–ื™ื›ืขืจ ื‘ืœื•ื™ื– ืฆื• ื‘ืืจื™ื›ื˜ืŸ ืงืจืื ื˜ืข ื ื™ื™ืขืก*'
2026-09-09 22:00:49,295 - IveltScraper - INFO - ivelt scrape complete. Checked 6 topics.
2026-09-09 22:00:49,295 - IveltScraper - INFO - All forums scrape complete. Found 36 new posts.
2026-09-09 22:00:49,295 - __main__ - INFO - Scraper rss completed: 0 results
2026-09-09 22:00:49,295 - __main__ - INFO - Scraper yiddish24 completed: 3 results
2026-09-09 22:00:49,295 - __main__ - INFO - Scraper ivelt completed: 36 results
2026-09-09 22:00:50,301 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-09 22:00:50.301319
2026-09-09 22:00:50,301 - __main__ - INFO - Email sent successfully
2026-09-09 22:00:50,301 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-09 22:00:50,302 - __main__ - INFO - Monitor complete. Found 39 total results: 3 new yiddish24 results, 36 new ivelt results.
2026-09-09 22:00:50,302 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-09 22:00:50,302 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-09 22:00:50,430 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-09 22:00:50,430 - __main__ - INFO - Closed all database connections
2026-09-09 22:00:50,433 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-09 22:00:50,433 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-09 22:30:01,931 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-09.log
2026-09-09 22:30:01,931 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-09.log
2026-09-09 22:30:01,932 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-09.log
2026-09-09 22:30:01,932 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-09 22:30:01,966 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-09 22:30:01,967 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-09 22:30:01,969 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-09 22:30:01,969 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-09 22:30:01,988 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-09 22:30:01,988 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-09 22:30:01,993 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-09 22:30:01,994 - __main__ - INFO - GitHub scraper initialized and enabled
2026-09-09 22:30:01,994 - __main__ - INFO - GitHub feed scraper initialized and enabled
2026-09-09 22:30:01,995 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-09 22:30:02,000 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-09 22:30:02,000 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-09 22:30:02,005 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-09 22:30:02,011 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-09 22:30:02,011 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-09 22:30:02,013 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-09 22:30:02,013 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-09 22:30:02,013 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-09 22:30:02,016 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-09 22:30:02,016 - __main__ - INFO - YouTube Intel scraper initialized and enabled
2026-09-09 22:30:02,016 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-09 22:30:02,016 - GitHubScraper - INFO - Searching GitHub for terms: ['"Hermes Agent"', '"claude code"', '"prime agent"', 'paperclip']
2026-09-09 22:30:02,425 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"
2026-09-09 22:30:02,426 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)
2026-09-09 22:30:03,106 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-09 22:30:03,132 - GitHubScraper - INFO - Found 596 GitHub repositories for term: "Hermes Agent"
2026-09-09 22:30:03,305 - GitHubScraper - INFO - Added new GitHub repository: token
2026-09-09 22:30:03,481 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"
2026-09-09 22:30:04,211 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22claude+code%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-09 22:30:04,215 - GitHubScraper - INFO - Found 8614 GitHub repositories for term: "claude code"
2026-09-09 22:30:04,233 - GitHubScraper - INFO - Added new GitHub repository: minutes
2026-09-09 22:30:04,378 - GitHubScraper - INFO - Added new GitHub repository: statewright
2026-09-09 22:30:04,396 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"
2026-09-09 22:30:05,288 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22prime+agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-09 22:30:05,292 - GitHubScraper - INFO - Found 39 GitHub repositories for term: "prime agent"
2026-09-09 22:30:05,681 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:05,682 - GitHubFeedScraper - INFO - GitHub account feed page 3 unchanged (ETag)
2026-09-09 22:30:06,278 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-09 22:30:06,282 - GitHubScraper - INFO - Found 258 GitHub repositories for term: paperclip
2026-09-09 22:30:06,440 - GitHubScraper - INFO - Total GitHub results found: 3
2026-09-09 22:30:08,828 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"
2026-09-09 22:30:09,218 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:09,302 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:09,321 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-09 22:30:09,418 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:09,645 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:09,709 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:09,774 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:09,814 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:10,036 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:10,155 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:10,207 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:10,266 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:10,368 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:10,462 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:10,608 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:10,618 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:10,777 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-09 22:30:10,921 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/sikmenedowai-a11y/savetube-stream-kit/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-09 22:30:10,975 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:11,068 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:11,182 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-09 22:30:11,328 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:11,402 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:11,490 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:11,683 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:11,720 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:11,908 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:12,027 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:12,087 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:12,095 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:12,328 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:12,462 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:12,580 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-09 22:30:12,634 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:12,654 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:12,810 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:13,094 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-09 22:30:13,142 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-09 22:30:13,170 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:13,190 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:13,571 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:13,587 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:13,694 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-09 22:30:13,735 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:13,989 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:14,023 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:14,055 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:14,277 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:14,313 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:14,339 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:14,514 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:14,703 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:14,712 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:14,798 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-09 22:30:14,837 - YouTubeIntelScraper - INFO - YouTube Intel found 54 candidates and 3 new videos
2026-09-09 22:30:14,963 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-09 22:30:15,032 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:15,150 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:15,419 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-09 22:30:15,460 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-09 22:30:15,573 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:15,636 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-09 22:30:15,782 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:15,810 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:15,877 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:16,118 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:16,156 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:16,164 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:16,312 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:16,448 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:16,462 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:16,473 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:16,631 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:16,822 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:16,863 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:16,917 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:16,962 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:17,217 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:17,317 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:17,437 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:17,597 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:17,629 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yeled-tov/filtertube-android/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-09 22:30:17,715 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:17,791 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:17,939 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-09 22:30:18,039 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-tfilah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:18,066 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:18,089 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:18,233 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:18,350 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:18,367 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:18,442 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:18,657 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:18,717 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:18,782 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:18,899 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:18,988 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:19,061 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akshatasatmar/WeatherServiceApi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:19,130 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elchunenfreund/satmar-matzos-app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:19,198 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmaribianca05-eng/AFSD-Satmari-Bianca/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:19,511 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/Sefaria-Export/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-09 22:30:19,653 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=200 account_new=0 list_repos=100 list_new=2 private_new=0 total_new=2
2026-09-09 22:30:19,655 - __main__ - INFO - Scraper github completed: 3 results
2026-09-09 22:30:19,655 - __main__ - INFO - Scraper github_feed completed: 2 results
2026-09-09 22:30:19,655 - __main__ - INFO - Scraper youtube_intel completed: 3 results
2026-09-09 22:30:20,410 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-09 22:30:20.410675
2026-09-09 22:30:20,410 - __main__ - INFO - Email sent successfully
2026-09-09 22:30:20,428 - __main__ - INFO - GitHub feed delivery acknowledged: 2 stored, 0 failed
2026-09-09 22:30:20,428 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-09 22:30:20,428 - __main__ - INFO - Monitor complete. Found 8 total results: 3 new github results, 2 new github feed results, 3 new youtube intel results.
2026-09-09 22:30:20,428 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-09 22:30:20,428 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-09 22:30:20,459 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-09 22:30:20,460 - __main__ - INFO - Closed all database connections
2026-09-09 22:30:20,462 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-09 22:30:20,463 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-09 23:00:02,119 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-09.log
2026-09-09 23:00:02,119 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-09.log
2026-09-09 23:00:02,119 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-09.log
2026-09-09 23:00:02,119 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-09 23:00:02,149 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-09 23:00:02,149 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-09 23:00:02,151 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-09 23:00:02,152 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-09 23:00:02,168 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-09 23:00:02,168 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-09 23:00:02,330 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-09 23:00:02,332 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-09 23:00:02,332 - __main__ - INFO - RSS scraper initialized and enabled
2026-09-09 23:00:02,339 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-09 23:00:02,339 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-09 23:00:02,339 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-09-09 23:00:02,345 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-09 23:00:02,354 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-09 23:00:02,354 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-09 23:00:02,357 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-09 23:00:02,357 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-09 23:00:02,357 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-09 23:00:02,361 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-09 23:00:02,361 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-09-09 23:00:02,361 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-09 23:00:02,361 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-09-09 23:00:02,463 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-09-09 23:00:02,468 - IveltScraper - INFO - Loaded 181 include, 4 exclude filters from DB topic_filters
2026-09-09 23:00:02,468 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-09-09 23:00:02,469 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-09-09 23:00:02,788 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-09-09 23:00:04,638 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-09-09 23:00:04,866 - Yiddish24Scraper - INFO - Received response with 495247 characters
2026-09-09 23:00:04,868 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (314581 chars)
2026-09-09 23:00:04,870 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-09-09 23:00:04,948 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-09-09 23:00:04,987 - Yiddish24Scraper - INFO - Page 1 extraction: 98 successful, 2 failed out of 100 elements
2026-09-09 23:00:04,987 - Yiddish24Scraper - INFO - Parsed 98 articles from HTML on page 1
2026-09-09 23:00:05,055 - Yiddish24Scraper - INFO - Term 'ื ื’ืขื“ืื ืง' matched in DESCRIPTION: 'ื“ื™ ืื™ื ื˜ืขืจื ืึทืฆื™ืึธื ืึทืœืข ืึทื˜ืึธืžื™ืฉืข ืขื ืขืจื’ื™ืข ืึทื’ืขื ื˜ื•ืจ ื”ืึธื˜ ื‘ืืฉืœืืกืŸ ืืจื™ื™ื ืฆื•ื’ืขื‘ืŸ ื ืงืœืื’ืข ืงืขื’ืŸ ืื™ืจืืŸ ืฆื•ื ื™ื•-ืขืŸ ื–ื™ื›ืขืจื”ื™ื™ื˜ ืงืื•ื ืกื™ืœ ืฆื•ื ืขืจืฉื˜ืŸ ืžืืœ ืื™ืŸ ืฆื•ื•ืื ืฆื™ื’ ื™ืืจ โ€ข ืคืืœื™ืฆื™ื™ ืื™ืŸ ืขื ื’ืœืื ื“ ื”ืื˜ ืื ื’ืขืงืœืื’ื˜ ื 31 ื™ืขืจื™ื’ืŸ ...'
2026-09-09 23:00:05,056 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ืกืš ื”ื›ืœ ืคื•ืŸ ื“ื™ ื ื™ื™ืขืก: ื“ื™ ืงืจื™ื’ ืฆื•ื•ื™ืฉืŸ ืืžืขืจื™ืงืข ืื•ืŸ ืื™
2026-09-09 23:00:05,556 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/KM_N111_29_1788992859.mp3
2026-09-09 23:00:06,409 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_KM_N111_29_1788992859.mp3 (844.7 KB)
2026-09-09 23:00:06,409 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-09-09 23:00:06,416 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_KM_N111_29_1788992859.mp3: title, artist, album, comment, source_url, genre, publisher
2026-09-09 23:00:06,416 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2_KM_N111_29_1788992859_ื_ื’ืขื“ืื ืง.mp3
2026-09-09 23:00:07,234 - Yiddish24Scraper - INFO - Page 1 summary: 11 new out of 98 total articles
2026-09-09 23:00:07,235 - Yiddish24Scraper - INFO - Page 1: 11/98 new items
2026-09-09 23:00:07,235 - Yiddish24Scraper - INFO - Low new item ratio (11.2%), stopping pagination
2026-09-09 23:00:07,235 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 11
2026-09-09 23:00:14,563 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-09-09 23:00:18,604 - IveltScraper - INFO - ivelt scrape complete. Checked 1 topics.
2026-09-09 23:00:18,605 - IveltScraper - INFO - All forums scrape complete. Found 6 new posts.
2026-09-09 23:00:18,605 - __main__ - INFO - Scraper rss completed: 0 results
2026-09-09 23:00:18,605 - __main__ - INFO - Scraper yiddish24 completed: 11 results
2026-09-09 23:00:18,605 - __main__ - INFO - Scraper ivelt completed: 6 results
2026-09-09 23:00:19,494 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-09 23:00:19.494477
2026-09-09 23:00:19,494 - __main__ - INFO - Email sent successfully
2026-09-09 23:00:19,495 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-09 23:00:19,495 - __main__ - INFO - Monitor complete. Found 17 total results: 11 new yiddish24 results, 6 new ivelt results.
2026-09-09 23:00:19,495 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-09 23:00:19,495 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-09 23:00:19,593 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-09 23:00:19,593 - __main__ - INFO - Closed all database connections
2026-09-09 23:00:19,595 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-09 23:00:19,595 - social_media_monitor.database.connection - INFO - Closed 0 database connections