โ† Logs

social_media_monitor_2026-09-22.log

2026-09-22 20:30:02,401 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-22 20:30:02,407 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-22 20:30:02,407 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-22 20:30:02,410 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-22 20:30:02,410 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-22 20:30:02,410 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-22 20:30:02,413 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-22 20:30:02,413 - __main__ - INFO - YouTube Intel scraper initialized and enabled
2026-09-22 20:30:02,413 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-22 20:30:02,413 - GitHubScraper - INFO - Searching GitHub for terms: ['"Hermes Agent"', '"grok bot OR grokbot"', '"muse NOT music NOT museum"', '"prime agent"', 'paperclip']
2026-09-22 20:30:02,816 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"
2026-09-22 20:30:02,817 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)
2026-09-22 20:30:03,487 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-22 20:30:03,586 - GitHubScraper - INFO - Found 633 GitHub repositories for term: "Hermes Agent"
2026-09-22 20:30:04,038 - GitHubScraper - INFO - Added new GitHub repository: section-11
2026-09-22 20:30:04,180 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"
2026-09-22 20:30:04,540 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22grok+bot+OR+grokbot%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-22 20:30:04,541 - GitHubScraper - INFO - Found 0 GitHub repositories for term: "grok bot OR grokbot"
2026-09-22 20:30:05,204 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"
2026-09-22 20:30:05,630 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22muse+NOT+music+NOT+museum%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-22 20:30:05,631 - GitHubScraper - INFO - Found 0 GitHub repositories for term: "muse NOT music NOT museum"
2026-09-22 20:30:06,398 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 200 OK"
2026-09-22 20:30:07,075 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22prime+agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-22 20:30:07,079 - GitHubScraper - INFO - Found 41 GitHub repositories for term: "prime agent"
2026-09-22 20:30:08,279 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-22 20:30:08,283 - GitHubScraper - INFO - Found 263 GitHub repositories for term: paperclip
2026-09-22 20:30:08,439 - GitHubScraper - INFO - Total GitHub results found: 1
2026-09-22 20:30:09,468 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"
2026-09-22 20:30:09,862 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:09,865 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:09,885 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:09,904 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:10,157 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:10,288 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:10,316 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:10,351 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-22 20:30:10,489 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:10,658 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:10,668 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:10,705 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:10,875 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:11,041 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:11,043 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:11,111 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:11,393 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:11,508 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:11,558 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-22 20:30:11,562 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/sikmenedowai-a11y/savetube-stream-kit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:11,696 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:11,849 - YouTubeIntelScraper - INFO - YouTube Intel found 25 candidates and 4 new videos
2026-09-22 20:30:11,939 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:11,971 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:11,973 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:12,088 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:12,418 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-22 20:30:12,423 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:12,487 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:12,622 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:12,763 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:12,774 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:13,021 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:13,067 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:13,106 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:13,140 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:13,390 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:13,584 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-22 20:30:13,611 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-22 20:30:13,616 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-22 20:30:13,757 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:14,098 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-22 20:30:14,120 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:14,122 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:14,153 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:14,502 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:14,504 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:14,581 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:14,747 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:14,890 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:14,919 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:15,087 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:15,141 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:15,232 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:15,357 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:15,472 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:15,499 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:15,649 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:15,929 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:15,998 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-22 20:30:16,070 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:16,191 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:16,299 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:16,348 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:16,403 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:16,639 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:16,673 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:16,676 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:16,792 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:16,994 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:17,037 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:17,060 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:17,140 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:17,342 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:17,435 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:17,498 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:17,511 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:17,725 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:17,765 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:17,818 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:17,892 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:18,168 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:18,183 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:18,213 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:18,263 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-tfilah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:18,498 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:18,533 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:18,565 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:18,730 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-22 20:30:18,856 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:18,883 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:18,941 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:19,102 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:19,224 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:19,273 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:19,308 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:19,420 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akshatasatmar/WeatherServiceApi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:19,540 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elchunenfreund/satmar-matzos-app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:19,632 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmaribianca05-eng/AFSD-Satmari-Bianca/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:19,814 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/Sefaria-Export/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 20:30:19,949 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-es6/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-22 20:30:20,081 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=300 account_new=0 list_repos=100 list_new=0 private_new=0 total_new=0
2026-09-22 20:30:20,082 - __main__ - INFO - Scraper github completed: 1 results
2026-09-22 20:30:20,083 - __main__ - INFO - Scraper github_feed completed: 0 results
2026-09-22 20:30:20,083 - __main__ - INFO - Scraper youtube_intel completed: 4 results
2026-09-22 20:30:20,779 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-22 20:30:20.779780
2026-09-22 20:30:20,780 - __main__ - INFO - Email sent successfully
2026-09-22 20:30:20,780 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-22 20:30:20,780 - __main__ - INFO - Monitor complete. Found 5 total results: 1 new github results, 4 new youtube intel results.
2026-09-22 20:30:20,780 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-22 20:30:20,780 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-22 20:30:20,827 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-22 20:30:20,827 - __main__ - INFO - Closed all database connections
2026-09-22 20:30:20,830 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-22 20:30:20,830 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-22 21:00:02,035 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-22.log
2026-09-22 21:00:02,035 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-22.log
2026-09-22 21:00:02,035 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-22.log
2026-09-22 21:00:02,035 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-22 21:00:02,066 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-22 21:00:02,066 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-22 21:00:02,068 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-22 21:00:02,069 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-22 21:00:02,087 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-22 21:00:02,087 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-22 21:00:02,092 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-22 21:00:02,094 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-22 21:00:02,095 - __main__ - INFO - RSS scraper initialized and enabled
2026-09-22 21:00:02,102 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-22 21:00:02,102 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-22 21:00:02,102 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-09-22 21:00:02,108 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-22 21:00:02,115 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-22 21:00:02,115 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-22 21:00:02,117 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-22 21:00:02,117 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-22 21:00:02,117 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-22 21:00:02,119 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-22 21:00:02,119 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-09-22 21:00:02,120 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-22 21:00:02,120 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-09-22 21:00:02,212 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-09-22 21:00:02,217 - IveltScraper - INFO - Loaded 181 include, 4 exclude filters from DB topic_filters
2026-09-22 21:00:02,217 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-09-22 21:00:02,218 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-09-22 21:00:02,577 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-09-22 21:00:03,026 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-09-22 21:00:03,238 - Yiddish24Scraper - INFO - Received response with 488899 characters
2026-09-22 21:00:03,240 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (310370 chars)
2026-09-22 21:00:03,241 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-09-22 21:00:03,322 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-09-22 21:00:03,365 - Yiddish24Scraper - INFO - Page 1 extraction: 98 successful, 2 failed out of 100 elements
2026-09-22 21:00:03,365 - Yiddish24Scraper - INFO - Parsed 98 articles from HTML on page 1
2026-09-22 21:00:04,209 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 98 total articles
2026-09-22 21:00:04,210 - Yiddish24Scraper - INFO - Page 1: 0/98 new items
2026-09-22 21:00:04,210 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination
2026-09-22 21:00:04,211 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0
2026-09-22 21:00:14,712 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-09-22 21:00:21,845 - IveltScraper - INFO - Filtering post containing exclude term: '*ื‘ื™ื˜ืข ืžืื›ื˜ ื–ื™ื›ืขืจ ื‘ืœื•ื™ื– ืฆื• ื‘ืืจื™ื›ื˜ืŸ ืงืจืื ื˜ืข ื ื™ื™ืขืก*'
2026-09-22 21:00:27,661 - IveltScraper - INFO - ivelt scrape complete. Checked 3 topics.
2026-09-22 21:00:27,661 - IveltScraper - INFO - All forums scrape complete. Found 6 new posts.
2026-09-22 21:00:27,662 - __main__ - INFO - Scraper rss completed: 0 results
2026-09-22 21:00:27,662 - __main__ - INFO - Scraper yiddish24 completed: 0 results
2026-09-22 21:00:27,662 - __main__ - INFO - Scraper ivelt completed: 6 results
2026-09-22 21:00:28,958 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-22 21:00:28.957929
2026-09-22 21:00:28,958 - __main__ - INFO - Email sent successfully
2026-09-22 21:00:28,958 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-22 21:00:28,958 - __main__ - INFO - Monitor complete. Found 6 total results: 6 new ivelt results.
2026-09-22 21:00:28,958 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-22 21:00:28,959 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-22 21:00:29,098 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-22 21:00:29,098 - __main__ - INFO - Closed all database connections
2026-09-22 21:00:29,100 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-22 21:00:29,100 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-22 22:00:02,386 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-22.log
2026-09-22 22:00:02,386 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-22.log
2026-09-22 22:00:02,386 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-22.log
2026-09-22 22:00:02,386 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-22 22:00:02,415 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-22 22:00:02,415 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-22 22:00:02,417 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-22 22:00:02,418 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-22 22:00:02,433 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-22 22:00:02,433 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-22 22:00:02,489 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-22 22:00:02,492 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-22 22:00:02,492 - __main__ - INFO - RSS scraper initialized and enabled
2026-09-22 22:00:02,500 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-22 22:00:02,500 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-22 22:00:02,500 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-09-22 22:00:02,505 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-22 22:00:02,511 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-22 22:00:02,511 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-22 22:00:02,514 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-22 22:00:02,514 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-22 22:00:02,514 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-22 22:00:02,516 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-22 22:00:02,516 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-09-22 22:00:02,516 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-22 22:00:02,517 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-09-22 22:00:02,605 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-09-22 22:00:02,609 - IveltScraper - INFO - Loaded 181 include, 4 exclude filters from DB topic_filters
2026-09-22 22:00:02,609 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-09-22 22:00:02,611 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-09-22 22:00:02,983 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-09-22 22:00:03,472 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-09-22 22:00:03,570 - Yiddish24Scraper - INFO - Received response with 498355 characters
2026-09-22 22:00:03,571 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (315269 chars)
2026-09-22 22:00:03,572 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-09-22 22:00:03,644 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-09-22 22:00:03,682 - Yiddish24Scraper - INFO - Page 1 extraction: 98 successful, 2 failed out of 100 elements
2026-09-22 22:00:03,682 - Yiddish24Scraper - INFO - Parsed 98 articles from HTML on page 1
2026-09-22 22:00:03,739 - Yiddish24Scraper - INFO - Term 'ืื™ื ื˜ืขืจืขืกืื ื˜ืก -' matched in DESCRIPTION: 'ืื™ื ื˜ืขืจืขืกืื ื˜ืก - ืขืจืคื™ื ื“ืŸ ื ืคืื˜ืขื ื˜ ืคื•ืŸ ื ืฉืœืืง'
2026-09-22 22:00:03,740 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ื”ื›ืœ ื‘ื›ืœ
2026-09-22 22:00:04,240 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/__________________260_260922051459.mp3
2026-09-22 22:00:04,438 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2___________________260_260922051459.mp3 (6.6 MB)
2026-09-22 22:00:04,438 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-09-22 22:00:04,445 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2___________________260_260922051459.mp3: title, artist, album, comment, source_url, genre, publisher
2026-09-22 22:00:04,445 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2___________________260_260922051459_ืื™ื ื˜ืขืจืขืกืื ื˜ืก_-.mp3
2026-09-22 22:00:05,106 - Yiddish24Scraper - INFO - Page 1 summary: 6 new out of 98 total articles
2026-09-22 22:00:05,106 - Yiddish24Scraper - INFO - Page 1: 6/98 new items
2026-09-22 22:00:05,106 - Yiddish24Scraper - INFO - Low new item ratio (6.1%), stopping pagination
2026-09-22 22:00:05,107 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 6
2026-09-22 22:00:14,765 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-09-22 22:00:23,660 - IveltScraper - INFO - Filtering post containing exclude term: '*ื‘ื™ื˜ืข ืžืื›ื˜ ื–ื™ื›ืขืจ ื‘ืœื•ื™ื– ืฆื• ื‘ืืจื™ื›ื˜ืŸ ืงืจืื ื˜ืข ื ื™ื™ืขืก*'
2026-09-22 22:00:26,797 - IveltScraper - INFO - Filtering post containing exclude term: '*ื‘ื™ื˜ืข ืžืื›ื˜ ื–ื™ื›ืขืจ ื‘ืœื•ื™ื– ืฆื• ื‘ืืจื™ื›ื˜ืŸ ืงืจืื ื˜ืข ื ื™ื™ืขืก*'
2026-09-22 22:00:30,667 - IveltScraper - INFO - ivelt scrape complete. Checked 3 topics.
2026-09-22 22:00:30,667 - IveltScraper - INFO - All forums scrape complete. Found 12 new posts.
2026-09-22 22:00:30,668 - __main__ - INFO - Scraper rss completed: 0 results
2026-09-22 22:00:30,668 - __main__ - INFO - Scraper yiddish24 completed: 6 results
2026-09-22 22:00:30,668 - __main__ - INFO - Scraper ivelt completed: 12 results
2026-09-22 22:00:31,862 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-22 22:00:31.862172
2026-09-22 22:00:31,862 - __main__ - INFO - Email sent successfully
2026-09-22 22:00:31,862 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-22 22:00:31,862 - __main__ - INFO - Monitor complete. Found 18 total results: 6 new yiddish24 results, 12 new ivelt results.
2026-09-22 22:00:31,863 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-22 22:00:31,863 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-22 22:00:31,910 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-22 22:00:31,910 - __main__ - INFO - Closed all database connections
2026-09-22 22:00:31,912 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-22 22:00:31,912 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-22 22:30:01,885 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-22.log
2026-09-22 22:30:01,885 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-22.log
2026-09-22 22:30:01,885 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-22.log
2026-09-22 22:30:01,885 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-22 22:30:01,914 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-22 22:30:01,914 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-22 22:30:01,916 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-22 22:30:01,917 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-22 22:30:01,930 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-22 22:30:01,930 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-22 22:30:01,933 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-22 22:30:01,933 - __main__ - INFO - GitHub scraper initialized and enabled
2026-09-22 22:30:01,933 - __main__ - INFO - GitHub feed scraper initialized and enabled
2026-09-22 22:30:01,934 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-22 22:30:01,936 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-22 22:30:01,936 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-22 22:30:01,940 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-22 22:30:01,946 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-22 22:30:01,946 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-22 22:30:01,948 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-22 22:30:01,948 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-22 22:30:01,949 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-22 22:30:01,951 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-22 22:30:01,951 - __main__ - INFO - YouTube Intel scraper initialized and enabled
2026-09-22 22:30:01,951 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-22 22:30:01,951 - GitHubScraper - INFO - Searching GitHub for terms: ['"Hermes Agent"', '"grok bot OR grokbot"', '"muse NOT music NOT museum"', '"prime agent"', 'paperclip']
2026-09-22 22:30:02,367 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"
2026-09-22 22:30:02,368 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)
2026-09-22 22:30:02,963 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-22 22:30:02,988 - GitHubScraper - INFO - Found 634 GitHub repositories for term: "Hermes Agent"
2026-09-22 22:30:03,227 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"
2026-09-22 22:30:03,517 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22grok+bot+OR+grokbot%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-22 22:30:03,518 - GitHubScraper - INFO - Found 0 GitHub repositories for term: "grok bot OR grokbot"
2026-09-22 22:30:04,174 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"
2026-09-22 22:30:04,522 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22muse+NOT+music+NOT+museum%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-22 22:30:04,523 - GitHubScraper - INFO - Found 0 GitHub repositories for term: "muse NOT music NOT museum"
2026-09-22 22:30:05,642 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 200 OK"
2026-09-22 22:30:06,067 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22prime+agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-22 22:30:06,071 - GitHubScraper - INFO - Found 41 GitHub repositories for term: "prime agent"
2026-09-22 22:30:07,053 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-22 22:30:07,057 - GitHubScraper - INFO - Found 263 GitHub repositories for term: paperclip
2026-09-22 22:30:07,183 - GitHubScraper - INFO - Total GitHub results found: 0
2026-09-22 22:30:09,603 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"
2026-09-22 22:30:09,963 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:09,984 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:10,011 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:10,036 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:10,286 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:10,333 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:10,451 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:10,583 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:10,654 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:10,728 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:10,749 - YouTubeIntelScraper - INFO - YouTube Intel found 25 candidates and 2 new videos
2026-09-22 22:30:10,804 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:10,945 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:10,985 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:11,084 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:11,204 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:11,401 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/sikmenedowai-a11y/savetube-stream-kit/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-22 22:30:11,485 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:11,642 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-22 22:30:11,750 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-22 22:30:11,755 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:11,775 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:12,054 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:12,061 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:12,077 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:12,172 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:12,591 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:12,593 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:12,607 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:12,759 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:12,929 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:12,944 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:13,201 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:13,238 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:13,252 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:13,261 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:13,492 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:13,705 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-22 22:30:13,718 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:13,769 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-22 22:30:13,795 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:14,088 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:14,147 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:14,187 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-22 22:30:14,236 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:14,484 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:14,581 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:14,641 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:14,820 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:14,872 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:14,874 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:15,154 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:15,156 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:15,234 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:15,265 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:15,445 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:15,535 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:15,642 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:15,851 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:15,963 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-22 22:30:16,050 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:16,164 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:16,223 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:16,296 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:16,359 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:16,489 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:16,514 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:16,685 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:16,741 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:16,837 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:16,859 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:17,049 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:17,050 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:17,156 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:17,242 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:17,398 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:17,419 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:17,504 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:17,601 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:17,789 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:17,818 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:17,893 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:17,926 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-22 22:30:18,115 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:18,201 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-tfilah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:18,259 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:18,290 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:18,494 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:18,541 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:18,601 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-22 22:30:18,663 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:18,844 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:18,872 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:18,932 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:19,058 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:19,135 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:19,208 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akshatasatmar/WeatherServiceApi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:19,313 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elchunenfreund/satmar-matzos-app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:19,386 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmaribianca05-eng/AFSD-Satmari-Bianca/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:19,621 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/Sefaria-Export/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:19,721 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-es6/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-22 22:30:19,795 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=300 account_new=0 list_repos=100 list_new=0 private_new=0 total_new=0
2026-09-22 22:30:19,796 - __main__ - INFO - Scraper github completed: 0 results
2026-09-22 22:30:19,796 - __main__ - INFO - Scraper github_feed completed: 0 results
2026-09-22 22:30:19,796 - __main__ - INFO - Scraper youtube_intel completed: 2 results
2026-09-22 22:30:20,486 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-22 22:30:20.486886
2026-09-22 22:30:20,487 - __main__ - INFO - Email sent successfully
2026-09-22 22:30:20,487 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-22 22:30:20,487 - __main__ - INFO - Monitor complete. Found 2 total results: 2 new youtube intel results.
2026-09-22 22:30:20,487 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-22 22:30:20,487 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-22 22:30:20,513 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-22 22:30:20,513 - __main__ - INFO - Closed all database connections
2026-09-22 22:30:20,516 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-22 22:30:20,516 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-22 23:00:01,687 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-22.log
2026-09-22 23:00:01,688 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-22.log
2026-09-22 23:00:01,688 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-22.log
2026-09-22 23:00:01,688 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-22 23:00:01,717 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-22 23:00:01,717 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-22 23:00:01,719 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-22 23:00:01,720 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-22 23:00:01,734 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-22 23:00:01,734 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-22 23:00:01,736 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-22 23:00:01,737 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-22 23:00:01,737 - __main__ - INFO - RSS scraper initialized and enabled
2026-09-22 23:00:01,742 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-22 23:00:01,742 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-22 23:00:01,742 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-09-22 23:00:01,745 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-22 23:00:01,749 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-22 23:00:01,749 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-22 23:00:01,752 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-22 23:00:01,752 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-22 23:00:01,752 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-22 23:00:01,755 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-22 23:00:01,755 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-09-22 23:00:01,755 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-22 23:00:01,755 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-09-22 23:00:01,843 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-09-22 23:00:01,848 - IveltScraper - INFO - Loaded 181 include, 4 exclude filters from DB topic_filters
2026-09-22 23:00:01,848 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-09-22 23:00:01,849 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-09-22 23:00:02,290 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-09-22 23:00:05,248 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-09-22 23:00:05,474 - Yiddish24Scraper - INFO - Received response with 496544 characters
2026-09-22 23:00:05,478 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (314838 chars)
2026-09-22 23:00:05,481 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-09-22 23:00:05,562 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-09-22 23:00:05,602 - Yiddish24Scraper - INFO - Page 1 extraction: 98 successful, 2 failed out of 100 elements
2026-09-22 23:00:05,602 - Yiddish24Scraper - INFO - Parsed 98 articles from HTML on page 1
2026-09-22 23:00:05,616 - Yiddish24Scraper - INFO - Term 'ืื‘ืจื”ื ื”ืืœืคืจื™ืŸ' matched in DESCRIPTION: 'ื’ืขื“ืื ืงืŸ ืื•ืŸ ืื‘ื–ืขืจื•ื•ืืฆื™ืขืก - ืจ' ื–ืœืžืŸ ืœื™ื™ื‘ ืคืจืขื ืงืœ ืื•ืŸ ืจ' ืื‘ืจื”ื ื”ืืœืคืจื™ืŸ'
2026-09-22 23:00:05,616 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ื”ื›ืœ ื‘ื›ืœ
2026-09-22 23:00:06,116 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/LEIBY_AVRUMY_260_260922061752.mp3
2026-09-22 23:00:07,289 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_LEIBY_AVRUMY_260_260922061752.mp3 (6.3 MB)
2026-09-22 23:00:07,291 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-09-22 23:00:07,305 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_LEIBY_AVRUMY_260_260922061752.mp3: title, artist, album, comment, source_url, genre, publisher
2026-09-22 23:00:07,305 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2_LEIBY_AVRUMY_260_260922061752_ืื‘ืจื”ื_ื”ืืœืคืจื™ืŸ.mp3
2026-09-22 23:00:07,406 - Yiddish24Scraper - INFO - Term 'ืคื•ืŸ ื“ื™ ืžื’ื™ื“'ืก ื˜ื™ืฉืœ' matched in DESCRIPTION: 'ืคื•ืŸ ื“ื™ ืžื’ื™ื“'ืก ื˜ื™ืฉืœ - ื–ื™ื™ืŸ ืคืจื™ื™ืœื™ืš ืกื•ื›ื•ืช ืื•ืŸ ื“ืขืจื ืืš ืื™ื– ืžืขืŸ ืคืจื™ื™ืœื™ืš ื ื’ืื ืฅ ื™ืืจ'
2026-09-22 23:00:07,406 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ื”ื›ืœ ื‘ื›ืœ
2026-09-22 23:00:07,907 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/__________________________________________916420910.mp3
2026-09-22 23:00:08,171 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2___________________________________________916420910.mp3 (45.5 MB)
2026-09-22 23:00:08,171 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-09-22 23:00:08,187 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2___________________________________________916420910.mp3: title, artist, album, comment, source_url, genre, publisher
2026-09-22 23:00:08,187 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2___________________________________________916420910_ืคื•ืŸ_ื“ื™_ืžื’ื™ื“_ืก_ื˜ื™ืฉืœ.mp3
2026-09-22 23:00:09,833 - Yiddish24Scraper - INFO - Page 1 summary: 10 new out of 98 total articles
2026-09-22 23:00:09,833 - Yiddish24Scraper - INFO - Page 1: 10/98 new items
2026-09-22 23:00:09,833 - Yiddish24Scraper - INFO - Low new item ratio (10.2%), stopping pagination
2026-09-22 23:00:09,834 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 10
2026-09-22 23:00:13,737 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-09-22 23:00:24,534 - IveltScraper - INFO - Filtering post containing exclude term: '*ื‘ื™ื˜ืข ืžืื›ื˜ ื–ื™ื›ืขืจ ื‘ืœื•ื™ื– ืฆื• ื‘ืืจื™ื›ื˜ืŸ ืงืจืื ื˜ืข ื ื™ื™ืขืก*'
2026-09-22 23:00:25,090 - IveltScraper - INFO - ivelt scrape complete. Checked 3 topics.
2026-09-22 23:00:25,091 - IveltScraper - INFO - All forums scrape complete. Found 6 new posts.
2026-09-22 23:00:25,091 - __main__ - INFO - Scraper rss completed: 0 results
2026-09-22 23:00:25,091 - __main__ - INFO - Scraper yiddish24 completed: 10 results
2026-09-22 23:00:25,091 - __main__ - INFO - Scraper ivelt completed: 6 results
2026-09-22 23:00:26,087 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-22 23:00:26.087514
2026-09-22 23:00:26,087 - __main__ - INFO - Email sent successfully
2026-09-22 23:00:26,088 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-22 23:00:26,088 - __main__ - INFO - Monitor complete. Found 16 total results: 10 new yiddish24 results, 6 new ivelt results.
2026-09-22 23:00:26,088 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-22 23:00:26,088 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-22 23:00:26,140 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-22 23:00:26,140 - __main__ - INFO - Closed all database connections
2026-09-22 23:00:26,142 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-22 23:00:26,142 - social_media_monitor.database.connection - INFO - Closed 0 database connections