โ† Logs

social_media_monitor_2026-09-15.log

2026-09-15 20:30:02,167 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-15 20:30:02,167 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-15 20:30:02,172 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-15 20:30:02,181 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-15 20:30:02,181 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-15 20:30:02,183 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-15 20:30:02,183 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-15 20:30:02,183 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-15 20:30:02,185 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-15 20:30:02,186 - __main__ - INFO - YouTube Intel scraper initialized and enabled
2026-09-15 20:30:02,186 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-15 20:30:02,186 - GitHubScraper - INFO - Searching GitHub for terms: ['"Hermes Agent"', '"claude code"', '"prime agent"', 'paperclip']
2026-09-15 20:30:02,605 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"
2026-09-15 20:30:02,605 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)
2026-09-15 20:30:03,359 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-15 20:30:03,384 - GitHubScraper - INFO - Found 609 GitHub repositories for term: "Hermes Agent"
2026-09-15 20:30:03,550 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"
2026-09-15 20:30:04,543 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22claude+code%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-15 20:30:04,548 - GitHubScraper - INFO - Found 8796 GitHub repositories for term: "claude code"
2026-09-15 20:30:04,610 - GitHubScraper - INFO - Added new GitHub repository: open-compute
2026-09-15 20:30:04,710 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"
2026-09-15 20:30:05,672 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22prime+agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-15 20:30:05,762 - GitHubScraper - INFO - Found 40 GitHub repositories for term: "prime agent"
2026-09-15 20:30:05,907 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:05,908 - GitHubFeedScraper - INFO - GitHub account feed page 3 unchanged (ETag)
2026-09-15 20:30:06,888 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-15 20:30:06,891 - GitHubScraper - INFO - Found 259 GitHub repositories for term: paperclip
2026-09-15 20:30:07,037 - GitHubScraper - INFO - Total GitHub results found: 1
2026-09-15 20:30:09,537 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"
2026-09-15 20:30:09,905 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:09,986 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:09,993 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:10,002 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:10,333 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:10,368 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:10,418 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:10,426 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:10,732 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:10,736 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:10,779 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:10,803 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:11,080 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:11,141 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:11,155 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:11,364 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-15 20:30:11,469 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:11,496 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/sikmenedowai-a11y/savetube-stream-kit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:11,659 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-15 20:30:11,715 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:11,855 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:11,944 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:12,082 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:12,105 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:12,237 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:12,522 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:12,597 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:12,625 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:12,658 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-15 20:30:12,867 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:13,009 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:13,209 - YouTubeIntelScraper - INFO - YouTube Intel found 40 candidates and 10 new videos
2026-09-15 20:30:13,236 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:13,257 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:13,280 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:13,382 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:13,525 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:13,779 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:13,822 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-15 20:30:13,882 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:13,927 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:14,198 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:14,247 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:14,427 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:14,445 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:14,656 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:14,804 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:14,877 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:14,956 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:15,050 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:15,117 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:15,329 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:15,388 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:15,470 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:15,494 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-15 20:30:15,743 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:15,748 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:15,932 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:16,095 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-15 20:30:16,231 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:16,309 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:16,543 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:16,613 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:16,642 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-15 20:30:16,728 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:16,928 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:17,005 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:17,030 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:17,092 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:17,322 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:17,366 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:17,399 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:17,451 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:17,675 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:17,681 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:17,764 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:17,815 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:17,964 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:18,130 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:18,135 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yeled-tov/filtertube-android/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-15 20:30:18,166 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:18,274 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:18,407 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:18,499 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:18,652 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:18,691 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-tfilah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:18,782 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:18,859 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:19,032 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:19,085 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:19,087 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:19,195 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:19,381 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:19,410 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:19,487 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:19,648 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:19,749 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:19,760 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akshatasatmar/WeatherServiceApi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:19,896 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elchunenfreund/satmar-matzos-app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:20,003 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmaribianca05-eng/AFSD-Satmari-Bianca/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:20,310 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/Sefaria-Export/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 20:30:20,384 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=200 account_new=0 list_repos=100 list_new=0 private_new=0 total_new=0
2026-09-15 20:30:20,385 - __main__ - INFO - Scraper github completed: 1 results
2026-09-15 20:30:20,385 - __main__ - INFO - Scraper github_feed completed: 0 results
2026-09-15 20:30:20,385 - __main__ - INFO - Scraper youtube_intel completed: 10 results
2026-09-15 20:30:21,053 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-15 20:30:21.053597
2026-09-15 20:30:21,053 - __main__ - INFO - Email sent successfully
2026-09-15 20:30:21,054 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-15 20:30:21,054 - __main__ - INFO - Monitor complete. Found 11 total results: 1 new github results, 10 new youtube intel results.
2026-09-15 20:30:21,054 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-15 20:30:21,054 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-15 20:30:21,076 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-15 20:30:21,077 - __main__ - INFO - Closed all database connections
2026-09-15 20:30:21,079 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-15 20:30:21,079 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-15 21:00:02,188 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-15.log
2026-09-15 21:00:02,188 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-15.log
2026-09-15 21:00:02,188 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-15.log
2026-09-15 21:00:02,188 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-15 21:00:02,220 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-15 21:00:02,220 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-15 21:00:02,223 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-15 21:00:02,223 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-15 21:00:02,246 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-15 21:00:02,246 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-15 21:00:02,254 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-15 21:00:02,256 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-15 21:00:02,256 - __main__ - INFO - RSS scraper initialized and enabled
2026-09-15 21:00:02,264 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-15 21:00:02,264 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-15 21:00:02,264 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-09-15 21:00:02,268 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-15 21:00:02,274 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-15 21:00:02,275 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-15 21:00:02,278 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-15 21:00:02,278 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-15 21:00:02,278 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-15 21:00:02,281 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-15 21:00:02,282 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-09-15 21:00:02,282 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-15 21:00:02,282 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-09-15 21:00:02,428 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-09-15 21:00:02,433 - IveltScraper - INFO - Loaded 181 include, 4 exclude filters from DB topic_filters
2026-09-15 21:00:02,433 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-09-15 21:00:02,437 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-09-15 21:00:02,746 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-09-15 21:00:05,518 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-09-15 21:00:05,736 - Yiddish24Scraper - INFO - Received response with 479892 characters
2026-09-15 21:00:05,738 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (306736 chars)
2026-09-15 21:00:05,739 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-09-15 21:00:05,814 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-09-15 21:00:05,854 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-09-15 21:00:05,854 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-09-15 21:00:05,886 - Yiddish24Scraper - INFO - Term 'ืคื•ืŸ ื“ื™ ืžื’ื™ื“'ืก ื˜ื™ืฉืœ' matched in DESCRIPTION: 'ืคื•ืŸ ื“ื™ ืžื’ื™ื“'ืก ื˜ื™ืฉืœ - ืื™ื ื˜ืขืจืขืกืื ื˜ืข ื›ืคืจื•ืช ืฉืœืื’ืŸ'
2026-09-15 21:00:05,886 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ื”ื›ืœ ื‘ื›ืœ
2026-09-15 21:00:06,386 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/__________________________________________562934567.mp3
2026-09-15 21:00:06,728 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2___________________________________________562934567.mp3 (35.0 MB)
2026-09-15 21:00:06,728 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-09-15 21:00:06,740 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2___________________________________________562934567.mp3: title, artist, album, comment, source_url, genre, publisher
2026-09-15 21:00:06,740 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2___________________________________________562934567_ืคื•ืŸ_ื“ื™_ืžื’ื™ื“_ืก_ื˜ื™ืฉืœ.mp3
2026-09-15 21:00:07,456 - Yiddish24Scraper - INFO - Page 1 summary: 4 new out of 100 total articles
2026-09-15 21:00:07,456 - Yiddish24Scraper - INFO - Page 1: 4/100 new items
2026-09-15 21:00:07,457 - Yiddish24Scraper - INFO - Low new item ratio (4.0%), stopping pagination
2026-09-15 21:00:07,457 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 4
2026-09-15 21:00:15,669 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-09-15 21:00:35,739 - IveltScraper - INFO - ivelt scrape complete. Checked 3 topics.
2026-09-15 21:00:35,740 - IveltScraper - INFO - All forums scrape complete. Found 25 new posts.
2026-09-15 21:00:35,740 - __main__ - INFO - Scraper rss completed: 0 results
2026-09-15 21:00:35,740 - __main__ - INFO - Scraper yiddish24 completed: 4 results
2026-09-15 21:00:35,740 - __main__ - INFO - Scraper ivelt completed: 25 results
2026-09-15 21:00:36,414 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-15 21:00:36.414752
2026-09-15 21:00:36,415 - __main__ - INFO - Email sent successfully
2026-09-15 21:00:36,415 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-15 21:00:36,415 - __main__ - INFO - Monitor complete. Found 29 total results: 4 new yiddish24 results, 25 new ivelt results.
2026-09-15 21:00:36,415 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-15 21:00:36,415 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-15 21:00:36,495 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-15 21:00:36,495 - __main__ - INFO - Closed all database connections
2026-09-15 21:00:36,498 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-15 21:00:36,498 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-15 22:00:02,037 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-15.log
2026-09-15 22:00:02,037 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-15.log
2026-09-15 22:00:02,038 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-15.log
2026-09-15 22:00:02,038 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-15 22:00:02,068 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-15 22:00:02,068 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-15 22:00:02,070 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-15 22:00:02,071 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-15 22:00:02,085 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-15 22:00:02,085 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-15 22:00:02,141 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-15 22:00:02,143 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-15 22:00:02,143 - __main__ - INFO - RSS scraper initialized and enabled
2026-09-15 22:00:02,149 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-15 22:00:02,149 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-15 22:00:02,149 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-09-15 22:00:02,154 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-15 22:00:02,158 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-15 22:00:02,159 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-15 22:00:02,161 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-15 22:00:02,161 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-15 22:00:02,161 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-15 22:00:02,163 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-15 22:00:02,163 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-09-15 22:00:02,164 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-15 22:00:02,164 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-09-15 22:00:02,260 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-09-15 22:00:02,265 - IveltScraper - INFO - Loaded 181 include, 4 exclude filters from DB topic_filters
2026-09-15 22:00:02,265 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-09-15 22:00:02,266 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-09-15 22:00:02,590 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-09-15 22:00:04,540 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-09-15 22:00:04,765 - Yiddish24Scraper - INFO - Received response with 487541 characters
2026-09-15 22:00:04,768 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (310237 chars)
2026-09-15 22:00:04,771 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-09-15 22:00:04,852 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-09-15 22:00:04,894 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-09-15 22:00:04,894 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-09-15 22:00:04,958 - Yiddish24Scraper - INFO - Term 'ื ื’ื•ื˜ ื•ื•ืืจื˜' matched in DESCRIPTION: 'ื ื’ื•ื˜ ื•ื•ืืจื˜ - ื—ื˜"ื ืื™ื– ืื•ื™ืš ื‘ื’ืž' ื—ื˜"ื'
2026-09-15 22:00:04,958 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ื”ื›ืœ ื‘ื›ืœ
2026-09-15 22:00:05,459 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/___________________________260_260915033234.mp3
2026-09-15 22:00:05,593 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2____________________________260_260915033234.mp3 (10.8 MB)
2026-09-15 22:00:05,593 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-09-15 22:00:05,600 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2____________________________260_260915033234.mp3: title, artist, album, comment, source_url, genre, publisher
2026-09-15 22:00:05,600 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2____________________________260_260915033234_ื_ื’ื•ื˜_ื•ื•ืืจื˜.mp3
2026-09-15 22:00:06,230 - Yiddish24Scraper - INFO - Page 1 summary: 6 new out of 100 total articles
2026-09-15 22:00:06,230 - Yiddish24Scraper - INFO - Page 1: 6/100 new items
2026-09-15 22:00:06,230 - Yiddish24Scraper - INFO - Low new item ratio (6.0%), stopping pagination
2026-09-15 22:00:06,231 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 6
2026-09-15 22:00:14,229 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-09-15 22:00:37,645 - IveltScraper - INFO - ivelt scrape complete. Checked 5 topics.
2026-09-15 22:00:37,645 - IveltScraper - INFO - All forums scrape complete. Found 34 new posts.
2026-09-15 22:00:37,646 - __main__ - INFO - Scraper rss completed: 0 results
2026-09-15 22:00:37,646 - __main__ - INFO - Scraper yiddish24 completed: 6 results
2026-09-15 22:00:37,646 - __main__ - INFO - Scraper ivelt completed: 34 results
2026-09-15 22:00:38,868 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-15 22:00:38.868489
2026-09-15 22:00:38,868 - __main__ - INFO - Email sent successfully
2026-09-15 22:00:38,868 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-15 22:00:38,868 - __main__ - INFO - Monitor complete. Found 40 total results: 6 new yiddish24 results, 34 new ivelt results.
2026-09-15 22:00:38,868 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-15 22:00:38,868 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-15 22:00:38,942 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-15 22:00:38,942 - __main__ - INFO - Closed all database connections
2026-09-15 22:00:38,944 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-15 22:00:38,944 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-15 22:30:02,099 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-15.log
2026-09-15 22:30:02,100 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-15.log
2026-09-15 22:30:02,100 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-15.log
2026-09-15 22:30:02,100 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-15 22:30:02,142 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-15 22:30:02,142 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-15 22:30:02,144 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-15 22:30:02,145 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-15 22:30:02,158 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-15 22:30:02,158 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-15 22:30:02,160 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-15 22:30:02,161 - __main__ - INFO - GitHub scraper initialized and enabled
2026-09-15 22:30:02,161 - __main__ - INFO - GitHub feed scraper initialized and enabled
2026-09-15 22:30:02,161 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-15 22:30:02,165 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-15 22:30:02,165 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-15 22:30:02,170 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-15 22:30:02,175 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-15 22:30:02,175 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-15 22:30:02,177 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-15 22:30:02,177 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-15 22:30:02,177 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-15 22:30:02,179 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-15 22:30:02,180 - __main__ - INFO - YouTube Intel scraper initialized and enabled
2026-09-15 22:30:02,180 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-15 22:30:02,180 - GitHubScraper - INFO - Searching GitHub for terms: ['"Hermes Agent"', '"claude code"', '"prime agent"', 'paperclip']
2026-09-15 22:30:02,596 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"
2026-09-15 22:30:02,596 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)
2026-09-15 22:30:03,342 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-15 22:30:03,368 - GitHubScraper - INFO - Found 610 GitHub repositories for term: "Hermes Agent"
2026-09-15 22:30:03,514 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"
2026-09-15 22:30:04,380 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22claude+code%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-15 22:30:04,473 - GitHubScraper - INFO - Found 8794 GitHub repositories for term: "claude code"
2026-09-15 22:30:04,545 - GitHubScraper - INFO - Added new GitHub repository: cyrus
2026-09-15 22:30:04,562 - GitHubScraper - INFO - Added new GitHub repository: claudebox
2026-09-15 22:30:04,619 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"
2026-09-15 22:30:05,502 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22prime+agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-15 22:30:05,601 - GitHubScraper - INFO - Found 40 GitHub repositories for term: "prime agent"
2026-09-15 22:30:05,877 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:05,878 - GitHubFeedScraper - INFO - GitHub account feed page 3 unchanged (ETag)
2026-09-15 22:30:06,813 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-15 22:30:06,912 - GitHubScraper - INFO - Found 259 GitHub repositories for term: paperclip
2026-09-15 22:30:07,053 - GitHubScraper - INFO - Total GitHub results found: 2
2026-09-15 22:30:09,503 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"
2026-09-15 22:30:09,919 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:09,948 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:09,983 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:10,018 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:10,278 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:10,313 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:10,323 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:10,338 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:10,617 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:10,659 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:10,689 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:10,741 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:10,972 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:10,975 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:11,058 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:11,263 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-15 22:30:11,386 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:11,503 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-15 22:30:11,541 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/sikmenedowai-a11y/savetube-stream-kit/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-15 22:30:11,603 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:11,768 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:11,819 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:11,903 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:11,922 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:12,100 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:12,428 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:12,449 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:12,459 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:12,530 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:12,764 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:12,770 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:13,059 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:13,091 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:13,094 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:13,121 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:13,188 - YouTubeIntelScraper - INFO - YouTube Intel found 40 candidates and 4 new videos
2026-09-15 22:30:13,346 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:13,565 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:13,631 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-15 22:30:13,687 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:13,711 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:13,959 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:13,998 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:14,096 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-15 22:30:14,233 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-15 22:30:14,328 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:14,513 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:14,520 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:14,579 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:14,659 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:14,892 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:14,948 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:15,030 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:15,053 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:15,260 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:15,283 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:15,307 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:15,732 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-15 22:30:15,764 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-15 22:30:15,841 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:15,863 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-15 22:30:16,144 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:16,189 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:16,201 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-15 22:30:16,261 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:16,528 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:16,545 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:16,591 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:16,678 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:16,855 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:16,904 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:16,921 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:16,983 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:17,228 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:17,290 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:17,319 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:17,355 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:17,587 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:17,660 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:17,664 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:17,744 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yeled-tov/filtertube-android/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-15 22:30:17,970 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:18,010 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:18,058 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:18,224 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-tfilah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:18,291 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:18,327 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:18,333 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:18,664 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:18,675 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:18,774 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:18,834 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:18,999 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:19,028 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:19,093 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:19,267 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:19,345 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:19,399 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akshatasatmar/WeatherServiceApi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:19,428 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elchunenfreund/satmar-matzos-app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:19,704 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmaribianca05-eng/AFSD-Satmari-Bianca/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:19,842 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/Sefaria-Export/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-15 22:30:19,920 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=200 account_new=0 list_repos=100 list_new=3 private_new=0 total_new=3
2026-09-15 22:30:19,922 - __main__ - INFO - Scraper github completed: 2 results
2026-09-15 22:30:19,923 - __main__ - INFO - Scraper github_feed completed: 3 results
2026-09-15 22:30:19,923 - __main__ - INFO - Scraper youtube_intel completed: 4 results
2026-09-15 22:30:20,763 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-15 22:30:20.763002
2026-09-15 22:30:20,763 - __main__ - INFO - Email sent successfully
2026-09-15 22:30:20,789 - __main__ - INFO - GitHub feed delivery acknowledged: 3 stored, 0 failed
2026-09-15 22:30:20,789 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-15 22:30:20,789 - __main__ - INFO - Monitor complete. Found 9 total results: 2 new github results, 3 new github feed results, 4 new youtube intel results.
2026-09-15 22:30:20,790 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-15 22:30:20,790 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-15 22:30:20,830 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-15 22:30:20,830 - __main__ - INFO - Closed all database connections
2026-09-15 22:30:20,833 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-15 22:30:20,833 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-15 23:00:01,956 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-15.log
2026-09-15 23:00:01,956 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-15.log
2026-09-15 23:00:01,956 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-15.log
2026-09-15 23:00:01,956 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-15 23:00:01,984 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-15 23:00:01,985 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-15 23:00:01,987 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-15 23:00:01,987 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-15 23:00:02,004 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-15 23:00:02,004 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-15 23:00:02,010 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-15 23:00:02,012 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-15 23:00:02,012 - __main__ - INFO - RSS scraper initialized and enabled
2026-09-15 23:00:02,018 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-15 23:00:02,018 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-15 23:00:02,018 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-09-15 23:00:02,024 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-15 23:00:02,032 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-15 23:00:02,032 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-15 23:00:02,034 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-15 23:00:02,034 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-15 23:00:02,034 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-15 23:00:02,036 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-15 23:00:02,036 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-09-15 23:00:02,037 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-15 23:00:02,037 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-09-15 23:00:02,130 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-09-15 23:00:02,135 - IveltScraper - INFO - Loaded 181 include, 4 exclude filters from DB topic_filters
2026-09-15 23:00:02,135 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-09-15 23:00:02,137 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-09-15 23:00:02,457 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-09-15 23:00:05,657 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-09-15 23:00:05,866 - Yiddish24Scraper - INFO - Received response with 487783 characters
2026-09-15 23:00:05,868 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (310314 chars)
2026-09-15 23:00:05,870 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-09-15 23:00:05,964 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-09-15 23:00:06,012 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-09-15 23:00:06,012 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-09-15 23:00:06,020 - Yiddish24Scraper - INFO - Term 'ืขืจืฉื˜ื”ืื ื˜ื™ื’' matched in DESCRIPTION: 'ืขืจืฉื˜ื”ืื ื˜ื™ื’ - ื’ืขืจืื˜ืขื•ื•ืขื˜ ื“ืืก ืงื™ื ื“ ืžื™ื˜ ื ืกื™ ื ืกื™ื ืžื™ื˜ ื“ื™ ื›ื— ืคื•ืŸ ืชืคืœื”'
2026-09-15 23:00:06,020 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ื”ื›ืœ ื‘ื›ืœ
2026-09-15 23:00:06,521 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/__________________________________________501086344.mp3
2026-09-15 23:00:07,567 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2___________________________________________501086344.mp3 (4.3 MB)
2026-09-15 23:00:07,568 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-09-15 23:00:07,580 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2___________________________________________501086344.mp3: title, artist, album, comment, source_url, genre, publisher
2026-09-15 23:00:07,580 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2___________________________________________501086344_ืขืจืฉื˜ื”ืื ื˜ื™ื’.mp3
2026-09-15 23:00:08,838 - Yiddish24Scraper - INFO - Page 1 summary: 1 new out of 100 total articles
2026-09-15 23:00:08,838 - Yiddish24Scraper - INFO - Page 1: 1/100 new items
2026-09-15 23:00:08,838 - Yiddish24Scraper - INFO - Low new item ratio (1.0%), stopping pagination
2026-09-15 23:00:08,838 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 1
2026-09-15 23:00:14,184 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-09-15 23:00:17,191 - IveltScraper - INFO - Filtering post containing exclude term: '*ื‘ื™ื˜ืข ืžืื›ื˜ ื–ื™ื›ืขืจ ื‘ืœื•ื™ื– ืฆื• ื‘ืืจื™ื›ื˜ืŸ ืงืจืื ื˜ืข ื ื™ื™ืขืก*'
2026-09-15 23:00:54,815 - IveltScraper - INFO - ivelt scrape complete. Checked 6 topics.
2026-09-15 23:00:54,815 - IveltScraper - INFO - All forums scrape complete. Found 28 new posts.
2026-09-15 23:00:54,815 - __main__ - INFO - Scraper rss completed: 0 results
2026-09-15 23:00:54,816 - __main__ - INFO - Scraper yiddish24 completed: 1 results
2026-09-15 23:00:54,816 - __main__ - INFO - Scraper ivelt completed: 28 results
2026-09-15 23:00:55,582 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-15 23:00:55.582384
2026-09-15 23:00:55,582 - __main__ - INFO - Email sent successfully
2026-09-15 23:00:55,583 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-15 23:00:55,583 - __main__ - INFO - Monitor complete. Found 29 total results: 1 new yiddish24 results, 28 new ivelt results.
2026-09-15 23:00:55,583 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-15 23:00:55,583 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-15 23:00:55,659 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-15 23:00:55,659 - __main__ - INFO - Closed all database connections
2026-09-15 23:00:55,661 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-15 23:00:55,661 - social_media_monitor.database.connection - INFO - Closed 0 database connections