← Logs

social_media_monitor_2026-09-14.log

2026-09-14 20:30:02,267 - __main__ - INFO - GitHub scraper initialized and enabled

2026-09-14 20:30:02,267 - __main__ - INFO - GitHub feed scraper initialized and enabled

2026-09-14 20:30:02,268 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-09-14 20:30:02,277 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled

2026-09-14 20:30:02,277 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0

2026-09-14 20:30:02,284 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-09-14 20:30:02,291 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled

2026-09-14 20:30:02,291 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13

2026-09-14 20:30:02,294 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-09-14 20:30:02,295 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2

2026-09-14 20:30:02,295 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0

2026-09-14 20:30:02,298 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0

2026-09-14 20:30:02,299 - __main__ - INFO - YouTube Intel scraper initialized and enabled

2026-09-14 20:30:02,299 - __main__ - INFO - Running 3 scrapers concurrently...

2026-09-14 20:30:02,299 - GitHubScraper - INFO - Searching GitHub for terms: ['"Hermes Agent"', '"claude code"', '"prime agent"', 'paperclip']

2026-09-14 20:30:02,825 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"

2026-09-14 20:30:02,826 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)

2026-09-14 20:30:03,625 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-09-14 20:30:03,652 - GitHubScraper - INFO - Found 607 GitHub repositories for term: "Hermes Agent"

2026-09-14 20:30:03,831 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"

2026-09-14 20:30:04,759 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22claude+code%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-09-14 20:30:04,850 - GitHubScraper - INFO - Found 8758 GitHub repositories for term: "claude code"

2026-09-14 20:30:04,861 - GitHubScraper - INFO - Added new GitHub repository: EasyAdminBundle

2026-09-14 20:30:04,886 - GitHubScraper - INFO - Added new GitHub repository: centaur

2026-09-14 20:30:04,959 - GitHubScraper - INFO - Added new GitHub repository: flue

2026-09-14 20:30:04,982 - GitHubScraper - INFO - Added new GitHub repository: tree-sitter-language-pack

2026-09-14 20:30:05,007 - GitHubScraper - INFO - Added new GitHub repository: lucumr

2026-09-14 20:30:05,035 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"

2026-09-14 20:30:05,941 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22prime+agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-09-14 20:30:05,945 - GitHubScraper - INFO - Found 40 GitHub repositories for term: "prime agent"

2026-09-14 20:30:06,160 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:06,161 - GitHubFeedScraper - INFO - GitHub account feed page 3 unchanged (ETag)

2026-09-14 20:30:07,168 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-09-14 20:30:07,192 - GitHubScraper - INFO - Found 259 GitHub repositories for term: paperclip

2026-09-14 20:30:07,337 - GitHubScraper - INFO - Total GitHub results found: 5

2026-09-14 20:30:09,864 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"

2026-09-14 20:30:10,181 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:10,298 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:10,354 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:10,366 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:10,596 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:10,614 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:10,775 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:10,906 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:11,050 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:11,232 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:11,338 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:11,401 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:11,708 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:11,715 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:11,720 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:11,851 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:12,156 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:12,247 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/sikmenedowai-a11y/savetube-stream-kit/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:12,257 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:12,275 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-14 20:30:12,443 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:12,593 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:12,673 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:12,740 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:12,773 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:13,140 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:13,162 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:13,193 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:13,313 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:13,507 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:13,568 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:13,710 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:13,814 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:13,946 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:13,993 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:14,122 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:14,281 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-14 20:30:14,517 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:14,531 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-14 20:30:14,559 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:14,748 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:14,845 - YouTubeIntelScraper - INFO - YouTube Intel found 48 candidates and 9 new videos

2026-09-14 20:30:14,937 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:15,055 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:15,064 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:15,148 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:15,383 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-14 20:30:15,472 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:15,474 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:15,503 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:15,673 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:15,783 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:15,903 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:15,931 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:16,155 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:16,228 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:16,349 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:16,385 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:16,667 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:16,688 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:16,800 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:16,867 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:16,982 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:17,002 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:17,217 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:17,239 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-14 20:30:17,300 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:17,354 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:17,594 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:17,717 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:17,752 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:17,755 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:18,013 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:18,024 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:18,162 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:18,229 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:18,285 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:18,428 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:18,626 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:18,655 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yeled-tov/filtertube-android/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:18,793 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:18,805 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:19,026 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:19,049 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:19,188 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:19,258 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-tfilah/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:19,392 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:19,412 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:19,508 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:19,669 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:19,750 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:19,781 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:19,879 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:20,029 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:20,118 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:20,209 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:20,233 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:20,378 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akshatasatmar/WeatherServiceApi/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:20,407 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elchunenfreund/satmar-matzos-app/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:20,607 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmaribianca05-eng/AFSD-Satmari-Bianca/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:20,782 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/Sefaria-Export/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 20:30:20,816 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=200 account_new=0 list_repos=100 list_new=0 private_new=0 total_new=0

2026-09-14 20:30:20,817 - __main__ - INFO - Scraper github completed: 5 results

2026-09-14 20:30:20,817 - __main__ - INFO - Scraper github_feed completed: 0 results

2026-09-14 20:30:20,817 - __main__ - INFO - Scraper youtube_intel completed: 9 results

2026-09-14 20:30:21,460 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-14 20:30:21.460892

2026-09-14 20:30:21,461 - __main__ - INFO - Email sent successfully

2026-09-14 20:30:21,461 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-09-14 20:30:21,461 - __main__ - INFO - Monitor complete. Found 14 total results: 5 new github results, 9 new youtube intel results.

2026-09-14 20:30:21,461 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-09-14 20:30:21,461 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-14 20:30:21,495 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-09-14 20:30:21,495 - __main__ - INFO - Closed all database connections

2026-09-14 20:30:21,498 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-14 20:30:21,498 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-09-14 21:00:02,243 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-14.log

2026-09-14 21:00:02,243 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-14.log

2026-09-14 21:00:02,243 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-14.log

2026-09-14 21:00:02,243 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-09-14 21:00:02,273 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-09-14 21:00:02,273 - __main__ - INFO - Configuration loaded and validated successfully

2026-09-14 21:00:02,275 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-09-14 21:00:02,276 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-09-14 21:00:02,295 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-09-14 21:00:02,295 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-09-14 21:00:02,303 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')

2026-09-14 21:00:02,306 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-09-14 21:00:02,306 - __main__ - INFO - RSS scraper initialized and enabled

2026-09-14 21:00:02,313 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled

2026-09-14 21:00:02,313 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0

2026-09-14 21:00:02,313 - __main__ - INFO - Yiddish24 scraper initialized and enabled

2026-09-14 21:00:02,319 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-09-14 21:00:02,328 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled

2026-09-14 21:00:02,328 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13

2026-09-14 21:00:02,332 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-09-14 21:00:02,332 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2

2026-09-14 21:00:02,332 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0

2026-09-14 21:00:02,337 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0

2026-09-14 21:00:02,337 - __main__ - INFO - Ivelt scraper initialized and enabled

2026-09-14 21:00:02,337 - __main__ - INFO - Running 3 scrapers concurrently...

2026-09-14 21:00:02,338 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)

2026-09-14 21:00:02,436 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100

2026-09-14 21:00:02,441 - IveltScraper - INFO - Loaded 181 include, 4 exclude filters from DB topic_filters

2026-09-14 21:00:02,441 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...

2026-09-14 21:00:02,442 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed

2026-09-14 21:00:02,858 - RSSFeedScraper - INFO - Total RSS/HTML results: 0

2026-09-14 21:00:05,876 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"

2026-09-14 21:00:06,098 - Yiddish24Scraper - INFO - Received response with 473089 characters

2026-09-14 21:00:06,102 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (301324 chars)

2026-09-14 21:00:06,105 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html

2026-09-14 21:00:06,186 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1

2026-09-14 21:00:06,228 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements

2026-09-14 21:00:06,228 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1

2026-09-14 21:00:06,308 - Yiddish24Scraper - INFO - Term 'מערקווירדיג -' matched in DESCRIPTION: 'מערקווירדיג - אז מען איז פארבינדען פון אויבן פאלט מען נישט פון אונטן'

2026-09-14 21:00:06,308 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: הכל בכל

2026-09-14 21:00:06,809 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/ChokLYisroelHaazinuDay1RYo1_260_260914043506.mp3

2026-09-14 21:00:07,829 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_ChokLYisroelHaazinuDay1RYo1_260_260914043506.mp3 (4.4 MB)

2026-09-14 21:00:07,829 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)

2026-09-14 21:00:07,836 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_ChokLYisroelHaazinuDay1RYo1_260_260914043506.mp3: title, artist, album, comment, source_url, genre, publisher

2026-09-14 21:00:07,836 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2_ChokLYisroelHaazinuDay1RYo1_260_260914043506_מערקווירדיג_-.mp3

2026-09-14 21:00:08,769 - Yiddish24Scraper - INFO - Page 1 summary: 10 new out of 100 total articles

2026-09-14 21:00:08,769 - Yiddish24Scraper - INFO - Page 1: 10/100 new items

2026-09-14 21:00:08,770 - Yiddish24Scraper - INFO - Low new item ratio (10.0%), stopping pagination

2026-09-14 21:00:08,770 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 10

2026-09-14 21:00:14,663 - IveltScraper - INFO - Found 50 active topics on ivelt

2026-09-14 21:00:33,237 - IveltScraper - INFO - ivelt scrape complete. Checked 4 topics.

2026-09-14 21:00:33,237 - IveltScraper - INFO - All forums scrape complete. Found 23 new posts.

2026-09-14 21:00:33,237 - __main__ - INFO - Scraper rss completed: 0 results

2026-09-14 21:00:33,237 - __main__ - INFO - Scraper yiddish24 completed: 10 results

2026-09-14 21:00:33,237 - __main__ - INFO - Scraper ivelt completed: 23 results

2026-09-14 21:00:34,286 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-14 21:00:34.286406

2026-09-14 21:00:34,286 - __main__ - INFO - Email sent successfully

2026-09-14 21:00:34,287 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-09-14 21:00:34,287 - __main__ - INFO - Monitor complete. Found 33 total results: 10 new yiddish24 results, 23 new ivelt results.

2026-09-14 21:00:34,287 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-09-14 21:00:34,287 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-14 21:00:34,366 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-09-14 21:00:34,367 - __main__ - INFO - Closed all database connections

2026-09-14 21:00:34,368 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-14 21:00:34,369 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-09-14 22:00:02,484 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-14.log

2026-09-14 22:00:02,485 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-14.log

2026-09-14 22:00:02,485 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-14.log

2026-09-14 22:00:02,485 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-09-14 22:00:02,514 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-09-14 22:00:02,514 - __main__ - INFO - Configuration loaded and validated successfully

2026-09-14 22:00:02,517 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-09-14 22:00:02,517 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-09-14 22:00:02,534 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-09-14 22:00:02,534 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-09-14 22:00:02,593 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')

2026-09-14 22:00:02,595 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-09-14 22:00:02,595 - __main__ - INFO - RSS scraper initialized and enabled

2026-09-14 22:00:02,604 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled

2026-09-14 22:00:02,604 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0

2026-09-14 22:00:02,604 - __main__ - INFO - Yiddish24 scraper initialized and enabled

2026-09-14 22:00:02,609 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-09-14 22:00:02,618 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled

2026-09-14 22:00:02,618 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13

2026-09-14 22:00:02,621 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-09-14 22:00:02,621 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2

2026-09-14 22:00:02,621 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0

2026-09-14 22:00:02,623 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0

2026-09-14 22:00:02,623 - __main__ - INFO - Ivelt scraper initialized and enabled

2026-09-14 22:00:02,624 - __main__ - INFO - Running 3 scrapers concurrently...

2026-09-14 22:00:02,624 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)

2026-09-14 22:00:02,720 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100

2026-09-14 22:00:02,725 - IveltScraper - INFO - Loaded 181 include, 4 exclude filters from DB topic_filters

2026-09-14 22:00:02,725 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...

2026-09-14 22:00:02,726 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed

2026-09-14 22:00:03,014 - RSSFeedScraper - INFO - Total RSS/HTML results: 0

2026-09-14 22:00:04,700 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"

2026-09-14 22:00:04,929 - Yiddish24Scraper - INFO - Received response with 473316 characters

2026-09-14 22:00:04,932 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (301320 chars)

2026-09-14 22:00:04,936 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html

2026-09-14 22:00:05,011 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1

2026-09-14 22:00:05,050 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements

2026-09-14 22:00:05,051 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1

2026-09-14 22:00:05,764 - Yiddish24Scraper - INFO - Page 1 summary: 1 new out of 100 total articles

2026-09-14 22:00:05,764 - Yiddish24Scraper - INFO - Page 1: 1/100 new items

2026-09-14 22:00:05,764 - Yiddish24Scraper - INFO - Low new item ratio (1.0%), stopping pagination

2026-09-14 22:00:05,765 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 1

2026-09-14 22:00:14,924 - IveltScraper - INFO - Found 50 active topics on ivelt

2026-09-14 22:00:32,831 - IveltScraper - INFO - Filtering post containing exclude term: '*ביטע מאכט זיכער בלויז צו באריכטן קראנטע נייעס*'

2026-09-14 22:00:33,368 - IveltScraper - INFO - ivelt scrape complete. Checked 3 topics.

2026-09-14 22:00:33,368 - IveltScraper - INFO - All forums scrape complete. Found 27 new posts.

2026-09-14 22:00:33,369 - __main__ - INFO - Scraper rss completed: 0 results

2026-09-14 22:00:33,369 - __main__ - INFO - Scraper yiddish24 completed: 1 results

2026-09-14 22:00:33,369 - __main__ - INFO - Scraper ivelt completed: 27 results

2026-09-14 22:00:34,085 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-14 22:00:34.085754

2026-09-14 22:00:34,086 - __main__ - INFO - Email sent successfully

2026-09-14 22:00:34,086 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-09-14 22:00:34,086 - __main__ - INFO - Monitor complete. Found 28 total results: 1 new yiddish24 results, 27 new ivelt results.

2026-09-14 22:00:34,086 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-09-14 22:00:34,086 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-14 22:00:34,169 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-09-14 22:00:34,169 - __main__ - INFO - Closed all database connections

2026-09-14 22:00:34,171 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-14 22:00:34,171 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-09-14 22:30:02,328 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-14.log

2026-09-14 22:30:02,328 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-14.log

2026-09-14 22:30:02,328 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-14.log

2026-09-14 22:30:02,328 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-09-14 22:30:02,358 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-09-14 22:30:02,358 - __main__ - INFO - Configuration loaded and validated successfully

2026-09-14 22:30:02,361 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-09-14 22:30:02,361 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-09-14 22:30:02,378 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-09-14 22:30:02,379 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-09-14 22:30:02,384 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')

2026-09-14 22:30:02,385 - __main__ - INFO - GitHub scraper initialized and enabled

2026-09-14 22:30:02,385 - __main__ - INFO - GitHub feed scraper initialized and enabled

2026-09-14 22:30:02,386 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-09-14 22:30:02,392 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled

2026-09-14 22:30:02,393 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0

2026-09-14 22:30:02,396 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-09-14 22:30:02,400 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled

2026-09-14 22:30:02,401 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13

2026-09-14 22:30:02,403 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-09-14 22:30:02,403 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2

2026-09-14 22:30:02,403 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0

2026-09-14 22:30:02,405 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0

2026-09-14 22:30:02,406 - __main__ - INFO - YouTube Intel scraper initialized and enabled

2026-09-14 22:30:02,406 - __main__ - INFO - Running 3 scrapers concurrently...

2026-09-14 22:30:02,406 - GitHubScraper - INFO - Searching GitHub for terms: ['"Hermes Agent"', '"claude code"', '"prime agent"', 'paperclip']

2026-09-14 22:30:02,856 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"

2026-09-14 22:30:02,856 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)

2026-09-14 22:30:04,048 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"

2026-09-14 22:30:04,183 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-09-14 22:30:04,210 - GitHubScraper - INFO - Found 607 GitHub repositories for term: "Hermes Agent"

2026-09-14 22:30:05,377 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"

2026-09-14 22:30:05,439 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22claude+code%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-09-14 22:30:05,442 - GitHubScraper - INFO - Found 8763 GitHub repositories for term: "claude code"

2026-09-14 22:30:05,512 - GitHubScraper - INFO - Added new GitHub repository: igv

2026-09-14 22:30:05,531 - GitHubScraper - INFO - Added new GitHub repository: switchboard

2026-09-14 22:30:05,543 - GitHubScraper - INFO - Added new GitHub repository: sashiko

2026-09-14 22:30:05,640 - GitHubScraper - INFO - Added new GitHub repository: PyAutoLens

2026-09-14 22:30:06,769 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 200 OK"

2026-09-14 22:30:06,926 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22prime+agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-09-14 22:30:06,929 - GitHubScraper - INFO - Found 40 GitHub repositories for term: "prime agent"

2026-09-14 22:30:08,047 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-09-14 22:30:08,141 - GitHubScraper - INFO - Found 259 GitHub repositories for term: paperclip

2026-09-14 22:30:08,282 - GitHubScraper - INFO - Total GitHub results found: 4

2026-09-14 22:30:09,800 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"

2026-09-14 22:30:10,156 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:10,217 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:10,338 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-14 22:30:10,348 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:10,570 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:10,695 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:10,702 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:10,786 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:11,028 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-14 22:30:11,098 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:11,101 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:11,196 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:11,326 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:11,427 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:11,507 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:11,681 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:11,920 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/sikmenedowai-a11y/savetube-stream-kit/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-14 22:30:11,924 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:12,067 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:12,251 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-14 22:30:12,275 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:12,391 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:12,493 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:12,644 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:12,672 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:12,928 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:12,993 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:13,104 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:13,233 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:13,272 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:13,319 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:13,497 - YouTubeIntelScraper - INFO - YouTube Intel found 48 candidates and 5 new videos

2026-09-14 22:30:13,645 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:13,728 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:13,802 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:13,953 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:13,992 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:14,314 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-14 22:30:14,344 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:14,351 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:14,496 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:14,693 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:14,786 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:14,864 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-14 22:30:14,900 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:15,190 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-14 22:30:15,193 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:15,231 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:15,368 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:15,572 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:15,599 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:15,729 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:15,805 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:15,941 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:16,038 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-14 22:30:16,107 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:16,159 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:16,355 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:16,521 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:16,577 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:16,742 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:16,924 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:16,938 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:16,964 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:17,205 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:17,238 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:17,253 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:17,311 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:17,564 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:17,596 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:17,603 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:17,837 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:17,855 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:17,915 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:17,928 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:18,170 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:18,306 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:18,347 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:18,473 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yeled-tov/filtertube-android/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:18,586 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:18,645 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:18,712 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:18,961 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:18,965 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:19,045 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:19,138 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-tfilah/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:19,258 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:19,330 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:19,391 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:19,596 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:19,675 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:19,705 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:19,736 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:20,118 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:20,120 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:20,132 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:20,162 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:20,481 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akshatasatmar/WeatherServiceApi/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:20,515 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elchunenfreund/satmar-matzos-app/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:20,572 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmaribianca05-eng/AFSD-Satmari-Bianca/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:20,739 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/Sefaria-Export/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-14 22:30:20,792 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=236 account_new=0 list_repos=100 list_new=0 private_new=0 total_new=0

2026-09-14 22:30:20,793 - __main__ - INFO - Scraper github completed: 4 results

2026-09-14 22:30:20,794 - __main__ - INFO - Scraper github_feed completed: 0 results

2026-09-14 22:30:20,794 - __main__ - INFO - Scraper youtube_intel completed: 5 results

2026-09-14 22:30:21,460 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-14 22:30:21.460540

2026-09-14 22:30:21,460 - __main__ - INFO - Email sent successfully

2026-09-14 22:30:21,461 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-09-14 22:30:21,461 - __main__ - INFO - Monitor complete. Found 9 total results: 4 new github results, 5 new youtube intel results.

2026-09-14 22:30:21,461 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-09-14 22:30:21,461 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-14 22:30:21,484 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-09-14 22:30:21,484 - __main__ - INFO - Closed all database connections

2026-09-14 22:30:21,486 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-14 22:30:21,486 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-09-14 23:00:02,495 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-14.log

2026-09-14 23:00:02,496 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-14.log

2026-09-14 23:00:02,496 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-14.log

2026-09-14 23:00:02,496 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-09-14 23:00:02,525 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-09-14 23:00:02,525 - __main__ - INFO - Configuration loaded and validated successfully

2026-09-14 23:00:02,527 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-09-14 23:00:02,528 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-09-14 23:00:02,541 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-09-14 23:00:02,542 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-09-14 23:00:02,545 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')

2026-09-14 23:00:02,546 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-09-14 23:00:02,546 - __main__ - INFO - RSS scraper initialized and enabled

2026-09-14 23:00:02,551 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled

2026-09-14 23:00:02,551 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0

2026-09-14 23:00:02,551 - __main__ - INFO - Yiddish24 scraper initialized and enabled

2026-09-14 23:00:02,557 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-09-14 23:00:02,562 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled

2026-09-14 23:00:02,562 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13

2026-09-14 23:00:02,564 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-09-14 23:00:02,564 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2

2026-09-14 23:00:02,564 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0

2026-09-14 23:00:02,567 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0

2026-09-14 23:00:02,567 - __main__ - INFO - Ivelt scraper initialized and enabled

2026-09-14 23:00:02,567 - __main__ - INFO - Running 3 scrapers concurrently...

2026-09-14 23:00:02,567 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)

2026-09-14 23:00:02,675 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100

2026-09-14 23:00:02,681 - IveltScraper - INFO - Loaded 181 include, 4 exclude filters from DB topic_filters

2026-09-14 23:00:02,681 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...

2026-09-14 23:00:02,684 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed

2026-09-14 23:00:02,977 - RSSFeedScraper - INFO - Total RSS/HTML results: 0

2026-09-14 23:00:04,651 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"

2026-09-14 23:00:04,867 - Yiddish24Scraper - INFO - Received response with 480633 characters

2026-09-14 23:00:04,868 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (300740 chars)

2026-09-14 23:00:04,870 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html

2026-09-14 23:00:04,948 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1

2026-09-14 23:00:04,991 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements

2026-09-14 23:00:04,991 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1

2026-09-14 23:00:05,123 - Yiddish24Scraper - INFO - Term 'א גוט ווארט' matched in DESCRIPTION: 'א גוט ווארט -'

2026-09-14 23:00:05,123 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: הכל בכל

2026-09-14 23:00:05,624 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/OLD______________260_260914061409.mp3

2026-09-14 23:00:05,823 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_OLD______________260_260914061409.mp3 (2.0 MB)

2026-09-14 23:00:05,823 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)

2026-09-14 23:00:05,834 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_OLD______________260_260914061409.mp3: title, artist, album, comment, source_url, genre, publisher

2026-09-14 23:00:05,834 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2_OLD______________260_260914061409_א_גוט_ווארט.mp3

2026-09-14 23:00:06,481 - Yiddish24Scraper - INFO - Page 1 summary: 12 new out of 100 total articles

2026-09-14 23:00:06,482 - Yiddish24Scraper - INFO - Page 1: 12/100 new items

2026-09-14 23:00:06,482 - Yiddish24Scraper - INFO - Low new item ratio (12.0%), stopping pagination

2026-09-14 23:00:06,482 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 12

2026-09-14 23:00:14,641 - IveltScraper - INFO - Found 50 active topics on ivelt

2026-09-14 23:00:21,901 - IveltScraper - INFO - ivelt scrape complete. Checked 2 topics.

2026-09-14 23:00:21,901 - IveltScraper - INFO - All forums scrape complete. Found 6 new posts.

2026-09-14 23:00:21,902 - __main__ - INFO - Scraper rss completed: 0 results

2026-09-14 23:00:21,902 - __main__ - INFO - Scraper yiddish24 completed: 12 results

2026-09-14 23:00:21,902 - __main__ - INFO - Scraper ivelt completed: 6 results

2026-09-14 23:00:22,638 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-14 23:00:22.638359

2026-09-14 23:00:22,638 - __main__ - INFO - Email sent successfully

2026-09-14 23:00:22,638 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-09-14 23:00:22,639 - __main__ - INFO - Monitor complete. Found 18 total results: 12 new yiddish24 results, 6 new ivelt results.

2026-09-14 23:00:22,639 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-09-14 23:00:22,639 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-14 23:00:22,678 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-09-14 23:00:22,678 - __main__ - INFO - Closed all database connections

2026-09-14 23:00:22,681 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-14 23:00:22,681 - social_media_monitor.database.connection - INFO - Closed 0 database connections