โ† Logs

social_media_monitor_2026-08-11.log

2026-08-11 20:30:02,479 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-08-11 20:30:02,489 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-08-11 20:30:02,489 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-08-11 20:30:02,493 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-08-11 20:30:02,493 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-08-11 20:30:02,493 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-08-11 20:30:02,495 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-08-11 20:30:02,495 - __main__ - INFO - YouTube Intel scraper initialized and enabled
2026-08-11 20:30:02,496 - __main__ - INFO - Running 3 scrapers concurrently...
2026-08-11 20:30:02,496 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-08-11 20:30:02,923 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"
2026-08-11 20:30:02,924 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)
2026-08-11 20:30:03,584 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-08-11 20:30:03,611 - GitHubScraper - INFO - Found 251 GitHub repositories for term: paperclip
2026-08-11 20:30:03,918 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"
2026-08-11 20:30:04,675 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-08-11 20:30:04,679 - GitHubScraper - INFO - Found 514 GitHub repositories for term: "Hermes Agent"
2026-08-11 20:30:04,966 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"
2026-08-11 20:30:05,749 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-08-11 20:30:05,837 - GitHubScraper - INFO - Found 61 GitHub repositories for term: multica
2026-08-11 20:30:06,042 - GitHubScraper - INFO - Total GitHub results found: 0
2026-08-11 20:30:06,044 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 200 OK"
2026-08-11 20:30:09,814 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"
2026-08-11 20:30:10,226 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:10,266 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:10,301 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:10,422 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:10,616 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:10,731 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:10,772 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:10,773 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yitzih97/torahtale/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-11 20:30:11,073 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/tatyesod/talmud-tora-web/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:11,141 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:11,254 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:11,421 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:11,433 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-11 20:30:11,532 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:11,667 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:11,834 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:12,221 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:12,236 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/sikmenedowai-a11y/savetube-stream-kit/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-11 20:30:12,308 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-11 20:30:12,543 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:12,651 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:12,697 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:12,867 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:13,023 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:13,047 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:13,090 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:13,294 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:13,526 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:13,621 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:13,680 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:13,838 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:13,901 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:14,236 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:14,239 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:14,366 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:14,479 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-11 20:30:14,605 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:14,640 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:14,925 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-11 20:30:14,992 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-11 20:30:15,052 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:15,140 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-11 20:30:15,246 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:15,424 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:15,427 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-11 20:30:15,652 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-11 20:30:15,684 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-11 20:30:15,740 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/scott-fleischman/shark-2026/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:15,939 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:16,081 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:16,095 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:16,108 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:16,300 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:16,447 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:16,530 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:16,615 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:16,694 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:16,904 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:16,923 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:17,124 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:17,284 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:17,305 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:17,517 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:17,612 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:17,641 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:17,715 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:17,951 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:17,991 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:18,015 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:18,126 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:18,303 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:18,336 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:18,390 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:18,464 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:18,668 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:18,783 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:18,835 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:18,844 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:19,007 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:19,112 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:19,242 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yeled-tov/filtertube-android/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:19,296 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:19,396 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:19,423 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:19,626 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-11 20:30:19,708 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-11 20:30:19,751 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-shabbat-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:19,835 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:20,022 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/ShireiShabbat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:20,101 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:20,166 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:20,195 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:20,414 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:20,449 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:20,518 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:20,520 - YouTubeIntelScraper - INFO - YouTube Intel found 65 candidates and 11 new videos
2026-08-11 20:30:20,751 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:20,805 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:20,907 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:20,928 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:21,054 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 20:30:21,144 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=299 account_new=0 list_repos=100 list_new=0 private_new=0 total_new=0
2026-08-11 20:30:21,145 - __main__ - INFO - Scraper github completed: 0 results
2026-08-11 20:30:21,146 - __main__ - INFO - Scraper github_feed completed: 0 results
2026-08-11 20:30:21,146 - __main__ - INFO - Scraper youtube_intel completed: 11 results
2026-08-11 20:30:21,869 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-08-11 20:30:21.869416
2026-08-11 20:30:21,869 - __main__ - INFO - Email sent successfully
2026-08-11 20:30:21,869 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-08-11 20:30:21,869 - __main__ - INFO - Monitor complete. Found 11 total results: 11 new youtube intel results.
2026-08-11 20:30:21,869 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-08-11 20:30:21,869 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-11 20:30:21,902 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-08-11 20:30:21,902 - __main__ - INFO - Closed all database connections
2026-08-11 20:30:21,903 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-11 20:30:21,904 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-08-11 21:00:02,205 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-08-11.log
2026-08-11 21:00:02,205 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-08-11.log
2026-08-11 21:00:02,205 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-08-11.log
2026-08-11 21:00:02,205 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-08-11 21:00:02,236 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-08-11 21:00:02,236 - __main__ - INFO - Configuration loaded and validated successfully
2026-08-11 21:00:02,239 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-08-11 21:00:02,239 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-08-11 21:00:02,262 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-08-11 21:00:02,262 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-08-11 21:00:02,265 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0 (contact:abep+dev@nocommand.local)')
2026-08-11 21:00:02,266 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-08-11 21:00:02,266 - __main__ - INFO - RSS scraper initialized and enabled
2026-08-11 21:00:02,270 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-08-11 21:00:02,270 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-08-11 21:00:02,270 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-08-11 21:00:02,273 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-08-11 21:00:02,277 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-08-11 21:00:02,277 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-08-11 21:00:02,280 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-08-11 21:00:02,280 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-08-11 21:00:02,280 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-08-11 21:00:02,282 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-08-11 21:00:02,282 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-08-11 21:00:02,282 - __main__ - INFO - Running 3 scrapers concurrently...
2026-08-11 21:00:02,283 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-08-11 21:00:02,376 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-08-11 21:00:02,381 - IveltScraper - INFO - Loaded 181 include, 1 exclude filters from DB topic_filters
2026-08-11 21:00:02,381 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-08-11 21:00:02,384 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-08-11 21:00:02,478 - RSSFeedScraper - ERROR - Error fetching RSS feed https://www.theyeshivaworld.com/feed: name 'feedparser' is not defined
2026-08-11 21:00:02,480 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-08-11 21:00:06,500 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-08-11 21:00:06,729 - Yiddish24Scraper - INFO - Received response with 483891 characters
2026-08-11 21:00:06,732 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (303323 chars)
2026-08-11 21:00:06,735 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-08-11 21:00:06,820 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-08-11 21:00:06,861 - Yiddish24Scraper - INFO - Page 1 extraction: 99 successful, 1 failed out of 100 elements
2026-08-11 21:00:06,861 - Yiddish24Scraper - INFO - Parsed 99 articles from HTML on page 1
2026-08-11 21:00:06,906 - Yiddish24Scraper - INFO - Term 'ืื™ื ื˜ืขืจืขืกืื ื˜ืก -' matched in DESCRIPTION: 'ืื™ื ื˜ืขืจืขืกืื ื˜ืก - ื“ื™ ื’ืขืคืืจืคื•ืœืข ื‘ืื–ื•ืš ื‘ื™ื™ ื“ื™ ื’ืขื”ื™ื™ืžืข 'ืขืจื™ืข 51''
2026-08-11 21:00:06,906 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ื”ื›ืœ ื‘ื›ืœ
2026-08-11 21:00:07,406 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/zions__260_260811044148.mp3
2026-08-11 21:00:07,992 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_zions__260_260811044148.mp3 (54.8 MB)
2026-08-11 21:00:07,993 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-08-11 21:00:08,014 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_zions__260_260811044148.mp3: title, artist, album, comment, source_url, genre, publisher
2026-08-11 21:00:08,014 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2_zions__260_260811044148_ืื™ื ื˜ืขืจืขืกืื ื˜ืก_-.mp3
2026-08-11 21:00:08,204 - Yiddish24Scraper - INFO - Term 'ืžืขืฉื”' matched in DESCRIPTION: 'ืขืจืฉื˜ื”ืื ื˜ื™ื’ - ืื™ืš ื•ื•ื™ืœ ืื•ื™ืš ื–ืขืŸ ื ืžืขืฉื”'
2026-08-11 21:00:08,204 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ื”ื›ืœ ื‘ื›ืœ
2026-08-11 21:00:08,705 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/__________________________________________530474049.mp3
2026-08-11 21:00:08,765 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2___________________________________________530474049.mp3 (1.2 MB)
2026-08-11 21:00:08,766 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-08-11 21:00:08,770 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2___________________________________________530474049.mp3: title, artist, album, comment, source_url, genre, publisher
2026-08-11 21:00:08,770 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2___________________________________________530474049_ืžืขืฉื”.mp3
2026-08-11 21:00:09,533 - Yiddish24Scraper - INFO - Page 1 summary: 19 new out of 99 total articles
2026-08-11 21:00:09,533 - Yiddish24Scraper - INFO - Page 1: 19/99 new items
2026-08-11 21:00:09,533 - Yiddish24Scraper - INFO - Low new item ratio (19.2%), stopping pagination
2026-08-11 21:00:09,534 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 19
2026-08-11 21:02:03,064 - IveltScraper - INFO - FlareSolverr error: Error: Error solving the challenge. Timeout after 120.0 seconds. (attempt 1)
2026-08-11 21:02:03,064 - IveltScraper - INFO - Retrying in 3s...
2026-08-11 21:04:06,754 - IveltScraper - ERROR - FlareSolverr error: Error: Error solving the challenge. Timeout after 120.0 seconds. (attempt 2)
2026-08-11 21:04:06,754 - IveltScraper - INFO - FlareSolverr failed, trying curl_cffi cookie fallback...
2026-08-11 21:04:06,754 - IveltScraper - WARNING - No cf_clearance cookie set โ€” skipping curl_cffi fallback
2026-08-11 21:04:06,755 - IveltScraper - ERROR - Failed to fetch ivelt active topics page
2026-08-11 21:04:06,755 - IveltScraper - INFO - All forums scrape complete. Found 0 new posts.
2026-08-11 21:04:06,755 - __main__ - INFO - Scraper rss completed: 0 results
2026-08-11 21:04:06,756 - __main__ - INFO - Scraper yiddish24 completed: 19 results
2026-08-11 21:04:06,756 - __main__ - INFO - Scraper ivelt completed: 0 results
2026-08-11 21:04:07,586 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-08-11 21:04:07.586486
2026-08-11 21:04:07,586 - __main__ - INFO - Email sent successfully
2026-08-11 21:04:07,587 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-08-11 21:04:07,587 - __main__ - INFO - Monitor complete. Found 19 total results: 19 new yiddish24 results.
2026-08-11 21:04:07,587 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-08-11 21:04:07,587 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-11 21:04:07,669 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-08-11 21:04:07,669 - __main__ - INFO - Closed all database connections
2026-08-11 21:04:07,671 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-11 21:04:07,672 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-08-11 22:00:01,701 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-08-11.log
2026-08-11 22:00:01,701 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-08-11.log
2026-08-11 22:00:01,701 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-08-11.log
2026-08-11 22:00:01,701 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-08-11 22:00:01,735 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-08-11 22:00:01,735 - __main__ - INFO - Configuration loaded and validated successfully
2026-08-11 22:00:01,739 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-08-11 22:00:01,740 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-08-11 22:00:01,761 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-08-11 22:00:01,761 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-08-11 22:00:01,911 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0 (contact:abep+dev@nocommand.local)')
2026-08-11 22:00:01,913 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-08-11 22:00:01,913 - __main__ - INFO - RSS scraper initialized and enabled
2026-08-11 22:00:01,920 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-08-11 22:00:01,920 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-08-11 22:00:01,920 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-08-11 22:00:01,926 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-08-11 22:00:01,938 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-08-11 22:00:01,939 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-08-11 22:00:01,943 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-08-11 22:00:01,943 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-08-11 22:00:01,944 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-08-11 22:00:01,948 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-08-11 22:00:01,948 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-08-11 22:00:01,949 - __main__ - INFO - Running 3 scrapers concurrently...
2026-08-11 22:00:01,949 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-08-11 22:00:02,037 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-08-11 22:00:02,044 - IveltScraper - INFO - Loaded 181 include, 1 exclude filters from DB topic_filters
2026-08-11 22:00:02,044 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-08-11 22:00:02,045 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-08-11 22:00:02,138 - RSSFeedScraper - ERROR - Error fetching RSS feed https://www.theyeshivaworld.com/feed: name 'feedparser' is not defined
2026-08-11 22:00:02,140 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-08-11 22:00:09,224 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-08-11 22:00:09,439 - Yiddish24Scraper - INFO - Received response with 480087 characters
2026-08-11 22:00:09,443 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (302546 chars)
2026-08-11 22:00:09,446 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-08-11 22:00:09,530 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-08-11 22:00:09,570 - Yiddish24Scraper - INFO - Page 1 extraction: 99 successful, 1 failed out of 100 elements
2026-08-11 22:00:09,570 - Yiddish24Scraper - INFO - Parsed 99 articles from HTML on page 1
2026-08-11 22:00:10,427 - Yiddish24Scraper - INFO - Page 1 summary: 2 new out of 99 total articles
2026-08-11 22:00:10,428 - Yiddish24Scraper - INFO - Page 1: 2/99 new items
2026-08-11 22:00:10,428 - Yiddish24Scraper - INFO - Low new item ratio (2.0%), stopping pagination
2026-08-11 22:00:10,428 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 2
2026-08-11 22:00:14,168 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-08-11 22:00:29,046 - IveltScraper - INFO - ivelt scrape complete. Checked 3 topics.
2026-08-11 22:00:29,046 - IveltScraper - INFO - All forums scrape complete. Found 18 new posts.
2026-08-11 22:00:29,047 - __main__ - INFO - Scraper rss completed: 0 results
2026-08-11 22:00:29,047 - __main__ - INFO - Scraper yiddish24 completed: 2 results
2026-08-11 22:00:29,047 - __main__ - INFO - Scraper ivelt completed: 18 results
2026-08-11 22:00:30,012 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-08-11 22:00:30.012123
2026-08-11 22:00:30,012 - __main__ - INFO - Email sent successfully
2026-08-11 22:00:30,013 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-08-11 22:00:30,013 - __main__ - INFO - Monitor complete. Found 20 total results: 2 new yiddish24 results, 18 new ivelt results.
2026-08-11 22:00:30,013 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-08-11 22:00:30,013 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-11 22:00:30,082 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-08-11 22:00:30,082 - __main__ - INFO - Closed all database connections
2026-08-11 22:00:30,084 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-11 22:00:30,084 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-08-11 22:30:02,064 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-08-11.log
2026-08-11 22:30:02,064 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-08-11.log
2026-08-11 22:30:02,064 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-08-11.log
2026-08-11 22:30:02,064 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-08-11 22:30:02,100 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-08-11 22:30:02,100 - __main__ - INFO - Configuration loaded and validated successfully
2026-08-11 22:30:02,103 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-08-11 22:30:02,103 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-08-11 22:30:02,116 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-08-11 22:30:02,116 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-08-11 22:30:02,119 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0 (contact:abep+dev@nocommand.local)')
2026-08-11 22:30:02,119 - __main__ - INFO - GitHub scraper initialized and enabled
2026-08-11 22:30:02,119 - __main__ - INFO - GitHub feed scraper initialized and enabled
2026-08-11 22:30:02,120 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-08-11 22:30:02,123 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-08-11 22:30:02,123 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-08-11 22:30:02,126 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-08-11 22:30:02,130 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-08-11 22:30:02,130 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-08-11 22:30:02,133 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-08-11 22:30:02,133 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-08-11 22:30:02,133 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-08-11 22:30:02,135 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-08-11 22:30:02,136 - __main__ - INFO - YouTube Intel scraper initialized and enabled
2026-08-11 22:30:02,136 - __main__ - INFO - Running 3 scrapers concurrently...
2026-08-11 22:30:02,136 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-08-11 22:30:02,535 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"
2026-08-11 22:30:02,536 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)
2026-08-11 22:30:03,265 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-08-11 22:30:03,292 - GitHubScraper - INFO - Found 251 GitHub repositories for term: paperclip
2026-08-11 22:30:03,533 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:03,534 - GitHubFeedScraper - INFO - GitHub account feed page 1 unchanged (ETag)
2026-08-11 22:30:05,027 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-08-11 22:30:05,120 - GitHubScraper - INFO - Found 515 GitHub repositories for term: "Hermes Agent"
2026-08-11 22:30:06,186 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-08-11 22:30:06,280 - GitHubScraper - INFO - Found 61 GitHub repositories for term: multica
2026-08-11 22:30:06,431 - GitHubScraper - INFO - Total GitHub results found: 0
2026-08-11 22:30:06,821 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"
2026-08-11 22:30:07,192 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:07,236 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:07,295 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:07,326 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:07,535 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:07,626 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:07,712 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:07,730 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yitzih97/torahtale/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:07,984 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/tatyesod/talmud-tora-web/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:08,065 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:08,066 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:08,264 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:08,270 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-11 22:30:08,400 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:08,402 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:08,652 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:08,690 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:08,904 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:08,912 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/sikmenedowai-a11y/savetube-stream-kit/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-11 22:30:09,006 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:09,210 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-11 22:30:09,249 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:09,386 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:09,415 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-11 22:30:09,531 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:09,637 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:09,788 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:09,903 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:10,030 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:10,226 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:10,314 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:10,444 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:10,525 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:10,786 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-11 22:30:10,809 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:10,846 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:10,877 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-11 22:30:11,158 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:11,234 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-11 22:30:11,382 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-11 22:30:11,477 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-11 22:30:11,565 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:11,815 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:11,838 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:11,897 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-11 22:30:11,909 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-11 22:30:12,237 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/scott-fleischman/shark-2026/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:12,261 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:12,279 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:12,318 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:12,605 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:12,623 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:12,637 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:12,800 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:13,000 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:13,002 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:13,013 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:13,317 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:13,412 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:13,426 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:13,540 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:13,830 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:13,843 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:13,859 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:13,921 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:14,211 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:14,213 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:14,241 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:14,252 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:14,585 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:14,598 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:14,628 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:14,635 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:14,908 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:14,920 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:15,027 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:15,063 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:15,289 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:15,294 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:15,306 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:15,450 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yeled-tov/filtertube-android/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:15,589 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:15,657 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:15,682 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:15,901 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:15,959 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:15,974 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:15,989 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-shabbat-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:16,323 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:16,329 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:16,470 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/ShireiShabbat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:16,483 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:16,666 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:16,715 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:16,775 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:16,804 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:17,057 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:17,091 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:17,112 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:17,195 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-11 22:30:17,271 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=0 account_new=0 list_repos=100 list_new=0 private_new=0 total_new=0
2026-08-11 22:30:20,024 - YouTubeIntelScraper - INFO - YouTube Intel found 65 candidates and 15 new videos
2026-08-11 22:30:20,024 - __main__ - INFO - Scraper github completed: 0 results
2026-08-11 22:30:20,024 - __main__ - INFO - Scraper github_feed completed: 0 results
2026-08-11 22:30:20,024 - __main__ - INFO - Scraper youtube_intel completed: 15 results
2026-08-11 22:30:20,733 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-08-11 22:30:20.733055
2026-08-11 22:30:20,733 - __main__ - INFO - Email sent successfully
2026-08-11 22:30:20,733 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-08-11 22:30:20,733 - __main__ - INFO - Monitor complete. Found 15 total results: 15 new youtube intel results.
2026-08-11 22:30:20,733 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-08-11 22:30:20,733 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-11 22:30:20,797 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-08-11 22:30:20,797 - __main__ - INFO - Closed all database connections
2026-08-11 22:30:20,799 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-11 22:30:20,800 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-08-11 23:00:01,835 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-08-11.log
2026-08-11 23:00:01,835 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-08-11.log
2026-08-11 23:00:01,835 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-08-11.log
2026-08-11 23:00:01,836 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-08-11 23:00:01,867 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-08-11 23:00:01,868 - __main__ - INFO - Configuration loaded and validated successfully
2026-08-11 23:00:01,870 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-08-11 23:00:01,871 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-08-11 23:00:01,889 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-08-11 23:00:01,889 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-08-11 23:00:01,892 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0 (contact:abep+dev@nocommand.local)')
2026-08-11 23:00:01,893 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-08-11 23:00:01,893 - __main__ - INFO - RSS scraper initialized and enabled
2026-08-11 23:00:01,895 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-08-11 23:00:01,895 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-08-11 23:00:01,895 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-08-11 23:00:01,898 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-08-11 23:00:01,903 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-08-11 23:00:01,903 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-08-11 23:00:01,905 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-08-11 23:00:01,905 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-08-11 23:00:01,905 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-08-11 23:00:01,908 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-08-11 23:00:01,908 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-08-11 23:00:01,908 - __main__ - INFO - Running 3 scrapers concurrently...
2026-08-11 23:00:01,908 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-08-11 23:00:02,001 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-08-11 23:00:02,006 - IveltScraper - INFO - Loaded 181 include, 1 exclude filters from DB topic_filters
2026-08-11 23:00:02,006 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-08-11 23:00:02,008 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-08-11 23:00:02,088 - RSSFeedScraper - ERROR - Error fetching RSS feed https://www.theyeshivaworld.com/feed: name 'feedparser' is not defined
2026-08-11 23:00:02,090 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-08-11 23:00:05,783 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-08-11 23:00:05,996 - Yiddish24Scraper - INFO - Received response with 486044 characters
2026-08-11 23:00:05,998 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (307004 chars)
2026-08-11 23:00:06,000 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-08-11 23:00:06,075 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-08-11 23:00:06,117 - Yiddish24Scraper - INFO - Page 1 extraction: 99 successful, 1 failed out of 100 elements
2026-08-11 23:00:06,117 - Yiddish24Scraper - INFO - Parsed 99 articles from HTML on page 1
2026-08-11 23:00:06,422 - Yiddish24Scraper - INFO - Term 'ื—ืง ืœื™ืฉืจืืœ' matched in TITLE: 'ื—ืง ืœื™ืฉืจืืœ - ื”ืจื‘ ื™ื•ืืœ ืœืขื‘ืื•ื•ื™ื˜ืฉ'
2026-08-11 23:00:06,423 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ื—ืง ืœื™ืฉืจืืœ - ื”ืจื‘ ื™ื•ืืœ ืœืขื‘ืื•ื•ื™ื˜ืฉ
2026-08-11 23:00:06,923 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/20260811055206-164134.mp3
2026-08-11 23:00:08,836 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_20260811055206-164134.mp3 (40.4 MB)
2026-08-11 23:00:08,837 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-08-11 23:00:08,865 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_20260811055206-164134.mp3: title, artist, album, comment, source_url, genre, publisher
2026-08-11 23:00:08,866 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2_20260811055206-164134_ื—ืง_ืœื™ืฉืจืืœ.mp3
2026-08-11 23:00:09,571 - Yiddish24Scraper - INFO - Term 'ื—ืง ืœื™ืฉืจืืœ' matched in TITLE: 'ื—ืง ืœื™ืฉืจืืœ - ื”ืจื‘ ื™ื•ืืœ ืœืขื‘ืื•ื•ื™ื˜ืฉ'
2026-08-11 23:00:09,571 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ื—ืง ืœื™ืฉืจืืœ - ื”ืจื‘ ื™ื•ืืœ ืœืขื‘ืื•ื•ื™ื˜ืฉ
2026-08-11 23:00:10,072 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/20260811055234-164135.mp3
2026-08-11 23:00:11,776 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_20260811055234-164135.mp3 (32.0 MB)
2026-08-11 23:00:11,777 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-08-11 23:00:11,795 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_20260811055234-164135.mp3: title, artist, album, comment, source_url, genre, publisher
2026-08-11 23:00:11,795 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2_20260811055234-164135_ื—ืง_ืœื™ืฉืจืืœ.mp3
2026-08-11 23:00:11,811 - Yiddish24Scraper - INFO - Page 1 summary: 8 new out of 99 total articles
2026-08-11 23:00:11,811 - Yiddish24Scraper - INFO - Page 1: 8/99 new items
2026-08-11 23:00:11,811 - Yiddish24Scraper - INFO - Low new item ratio (8.1%), stopping pagination
2026-08-11 23:00:11,811 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 8
2026-08-11 23:00:15,168 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-08-11 23:00:30,298 - IveltScraper - INFO - ivelt scrape complete. Checked 4 topics.
2026-08-11 23:00:30,299 - IveltScraper - INFO - All forums scrape complete. Found 18 new posts.
2026-08-11 23:00:30,299 - __main__ - INFO - Scraper rss completed: 0 results
2026-08-11 23:00:30,299 - __main__ - INFO - Scraper yiddish24 completed: 8 results
2026-08-11 23:00:30,299 - __main__ - INFO - Scraper ivelt completed: 18 results
2026-08-11 23:00:31,355 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-08-11 23:00:31.355568
2026-08-11 23:00:31,355 - __main__ - INFO - Email sent successfully
2026-08-11 23:00:31,355 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-08-11 23:00:31,356 - __main__ - INFO - Monitor complete. Found 26 total results: 8 new yiddish24 results, 18 new ivelt results.
2026-08-11 23:00:31,356 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-08-11 23:00:31,356 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-11 23:00:31,418 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-08-11 23:00:31,419 - __main__ - INFO - Closed all database connections
2026-08-11 23:00:31,420 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-11 23:00:31,421 - social_media_monitor.database.connection - INFO - Closed 0 database connections