โ† Logs

social_media_monitor_2026-09-10.log

2026-09-10 20:30:02,420 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-10 20:30:02,426 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-10 20:30:02,426 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-10 20:30:02,431 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-10 20:30:02,435 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-10 20:30:02,435 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-10 20:30:02,438 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-10 20:30:02,438 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-10 20:30:02,438 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-10 20:30:02,440 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-10 20:30:02,440 - __main__ - INFO - YouTube Intel scraper initialized and enabled
2026-09-10 20:30:02,440 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-10 20:30:02,440 - GitHubScraper - INFO - Searching GitHub for terms: ['"Hermes Agent"', '"claude code"', '"prime agent"', 'paperclip']
2026-09-10 20:30:02,867 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"
2026-09-10 20:30:02,868 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)
2026-09-10 20:30:03,574 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-10 20:30:03,664 - GitHubScraper - INFO - Found 598 GitHub repositories for term: "Hermes Agent"
2026-09-10 20:30:03,802 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"
2026-09-10 20:30:04,803 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22claude+code%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-10 20:30:04,808 - GitHubScraper - INFO - Found 8639 GitHub repositories for term: "claude code"
2026-09-10 20:30:04,912 - GitHubScraper - INFO - Added new GitHub repository: jolt
2026-09-10 20:30:04,973 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"
2026-09-10 20:30:05,874 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22prime+agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-10 20:30:05,878 - GitHubScraper - INFO - Found 39 GitHub repositories for term: "prime agent"
2026-09-10 20:30:06,078 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 200 OK"
2026-09-10 20:30:06,844 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-10 20:30:06,848 - GitHubScraper - INFO - Found 259 GitHub repositories for term: paperclip
2026-09-10 20:30:06,986 - GitHubScraper - INFO - Total GitHub results found: 1
2026-09-10 20:30:09,926 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"
2026-09-10 20:30:10,327 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:10,339 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:10,366 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:10,467 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:10,690 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:10,728 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:10,798 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:10,891 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:11,110 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:11,122 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:11,162 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:11,386 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:11,409 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:11,494 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:11,523 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:11,817 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:11,819 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:11,972 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/sikmenedowai-a11y/savetube-stream-kit/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-10 20:30:12,099 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:12,182 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:12,233 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:12,452 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:12,513 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:12,576 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:12,626 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:12,811 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:12,962 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:13,038 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:13,140 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:13,197 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:13,366 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:13,514 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:13,623 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:13,712 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:13,722 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:13,817 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:14,174 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:14,223 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:14,257 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:14,287 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:14,625 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:14,639 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:14,799 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-10 20:30:14,827 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:15,018 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:15,124 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:15,194 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:15,215 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:15,379 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:15,490 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:15,647 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:15,657 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:15,789 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:15,999 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-10 20:30:16,032 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:16,086 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:16,255 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:16,491 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-10 20:30:16,607 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:16,616 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-10 20:30:16,828 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:16,859 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:16,985 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:17,140 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:17,207 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:17,242 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-10 20:30:17,292 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:17,528 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-10 20:30:17,555 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:17,571 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:17,614 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:17,861 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:17,908 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:17,949 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:18,073 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:18,213 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:18,253 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:18,451 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yeled-tov/filtertube-android/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:18,494 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:18,581 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:18,606 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:18,843 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:18,870 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-10 20:30:18,892 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:19,083 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-tfilah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:19,211 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:19,220 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:19,251 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:19,515 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:19,536 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:19,591 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:19,596 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:19,865 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:19,918 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:19,984 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:20,004 - YouTubeIntelScraper - INFO - YouTube Intel found 50 candidates and 12 new videos
2026-09-10 20:30:20,054 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:20,154 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akshatasatmar/WeatherServiceApi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:20,289 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elchunenfreund/satmar-matzos-app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:20,299 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmaribianca05-eng/AFSD-Satmari-Bianca/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:20,537 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/Sefaria-Export/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 20:30:20,595 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=244 account_new=0 list_repos=100 list_new=0 private_new=0 total_new=0
2026-09-10 20:30:20,596 - __main__ - INFO - Scraper github completed: 1 results
2026-09-10 20:30:20,597 - __main__ - INFO - Scraper github_feed completed: 0 results
2026-09-10 20:30:20,597 - __main__ - INFO - Scraper youtube_intel completed: 12 results
2026-09-10 20:30:21,483 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-10 20:30:21.483694
2026-09-10 20:30:21,483 - __main__ - INFO - Email sent successfully
2026-09-10 20:30:21,484 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-10 20:30:21,484 - __main__ - INFO - Monitor complete. Found 13 total results: 1 new github results, 12 new youtube intel results.
2026-09-10 20:30:21,484 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-10 20:30:21,484 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-10 20:30:21,506 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-10 20:30:21,507 - __main__ - INFO - Closed all database connections
2026-09-10 20:30:21,509 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-10 20:30:21,509 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-10 21:00:02,356 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-10.log
2026-09-10 21:00:02,356 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-10.log
2026-09-10 21:00:02,357 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-10.log
2026-09-10 21:00:02,357 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-10 21:00:02,385 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-10 21:00:02,385 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-10 21:00:02,387 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-10 21:00:02,388 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-10 21:00:02,404 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-10 21:00:02,404 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-10 21:00:02,408 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-10 21:00:02,410 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-10 21:00:02,410 - __main__ - INFO - RSS scraper initialized and enabled
2026-09-10 21:00:02,415 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-10 21:00:02,415 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-10 21:00:02,415 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-09-10 21:00:02,417 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-10 21:00:02,422 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-10 21:00:02,422 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-10 21:00:02,424 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-10 21:00:02,424 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-10 21:00:02,424 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-10 21:00:02,426 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-10 21:00:02,426 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-09-10 21:00:02,426 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-10 21:00:02,427 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-09-10 21:00:02,516 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-09-10 21:00:02,521 - IveltScraper - INFO - Loaded 181 include, 4 exclude filters from DB topic_filters
2026-09-10 21:00:02,521 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-09-10 21:00:02,525 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-09-10 21:00:02,895 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-09-10 21:00:06,007 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-09-10 21:00:06,227 - Yiddish24Scraper - INFO - Received response with 474302 characters
2026-09-10 21:00:06,230 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (307920 chars)
2026-09-10 21:00:06,233 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-09-10 21:00:06,305 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-09-10 21:00:06,344 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-09-10 21:00:06,344 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-09-10 21:00:06,383 - Yiddish24Scraper - INFO - Term 'ืขืจืฉื˜ื”ืื ื˜ื™ื’' matched in DESCRIPTION: 'ืขืจืฉื˜ื”ืื ื˜ื™ื’ - ืคืขืจื–ืขื ืœื™ื›ืข ืงืืžืคืœื™ืžืขื ื˜ืŸ ืคืืจ ื™ืขื“ืขื ื‘ืื–ื•ื ื“ืขืจ'
2026-09-10 21:00:06,383 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ื”ื›ืœ ื‘ื›ืœ
2026-09-10 21:00:06,883 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/ChokLYisroelLeilShishiVayele1_260_260910045238.mp3
2026-09-10 21:00:07,808 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_ChokLYisroelLeilShishiVayele1_260_260910045238.mp3 (2.3 MB)
2026-09-10 21:00:07,808 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-09-10 21:00:07,817 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_ChokLYisroelLeilShishiVayele1_260_260910045238.mp3: title, artist, album, comment, source_url, genre, publisher
2026-09-10 21:00:07,818 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2_ChokLYisroelLeilShishiVayele1_260_260910045238_ืขืจืฉื˜ื”ืื ื˜ื™ื’.mp3
2026-09-10 21:00:08,156 - Yiddish24Scraper - INFO - Term 'ืฉืœื™ื˜' matched in TITLE: 'ื”ืจื‘ ืฉืœืžื” ื”ืืคืžืืŸ ืฉืœื™ื˜"ื'
2026-09-10 21:00:08,156 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ื”ืจื‘ ืฉืœืžื” ื”ืืคืžืืŸ ืฉืœื™ื˜"ื
2026-09-10 21:00:08,656 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/_________MP4_173_1789066299688_694_0_2609_809943636.mp3
2026-09-10 21:00:11,184 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2__________MP4_173_1789066299688_694_0_2609_809943636.mp3 (63.4 MB)
2026-09-10 21:00:11,185 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-09-10 21:00:11,216 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2__________MP4_173_1789066299688_694_0_2609_809943636.mp3: title, artist, album, comment, source_url, genre, publisher
2026-09-10 21:00:11,216 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2__________MP4_173_1789066299688_694_0_2609_809943636_ืฉืœื™ื˜.mp3
2026-09-10 21:00:11,981 - Yiddish24Scraper - INFO - Page 1 summary: 5 new out of 100 total articles
2026-09-10 21:00:11,981 - Yiddish24Scraper - INFO - Page 1: 5/100 new items
2026-09-10 21:00:11,981 - Yiddish24Scraper - INFO - Low new item ratio (5.0%), stopping pagination
2026-09-10 21:00:11,982 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 5
2026-09-10 21:00:14,581 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-09-10 21:00:47,827 - IveltScraper - INFO - ivelt scrape complete. Checked 6 topics.
2026-09-10 21:00:47,827 - IveltScraper - INFO - All forums scrape complete. Found 25 new posts.
2026-09-10 21:00:47,828 - __main__ - INFO - Scraper rss completed: 0 results
2026-09-10 21:00:47,828 - __main__ - INFO - Scraper yiddish24 completed: 5 results
2026-09-10 21:00:47,828 - __main__ - INFO - Scraper ivelt completed: 25 results
2026-09-10 21:00:49,160 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-10 21:00:49.160339
2026-09-10 21:00:49,160 - __main__ - INFO - Email sent successfully
2026-09-10 21:00:49,160 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-10 21:00:49,160 - __main__ - INFO - Monitor complete. Found 30 total results: 5 new yiddish24 results, 25 new ivelt results.
2026-09-10 21:00:49,161 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-10 21:00:49,161 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-10 21:00:49,280 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-10 21:00:49,281 - __main__ - INFO - Closed all database connections
2026-09-10 21:00:49,283 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-10 21:00:49,283 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-10 22:00:02,099 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-10.log
2026-09-10 22:00:02,099 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-10.log
2026-09-10 22:00:02,099 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-10.log
2026-09-10 22:00:02,099 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-10 22:00:02,128 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-10 22:00:02,128 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-10 22:00:02,130 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-10 22:00:02,131 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-10 22:00:02,181 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-10 22:00:02,181 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-10 22:00:02,239 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-10 22:00:02,241 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-10 22:00:02,242 - __main__ - INFO - RSS scraper initialized and enabled
2026-09-10 22:00:02,249 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-10 22:00:02,249 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-10 22:00:02,250 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-09-10 22:00:02,256 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-10 22:00:02,263 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-10 22:00:02,263 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-10 22:00:02,265 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-10 22:00:02,265 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-10 22:00:02,266 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-10 22:00:02,268 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-10 22:00:02,268 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-09-10 22:00:02,268 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-10 22:00:02,268 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-09-10 22:00:02,355 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-09-10 22:00:02,359 - IveltScraper - INFO - Loaded 181 include, 4 exclude filters from DB topic_filters
2026-09-10 22:00:02,359 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-09-10 22:00:02,361 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-09-10 22:00:02,667 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-09-10 22:00:06,518 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-09-10 22:00:06,740 - Yiddish24Scraper - INFO - Received response with 493216 characters
2026-09-10 22:00:06,744 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (311390 chars)
2026-09-10 22:00:06,747 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-09-10 22:00:06,821 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-09-10 22:00:06,864 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-09-10 22:00:06,864 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-09-10 22:00:07,884 - Yiddish24Scraper - INFO - Page 1 summary: 9 new out of 100 total articles
2026-09-10 22:00:07,884 - Yiddish24Scraper - INFO - Page 1: 9/100 new items
2026-09-10 22:00:07,884 - Yiddish24Scraper - INFO - Low new item ratio (9.0%), stopping pagination
2026-09-10 22:00:07,885 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 9
2026-09-10 22:00:14,710 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-09-10 22:00:25,046 - IveltScraper - INFO - Filtering post containing exclude term: '*ื‘ื™ื˜ืข ืžืื›ื˜ ื–ื™ื›ืขืจ ื‘ืœื•ื™ื– ืฆื• ื‘ืืจื™ื›ื˜ืŸ ืงืจืื ื˜ืข ื ื™ื™ืขืก*'
2026-09-10 22:00:27,530 - IveltScraper - INFO - ivelt scrape complete. Checked 3 topics.
2026-09-10 22:00:27,530 - IveltScraper - INFO - All forums scrape complete. Found 16 new posts.
2026-09-10 22:00:27,530 - __main__ - INFO - Scraper rss completed: 0 results
2026-09-10 22:00:27,530 - __main__ - INFO - Scraper yiddish24 completed: 9 results
2026-09-10 22:00:27,530 - __main__ - INFO - Scraper ivelt completed: 16 results
2026-09-10 22:00:29,204 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-10 22:00:29.204808
2026-09-10 22:00:29,205 - __main__ - INFO - Email sent successfully
2026-09-10 22:00:29,205 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-10 22:00:29,205 - __main__ - INFO - Monitor complete. Found 25 total results: 9 new yiddish24 results, 16 new ivelt results.
2026-09-10 22:00:29,205 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-10 22:00:29,205 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-10 22:00:29,285 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-10 22:00:29,286 - __main__ - INFO - Closed all database connections
2026-09-10 22:00:29,288 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-10 22:00:29,288 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-10 22:30:02,411 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-10.log
2026-09-10 22:30:02,411 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-10.log
2026-09-10 22:30:02,411 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-10.log
2026-09-10 22:30:02,411 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-10 22:30:02,443 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-10 22:30:02,443 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-10 22:30:02,446 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-10 22:30:02,447 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-10 22:30:02,462 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-10 22:30:02,462 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-10 22:30:02,465 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-10 22:30:02,466 - __main__ - INFO - GitHub scraper initialized and enabled
2026-09-10 22:30:02,466 - __main__ - INFO - GitHub feed scraper initialized and enabled
2026-09-10 22:30:02,467 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-10 22:30:02,472 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-10 22:30:02,472 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-10 22:30:02,477 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-10 22:30:02,486 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-10 22:30:02,486 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-10 22:30:02,490 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-10 22:30:02,490 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-10 22:30:02,490 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-10 22:30:02,493 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-10 22:30:02,493 - __main__ - INFO - YouTube Intel scraper initialized and enabled
2026-09-10 22:30:02,493 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-10 22:30:02,493 - GitHubScraper - INFO - Searching GitHub for terms: ['"Hermes Agent"', '"claude code"', '"prime agent"', 'paperclip']
2026-09-10 22:30:02,930 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"
2026-09-10 22:30:02,931 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)
2026-09-10 22:30:03,608 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-10 22:30:03,691 - GitHubScraper - INFO - Found 598 GitHub repositories for term: "Hermes Agent"
2026-09-10 22:30:03,998 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"
2026-09-10 22:30:04,874 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22claude+code%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-10 22:30:04,965 - GitHubScraper - INFO - Found 8639 GitHub repositories for term: "claude code"
2026-09-10 22:30:05,044 - GitHubScraper - INFO - Added new GitHub repository: opendraft
2026-09-10 22:30:05,111 - GitHubScraper - INFO - Added new GitHub repository: spring-tools
2026-09-10 22:30:05,125 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"
2026-09-10 22:30:06,012 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22prime+agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-10 22:30:06,016 - GitHubScraper - INFO - Found 39 GitHub repositories for term: "prime agent"
2026-09-10 22:30:06,167 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 200 OK"
2026-09-10 22:30:07,131 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-10 22:30:07,133 - GitHubScraper - INFO - Found 259 GitHub repositories for term: paperclip
2026-09-10 22:30:07,259 - GitHubScraper - INFO - Total GitHub results found: 2
2026-09-10 22:30:09,274 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"
2026-09-10 22:30:09,692 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:09,693 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:09,695 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:09,769 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:09,994 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:10,200 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:10,237 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:10,294 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:10,414 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:10,600 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:10,680 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:10,832 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:10,964 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:10,969 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:10,997 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:11,273 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:11,411 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:11,510 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/sikmenedowai-a11y/savetube-stream-kit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:11,556 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-10 22:30:11,621 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:11,741 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:11,896 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:11,903 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:11,973 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:12,137 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:12,225 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-10 22:30:12,444 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:12,480 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:12,577 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:12,582 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-10 22:30:12,835 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:12,877 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:13,032 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:13,182 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:13,212 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:13,314 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:13,488 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-10 22:30:13,595 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:13,739 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:13,776 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-10 22:30:13,978 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:14,122 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-10 22:30:14,139 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:14,193 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:14,410 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:14,551 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:14,552 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:14,703 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:14,747 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:14,918 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:15,082 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:15,111 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:15,135 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:15,317 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-10 22:30:15,432 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:15,461 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:15,537 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:15,856 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:15,970 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:16,021 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:16,041 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:16,169 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:16,349 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:16,372 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:16,446 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:16,453 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:16,678 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:16,786 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:16,817 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:16,919 - YouTubeIntelScraper - INFO - YouTube Intel found 50 candidates and 10 new videos
2026-09-10 22:30:16,962 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:17,024 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:17,118 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:17,190 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:17,278 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:17,417 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:17,425 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:17,535 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:17,792 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:17,795 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:17,801 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yeled-tov/filtertube-android/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-10 22:30:17,834 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:18,138 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:18,160 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:18,216 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:18,290 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-tfilah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:18,480 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:18,502 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:18,505 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:18,619 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:18,789 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:18,832 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:18,893 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:18,985 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:19,153 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:19,172 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:19,245 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:19,351 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akshatasatmar/WeatherServiceApi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:19,428 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elchunenfreund/satmar-matzos-app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:19,594 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmaribianca05-eng/AFSD-Satmari-Bianca/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:19,770 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/Sefaria-Export/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-10 22:30:19,822 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=236 account_new=0 list_repos=100 list_new=2 private_new=0 total_new=2
2026-09-10 22:30:19,823 - __main__ - INFO - Scraper github completed: 2 results
2026-09-10 22:30:19,823 - __main__ - INFO - Scraper github_feed completed: 2 results
2026-09-10 22:30:19,824 - __main__ - INFO - Scraper youtube_intel completed: 10 results
2026-09-10 22:30:20,494 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-10 22:30:20.494502
2026-09-10 22:30:20,494 - __main__ - INFO - Email sent successfully
2026-09-10 22:30:20,513 - __main__ - INFO - GitHub feed delivery acknowledged: 2 stored, 0 failed
2026-09-10 22:30:20,514 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-10 22:30:20,514 - __main__ - INFO - Monitor complete. Found 14 total results: 2 new github results, 2 new github feed results, 10 new youtube intel results.
2026-09-10 22:30:20,514 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-10 22:30:20,514 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-10 22:30:20,559 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-10 22:30:20,559 - __main__ - INFO - Closed all database connections
2026-09-10 22:30:20,561 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-10 22:30:20,561 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-10 23:00:02,321 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-10.log
2026-09-10 23:00:02,321 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-10.log
2026-09-10 23:00:02,321 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-10.log
2026-09-10 23:00:02,321 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-10 23:00:02,352 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-10 23:00:02,352 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-10 23:00:02,355 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-10 23:00:02,356 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-10 23:00:02,370 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-10 23:00:02,370 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-10 23:00:02,427 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-10 23:00:02,429 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-10 23:00:02,429 - __main__ - INFO - RSS scraper initialized and enabled
2026-09-10 23:00:02,435 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-10 23:00:02,435 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-10 23:00:02,435 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-09-10 23:00:02,437 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-10 23:00:02,441 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-10 23:00:02,441 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-10 23:00:02,443 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-10 23:00:02,443 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-10 23:00:02,444 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-10 23:00:02,446 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-10 23:00:02,446 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-09-10 23:00:02,446 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-10 23:00:02,446 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-09-10 23:00:02,532 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-09-10 23:00:02,536 - IveltScraper - INFO - Loaded 181 include, 4 exclude filters from DB topic_filters
2026-09-10 23:00:02,536 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-09-10 23:00:02,538 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-09-10 23:00:02,853 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-09-10 23:00:05,371 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-09-10 23:00:05,593 - Yiddish24Scraper - INFO - Received response with 510531 characters
2026-09-10 23:00:05,596 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (320007 chars)
2026-09-10 23:00:05,599 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-09-10 23:00:05,679 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-09-10 23:00:05,724 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-09-10 23:00:05,725 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-09-10 23:00:05,746 - Yiddish24Scraper - INFO - Term 'ืื™ื ืกืคื™ืจืืฆื™ืข -' matched in DESCRIPTION: 'ืื™ื ืกืคื™ืจืืฆื™ืข - ื–ืขื ืขืŸ ื“ื™ ืกื™ืžื ื™ื ืื–ืขืœื›ืข ื’ืขืฉืžืืงืข ืขืกืŸ?'
2026-09-10 23:00:05,746 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ื”ื›ืœ ื‘ื›ืœ
2026-09-10 23:00:06,255 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/_________________238_260910042619.mp3
2026-09-10 23:00:07,392 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2__________________238_260910042619.mp3 (8.4 MB)
2026-09-10 23:00:07,393 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-09-10 23:00:07,406 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2__________________238_260910042619.mp3: title, artist, album, comment, source_url, genre, publisher
2026-09-10 23:00:07,406 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2__________________238_260910042619_ืื™ื ืกืคื™ืจืืฆื™ืข_-.mp3
2026-09-10 23:00:09,012 - Yiddish24Scraper - INFO - Page 1 summary: 6 new out of 100 total articles
2026-09-10 23:00:09,012 - Yiddish24Scraper - INFO - Page 1: 6/100 new items
2026-09-10 23:00:09,013 - Yiddish24Scraper - INFO - Low new item ratio (6.0%), stopping pagination
2026-09-10 23:00:09,013 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 6
2026-09-10 23:00:14,462 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-09-10 23:00:30,560 - IveltScraper - INFO - Filtering post containing exclude term: '*ื‘ื™ื˜ืข ืžืื›ื˜ ื–ื™ื›ืขืจ ื‘ืœื•ื™ื– ืฆื• ื‘ืืจื™ื›ื˜ืŸ ืงืจืื ื˜ืข ื ื™ื™ืขืก*'
2026-09-10 23:00:41,751 - IveltScraper - INFO - ivelt scrape complete. Checked 6 topics.
2026-09-10 23:00:41,751 - IveltScraper - INFO - All forums scrape complete. Found 19 new posts.
2026-09-10 23:00:41,751 - __main__ - INFO - Scraper rss completed: 0 results
2026-09-10 23:00:41,751 - __main__ - INFO - Scraper yiddish24 completed: 6 results
2026-09-10 23:00:41,751 - __main__ - INFO - Scraper ivelt completed: 19 results
2026-09-10 23:00:42,523 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-10 23:00:42.523464
2026-09-10 23:00:42,523 - __main__ - INFO - Email sent successfully
2026-09-10 23:00:42,524 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-10 23:00:42,524 - __main__ - INFO - Monitor complete. Found 25 total results: 6 new yiddish24 results, 19 new ivelt results.
2026-09-10 23:00:42,524 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-10 23:00:42,524 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-10 23:00:43,024 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-10 23:00:43,024 - __main__ - INFO - Closed all database connections
2026-09-10 23:00:43,027 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-10 23:00:43,027 - social_media_monitor.database.connection - INFO - Closed 0 database connections