← Logs
social_media_monitor_2026-08-08.log
2026-08-08 20:00:03,841 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 100 total articles
2026-08-08 20:00:03,841 - Yiddish24Scraper - INFO - Page 1: 0/100 new items
2026-08-08 20:00:03,841 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination
2026-08-08 20:00:03,842 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0
2026-08-08 20:00:14,181 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-08-08 20:00:25,430 - IveltScraper - INFO - ivelt scrape complete. Checked 3 topics.
2026-08-08 20:00:25,430 - IveltScraper - INFO - All forums scrape complete. Found 0 new posts.
2026-08-08 20:00:25,430 - __main__ - INFO - Scraper rss completed: 0 results
2026-08-08 20:00:25,431 - __main__ - INFO - Scraper yiddish24 completed: 0 results
2026-08-08 20:00:25,431 - __main__ - INFO - Scraper ivelt completed: 0 results
2026-08-08 20:00:25,431 - __main__ - INFO - No new results found across all enabled sources
2026-08-08 20:00:25,431 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-08-08 20:00:25,431 - __main__ - INFO - Monitor complete. No new results found across all sources.
2026-08-08 20:00:25,431 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-08-08 20:00:25,431 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-08 20:00:25,484 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-08-08 20:00:25,484 - __main__ - INFO - Closed all database connections
2026-08-08 20:00:25,486 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-08 20:00:25,486 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-08-08 20:30:02,432 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-08-08.log
2026-08-08 20:30:02,433 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-08-08.log
2026-08-08 20:30:02,433 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-08-08.log
2026-08-08 20:30:02,433 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-08-08 20:30:02,465 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-08-08 20:30:02,465 - __main__ - INFO - Configuration loaded and validated successfully
2026-08-08 20:30:02,467 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-08-08 20:30:02,468 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-08-08 20:30:02,481 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-08-08 20:30:02,481 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-08-08 20:30:02,485 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0 (contact:abep+dev@nocommand.local)')
2026-08-08 20:30:02,485 - __main__ - INFO - GitHub scraper initialized and enabled
2026-08-08 20:30:02,485 - __main__ - INFO - GitHub feed scraper initialized and enabled
2026-08-08 20:30:02,486 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-08-08 20:30:02,490 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-08-08 20:30:02,490 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-08-08 20:30:02,495 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-08-08 20:30:02,502 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-08-08 20:30:02,502 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-08-08 20:30:02,506 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-08-08 20:30:02,506 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-08-08 20:30:02,506 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-08-08 20:30:02,510 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-08-08 20:30:02,510 - __main__ - INFO - YouTube Intel scraper initialized and enabled
2026-08-08 20:30:02,510 - __main__ - INFO - Running 3 scrapers concurrently...
2026-08-08 20:30:02,510 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-08-08 20:30:02,947 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"
2026-08-08 20:30:02,948 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)
2026-08-08 20:30:03,744 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-08-08 20:30:03,771 - GitHubScraper - INFO - Found 247 GitHub repositories for term: paperclip
2026-08-08 20:30:04,000 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:04,001 - GitHubFeedScraper - INFO - GitHub account feed page 1 unchanged (ETag)
2026-08-08 20:30:04,725 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-08-08 20:30:04,731 - GitHubScraper - INFO - Found 507 GitHub repositories for term: "Hermes Agent"
2026-08-08 20:30:05,836 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-08-08 20:30:05,838 - GitHubScraper - INFO - Found 60 GitHub repositories for term: multica
2026-08-08 20:30:05,898 - GitHubScraper - INFO - Added new GitHub repository: multicalc-rust
2026-08-08 20:30:05,982 - GitHubScraper - INFO - Total GitHub results found: 1
2026-08-08 20:30:06,670 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"
2026-08-08 20:30:07,024 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:07,069 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:07,143 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:07,163 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:07,448 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:07,464 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:07,516 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:07,608 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yitzih97/torahtale/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:07,799 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/tatyesod/talmud-tora-web/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:07,831 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:07,997 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:08,141 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:08,200 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:08,279 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-08 20:30:08,381 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:08,419 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:08,572 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:08,844 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:08,846 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-08 20:30:08,900 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/sikmenedowai-a11y/savetube-stream-kit/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-08 20:30:09,026 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-08 20:30:09,169 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:09,243 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-08 20:30:09,348 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:09,446 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:09,511 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:09,637 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:09,842 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:09,858 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:10,071 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:10,188 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:10,210 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:10,345 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:10,524 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:10,749 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:10,751 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:10,767 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:10,900 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:11,180 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-08 20:30:11,195 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:11,268 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-08 20:30:11,301 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-08 20:30:11,608 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:11,646 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:11,690 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-08 20:30:11,693 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-08 20:30:11,956 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/scott-fleischman/shark-2026/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:11,996 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-08 20:30:12,134 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:12,144 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:12,316 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:12,320 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:12,472 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:12,575 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:12,687 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:12,855 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:12,912 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:12,936 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:13,062 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:13,342 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:13,372 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:13,400 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:13,407 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:13,736 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:13,779 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:13,812 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:13,972 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:14,043 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:14,085 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:14,109 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:14,342 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:14,385 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:14,438 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:14,472 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:14,718 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:14,744 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:14,753 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:14,902 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:15,018 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:15,058 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:15,138 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yeled-tov/filtertube-android/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:15,283 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:15,301 - YouTubeIntelScraper - INFO - YouTube Intel found 55 candidates and 9 new videos
2026-08-08 20:30:15,386 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:15,457 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:15,558 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:15,644 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:15,680 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-shabbat-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:15,806 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:15,834 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/ShireiShabbat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:15,974 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:15,992 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:16,134 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:16,238 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:16,259 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:16,315 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:16,473 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:16,654 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:16,672 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:16,727 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:16,821 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 20:30:16,918 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=0 account_new=0 list_repos=100 list_new=0 private_new=0 total_new=0
2026-08-08 20:30:16,919 - __main__ - INFO - Scraper github completed: 1 results
2026-08-08 20:30:16,919 - __main__ - INFO - Scraper github_feed completed: 0 results
2026-08-08 20:30:16,919 - __main__ - INFO - Scraper youtube_intel completed: 9 results
2026-08-08 20:30:17,624 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-08-08 20:30:17.624844
2026-08-08 20:30:17,625 - __main__ - INFO - Email sent successfully
2026-08-08 20:30:17,625 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-08-08 20:30:17,625 - __main__ - INFO - Monitor complete. Found 10 total results: 1 new github results, 9 new youtube intel results.
2026-08-08 20:30:17,625 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-08-08 20:30:17,625 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-08 20:30:17,650 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-08-08 20:30:17,650 - __main__ - INFO - Closed all database connections
2026-08-08 20:30:17,652 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-08 20:30:17,652 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-08-08 21:00:01,651 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-08-08.log
2026-08-08 21:00:01,651 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-08-08.log
2026-08-08 21:00:01,651 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-08-08.log
2026-08-08 21:00:01,651 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-08-08 21:00:01,682 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-08-08 21:00:01,682 - __main__ - INFO - Configuration loaded and validated successfully
2026-08-08 21:00:01,685 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-08-08 21:00:01,685 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-08-08 21:00:01,721 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-08-08 21:00:01,721 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-08-08 21:00:01,725 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0 (contact:abep+dev@nocommand.local)')
2026-08-08 21:00:01,725 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-08-08 21:00:01,726 - __main__ - INFO - RSS scraper initialized and enabled
2026-08-08 21:00:01,729 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-08-08 21:00:01,729 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-08-08 21:00:01,729 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-08-08 21:00:01,733 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-08-08 21:00:01,739 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-08-08 21:00:01,739 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-08-08 21:00:01,741 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-08-08 21:00:01,742 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-08-08 21:00:01,742 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-08-08 21:00:01,744 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-08-08 21:00:01,744 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-08-08 21:00:01,744 - __main__ - INFO - Running 3 scrapers concurrently...
2026-08-08 21:00:01,745 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-08-08 21:00:01,843 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-08-08 21:00:01,848 - IveltScraper - INFO - Loaded 181 include, 1 exclude filters from DB topic_filters
2026-08-08 21:00:01,848 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-08-08 21:00:01,849 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-08-08 21:00:01,947 - RSSFeedScraper - ERROR - Error fetching RSS feed https://www.theyeshivaworld.com/feed: name 'feedparser' is not defined
2026-08-08 21:00:01,949 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-08-08 21:00:02,382 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-08-08 21:00:02,586 - Yiddish24Scraper - INFO - Received response with 438554 characters
2026-08-08 21:00:02,589 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (292364 chars)
2026-08-08 21:00:02,592 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-08-08 21:00:02,686 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-08-08 21:00:02,732 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-08-08 21:00:02,732 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-08-08 21:00:03,576 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 100 total articles
2026-08-08 21:00:03,576 - Yiddish24Scraper - INFO - Page 1: 0/100 new items
2026-08-08 21:00:03,576 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination
2026-08-08 21:00:03,576 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0
2026-08-08 21:00:13,936 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-08-08 21:00:25,790 - IveltScraper - INFO - ivelt scrape complete. Checked 3 topics.
2026-08-08 21:00:25,790 - IveltScraper - INFO - All forums scrape complete. Found 0 new posts.
2026-08-08 21:00:25,790 - __main__ - INFO - Scraper rss completed: 0 results
2026-08-08 21:00:25,790 - __main__ - INFO - Scraper yiddish24 completed: 0 results
2026-08-08 21:00:25,790 - __main__ - INFO - Scraper ivelt completed: 0 results
2026-08-08 21:00:25,791 - __main__ - INFO - No new results found across all enabled sources
2026-08-08 21:00:25,791 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-08-08 21:00:25,791 - __main__ - INFO - Monitor complete. No new results found across all sources.
2026-08-08 21:00:25,791 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-08-08 21:00:25,791 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-08 21:00:25,839 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-08-08 21:00:25,839 - __main__ - INFO - Closed all database connections
2026-08-08 21:00:25,841 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-08 21:00:25,841 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-08-08 22:00:01,997 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-08-08.log
2026-08-08 22:00:01,997 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-08-08.log
2026-08-08 22:00:01,997 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-08-08.log
2026-08-08 22:00:01,997 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-08-08 22:00:02,030 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-08-08 22:00:02,030 - __main__ - INFO - Configuration loaded and validated successfully
2026-08-08 22:00:02,033 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-08-08 22:00:02,033 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-08-08 22:00:02,053 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-08-08 22:00:02,053 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-08-08 22:00:02,097 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0 (contact:abep+dev@nocommand.local)')
2026-08-08 22:00:02,098 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-08-08 22:00:02,098 - __main__ - INFO - RSS scraper initialized and enabled
2026-08-08 22:00:02,102 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-08-08 22:00:02,102 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-08-08 22:00:02,102 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-08-08 22:00:02,104 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-08-08 22:00:02,109 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-08-08 22:00:02,109 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-08-08 22:00:02,111 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-08-08 22:00:02,111 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-08-08 22:00:02,111 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-08-08 22:00:02,115 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-08-08 22:00:02,115 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-08-08 22:00:02,115 - __main__ - INFO - Running 3 scrapers concurrently...
2026-08-08 22:00:02,115 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-08-08 22:00:02,212 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-08-08 22:00:02,217 - IveltScraper - INFO - Loaded 181 include, 1 exclude filters from DB topic_filters
2026-08-08 22:00:02,217 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-08-08 22:00:02,219 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-08-08 22:00:02,310 - RSSFeedScraper - ERROR - Error fetching RSS feed https://www.theyeshivaworld.com/feed: name 'feedparser' is not defined
2026-08-08 22:00:02,312 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-08-08 22:00:02,749 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-08-08 22:00:02,973 - Yiddish24Scraper - INFO - Received response with 438554 characters
2026-08-08 22:00:02,976 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (292364 chars)
2026-08-08 22:00:02,979 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-08-08 22:00:03,063 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-08-08 22:00:03,106 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-08-08 22:00:03,106 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-08-08 22:00:03,947 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 100 total articles
2026-08-08 22:00:03,947 - Yiddish24Scraper - INFO - Page 1: 0/100 new items
2026-08-08 22:00:03,947 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination
2026-08-08 22:00:03,948 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0
2026-08-08 22:00:14,132 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-08-08 22:00:25,882 - IveltScraper - INFO - ivelt scrape complete. Checked 3 topics.
2026-08-08 22:00:25,882 - IveltScraper - INFO - All forums scrape complete. Found 0 new posts.
2026-08-08 22:00:25,882 - __main__ - INFO - Scraper rss completed: 0 results
2026-08-08 22:00:25,882 - __main__ - INFO - Scraper yiddish24 completed: 0 results
2026-08-08 22:00:25,882 - __main__ - INFO - Scraper ivelt completed: 0 results
2026-08-08 22:00:25,882 - __main__ - INFO - No new results found across all enabled sources
2026-08-08 22:00:25,883 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-08-08 22:00:25,883 - __main__ - INFO - Monitor complete. No new results found across all sources.
2026-08-08 22:00:25,883 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-08-08 22:00:25,883 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-08 22:00:25,928 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-08-08 22:00:25,928 - __main__ - INFO - Closed all database connections
2026-08-08 22:00:25,930 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-08 22:00:25,930 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-08-08 22:30:01,909 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-08-08.log
2026-08-08 22:30:01,909 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-08-08.log
2026-08-08 22:30:01,909 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-08-08.log
2026-08-08 22:30:01,909 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-08-08 22:30:01,941 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-08-08 22:30:01,941 - __main__ - INFO - Configuration loaded and validated successfully
2026-08-08 22:30:01,943 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-08-08 22:30:01,944 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-08-08 22:30:01,959 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-08-08 22:30:01,959 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-08-08 22:30:01,961 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0 (contact:abep+dev@nocommand.local)')
2026-08-08 22:30:01,961 - __main__ - INFO - GitHub scraper initialized and enabled
2026-08-08 22:30:01,961 - __main__ - INFO - GitHub feed scraper initialized and enabled
2026-08-08 22:30:01,962 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-08-08 22:30:01,965 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-08-08 22:30:01,966 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-08-08 22:30:01,968 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-08-08 22:30:01,973 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-08-08 22:30:01,973 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-08-08 22:30:01,975 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-08-08 22:30:01,975 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-08-08 22:30:01,975 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-08-08 22:30:01,978 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-08-08 22:30:01,978 - __main__ - INFO - YouTube Intel scraper initialized and enabled
2026-08-08 22:30:01,978 - __main__ - INFO - Running 3 scrapers concurrently...
2026-08-08 22:30:01,978 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-08-08 22:30:02,396 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"
2026-08-08 22:30:02,397 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)
2026-08-08 22:30:03,027 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-08-08 22:30:03,055 - GitHubScraper - INFO - Found 247 GitHub repositories for term: paperclip
2026-08-08 22:30:03,347 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:03,348 - GitHubFeedScraper - INFO - GitHub account feed page 1 unchanged (ETag)
2026-08-08 22:30:04,026 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-08-08 22:30:04,030 - GitHubScraper - INFO - Found 507 GitHub repositories for term: "Hermes Agent"
2026-08-08 22:30:04,944 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-08-08 22:30:04,946 - GitHubScraper - INFO - Found 60 GitHub repositories for term: multica
2026-08-08 22:30:05,080 - GitHubScraper - INFO - Total GitHub results found: 0
2026-08-08 22:30:06,382 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"
2026-08-08 22:30:06,748 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:06,786 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:06,790 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:06,884 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:07,158 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:07,187 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:07,203 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:07,272 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yitzih97/torahtale/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:07,514 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:07,581 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:07,595 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/tatyesod/talmud-tora-web/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:07,854 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:07,914 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-08 22:30:08,001 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:08,125 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:08,185 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:08,296 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:08,513 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:08,522 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:08,621 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/sikmenedowai-a11y/savetube-stream-kit/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-08 22:30:08,737 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-08 22:30:08,853 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:08,861 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:09,028 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:09,047 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:09,192 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:09,222 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:09,498 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:09,673 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:09,758 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:09,863 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:09,871 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:10,150 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:10,278 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:10,282 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:10,457 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:10,492 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:10,628 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:10,774 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-08 22:30:10,882 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-08 22:30:10,940 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-08 22:30:11,002 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:11,188 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:11,237 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-08 22:30:11,352 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:11,476 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-08 22:30:11,696 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:11,749 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/scott-fleischman/shark-2026/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:11,852 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:11,873 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:12,027 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:12,066 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:12,207 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:12,302 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:12,437 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:12,448 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:12,570 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:12,660 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:12,825 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:13,018 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:13,118 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:13,200 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:13,232 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:13,450 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:13,514 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:13,592 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:13,657 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:13,777 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:13,843 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:13,985 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:14,059 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:14,154 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:14,227 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:14,401 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:14,433 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:14,483 - YouTubeIntelScraper - INFO - YouTube Intel found 55 candidates and 9 new videos
2026-08-08 22:30:14,622 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:14,654 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:14,703 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:14,768 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:14,968 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:14,988 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yeled-tov/filtertube-android/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:14,995 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:15,149 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:15,222 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:15,322 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:15,373 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:15,453 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-shabbat-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:15,625 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:15,645 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:15,669 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/ShireiShabbat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:15,729 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:15,958 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:15,980 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:16,007 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:16,015 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:16,254 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:16,260 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:16,365 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:16,370 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:16,605 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-08 22:30:16,689 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=0 account_new=0 list_repos=100 list_new=0 private_new=0 total_new=0
2026-08-08 22:30:16,691 - __main__ - INFO - Scraper github completed: 0 results
2026-08-08 22:30:16,691 - __main__ - INFO - Scraper github_feed completed: 0 results
2026-08-08 22:30:16,691 - __main__ - INFO - Scraper youtube_intel completed: 9 results
2026-08-08 22:30:17,471 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-08-08 22:30:17.471113
2026-08-08 22:30:17,471 - __main__ - INFO - Email sent successfully
2026-08-08 22:30:17,471 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-08-08 22:30:17,471 - __main__ - INFO - Monitor complete. Found 9 total results: 9 new youtube intel results.
2026-08-08 22:30:17,471 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-08-08 22:30:17,471 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-08 22:30:17,502 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-08-08 22:30:17,502 - __main__ - INFO - Closed all database connections
2026-08-08 22:30:17,504 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-08 22:30:17,504 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-08-08 23:00:02,525 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-08-08.log
2026-08-08 23:00:02,525 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-08-08.log
2026-08-08 23:00:02,525 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-08-08.log
2026-08-08 23:00:02,525 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-08-08 23:00:02,556 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-08-08 23:00:02,557 - __main__ - INFO - Configuration loaded and validated successfully
2026-08-08 23:00:02,559 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-08-08 23:00:02,560 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-08-08 23:00:02,584 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-08-08 23:00:02,584 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-08-08 23:00:02,631 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0 (contact:abep+dev@nocommand.local)')
2026-08-08 23:00:02,632 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-08-08 23:00:02,632 - __main__ - INFO - RSS scraper initialized and enabled
2026-08-08 23:00:02,635 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-08-08 23:00:02,635 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-08-08 23:00:02,635 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-08-08 23:00:02,638 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-08-08 23:00:02,642 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-08-08 23:00:02,642 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-08-08 23:00:02,645 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-08-08 23:00:02,645 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-08-08 23:00:02,645 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-08-08 23:00:02,647 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-08-08 23:00:02,648 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-08-08 23:00:02,648 - __main__ - INFO - Running 3 scrapers concurrently...
2026-08-08 23:00:02,648 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-08-08 23:00:02,737 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-08-08 23:00:02,742 - IveltScraper - INFO - Loaded 181 include, 1 exclude filters from DB topic_filters
2026-08-08 23:00:02,742 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-08-08 23:00:02,743 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-08-08 23:00:02,822 - RSSFeedScraper - ERROR - Error fetching RSS feed https://www.theyeshivaworld.com/feed: name 'feedparser' is not defined
2026-08-08 23:00:02,825 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-08-08 23:00:03,226 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-08-08 23:00:03,432 - Yiddish24Scraper - INFO - Received response with 438554 characters
2026-08-08 23:00:03,434 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (292364 chars)
2026-08-08 23:00:03,436 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-08-08 23:00:03,515 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-08-08 23:00:03,554 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-08-08 23:00:03,554 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-08-08 23:00:04,434 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 100 total articles
2026-08-08 23:00:04,434 - Yiddish24Scraper - INFO - Page 1: 0/100 new items
2026-08-08 23:00:04,434 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination
2026-08-08 23:00:04,434 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0
2026-08-08 23:00:14,600 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-08-08 23:00:25,655 - IveltScraper - INFO - ivelt scrape complete. Checked 3 topics.
2026-08-08 23:00:25,656 - IveltScraper - INFO - All forums scrape complete. Found 0 new posts.
2026-08-08 23:00:25,656 - __main__ - INFO - Scraper rss completed: 0 results
2026-08-08 23:00:25,656 - __main__ - INFO - Scraper yiddish24 completed: 0 results
2026-08-08 23:00:25,656 - __main__ - INFO - Scraper ivelt completed: 0 results
2026-08-08 23:00:25,656 - __main__ - INFO - No new results found across all enabled sources
2026-08-08 23:00:25,657 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-08-08 23:00:25,657 - __main__ - INFO - Monitor complete. No new results found across all sources.
2026-08-08 23:00:25,657 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-08-08 23:00:25,657 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-08 23:00:25,708 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-08-08 23:00:25,708 - __main__ - INFO - Closed all database connections
2026-08-08 23:00:25,710 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-08 23:00:25,711 - social_media_monitor.database.connection - INFO - Closed 0 database connections
Live tail active — waiting for new lines...