← Logs
social_media_monitor_2026-09-26.log
2026-09-26 20:00:13,738 - __main__ - INFO - Scraper yiddish24 completed: 0 results
2026-09-26 20:00:13,738 - __main__ - INFO - Scraper ivelt completed: 0 results
2026-09-26 20:00:13,738 - __main__ - INFO - No new results found across all enabled sources
2026-09-26 20:00:13,738 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-26 20:00:13,738 - __main__ - INFO - Monitor complete. No new results found across all sources.
2026-09-26 20:00:13,738 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-26 20:00:13,738 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-26 20:00:14,498 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-26 20:00:14,498 - __main__ - INFO - Closed all database connections
2026-09-26 20:00:14,500 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-26 20:00:14,500 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-26 20:30:01,826 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-26.log
2026-09-26 20:30:01,826 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-26.log
2026-09-26 20:30:01,827 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-26.log
2026-09-26 20:30:01,827 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-26 20:30:01,857 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-26 20:30:01,857 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-26 20:30:01,859 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-26 20:30:01,860 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-26 20:30:01,874 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-26 20:30:01,874 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-26 20:30:01,877 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-26 20:30:01,878 - __main__ - INFO - GitHub scraper initialized and enabled
2026-09-26 20:30:01,878 - __main__ - INFO - GitHub feed scraper initialized and enabled
2026-09-26 20:30:01,879 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-26 20:30:01,884 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-26 20:30:01,884 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-26 20:30:01,887 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-26 20:30:01,892 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-26 20:30:01,892 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-26 20:30:01,895 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-26 20:30:01,895 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-26 20:30:01,895 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-26 20:30:01,897 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-26 20:30:01,897 - __main__ - INFO - YouTube Intel scraper initialized and enabled
2026-09-26 20:30:01,898 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-26 20:30:01,898 - GitHubScraper - INFO - Searching GitHub for terms: ['"Hermes Agent"', '"grok bot OR grokbot"', '"muse NOT music NOT museum"', '"prime agent"', 'paperclip']
2026-09-26 20:30:02,511 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"
2026-09-26 20:30:02,512 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)
2026-09-26 20:30:02,918 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-26 20:30:02,943 - GitHubScraper - INFO - Found 644 GitHub repositories for term: "Hermes Agent"
2026-09-26 20:30:03,150 - GitHubScraper - INFO - Added new GitHub repository: awesome-jev-use-cases
2026-09-26 20:30:03,427 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:03,427 - GitHubFeedScraper - INFO - GitHub account feed page 1 unchanged (ETag)
2026-09-26 20:30:03,506 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22grok+bot+OR+grokbot%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-26 20:30:03,507 - GitHubScraper - INFO - Found 0 GitHub repositories for term: "grok bot OR grokbot"
2026-09-26 20:30:04,582 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22muse+NOT+music+NOT+museum%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-26 20:30:04,582 - GitHubScraper - INFO - Found 0 GitHub repositories for term: "muse NOT music NOT museum"
2026-09-26 20:30:06,071 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22prime+agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-26 20:30:06,076 - GitHubScraper - INFO - Found 41 GitHub repositories for term: "prime agent"
2026-09-26 20:30:06,753 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"
2026-09-26 20:30:07,093 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:07,102 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:07,148 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:07,154 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-26 20:30:07,157 - GitHubScraper - INFO - Found 263 GitHub repositories for term: paperclip
2026-09-26 20:30:07,321 - GitHubScraper - INFO - Total GitHub results found: 1
2026-09-26 20:30:07,322 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:07,439 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:07,447 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:07,481 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:07,654 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:07,764 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:07,813 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:07,868 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:07,993 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:08,101 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:08,179 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:08,184 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:08,412 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:08,546 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:08,578 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/sikmenedowai-a11y/savetube-stream-kit/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-26 20:30:08,602 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-26 20:30:08,785 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:08,815 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:08,966 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:09,000 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:09,114 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:09,145 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:09,439 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:09,539 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:09,594 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:09,626 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:09,760 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:09,859 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:10,017 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:10,122 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:10,201 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:10,215 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:10,386 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:10,484 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:10,569 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:10,590 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:10,708 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:10,884 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:10,949 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:11,005 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-26 20:30:11,008 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:11,268 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:11,372 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:11,468 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:11,548 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:11,598 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:11,628 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:11,871 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:11,905 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-26 20:30:12,017 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:12,138 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:12,226 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:12,229 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:12,308 - YouTubeIntelScraper - INFO - YouTube Intel found 27 candidates and 6 new videos
2026-09-26 20:30:12,649 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:12,651 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:12,658 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:12,740 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:13,032 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:13,093 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:13,098 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:13,303 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:13,386 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:13,426 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:13,438 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:13,623 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:13,709 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:13,750 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:13,776 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:13,959 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:14,036 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:14,137 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:14,139 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:14,276 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:14,360 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:14,412 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:14,494 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:14,624 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:14,690 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:14,750 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-26 20:30:14,885 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-tfilah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:14,995 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:15,024 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:15,027 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:15,236 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:15,279 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:15,310 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:15,315 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:15,502 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:15,556 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:15,597 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:15,663 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-26 20:30:15,890 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akshatasatmar/WeatherServiceApi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:15,934 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmaribianca05-eng/AFSD-Satmari-Bianca/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:15,952 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elchunenfreund/satmar-matzos-app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:16,013 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:16,312 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/Sefaria-Export/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:16,417 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-es6/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 20:30:16,467 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=0 account_new=0 list_repos=100 list_new=0 private_new=0 total_new=0
2026-09-26 20:30:16,468 - __main__ - INFO - Scraper github completed: 1 results
2026-09-26 20:30:16,468 - __main__ - INFO - Scraper github_feed completed: 0 results
2026-09-26 20:30:16,468 - __main__ - INFO - Scraper youtube_intel completed: 6 results
2026-09-26 20:30:17,306 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-26 20:30:17.306915
2026-09-26 20:30:17,307 - __main__ - INFO - Email sent successfully
2026-09-26 20:30:17,307 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-26 20:30:17,307 - __main__ - INFO - Monitor complete. Found 7 total results: 1 new github results, 6 new youtube intel results.
2026-09-26 20:30:17,307 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-26 20:30:17,307 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-26 20:30:17,342 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-26 20:30:17,343 - __main__ - INFO - Closed all database connections
2026-09-26 20:30:17,345 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-26 20:30:17,345 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-26 21:00:02,311 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-26.log
2026-09-26 21:00:02,311 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-26.log
2026-09-26 21:00:02,311 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-26.log
2026-09-26 21:00:02,311 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-26 21:00:02,341 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-26 21:00:02,341 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-26 21:00:02,343 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-26 21:00:02,344 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-26 21:00:02,365 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-26 21:00:02,366 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-26 21:00:02,425 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-26 21:00:02,428 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-26 21:00:02,428 - __main__ - INFO - RSS scraper initialized and enabled
2026-09-26 21:00:02,436 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-26 21:00:02,436 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-26 21:00:02,436 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-09-26 21:00:02,441 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-26 21:00:02,448 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-26 21:00:02,448 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-26 21:00:02,450 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-26 21:00:02,450 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-26 21:00:02,451 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-26 21:00:02,453 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-26 21:00:02,453 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-09-26 21:00:02,453 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-26 21:00:02,454 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-09-26 21:00:02,544 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-09-26 21:00:02,550 - IveltScraper - INFO - Loaded 182 include, 4 exclude filters from DB topic_filters
2026-09-26 21:00:02,550 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-09-26 21:00:02,553 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-09-26 21:00:02,884 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-09-26 21:00:04,293 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-09-26 21:00:04,507 - Yiddish24Scraper - INFO - Received response with 486710 characters
2026-09-26 21:00:04,509 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (301532 chars)
2026-09-26 21:00:04,511 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-09-26 21:00:04,589 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-09-26 21:00:04,632 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-09-26 21:00:04,632 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-09-26 21:00:05,413 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 100 total articles
2026-09-26 21:00:05,413 - Yiddish24Scraper - INFO - Page 1: 0/100 new items
2026-09-26 21:00:05,413 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination
2026-09-26 21:00:05,414 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0
2026-09-26 21:00:14,344 - IveltScraper - INFO - Found 0 active topics on ivelt
2026-09-26 21:00:14,345 - IveltScraper - INFO - ivelt scrape complete. Checked 0 topics.
2026-09-26 21:00:14,345 - IveltScraper - INFO - All forums scrape complete. Found 0 new posts.
2026-09-26 21:00:14,345 - __main__ - INFO - Scraper rss completed: 0 results
2026-09-26 21:00:14,345 - __main__ - INFO - Scraper yiddish24 completed: 0 results
2026-09-26 21:00:14,345 - __main__ - INFO - Scraper ivelt completed: 0 results
2026-09-26 21:00:14,346 - __main__ - INFO - No new results found across all enabled sources
2026-09-26 21:00:14,346 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-26 21:00:14,346 - __main__ - INFO - Monitor complete. No new results found across all sources.
2026-09-26 21:00:14,346 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-26 21:00:14,346 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-26 21:00:15,161 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-26 21:00:15,161 - __main__ - INFO - Closed all database connections
2026-09-26 21:00:15,164 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-26 21:00:15,164 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-26 22:00:02,439 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-26.log
2026-09-26 22:00:02,439 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-26.log
2026-09-26 22:00:02,439 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-26.log
2026-09-26 22:00:02,439 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-26 22:00:02,468 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-26 22:00:02,468 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-26 22:00:02,470 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-26 22:00:02,471 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-26 22:00:02,486 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-26 22:00:02,486 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-26 22:00:02,539 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-26 22:00:02,540 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-26 22:00:02,540 - __main__ - INFO - RSS scraper initialized and enabled
2026-09-26 22:00:02,544 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-26 22:00:02,544 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-26 22:00:02,544 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-09-26 22:00:02,547 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-26 22:00:02,552 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-26 22:00:02,552 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-26 22:00:02,555 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-26 22:00:02,555 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-26 22:00:02,555 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-26 22:00:02,559 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-26 22:00:02,559 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-09-26 22:00:02,559 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-26 22:00:02,559 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-09-26 22:00:02,645 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-09-26 22:00:02,650 - IveltScraper - INFO - Loaded 182 include, 4 exclude filters from DB topic_filters
2026-09-26 22:00:02,650 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-09-26 22:00:02,651 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-09-26 22:00:02,991 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-09-26 22:00:03,499 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-09-26 22:00:03,718 - Yiddish24Scraper - INFO - Received response with 486710 characters
2026-09-26 22:00:03,721 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (301532 chars)
2026-09-26 22:00:03,723 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-09-26 22:00:03,794 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-09-26 22:00:03,835 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-09-26 22:00:03,835 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-09-26 22:00:04,654 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 100 total articles
2026-09-26 22:00:04,654 - Yiddish24Scraper - INFO - Page 1: 0/100 new items
2026-09-26 22:00:04,654 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination
2026-09-26 22:00:04,655 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0
2026-09-26 22:00:14,461 - IveltScraper - INFO - Found 0 active topics on ivelt
2026-09-26 22:00:14,461 - IveltScraper - INFO - ivelt scrape complete. Checked 0 topics.
2026-09-26 22:00:14,461 - IveltScraper - INFO - All forums scrape complete. Found 0 new posts.
2026-09-26 22:00:14,461 - __main__ - INFO - Scraper rss completed: 0 results
2026-09-26 22:00:14,462 - __main__ - INFO - Scraper yiddish24 completed: 0 results
2026-09-26 22:00:14,462 - __main__ - INFO - Scraper ivelt completed: 0 results
2026-09-26 22:00:14,462 - __main__ - INFO - No new results found across all enabled sources
2026-09-26 22:00:14,462 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-26 22:00:14,462 - __main__ - INFO - Monitor complete. No new results found across all sources.
2026-09-26 22:00:14,462 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-26 22:00:14,463 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-26 22:00:15,235 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-26 22:00:15,235 - __main__ - INFO - Closed all database connections
2026-09-26 22:00:15,237 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-26 22:00:15,238 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-26 22:30:02,025 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-26.log
2026-09-26 22:30:02,025 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-26.log
2026-09-26 22:30:02,025 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-26.log
2026-09-26 22:30:02,025 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-26 22:30:02,054 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-26 22:30:02,054 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-26 22:30:02,057 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-26 22:30:02,057 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-26 22:30:02,070 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-26 22:30:02,070 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-26 22:30:02,073 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-26 22:30:02,073 - __main__ - INFO - GitHub scraper initialized and enabled
2026-09-26 22:30:02,073 - __main__ - INFO - GitHub feed scraper initialized and enabled
2026-09-26 22:30:02,074 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-26 22:30:02,079 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-26 22:30:02,079 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-26 22:30:02,082 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-26 22:30:02,087 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-26 22:30:02,087 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-26 22:30:02,089 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-26 22:30:02,090 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-26 22:30:02,090 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-26 22:30:02,092 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-26 22:30:02,092 - __main__ - INFO - YouTube Intel scraper initialized and enabled
2026-09-26 22:30:02,092 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-26 22:30:02,092 - GitHubScraper - INFO - Searching GitHub for terms: ['"Hermes Agent"', '"grok bot OR grokbot"', '"muse NOT music NOT museum"', '"prime agent"', 'paperclip']
2026-09-26 22:30:02,543 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"
2026-09-26 22:30:02,543 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)
2026-09-26 22:30:03,439 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"
2026-09-26 22:30:04,547 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"
2026-09-26 22:30:04,747 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-26 22:30:04,772 - GitHubScraper - INFO - Found 644 GitHub repositories for term: "Hermes Agent"
2026-09-26 22:30:04,849 - GitHubScraper - INFO - Added new GitHub repository: avenoxbeyin
2026-09-26 22:30:05,343 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22grok+bot+OR+grokbot%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-26 22:30:05,343 - GitHubScraper - INFO - Found 0 GitHub repositories for term: "grok bot OR grokbot"
2026-09-26 22:30:05,520 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:05,520 - GitHubFeedScraper - INFO - GitHub account feed page 3 unchanged (ETag)
2026-09-26 22:30:06,298 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22muse+NOT+music+NOT+museum%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-26 22:30:06,299 - GitHubScraper - INFO - Found 0 GitHub repositories for term: "muse NOT music NOT museum"
2026-09-26 22:30:07,962 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22prime+agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-26 22:30:08,049 - GitHubScraper - INFO - Found 41 GitHub repositories for term: "prime agent"
2026-09-26 22:30:08,605 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"
2026-09-26 22:30:08,935 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:08,980 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-26 22:30:08,985 - GitHubScraper - INFO - Found 263 GitHub repositories for term: paperclip
2026-09-26 22:30:09,105 - GitHubScraper - INFO - Total GitHub results found: 1
2026-09-26 22:30:09,106 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:09,107 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:09,108 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:09,365 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:09,389 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:09,447 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:09,451 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:09,667 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:09,717 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:09,778 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:09,780 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:09,948 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:10,118 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:10,139 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:10,326 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:10,373 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/sikmenedowai-a11y/savetube-stream-kit/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-26 22:30:10,472 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:10,615 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-26 22:30:10,665 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:10,715 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:10,830 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:10,998 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:11,003 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:11,079 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:11,321 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:11,389 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:11,456 - YouTubeIntelScraper - INFO - YouTube Intel found 27 candidates and 3 new videos
2026-09-26 22:30:11,511 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:11,603 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:11,649 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:11,732 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:11,940 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:12,030 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:12,040 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:12,082 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:12,290 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:12,397 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-26 22:30:12,438 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:12,536 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-26 22:30:12,633 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:12,789 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:12,791 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-26 22:30:12,920 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:13,012 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-26 22:30:13,176 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:13,331 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:13,351 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:13,448 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:13,449 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:13,685 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:13,857 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:13,914 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:13,995 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:14,150 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:14,240 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:14,246 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:14,541 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:14,663 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:14,718 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:14,765 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:15,038 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:15,087 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:15,100 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:15,134 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:15,367 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:15,433 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:15,510 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:15,576 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:15,704 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:15,733 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:15,882 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:15,888 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:16,029 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:16,033 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:16,214 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:16,256 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:16,296 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:16,366 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:16,565 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:16,588 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:16,704 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:16,714 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:16,944 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:16,945 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-tfilah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:17,037 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:17,096 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:17,282 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:17,331 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:17,374 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:17,424 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:17,594 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:17,616 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:17,711 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:17,842 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:17,876 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:17,901 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akshatasatmar/WeatherServiceApi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:18,059 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elchunenfreund/satmar-matzos-app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:18,103 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmaribianca05-eng/AFSD-Satmari-Bianca/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:18,276 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/Sefaria-Export/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:18,413 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-es6/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-26 22:30:18,597 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=200 account_new=0 list_repos=100 list_new=0 private_new=0 total_new=0
2026-09-26 22:30:18,598 - __main__ - INFO - Scraper github completed: 1 results
2026-09-26 22:30:18,598 - __main__ - INFO - Scraper github_feed completed: 0 results
2026-09-26 22:30:18,598 - __main__ - INFO - Scraper youtube_intel completed: 3 results
2026-09-26 22:30:19,326 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-26 22:30:19.326292
2026-09-26 22:30:19,326 - __main__ - INFO - Email sent successfully
2026-09-26 22:30:19,326 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-26 22:30:19,327 - __main__ - INFO - Monitor complete. Found 4 total results: 1 new github results, 3 new youtube intel results.
2026-09-26 22:30:19,327 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-26 22:30:19,327 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-26 22:30:19,358 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-26 22:30:19,358 - __main__ - INFO - Closed all database connections
2026-09-26 22:30:19,360 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-26 22:30:19,360 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-26 23:00:02,040 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-26.log
2026-09-26 23:00:02,040 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-26.log
2026-09-26 23:00:02,041 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-26.log
2026-09-26 23:00:02,041 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-26 23:00:02,071 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-26 23:00:02,071 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-26 23:00:02,073 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-26 23:00:02,074 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-26 23:00:02,089 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-26 23:00:02,089 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-26 23:00:02,094 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-26 23:00:02,096 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-26 23:00:02,097 - __main__ - INFO - RSS scraper initialized and enabled
2026-09-26 23:00:02,102 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-26 23:00:02,102 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-26 23:00:02,102 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-09-26 23:00:02,107 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-26 23:00:02,114 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-26 23:00:02,114 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-26 23:00:02,116 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-26 23:00:02,116 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-26 23:00:02,117 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-26 23:00:02,119 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-26 23:00:02,119 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-09-26 23:00:02,119 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-26 23:00:02,119 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-09-26 23:00:02,211 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-09-26 23:00:02,216 - IveltScraper - INFO - Loaded 182 include, 4 exclude filters from DB topic_filters
2026-09-26 23:00:02,216 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-09-26 23:00:02,217 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-09-26 23:00:02,552 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-09-26 23:00:03,025 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-09-26 23:00:03,247 - Yiddish24Scraper - INFO - Received response with 486710 characters
2026-09-26 23:00:03,250 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (301532 chars)
2026-09-26 23:00:03,254 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-09-26 23:00:03,352 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-09-26 23:00:03,391 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-09-26 23:00:03,391 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-09-26 23:00:04,322 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 100 total articles
2026-09-26 23:00:04,323 - Yiddish24Scraper - INFO - Page 1: 0/100 new items
2026-09-26 23:00:04,323 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination
2026-09-26 23:00:04,323 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0
2026-09-26 23:00:14,722 - IveltScraper - INFO - Found 0 active topics on ivelt
2026-09-26 23:00:14,722 - IveltScraper - INFO - ivelt scrape complete. Checked 0 topics.
2026-09-26 23:00:14,722 - IveltScraper - INFO - All forums scrape complete. Found 0 new posts.
2026-09-26 23:00:14,722 - __main__ - INFO - Scraper rss completed: 0 results
2026-09-26 23:00:14,722 - __main__ - INFO - Scraper yiddish24 completed: 0 results
2026-09-26 23:00:14,722 - __main__ - INFO - Scraper ivelt completed: 0 results
2026-09-26 23:00:14,723 - __main__ - INFO - No new results found across all enabled sources
2026-09-26 23:00:14,723 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-26 23:00:14,723 - __main__ - INFO - Monitor complete. No new results found across all sources.
2026-09-26 23:00:14,723 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-26 23:00:14,723 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-26 23:00:15,253 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-26 23:00:15,254 - __main__ - INFO - Closed all database connections
2026-09-26 23:00:15,255 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-26 23:00:15,255 - social_media_monitor.database.connection - INFO - Closed 0 database connections
Live tail active — waiting for new lines...