← Logs

social_media_monitor_2026-09-05.log

2026-09-05 20:00:30,191 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-05 20:00:30,191 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-05 20:30:02,139 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-05.log
2026-09-05 20:30:02,139 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-05.log
2026-09-05 20:30:02,139 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-05.log
2026-09-05 20:30:02,140 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-05 20:30:02,169 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-05 20:30:02,169 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-05 20:30:02,172 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-05 20:30:02,172 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-05 20:30:02,185 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-05 20:30:02,185 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-05 20:30:02,243 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-05 20:30:02,245 - __main__ - INFO - GitHub scraper initialized and enabled
2026-09-05 20:30:02,245 - __main__ - INFO - GitHub feed scraper initialized and enabled
2026-09-05 20:30:02,245 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-05 20:30:02,253 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-05 20:30:02,253 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-05 20:30:02,258 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-05 20:30:02,266 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-05 20:30:02,266 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-05 20:30:02,268 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-05 20:30:02,268 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-05 20:30:02,269 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-05 20:30:02,271 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-05 20:30:02,271 - __main__ - INFO - YouTube Intel scraper initialized and enabled
2026-09-05 20:30:02,271 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-05 20:30:02,271 - GitHubScraper - INFO - Searching GitHub for terms: ['"Hermes Agent"', '"claude code"', '"prime agent"', 'paperclip']
2026-09-05 20:30:02,695 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"
2026-09-05 20:30:02,696 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)
2026-09-05 20:30:03,265 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-05 20:30:03,353 - GitHubScraper - INFO - Found 585 GitHub repositories for term: "Hermes Agent"
2026-09-05 20:30:03,457 - GitHubScraper - INFO - Added new GitHub repository: carrot
2026-09-05 20:30:03,538 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"
2026-09-05 20:30:04,308 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22claude+code%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-05 20:30:04,404 - GitHubScraper - INFO - Found 8469 GitHub repositories for term: "claude code"
2026-09-05 20:30:04,434 - GitHubScraper - INFO - Added new GitHub repository: hippo-memory
2026-09-05 20:30:04,488 - GitHubScraper - INFO - Added new GitHub repository: system_prompts_leaks
2026-09-05 20:30:04,506 - GitHubScraper - INFO - Added new GitHub repository: exo
2026-09-05 20:30:04,529 - GitHubScraper - INFO - Added new GitHub repository: skills
2026-09-05 20:30:04,606 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"
2026-09-05 20:30:05,309 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22prime+agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-05 20:30:05,312 - GitHubScraper - INFO - Found 39 GitHub repositories for term: "prime agent"
2026-09-05 20:30:05,650 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:05,651 - GitHubFeedScraper - INFO - GitHub account feed page 3 unchanged (ETag)
2026-09-05 20:30:06,452 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-05 20:30:06,455 - GitHubScraper - INFO - Found 258 GitHub repositories for term: paperclip
2026-09-05 20:30:06,699 - GitHubScraper - INFO - Total GitHub results found: 5
2026-09-05 20:30:08,199 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"
2026-09-05 20:30:08,531 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:08,598 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:08,604 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:08,611 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:08,883 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:08,897 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:08,963 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:08,972 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:09,265 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:09,291 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:09,376 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:09,547 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:09,599 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:09,653 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:09,754 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:09,967 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:09,988 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:10,039 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/sikmenedowai-a11y/savetube-stream-kit/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-05 20:30:10,245 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-05 20:30:10,282 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:10,308 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:10,423 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:10,620 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:10,630 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-05 20:30:10,641 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:10,777 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:10,980 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:11,030 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:11,108 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:11,279 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:11,348 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:11,613 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:11,622 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:11,626 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:11,643 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:11,879 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:12,027 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:12,090 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-05 20:30:12,223 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:12,227 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-05 20:30:12,516 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:12,570 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:12,650 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:12,831 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-05 20:30:12,902 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:13,020 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:13,026 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-05 20:30:13,158 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:13,257 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:13,495 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:13,529 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:13,534 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:13,568 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:13,911 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:13,997 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:14,033 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:14,048 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:14,364 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:14,427 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:14,455 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:14,549 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:14,691 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:14,751 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-05 20:30:14,758 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:14,864 - YouTubeIntelScraper - INFO - YouTube Intel found 48 candidates and 8 new videos
2026-09-05 20:30:14,911 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:15,027 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:15,089 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:15,155 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-05 20:30:15,287 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:15,344 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:15,378 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:15,529 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:15,626 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:15,728 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:15,812 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:15,834 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:15,965 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:16,180 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:16,211 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-05 20:30:16,304 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yeled-tov/filtertube-android/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-05 20:30:16,315 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:16,535 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:16,578 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:16,680 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-tfilah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:16,718 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:16,809 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:16,922 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:17,022 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:17,084 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:17,099 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:17,276 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:17,378 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:17,434 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:17,442 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:17,634 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:17,655 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:17,733 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akshatasatmar/WeatherServiceApi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:17,735 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elchunenfreund/satmar-matzos-app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:17,983 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmaribianca05-eng/AFSD-Satmari-Bianca/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:18,094 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/Sefaria-Export/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 20:30:18,165 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=200 account_new=0 list_repos=100 list_new=0 private_new=0 total_new=0
2026-09-05 20:30:18,166 - __main__ - INFO - Scraper github completed: 5 results
2026-09-05 20:30:18,166 - __main__ - INFO - Scraper github_feed completed: 0 results
2026-09-05 20:30:18,166 - __main__ - INFO - Scraper youtube_intel completed: 8 results
2026-09-05 20:30:19,176 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-05 20:30:19.175957
2026-09-05 20:30:19,176 - __main__ - INFO - Email sent successfully
2026-09-05 20:30:19,176 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-05 20:30:19,176 - __main__ - INFO - Monitor complete. Found 13 total results: 5 new github results, 8 new youtube intel results.
2026-09-05 20:30:19,176 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-05 20:30:19,176 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-05 20:30:19,225 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-05 20:30:19,226 - __main__ - INFO - Closed all database connections
2026-09-05 20:30:19,228 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-05 20:30:19,228 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-05 21:00:02,261 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-05.log
2026-09-05 21:00:02,261 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-05.log
2026-09-05 21:00:02,261 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-05.log
2026-09-05 21:00:02,262 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-05 21:00:02,290 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-05 21:00:02,290 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-05 21:00:02,292 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-05 21:00:02,293 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-05 21:00:02,413 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-05 21:00:02,414 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-05 21:00:02,419 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-05 21:00:02,421 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-05 21:00:02,421 - __main__ - INFO - RSS scraper initialized and enabled
2026-09-05 21:00:02,429 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-05 21:00:02,429 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-05 21:00:02,430 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-09-05 21:00:02,438 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-05 21:00:02,445 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-05 21:00:02,445 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-05 21:00:02,450 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-05 21:00:02,450 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-05 21:00:02,450 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-05 21:00:02,456 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-05 21:00:02,456 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-09-05 21:00:02,456 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-05 21:00:02,457 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-09-05 21:00:02,556 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-09-05 21:00:02,562 - IveltScraper - INFO - Loaded 181 include, 4 exclude filters from DB topic_filters
2026-09-05 21:00:02,562 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-09-05 21:00:02,564 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-09-05 21:00:03,005 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-09-05 21:00:04,228 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-09-05 21:00:04,453 - Yiddish24Scraper - INFO - Received response with 474815 characters
2026-09-05 21:00:04,456 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (304422 chars)
2026-09-05 21:00:04,459 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-09-05 21:00:04,555 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-09-05 21:00:04,595 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-09-05 21:00:04,596 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-09-05 21:00:05,299 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 100 total articles
2026-09-05 21:00:05,300 - Yiddish24Scraper - INFO - Page 1: 0/100 new items
2026-09-05 21:00:05,300 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination
2026-09-05 21:00:05,300 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0
2026-09-05 21:00:14,514 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-09-05 21:00:28,849 - IveltScraper - INFO - ivelt scrape complete. Checked 4 topics.
2026-09-05 21:00:28,849 - IveltScraper - INFO - All forums scrape complete. Found 0 new posts.
2026-09-05 21:00:28,849 - __main__ - INFO - Scraper rss completed: 0 results
2026-09-05 21:00:28,849 - __main__ - INFO - Scraper yiddish24 completed: 0 results
2026-09-05 21:00:28,849 - __main__ - INFO - Scraper ivelt completed: 0 results
2026-09-05 21:00:28,850 - __main__ - INFO - No new results found across all enabled sources
2026-09-05 21:00:28,850 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-05 21:00:28,850 - __main__ - INFO - Monitor complete. No new results found across all sources.
2026-09-05 21:00:28,850 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-05 21:00:28,850 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-05 21:00:28,931 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-05 21:00:28,931 - __main__ - INFO - Closed all database connections
2026-09-05 21:00:28,934 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-05 21:00:28,934 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-05 22:00:01,840 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-05.log
2026-09-05 22:00:01,840 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-05.log
2026-09-05 22:00:01,840 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-05.log
2026-09-05 22:00:01,841 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-05 22:00:01,869 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-05 22:00:01,869 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-05 22:00:01,871 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-05 22:00:01,872 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-05 22:00:01,887 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-05 22:00:01,888 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-05 22:00:01,940 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-05 22:00:01,942 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-05 22:00:01,942 - __main__ - INFO - RSS scraper initialized and enabled
2026-09-05 22:00:01,948 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-05 22:00:01,948 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-05 22:00:01,948 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-09-05 22:00:01,953 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-05 22:00:01,960 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-05 22:00:01,960 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-05 22:00:01,962 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-05 22:00:01,962 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-05 22:00:01,962 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-05 22:00:01,964 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-05 22:00:01,964 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-09-05 22:00:01,964 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-05 22:00:01,965 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-09-05 22:00:02,053 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-09-05 22:00:02,057 - IveltScraper - INFO - Loaded 181 include, 4 exclude filters from DB topic_filters
2026-09-05 22:00:02,057 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-09-05 22:00:02,060 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-09-05 22:00:02,566 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-09-05 22:00:02,974 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-09-05 22:00:03,195 - Yiddish24Scraper - INFO - Received response with 474815 characters
2026-09-05 22:00:03,196 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (304422 chars)
2026-09-05 22:00:03,197 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-09-05 22:00:03,284 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-09-05 22:00:03,331 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-09-05 22:00:03,331 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-09-05 22:00:04,038 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 100 total articles
2026-09-05 22:00:04,038 - Yiddish24Scraper - INFO - Page 1: 0/100 new items
2026-09-05 22:00:04,038 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination
2026-09-05 22:00:04,039 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0
2026-09-05 22:00:13,990 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-09-05 22:00:27,618 - IveltScraper - INFO - ivelt scrape complete. Checked 4 topics.
2026-09-05 22:00:27,618 - IveltScraper - INFO - All forums scrape complete. Found 0 new posts.
2026-09-05 22:00:27,618 - __main__ - INFO - Scraper rss completed: 0 results
2026-09-05 22:00:27,618 - __main__ - INFO - Scraper yiddish24 completed: 0 results
2026-09-05 22:00:27,619 - __main__ - INFO - Scraper ivelt completed: 0 results
2026-09-05 22:00:27,619 - __main__ - INFO - No new results found across all enabled sources
2026-09-05 22:00:27,619 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-05 22:00:27,619 - __main__ - INFO - Monitor complete. No new results found across all sources.
2026-09-05 22:00:27,619 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-05 22:00:27,619 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-05 22:00:27,685 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-05 22:00:27,685 - __main__ - INFO - Closed all database connections
2026-09-05 22:00:27,687 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-05 22:00:27,687 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-05 22:30:02,469 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-05.log
2026-09-05 22:30:02,469 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-05.log
2026-09-05 22:30:02,469 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-05.log
2026-09-05 22:30:02,469 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-05 22:30:02,498 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-05 22:30:02,498 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-05 22:30:02,500 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-05 22:30:02,501 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-05 22:30:02,515 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-05 22:30:02,516 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-05 22:30:02,520 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-05 22:30:02,521 - __main__ - INFO - GitHub scraper initialized and enabled
2026-09-05 22:30:02,521 - __main__ - INFO - GitHub feed scraper initialized and enabled
2026-09-05 22:30:02,521 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-05 22:30:02,527 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-05 22:30:02,527 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-05 22:30:02,531 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-05 22:30:02,535 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-05 22:30:02,536 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-05 22:30:02,538 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-05 22:30:02,538 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-05 22:30:02,538 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-05 22:30:02,540 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-05 22:30:02,540 - __main__ - INFO - YouTube Intel scraper initialized and enabled
2026-09-05 22:30:02,540 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-05 22:30:02,541 - GitHubScraper - INFO - Searching GitHub for terms: ['"Hermes Agent"', '"claude code"', '"prime agent"', 'paperclip']
2026-09-05 22:30:02,947 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"
2026-09-05 22:30:02,948 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)
2026-09-05 22:30:03,549 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-05 22:30:03,577 - GitHubScraper - INFO - Found 586 GitHub repositories for term: "Hermes Agent"
2026-09-05 22:30:03,792 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"
2026-09-05 22:30:04,530 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"
2026-09-05 22:30:04,535 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22claude+code%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-05 22:30:04,538 - GitHubScraper - INFO - Found 8471 GitHub repositories for term: "claude code"
2026-09-05 22:30:04,554 - GitHubScraper - INFO - Added new GitHub repository: CodeWebChat
2026-09-05 22:30:04,584 - GitHubScraper - INFO - Added new GitHub repository: blockrun-mcp
2026-09-05 22:30:04,640 - GitHubScraper - INFO - Added new GitHub repository: fit
2026-09-05 22:30:04,648 - GitHubScraper - INFO - Added new GitHub repository: pymobiledevice3
2026-09-05 22:30:04,656 - GitHubScraper - INFO - Added new GitHub repository: nativ
2026-09-05 22:30:04,682 - GitHubScraper - INFO - Added new GitHub repository: oracle
2026-09-05 22:30:04,690 - GitHubScraper - INFO - Added new GitHub repository: vexa
2026-09-05 22:30:04,706 - GitHubScraper - INFO - Added new GitHub repository: awesome-OpenClaw-Money-Maker
2026-09-05 22:30:05,554 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22prime+agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-05 22:30:05,643 - GitHubScraper - INFO - Found 39 GitHub repositories for term: "prime agent"
2026-09-05 22:30:05,787 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:05,788 - GitHubFeedScraper - INFO - GitHub account feed page 3 unchanged (ETag)
2026-09-05 22:30:06,629 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-05 22:30:06,633 - GitHubScraper - INFO - Found 258 GitHub repositories for term: paperclip
2026-09-05 22:30:06,763 - GitHubScraper - INFO - Total GitHub results found: 8
2026-09-05 22:30:08,649 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"
2026-09-05 22:30:09,036 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:09,064 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:09,091 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:09,238 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:09,381 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:09,416 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:09,465 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:09,608 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-05 22:30:09,734 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:09,806 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:09,987 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:10,047 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:10,059 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:10,122 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:10,343 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:10,463 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:10,492 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:10,586 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/sikmenedowai-a11y/savetube-stream-kit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:10,787 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:10,808 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:10,865 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:10,995 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:11,180 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:11,213 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:11,267 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:11,338 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:11,588 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:11,700 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-05 22:30:11,727 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:11,878 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:11,951 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:12,198 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:12,233 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:12,253 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:12,355 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:12,594 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:12,688 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-05 22:30:12,741 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-05 22:30:12,913 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-05 22:30:12,918 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:13,132 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:13,191 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:13,277 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:13,405 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-05 22:30:13,527 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:13,659 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:13,680 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:13,686 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:13,892 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:13,992 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:14,003 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:14,162 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:14,187 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:14,372 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:14,440 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:14,482 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:14,522 - YouTubeIntelScraper - INFO - YouTube Intel found 53 candidates and 11 new videos
2026-09-05 22:30:14,576 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:14,907 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:14,909 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:15,084 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:15,150 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:15,227 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-05 22:30:15,236 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:15,413 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:15,498 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:15,532 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:15,596 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:15,811 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:15,834 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:15,852 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:15,922 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:16,152 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:16,210 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:16,219 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:16,347 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:16,490 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:16,543 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yeled-tov/filtertube-android/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-05 22:30:16,561 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:16,765 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:16,826 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:16,829 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:17,039 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:17,131 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:17,195 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:17,347 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-tfilah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:17,384 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:17,408 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:17,535 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:17,710 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:17,744 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:17,755 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:17,801 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:18,027 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:18,062 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:18,145 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:18,177 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:18,381 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akshatasatmar/WeatherServiceApi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:18,432 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elchunenfreund/satmar-matzos-app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:18,461 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmaribianca05-eng/AFSD-Satmari-Bianca/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:18,605 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/Sefaria-Export/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-05 22:30:18,662 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=200 account_new=0 list_repos=100 list_new=0 private_new=0 total_new=0
2026-09-05 22:30:18,663 - __main__ - INFO - Scraper github completed: 8 results
2026-09-05 22:30:18,663 - __main__ - INFO - Scraper github_feed completed: 0 results
2026-09-05 22:30:18,663 - __main__ - INFO - Scraper youtube_intel completed: 11 results
2026-09-05 22:30:19,322 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-05 22:30:19.322658
2026-09-05 22:30:19,322 - __main__ - INFO - Email sent successfully
2026-09-05 22:30:19,323 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-05 22:30:19,323 - __main__ - INFO - Monitor complete. Found 19 total results: 8 new github results, 11 new youtube intel results.
2026-09-05 22:30:19,323 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-05 22:30:19,323 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-05 22:30:19,363 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-05 22:30:19,363 - __main__ - INFO - Closed all database connections
2026-09-05 22:30:19,365 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-05 22:30:19,365 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-05 23:00:01,742 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-05.log
2026-09-05 23:00:01,742 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-05.log
2026-09-05 23:00:01,743 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-05.log
2026-09-05 23:00:01,743 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-05 23:00:01,771 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-05 23:00:01,771 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-05 23:00:01,773 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-05 23:00:01,774 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-05 23:00:01,792 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-05 23:00:01,792 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-05 23:00:01,797 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-05 23:00:01,799 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-05 23:00:01,800 - __main__ - INFO - RSS scraper initialized and enabled
2026-09-05 23:00:01,806 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-05 23:00:01,807 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-05 23:00:01,807 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-09-05 23:00:01,812 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-05 23:00:01,819 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-05 23:00:01,819 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-05 23:00:01,822 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-05 23:00:01,822 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-05 23:00:01,822 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-05 23:00:01,824 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-05 23:00:01,824 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-09-05 23:00:01,824 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-05 23:00:01,824 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-09-05 23:00:01,910 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-09-05 23:00:01,915 - IveltScraper - INFO - Loaded 181 include, 4 exclude filters from DB topic_filters
2026-09-05 23:00:01,915 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-09-05 23:00:01,917 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-09-05 23:00:02,992 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-09-05 23:00:03,507 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-09-05 23:00:03,726 - Yiddish24Scraper - INFO - Received response with 474815 characters
2026-09-05 23:00:03,730 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (304422 chars)
2026-09-05 23:00:03,734 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-09-05 23:00:03,826 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-09-05 23:00:03,872 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-09-05 23:00:03,872 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-09-05 23:00:04,622 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 100 total articles
2026-09-05 23:00:04,622 - Yiddish24Scraper - INFO - Page 1: 0/100 new items
2026-09-05 23:00:04,622 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination
2026-09-05 23:00:04,623 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0
2026-09-05 23:00:13,825 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-09-05 23:00:28,128 - IveltScraper - INFO - ivelt scrape complete. Checked 4 topics.
2026-09-05 23:00:28,128 - IveltScraper - INFO - All forums scrape complete. Found 0 new posts.
2026-09-05 23:00:28,129 - __main__ - INFO - Scraper rss completed: 0 results
2026-09-05 23:00:28,129 - __main__ - INFO - Scraper yiddish24 completed: 0 results
2026-09-05 23:00:28,129 - __main__ - INFO - Scraper ivelt completed: 0 results
2026-09-05 23:00:28,129 - __main__ - INFO - No new results found across all enabled sources
2026-09-05 23:00:28,130 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-05 23:00:28,130 - __main__ - INFO - Monitor complete. No new results found across all sources.
2026-09-05 23:00:28,130 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-05 23:00:28,130 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-05 23:00:28,160 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-05 23:00:28,161 - __main__ - INFO - Closed all database connections
2026-09-05 23:00:28,162 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-05 23:00:28,163 - social_media_monitor.database.connection - INFO - Closed 0 database connections