← Logs

social_media_monitor_2026-09-12.log

2026-09-12 20:00:32,579 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-09-12 20:00:32,579 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-12 20:00:32,625 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-09-12 20:00:32,625 - __main__ - INFO - Closed all database connections

2026-09-12 20:00:32,627 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-12 20:00:32,627 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-09-12 20:30:02,086 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-12.log

2026-09-12 20:30:02,086 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-12.log

2026-09-12 20:30:02,086 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-12.log

2026-09-12 20:30:02,086 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-09-12 20:30:02,114 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-09-12 20:30:02,115 - __main__ - INFO - Configuration loaded and validated successfully

2026-09-12 20:30:02,117 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-09-12 20:30:02,117 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-09-12 20:30:02,132 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-09-12 20:30:02,132 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-09-12 20:30:02,135 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')

2026-09-12 20:30:02,135 - __main__ - INFO - GitHub scraper initialized and enabled

2026-09-12 20:30:02,135 - __main__ - INFO - GitHub feed scraper initialized and enabled

2026-09-12 20:30:02,136 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-09-12 20:30:02,138 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled

2026-09-12 20:30:02,138 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0

2026-09-12 20:30:02,140 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-09-12 20:30:02,145 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled

2026-09-12 20:30:02,145 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13

2026-09-12 20:30:02,147 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-09-12 20:30:02,147 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2

2026-09-12 20:30:02,147 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0

2026-09-12 20:30:02,149 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0

2026-09-12 20:30:02,150 - __main__ - INFO - YouTube Intel scraper initialized and enabled

2026-09-12 20:30:02,150 - __main__ - INFO - Running 3 scrapers concurrently...

2026-09-12 20:30:02,150 - GitHubScraper - INFO - Searching GitHub for terms: ['"Hermes Agent"', '"claude code"', '"prime agent"', 'paperclip']

2026-09-12 20:30:02,713 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"

2026-09-12 20:30:02,715 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)

2026-09-12 20:30:03,435 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-09-12 20:30:03,525 - GitHubScraper - INFO - Found 604 GitHub repositories for term: "Hermes Agent"

2026-09-12 20:30:03,780 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"

2026-09-12 20:30:04,743 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22claude+code%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-09-12 20:30:04,746 - GitHubScraper - INFO - Found 8708 GitHub repositories for term: "claude code"

2026-09-12 20:30:04,810 - GitHubScraper - INFO - Added new GitHub repository: partcad

2026-09-12 20:30:04,893 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"

2026-09-12 20:30:05,721 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22prime+agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-09-12 20:30:05,818 - GitHubScraper - INFO - Found 40 GitHub repositories for term: "prime agent"

2026-09-12 20:30:05,962 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 200 OK"

2026-09-12 20:30:06,778 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-09-12 20:30:06,782 - GitHubScraper - INFO - Found 259 GitHub repositories for term: paperclip

2026-09-12 20:30:07,014 - GitHubScraper - INFO - Total GitHub results found: 1

2026-09-12 20:30:08,863 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"

2026-09-12 20:30:09,205 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:09,253 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:09,291 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:09,295 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:09,521 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:09,618 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:09,640 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:09,674 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:09,922 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:10,017 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:10,099 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:10,101 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:10,208 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:10,328 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:10,472 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:10,474 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:10,676 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-12 20:30:10,749 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/sikmenedowai-a11y/savetube-stream-kit/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-12 20:30:10,801 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:10,911 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:11,016 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:11,169 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:11,189 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-12 20:30:11,240 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:11,320 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:11,520 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:11,709 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:11,736 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:11,828 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:11,869 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:12,040 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:12,252 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:12,254 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:12,325 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:12,376 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:12,532 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:12,796 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-12 20:30:12,826 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-12 20:30:12,865 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:12,891 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:13,205 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:13,282 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:13,325 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-12 20:30:13,349 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:13,365 - YouTubeIntelScraper - INFO - YouTube Intel found 47 candidates and 11 new videos

2026-09-12 20:30:13,602 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:13,675 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:13,732 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:13,753 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:13,946 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:13,966 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:14,145 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:14,271 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:14,328 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:14,436 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:14,495 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-12 20:30:14,709 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:14,833 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:14,899 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:14,933 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-12 20:30:15,163 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:15,234 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:15,269 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:15,394 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:15,516 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:15,606 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:15,645 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:15,689 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:15,882 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:15,970 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:16,003 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:16,079 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:16,263 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:16,342 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:16,410 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:16,491 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:16,537 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:16,681 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:16,839 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yeled-tov/filtertube-android/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-12 20:30:16,941 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:17,029 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:17,063 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:17,277 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-12 20:30:17,285 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:17,441 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:17,447 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-tfilah/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:17,554 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:17,578 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:17,788 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:17,830 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:17,914 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:17,955 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:18,124 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:18,212 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:18,213 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:18,351 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:18,462 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:18,545 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elchunenfreund/satmar-matzos-app/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:18,599 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akshatasatmar/WeatherServiceApi/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:18,705 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmaribianca05-eng/AFSD-Satmari-Bianca/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:18,988 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/Sefaria-Export/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 20:30:19,068 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=235 account_new=0 list_repos=100 list_new=0 private_new=0 total_new=0

2026-09-12 20:30:19,069 - __main__ - INFO - Scraper github completed: 1 results

2026-09-12 20:30:19,069 - __main__ - INFO - Scraper github_feed completed: 0 results

2026-09-12 20:30:19,069 - __main__ - INFO - Scraper youtube_intel completed: 11 results

2026-09-12 20:30:19,728 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-12 20:30:19.728866

2026-09-12 20:30:19,729 - __main__ - INFO - Email sent successfully

2026-09-12 20:30:19,729 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-09-12 20:30:19,729 - __main__ - INFO - Monitor complete. Found 12 total results: 1 new github results, 11 new youtube intel results.

2026-09-12 20:30:19,729 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-09-12 20:30:19,729 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-12 20:30:19,757 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-09-12 20:30:19,757 - __main__ - INFO - Closed all database connections

2026-09-12 20:30:19,760 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-12 20:30:19,760 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-09-12 21:00:02,285 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-12.log

2026-09-12 21:00:02,285 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-12.log

2026-09-12 21:00:02,285 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-12.log

2026-09-12 21:00:02,285 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-09-12 21:00:02,314 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-09-12 21:00:02,314 - __main__ - INFO - Configuration loaded and validated successfully

2026-09-12 21:00:02,316 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-09-12 21:00:02,317 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-09-12 21:00:02,333 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-09-12 21:00:02,333 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-09-12 21:00:02,390 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')

2026-09-12 21:00:02,392 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-09-12 21:00:02,392 - __main__ - INFO - RSS scraper initialized and enabled

2026-09-12 21:00:02,400 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled

2026-09-12 21:00:02,401 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0

2026-09-12 21:00:02,401 - __main__ - INFO - Yiddish24 scraper initialized and enabled

2026-09-12 21:00:02,405 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-09-12 21:00:02,414 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled

2026-09-12 21:00:02,414 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13

2026-09-12 21:00:02,418 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-09-12 21:00:02,418 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2

2026-09-12 21:00:02,418 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0

2026-09-12 21:00:02,424 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0

2026-09-12 21:00:02,424 - __main__ - INFO - Ivelt scraper initialized and enabled

2026-09-12 21:00:02,425 - __main__ - INFO - Running 3 scrapers concurrently...

2026-09-12 21:00:02,425 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)

2026-09-12 21:00:02,522 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100

2026-09-12 21:00:02,527 - IveltScraper - INFO - Loaded 181 include, 4 exclude filters from DB topic_filters

2026-09-12 21:00:02,527 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...

2026-09-12 21:00:02,530 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed

2026-09-12 21:00:03,628 - RSSFeedScraper - INFO - Total RSS/HTML results: 0

2026-09-12 21:00:04,071 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"

2026-09-12 21:00:04,281 - Yiddish24Scraper - INFO - Received response with 439901 characters

2026-09-12 21:00:04,284 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (292340 chars)

2026-09-12 21:00:04,287 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html

2026-09-12 21:00:04,362 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1

2026-09-12 21:00:04,402 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements

2026-09-12 21:00:04,402 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1

2026-09-12 21:00:05,069 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 100 total articles

2026-09-12 21:00:05,070 - Yiddish24Scraper - INFO - Page 1: 0/100 new items

2026-09-12 21:00:05,070 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination

2026-09-12 21:00:05,070 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0

2026-09-12 21:00:14,451 - IveltScraper - INFO - Found 50 active topics on ivelt

2026-09-12 21:00:28,372 - IveltScraper - INFO - Filtering post containing exclude term: '*ביטע מאכט זיכער בלויז צו באריכטן קראנטע נייעס*'

2026-09-12 21:00:32,625 - IveltScraper - INFO - ivelt scrape complete. Checked 5 topics.

2026-09-12 21:00:32,625 - IveltScraper - INFO - All forums scrape complete. Found 0 new posts.

2026-09-12 21:00:32,626 - __main__ - INFO - Scraper rss completed: 0 results

2026-09-12 21:00:32,626 - __main__ - INFO - Scraper yiddish24 completed: 0 results

2026-09-12 21:00:32,626 - __main__ - INFO - Scraper ivelt completed: 0 results

2026-09-12 21:00:32,626 - __main__ - INFO - No new results found across all enabled sources

2026-09-12 21:00:32,626 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-09-12 21:00:32,627 - __main__ - INFO - Monitor complete. No new results found across all sources.

2026-09-12 21:00:32,627 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-09-12 21:00:32,627 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-12 21:00:32,685 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-09-12 21:00:32,686 - __main__ - INFO - Closed all database connections

2026-09-12 21:00:32,688 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-12 21:00:32,688 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-09-12 22:00:02,498 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-12.log

2026-09-12 22:00:02,498 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-12.log

2026-09-12 22:00:02,498 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-12.log

2026-09-12 22:00:02,498 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-09-12 22:00:02,526 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-09-12 22:00:02,526 - __main__ - INFO - Configuration loaded and validated successfully

2026-09-12 22:00:02,528 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-09-12 22:00:02,529 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-09-12 22:00:02,542 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-09-12 22:00:02,542 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-09-12 22:00:02,589 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')

2026-09-12 22:00:02,591 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-09-12 22:00:02,591 - __main__ - INFO - RSS scraper initialized and enabled

2026-09-12 22:00:02,597 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled

2026-09-12 22:00:02,597 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0

2026-09-12 22:00:02,598 - __main__ - INFO - Yiddish24 scraper initialized and enabled

2026-09-12 22:00:02,602 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-09-12 22:00:02,611 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled

2026-09-12 22:00:02,611 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13

2026-09-12 22:00:02,614 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-09-12 22:00:02,614 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2

2026-09-12 22:00:02,614 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0

2026-09-12 22:00:02,616 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0

2026-09-12 22:00:02,616 - __main__ - INFO - Ivelt scraper initialized and enabled

2026-09-12 22:00:02,616 - __main__ - INFO - Running 3 scrapers concurrently...

2026-09-12 22:00:02,617 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)

2026-09-12 22:00:02,723 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100

2026-09-12 22:00:02,727 - IveltScraper - INFO - Loaded 181 include, 4 exclude filters from DB topic_filters

2026-09-12 22:00:02,727 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...

2026-09-12 22:00:02,729 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed

2026-09-12 22:00:03,636 - RSSFeedScraper - INFO - Total RSS/HTML results: 0

2026-09-12 22:00:04,047 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"

2026-09-12 22:00:04,268 - Yiddish24Scraper - INFO - Received response with 439901 characters

2026-09-12 22:00:04,271 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (292340 chars)

2026-09-12 22:00:04,273 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html

2026-09-12 22:00:04,345 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1

2026-09-12 22:00:04,386 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements

2026-09-12 22:00:04,386 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1

2026-09-12 22:00:05,058 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 100 total articles

2026-09-12 22:00:05,058 - Yiddish24Scraper - INFO - Page 1: 0/100 new items

2026-09-12 22:00:05,058 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination

2026-09-12 22:00:05,059 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0

2026-09-12 22:00:14,925 - IveltScraper - INFO - Found 50 active topics on ivelt

2026-09-12 22:00:28,509 - IveltScraper - INFO - Filtering post containing exclude term: '*ביטע מאכט זיכער בלויז צו באריכטן קראנטע נייעס*'

2026-09-12 22:00:32,794 - IveltScraper - INFO - ivelt scrape complete. Checked 5 topics.

2026-09-12 22:00:32,794 - IveltScraper - INFO - All forums scrape complete. Found 0 new posts.

2026-09-12 22:00:32,795 - __main__ - INFO - Scraper rss completed: 0 results

2026-09-12 22:00:32,795 - __main__ - INFO - Scraper yiddish24 completed: 0 results

2026-09-12 22:00:32,795 - __main__ - INFO - Scraper ivelt completed: 0 results

2026-09-12 22:00:32,795 - __main__ - INFO - No new results found across all enabled sources

2026-09-12 22:00:32,795 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-09-12 22:00:32,795 - __main__ - INFO - Monitor complete. No new results found across all sources.

2026-09-12 22:00:32,796 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-09-12 22:00:32,796 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-12 22:00:32,863 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-09-12 22:00:32,863 - __main__ - INFO - Closed all database connections

2026-09-12 22:00:32,866 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-12 22:00:32,866 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-09-12 22:30:02,580 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-12.log

2026-09-12 22:30:02,580 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-12.log

2026-09-12 22:30:02,581 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-12.log

2026-09-12 22:30:02,581 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-09-12 22:30:02,618 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-09-12 22:30:02,618 - __main__ - INFO - Configuration loaded and validated successfully

2026-09-12 22:30:02,621 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-09-12 22:30:02,622 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-09-12 22:30:02,637 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-09-12 22:30:02,638 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-09-12 22:30:02,641 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')

2026-09-12 22:30:02,642 - __main__ - INFO - GitHub scraper initialized and enabled

2026-09-12 22:30:02,642 - __main__ - INFO - GitHub feed scraper initialized and enabled

2026-09-12 22:30:02,643 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-09-12 22:30:02,647 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled

2026-09-12 22:30:02,647 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0

2026-09-12 22:30:02,651 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-09-12 22:30:02,659 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled

2026-09-12 22:30:02,659 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13

2026-09-12 22:30:02,663 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-09-12 22:30:02,663 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2

2026-09-12 22:30:02,664 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0

2026-09-12 22:30:02,668 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0

2026-09-12 22:30:02,668 - __main__ - INFO - YouTube Intel scraper initialized and enabled

2026-09-12 22:30:02,668 - __main__ - INFO - Running 3 scrapers concurrently...

2026-09-12 22:30:02,668 - GitHubScraper - INFO - Searching GitHub for terms: ['"Hermes Agent"', '"claude code"', '"prime agent"', 'paperclip']

2026-09-12 22:30:03,146 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"

2026-09-12 22:30:03,147 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)

2026-09-12 22:30:03,798 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-09-12 22:30:03,891 - GitHubScraper - INFO - Found 604 GitHub repositories for term: "Hermes Agent"

2026-09-12 22:30:04,064 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"

2026-09-12 22:30:04,914 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22claude+code%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-09-12 22:30:04,918 - GitHubScraper - INFO - Found 8708 GitHub repositories for term: "claude code"

2026-09-12 22:30:04,936 - GitHubScraper - INFO - Added new GitHub repository: beancount-io

2026-09-12 22:30:04,945 - GitHubScraper - INFO - Added new GitHub repository: mcp-logseq

2026-09-12 22:30:04,955 - GitHubScraper - INFO - Added new GitHub repository: Semantic-Anchors

2026-09-12 22:30:04,962 - GitHubScraper - INFO - Added new GitHub repository: flight-finder

2026-09-12 22:30:05,031 - GitHubScraper - INFO - Added new GitHub repository: hyperresearch

2026-09-12 22:30:05,051 - GitHubScraper - INFO - Added new GitHub repository: avoid-ai-writing

2026-09-12 22:30:05,110 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"

2026-09-12 22:30:05,996 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22prime+agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-09-12 22:30:06,000 - GitHubScraper - INFO - Found 40 GitHub repositories for term: "prime agent"

2026-09-12 22:30:06,140 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:06,141 - GitHubFeedScraper - INFO - GitHub account feed page 3 unchanged (ETag)

2026-09-12 22:30:07,030 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-09-12 22:30:07,123 - GitHubScraper - INFO - Found 259 GitHub repositories for term: paperclip

2026-09-12 22:30:07,260 - GitHubScraper - INFO - Total GitHub results found: 6

2026-09-12 22:30:08,905 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"

2026-09-12 22:30:09,230 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:09,336 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:09,362 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-12 22:30:09,367 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:09,634 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:09,676 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:09,680 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:09,738 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:10,020 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-12 22:30:10,023 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:10,029 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:10,161 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:10,329 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:10,402 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:10,418 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:10,495 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:10,754 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/sikmenedowai-a11y/savetube-stream-kit/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-12 22:30:10,779 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:10,837 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:10,964 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-12 22:30:11,110 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:11,170 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:11,206 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:11,295 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:11,495 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:11,505 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:11,715 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:11,811 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:11,825 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:11,878 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:12,081 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:12,237 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:12,424 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:12,437 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:12,447 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:12,578 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:12,879 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:12,923 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:12,968 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:13,001 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:13,290 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:13,345 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:13,468 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:13,502 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-12 22:30:13,678 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:13,861 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:13,870 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:13,910 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:14,002 - YouTubeIntelScraper - INFO - YouTube Intel found 47 candidates and 10 new videos

2026-09-12 22:30:14,035 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:14,209 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:14,280 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:14,346 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:14,380 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:14,591 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:14,609 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:14,631 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:14,839 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:15,038 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:15,152 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:15,189 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:15,381 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:15,437 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:15,494 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:15,562 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:15,779 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:15,828 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:15,877 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:15,952 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:16,145 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:16,208 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:16,240 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:16,327 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:16,491 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:16,531 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:16,663 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:16,682 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:16,825 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:16,958 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:16,980 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yeled-tov/filtertube-android/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:17,030 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:17,173 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:17,360 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:17,366 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:17,526 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-tfilah/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:17,550 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:17,639 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:17,700 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:17,874 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:17,931 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:17,985 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:17,996 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:18,162 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:18,266 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:18,379 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:18,512 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:18,625 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akshatasatmar/WeatherServiceApi/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:18,630 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:18,666 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elchunenfreund/satmar-matzos-app/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:18,849 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmaribianca05-eng/AFSD-Satmari-Bianca/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:19,042 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/Sefaria-Export/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-12 22:30:19,084 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=200 account_new=0 list_repos=100 list_new=0 private_new=0 total_new=0

2026-09-12 22:30:19,085 - __main__ - INFO - Scraper github completed: 6 results

2026-09-12 22:30:19,085 - __main__ - INFO - Scraper github_feed completed: 0 results

2026-09-12 22:30:19,085 - __main__ - INFO - Scraper youtube_intel completed: 10 results

2026-09-12 22:30:20,018 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-12 22:30:20.018290

2026-09-12 22:30:20,018 - __main__ - INFO - Email sent successfully

2026-09-12 22:30:20,018 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-09-12 22:30:20,018 - __main__ - INFO - Monitor complete. Found 16 total results: 6 new github results, 10 new youtube intel results.

2026-09-12 22:30:20,018 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-09-12 22:30:20,018 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-12 22:30:20,045 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-09-12 22:30:20,045 - __main__ - INFO - Closed all database connections

2026-09-12 22:30:20,047 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-12 22:30:20,047 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-09-12 23:00:01,658 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-12.log

2026-09-12 23:00:01,658 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-12.log

2026-09-12 23:00:01,658 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-12.log

2026-09-12 23:00:01,658 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-09-12 23:00:01,686 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-09-12 23:00:01,686 - __main__ - INFO - Configuration loaded and validated successfully

2026-09-12 23:00:01,689 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-09-12 23:00:01,689 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-09-12 23:00:01,702 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-09-12 23:00:01,702 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-09-12 23:00:01,704 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')

2026-09-12 23:00:01,705 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-09-12 23:00:01,705 - __main__ - INFO - RSS scraper initialized and enabled

2026-09-12 23:00:01,708 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled

2026-09-12 23:00:01,709 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0

2026-09-12 23:00:01,709 - __main__ - INFO - Yiddish24 scraper initialized and enabled

2026-09-12 23:00:01,714 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-09-12 23:00:01,719 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled

2026-09-12 23:00:01,719 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13

2026-09-12 23:00:01,721 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-09-12 23:00:01,721 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2

2026-09-12 23:00:01,721 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0

2026-09-12 23:00:01,724 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0

2026-09-12 23:00:01,724 - __main__ - INFO - Ivelt scraper initialized and enabled

2026-09-12 23:00:01,724 - __main__ - INFO - Running 3 scrapers concurrently...

2026-09-12 23:00:01,724 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)

2026-09-12 23:00:01,838 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100

2026-09-12 23:00:01,843 - IveltScraper - INFO - Loaded 181 include, 4 exclude filters from DB topic_filters

2026-09-12 23:00:01,843 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...

2026-09-12 23:00:01,845 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed

2026-09-12 23:00:03,105 - RSSFeedScraper - INFO - Total RSS/HTML results: 0

2026-09-12 23:00:03,503 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"

2026-09-12 23:00:03,723 - Yiddish24Scraper - INFO - Received response with 439901 characters

2026-09-12 23:00:03,727 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (292340 chars)

2026-09-12 23:00:03,730 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html

2026-09-12 23:00:03,806 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1

2026-09-12 23:00:03,848 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements

2026-09-12 23:00:03,848 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1

2026-09-12 23:00:04,659 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 100 total articles

2026-09-12 23:00:04,659 - Yiddish24Scraper - INFO - Page 1: 0/100 new items

2026-09-12 23:00:04,659 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination

2026-09-12 23:00:04,660 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0

2026-09-12 23:00:13,926 - IveltScraper - INFO - Found 50 active topics on ivelt

2026-09-12 23:00:27,928 - IveltScraper - INFO - Filtering post containing exclude term: '*ביטע מאכט זיכער בלויז צו באריכטן קראנטע נייעס*'

2026-09-12 23:00:32,056 - IveltScraper - INFO - ivelt scrape complete. Checked 5 topics.

2026-09-12 23:00:32,056 - IveltScraper - INFO - All forums scrape complete. Found 0 new posts.

2026-09-12 23:00:32,056 - __main__ - INFO - Scraper rss completed: 0 results

2026-09-12 23:00:32,056 - __main__ - INFO - Scraper yiddish24 completed: 0 results

2026-09-12 23:00:32,056 - __main__ - INFO - Scraper ivelt completed: 0 results

2026-09-12 23:00:32,057 - __main__ - INFO - No new results found across all enabled sources

2026-09-12 23:00:32,057 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-09-12 23:00:32,057 - __main__ - INFO - Monitor complete. No new results found across all sources.

2026-09-12 23:00:32,057 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-09-12 23:00:32,057 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-12 23:00:32,091 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-09-12 23:00:32,091 - __main__ - INFO - Closed all database connections

2026-09-12 23:00:32,093 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-12 23:00:32,093 - social_media_monitor.database.connection - INFO - Closed 0 database connections