โ† Logs

social_media_monitor_2026-09-13.log

2026-09-13 20:00:34,134 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-13 20:00:34,187 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-13 20:00:34,187 - __main__ - INFO - Closed all database connections
2026-09-13 20:00:34,189 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-13 20:00:34,189 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-13 20:30:02,476 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-13.log
2026-09-13 20:30:02,476 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-13.log
2026-09-13 20:30:02,476 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-13.log
2026-09-13 20:30:02,476 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-13 20:30:02,506 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-13 20:30:02,506 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-13 20:30:02,509 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-13 20:30:02,509 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-13 20:30:02,524 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-13 20:30:02,524 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-13 20:30:02,530 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-13 20:30:02,531 - __main__ - INFO - GitHub scraper initialized and enabled
2026-09-13 20:30:02,531 - __main__ - INFO - GitHub feed scraper initialized and enabled
2026-09-13 20:30:02,532 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-13 20:30:02,539 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-13 20:30:02,539 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-13 20:30:02,545 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-13 20:30:02,551 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-13 20:30:02,551 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-13 20:30:02,553 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-13 20:30:02,554 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-13 20:30:02,554 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-13 20:30:02,556 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-13 20:30:02,556 - __main__ - INFO - YouTube Intel scraper initialized and enabled
2026-09-13 20:30:02,556 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-13 20:30:02,556 - GitHubScraper - INFO - Searching GitHub for terms: ['"Hermes Agent"', '"claude code"', '"prime agent"', 'paperclip']
2026-09-13 20:30:02,997 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"
2026-09-13 20:30:02,998 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)
2026-09-13 20:30:03,734 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-13 20:30:03,759 - GitHubScraper - INFO - Found 607 GitHub repositories for term: "Hermes Agent"
2026-09-13 20:30:03,904 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"
2026-09-13 20:30:04,821 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22claude+code%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-13 20:30:04,908 - GitHubScraper - INFO - Found 8732 GitHub repositories for term: "claude code"
2026-09-13 20:30:05,018 - GitHubScraper - INFO - Added new GitHub repository: happy
2026-09-13 20:30:05,052 - GitHubScraper - INFO - Added new GitHub repository: git-machete
2026-09-13 20:30:05,070 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"
2026-09-13 20:30:05,941 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22prime+agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-13 20:30:05,944 - GitHubScraper - INFO - Found 40 GitHub repositories for term: "prime agent"
2026-09-13 20:30:06,086 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:06,086 - GitHubFeedScraper - INFO - GitHub account feed page 3 unchanged (ETag)
2026-09-13 20:30:06,922 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-13 20:30:06,925 - GitHubScraper - INFO - Found 259 GitHub repositories for term: paperclip
2026-09-13 20:30:07,059 - GitHubScraper - INFO - Total GitHub results found: 2
2026-09-13 20:30:09,016 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"
2026-09-13 20:30:09,387 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:09,435 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:09,438 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:09,444 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:09,724 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:09,794 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:09,815 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:09,857 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:10,026 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-13 20:30:10,069 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:10,104 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:10,281 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:10,317 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:10,436 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:10,438 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:10,719 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:10,815 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:10,847 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/sikmenedowai-a11y/savetube-stream-kit/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-13 20:30:10,913 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:10,997 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:11,150 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:11,281 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:11,287 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-13 20:30:11,342 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:11,457 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:11,735 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-13 20:30:11,816 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:11,875 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:11,937 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:12,042 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:12,205 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:12,328 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:12,350 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:12,527 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:12,540 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:12,613 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:12,865 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-13 20:30:12,888 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:12,990 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-13 20:30:13,040 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-13 20:30:13,174 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:13,360 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:13,433 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-13 20:30:13,483 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-13 20:30:13,588 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-13 20:30:13,766 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:13,847 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:13,889 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:13,929 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:14,051 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:14,300 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:14,317 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:14,476 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:14,477 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:14,665 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:14,696 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:14,871 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:14,967 - YouTubeIntelScraper - INFO - YouTube Intel found 47 candidates and 17 new videos
2026-09-13 20:30:15,059 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:15,117 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:15,213 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:15,394 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:15,462 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:15,535 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-13 20:30:15,571 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:15,739 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:15,765 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:15,816 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:15,957 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:16,050 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:16,066 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:16,322 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:16,329 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:16,334 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:16,462 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:16,605 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:16,622 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:16,684 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:16,877 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yeled-tov/filtertube-android/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-13 20:30:16,889 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:16,951 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:17,006 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:17,251 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:17,323 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-13 20:30:17,357 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:17,467 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-tfilah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:17,638 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:17,654 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:17,683 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:17,856 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:17,960 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:17,973 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:17,982 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:18,139 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:18,295 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:18,340 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:18,372 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:18,506 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akshatasatmar/WeatherServiceApi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:18,642 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elchunenfreund/satmar-matzos-app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:18,848 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/Sefaria-Export/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:18,883 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmaribianca05-eng/AFSD-Satmari-Bianca/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 20:30:18,976 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=200 account_new=0 list_repos=100 list_new=1 private_new=0 total_new=1
2026-09-13 20:30:18,977 - __main__ - INFO - Scraper github completed: 2 results
2026-09-13 20:30:18,977 - __main__ - INFO - Scraper github_feed completed: 1 results
2026-09-13 20:30:18,978 - __main__ - INFO - Scraper youtube_intel completed: 17 results
2026-09-13 20:30:19,639 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-13 20:30:19.638946
2026-09-13 20:30:19,639 - __main__ - INFO - Email sent successfully
2026-09-13 20:30:19,649 - __main__ - INFO - GitHub feed delivery acknowledged: 1 stored, 0 failed
2026-09-13 20:30:19,650 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-13 20:30:19,650 - __main__ - INFO - Monitor complete. Found 20 total results: 2 new github results, 1 new github feed results, 17 new youtube intel results.
2026-09-13 20:30:19,650 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-13 20:30:19,650 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-13 20:30:19,681 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-13 20:30:19,681 - __main__ - INFO - Closed all database connections
2026-09-13 20:30:19,684 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-13 20:30:19,684 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-13 21:00:02,609 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-13.log
2026-09-13 21:00:02,609 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-13.log
2026-09-13 21:00:02,609 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-13.log
2026-09-13 21:00:02,609 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-13 21:00:02,638 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-13 21:00:02,638 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-13 21:00:02,640 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-13 21:00:02,641 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-13 21:00:03,438 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-13 21:00:03,438 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-13 21:00:03,501 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-13 21:00:03,504 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-13 21:00:03,504 - __main__ - INFO - RSS scraper initialized and enabled
2026-09-13 21:00:03,511 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-13 21:00:03,511 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-13 21:00:03,512 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-09-13 21:00:03,516 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-13 21:00:03,523 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-13 21:00:03,523 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-13 21:00:03,525 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-13 21:00:03,525 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-13 21:00:03,525 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-13 21:00:03,527 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-13 21:00:03,527 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-09-13 21:00:03,528 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-13 21:00:03,528 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-09-13 21:00:03,618 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-09-13 21:00:03,623 - IveltScraper - INFO - Loaded 181 include, 4 exclude filters from DB topic_filters
2026-09-13 21:00:03,623 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-09-13 21:00:03,624 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-09-13 21:00:04,745 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-09-13 21:00:05,154 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-09-13 21:00:05,359 - Yiddish24Scraper - INFO - Received response with 439901 characters
2026-09-13 21:00:05,362 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (292340 chars)
2026-09-13 21:00:05,366 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-09-13 21:00:05,441 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-09-13 21:00:05,480 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-09-13 21:00:05,480 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-09-13 21:00:06,185 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 100 total articles
2026-09-13 21:00:06,185 - Yiddish24Scraper - INFO - Page 1: 0/100 new items
2026-09-13 21:00:06,186 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination
2026-09-13 21:00:06,186 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0
2026-09-13 21:00:15,978 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-09-13 21:00:29,179 - IveltScraper - INFO - Filtering post containing exclude term: '*ื‘ื™ื˜ืข ืžืื›ื˜ ื–ื™ื›ืขืจ ื‘ืœื•ื™ื– ืฆื• ื‘ืืจื™ื›ื˜ืŸ ืงืจืื ื˜ืข ื ื™ื™ืขืก*'
2026-09-13 21:00:29,827 - IveltScraper - INFO - ivelt scrape complete. Checked 4 topics.
2026-09-13 21:00:29,828 - IveltScraper - INFO - All forums scrape complete. Found 0 new posts.
2026-09-13 21:00:29,828 - __main__ - INFO - Scraper rss completed: 0 results
2026-09-13 21:00:29,828 - __main__ - INFO - Scraper yiddish24 completed: 0 results
2026-09-13 21:00:29,828 - __main__ - INFO - Scraper ivelt completed: 0 results
2026-09-13 21:00:29,828 - __main__ - INFO - No new results found across all enabled sources
2026-09-13 21:00:29,829 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-13 21:00:29,829 - __main__ - INFO - Monitor complete. No new results found across all sources.
2026-09-13 21:00:29,829 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-13 21:00:29,829 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-13 21:00:29,862 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-13 21:00:29,863 - __main__ - INFO - Closed all database connections
2026-09-13 21:00:29,865 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-13 21:00:29,865 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-13 22:00:01,933 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-13.log
2026-09-13 22:00:01,933 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-13.log
2026-09-13 22:00:01,933 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-13.log
2026-09-13 22:00:01,933 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-13 22:00:01,961 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-13 22:00:01,961 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-13 22:00:01,964 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-13 22:00:01,964 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-13 22:00:01,982 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-13 22:00:01,982 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-13 22:00:01,986 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-13 22:00:01,988 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-13 22:00:01,988 - __main__ - INFO - RSS scraper initialized and enabled
2026-09-13 22:00:01,993 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-13 22:00:01,993 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-13 22:00:01,993 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-09-13 22:00:01,998 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-13 22:00:02,003 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-13 22:00:02,003 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-13 22:00:02,005 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-13 22:00:02,005 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-13 22:00:02,006 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-13 22:00:02,008 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-13 22:00:02,008 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-09-13 22:00:02,008 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-13 22:00:02,008 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-09-13 22:00:02,100 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-09-13 22:00:02,105 - IveltScraper - INFO - Loaded 181 include, 4 exclude filters from DB topic_filters
2026-09-13 22:00:02,105 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-09-13 22:00:02,108 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-09-13 22:00:02,386 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-09-13 22:00:04,476 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-09-13 22:00:04,701 - Yiddish24Scraper - INFO - Received response with 439901 characters
2026-09-13 22:00:04,704 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (292340 chars)
2026-09-13 22:00:04,707 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-09-13 22:00:04,786 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-09-13 22:00:04,840 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-09-13 22:00:04,840 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-09-13 22:00:05,545 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 100 total articles
2026-09-13 22:00:05,545 - Yiddish24Scraper - INFO - Page 1: 0/100 new items
2026-09-13 22:00:05,545 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination
2026-09-13 22:00:05,546 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0
2026-09-13 22:00:14,313 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-09-13 22:00:27,930 - IveltScraper - INFO - Filtering post containing exclude term: '*ื‘ื™ื˜ืข ืžืื›ื˜ ื–ื™ื›ืขืจ ื‘ืœื•ื™ื– ืฆื• ื‘ืืจื™ื›ื˜ืŸ ืงืจืื ื˜ืข ื ื™ื™ืขืก*'
2026-09-13 22:00:28,558 - IveltScraper - INFO - ivelt scrape complete. Checked 4 topics.
2026-09-13 22:00:28,558 - IveltScraper - INFO - All forums scrape complete. Found 0 new posts.
2026-09-13 22:00:28,558 - __main__ - INFO - Scraper rss completed: 0 results
2026-09-13 22:00:28,558 - __main__ - INFO - Scraper yiddish24 completed: 0 results
2026-09-13 22:00:28,558 - __main__ - INFO - Scraper ivelt completed: 0 results
2026-09-13 22:00:28,559 - __main__ - INFO - No new results found across all enabled sources
2026-09-13 22:00:28,559 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-13 22:00:28,559 - __main__ - INFO - Monitor complete. No new results found across all sources.
2026-09-13 22:00:28,559 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-13 22:00:28,559 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-13 22:00:28,600 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-13 22:00:28,600 - __main__ - INFO - Closed all database connections
2026-09-13 22:00:28,602 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-13 22:00:28,603 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-13 22:30:02,215 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-13.log
2026-09-13 22:30:02,215 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-13.log
2026-09-13 22:30:02,215 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-13.log
2026-09-13 22:30:02,215 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-13 22:30:02,245 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-13 22:30:02,245 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-13 22:30:02,247 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-13 22:30:02,248 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-13 22:30:02,264 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-13 22:30:02,264 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-13 22:30:02,327 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-13 22:30:02,328 - __main__ - INFO - GitHub scraper initialized and enabled
2026-09-13 22:30:02,329 - __main__ - INFO - GitHub feed scraper initialized and enabled
2026-09-13 22:30:02,329 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-13 22:30:02,336 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-13 22:30:02,337 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-13 22:30:02,341 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-13 22:30:02,346 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-13 22:30:02,346 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-13 22:30:02,349 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-13 22:30:02,349 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-13 22:30:02,349 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-13 22:30:02,352 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-13 22:30:02,352 - __main__ - INFO - YouTube Intel scraper initialized and enabled
2026-09-13 22:30:02,352 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-13 22:30:02,352 - GitHubScraper - INFO - Searching GitHub for terms: ['"Hermes Agent"', '"claude code"', '"prime agent"', 'paperclip']
2026-09-13 22:30:02,945 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"
2026-09-13 22:30:02,946 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)
2026-09-13 22:30:03,842 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-13 22:30:03,869 - GitHubScraper - INFO - Found 607 GitHub repositories for term: "Hermes Agent"
2026-09-13 22:30:04,011 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"
2026-09-13 22:30:04,772 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22claude+code%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-13 22:30:04,778 - GitHubScraper - INFO - Found 8733 GitHub repositories for term: "claude code"
2026-09-13 22:30:04,858 - GitHubScraper - INFO - Added new GitHub repository: engrim
2026-09-13 22:30:04,916 - GitHubScraper - INFO - Added new GitHub repository: lighthouse-mcp
2026-09-13 22:30:04,925 - GitHubScraper - INFO - Added new GitHub repository: agentacct
2026-09-13 22:30:05,068 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"
2026-09-13 22:30:05,911 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22prime+agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-13 22:30:05,915 - GitHubScraper - INFO - Found 40 GitHub repositories for term: "prime agent"
2026-09-13 22:30:06,075 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:06,076 - GitHubFeedScraper - INFO - GitHub account feed page 3 unchanged (ETag)
2026-09-13 22:30:06,958 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-09-13 22:30:07,052 - GitHubScraper - INFO - Found 259 GitHub repositories for term: paperclip
2026-09-13 22:30:07,201 - GitHubScraper - INFO - Total GitHub results found: 3
2026-09-13 22:30:08,944 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"
2026-09-13 22:30:09,302 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:09,327 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:09,334 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:09,340 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:09,671 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:09,679 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:09,682 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:09,733 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:09,966 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:10,017 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:10,076 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:10,134 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:10,318 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:10,320 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:10,437 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:10,624 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:10,631 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-13 22:30:10,860 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/sikmenedowai-a11y/savetube-stream-kit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:10,909 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:11,006 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:11,009 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-13 22:30:11,299 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:11,312 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:11,391 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:11,402 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:11,733 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:11,823 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:11,888 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:11,893 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:12,086 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:12,215 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:12,423 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:12,437 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:12,448 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:12,704 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:12,762 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:12,948 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-13 22:30:12,977 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-13 22:30:13,147 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-13 22:30:13,150 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:13,330 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:13,500 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-13 22:30:13,520 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:13,545 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-13 22:30:13,598 - YouTubeIntelScraper - INFO - YouTube Intel found 41 candidates and 7 new videos
2026-09-13 22:30:13,735 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:13,883 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:13,961 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:13,999 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:14,094 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:14,150 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:14,324 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:14,445 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:14,486 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:14,616 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:14,725 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:14,772 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:14,959 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:15,147 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:15,211 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:15,294 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:15,401 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:15,532 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:15,572 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:15,604 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:15,855 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-13 22:30:15,866 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:15,915 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:15,972 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:16,226 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:16,236 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:16,247 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:16,336 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:16,544 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:16,607 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:16,620 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:16,684 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:16,878 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:16,990 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:17,016 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yeled-tov/filtertube-android/events?per_page=10 "HTTP/1.1 200 OK"
2026-09-13 22:30:17,078 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:17,215 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:17,343 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:17,345 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:17,516 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:17,646 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-tfilah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:17,677 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:17,713 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:17,855 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:18,006 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:18,020 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:18,065 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:18,134 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:18,364 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:18,408 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:18,519 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:18,560 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:18,675 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elchunenfreund/satmar-matzos-app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:18,707 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akshatasatmar/WeatherServiceApi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:18,856 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmaribianca05-eng/AFSD-Satmari-Bianca/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:19,085 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/Sefaria-Export/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-09-13 22:30:19,164 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=200 account_new=0 list_repos=100 list_new=1 private_new=0 total_new=1
2026-09-13 22:30:19,165 - __main__ - INFO - Scraper github completed: 3 results
2026-09-13 22:30:19,165 - __main__ - INFO - Scraper github_feed completed: 1 results
2026-09-13 22:30:19,165 - __main__ - INFO - Scraper youtube_intel completed: 7 results
2026-09-13 22:30:19,739 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-13 22:30:19.739098
2026-09-13 22:30:19,739 - __main__ - INFO - Email sent successfully
2026-09-13 22:30:19,748 - __main__ - INFO - GitHub feed delivery acknowledged: 1 stored, 0 failed
2026-09-13 22:30:19,748 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-13 22:30:19,748 - __main__ - INFO - Monitor complete. Found 11 total results: 3 new github results, 1 new github feed results, 7 new youtube intel results.
2026-09-13 22:30:19,748 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-13 22:30:19,749 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-13 22:30:19,824 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-13 22:30:19,824 - __main__ - INFO - Closed all database connections
2026-09-13 22:30:19,826 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-13 22:30:19,826 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-09-13 23:00:02,298 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-13.log
2026-09-13 23:00:02,299 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-13.log
2026-09-13 23:00:02,299 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-13.log
2026-09-13 23:00:02,299 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-09-13 23:00:02,336 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-09-13 23:00:02,336 - __main__ - INFO - Configuration loaded and validated successfully
2026-09-13 23:00:02,338 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-09-13 23:00:02,339 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-09-13 23:00:02,362 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-09-13 23:00:02,362 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-09-13 23:00:02,366 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')
2026-09-13 23:00:02,368 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-09-13 23:00:02,368 - __main__ - INFO - RSS scraper initialized and enabled
2026-09-13 23:00:02,373 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-09-13 23:00:02,373 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-09-13 23:00:02,373 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-09-13 23:00:02,378 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-09-13 23:00:02,384 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-09-13 23:00:02,384 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-09-13 23:00:02,387 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-09-13 23:00:02,387 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-09-13 23:00:02,387 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-09-13 23:00:02,389 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-09-13 23:00:02,389 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-09-13 23:00:02,389 - __main__ - INFO - Running 3 scrapers concurrently...
2026-09-13 23:00:02,389 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-09-13 23:00:02,475 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-09-13 23:00:02,480 - IveltScraper - INFO - Loaded 181 include, 4 exclude filters from DB topic_filters
2026-09-13 23:00:02,480 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-09-13 23:00:02,481 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-09-13 23:00:02,793 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-09-13 23:00:03,155 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-09-13 23:00:03,365 - Yiddish24Scraper - INFO - Received response with 439901 characters
2026-09-13 23:00:03,366 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (292340 chars)
2026-09-13 23:00:03,368 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-09-13 23:00:03,439 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-09-13 23:00:03,494 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-09-13 23:00:03,494 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-09-13 23:00:05,341 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 100 total articles
2026-09-13 23:00:05,341 - Yiddish24Scraper - INFO - Page 1: 0/100 new items
2026-09-13 23:00:05,341 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination
2026-09-13 23:00:05,341 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0
2026-09-13 23:00:14,678 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-09-13 23:00:28,470 - IveltScraper - INFO - Filtering post containing exclude term: '*ื‘ื™ื˜ืข ืžืื›ื˜ ื–ื™ื›ืขืจ ื‘ืœื•ื™ื– ืฆื• ื‘ืืจื™ื›ื˜ืŸ ืงืจืื ื˜ืข ื ื™ื™ืขืก*'
2026-09-13 23:00:29,161 - IveltScraper - INFO - ivelt scrape complete. Checked 4 topics.
2026-09-13 23:00:29,161 - IveltScraper - INFO - All forums scrape complete. Found 0 new posts.
2026-09-13 23:00:29,161 - __main__ - INFO - Scraper rss completed: 0 results
2026-09-13 23:00:29,161 - __main__ - INFO - Scraper yiddish24 completed: 0 results
2026-09-13 23:00:29,161 - __main__ - INFO - Scraper ivelt completed: 0 results
2026-09-13 23:00:29,162 - __main__ - INFO - No new results found across all enabled sources
2026-09-13 23:00:29,162 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-09-13 23:00:29,162 - __main__ - INFO - Monitor complete. No new results found across all sources.
2026-09-13 23:00:29,162 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-09-13 23:00:29,162 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-13 23:00:29,213 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-09-13 23:00:29,213 - __main__ - INFO - Closed all database connections
2026-09-13 23:00:29,214 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-09-13 23:00:29,214 - social_media_monitor.database.connection - INFO - Closed 0 database connections