← Logs

social_media_monitor_2026-09-30.log

2026-09-30 20:30:02,100 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-09-30 20:30:02,101 - __main__ - INFO - Configuration loaded and validated successfully

2026-09-30 20:30:02,103 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-09-30 20:30:02,103 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-09-30 20:30:02,116 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-09-30 20:30:02,116 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-09-30 20:30:02,120 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')

2026-09-30 20:30:02,121 - __main__ - INFO - GitHub scraper initialized and enabled

2026-09-30 20:30:02,121 - __main__ - INFO - GitHub feed scraper initialized and enabled

2026-09-30 20:30:02,122 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-09-30 20:30:02,127 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled

2026-09-30 20:30:02,127 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0

2026-09-30 20:30:02,131 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-09-30 20:30:02,136 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled

2026-09-30 20:30:02,136 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13

2026-09-30 20:30:02,138 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-09-30 20:30:02,138 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2

2026-09-30 20:30:02,138 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0

2026-09-30 20:30:02,140 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0

2026-09-30 20:30:02,140 - __main__ - INFO - YouTube Intel scraper initialized and enabled

2026-09-30 20:30:02,141 - __main__ - INFO - Running 3 scrapers concurrently...

2026-09-30 20:30:02,141 - GitHubScraper - INFO - Searching GitHub for terms: ['"Hermes Agent"', '"grok bot OR grokbot"', '"muse NOT music NOT museum"', '"prime agent"', 'paperclip']

2026-09-30 20:30:02,553 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"

2026-09-30 20:30:02,554 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)

2026-09-30 20:30:03,295 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-09-30 20:30:03,321 - GitHubScraper - INFO - Found 655 GitHub repositories for term: "Hermes Agent"

2026-09-30 20:30:03,676 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"

2026-09-30 20:30:04,072 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22grok+bot+OR+grokbot%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-09-30 20:30:04,073 - GitHubScraper - INFO - Found 0 GitHub repositories for term: "grok bot OR grokbot"

2026-09-30 20:30:04,609 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"

2026-09-30 20:30:04,898 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22muse+NOT+music+NOT+museum%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-09-30 20:30:04,899 - GitHubScraper - INFO - Found 0 GitHub repositories for term: "muse NOT music NOT museum"

2026-09-30 20:30:05,715 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 200 OK"

2026-09-30 20:30:06,393 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22prime+agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-09-30 20:30:06,396 - GitHubScraper - INFO - Found 44 GitHub repositories for term: "prime agent"

2026-09-30 20:30:07,532 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-09-30 20:30:07,536 - GitHubScraper - INFO - Found 266 GitHub repositories for term: paperclip

2026-09-30 20:30:07,669 - GitHubScraper - INFO - Total GitHub results found: 0

2026-09-30 20:30:09,731 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"

2026-09-30 20:30:10,117 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:10,181 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:10,211 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:10,253 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:10,384 - YouTubeIntelScraper - INFO - YouTube Intel found 31 candidates and 6 new videos

2026-09-30 20:30:10,572 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:10,574 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:10,598 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:10,602 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:10,932 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:10,940 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:10,963 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:11,049 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:11,255 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:11,305 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:11,354 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:11,508 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:11,710 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:11,916 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-30 20:30:11,951 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:12,034 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:12,048 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:12,244 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:12,274 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:12,427 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:12,646 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:12,846 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:12,957 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:12,974 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:12,994 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:13,173 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:13,374 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:13,472 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:13,534 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:13,591 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:13,724 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:13,992 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-30 20:30:14,000 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:14,009 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:14,088 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:14,457 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:14,491 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:14,494 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:14,782 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:14,966 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:15,124 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:15,146 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:15,286 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:15,480 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:15,526 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:15,696 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:15,821 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:15,913 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:15,998 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:16,189 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:16,336 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:16,538 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-30 20:30:16,576 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:16,732 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:16,797 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:17,061 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:17,123 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:17,148 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:17,221 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:17,442 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:17,504 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:17,508 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:17,678 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:17,770 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:17,872 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:17,935 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:18,050 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:18,054 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:18,339 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:18,379 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:18,401 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:18,481 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:18,697 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:18,701 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:18,779 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:18,955 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:18,995 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:19,117 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-tfilah/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:19,190 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:19,335 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:19,336 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:19,396 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:19,570 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:19,626 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:19,693 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:19,722 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:19,936 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:19,989 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:20,073 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:20,080 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:20,299 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akshatasatmar/WeatherServiceApi/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:20,347 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elchunenfreund/satmar-matzos-app/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:20,440 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmaribianca05-eng/AFSD-Satmari-Bianca/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:20,597 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/Sefaria-Export/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:20,702 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mritunjaysharma2004/SATMARG-An-Online-Pilgrimage-planner-/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:21,026 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-es6/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 20:30:21,058 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=300 account_new=1 list_repos=100 list_new=0 private_new=0 total_new=1

2026-09-30 20:30:21,059 - __main__ - INFO - Scraper github completed: 0 results

2026-09-30 20:30:21,059 - __main__ - INFO - Scraper github_feed completed: 1 results

2026-09-30 20:30:21,059 - __main__ - INFO - Scraper youtube_intel completed: 6 results

2026-09-30 20:30:22,581 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-30 20:30:22.581179

2026-09-30 20:30:22,581 - __main__ - INFO - Email sent successfully

2026-09-30 20:30:22,589 - __main__ - INFO - GitHub feed delivery acknowledged: 1 stored, 0 failed

2026-09-30 20:30:22,589 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-09-30 20:30:22,589 - __main__ - INFO - Monitor complete. Found 7 total results: 1 new github feed results, 6 new youtube intel results.

2026-09-30 20:30:22,589 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-09-30 20:30:22,589 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-30 20:30:22,631 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-09-30 20:30:22,631 - __main__ - INFO - Closed all database connections

2026-09-30 20:30:22,634 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-30 20:30:22,634 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-09-30 21:00:02,451 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-30.log

2026-09-30 21:00:02,452 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-30.log

2026-09-30 21:00:02,452 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-30.log

2026-09-30 21:00:02,452 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-09-30 21:00:02,484 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-09-30 21:00:02,484 - __main__ - INFO - Configuration loaded and validated successfully

2026-09-30 21:00:02,487 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-09-30 21:00:02,487 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-09-30 21:00:02,504 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-09-30 21:00:02,504 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-09-30 21:00:02,563 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')

2026-09-30 21:00:02,565 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-09-30 21:00:02,565 - __main__ - INFO - RSS scraper initialized and enabled

2026-09-30 21:00:02,571 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled

2026-09-30 21:00:02,571 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0

2026-09-30 21:00:02,571 - __main__ - INFO - Yiddish24 scraper initialized and enabled

2026-09-30 21:00:02,576 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-09-30 21:00:02,583 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled

2026-09-30 21:00:02,583 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13

2026-09-30 21:00:02,585 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-09-30 21:00:02,585 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2

2026-09-30 21:00:02,586 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0

2026-09-30 21:00:02,588 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0

2026-09-30 21:00:02,588 - __main__ - INFO - Ivelt scraper initialized and enabled

2026-09-30 21:00:02,588 - __main__ - INFO - Running 3 scrapers concurrently...

2026-09-30 21:00:02,589 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)

2026-09-30 21:00:02,679 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100

2026-09-30 21:00:02,685 - IveltScraper - INFO - Loaded 182 include, 4 exclude filters from DB topic_filters

2026-09-30 21:00:02,685 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...

2026-09-30 21:00:02,686 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed

2026-09-30 21:00:02,969 - RSSFeedScraper - INFO - Total RSS/HTML results: 0

2026-09-30 21:00:04,301 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"

2026-09-30 21:00:04,530 - Yiddish24Scraper - INFO - Received response with 548357 characters

2026-09-30 21:00:04,533 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (323369 chars)

2026-09-30 21:00:04,537 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html

2026-09-30 21:00:04,617 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1

2026-09-30 21:00:04,657 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements

2026-09-30 21:00:04,657 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1

2026-09-30 21:00:04,691 - Yiddish24Scraper - INFO - Term 'מעשה' matched in DESCRIPTION: 'דראמאטישע מעשה דורך ר' ארי' אבראמאוויטש'

2026-09-30 21:00:04,691 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: הכל בכל

2026-09-30 21:00:05,191 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/16HBS_260_260930042226.mp3

2026-09-30 21:00:07,870 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_16HBS_260_260930042226.mp3 (71.4 MB)

2026-09-30 21:00:07,870 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)

2026-09-30 21:00:07,905 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_16HBS_260_260930042226.mp3: title, artist, album, comment, source_url, genre, publisher

2026-09-30 21:00:07,905 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2_16HBS_260_260930042226_מעשה.mp3

2026-09-30 21:00:08,666 - Yiddish24Scraper - INFO - Page 1 summary: 5 new out of 100 total articles

2026-09-30 21:00:08,667 - Yiddish24Scraper - INFO - Page 1: 5/100 new items

2026-09-30 21:00:08,667 - Yiddish24Scraper - INFO - Low new item ratio (5.0%), stopping pagination

2026-09-30 21:00:08,667 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 5

2026-09-30 21:00:14,835 - IveltScraper - INFO - Found 50 active topics on ivelt

2026-09-30 21:00:22,070 - IveltScraper - INFO - Filtering post containing exclude term: '*ביטע מאכט זיכער בלויז צו באריכטן קראנטע נייעס*'

2026-09-30 21:00:26,791 - IveltScraper - INFO - ivelt scrape complete. Checked 3 topics.

2026-09-30 21:00:26,791 - IveltScraper - INFO - All forums scrape complete. Found 3 new posts.

2026-09-30 21:00:26,791 - __main__ - INFO - Scraper rss completed: 0 results

2026-09-30 21:00:26,791 - __main__ - INFO - Scraper yiddish24 completed: 5 results

2026-09-30 21:00:26,791 - __main__ - INFO - Scraper ivelt completed: 3 results

2026-09-30 21:00:28,019 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-30 21:00:28.019769

2026-09-30 21:00:28,020 - __main__ - INFO - Email sent successfully

2026-09-30 21:00:28,020 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-09-30 21:00:28,020 - __main__ - INFO - Monitor complete. Found 8 total results: 5 new yiddish24 results, 3 new ivelt results.

2026-09-30 21:00:28,020 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-09-30 21:00:28,020 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-30 21:00:28,115 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-09-30 21:00:28,115 - __main__ - INFO - Closed all database connections

2026-09-30 21:00:28,117 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-30 21:00:28,117 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-09-30 22:00:02,035 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-30.log

2026-09-30 22:00:02,035 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-30.log

2026-09-30 22:00:02,036 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-30.log

2026-09-30 22:00:02,036 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-09-30 22:00:02,064 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-09-30 22:00:02,065 - __main__ - INFO - Configuration loaded and validated successfully

2026-09-30 22:00:02,067 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-09-30 22:00:02,067 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-09-30 22:00:02,080 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-09-30 22:00:02,081 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-09-30 22:00:02,084 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')

2026-09-30 22:00:02,085 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-09-30 22:00:02,085 - __main__ - INFO - RSS scraper initialized and enabled

2026-09-30 22:00:02,089 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled

2026-09-30 22:00:02,089 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0

2026-09-30 22:00:02,089 - __main__ - INFO - Yiddish24 scraper initialized and enabled

2026-09-30 22:00:02,093 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-09-30 22:00:02,100 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled

2026-09-30 22:00:02,100 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13

2026-09-30 22:00:02,104 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-09-30 22:00:02,104 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2

2026-09-30 22:00:02,104 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0

2026-09-30 22:00:02,107 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0

2026-09-30 22:00:02,107 - __main__ - INFO - Ivelt scraper initialized and enabled

2026-09-30 22:00:02,108 - __main__ - INFO - Running 3 scrapers concurrently...

2026-09-30 22:00:02,108 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)

2026-09-30 22:00:02,203 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100

2026-09-30 22:00:02,208 - IveltScraper - INFO - Loaded 182 include, 4 exclude filters from DB topic_filters

2026-09-30 22:00:02,208 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...

2026-09-30 22:00:02,209 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed

2026-09-30 22:00:02,486 - RSSFeedScraper - INFO - Total RSS/HTML results: 0

2026-09-30 22:00:03,921 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"

2026-09-30 22:00:04,157 - Yiddish24Scraper - INFO - Received response with 570373 characters

2026-09-30 22:00:04,161 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (330772 chars)

2026-09-30 22:00:04,164 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html

2026-09-30 22:00:04,246 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1

2026-09-30 22:00:04,287 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements

2026-09-30 22:00:04,287 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1

2026-09-30 22:00:04,970 - Yiddish24Scraper - INFO - Page 1 summary: 5 new out of 100 total articles

2026-09-30 22:00:04,970 - Yiddish24Scraper - INFO - Page 1: 5/100 new items

2026-09-30 22:00:04,971 - Yiddish24Scraper - INFO - Low new item ratio (5.0%), stopping pagination

2026-09-30 22:00:04,971 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 5

2026-09-30 22:00:14,460 - IveltScraper - INFO - Found 50 active topics on ivelt

2026-09-30 22:00:29,085 - IveltScraper - INFO - Filtering post containing exclude term: '*ביטע מאכט זיכער בלויז צו באריכטן קראנטע נייעס*'

2026-09-30 22:00:34,301 - IveltScraper - INFO - Filtering post containing exclude term: '*ביטע מאכט זיכער בלויז צו באריכטן קראנטע נייעס*'

2026-09-30 22:00:44,252 - IveltScraper - INFO - ivelt scrape complete. Checked 6 topics.

2026-09-30 22:00:44,252 - IveltScraper - INFO - All forums scrape complete. Found 17 new posts.

2026-09-30 22:00:44,252 - __main__ - INFO - Scraper rss completed: 0 results

2026-09-30 22:00:44,252 - __main__ - INFO - Scraper yiddish24 completed: 5 results

2026-09-30 22:00:44,252 - __main__ - INFO - Scraper ivelt completed: 17 results

2026-09-30 22:00:45,039 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-30 22:00:45.039242

2026-09-30 22:00:45,039 - __main__ - INFO - Email sent successfully

2026-09-30 22:00:45,039 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-09-30 22:00:45,039 - __main__ - INFO - Monitor complete. Found 22 total results: 5 new yiddish24 results, 17 new ivelt results.

2026-09-30 22:00:45,040 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-09-30 22:00:45,040 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-30 22:00:45,187 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-09-30 22:00:45,188 - __main__ - INFO - Closed all database connections

2026-09-30 22:00:45,190 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-30 22:00:45,190 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-09-30 22:30:02,080 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-30.log

2026-09-30 22:30:02,080 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-30.log

2026-09-30 22:30:02,080 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-30.log

2026-09-30 22:30:02,080 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-09-30 22:30:02,113 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-09-30 22:30:02,113 - __main__ - INFO - Configuration loaded and validated successfully

2026-09-30 22:30:02,115 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-09-30 22:30:02,116 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-09-30 22:30:02,129 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-09-30 22:30:02,130 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-09-30 22:30:02,191 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')

2026-09-30 22:30:02,193 - __main__ - INFO - GitHub scraper initialized and enabled

2026-09-30 22:30:02,193 - __main__ - INFO - GitHub feed scraper initialized and enabled

2026-09-30 22:30:02,194 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-09-30 22:30:02,200 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled

2026-09-30 22:30:02,201 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0

2026-09-30 22:30:02,206 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-09-30 22:30:02,211 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled

2026-09-30 22:30:02,211 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13

2026-09-30 22:30:02,214 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-09-30 22:30:02,214 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2

2026-09-30 22:30:02,214 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0

2026-09-30 22:30:02,216 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0

2026-09-30 22:30:02,217 - __main__ - INFO - YouTube Intel scraper initialized and enabled

2026-09-30 22:30:02,217 - __main__ - INFO - Running 3 scrapers concurrently...

2026-09-30 22:30:02,217 - GitHubScraper - INFO - Searching GitHub for terms: ['"Hermes Agent"', '"grok bot OR grokbot"', '"muse NOT music NOT museum"', '"prime agent"', 'paperclip']

2026-09-30 22:30:02,633 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"

2026-09-30 22:30:02,634 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)

2026-09-30 22:30:03,504 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-09-30 22:30:03,589 - GitHubScraper - INFO - Found 655 GitHub repositories for term: "Hermes Agent"

2026-09-30 22:30:03,778 - GitHubScraper - INFO - Added new GitHub repository: awesome-ai-ppt

2026-09-30 22:30:03,834 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"

2026-09-30 22:30:04,270 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22grok+bot+OR+grokbot%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-09-30 22:30:04,271 - GitHubScraper - INFO - Found 0 GitHub repositories for term: "grok bot OR grokbot"

2026-09-30 22:30:05,068 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"

2026-09-30 22:30:05,276 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22muse+NOT+music+NOT+museum%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-09-30 22:30:05,277 - GitHubScraper - INFO - Found 0 GitHub repositories for term: "muse NOT music NOT museum"

2026-09-30 22:30:06,212 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:06,213 - GitHubFeedScraper - INFO - GitHub account feed page 3 unchanged (ETag)

2026-09-30 22:30:06,676 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22prime+agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-09-30 22:30:06,677 - GitHubScraper - INFO - Found 44 GitHub repositories for term: "prime agent"

2026-09-30 22:30:07,727 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-09-30 22:30:07,730 - GitHubScraper - INFO - Found 266 GitHub repositories for term: paperclip

2026-09-30 22:30:07,858 - GitHubScraper - INFO - Total GitHub results found: 1

2026-09-30 22:30:09,468 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"

2026-09-30 22:30:09,828 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:09,849 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:09,852 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:10,013 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-30 22:30:10,160 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:10,199 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:10,307 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:10,423 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:10,523 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:10,541 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:10,598 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:10,754 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:10,870 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:10,871 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:11,014 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:11,213 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:11,243 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:11,378 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:11,400 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-30 22:30:11,598 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:11,644 - YouTubeIntelScraper - INFO - YouTube Intel found 31 candidates and 5 new videos

2026-09-30 22:30:11,672 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:11,738 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:11,804 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:11,986 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:12,237 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:12,253 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:12,439 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:12,442 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:12,631 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:12,675 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:12,924 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:12,926 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:12,946 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:12,958 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:13,259 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:13,333 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:13,371 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:13,476 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:13,636 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:13,847 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:13,881 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:13,884 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:13,981 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:14,234 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:14,245 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:14,369 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:14,372 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-30 22:30:14,528 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:14,704 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:14,706 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:14,951 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:14,973 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:15,053 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:15,223 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:15,248 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:15,597 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-30 22:30:15,661 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-30 22:30:15,684 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:15,771 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:16,033 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:16,142 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:16,247 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:16,285 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:16,339 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:16,461 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:16,676 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:16,684 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:16,810 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:16,811 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:17,025 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:17,042 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:17,166 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:17,219 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:17,318 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:17,349 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:17,458 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:17,593 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:17,625 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:17,644 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:17,926 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-30 22:30:17,970 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:17,984 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-tfilah/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:18,085 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:18,322 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:18,329 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:18,344 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:18,472 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:18,627 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:18,636 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:18,679 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:18,811 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:18,978 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:18,996 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:19,038 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:19,088 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akshatasatmar/WeatherServiceApi/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:19,304 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmaribianca05-eng/AFSD-Satmari-Bianca/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:19,352 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elchunenfreund/satmar-matzos-app/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:19,474 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/Sefaria-Export/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:19,637 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-es6/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:19,836 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mritunjaysharma2004/SATMARG-An-Online-Pilgrimage-planner-/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-30 22:30:19,874 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=200 account_new=0 list_repos=100 list_new=2 private_new=0 total_new=2

2026-09-30 22:30:19,875 - __main__ - INFO - Scraper github completed: 1 results

2026-09-30 22:30:19,875 - __main__ - INFO - Scraper github_feed completed: 2 results

2026-09-30 22:30:19,875 - __main__ - INFO - Scraper youtube_intel completed: 5 results

2026-09-30 22:30:20,891 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-30 22:30:20.891738

2026-09-30 22:30:20,891 - __main__ - INFO - Email sent successfully

2026-09-30 22:30:20,904 - __main__ - INFO - GitHub feed delivery acknowledged: 2 stored, 0 failed

2026-09-30 22:30:20,905 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-09-30 22:30:20,905 - __main__ - INFO - Monitor complete. Found 8 total results: 1 new github results, 2 new github feed results, 5 new youtube intel results.

2026-09-30 22:30:20,905 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-09-30 22:30:20,905 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-30 22:30:20,922 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-09-30 22:30:20,922 - __main__ - INFO - Closed all database connections

2026-09-30 22:30:20,924 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-30 22:30:20,924 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-09-30 23:00:01,791 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-30.log

2026-09-30 23:00:01,791 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-30.log

2026-09-30 23:00:01,791 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-30.log

2026-09-30 23:00:01,791 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-09-30 23:00:01,822 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-09-30 23:00:01,822 - __main__ - INFO - Configuration loaded and validated successfully

2026-09-30 23:00:01,825 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-09-30 23:00:01,825 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-09-30 23:00:01,840 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-09-30 23:00:01,840 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-09-30 23:00:01,843 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')

2026-09-30 23:00:01,844 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-09-30 23:00:01,844 - __main__ - INFO - RSS scraper initialized and enabled

2026-09-30 23:00:01,848 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled

2026-09-30 23:00:01,848 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0

2026-09-30 23:00:01,848 - __main__ - INFO - Yiddish24 scraper initialized and enabled

2026-09-30 23:00:01,854 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-09-30 23:00:01,861 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled

2026-09-30 23:00:01,861 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13

2026-09-30 23:00:01,865 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-09-30 23:00:01,865 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2

2026-09-30 23:00:01,865 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0

2026-09-30 23:00:01,868 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0

2026-09-30 23:00:01,868 - __main__ - INFO - Ivelt scraper initialized and enabled

2026-09-30 23:00:01,869 - __main__ - INFO - Running 3 scrapers concurrently...

2026-09-30 23:00:01,869 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)

2026-09-30 23:00:01,961 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100

2026-09-30 23:00:01,965 - IveltScraper - INFO - Loaded 182 include, 4 exclude filters from DB topic_filters

2026-09-30 23:00:01,966 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...

2026-09-30 23:00:01,967 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed

2026-09-30 23:00:02,194 - RSSFeedScraper - INFO - Total RSS/HTML results: 0

2026-09-30 23:00:03,585 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"

2026-09-30 23:00:03,819 - Yiddish24Scraper - INFO - Received response with 569542 characters

2026-09-30 23:00:03,821 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (331665 chars)

2026-09-30 23:00:03,824 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html

2026-09-30 23:00:03,898 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1

2026-09-30 23:00:03,939 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements

2026-09-30 23:00:03,939 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1

2026-09-30 23:00:04,702 - Yiddish24Scraper - INFO - Page 1 summary: 5 new out of 100 total articles

2026-09-30 23:00:04,702 - Yiddish24Scraper - INFO - Page 1: 5/100 new items

2026-09-30 23:00:04,702 - Yiddish24Scraper - INFO - Low new item ratio (5.0%), stopping pagination

2026-09-30 23:00:04,702 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 5

2026-09-30 23:00:14,348 - IveltScraper - INFO - Found 50 active topics on ivelt

2026-09-30 23:00:37,767 - IveltScraper - INFO - ivelt scrape complete. Checked 5 topics.

2026-09-30 23:00:37,767 - IveltScraper - INFO - All forums scrape complete. Found 10 new posts.

2026-09-30 23:00:37,767 - __main__ - INFO - Scraper rss completed: 0 results

2026-09-30 23:00:37,767 - __main__ - INFO - Scraper yiddish24 completed: 5 results

2026-09-30 23:00:37,768 - __main__ - INFO - Scraper ivelt completed: 10 results

2026-09-30 23:00:39,242 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-30 23:00:39.242457

2026-09-30 23:00:39,242 - __main__ - INFO - Email sent successfully

2026-09-30 23:00:39,243 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-09-30 23:00:39,243 - __main__ - INFO - Monitor complete. Found 15 total results: 5 new yiddish24 results, 10 new ivelt results.

2026-09-30 23:00:39,243 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-09-30 23:00:39,243 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-30 23:00:39,365 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-09-30 23:00:39,366 - __main__ - INFO - Closed all database connections

2026-09-30 23:00:39,367 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-30 23:00:39,368 - social_media_monitor.database.connection - INFO - Closed 0 database connections