← Logs

social_media_monitor_2026-08-09.log

2026-08-09 20:30:01,635 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-08-09.log

2026-08-09 20:30:01,635 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-08-09.log

2026-08-09 20:30:01,635 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-08-09 20:30:01,669 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-08-09 20:30:01,670 - __main__ - INFO - Configuration loaded and validated successfully

2026-08-09 20:30:01,672 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-08-09 20:30:01,672 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-08-09 20:30:01,684 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-08-09 20:30:01,684 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-08-09 20:30:01,687 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0 (contact:abep+dev@nocommand.local)')

2026-08-09 20:30:01,687 - __main__ - INFO - GitHub scraper initialized and enabled

2026-08-09 20:30:01,687 - __main__ - INFO - GitHub feed scraper initialized and enabled

2026-08-09 20:30:01,688 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-08-09 20:30:01,690 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled

2026-08-09 20:30:01,690 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0

2026-08-09 20:30:01,693 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-08-09 20:30:01,697 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled

2026-08-09 20:30:01,697 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13

2026-08-09 20:30:01,699 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-08-09 20:30:01,699 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2

2026-08-09 20:30:01,700 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0

2026-08-09 20:30:01,702 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0

2026-08-09 20:30:01,702 - __main__ - INFO - YouTube Intel scraper initialized and enabled

2026-08-09 20:30:01,702 - __main__ - INFO - Running 3 scrapers concurrently...

2026-08-09 20:30:01,702 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']

2026-08-09 20:30:02,094 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"

2026-08-09 20:30:02,095 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)

2026-08-09 20:30:02,759 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-08-09 20:30:02,785 - GitHubScraper - INFO - Found 246 GitHub repositories for term: paperclip

2026-08-09 20:30:03,051 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"

2026-08-09 20:30:03,829 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-08-09 20:30:03,911 - GitHubScraper - INFO - Found 510 GitHub repositories for term: "Hermes Agent"

2026-08-09 20:30:04,158 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"

2026-08-09 20:30:04,816 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-08-09 20:30:04,908 - GitHubScraper - INFO - Found 61 GitHub repositories for term: multica

2026-08-09 20:30:05,041 - GitHubScraper - INFO - Total GitHub results found: 0

2026-08-09 20:30:05,230 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:05,231 - GitHubFeedScraper - INFO - GitHub account feed page 3 unchanged (ETag)

2026-08-09 20:30:08,201 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"

2026-08-09 20:30:08,629 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:08,650 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:08,694 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:08,891 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:09,009 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:09,052 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:09,061 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yitzih97/torahtale/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:09,289 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:09,411 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:09,444 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:09,669 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/tatyesod/talmud-tora-web/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:09,801 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:09,811 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:09,997 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 200 OK"

2026-08-09 20:30:10,030 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:10,149 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:10,172 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:10,476 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 200 OK"

2026-08-09 20:30:10,519 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:10,632 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/sikmenedowai-a11y/savetube-stream-kit/events?per_page=10 "HTTP/1.1 200 OK"

2026-08-09 20:30:10,678 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:10,901 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:10,924 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:11,001 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:11,123 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:11,231 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:11,242 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:11,555 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:11,605 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:11,750 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:11,921 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:11,943 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:11,992 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:12,276 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:12,333 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:12,381 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:12,540 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:12,632 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:12,788 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 200 OK"

2026-08-09 20:30:12,852 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 200 OK"

2026-08-09 20:30:13,000 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 200 OK"

2026-08-09 20:30:13,022 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:13,262 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:13,368 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 200 OK"

2026-08-09 20:30:13,372 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:13,558 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 200 OK"

2026-08-09 20:30:13,649 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 200 OK"

2026-08-09 20:30:13,717 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/scott-fleischman/shark-2026/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:13,862 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:13,989 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:14,049 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:14,054 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:14,145 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:14,414 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:14,417 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:14,519 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:14,535 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:14,805 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:14,859 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 200 OK"

2026-08-09 20:30:15,056 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 200 OK"

2026-08-09 20:30:15,185 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:15,327 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:15,484 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:15,538 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:15,683 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:15,772 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:15,859 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:15,929 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:16,019 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:16,122 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:16,164 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:16,382 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:16,403 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:16,471 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:16,517 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:16,778 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:16,780 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:16,844 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:16,891 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:17,048 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:17,117 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yeled-tov/filtertube-android/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:17,186 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:17,234 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 200 OK"

2026-08-09 20:30:17,381 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:17,544 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:17,561 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:17,591 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-shabbat-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:17,696 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:17,880 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/ShireiShabbat/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:17,900 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:17,930 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:17,998 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:18,188 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:18,254 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:18,313 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:18,430 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:18,625 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:18,680 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:18,688 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:18,701 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 20:30:18,841 - YouTubeIntelScraper - INFO - YouTube Intel found 74 candidates and 11 new videos

2026-08-09 20:30:18,962 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=200 account_new=0 list_repos=100 list_new=1 private_new=0 total_new=1

2026-08-09 20:30:18,963 - __main__ - INFO - Scraper github completed: 0 results

2026-08-09 20:30:18,963 - __main__ - INFO - Scraper github_feed completed: 1 results

2026-08-09 20:30:18,963 - __main__ - INFO - Scraper youtube_intel completed: 11 results

2026-08-09 20:30:19,780 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-08-09 20:30:19.780191

2026-08-09 20:30:19,780 - __main__ - INFO - Email sent successfully

2026-08-09 20:30:19,791 - __main__ - INFO - GitHub feed delivery acknowledged: 1 stored, 0 failed

2026-08-09 20:30:19,792 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-08-09 20:30:19,792 - __main__ - INFO - Monitor complete. Found 12 total results: 1 new github feed results, 11 new youtube intel results.

2026-08-09 20:30:19,792 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-08-09 20:30:19,792 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-08-09 20:30:19,817 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-08-09 20:30:19,817 - __main__ - INFO - Closed all database connections

2026-08-09 20:30:19,819 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-08-09 20:30:19,820 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-08-09 21:00:02,622 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-08-09.log

2026-08-09 21:00:02,623 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-08-09.log

2026-08-09 21:00:02,623 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-08-09.log

2026-08-09 21:00:02,623 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-08-09 21:00:02,654 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-08-09 21:00:02,654 - __main__ - INFO - Configuration loaded and validated successfully

2026-08-09 21:00:02,657 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-08-09 21:00:02,657 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-08-09 21:00:02,672 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-08-09 21:00:02,672 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-08-09 21:00:02,821 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0 (contact:abep+dev@nocommand.local)')

2026-08-09 21:00:02,823 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-08-09 21:00:02,823 - __main__ - INFO - RSS scraper initialized and enabled

2026-08-09 21:00:02,831 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled

2026-08-09 21:00:02,831 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0

2026-08-09 21:00:02,831 - __main__ - INFO - Yiddish24 scraper initialized and enabled

2026-08-09 21:00:02,838 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-08-09 21:00:02,849 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled

2026-08-09 21:00:02,849 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13

2026-08-09 21:00:02,854 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-08-09 21:00:02,854 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2

2026-08-09 21:00:02,854 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0

2026-08-09 21:00:02,858 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0

2026-08-09 21:00:02,858 - __main__ - INFO - Ivelt scraper initialized and enabled

2026-08-09 21:00:02,858 - __main__ - INFO - Running 3 scrapers concurrently...

2026-08-09 21:00:02,858 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)

2026-08-09 21:00:02,952 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100

2026-08-09 21:00:02,956 - IveltScraper - INFO - Loaded 181 include, 1 exclude filters from DB topic_filters

2026-08-09 21:00:02,956 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...

2026-08-09 21:00:02,958 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed

2026-08-09 21:00:03,056 - RSSFeedScraper - ERROR - Error fetching RSS feed https://www.theyeshivaworld.com/feed: name 'feedparser' is not defined

2026-08-09 21:00:03,057 - RSSFeedScraper - INFO - Total RSS/HTML results: 0

2026-08-09 21:00:03,502 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"

2026-08-09 21:00:03,718 - Yiddish24Scraper - INFO - Received response with 457753 characters

2026-08-09 21:00:03,721 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (298977 chars)

2026-08-09 21:00:03,724 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html

2026-08-09 21:00:03,809 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1

2026-08-09 21:00:03,850 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements

2026-08-09 21:00:03,851 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1

2026-08-09 21:00:05,131 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 100 total articles

2026-08-09 21:00:05,131 - Yiddish24Scraper - INFO - Page 1: 0/100 new items

2026-08-09 21:00:05,131 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination

2026-08-09 21:00:05,132 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0

2026-08-09 21:00:15,123 - IveltScraper - INFO - Found 50 active topics on ivelt

2026-08-09 21:00:52,739 - IveltScraper - INFO - ivelt scrape complete. Checked 7 topics.

2026-08-09 21:00:52,739 - IveltScraper - INFO - All forums scrape complete. Found 36 new posts.

2026-08-09 21:00:52,740 - __main__ - INFO - Scraper rss completed: 0 results

2026-08-09 21:00:52,740 - __main__ - INFO - Scraper yiddish24 completed: 0 results

2026-08-09 21:00:52,740 - __main__ - INFO - Scraper ivelt completed: 36 results

2026-08-09 21:00:53,767 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-08-09 21:00:53.767608

2026-08-09 21:00:53,767 - __main__ - INFO - Email sent successfully

2026-08-09 21:00:53,768 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-08-09 21:00:53,768 - __main__ - INFO - Monitor complete. Found 36 total results: 36 new ivelt results.

2026-08-09 21:00:53,768 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-08-09 21:00:53,768 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-08-09 21:00:53,841 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-08-09 21:00:53,841 - __main__ - INFO - Closed all database connections

2026-08-09 21:00:53,843 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-08-09 21:00:53,844 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-08-09 22:00:02,503 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-08-09.log

2026-08-09 22:00:02,503 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-08-09.log

2026-08-09 22:00:02,503 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-08-09.log

2026-08-09 22:00:02,503 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-08-09 22:00:02,535 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-08-09 22:00:02,535 - __main__ - INFO - Configuration loaded and validated successfully

2026-08-09 22:00:02,538 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-08-09 22:00:02,539 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-08-09 22:00:02,562 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-08-09 22:00:02,562 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-08-09 22:00:02,567 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0 (contact:abep+dev@nocommand.local)')

2026-08-09 22:00:02,569 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-08-09 22:00:02,570 - __main__ - INFO - RSS scraper initialized and enabled

2026-08-09 22:00:02,577 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled

2026-08-09 22:00:02,577 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0

2026-08-09 22:00:02,577 - __main__ - INFO - Yiddish24 scraper initialized and enabled

2026-08-09 22:00:02,584 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-08-09 22:00:02,595 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled

2026-08-09 22:00:02,595 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13

2026-08-09 22:00:02,600 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-08-09 22:00:02,600 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2

2026-08-09 22:00:02,600 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0

2026-08-09 22:00:02,605 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0

2026-08-09 22:00:02,605 - __main__ - INFO - Ivelt scraper initialized and enabled

2026-08-09 22:00:02,606 - __main__ - INFO - Running 3 scrapers concurrently...

2026-08-09 22:00:02,606 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)

2026-08-09 22:00:02,694 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100

2026-08-09 22:00:02,698 - IveltScraper - INFO - Loaded 181 include, 1 exclude filters from DB topic_filters

2026-08-09 22:00:02,699 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...

2026-08-09 22:00:02,700 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed

2026-08-09 22:00:02,773 - RSSFeedScraper - ERROR - Error fetching RSS feed https://www.theyeshivaworld.com/feed: name 'feedparser' is not defined

2026-08-09 22:00:02,775 - RSSFeedScraper - INFO - Total RSS/HTML results: 0

2026-08-09 22:00:06,274 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"

2026-08-09 22:00:06,498 - Yiddish24Scraper - INFO - Received response with 473479 characters

2026-08-09 22:00:06,501 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (302090 chars)

2026-08-09 22:00:06,504 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html

2026-08-09 22:00:06,587 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1

2026-08-09 22:00:06,629 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements

2026-08-09 22:00:06,629 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1

2026-08-09 22:00:07,398 - Yiddish24Scraper - INFO - Page 1 summary: 12 new out of 100 total articles

2026-08-09 22:00:07,398 - Yiddish24Scraper - INFO - Page 1: 12/100 new items

2026-08-09 22:00:07,398 - Yiddish24Scraper - INFO - Low new item ratio (12.0%), stopping pagination

2026-08-09 22:00:07,399 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 12

2026-08-09 22:00:15,024 - IveltScraper - INFO - Found 50 active topics on ivelt

2026-08-09 22:00:34,560 - IveltScraper - INFO - ivelt scrape complete. Checked 4 topics.

2026-08-09 22:00:34,560 - IveltScraper - INFO - All forums scrape complete. Found 9 new posts.

2026-08-09 22:00:34,561 - __main__ - INFO - Scraper rss completed: 0 results

2026-08-09 22:00:34,561 - __main__ - INFO - Scraper yiddish24 completed: 12 results

2026-08-09 22:00:34,561 - __main__ - INFO - Scraper ivelt completed: 9 results

2026-08-09 22:00:35,677 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-08-09 22:00:35.677129

2026-08-09 22:00:35,677 - __main__ - INFO - Email sent successfully

2026-08-09 22:00:35,677 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-08-09 22:00:35,678 - __main__ - INFO - Monitor complete. Found 21 total results: 12 new yiddish24 results, 9 new ivelt results.

2026-08-09 22:00:35,678 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-08-09 22:00:35,678 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-08-09 22:00:35,754 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-08-09 22:00:35,754 - __main__ - INFO - Closed all database connections

2026-08-09 22:00:35,756 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-08-09 22:00:35,756 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-08-09 22:30:01,688 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-08-09.log

2026-08-09 22:30:01,688 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-08-09.log

2026-08-09 22:30:01,689 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-08-09.log

2026-08-09 22:30:01,689 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-08-09 22:30:01,729 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-08-09 22:30:01,729 - __main__ - INFO - Configuration loaded and validated successfully

2026-08-09 22:30:01,732 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-08-09 22:30:01,733 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-08-09 22:30:01,748 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-08-09 22:30:01,748 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-08-09 22:30:01,801 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0 (contact:abep+dev@nocommand.local)')

2026-08-09 22:30:01,801 - __main__ - INFO - GitHub scraper initialized and enabled

2026-08-09 22:30:01,802 - __main__ - INFO - GitHub feed scraper initialized and enabled

2026-08-09 22:30:01,802 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-08-09 22:30:01,806 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled

2026-08-09 22:30:01,806 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0

2026-08-09 22:30:01,809 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-08-09 22:30:01,814 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled

2026-08-09 22:30:01,814 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13

2026-08-09 22:30:01,816 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-08-09 22:30:01,816 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2

2026-08-09 22:30:01,817 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0

2026-08-09 22:30:01,819 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0

2026-08-09 22:30:01,819 - __main__ - INFO - YouTube Intel scraper initialized and enabled

2026-08-09 22:30:01,819 - __main__ - INFO - Running 3 scrapers concurrently...

2026-08-09 22:30:01,819 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']

2026-08-09 22:30:02,294 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"

2026-08-09 22:30:02,295 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)

2026-08-09 22:30:02,841 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-08-09 22:30:02,867 - GitHubScraper - INFO - Found 246 GitHub repositories for term: paperclip

2026-08-09 22:30:03,440 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"

2026-08-09 22:30:03,825 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-08-09 22:30:03,923 - GitHubScraper - INFO - Found 510 GitHub repositories for term: "Hermes Agent"

2026-08-09 22:30:04,458 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"

2026-08-09 22:30:04,930 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-08-09 22:30:04,932 - GitHubScraper - INFO - Found 61 GitHub repositories for term: multica

2026-08-09 22:30:05,050 - GitHubScraper - INFO - Total GitHub results found: 0

2026-08-09 22:30:05,555 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 200 OK"

2026-08-09 22:30:08,387 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"

2026-08-09 22:30:08,788 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:08,804 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:08,809 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:08,851 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:09,143 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:09,182 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:09,230 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:09,280 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yitzih97/torahtale/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:09,585 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:09,614 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:09,622 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/tatyesod/talmud-tora-web/events?per_page=10 "HTTP/1.1 200 OK"

2026-08-09 22:30:09,819 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 200 OK"

2026-08-09 22:30:09,930 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:09,951 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:10,007 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:10,153 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:10,263 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:10,491 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:10,507 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:10,519 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/sikmenedowai-a11y/savetube-stream-kit/events?per_page=10 "HTTP/1.1 200 OK"

2026-08-09 22:30:10,809 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:10,839 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:10,859 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:10,862 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:11,119 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:11,180 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:11,273 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:11,288 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:11,558 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:11,650 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:11,763 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:11,967 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:12,301 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:12,384 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:12,399 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:12,416 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:12,628 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:12,661 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:12,843 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 200 OK"

2026-08-09 22:30:12,885 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 200 OK"

2026-08-09 22:30:13,131 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 200 OK"

2026-08-09 22:30:13,215 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:13,229 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:13,346 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 200 OK"

2026-08-09 22:30:13,513 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:13,636 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:13,645 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 200 OK"

2026-08-09 22:30:13,739 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/scott-fleischman/shark-2026/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:13,906 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:14,000 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:14,031 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:14,065 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:14,179 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:14,427 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:14,437 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:14,451 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:14,502 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 200 OK"

2026-08-09 22:30:14,762 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:14,884 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 200 OK"

2026-08-09 22:30:14,927 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 200 OK"

2026-08-09 22:30:15,114 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:15,202 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:15,301 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:15,472 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:15,527 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:15,533 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:15,600 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:15,806 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:15,841 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:15,878 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:15,958 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:16,127 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:16,198 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:16,223 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:16,329 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:16,541 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:16,586 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:16,624 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:16,628 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:16,866 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:16,900 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yeled-tov/filtertube-android/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:17,035 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:17,166 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:17,231 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:17,390 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 200 OK"

2026-08-09 22:30:17,506 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 200 OK"

2026-08-09 22:30:17,523 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:17,536 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-shabbat-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:17,720 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/ShireiShabbat/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:17,826 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:17,870 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:17,875 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:18,036 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:18,186 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:18,214 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:18,281 - YouTubeIntelScraper - INFO - YouTube Intel found 74 candidates and 18 new videos

2026-08-09 22:30:18,386 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:18,468 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:18,508 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:18,560 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:18,648 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-08-09 22:30:18,737 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=299 account_new=0 list_repos=100 list_new=0 private_new=0 total_new=0

2026-08-09 22:30:18,737 - __main__ - INFO - Scraper github completed: 0 results

2026-08-09 22:30:18,738 - __main__ - INFO - Scraper github_feed completed: 0 results

2026-08-09 22:30:18,738 - __main__ - INFO - Scraper youtube_intel completed: 18 results

2026-08-09 22:30:20,120 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-08-09 22:30:20.120151

2026-08-09 22:30:20,120 - __main__ - INFO - Email sent successfully

2026-08-09 22:30:20,120 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-08-09 22:30:20,120 - __main__ - INFO - Monitor complete. Found 18 total results: 18 new youtube intel results.

2026-08-09 22:30:20,120 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-08-09 22:30:20,121 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-08-09 22:30:20,166 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-08-09 22:30:20,166 - __main__ - INFO - Closed all database connections

2026-08-09 22:30:20,169 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-08-09 22:30:20,169 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-08-09 23:00:02,132 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-08-09.log

2026-08-09 23:00:02,132 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-08-09.log

2026-08-09 23:00:02,132 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-08-09.log

2026-08-09 23:00:02,132 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-08-09 23:00:02,163 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-08-09 23:00:02,163 - __main__ - INFO - Configuration loaded and validated successfully

2026-08-09 23:00:02,165 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-08-09 23:00:02,166 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-08-09 23:00:02,197 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-08-09 23:00:02,198 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-08-09 23:00:02,200 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0 (contact:abep+dev@nocommand.local)')

2026-08-09 23:00:02,201 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-08-09 23:00:02,201 - __main__ - INFO - RSS scraper initialized and enabled

2026-08-09 23:00:02,204 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled

2026-08-09 23:00:02,204 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0

2026-08-09 23:00:02,204 - __main__ - INFO - Yiddish24 scraper initialized and enabled

2026-08-09 23:00:02,207 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-08-09 23:00:02,211 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled

2026-08-09 23:00:02,211 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13

2026-08-09 23:00:02,214 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-08-09 23:00:02,214 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2

2026-08-09 23:00:02,214 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0

2026-08-09 23:00:02,216 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0

2026-08-09 23:00:02,216 - __main__ - INFO - Ivelt scraper initialized and enabled

2026-08-09 23:00:02,216 - __main__ - INFO - Running 3 scrapers concurrently...

2026-08-09 23:00:02,217 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)

2026-08-09 23:00:02,316 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100

2026-08-09 23:00:02,321 - IveltScraper - INFO - Loaded 181 include, 1 exclude filters from DB topic_filters

2026-08-09 23:00:02,321 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...

2026-08-09 23:00:02,324 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed

2026-08-09 23:00:02,367 - RSSFeedScraper - ERROR - Error fetching RSS feed https://www.theyeshivaworld.com/feed: name 'feedparser' is not defined

2026-08-09 23:00:02,368 - RSSFeedScraper - INFO - Total RSS/HTML results: 0

2026-08-09 23:00:12,122 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"

2026-08-09 23:00:12,339 - Yiddish24Scraper - INFO - Received response with 465768 characters

2026-08-09 23:00:12,342 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (297792 chars)

2026-08-09 23:00:12,346 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html

2026-08-09 23:00:12,427 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1

2026-08-09 23:00:12,466 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements

2026-08-09 23:00:12,466 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1

2026-08-09 23:00:12,512 - Yiddish24Scraper - INFO - Term 'פרטית' matched in TITLE: 'אינטערוויו: אינטערסאנטע השגחה פרטית זיך אפגעשפילט מיט א פאמיליע אויף האלדעי וויקאציע'

2026-08-09 23:00:12,512 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: אינטערוויו: אינטערסאנטע השגחה פרטית זיך אפגעשפילט

2026-08-09 23:00:13,012 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/KM_N114_273_1786315476.mp3

2026-08-09 23:00:13,093 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_KM_N114_273_1786315476.mp3 (631.0 KB)

2026-08-09 23:00:13,094 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)

2026-08-09 23:00:13,102 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_KM_N114_273_1786315476.mp3: title, artist, album, source_url, genre, publisher

2026-08-09 23:00:13,102 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2_KM_N114_273_1786315476_פרטית.mp3

2026-08-09 23:00:13,198 - Yiddish24Scraper - INFO - Term 'אינספיראציע -' matched in DESCRIPTION: 'אינספיראציע - געראטעוועט בין מות לחיים'

2026-08-09 23:00:13,198 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: הכל בכל

2026-08-09 23:00:14,012 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/VIDEO20260809132634D_260_260809045609.mp3

2026-08-09 23:00:14,136 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_VIDEO20260809132634D_260_260809045609.mp3 (5.0 MB)

2026-08-09 23:00:14,136 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)

2026-08-09 23:00:14,142 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_VIDEO20260809132634D_260_260809045609.mp3: title, artist, album, comment, source_url, genre, publisher

2026-08-09 23:00:14,142 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2_VIDEO20260809132634D_260_260809045609_אינספיראציע_-.mp3

2026-08-09 23:00:14,892 - Yiddish24Scraper - INFO - Page 1 summary: 10 new out of 100 total articles

2026-08-09 23:00:14,892 - Yiddish24Scraper - INFO - Page 1: 10/100 new items

2026-08-09 23:00:14,892 - Yiddish24Scraper - INFO - Low new item ratio (10.0%), stopping pagination

2026-08-09 23:00:14,893 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 10

2026-08-09 23:00:14,901 - IveltScraper - INFO - Found 50 active topics on ivelt

2026-08-09 23:00:32,172 - IveltScraper - INFO - ivelt scrape complete. Checked 4 topics.

2026-08-09 23:00:32,172 - IveltScraper - INFO - All forums scrape complete. Found 12 new posts.

2026-08-09 23:00:32,173 - __main__ - INFO - Scraper rss completed: 0 results

2026-08-09 23:00:32,173 - __main__ - INFO - Scraper yiddish24 completed: 10 results

2026-08-09 23:00:32,173 - __main__ - INFO - Scraper ivelt completed: 12 results

2026-08-09 23:00:33,139 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-08-09 23:00:33.139709

2026-08-09 23:00:33,140 - __main__ - INFO - Email sent successfully

2026-08-09 23:00:33,140 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-08-09 23:00:33,140 - __main__ - INFO - Monitor complete. Found 22 total results: 10 new yiddish24 results, 12 new ivelt results.

2026-08-09 23:00:33,140 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-08-09 23:00:33,140 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-08-09 23:00:33,364 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-08-09 23:00:33,365 - __main__ - INFO - Closed all database connections

2026-08-09 23:00:33,366 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-08-09 23:00:33,366 - social_media_monitor.database.connection - INFO - Closed 0 database connections