← Logs

social_media_monitor_2026-09-11.log

2026-09-11 20:00:26,445 - __main__ - INFO - Closed all database connections

2026-09-11 20:00:26,447 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-11 20:00:26,447 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-09-11 20:30:01,899 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-11.log

2026-09-11 20:30:01,899 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-11.log

2026-09-11 20:30:01,899 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-11.log

2026-09-11 20:30:01,899 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-09-11 20:30:01,946 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-09-11 20:30:01,946 - __main__ - INFO - Configuration loaded and validated successfully

2026-09-11 20:30:01,950 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-09-11 20:30:01,951 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-09-11 20:30:01,965 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-09-11 20:30:01,966 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-09-11 20:30:02,016 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')

2026-09-11 20:30:02,017 - __main__ - INFO - GitHub scraper initialized and enabled

2026-09-11 20:30:02,017 - __main__ - INFO - GitHub feed scraper initialized and enabled

2026-09-11 20:30:02,017 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-09-11 20:30:02,022 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled

2026-09-11 20:30:02,022 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0

2026-09-11 20:30:02,026 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-09-11 20:30:02,033 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled

2026-09-11 20:30:02,033 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13

2026-09-11 20:30:02,036 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-09-11 20:30:02,037 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2

2026-09-11 20:30:02,037 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0

2026-09-11 20:30:02,040 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0

2026-09-11 20:30:02,041 - __main__ - INFO - YouTube Intel scraper initialized and enabled

2026-09-11 20:30:02,041 - __main__ - INFO - Running 3 scrapers concurrently...

2026-09-11 20:30:02,041 - GitHubScraper - INFO - Searching GitHub for terms: ['"Hermes Agent"', '"claude code"', '"prime agent"', 'paperclip']

2026-09-11 20:30:02,495 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"

2026-09-11 20:30:02,496 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)

2026-09-11 20:30:03,266 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-09-11 20:30:03,293 - GitHubScraper - INFO - Found 599 GitHub repositories for term: "Hermes Agent"

2026-09-11 20:30:03,456 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"

2026-09-11 20:30:04,371 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22claude+code%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-09-11 20:30:04,452 - GitHubScraper - INFO - Found 8674 GitHub repositories for term: "claude code"

2026-09-11 20:30:04,512 - GitHubScraper - INFO - Added new GitHub repository: relay-ai

2026-09-11 20:30:04,520 - GitHubScraper - INFO - Added new GitHub repository: visa-vulnerability-agentic-harness

2026-09-11 20:30:04,567 - GitHubScraper - INFO - Added new GitHub repository: zeron

2026-09-11 20:30:04,704 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"

2026-09-11 20:30:05,578 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22prime+agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-09-11 20:30:05,671 - GitHubScraper - INFO - Found 39 GitHub repositories for term: "prime agent"

2026-09-11 20:30:05,872 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:05,872 - GitHubFeedScraper - INFO - GitHub account feed page 3 unchanged (ETag)

2026-09-11 20:30:06,777 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-09-11 20:30:06,869 - GitHubScraper - INFO - Found 259 GitHub repositories for term: paperclip

2026-09-11 20:30:06,993 - GitHubScraper - INFO - Total GitHub results found: 3

2026-09-11 20:30:09,660 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"

2026-09-11 20:30:09,990 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:10,117 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:10,121 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:10,136 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-11 20:30:10,392 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:10,407 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:10,494 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:10,542 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:10,704 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:10,796 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:10,798 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:10,970 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:11,067 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:11,195 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:11,200 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:11,400 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:11,583 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:11,652 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/sikmenedowai-a11y/savetube-stream-kit/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:11,667 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:11,751 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:11,923 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:12,013 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:12,101 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:12,131 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:12,316 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:12,465 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-11 20:30:12,692 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:12,771 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:12,814 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:12,907 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:13,081 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:13,271 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:13,332 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:13,348 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:13,423 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:13,564 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:13,775 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:13,797 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:13,955 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-11 20:30:13,958 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:13,987 - YouTubeIntelScraper - INFO - YouTube Intel found 45 candidates and 6 new videos

2026-09-11 20:30:14,264 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:14,346 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:14,378 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:14,392 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:14,805 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-11 20:30:14,857 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:14,867 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:14,963 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:15,125 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:15,170 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:15,288 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-11 20:30:15,415 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:15,493 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:15,680 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:15,703 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:15,788 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:16,133 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:16,222 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-11 20:30:16,239 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:16,298 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:16,540 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:16,683 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:16,712 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:16,831 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:16,932 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-11 20:30:16,982 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:17,058 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:17,171 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:17,329 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:17,401 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:17,404 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:17,475 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:17,685 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:17,717 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:17,832 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:17,834 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:18,051 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:18,194 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:18,196 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:18,219 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yeled-tov/filtertube-android/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-11 20:30:18,395 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:18,506 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:18,639 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:18,676 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-tfilah/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:18,728 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:18,857 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:19,008 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:19,047 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:19,123 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:19,267 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:19,329 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:19,485 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:19,541 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:19,637 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:19,752 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:19,754 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:19,840 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akshatasatmar/WeatherServiceApi/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:19,948 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elchunenfreund/satmar-matzos-app/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:20,267 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/Sefaria-Export/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:20,386 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmaribianca05-eng/AFSD-Satmari-Bianca/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 20:30:20,460 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=200 account_new=0 list_repos=100 list_new=0 private_new=0 total_new=0

2026-09-11 20:30:20,462 - __main__ - INFO - Scraper github completed: 3 results

2026-09-11 20:30:20,462 - __main__ - INFO - Scraper github_feed completed: 0 results

2026-09-11 20:30:20,462 - __main__ - INFO - Scraper youtube_intel completed: 6 results

2026-09-11 20:30:21,154 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-11 20:30:21.154806

2026-09-11 20:30:21,155 - __main__ - INFO - Email sent successfully

2026-09-11 20:30:21,155 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-09-11 20:30:21,155 - __main__ - INFO - Monitor complete. Found 9 total results: 3 new github results, 6 new youtube intel results.

2026-09-11 20:30:21,155 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-09-11 20:30:21,155 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-11 20:30:21,186 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-09-11 20:30:21,187 - __main__ - INFO - Closed all database connections

2026-09-11 20:30:21,189 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-11 20:30:21,189 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-09-11 21:00:01,949 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-11.log

2026-09-11 21:00:01,949 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-11.log

2026-09-11 21:00:01,949 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-11.log

2026-09-11 21:00:01,949 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-09-11 21:00:01,978 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-09-11 21:00:01,978 - __main__ - INFO - Configuration loaded and validated successfully

2026-09-11 21:00:01,981 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-09-11 21:00:01,981 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-09-11 21:00:01,996 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-09-11 21:00:01,996 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-09-11 21:00:01,999 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')

2026-09-11 21:00:02,001 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-09-11 21:00:02,001 - __main__ - INFO - RSS scraper initialized and enabled

2026-09-11 21:00:02,006 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled

2026-09-11 21:00:02,006 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0

2026-09-11 21:00:02,007 - __main__ - INFO - Yiddish24 scraper initialized and enabled

2026-09-11 21:00:02,011 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-09-11 21:00:02,015 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled

2026-09-11 21:00:02,015 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13

2026-09-11 21:00:02,017 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-09-11 21:00:02,017 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2

2026-09-11 21:00:02,017 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0

2026-09-11 21:00:02,020 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0

2026-09-11 21:00:02,020 - __main__ - INFO - Ivelt scraper initialized and enabled

2026-09-11 21:00:02,020 - __main__ - INFO - Running 3 scrapers concurrently...

2026-09-11 21:00:02,020 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)

2026-09-11 21:00:02,111 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100

2026-09-11 21:00:02,116 - IveltScraper - INFO - Loaded 181 include, 4 exclude filters from DB topic_filters

2026-09-11 21:00:02,116 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...

2026-09-11 21:00:02,118 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed

2026-09-11 21:00:02,396 - RSSFeedScraper - INFO - Total RSS/HTML results: 0

2026-09-11 21:00:06,553 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"

2026-09-11 21:00:14,324 - IveltScraper - INFO - Found 50 active topics on ivelt

2026-09-11 21:00:20,088 - Yiddish24Scraper - INFO - Received response with 439901 characters

2026-09-11 21:00:20,091 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (292340 chars)

2026-09-11 21:00:20,094 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html

2026-09-11 21:00:20,180 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1

2026-09-11 21:00:20,222 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements

2026-09-11 21:00:20,222 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1

2026-09-11 21:00:20,949 - Yiddish24Scraper - INFO - Page 1 summary: 5 new out of 100 total articles

2026-09-11 21:00:20,949 - Yiddish24Scraper - INFO - Page 1: 5/100 new items

2026-09-11 21:00:20,949 - Yiddish24Scraper - INFO - Low new item ratio (5.0%), stopping pagination

2026-09-11 21:00:20,949 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 5

2026-09-11 21:00:28,594 - IveltScraper - INFO - Filtering post containing exclude term: '*ביטע מאכט זיכער בלויז צו באריכטן קראנטע נייעס*'

2026-09-11 21:00:36,242 - IveltScraper - INFO - ivelt scrape complete. Checked 5 topics.

2026-09-11 21:00:36,242 - IveltScraper - INFO - All forums scrape complete. Found 9 new posts.

2026-09-11 21:00:36,242 - __main__ - INFO - Scraper rss completed: 0 results

2026-09-11 21:00:36,242 - __main__ - INFO - Scraper yiddish24 completed: 5 results

2026-09-11 21:00:36,242 - __main__ - INFO - Scraper ivelt completed: 9 results

2026-09-11 21:00:37,460 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-11 21:00:37.460024

2026-09-11 21:00:37,460 - __main__ - INFO - Email sent successfully

2026-09-11 21:00:37,460 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-09-11 21:00:37,460 - __main__ - INFO - Monitor complete. Found 14 total results: 5 new yiddish24 results, 9 new ivelt results.

2026-09-11 21:00:37,460 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-09-11 21:00:37,460 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-11 21:00:37,656 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-09-11 21:00:37,657 - __main__ - INFO - Closed all database connections

2026-09-11 21:00:37,659 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-11 21:00:37,659 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-09-11 22:00:02,225 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-11.log

2026-09-11 22:00:02,225 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-11.log

2026-09-11 22:00:02,225 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-11.log

2026-09-11 22:00:02,225 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-09-11 22:00:02,255 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-09-11 22:00:02,255 - __main__ - INFO - Configuration loaded and validated successfully

2026-09-11 22:00:02,257 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-09-11 22:00:02,258 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-09-11 22:00:02,272 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-09-11 22:00:02,273 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-09-11 22:00:02,328 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')

2026-09-11 22:00:02,330 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-09-11 22:00:02,330 - __main__ - INFO - RSS scraper initialized and enabled

2026-09-11 22:00:02,338 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled

2026-09-11 22:00:02,338 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0

2026-09-11 22:00:02,339 - __main__ - INFO - Yiddish24 scraper initialized and enabled

2026-09-11 22:00:02,346 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-09-11 22:00:02,353 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled

2026-09-11 22:00:02,353 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13

2026-09-11 22:00:02,355 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-09-11 22:00:02,355 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2

2026-09-11 22:00:02,355 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0

2026-09-11 22:00:02,358 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0

2026-09-11 22:00:02,358 - __main__ - INFO - Ivelt scraper initialized and enabled

2026-09-11 22:00:02,358 - __main__ - INFO - Running 3 scrapers concurrently...

2026-09-11 22:00:02,358 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)

2026-09-11 22:00:02,446 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100

2026-09-11 22:00:02,451 - IveltScraper - INFO - Loaded 181 include, 4 exclude filters from DB topic_filters

2026-09-11 22:00:02,451 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...

2026-09-11 22:00:02,453 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed

2026-09-11 22:00:02,948 - RSSFeedScraper - INFO - Total RSS/HTML results: 0

2026-09-11 22:00:14,820 - IveltScraper - INFO - Found 50 active topics on ivelt

2026-09-11 22:00:25,719 - IveltScraper - INFO - Filtering post containing exclude term: '*ביטע מאכט זיכער בלויז צו באריכטן קראנטע נייעס*'

2026-09-11 22:00:26,661 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"

2026-09-11 22:00:27,213 - Yiddish24Scraper - INFO - Received response with 439901 characters

2026-09-11 22:00:27,217 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (292340 chars)

2026-09-11 22:00:27,221 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html

2026-09-11 22:00:27,298 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1

2026-09-11 22:00:27,339 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements

2026-09-11 22:00:27,339 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1

2026-09-11 22:00:28,223 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 100 total articles

2026-09-11 22:00:28,223 - Yiddish24Scraper - INFO - Page 1: 0/100 new items

2026-09-11 22:00:28,223 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination

2026-09-11 22:00:28,224 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0

2026-09-11 22:00:33,151 - IveltScraper - INFO - ivelt scrape complete. Checked 5 topics.

2026-09-11 22:00:33,151 - IveltScraper - INFO - All forums scrape complete. Found 5 new posts.

2026-09-11 22:00:33,151 - __main__ - INFO - Scraper rss completed: 0 results

2026-09-11 22:00:33,151 - __main__ - INFO - Scraper yiddish24 completed: 0 results

2026-09-11 22:00:33,151 - __main__ - INFO - Scraper ivelt completed: 5 results

2026-09-11 22:00:33,803 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-11 22:00:33.803517

2026-09-11 22:00:33,803 - __main__ - INFO - Email sent successfully

2026-09-11 22:00:33,804 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-09-11 22:00:33,804 - __main__ - INFO - Monitor complete. Found 5 total results: 5 new ivelt results.

2026-09-11 22:00:33,804 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-09-11 22:00:33,804 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-11 22:00:33,884 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-09-11 22:00:33,884 - __main__ - INFO - Closed all database connections

2026-09-11 22:00:33,886 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-11 22:00:33,886 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-09-11 22:30:02,250 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-11.log

2026-09-11 22:30:02,251 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-11.log

2026-09-11 22:30:02,251 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-11.log

2026-09-11 22:30:02,251 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-09-11 22:30:02,281 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-09-11 22:30:02,281 - __main__ - INFO - Configuration loaded and validated successfully

2026-09-11 22:30:02,284 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-09-11 22:30:02,284 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-09-11 22:30:02,297 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-09-11 22:30:02,297 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-09-11 22:30:02,300 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')

2026-09-11 22:30:02,302 - __main__ - INFO - GitHub scraper initialized and enabled

2026-09-11 22:30:02,302 - __main__ - INFO - GitHub feed scraper initialized and enabled

2026-09-11 22:30:02,302 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-09-11 22:30:02,307 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled

2026-09-11 22:30:02,307 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0

2026-09-11 22:30:02,313 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-09-11 22:30:02,317 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled

2026-09-11 22:30:02,318 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13

2026-09-11 22:30:02,320 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-09-11 22:30:02,320 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2

2026-09-11 22:30:02,320 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0

2026-09-11 22:30:02,322 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0

2026-09-11 22:30:02,322 - __main__ - INFO - YouTube Intel scraper initialized and enabled

2026-09-11 22:30:02,323 - __main__ - INFO - Running 3 scrapers concurrently...

2026-09-11 22:30:02,323 - GitHubScraper - INFO - Searching GitHub for terms: ['"Hermes Agent"', '"claude code"', '"prime agent"', 'paperclip']

2026-09-11 22:30:02,736 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"

2026-09-11 22:30:02,737 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)

2026-09-11 22:30:03,523 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-09-11 22:30:03,550 - GitHubScraper - INFO - Found 599 GitHub repositories for term: "Hermes Agent"

2026-09-11 22:30:03,743 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"

2026-09-11 22:30:04,638 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22claude+code%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-09-11 22:30:04,722 - GitHubScraper - INFO - Found 8676 GitHub repositories for term: "claude code"

2026-09-11 22:30:04,742 - GitHubScraper - INFO - Added new GitHub repository: codex-seo

2026-09-11 22:30:04,771 - GitHubScraper - INFO - Added new GitHub repository: ios-builder

2026-09-11 22:30:04,839 - GitHubScraper - INFO - Added new GitHub repository: traceroot

2026-09-11 22:30:04,878 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"

2026-09-11 22:30:05,762 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22prime+agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-09-11 22:30:05,766 - GitHubScraper - INFO - Found 40 GitHub repositories for term: "prime agent"

2026-09-11 22:30:06,106 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:06,106 - GitHubFeedScraper - INFO - GitHub account feed page 3 unchanged (ETag)

2026-09-11 22:30:06,870 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"

2026-09-11 22:30:06,873 - GitHubScraper - INFO - Found 259 GitHub repositories for term: paperclip

2026-09-11 22:30:07,084 - GitHubScraper - INFO - Total GitHub results found: 3

2026-09-11 22:30:09,133 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"

2026-09-11 22:30:09,481 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:09,577 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:09,604 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:09,638 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:09,902 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:09,942 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-11 22:30:09,944 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:10,057 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:10,315 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:10,323 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:10,350 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:10,551 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:10,606 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:10,683 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:10,721 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:11,063 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:11,134 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:11,161 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/sikmenedowai-a11y/savetube-stream-kit/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-11 22:30:11,296 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:11,422 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:11,441 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:11,512 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-11 22:30:11,742 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:11,757 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:11,813 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:11,906 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-11 22:30:12,155 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:12,252 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:12,304 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:12,396 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:12,575 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:12,746 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:12,755 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:12,849 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:12,932 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:13,098 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:13,423 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:13,455 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:13,476 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:13,551 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-11 22:30:13,852 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:13,868 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-11 22:30:13,990 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:14,005 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-11 22:30:14,227 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:14,337 - YouTubeIntelScraper - INFO - YouTube Intel found 45 candidates and 7 new videos

2026-09-11 22:30:14,355 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:14,382 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:14,408 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:14,581 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:14,699 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:14,812 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:14,938 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:14,992 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:15,177 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:15,242 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:15,388 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:15,426 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:15,699 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:15,734 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:15,802 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-11 22:30:15,938 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:16,035 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:16,108 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:16,210 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:16,337 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:16,383 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:16,467 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:16,524 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:16,710 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:16,732 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:16,826 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:16,891 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:17,061 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:17,136 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:17,165 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:17,280 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:17,414 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:17,532 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:17,535 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yeled-tov/filtertube-android/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:17,650 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:17,758 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:17,895 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:17,956 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:18,073 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-tfilah/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:18,139 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:18,278 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:18,294 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:18,391 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:18,554 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 200 OK"

2026-09-11 22:30:18,618 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:18,627 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:18,762 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:18,895 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:18,910 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:19,035 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:19,119 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:19,167 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akshatasatmar/WeatherServiceApi/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:19,259 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elchunenfreund/satmar-matzos-app/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:19,388 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmaribianca05-eng/AFSD-Satmari-Bianca/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:19,590 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/Sefaria-Export/events?per_page=10 "HTTP/1.1 304 Not Modified"

2026-09-11 22:30:19,660 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=200 account_new=0 list_repos=100 list_new=0 private_new=0 total_new=0

2026-09-11 22:30:19,661 - __main__ - INFO - Scraper github completed: 3 results

2026-09-11 22:30:19,661 - __main__ - INFO - Scraper github_feed completed: 0 results

2026-09-11 22:30:19,661 - __main__ - INFO - Scraper youtube_intel completed: 7 results

2026-09-11 22:30:20,308 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-11 22:30:20.308292

2026-09-11 22:30:20,308 - __main__ - INFO - Email sent successfully

2026-09-11 22:30:20,308 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-09-11 22:30:20,309 - __main__ - INFO - Monitor complete. Found 10 total results: 3 new github results, 7 new youtube intel results.

2026-09-11 22:30:20,309 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-09-11 22:30:20,309 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-11 22:30:20,340 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-09-11 22:30:20,341 - __main__ - INFO - Closed all database connections

2026-09-11 22:30:20,343 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-11 22:30:20,343 - social_media_monitor.database.connection - INFO - Closed 0 database connections

2026-09-11 23:00:02,311 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-09-11.log

2026-09-11 23:00:02,312 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-09-11.log

2026-09-11 23:00:02,312 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-09-11.log

2026-09-11 23:00:02,312 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===

2026-09-11 23:00:02,341 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml

2026-09-11 23:00:02,341 - __main__ - INFO - Configuration loaded and validated successfully

2026-09-11 23:00:02,343 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections

2026-09-11 23:00:02,344 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists

2026-09-11 23:00:02,996 - social_media_monitor.database.connection - INFO - Database setup completed successfully

2026-09-11 23:00:02,997 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db

2026-09-11 23:00:03,055 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='SocialMediaMonitor/1.0')

2026-09-11 23:00:03,057 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0

2026-09-11 23:00:03,058 - __main__ - INFO - RSS scraper initialized and enabled

2026-09-11 23:00:03,065 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled

2026-09-11 23:00:03,065 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0

2026-09-11 23:00:03,065 - __main__ - INFO - Yiddish24 scraper initialized and enabled

2026-09-11 23:00:03,070 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0

2026-09-11 23:00:03,079 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled

2026-09-11 23:00:03,079 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13

2026-09-11 23:00:03,081 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled

2026-09-11 23:00:03,081 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2

2026-09-11 23:00:03,081 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0

2026-09-11 23:00:03,083 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0

2026-09-11 23:00:03,083 - __main__ - INFO - Ivelt scraper initialized and enabled

2026-09-11 23:00:03,084 - __main__ - INFO - Running 3 scrapers concurrently...

2026-09-11 23:00:03,084 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)

2026-09-11 23:00:03,170 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100

2026-09-11 23:00:03,174 - IveltScraper - INFO - Loaded 181 include, 4 exclude filters from DB topic_filters

2026-09-11 23:00:03,174 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...

2026-09-11 23:00:03,175 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed

2026-09-11 23:00:03,623 - RSSFeedScraper - INFO - Total RSS/HTML results: 0

2026-09-11 23:00:14,920 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"

2026-09-11 23:00:15,412 - IveltScraper - INFO - Found 50 active topics on ivelt

2026-09-11 23:00:15,496 - Yiddish24Scraper - INFO - Received response with 439901 characters

2026-09-11 23:00:15,499 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (292340 chars)

2026-09-11 23:00:15,502 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html

2026-09-11 23:00:15,579 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1

2026-09-11 23:00:15,619 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements

2026-09-11 23:00:15,620 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1

2026-09-11 23:00:16,603 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 100 total articles

2026-09-11 23:00:16,604 - Yiddish24Scraper - INFO - Page 1: 0/100 new items

2026-09-11 23:00:16,604 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination

2026-09-11 23:00:16,604 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0

2026-09-11 23:00:32,636 - IveltScraper - INFO - Filtering post containing exclude term: '*ביטע מאכט זיכער בלויז צו באריכטן קראנטע נייעס*'

2026-09-11 23:00:36,968 - IveltScraper - INFO - ivelt scrape complete. Checked 5 topics.

2026-09-11 23:00:36,969 - IveltScraper - INFO - All forums scrape complete. Found 3 new posts.

2026-09-11 23:00:36,969 - __main__ - INFO - Scraper rss completed: 0 results

2026-09-11 23:00:36,969 - __main__ - INFO - Scraper yiddish24 completed: 0 results

2026-09-11 23:00:36,969 - __main__ - INFO - Scraper ivelt completed: 3 results

2026-09-11 23:00:37,635 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-09-11 23:00:37.635318

2026-09-11 23:00:37,635 - __main__ - INFO - Email sent successfully

2026-09-11 23:00:37,635 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk

2026-09-11 23:00:37,636 - __main__ - INFO - Monitor complete. Found 3 total results: 3 new ivelt results.

2026-09-11 23:00:37,636 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===

2026-09-11 23:00:37,636 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-11 23:00:37,878 - social_media_monitor.database.connection - INFO - Closed 5 database connections

2026-09-11 23:00:37,879 - __main__ - INFO - Closed all database connections

2026-09-11 23:00:37,880 - social_media_monitor.database.connection - INFO - Closing all database connections

2026-09-11 23:00:37,880 - social_media_monitor.database.connection - INFO - Closed 0 database connections