← Logs
social_media_monitor_2026-08-21.log
2026-08-21 20:30:02,951 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-08-21 20:30:02,951 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-08-21 20:30:02,951 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-08-21 20:30:02,956 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-08-21 20:30:02,956 - __main__ - INFO - YouTube Intel scraper initialized and enabled
2026-08-21 20:30:02,956 - __main__ - INFO - Running 4 scrapers concurrently...
2026-08-21 20:30:02,956 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit search monitoring enabled. Running search with terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-08-21 20:30:02,957 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit (PRAW) for terms: ['"Hermes Agent"']
2026-08-21 20:30:03,954 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit PRAW search: 25 entries for term '"Hermes Agent"'
2026-08-21 20:30:03,968 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Qwen3.8-27B heretic-ara: Custom GGUF quants with MTP + Vision + ROCmFP
2026-08-21 20:30:03,978 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: I use the ZCode Harness
2026-08-21 20:30:05,164 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit search results found: 2
2026-08-21 20:30:05,164 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'paperclip' restricted to subreddits: ['PaperClip_AI', 'PaperclipAI']
2026-08-21 20:30:05,164 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit (PRAW) for terms: ['paperclip'] within r/PaperClip_AI+PaperclipAI
2026-08-21 20:30:05,886 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit PRAW search: 25 entries for term 'paperclip'
2026-08-21 20:30:07,079 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit search results found: 0
2026-08-21 20:30:07,079 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'multica' restricted to subreddits: ['hermesagent', 'HermesAI']
2026-08-21 20:30:07,079 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit (PRAW) for terms: ['multica'] within r/hermesagent+HermesAI
2026-08-21 20:30:07,302 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit PRAW search: 0 entries for term 'multica'
2026-08-21 20:30:08,303 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit search results found: 0
2026-08-21 20:30:08,303 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-08-21 20:30:08,785 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"
2026-08-21 20:30:08,787 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)
2026-08-21 20:30:09,520 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-08-21 20:30:09,552 - GitHubScraper - INFO - Found 253 GitHub repositories for term: paperclip
2026-08-21 20:30:09,693 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"
2026-08-21 20:30:10,625 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-08-21 20:30:10,629 - GitHubScraper - INFO - Found 545 GitHub repositories for term: "Hermes Agent"
2026-08-21 20:30:10,655 - GitHubScraper - INFO - Added new GitHub repository: harnessrouter
2026-08-21 20:30:10,767 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"
2026-08-21 20:30:12,074 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:12,075 - GitHubFeedScraper - INFO - GitHub account feed page 3 unchanged (ETag)
2026-08-21 20:30:12,098 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-08-21 20:30:12,184 - GitHubScraper - INFO - Found 65 GitHub repositories for term: multica
2026-08-21 20:30:12,316 - GitHubScraper - INFO - Total GitHub results found: 1
2026-08-21 20:30:15,263 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"
2026-08-21 20:30:15,629 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:15,672 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:15,718 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:15,775 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:16,110 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:16,118 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:16,165 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:16,206 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yitzih97/torahtale/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-21 20:30:16,504 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:16,528 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/tatyesod/talmud-tora-web/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:16,597 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:16,796 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:16,897 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:16,938 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:16,975 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:17,211 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:17,241 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:17,386 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-21 20:30:17,447 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/sikmenedowai-a11y/savetube-stream-kit/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-21 20:30:17,656 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:17,701 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:17,735 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:17,756 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-21 20:30:17,996 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:18,087 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:18,105 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:18,165 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:18,357 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:18,546 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:18,600 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:18,811 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:18,899 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:18,907 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:19,145 - YouTubeIntelScraper - INFO - YouTube Intel found 42 candidates and 9 new videos
2026-08-21 20:30:19,246 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:19,419 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:19,422 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:19,502 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:19,656 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:19,907 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-21 20:30:19,995 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-21 20:30:20,031 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:20,066 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:20,296 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:20,424 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:20,589 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-21 20:30:20,607 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:20,694 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:20,918 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:21,016 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:21,022 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:21,045 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:21,305 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:21,421 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:21,449 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:21,497 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:21,704 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:21,861 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:21,910 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:21,944 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:22,294 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:22,297 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:22,412 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:22,443 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:22,726 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:22,728 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:22,769 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:22,856 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:23,091 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:23,124 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:23,164 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:23,235 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:23,468 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:23,504 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:23,565 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:23,735 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:23,841 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:23,873 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:24,014 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:24,016 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:24,250 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yeled-tov/filtertube-android/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:24,449 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:24,485 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:24,504 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:24,729 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:24,790 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:24,846 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:24,872 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-shabbat-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:25,021 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/ShireiShabbat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:25,138 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:25,153 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:25,238 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:25,422 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:25,431 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:25,514 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:25,609 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:25,764 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:25,772 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:25,841 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:25,982 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:26,104 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akshatasatmar/WeatherServiceApi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 20:30:26,148 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=200 account_new=0 list_repos=100 list_new=0 private_new=0 total_new=0
2026-08-21 20:30:26,148 - __main__ - INFO - Scraper reddit completed: 2 results
2026-08-21 20:30:26,148 - __main__ - INFO - Scraper github completed: 1 results
2026-08-21 20:30:26,149 - __main__ - INFO - Scraper github_feed completed: 0 results
2026-08-21 20:30:26,149 - __main__ - INFO - Scraper youtube_intel completed: 9 results
2026-08-21 20:30:26,853 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-08-21 20:30:26.853893
2026-08-21 20:30:26,854 - __main__ - INFO - Email sent successfully
2026-08-21 20:30:26,854 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-08-21 20:30:26,854 - __main__ - INFO - Monitor complete. Found 12 total results: 2 new reddit results, 1 new github results, 9 new youtube intel results.
2026-08-21 20:30:26,854 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-08-21 20:30:26,854 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-21 20:30:26,885 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-08-21 20:30:26,886 - __main__ - INFO - Closed all database connections
2026-08-21 20:30:26,889 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-21 20:30:26,890 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-08-21 21:00:02,661 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-08-21.log
2026-08-21 21:00:02,661 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-08-21.log
2026-08-21 21:00:02,661 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-08-21.log
2026-08-21 21:00:02,661 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-08-21 21:00:02,687 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-08-21 21:00:02,687 - __main__ - INFO - Configuration loaded and validated successfully
2026-08-21 21:00:02,690 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-08-21 21:00:02,690 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-08-21 21:00:02,705 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-08-21 21:00:02,705 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-08-21 21:00:02,707 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='linux:SocialMediaMonitor:1.0 (by /u/abeperl)')
2026-08-21 21:00:02,708 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-08-21 21:00:02,708 - __main__ - INFO - RSS scraper initialized and enabled
2026-08-21 21:00:02,711 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-08-21 21:00:02,711 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-08-21 21:00:02,711 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-08-21 21:00:02,713 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-08-21 21:00:02,718 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-08-21 21:00:02,718 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-08-21 21:00:02,720 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-08-21 21:00:02,720 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-08-21 21:00:02,720 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-08-21 21:00:02,722 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-08-21 21:00:02,722 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-08-21 21:00:02,722 - __main__ - INFO - Running 3 scrapers concurrently...
2026-08-21 21:00:02,722 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-08-21 21:00:02,811 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-08-21 21:00:02,816 - IveltScraper - INFO - Loaded 181 include, 1 exclude filters from DB topic_filters
2026-08-21 21:00:02,816 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-08-21 21:00:02,817 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-08-21 21:00:02,975 - RSSFeedScraper - ERROR - Error fetching RSS feed https://www.theyeshivaworld.com/feed: name 'feedparser' is not defined
2026-08-21 21:00:02,977 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-08-21 21:00:03,395 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-08-21 21:00:03,614 - Yiddish24Scraper - INFO - Received response with 436132 characters
2026-08-21 21:00:03,618 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (289289 chars)
2026-08-21 21:00:03,621 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-08-21 21:00:03,705 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-08-21 21:00:03,744 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-08-21 21:00:03,744 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-08-21 21:00:04,539 - Yiddish24Scraper - INFO - Page 1 summary: 11 new out of 100 total articles
2026-08-21 21:00:04,539 - Yiddish24Scraper - INFO - Page 1: 11/100 new items
2026-08-21 21:00:04,539 - Yiddish24Scraper - INFO - Low new item ratio (11.0%), stopping pagination
2026-08-21 21:00:04,539 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 11
2026-08-21 21:00:15,055 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-08-21 21:00:40,800 - IveltScraper - INFO - ivelt scrape complete. Checked 6 topics.
2026-08-21 21:00:40,800 - IveltScraper - INFO - All forums scrape complete. Found 49 new posts.
2026-08-21 21:00:40,801 - __main__ - INFO - Scraper rss completed: 0 results
2026-08-21 21:00:40,801 - __main__ - INFO - Scraper yiddish24 completed: 11 results
2026-08-21 21:00:40,801 - __main__ - INFO - Scraper ivelt completed: 49 results
2026-08-21 21:00:42,276 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-08-21 21:00:42.275972
2026-08-21 21:00:42,276 - __main__ - INFO - Email sent successfully
2026-08-21 21:00:42,276 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-08-21 21:00:42,276 - __main__ - INFO - Monitor complete. Found 60 total results: 11 new yiddish24 results, 49 new ivelt results.
2026-08-21 21:00:42,276 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-08-21 21:00:42,276 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-21 21:00:42,348 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-08-21 21:00:42,349 - __main__ - INFO - Closed all database connections
2026-08-21 21:00:42,350 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-21 21:00:42,351 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-08-21 22:00:02,378 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-08-21.log
2026-08-21 22:00:02,378 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-08-21.log
2026-08-21 22:00:02,379 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-08-21.log
2026-08-21 22:00:02,379 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-08-21 22:00:02,404 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-08-21 22:00:02,404 - __main__ - INFO - Configuration loaded and validated successfully
2026-08-21 22:00:02,406 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-08-21 22:00:02,407 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-08-21 22:00:02,421 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-08-21 22:00:02,421 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-08-21 22:00:02,487 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='linux:SocialMediaMonitor:1.0 (by /u/abeperl)')
2026-08-21 22:00:02,488 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-08-21 22:00:02,489 - __main__ - INFO - RSS scraper initialized and enabled
2026-08-21 22:00:02,496 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-08-21 22:00:02,497 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-08-21 22:00:02,497 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-08-21 22:00:02,503 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-08-21 22:00:02,512 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-08-21 22:00:02,512 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-08-21 22:00:02,514 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-08-21 22:00:02,514 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-08-21 22:00:02,514 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-08-21 22:00:02,517 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-08-21 22:00:02,517 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-08-21 22:00:02,517 - __main__ - INFO - Running 3 scrapers concurrently...
2026-08-21 22:00:02,517 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-08-21 22:00:02,608 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-08-21 22:00:02,613 - IveltScraper - INFO - Loaded 181 include, 1 exclude filters from DB topic_filters
2026-08-21 22:00:02,613 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-08-21 22:00:02,614 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-08-21 22:00:02,745 - RSSFeedScraper - ERROR - Error fetching RSS feed https://www.theyeshivaworld.com/feed: name 'feedparser' is not defined
2026-08-21 22:00:02,747 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-08-21 22:00:04,080 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-08-21 22:00:04,308 - Yiddish24Scraper - INFO - Received response with 436016 characters
2026-08-21 22:00:04,311 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (291275 chars)
2026-08-21 22:00:04,313 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-08-21 22:00:04,400 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-08-21 22:00:04,438 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-08-21 22:00:04,438 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-08-21 22:00:05,116 - Yiddish24Scraper - INFO - Page 1 summary: 5 new out of 100 total articles
2026-08-21 22:00:05,116 - Yiddish24Scraper - INFO - Page 1: 5/100 new items
2026-08-21 22:00:05,116 - Yiddish24Scraper - INFO - Low new item ratio (5.0%), stopping pagination
2026-08-21 22:00:05,117 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 5
2026-08-21 22:00:14,790 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-08-21 22:00:38,366 - IveltScraper - INFO - ivelt scrape complete. Checked 6 topics.
2026-08-21 22:00:38,366 - IveltScraper - INFO - All forums scrape complete. Found 14 new posts.
2026-08-21 22:00:38,367 - __main__ - INFO - Scraper rss completed: 0 results
2026-08-21 22:00:38,367 - __main__ - INFO - Scraper yiddish24 completed: 5 results
2026-08-21 22:00:38,367 - __main__ - INFO - Scraper ivelt completed: 14 results
2026-08-21 22:00:39,748 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-08-21 22:00:39.748543
2026-08-21 22:00:39,748 - __main__ - INFO - Email sent successfully
2026-08-21 22:00:39,749 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-08-21 22:00:39,749 - __main__ - INFO - Monitor complete. Found 19 total results: 5 new yiddish24 results, 14 new ivelt results.
2026-08-21 22:00:39,749 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-08-21 22:00:39,749 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-21 22:00:39,805 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-08-21 22:00:39,805 - __main__ - INFO - Closed all database connections
2026-08-21 22:00:39,807 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-21 22:00:39,807 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-08-21 22:30:02,883 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-08-21.log
2026-08-21 22:30:02,883 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-08-21.log
2026-08-21 22:30:02,883 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-08-21.log
2026-08-21 22:30:02,884 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-08-21 22:30:02,908 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-08-21 22:30:02,908 - __main__ - INFO - Configuration loaded and validated successfully
2026-08-21 22:30:02,911 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-08-21 22:30:02,911 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-08-21 22:30:02,925 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-08-21 22:30:02,925 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-08-21 22:30:02,927 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='linux:SocialMediaMonitor:1.0 (by /u/abeperl)')
2026-08-21 22:30:02,927 - __main__ - INFO - Reddit scraper initialized and enabled
2026-08-21 22:30:02,927 - __main__ - INFO - GitHub scraper initialized and enabled
2026-08-21 22:30:02,927 - __main__ - INFO - GitHub feed scraper initialized and enabled
2026-08-21 22:30:02,928 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-08-21 22:30:02,930 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-08-21 22:30:02,930 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-08-21 22:30:02,933 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-08-21 22:30:02,937 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-08-21 22:30:02,937 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-08-21 22:30:02,939 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-08-21 22:30:02,939 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-08-21 22:30:02,939 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-08-21 22:30:02,942 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-08-21 22:30:02,942 - __main__ - INFO - YouTube Intel scraper initialized and enabled
2026-08-21 22:30:02,942 - __main__ - INFO - Running 4 scrapers concurrently...
2026-08-21 22:30:02,942 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit search monitoring enabled. Running search with terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-08-21 22:30:02,942 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit (PRAW) for terms: ['"Hermes Agent"']
2026-08-21 22:30:03,922 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit PRAW search: 25 entries for term '"Hermes Agent"'
2026-08-21 22:30:03,934 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Argos - A Hermes memory plugin
2026-08-21 22:30:05,119 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit search results found: 1
2026-08-21 22:30:05,119 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'paperclip' restricted to subreddits: ['PaperClip_AI', 'PaperclipAI']
2026-08-21 22:30:05,119 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit (PRAW) for terms: ['paperclip'] within r/PaperClip_AI+PaperclipAI
2026-08-21 22:30:05,782 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit PRAW search: 25 entries for term 'paperclip'
2026-08-21 22:30:06,951 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit search results found: 0
2026-08-21 22:30:06,952 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'multica' restricted to subreddits: ['hermesagent', 'HermesAI']
2026-08-21 22:30:06,952 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit (PRAW) for terms: ['multica'] within r/hermesagent+HermesAI
2026-08-21 22:30:07,161 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit PRAW search: 0 entries for term 'multica'
2026-08-21 22:30:08,161 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit search results found: 0
2026-08-21 22:30:08,162 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-08-21 22:30:08,630 - httpx - INFO - HTTP Request: GET https://api.github.com/user "HTTP/1.1 200 OK"
2026-08-21 22:30:08,631 - GitHubFeedScraper - INFO - GitHub auth preflight passed for abeperl; token scopes: not reported (fine-grained token)
2026-08-21 22:30:09,297 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-08-21 22:30:09,332 - GitHubScraper - INFO - Found 253 GitHub repositories for term: paperclip
2026-08-21 22:30:09,473 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"
2026-08-21 22:30:10,348 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-08-21 22:30:10,350 - GitHubScraper - INFO - Found 544 GitHub repositories for term: "Hermes Agent"
2026-08-21 22:30:10,383 - GitHubScraper - INFO - Added new GitHub repository: diagram-design
2026-08-21 22:30:10,427 - GitHubScraper - INFO - Added new GitHub repository: code-review-graph
2026-08-21 22:30:10,545 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"
2026-08-21 22:30:11,425 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-08-21 22:30:11,429 - GitHubScraper - INFO - Found 65 GitHub repositories for term: multica
2026-08-21 22:30:11,552 - GitHubScraper - INFO - Total GitHub results found: 2
2026-08-21 22:30:11,695 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 200 OK"
2026-08-21 22:30:14,451 - httpx - INFO - HTTP Request: POST https://api.github.com/graphql "HTTP/1.1 200 OK"
2026-08-21 22:30:14,877 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Biswaspr1022/KodeshMode/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:14,911 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yehoshuayaakov/mishnayos-signup/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:14,919 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/efiles-star/ShasTracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:14,952 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akivayevdayev-debug/Shelah_app/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:15,268 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Oranburg/havruta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:15,284 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/nnanach/torah-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:15,343 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hitchin999/YidCal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:15,368 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yitzih97/torahtale/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-21 22:30:15,613 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/azernjj/talmudai/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:15,729 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ethanpil/daily-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:15,829 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/tatyesod/talmud-tora-web/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:15,933 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rabbishimon613-lang/chabad-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:15,991 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/adunnmobilenotary-gif/halacha-search/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:16,116 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Chabadrt/chabad-cms-backend/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:16,221 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ronrefael/kav-siddur-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:16,223 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/IsraelCIL/SiddurAmIsrael/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:16,314 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ElikoGrins/Halacha-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:16,463 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/kdroidFilter/Zayit/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:16,650 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/EzraBrand/talmud-nlp-indexer/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:16,779 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/sikmenedowai-a11y/savetube-stream-kit/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-21 22:30:16,870 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/brainheart/tanakh-contabulate/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:16,879 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Hbleiberg/Hebrew_Blender/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-21 22:30:16,996 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Esoterics611/maayan/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:17,165 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/wuisabel-gif/Aleph-Bet/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:17,200 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/stenagmois-byte/SimHebrew-Concordance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:17,251 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/daf-yomi-history-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:17,390 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jepick/talmud-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:17,533 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shloimie-beep/bnei-neviim-academy/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:17,636 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/paperlesspaper/integrations/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:17,804 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Asifah-Analytics-C-A-V-E/asifah-analytics/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:17,900 - YouTubeIntelScraper - INFO - YouTube Intel found 41 candidates and 9 new videos
2026-08-21 22:30:17,962 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-collector-components/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:17,996 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dniasoff/learning-tracker/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:18,005 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DavidPatlas-AI/tehillim-russian-site/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:18,318 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hytric/NLP_term_project/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:18,411 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RonTurrentine/KJV-Strongs-EBook/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:18,555 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yossi-weinberger/ten10/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:18,645 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/dmo18/MySugya/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:18,670 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zarbinco/zarbin-seo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:18,973 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/v97969181-commits/master-pdf-editor-legacy-release/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-21 22:30:19,002 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/duvarakesh06/FAB-Subtitler-12.1-Offline-Release/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-21 22:30:19,062 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elmadanimohammed78-del/daily-flow-landing/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:19,074 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AUX440/liquidtext-ultimate-patch-kit/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-21 22:30:19,331 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/rafistrauss/commons-announcements/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:19,360 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/apusaha0011/MenuSideKick/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:19,531 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Roger0129/bitwarden-2024-8-0-patchless-install/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-21 22:30:19,624 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Aljademaratas/readiris-product-code-generator/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-21 22:30:19,648 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/chfle/chfle/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:19,846 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/revanite-io/pvtr-gcp-cloud-storage/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:19,934 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Jossifresben/translation-alignment/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:20,012 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/benemanuel/status/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:20,041 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/100Reps/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:20,115 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/egkristi/ToponymiaEuropaea/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:20,345 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:20,417 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/KosherJava/zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:20,446 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Israel-Kli/shabbat-timetable/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:20,709 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/woodpeckerbros/watch-reminder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:20,798 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/hebcal-go/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:20,859 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/hebcal/learning/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:20,931 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/svenalot-ui/sidur-native/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:21,172 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/joelcw/intsayt/events?per_page=10 "HTTP/1.1 200 OK"
2026-08-21 22:30:21,293 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/levidao-eth/Torah/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:21,303 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Sefaria/ai-chatbot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:21,414 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/complytime/complytime-policies/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:21,546 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AdamYairLee/torah-korean-translation/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:21,598 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ainihonuragawa-lang/TalmudFinance/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:21,615 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/zakdev26/sefaria-links/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:21,805 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vaisisrael/gemara-benichuta/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:21,840 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Yiddish-Dialect-Dictionary/-brukhe-machine/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:21,984 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/SnirRadomsky/daf-yomi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:22,017 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/elconde/kosher-races/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:22,174 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/jacopovirga/kindle-zmanim/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:22,229 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Selecr-Surplus/minyan-finder/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:22,314 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/aharonium/opensiddur.org/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:22,316 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/robmoffat/FOSS-Contribution-Gemara/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:22,477 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/theOnionsAreWatching/Shtigletz/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:22,648 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/naorbrown/peninei-halacha-yomi-bot/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:22,673 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/vistaTeam/satmar/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:22,703 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mig2/mishnah-style/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:22,762 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/skilead770/stoliskikosher/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:23,034 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/mak-sandboxuser/chabad-react-and-supabase/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:23,043 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yeled-tov/filtertube-android/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:23,056 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/a0556770172-png/koshermat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:23,128 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/bnq9705-creator/siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:23,374 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/yosefmalul52-lang/costa-rica-kosher-retreat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:23,408 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/shirei-shabbat-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:23,411 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Kosher-T/fannexus/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:23,506 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/ReuvenB-S/kosher-browser-data/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:23,694 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/shliachflow/chabad-southern-delaware-camp/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:23,745 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/AviMish10/tanach-map/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:23,754 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/RavBogard/ShireiShabbat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:23,864 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TanachatGKRB/TanachatGKRB.github.io/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:24,086 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/DeepSynchronicity/chabadofhurlingham/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:24,109 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-FG1/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:24,131 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TamamTamar/chabad-yafo/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:24,209 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/semiagenticRob/digital-siddur/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:24,415 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/orelzion/daily-tanach/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:24,452 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/TG-CONSULTANT/tanachok-stock-mat/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:24,454 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/Frish-Gebakn/kol-satmar-website/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:24,538 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/satmarthubby-blip/Satmarthubby/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:24,698 - httpx - INFO - HTTP Request: GET https://api.github.com/repos/akshatasatmar/WeatherServiceApi/events?per_page=10 "HTTP/1.1 304 Not Modified"
2026-08-21 22:30:24,759 - GitHubFeedScraper - INFO - GitHub feed healthy: login=abeperl fetched=268 account_new=0 list_repos=100 list_new=0 private_new=0 total_new=0
2026-08-21 22:30:24,761 - __main__ - INFO - Scraper reddit completed: 1 results
2026-08-21 22:30:24,761 - __main__ - INFO - Scraper github completed: 2 results
2026-08-21 22:30:24,761 - __main__ - INFO - Scraper github_feed completed: 0 results
2026-08-21 22:30:24,761 - __main__ - INFO - Scraper youtube_intel completed: 9 results
2026-08-21 22:30:25,564 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-08-21 22:30:25.564571
2026-08-21 22:30:25,564 - __main__ - INFO - Email sent successfully
2026-08-21 22:30:25,565 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-08-21 22:30:25,565 - __main__ - INFO - Monitor complete. Found 12 total results: 1 new reddit results, 2 new github results, 9 new youtube intel results.
2026-08-21 22:30:25,565 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-08-21 22:30:25,565 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-21 22:30:25,593 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-08-21 22:30:25,593 - __main__ - INFO - Closed all database connections
2026-08-21 22:30:25,596 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-21 22:30:25,597 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-08-21 23:00:02,751 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-08-21.log
2026-08-21 23:00:02,751 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-08-21.log
2026-08-21 23:00:02,751 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-08-21.log
2026-08-21 23:00:02,751 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-08-21 23:00:02,776 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-08-21 23:00:02,776 - __main__ - INFO - Configuration loaded and validated successfully
2026-08-21 23:00:02,779 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-08-21 23:00:02,779 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-08-21 23:00:02,803 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-08-21 23:00:02,803 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-08-21 23:00:02,846 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully (UA='linux:SocialMediaMonitor:1.0 (by /u/abeperl)')
2026-08-21 23:00:02,847 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=1, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-08-21 23:00:02,847 - __main__ - INFO - RSS scraper initialized and enabled
2026-08-21 23:00:02,850 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-08-21 23:00:02,850 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-08-21 23:00:02,850 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-08-21 23:00:02,852 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-08-21 23:00:02,857 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-08-21 23:00:02,857 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=13
2026-08-21 23:00:02,859 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-08-21 23:00:02,859 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=2
2026-08-21 23:00:02,859 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=True, exclude_filters=1, include_filters=0
2026-08-21 23:00:02,861 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-08-21 23:00:02,862 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-08-21 23:00:02,862 - __main__ - INFO - Running 3 scrapers concurrently...
2026-08-21 23:00:02,862 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-08-21 23:00:02,946 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-08-21 23:00:02,951 - IveltScraper - INFO - Loaded 181 include, 1 exclude filters from DB topic_filters
2026-08-21 23:00:02,951 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-08-21 23:00:02,952 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-08-21 23:00:03,083 - RSSFeedScraper - ERROR - Error fetching RSS feed https://www.theyeshivaworld.com/feed: name 'feedparser' is not defined
2026-08-21 23:00:03,085 - RSSFeedScraper - INFO - Total RSS/HTML results: 0
2026-08-21 23:00:04,574 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-08-21 23:00:04,802 - Yiddish24Scraper - INFO - Received response with 436016 characters
2026-08-21 23:00:04,806 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (291275 chars)
2026-08-21 23:00:04,809 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-08-21 23:00:04,897 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-08-21 23:00:04,936 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-08-21 23:00:04,936 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-08-21 23:00:05,684 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 100 total articles
2026-08-21 23:00:05,684 - Yiddish24Scraper - INFO - Page 1: 0/100 new items
2026-08-21 23:00:05,684 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination
2026-08-21 23:00:05,685 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0
2026-08-21 23:00:15,169 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-08-21 23:00:33,590 - IveltScraper - INFO - ivelt scrape complete. Checked 5 topics.
2026-08-21 23:00:33,590 - IveltScraper - INFO - All forums scrape complete. Found 4 new posts.
2026-08-21 23:00:33,590 - __main__ - INFO - Scraper rss completed: 0 results
2026-08-21 23:00:33,590 - __main__ - INFO - Scraper yiddish24 completed: 0 results
2026-08-21 23:00:33,591 - __main__ - INFO - Scraper ivelt completed: 4 results
2026-08-21 23:00:34,446 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-08-21 23:00:34.446913
2026-08-21 23:00:34,447 - __main__ - INFO - Email sent successfully
2026-08-21 23:00:34,447 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-08-21 23:00:34,447 - __main__ - INFO - Monitor complete. Found 4 total results: 4 new ivelt results.
2026-08-21 23:00:34,447 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-08-21 23:00:34,447 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-21 23:00:34,532 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-08-21 23:00:34,532 - __main__ - INFO - Closed all database connections
2026-08-21 23:00:34,534 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-08-21 23:00:34,534 - social_media_monitor.database.connection - INFO - Closed 0 database connections
Live tail active — waiting for new lines...