← Logs

social_media_monitor_2026-05-15.log

2026-05-15 20:00:02,096 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=1, exclude_terms=0
2026-05-15 20:00:02,096 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-05-15 20:00:02,096 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-05-15 20:00:02,096 - __main__ - INFO - Running 3 scrapers concurrently...
2026-05-15 20:00:02,096 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-05-15 20:00:02,183 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-05-15 20:00:02,187 - IveltScraper - INFO - Loaded 178 include, 0 exclude filters from DB topic_filters
2026-05-15 20:00:02,187 - IveltScraper - INFO - Fetching ivelt.com active topics...
2026-05-15 20:00:02,189 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-05-15 20:00:02,507 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-05-15 20:00:03,010 - RSSFeedScraper - INFO - Fetching RSS feed: https://github.com/BuilderPulse/BuilderPulse/commits/main.atom
2026-05-15 20:00:03,563 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-15.md "HTTP/1.1 200 OK"
2026-05-15 20:00:03,768 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-05-15 20:00:03,999 - Yiddish24Scraper - INFO - Received response with 488153 characters
2026-05-15 20:00:04,003 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (309413 chars)
2026-05-15 20:00:04,007 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-05-15 20:00:04,097 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-05-15 20:00:04,138 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-05-15 20:00:04,138 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-05-15 20:00:04,885 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 100 total articles
2026-05-15 20:00:04,886 - Yiddish24Scraper - INFO - Page 1: 0/100 new items
2026-05-15 20:00:04,886 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination
2026-05-15 20:00:04,886 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0
2026-05-15 20:00:04,897 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-15.md "HTTP/1.1 200 OK"
2026-05-15 20:00:06,076 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-14.md "HTTP/1.1 200 OK"
2026-05-15 20:00:06,901 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-14.md "HTTP/1.1 200 OK"
2026-05-15 20:00:08,038 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-13.md "HTTP/1.1 200 OK"
2026-05-15 20:00:08,904 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-13.md "HTTP/1.1 200 OK"
2026-05-15 20:00:10,053 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-12.md "HTTP/1.1 200 OK"
2026-05-15 20:00:10,908 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-12.md "HTTP/1.1 200 OK"
2026-05-15 20:00:12,031 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-11.md "HTTP/1.1 200 OK"
2026-05-15 20:00:12,911 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-11.md "HTTP/1.1 200 OK"
2026-05-15 20:00:13,938 - IveltScraper - INFO - Found 50 active topics on ivelt.com
2026-05-15 20:00:14,057 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-10.md "HTTP/1.1 200 OK"
2026-05-15 20:00:14,915 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-10.md "HTTP/1.1 200 OK"
2026-05-15 20:00:20,700 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-09.md "HTTP/1.1 200 OK"
2026-05-15 20:00:20,731 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-09.md "HTTP/1.1 200 OK"
2026-05-15 20:00:21,919 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-08.md "HTTP/1.1 200 OK"
2026-05-15 20:00:22,866 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-07.md "HTTP/1.1 200 OK"
2026-05-15 20:00:23,735 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-07.md "HTTP/1.1 200 OK"
2026-05-15 20:00:24,884 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-06.md "HTTP/1.1 200 OK"
2026-05-15 20:00:25,739 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-06.md "HTTP/1.1 200 OK"
2026-05-15 20:00:26,905 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-05.md "HTTP/1.1 200 OK"
2026-05-15 20:00:26,927 - RSSFeedScraper - INFO - Total RSS/HTML results: 3
2026-05-15 20:00:32,428 - IveltScraper - INFO - Ivelt scrape complete. Checked 3 topics, found 14 new posts.
2026-05-15 20:00:32,428 - __main__ - INFO - Scraper rss completed: 3 results
2026-05-15 20:00:32,428 - __main__ - INFO - Scraper yiddish24 completed: 0 results
2026-05-15 20:00:32,428 - __main__ - INFO - Scraper ivelt completed: 14 results
2026-05-15 20:00:33,222 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-15 20:00:33.222070
2026-05-15 20:00:33,222 - __main__ - INFO - Email sent successfully
2026-05-15 20:00:33,222 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-05-15 20:00:33,222 - __main__ - INFO - Monitor complete. Found 17 total results: 3 new rss results, 14 new ivelt results.
2026-05-15 20:00:33,223 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-05-15 20:00:33,223 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-15 20:00:33,277 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-05-15 20:00:33,277 - __main__ - INFO - Closed all database connections
2026-05-15 20:00:33,280 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-15 20:00:33,280 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-05-15 20:30:02,604 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-15.log
2026-05-15 20:30:02,604 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-15.log
2026-05-15 20:30:02,604 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-15.log
2026-05-15 20:30:02,604 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-05-15 20:30:02,627 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-05-15 20:30:02,628 - social_media_monitor.config.settings - WARNING - Twitter monitoring enabled but credentials validation not implemented
2026-05-15 20:30:02,628 - __main__ - INFO - Configuration loaded and validated successfully
2026-05-15 20:30:02,630 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-05-15 20:30:02,630 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-05-15 20:30:02,854 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-05-15 20:30:02,854 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-05-15 20:30:02,856 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-05-15 20:30:02,856 - __main__ - INFO - Reddit scraper initialized and enabled
2026-05-15 20:30:02,856 - __main__ - INFO - GitHub scraper initialized and enabled
2026-05-15 20:30:02,857 - __main__ - INFO - Twitter scraper initialized and enabled
2026-05-15 20:30:02,858 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=3, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0
2026-05-15 20:30:02,858 - __main__ - INFO - LinkedIn scraper initialized and enabled
2026-05-15 20:30:02,858 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled
2026-05-15 20:30:02,864 - Yiddish24Scraper - INFO - File downloader initialized with 1 terms, prefix 'Y2', and file type organization enabled
2026-05-15 20:30:02,864 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=1, exclude_terms=0
2026-05-15 20:30:02,886 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0
2026-05-15 20:30:02,895 - TorahAnytimeScraper - INFO - File downloader initialized with 1 terms, prefix 'TA', and file type organization enabled
2026-05-15 20:30:02,896 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=1, exclude_terms=0
2026-05-15 20:30:02,900 - BatorahScraper - INFO - File downloader initialized with 1 terms, prefix 'BT', and file type organization enabled
2026-05-15 20:30:02,900 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=1, exclude_terms=0
2026-05-15 20:30:02,900 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-05-15 20:30:02,900 - __main__ - INFO - Running 5 scrapers concurrently...
2026-05-15 20:30:02,900 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit search monitoring enabled. Running search with terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-15 20:30:02,900 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['"Hermes Agent"']
2026-05-15 20:30:03,866 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term '"Hermes Agent"'
2026-05-15 20:30:03,899 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Agente de atendimento
2026-05-15 20:30:03,910 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Optimising for faster responses
2026-05-15 20:30:03,920 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Hermes Agent killed OpenClaw
2026-05-15 20:30:03,929 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: How to Pair Hermes Agent with NotebookLM: Build a Self-Improving "Seco
2026-05-15 20:30:03,943 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Claude Hermes Agent With Codex Is A Crazy AI Stack
2026-05-15 20:30:05,104 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 5
2026-05-15 20:30:05,105 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'paperclip' restricted to subreddits: ['PaperClip_AI', 'PaperclipAI']
2026-05-15 20:30:05,105 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['paperclip']
2026-05-15 20:30:05,105 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/PaperClip_AI+PaperclipAI
2026-05-15 20:30:06,190 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'paperclip'
2026-05-15 20:30:06,226 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: And i thought the universe of paperclips achievement took too long
2026-05-15 20:30:07,413 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 1
2026-05-15 20:30:07,413 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'multica' restricted to subreddits: ['hermesagent', 'HermesAI']
2026-05-15 20:30:07,413 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['multica']
2026-05-15 20:30:07,413 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/hermesagent+HermesAI
2026-05-15 20:30:08,774 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'multica'
2026-05-15 20:30:10,000 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0
2026-05-15 20:30:10,001 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit subreddit feed monitoring enabled.
2026-05-15 20:30:10,001 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'hermes_agent': r/hermesagent+HermesAI+AI_Agents+aiagents+AgentsOfAI+LocalLLaMA+AutoGPT (limit=25)
2026-05-15 20:30:10,001 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes agent via RSS
2026-05-15 20:30:12,241 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes AI via RSS
2026-05-15 20:30:14,385 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: nous research hermes via RSS
2026-05-15 20:30:16,656 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: multica via RSS
2026-05-15 20:30:19,221 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'paperclip_ai': r/PaperClip_AI+PaperclipAI+pAIperclip (limit=25)
2026-05-15 20:30:19,221 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip ai via RSS
2026-05-15 20:30:21,669 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip agent via RSS
2026-05-15 20:30:23,702 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: multica via RSS
2026-05-15 20:30:25,612 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'claude_agents': r/vibecoding (limit=25)
2026-05-15 20:30:25,612 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: multica via RSS
2026-05-15 20:30:27,690 - social_media_monitor.scrapers.reddit_scraper - INFO - Total subreddit feed results: 0
2026-05-15 20:30:27,691 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-15 20:30:27,833 - TwitterScraper - INFO - Searching Twitter/X (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-15 20:30:28,322 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'paperclip'
2026-05-15 20:30:43,452 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for '"Hermes Agent"'
2026-05-15 20:30:58,681 - TwitterScraper - INFO - Twitter/X RSS: 97 entries for 'multica'
2026-05-15 20:31:13,236 - TwitterScraper - INFO - Twitter scrape complete. Found 0 new results.
2026-05-15 20:31:13,237 - LinkedInScraper - INFO - Searching LinkedIn (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-15 20:31:13,816 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'paperclip'
2026-05-15 20:31:15,184 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for '"Hermes Agent"'
2026-05-15 20:31:15,212 - LinkedInScraper - INFO - New LinkedIn post: It’s wild to have 16 AI agents running at one time each completing dif
2026-05-15 20:31:15,303 - LinkedInScraper - INFO - New LinkedIn post: GitHub - NousResearch/hermes-agent: The agent that grows with you - Li
2026-05-15 20:31:15,341 - LinkedInScraper - INFO - New LinkedIn post: Pieces can be connected to your Nous Research Hermes Agent or your Ope
2026-05-15 20:31:15,655 - LinkedInScraper - INFO - New LinkedIn post: The three-tier memory of Hermes agent! (better than OpenClaw, 150k+ st
2026-05-15 20:31:16,586 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'multica'
2026-05-15 20:31:17,344 - LinkedInScraper - INFO - LinkedIn scrape complete. Found 4 new results.
2026-05-15 20:31:17,344 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)
2026-05-15 20:31:21,969 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-05-15 20:31:22,061 - GitHubScraper - INFO - Found 227 GitHub repositories for term: paperclip
2026-05-15 20:31:23,187 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-05-15 20:31:23,192 - GitHubScraper - INFO - Found 226 GitHub repositories for term: "Hermes Agent"
2026-05-15 20:31:24,161 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-05-15 20:31:24,164 - GitHubScraper - INFO - Found 45 GitHub repositories for term: multica
2026-05-15 20:31:24,311 - GitHubScraper - INFO - Total GitHub results found: 0
2026-05-15 20:31:24,311 - __main__ - INFO - Scraper reddit completed: 6 results
2026-05-15 20:31:24,311 - __main__ - INFO - Scraper github completed: 0 results
2026-05-15 20:31:24,311 - __main__ - INFO - Scraper twitter completed: 0 results
2026-05-15 20:31:24,311 - __main__ - INFO - Scraper linkedin completed: 4 results
2026-05-15 20:31:24,311 - __main__ - INFO - Scraper linkedin_feed completed: 0 results
2026-05-15 20:31:24,952 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-15 20:31:24.952095
2026-05-15 20:31:24,952 - __main__ - INFO - Email sent successfully
2026-05-15 20:31:24,952 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-05-15 20:31:24,952 - __main__ - INFO - Monitor complete. Found 10 total results: 6 new reddit results, 4 new linkedin results.
2026-05-15 20:31:24,952 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-05-15 20:31:24,952 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-15 20:31:25,050 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-05-15 20:31:25,050 - __main__ - INFO - Closed all database connections
2026-05-15 20:31:25,107 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-15 20:31:25,123 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-05-15 21:00:01,878 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-15.log
2026-05-15 21:00:01,879 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-15.log
2026-05-15 21:00:01,879 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-15.log
2026-05-15 21:00:01,879 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-05-15 21:00:01,906 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-05-15 21:00:01,906 - __main__ - INFO - Configuration loaded and validated successfully
2026-05-15 21:00:01,908 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-05-15 21:00:01,909 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-05-15 21:00:02,078 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-05-15 21:00:02,078 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-05-15 21:00:02,137 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-05-15 21:00:02,138 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=3, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0
2026-05-15 21:00:02,138 - __main__ - INFO - RSS scraper initialized and enabled
2026-05-15 21:00:02,162 - Yiddish24Scraper - INFO - File downloader initialized with 1 terms, prefix 'Y2', and file type organization enabled
2026-05-15 21:00:02,162 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=1, exclude_terms=0
2026-05-15 21:00:02,162 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-05-15 21:00:02,166 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0
2026-05-15 21:00:02,170 - TorahAnytimeScraper - INFO - File downloader initialized with 1 terms, prefix 'TA', and file type organization enabled
2026-05-15 21:00:02,170 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=1, exclude_terms=0
2026-05-15 21:00:02,172 - BatorahScraper - INFO - File downloader initialized with 1 terms, prefix 'BT', and file type organization enabled
2026-05-15 21:00:02,172 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=1, exclude_terms=0
2026-05-15 21:00:02,172 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-05-15 21:00:02,172 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-05-15 21:00:02,172 - __main__ - INFO - Running 3 scrapers concurrently...
2026-05-15 21:00:02,173 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-05-15 21:00:02,256 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-05-15 21:00:02,260 - IveltScraper - INFO - Loaded 178 include, 0 exclude filters from DB topic_filters
2026-05-15 21:00:02,260 - IveltScraper - INFO - Fetching ivelt.com active topics...
2026-05-15 21:00:02,261 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-05-15 21:00:02,594 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-05-15 21:00:03,020 - RSSFeedScraper - INFO - Fetching RSS feed: https://github.com/BuilderPulse/BuilderPulse/commits/main.atom
2026-05-15 21:00:03,580 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-15.md "HTTP/1.1 200 OK"
2026-05-15 21:00:04,400 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-15.md "HTTP/1.1 200 OK"
2026-05-15 21:00:05,525 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-14.md "HTTP/1.1 200 OK"
2026-05-15 21:00:06,403 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-14.md "HTTP/1.1 200 OK"
2026-05-15 21:00:07,047 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-05-15 21:00:07,296 - Yiddish24Scraper - INFO - Received response with 507667 characters
2026-05-15 21:00:07,297 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (316993 chars)
2026-05-15 21:00:07,299 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-05-15 21:00:07,370 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-05-15 21:00:07,410 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-05-15 21:00:07,411 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-05-15 21:00:08,218 - Yiddish24Scraper - INFO - Page 1 summary: 13 new out of 100 total articles
2026-05-15 21:00:08,219 - Yiddish24Scraper - INFO - Page 1: 13/100 new items
2026-05-15 21:00:08,219 - Yiddish24Scraper - INFO - Low new item ratio (13.0%), stopping pagination
2026-05-15 21:00:08,219 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 13
2026-05-15 21:00:08,414 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-13.md "HTTP/1.1 200 OK"
2026-05-15 21:00:09,231 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-13.md "HTTP/1.1 200 OK"
2026-05-15 21:00:10,391 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-12.md "HTTP/1.1 200 OK"
2026-05-15 21:00:11,235 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-12.md "HTTP/1.1 200 OK"
2026-05-15 21:00:12,390 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-11.md "HTTP/1.1 200 OK"
2026-05-15 21:00:13,237 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-11.md "HTTP/1.1 200 OK"
2026-05-15 21:00:14,029 - IveltScraper - INFO - Found 50 active topics on ivelt.com
2026-05-15 21:00:14,391 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-10.md "HTTP/1.1 200 OK"
2026-05-15 21:00:15,239 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-10.md "HTTP/1.1 200 OK"
2026-05-15 21:00:16,399 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-09.md "HTTP/1.1 200 OK"
2026-05-15 21:00:17,241 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-09.md "HTTP/1.1 200 OK"
2026-05-15 21:00:18,370 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-08.md "HTTP/1.1 200 OK"
2026-05-15 21:00:19,373 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-07.md "HTTP/1.1 200 OK"
2026-05-15 21:00:23,113 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-07.md "HTTP/1.1 200 OK"
2026-05-15 21:00:24,241 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-06.md "HTTP/1.1 200 OK"
2026-05-15 21:00:25,115 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-06.md "HTTP/1.1 200 OK"
2026-05-15 21:00:26,496 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-05.md "HTTP/1.1 200 OK"
2026-05-15 21:00:26,518 - RSSFeedScraper - INFO - Total RSS/HTML results: 22
2026-05-15 21:00:30,333 - IveltScraper - INFO - Ivelt scrape complete. Checked 4 topics, found 15 new posts.
2026-05-15 21:00:30,333 - __main__ - INFO - Scraper rss completed: 22 results
2026-05-15 21:00:30,333 - __main__ - INFO - Scraper yiddish24 completed: 13 results
2026-05-15 21:00:30,334 - __main__ - INFO - Scraper ivelt completed: 15 results
2026-05-15 21:00:31,207 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-15 21:00:31.207196
2026-05-15 21:00:31,207 - __main__ - INFO - Email sent successfully
2026-05-15 21:00:31,207 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-05-15 21:00:31,207 - __main__ - INFO - Monitor complete. Found 50 total results: 22 new rss results, 13 new yiddish24 results, 15 new ivelt results.
2026-05-15 21:00:31,208 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-05-15 21:00:31,208 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-15 21:00:31,317 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-05-15 21:00:31,317 - __main__ - INFO - Closed all database connections
2026-05-15 21:00:31,319 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-15 21:00:31,319 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-05-15 22:00:01,958 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-15.log
2026-05-15 22:00:01,958 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-15.log
2026-05-15 22:00:01,958 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-15.log
2026-05-15 22:00:01,958 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-05-15 22:00:01,983 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-05-15 22:00:01,983 - __main__ - INFO - Configuration loaded and validated successfully
2026-05-15 22:00:01,985 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-05-15 22:00:01,985 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-05-15 22:00:02,068 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-05-15 22:00:02,068 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-05-15 22:00:02,070 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-05-15 22:00:02,072 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=3, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0
2026-05-15 22:00:02,072 - __main__ - INFO - RSS scraper initialized and enabled
2026-05-15 22:00:02,077 - Yiddish24Scraper - INFO - File downloader initialized with 1 terms, prefix 'Y2', and file type organization enabled
2026-05-15 22:00:02,078 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=1, exclude_terms=0
2026-05-15 22:00:02,078 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-05-15 22:00:02,098 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0
2026-05-15 22:00:02,104 - TorahAnytimeScraper - INFO - File downloader initialized with 1 terms, prefix 'TA', and file type organization enabled
2026-05-15 22:00:02,104 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=1, exclude_terms=0
2026-05-15 22:00:02,106 - BatorahScraper - INFO - File downloader initialized with 1 terms, prefix 'BT', and file type organization enabled
2026-05-15 22:00:02,106 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=1, exclude_terms=0
2026-05-15 22:00:02,107 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-05-15 22:00:02,107 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-05-15 22:00:02,107 - __main__ - INFO - Running 3 scrapers concurrently...
2026-05-15 22:00:02,107 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-05-15 22:00:02,189 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-05-15 22:00:02,193 - IveltScraper - INFO - Loaded 178 include, 0 exclude filters from DB topic_filters
2026-05-15 22:00:02,193 - IveltScraper - INFO - Fetching ivelt.com active topics...
2026-05-15 22:00:02,194 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-05-15 22:00:02,489 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-05-15 22:00:02,856 - RSSFeedScraper - INFO - Fetching RSS feed: https://github.com/BuilderPulse/BuilderPulse/commits/main.atom
2026-05-15 22:00:03,385 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-15.md "HTTP/1.1 200 OK"
2026-05-15 22:00:04,228 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-15.md "HTTP/1.1 200 OK"
2026-05-15 22:00:05,377 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-14.md "HTTP/1.1 200 OK"
2026-05-15 22:00:06,231 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-14.md "HTTP/1.1 200 OK"
2026-05-15 22:00:06,601 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-05-15 22:00:06,841 - Yiddish24Scraper - INFO - Received response with 500516 characters
2026-05-15 22:00:06,844 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (316630 chars)
2026-05-15 22:00:06,848 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-05-15 22:00:06,928 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-05-15 22:00:06,970 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-05-15 22:00:06,970 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-05-15 22:00:07,671 - Yiddish24Scraper - INFO - Page 1 summary: 1 new out of 100 total articles
2026-05-15 22:00:07,671 - Yiddish24Scraper - INFO - Page 1: 1/100 new items
2026-05-15 22:00:07,671 - Yiddish24Scraper - INFO - Low new item ratio (1.0%), stopping pagination
2026-05-15 22:00:07,672 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 1
2026-05-15 22:00:07,809 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-13.md "HTTP/1.1 200 OK"
2026-05-15 22:00:08,685 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-13.md "HTTP/1.1 200 OK"
2026-05-15 22:00:09,809 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-12.md "HTTP/1.1 200 OK"
2026-05-15 22:00:10,687 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-12.md "HTTP/1.1 200 OK"
2026-05-15 22:00:11,820 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-11.md "HTTP/1.1 200 OK"
2026-05-15 22:00:12,688 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-11.md "HTTP/1.1 200 OK"
2026-05-15 22:00:13,810 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-10.md "HTTP/1.1 200 OK"
2026-05-15 22:00:13,920 - IveltScraper - INFO - Found 50 active topics on ivelt.com
2026-05-15 22:00:14,691 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-10.md "HTTP/1.1 200 OK"
2026-05-15 22:00:15,821 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-09.md "HTTP/1.1 200 OK"
2026-05-15 22:00:23,552 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-09.md "HTTP/1.1 200 OK"
2026-05-15 22:00:24,694 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-08.md "HTTP/1.1 200 OK"
2026-05-15 22:00:25,683 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-07.md "HTTP/1.1 200 OK"
2026-05-15 22:00:26,531 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-07.md "HTTP/1.1 200 OK"
2026-05-15 22:00:27,682 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-06.md "HTTP/1.1 200 OK"
2026-05-15 22:00:28,534 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-06.md "HTTP/1.1 200 OK"
2026-05-15 22:00:29,713 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-05.md "HTTP/1.1 200 OK"
2026-05-15 22:00:29,733 - RSSFeedScraper - INFO - Total RSS/HTML results: 3
2026-05-15 22:00:36,121 - IveltScraper - INFO - Ivelt scrape complete. Checked 4 topics, found 15 new posts.
2026-05-15 22:00:36,121 - __main__ - INFO - Scraper rss completed: 3 results
2026-05-15 22:00:36,121 - __main__ - INFO - Scraper yiddish24 completed: 1 results
2026-05-15 22:00:36,121 - __main__ - INFO - Scraper ivelt completed: 15 results
2026-05-15 22:00:36,846 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-15 22:00:36.846259
2026-05-15 22:00:36,846 - __main__ - INFO - Email sent successfully
2026-05-15 22:00:36,846 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-05-15 22:00:36,847 - __main__ - INFO - Monitor complete. Found 19 total results: 3 new rss results, 1 new yiddish24 results, 15 new ivelt results.
2026-05-15 22:00:36,847 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-05-15 22:00:36,847 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-15 22:00:36,929 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-05-15 22:00:36,929 - __main__ - INFO - Closed all database connections
2026-05-15 22:00:36,932 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-15 22:00:36,932 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-05-15 22:30:02,251 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-15.log
2026-05-15 22:30:02,252 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-15.log
2026-05-15 22:30:02,252 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-15.log
2026-05-15 22:30:02,252 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-05-15 22:30:02,275 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-05-15 22:30:02,275 - social_media_monitor.config.settings - WARNING - Twitter monitoring enabled but credentials validation not implemented
2026-05-15 22:30:02,275 - __main__ - INFO - Configuration loaded and validated successfully
2026-05-15 22:30:02,277 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-05-15 22:30:02,277 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-05-15 22:30:02,511 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-05-15 22:30:02,511 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-05-15 22:30:02,568 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-05-15 22:30:02,568 - __main__ - INFO - Reddit scraper initialized and enabled
2026-05-15 22:30:02,568 - __main__ - INFO - GitHub scraper initialized and enabled
2026-05-15 22:30:02,568 - __main__ - INFO - Twitter scraper initialized and enabled
2026-05-15 22:30:02,569 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=3, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0
2026-05-15 22:30:02,570 - __main__ - INFO - LinkedIn scraper initialized and enabled
2026-05-15 22:30:02,570 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled
2026-05-15 22:30:02,591 - Yiddish24Scraper - INFO - File downloader initialized with 1 terms, prefix 'Y2', and file type organization enabled
2026-05-15 22:30:02,591 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=1, exclude_terms=0
2026-05-15 22:30:02,596 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0
2026-05-15 22:30:02,601 - TorahAnytimeScraper - INFO - File downloader initialized with 1 terms, prefix 'TA', and file type organization enabled
2026-05-15 22:30:02,601 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=1, exclude_terms=0
2026-05-15 22:30:02,603 - BatorahScraper - INFO - File downloader initialized with 1 terms, prefix 'BT', and file type organization enabled
2026-05-15 22:30:02,603 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=1, exclude_terms=0
2026-05-15 22:30:02,603 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-05-15 22:30:02,603 - __main__ - INFO - Running 5 scrapers concurrently...
2026-05-15 22:30:02,603 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit search monitoring enabled. Running search with terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-15 22:30:02,603 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['"Hermes Agent"']
2026-05-15 22:30:03,488 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term '"Hermes Agent"'
2026-05-15 22:30:03,529 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Tomorrow I install Hermes agent. Any advice?
2026-05-15 22:30:03,545 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Problems with Openclaw on Android
2026-05-15 22:30:03,558 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Run Hermes on a VPS without Leaking your API keys
2026-05-15 22:30:03,570 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: WhatsApp Business banned
2026-05-15 22:30:03,580 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Supergrok subscription is going to be the best plan for hermes agent
2026-05-15 22:30:03,589 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Supergrok subscription is now available on hermes agent
2026-05-15 22:30:03,614 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Optimising for faster responses
2026-05-15 22:30:04,759 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 7
2026-05-15 22:30:04,760 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'paperclip' restricted to subreddits: ['PaperClip_AI', 'PaperclipAI']
2026-05-15 22:30:04,760 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['paperclip']
2026-05-15 22:30:04,760 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/PaperClip_AI+PaperclipAI
2026-05-15 22:30:05,723 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'paperclip'
2026-05-15 22:30:05,765 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Ran the numbers last night — been overpaying for AI tools for over a y
2026-05-15 22:30:05,776 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Hope you enjoy this break-y, techno, jazzy set
2026-05-15 22:30:06,941 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 2
2026-05-15 22:30:06,941 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'multica' restricted to subreddits: ['hermesagent', 'HermesAI']
2026-05-15 22:30:06,941 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['multica']
2026-05-15 22:30:06,941 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/hermesagent+HermesAI
2026-05-15 22:30:08,186 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'multica'
2026-05-15 22:30:09,455 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0
2026-05-15 22:30:09,455 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit subreddit feed monitoring enabled.
2026-05-15 22:30:09,455 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'hermes_agent': r/hermesagent+HermesAI+AI_Agents+aiagents+AgentsOfAI+LocalLLaMA+AutoGPT (limit=25)
2026-05-15 22:30:09,455 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes agent via RSS
2026-05-15 22:30:11,398 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/HFY: Arthrosauria: False Paradise (Chapter 3)
2026-05-15 22:30:12,554 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes AI via RSS
2026-05-15 22:30:15,932 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: nous research hermes via RSS
2026-05-15 22:30:20,110 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: multica via RSS
2026-05-15 22:30:22,823 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'paperclip_ai': r/PaperClip_AI+PaperclipAI+pAIperclip (limit=25)
2026-05-15 22:30:22,823 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip ai via RSS
2026-05-15 22:30:27,040 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip agent via RSS
2026-05-15 22:30:29,450 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: multica via RSS
2026-05-15 22:30:31,643 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'claude_agents': r/vibecoding (limit=25)
2026-05-15 22:30:31,643 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: multica via RSS
2026-05-15 22:30:33,973 - social_media_monitor.scrapers.reddit_scraper - INFO - Total subreddit feed results: 1
2026-05-15 22:30:33,974 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-15 22:30:34,114 - TwitterScraper - INFO - Searching Twitter/X (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-15 22:30:34,577 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'paperclip'
2026-05-15 22:30:48,676 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for '"Hermes Agent"'
2026-05-15 22:31:02,595 - TwitterScraper - INFO - Twitter/X RSS: 97 entries for 'multica'
2026-05-15 22:31:15,742 - TwitterScraper - INFO - Twitter scrape complete. Found 0 new results.
2026-05-15 22:31:15,742 - LinkedInScraper - INFO - Searching LinkedIn (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-15 22:31:16,398 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'paperclip'
2026-05-15 22:31:16,458 - LinkedInScraper - INFO - New LinkedIn post: Inclusive & thoughtful designs bring people together. We create soluti
2026-05-15 22:31:17,630 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for '"Hermes Agent"'
2026-05-15 22:31:18,916 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'multica'
2026-05-15 22:31:18,990 - LinkedInScraper - INFO - New LinkedIn post: A few weeks ago I shared how I use Claude Cowork to draft daily mornin
2026-05-15 22:31:19,393 - LinkedInScraper - INFO - New LinkedIn post: Sharon M.H. MacDonald - LinkedIn
2026-05-15 22:31:19,685 - LinkedInScraper - INFO - LinkedIn scrape complete. Found 3 new results.
2026-05-15 22:31:19,686 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)
2026-05-15 22:31:25,376 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-05-15 22:31:25,467 - GitHubScraper - INFO - Found 227 GitHub repositories for term: paperclip
2026-05-15 22:31:25,483 - GitHubScraper - INFO - Added new GitHub repository: awesome-paperclip
2026-05-15 22:31:26,473 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-05-15 22:31:26,477 - GitHubScraper - INFO - Found 228 GitHub repositories for term: "Hermes Agent"
2026-05-15 22:31:26,569 - GitHubScraper - INFO - Added new GitHub repository: hermes-war-room
2026-05-15 22:31:26,595 - GitHubScraper - INFO - Added new GitHub repository: cascadeflow
2026-05-15 22:31:26,607 - GitHubScraper - INFO - Added new GitHub repository: agent-vault
2026-05-15 22:31:27,386 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-05-15 22:31:27,390 - GitHubScraper - INFO - Found 45 GitHub repositories for term: multica
2026-05-15 22:31:27,525 - GitHubScraper - INFO - Total GitHub results found: 4
2026-05-15 22:31:27,525 - __main__ - INFO - Scraper reddit completed: 10 results
2026-05-15 22:31:27,525 - __main__ - INFO - Scraper github completed: 4 results
2026-05-15 22:31:27,525 - __main__ - INFO - Scraper twitter completed: 0 results
2026-05-15 22:31:27,525 - __main__ - INFO - Scraper linkedin completed: 3 results
2026-05-15 22:31:27,525 - __main__ - INFO - Scraper linkedin_feed completed: 0 results
2026-05-15 22:31:28,773 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-15 22:31:28.773201
2026-05-15 22:31:28,773 - __main__ - INFO - Email sent successfully
2026-05-15 22:31:28,773 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-05-15 22:31:28,773 - __main__ - INFO - Monitor complete. Found 17 total results: 10 new reddit results, 4 new github results, 3 new linkedin results.
2026-05-15 22:31:28,773 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-05-15 22:31:28,774 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-15 22:31:28,915 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-05-15 22:31:28,916 - __main__ - INFO - Closed all database connections
2026-05-15 22:31:28,969 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-15 22:31:28,986 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-05-15 23:00:01,779 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-15.log
2026-05-15 23:00:01,779 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-15.log
2026-05-15 23:00:01,779 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-15.log
2026-05-15 23:00:01,779 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-05-15 23:00:01,802 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-05-15 23:00:01,802 - __main__ - INFO - Configuration loaded and validated successfully
2026-05-15 23:00:01,804 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-05-15 23:00:01,804 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-05-15 23:00:01,945 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-05-15 23:00:01,945 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-05-15 23:00:01,947 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-05-15 23:00:01,949 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=3, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0
2026-05-15 23:00:01,949 - __main__ - INFO - RSS scraper initialized and enabled
2026-05-15 23:00:01,957 - Yiddish24Scraper - INFO - File downloader initialized with 1 terms, prefix 'Y2', and file type organization enabled
2026-05-15 23:00:01,957 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=1, exclude_terms=0
2026-05-15 23:00:01,957 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-05-15 23:00:01,982 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0
2026-05-15 23:00:01,988 - TorahAnytimeScraper - INFO - File downloader initialized with 1 terms, prefix 'TA', and file type organization enabled
2026-05-15 23:00:01,988 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=1, exclude_terms=0
2026-05-15 23:00:01,991 - BatorahScraper - INFO - File downloader initialized with 1 terms, prefix 'BT', and file type organization enabled
2026-05-15 23:00:01,991 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=1, exclude_terms=0
2026-05-15 23:00:01,991 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-05-15 23:00:01,991 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-05-15 23:00:01,991 - __main__ - INFO - Running 3 scrapers concurrently...
2026-05-15 23:00:01,991 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-05-15 23:00:02,074 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-05-15 23:00:02,078 - IveltScraper - INFO - Loaded 178 include, 0 exclude filters from DB topic_filters
2026-05-15 23:00:02,078 - IveltScraper - INFO - Fetching ivelt.com active topics...
2026-05-15 23:00:02,080 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-05-15 23:00:02,345 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-05-15 23:00:02,734 - RSSFeedScraper - INFO - Fetching RSS feed: https://github.com/BuilderPulse/BuilderPulse/commits/main.atom
2026-05-15 23:00:03,284 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-15.md "HTTP/1.1 200 OK"
2026-05-15 23:00:04,142 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-15.md "HTTP/1.1 200 OK"
2026-05-15 23:00:05,266 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-14.md "HTTP/1.1 200 OK"
2026-05-15 23:00:06,144 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-14.md "HTTP/1.1 200 OK"
2026-05-15 23:00:06,853 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-05-15 23:00:07,089 - Yiddish24Scraper - INFO - Received response with 493286 characters
2026-05-15 23:00:07,093 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (317464 chars)
2026-05-15 23:00:07,097 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-05-15 23:00:07,180 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-05-15 23:00:07,220 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-05-15 23:00:07,220 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-05-15 23:00:08,028 - Yiddish24Scraper - INFO - Page 1 summary: 7 new out of 100 total articles
2026-05-15 23:00:08,028 - Yiddish24Scraper - INFO - Page 1: 7/100 new items
2026-05-15 23:00:08,028 - Yiddish24Scraper - INFO - Low new item ratio (7.0%), stopping pagination
2026-05-15 23:00:08,029 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 7
2026-05-15 23:00:08,158 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-13.md "HTTP/1.1 200 OK"
2026-05-15 23:00:09,041 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-13.md "HTTP/1.1 200 OK"
2026-05-15 23:00:10,197 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-12.md "HTTP/1.1 200 OK"
2026-05-15 23:00:11,044 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-12.md "HTTP/1.1 200 OK"
2026-05-15 23:00:12,175 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-11.md "HTTP/1.1 200 OK"
2026-05-15 23:00:13,049 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-11.md "HTTP/1.1 200 OK"
2026-05-15 23:00:13,635 - IveltScraper - INFO - Found 50 active topics on ivelt.com
2026-05-15 23:00:14,165 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-10.md "HTTP/1.1 200 OK"
2026-05-15 23:00:15,050 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-10.md "HTTP/1.1 200 OK"
2026-05-15 23:00:16,172 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-09.md "HTTP/1.1 200 OK"
2026-05-15 23:00:18,087 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-09.md "HTTP/1.1 200 OK"
2026-05-15 23:00:19,211 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-08.md "HTTP/1.1 200 OK"
2026-05-15 23:00:20,212 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-07.md "HTTP/1.1 200 OK"
2026-05-15 23:00:21,091 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-07.md "HTTP/1.1 200 OK"
2026-05-15 23:00:22,216 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-06.md "HTTP/1.1 200 OK"
2026-05-15 23:00:23,091 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-06.md "HTTP/1.1 200 OK"
2026-05-15 23:00:24,353 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-05.md "HTTP/1.1 200 OK"
2026-05-15 23:00:24,371 - RSSFeedScraper - INFO - Total RSS/HTML results: 3
2026-05-15 23:02:59,671 - IveltScraper - ERROR - FlareSolverr error: Error: Error solving the challenge. Timeout after 120.0 seconds. (attempt 1)
2026-05-15 23:02:59,671 - IveltScraper - INFO - Retrying in 3s...
2026-05-15 23:05:04,640 - IveltScraper - ERROR - FlareSolverr error: Error: Error solving the challenge. Timeout after 120.0 seconds. (attempt 2)
2026-05-15 23:05:04,640 - IveltScraper - INFO - FlareSolverr failed, trying curl_cffi cookie fallback...
2026-05-15 23:05:04,640 - IveltScraper - WARNING - No cf_clearance cookie set — skipping curl_cffi fallback
2026-05-15 23:05:04,640 - IveltScraper - INFO - Ivelt scrape complete. Checked 8 topics, found 48 new posts.
2026-05-15 23:05:04,641 - __main__ - INFO - Scraper rss completed: 3 results
2026-05-15 23:05:04,641 - __main__ - INFO - Scraper yiddish24 completed: 7 results
2026-05-15 23:05:04,641 - __main__ - INFO - Scraper ivelt completed: 48 results
2026-05-15 23:05:05,410 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-15 23:05:05.410585
2026-05-15 23:05:05,410 - __main__ - INFO - Email sent successfully
2026-05-15 23:05:05,411 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-05-15 23:05:05,411 - __main__ - INFO - Monitor complete. Found 58 total results: 3 new rss results, 7 new yiddish24 results, 48 new ivelt results.
2026-05-15 23:05:05,411 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-05-15 23:05:05,411 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-15 23:05:05,541 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-05-15 23:05:05,541 - __main__ - INFO - Closed all database connections
2026-05-15 23:05:05,544 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-15 23:05:05,544 - social_media_monitor.database.connection - INFO - Closed 0 database connections