โ† Logs

social_media_monitor_2026-05-26.log

2026-05-26 20:00:03,062 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-05-26 20:00:03,086 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-05-26 20:00:03,086 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-05-26 20:00:03,143 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-05-26 20:00:03,148 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0
2026-05-26 20:00:03,148 - __main__ - INFO - RSS scraper initialized and enabled
2026-05-26 20:00:03,164 - Yiddish24Scraper - INFO - File downloader initialized with 30 terms, prefix 'Y2', and file type organization enabled
2026-05-26 20:00:03,164 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=30, exclude_terms=0
2026-05-26 20:00:03,164 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-05-26 20:00:03,168 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0
2026-05-26 20:00:03,172 - TorahAnytimeScraper - INFO - File downloader initialized with 51 terms, prefix 'TA', and file type organization enabled
2026-05-26 20:00:03,172 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=51, exclude_terms=3
2026-05-26 20:00:03,176 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-05-26 20:00:03,176 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0
2026-05-26 20:00:03,176 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-05-26 20:00:03,176 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-05-26 20:00:03,176 - __main__ - INFO - Running 3 scrapers concurrently...
2026-05-26 20:00:03,176 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-05-26 20:00:03,329 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-05-26 20:00:03,340 - IveltScraper - INFO - Loaded 178 include, 0 exclude filters from DB topic_filters
2026-05-26 20:00:03,340 - IveltScraper - INFO - Fetching ivelt.com active topics...
2026-05-26 20:00:03,341 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-05-26 20:00:03,691 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-05-26 20:00:04,257 - RSSFeedScraper - INFO - Total RSS/HTML results: 3
2026-05-26 20:00:07,559 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-05-26 20:00:07,744 - Yiddish24Scraper - INFO - Received response with 512206 characters
2026-05-26 20:00:07,745 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (326638 chars)
2026-05-26 20:00:07,747 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-05-26 20:00:07,829 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-05-26 20:00:07,868 - Yiddish24Scraper - INFO - Page 1 extraction: 99 successful, 1 failed out of 100 elements
2026-05-26 20:00:07,868 - Yiddish24Scraper - INFO - Parsed 99 articles from HTML on page 1
2026-05-26 20:00:08,716 - Yiddish24Scraper - INFO - Term 'ื”ื›ืœ ื‘ื›ืœ' matched in TITLE: 'ื”ื›ืœ ื‘ื›ืœ'
2026-05-26 20:00:08,716 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ื”ื›ืœ ื‘ื›ืœ
2026-05-26 20:00:09,439 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/HEU_260_260526013619.mp3
2026-05-26 20:00:10,563 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_HEU_260_260526013619.mp3 (6.6 MB)
2026-05-26 20:00:10,563 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-05-26 20:00:10,572 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_HEU_260_260526013619.mp3: title, artist, album, comment, source_url, genre, publisher
2026-05-26 20:00:11,474 - Yiddish24Scraper - INFO - Page 1 summary: 5 new out of 99 total articles
2026-05-26 20:00:11,474 - Yiddish24Scraper - INFO - Page 1: 5/99 new items
2026-05-26 20:00:11,474 - Yiddish24Scraper - INFO - Low new item ratio (5.1%), stopping pagination
2026-05-26 20:00:11,474 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 5
2026-05-26 20:00:14,977 - IveltScraper - INFO - Found 50 active topics on ivelt.com
2026-05-26 20:00:27,517 - IveltScraper - INFO - Ivelt scrape complete. Checked 3 topics, found 15 new posts.
2026-05-26 20:00:27,518 - __main__ - INFO - Scraper rss completed: 3 results
2026-05-26 20:00:27,518 - __main__ - INFO - Scraper yiddish24 completed: 5 results
2026-05-26 20:00:27,518 - __main__ - INFO - Scraper ivelt completed: 15 results
2026-05-26 20:00:28,770 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-26 20:00:28.769964
2026-05-26 20:00:28,770 - __main__ - INFO - Email sent successfully
2026-05-26 20:00:28,770 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-05-26 20:00:28,770 - __main__ - INFO - Monitor complete. Found 23 total results: 3 new rss results, 5 new yiddish24 results, 15 new ivelt results.
2026-05-26 20:00:28,771 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-05-26 20:00:28,771 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-26 20:00:28,854 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-05-26 20:00:28,854 - __main__ - INFO - Closed all database connections
2026-05-26 20:00:28,856 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-26 20:00:28,856 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-05-26 20:30:03,075 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-26.log
2026-05-26 20:30:03,078 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-26.log
2026-05-26 20:30:03,078 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-26.log
2026-05-26 20:30:03,078 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-05-26 20:30:03,110 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-05-26 20:30:03,111 - social_media_monitor.config.settings - WARNING - Twitter monitoring enabled but credentials validation not implemented
2026-05-26 20:30:03,111 - __main__ - INFO - Configuration loaded and validated successfully
2026-05-26 20:30:03,119 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-05-26 20:30:03,125 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-05-26 20:30:03,157 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-05-26 20:30:03,157 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-05-26 20:30:03,159 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-05-26 20:30:03,159 - __main__ - INFO - Reddit scraper initialized and enabled
2026-05-26 20:30:03,159 - __main__ - INFO - GitHub scraper initialized and enabled
2026-05-26 20:30:03,159 - __main__ - INFO - Twitter scraper initialized and enabled
2026-05-26 20:30:03,160 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0
2026-05-26 20:30:03,160 - __main__ - INFO - LinkedIn scraper initialized and enabled
2026-05-26 20:30:03,160 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled
2026-05-26 20:30:03,163 - Yiddish24Scraper - INFO - File downloader initialized with 30 terms, prefix 'Y2', and file type organization enabled
2026-05-26 20:30:03,163 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=30, exclude_terms=0
2026-05-26 20:30:03,174 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0
2026-05-26 20:30:03,179 - TorahAnytimeScraper - INFO - File downloader initialized with 51 terms, prefix 'TA', and file type organization enabled
2026-05-26 20:30:03,180 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=51, exclude_terms=3
2026-05-26 20:30:03,182 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-05-26 20:30:03,182 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0
2026-05-26 20:30:03,182 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-05-26 20:30:03,182 - __main__ - INFO - Running 5 scrapers concurrently...
2026-05-26 20:30:03,182 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit search monitoring enabled. Running search with terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-26 20:30:03,182 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['"Hermes Agent"']
2026-05-26 20:30:04,109 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term '"Hermes Agent"'
2026-05-26 20:30:04,155 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Hermes Agent AI Use Case: Self-Improving LLM Wiki Second Brain
2026-05-26 20:30:04,169 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Hermes Agent AI Use Case: Smart Home Control via Home Assistant
2026-05-26 20:30:04,182 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Hermes Agent AI Use Case: Plane.so Ticket Triage and Documentation
2026-05-26 20:30:04,200 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Hermes Agent AI Use Case: Voice-First Fitness Coach That Learns Your B
2026-05-26 20:30:04,213 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Hermes Agent AI Use Case: Project Manager Agent for ADHD with Morning
2026-05-26 20:30:04,223 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Welcome everyone who's checking out Hermes Agent from... other agents!
2026-05-26 20:30:04,237 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: I turned my Raspberry Pi into a local AI-powered setup and I'm absolut
2026-05-26 20:30:04,249 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Hermes Agent memory tip: Cron scheduling without the stale context tra
2026-05-26 20:30:04,265 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: ๐Ÿ‘‹Welcome to r/hermesagentbuilders - Introduce Yourself and Read First!
2026-05-26 20:30:05,359 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 9
2026-05-26 20:30:05,360 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'paperclip' restricted to subreddits: ['PaperClip_AI', 'PaperclipAI']
2026-05-26 20:30:05,360 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['paperclip']
2026-05-26 20:30:05,360 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/PaperClip_AI+PaperclipAI
2026-05-26 20:30:06,253 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'paperclip'
2026-05-26 20:30:07,507 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0
2026-05-26 20:30:07,507 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'multica' restricted to subreddits: ['hermesagent', 'HermesAI']
2026-05-26 20:30:07,507 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['multica']
2026-05-26 20:30:07,507 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/hermesagent+HermesAI
2026-05-26 20:30:08,416 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'multica'
2026-05-26 20:30:09,814 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0
2026-05-26 20:30:09,814 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit subreddit feed monitoring enabled.
2026-05-26 20:30:09,814 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'hermes_agent': r/hermesagent+HermesAI+AI_Agents+aiagents+AgentsOfAI+LocalLLaMA+AutoGPT (limit=25)
2026-05-26 20:30:09,814 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes agent via RSS
2026-05-26 20:30:10,619 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/LocalLLaMA: Fast little local memory retriever for Hermes
2026-05-26 20:30:10,670 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/micro_saas: Nobody cares that you can ship fast. The real "boss fight" is DISTRIBU
2026-05-26 20:30:10,687 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/ClaudeCode: Just published my first AI project an Obsidian second brain
2026-05-26 20:30:10,706 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/aiagents: I found a way for Ollama uses to get better Memory yet cheaper alterna
2026-05-26 20:30:10,721 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/AgentiaNet: I was manually copy-pasting messages between my AI agent and my friend
2026-05-26 20:30:10,732 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/vibecoding: claude โ†’ hermes โ†’ codex: stopped re-explaining the same project to eve
2026-05-26 20:30:10,741 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/ollama: I found a way for Ollama uses to get better Memory yet cheaper alterna
2026-05-26 20:30:11,760 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes AI via RSS
2026-05-26 20:30:12,674 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/hermesagent: New unlimited compute plan for Hermes in testing
2026-05-26 20:30:13,695 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: nous research hermes via RSS
2026-05-26 20:30:15,913 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: multica via RSS
2026-05-26 20:30:17,882 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'paperclip_ai': r/PaperClip_AI+PaperclipAI+pAIperclip (limit=25)
2026-05-26 20:30:17,882 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip ai via RSS
2026-05-26 20:30:20,018 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip agent via RSS
2026-05-26 20:30:22,006 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: multica via RSS
2026-05-26 20:30:23,879 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'claude_agents': r/vibecoding (limit=25)
2026-05-26 20:30:23,880 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: multica via RSS
2026-05-26 20:30:25,951 - social_media_monitor.scrapers.reddit_scraper - INFO - Total subreddit feed results: 8
2026-05-26 20:30:25,952 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-26 20:30:26,123 - TwitterScraper - INFO - Searching Twitter/X (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-26 20:30:26,558 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'paperclip'
2026-05-26 20:30:41,165 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for '"Hermes Agent"'
2026-05-26 20:30:54,677 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'multica'
2026-05-26 20:31:06,742 - TwitterScraper - INFO - Twitter scrape complete. Found 0 new results.
2026-05-26 20:31:06,742 - LinkedInScraper - INFO - Searching LinkedIn (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-26 20:31:07,345 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'paperclip'
2026-05-26 20:31:08,643 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for '"Hermes Agent"'
2026-05-26 20:31:10,137 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'multica'
2026-05-26 20:31:10,914 - LinkedInScraper - INFO - LinkedIn scrape complete. Found 0 new results.
2026-05-26 20:31:10,915 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)
2026-05-26 20:31:15,889 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-05-26 20:31:15,914 - GitHubScraper - INFO - Found 232 GitHub repositories for term: paperclip
2026-05-26 20:31:17,434 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-05-26 20:31:17,529 - GitHubScraper - INFO - Found 286 GitHub repositories for term: "Hermes Agent"
2026-05-26 20:31:18,753 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-05-26 20:31:18,755 - GitHubScraper - INFO - Found 49 GitHub repositories for term: multica
2026-05-26 20:31:18,917 - GitHubScraper - INFO - Total GitHub results found: 0
2026-05-26 20:31:18,917 - __main__ - INFO - Scraper reddit completed: 17 results
2026-05-26 20:31:18,917 - __main__ - INFO - Scraper github completed: 0 results
2026-05-26 20:31:18,917 - __main__ - INFO - Scraper twitter completed: 0 results
2026-05-26 20:31:18,917 - __main__ - INFO - Scraper linkedin completed: 0 results
2026-05-26 20:31:18,917 - __main__ - INFO - Scraper linkedin_feed completed: 0 results
2026-05-26 20:31:19,817 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-26 20:31:19.817699
2026-05-26 20:31:19,817 - __main__ - INFO - Email sent successfully
2026-05-26 20:31:19,818 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-05-26 20:31:19,818 - __main__ - INFO - Monitor complete. Found 17 total results: 17 new reddit results.
2026-05-26 20:31:19,818 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-05-26 20:31:19,818 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-26 20:31:19,918 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-05-26 20:31:19,918 - __main__ - INFO - Closed all database connections
2026-05-26 20:31:19,941 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-26 20:31:19,957 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-05-26 21:00:02,096 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-26.log
2026-05-26 21:00:02,097 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-26.log
2026-05-26 21:00:02,097 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-26.log
2026-05-26 21:00:02,097 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-05-26 21:00:02,123 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-05-26 21:00:02,124 - __main__ - INFO - Configuration loaded and validated successfully
2026-05-26 21:00:02,126 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-05-26 21:00:02,127 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-05-26 21:00:02,173 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-05-26 21:00:02,173 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-05-26 21:00:02,175 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-05-26 21:00:02,175 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0
2026-05-26 21:00:02,175 - __main__ - INFO - RSS scraper initialized and enabled
2026-05-26 21:00:02,178 - Yiddish24Scraper - INFO - File downloader initialized with 30 terms, prefix 'Y2', and file type organization enabled
2026-05-26 21:00:02,178 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=30, exclude_terms=0
2026-05-26 21:00:02,178 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-05-26 21:00:02,193 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0
2026-05-26 21:00:02,199 - TorahAnytimeScraper - INFO - File downloader initialized with 51 terms, prefix 'TA', and file type organization enabled
2026-05-26 21:00:02,200 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=51, exclude_terms=3
2026-05-26 21:00:02,202 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-05-26 21:00:02,202 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0
2026-05-26 21:00:02,202 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-05-26 21:00:02,202 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-05-26 21:00:02,202 - __main__ - INFO - Running 3 scrapers concurrently...
2026-05-26 21:00:02,202 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-05-26 21:00:02,285 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-05-26 21:00:02,292 - IveltScraper - INFO - Loaded 178 include, 0 exclude filters from DB topic_filters
2026-05-26 21:00:02,292 - IveltScraper - INFO - Fetching ivelt.com active topics...
2026-05-26 21:00:02,294 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-05-26 21:00:02,662 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-05-26 21:00:03,182 - RSSFeedScraper - INFO - Total RSS/HTML results: 3
2026-05-26 21:00:06,998 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-05-26 21:00:07,178 - Yiddish24Scraper - INFO - Received response with 513428 characters
2026-05-26 21:00:07,179 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (325722 chars)
2026-05-26 21:00:07,180 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-05-26 21:00:07,257 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-05-26 21:00:07,297 - Yiddish24Scraper - INFO - Page 1 extraction: 99 successful, 1 failed out of 100 elements
2026-05-26 21:00:07,298 - Yiddish24Scraper - INFO - Parsed 99 articles from HTML on page 1
2026-05-26 21:00:07,328 - Yiddish24Scraper - INFO - Term 'ื”ื›ืœ ื‘ื›ืœ' matched in TITLE: 'ื”ื›ืœ ื‘ื›ืœ'
2026-05-26 21:00:07,329 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ื”ื›ืœ ื‘ื›ืœ
2026-05-26 21:00:07,829 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/154__What_is_therapy_260_260526014402.mp3
2026-05-26 21:00:08,314 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_154__What_is_therapy_260_260526014402.mp3 (39.9 MB)
2026-05-26 21:00:08,315 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-05-26 21:00:08,337 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_154__What_is_therapy_260_260526014402.mp3: title, artist, album, comment, source_url, genre, publisher
2026-05-26 21:00:08,354 - Yiddish24Scraper - INFO - Term 'ื”ืจื‘' matched in DESCRIPTION: 'ื”ืจื‘ ืžืฉื” ืืœื™ืžืœืš ืฉื˜ืขืจืŸ, ืœืื ื“ืืŸ'
2026-05-26 21:00:08,354 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ืื™ื ื˜ืขืจื•ื•ื™ื•: ื“ื™ ืฆื™ื•ืŸ ืคื•ืŸ ื”ืจื”"ืง ืจื‘ื™ ื™ื•ื“ืืœืข ื“ืฉื™ืงื•ื‘ืขืจ
2026-05-26 21:00:08,855 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/KM_N114_289_1779826961.mp3
2026-05-26 21:00:08,943 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_KM_N114_289_1779826961.mp3 (3.7 MB)
2026-05-26 21:00:08,943 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-05-26 21:00:08,947 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_KM_N114_289_1779826961.mp3: title, artist, album, comment, source_url, genre, publisher
2026-05-26 21:00:08,960 - Yiddish24Scraper - INFO - Term 'ื”ืจื‘' matched in DESCRIPTION: 'ื”ืจื‘ ื—ื™ื™ื ืžืื™ืจ ืœื•ื™ื‘ืขืจ / ื“ื•ืงืœื ืจื‘'
2026-05-26 21:00:08,960 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ืื™ื ื˜ืขืจื•ื•ื™ื•: "ื”ึฒืœื•ึนื ื–ึถื” ืื•ึผื“ ืžึปืฆึธึผืœ ืžึตืึตืฉืโ โ€, ืคืืจื’
2026-05-26 21:00:09,855 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/KM_N114_290_1779826935.mp3
2026-05-26 21:00:10,078 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_KM_N114_290_1779826935.mp3 (11.5 MB)
2026-05-26 21:00:10,078 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-05-26 21:00:10,083 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_KM_N114_290_1779826935.mp3: title, artist, album, comment, source_url, genre, publisher
2026-05-26 21:00:10,095 - Yiddish24Scraper - INFO - Term 'ื”ืจื‘' matched in DESCRIPTION: 'ื”ืจื‘ ืฆื“ื•ืง ื”ืืคืžืืŸ'
2026-05-26 21:00:10,095 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ืื™ื ื˜ืขืจื•ื•ื™ื•: ื™' ืกื™ื•ืŸ, ื ืกืคืขืฆื™ืขืœืข ื™ื•ื ืกื’ื•ืœื”, ื ื’ืขืฉื™ื›
2026-05-26 21:00:10,855 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/KM_N114_288_1779826905.mp3
2026-05-26 21:00:10,931 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_KM_N114_288_1779826905.mp3 (2.3 MB)
2026-05-26 21:00:10,932 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-05-26 21:00:10,934 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_KM_N114_288_1779826905.mp3: title, artist, album, comment, source_url, genre, publisher
2026-05-26 21:00:10,947 - Yiddish24Scraper - INFO - Term 'ื”ืจื‘' matched in DESCRIPTION: 'ื”ืจื‘ ื™ื—ื–ืงืืœ ื˜ืขื ืขื ื‘ื•ื™ื, ืžื™ืœื™ื˜ืขืจื™ืฉืข ื˜ืฉืืคืœืขืŸ'
2026-05-26 21:00:10,947 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ืื™ื ื˜ืขืจื•ื•ื™ื•: ื“ืขืจ ืžื™ืœื™ื˜ืขืจื™ืฉืข ื˜ืฉืฉืืคืœืขืŸ ืื™ืŸ ืžืขืจืœื™ืœืขื ื“
2026-05-26 21:00:11,855 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/KM_N114_287_1779826877.mp3
2026-05-26 21:00:11,946 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_KM_N114_287_1779826877.mp3 (728.4 KB)
2026-05-26 21:00:11,946 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-05-26 21:00:11,948 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_KM_N114_287_1779826877.mp3: title, artist, album, comment, source_url, genre, publisher
2026-05-26 21:00:11,957 - Yiddish24Scraper - INFO - Term 'ื”ืจื‘' matched in DESCRIPTION: 'ื”ืจื‘ ืื‘ืจื”ื ืจื™ื™ื›ืžืืŸ'
2026-05-26 21:00:11,957 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ืื™ื ื˜ืขืจื•ื•ื™ื•: ื•ื•ื™ ื”ืืœื˜ืขืก ืžื™ื˜ ื“ื™ ืคืืจื”ืื ื“ืœื•ื ื’ืขืŸ ืฆื•ื•ื™ืฉืŸ
2026-05-26 21:00:12,855 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/KM_N114_286_1779826847.mp3
2026-05-26 21:00:12,906 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_KM_N114_286_1779826847.mp3 (1.5 MB)
2026-05-26 21:00:12,907 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-05-26 21:00:12,908 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_KM_N114_286_1779826847.mp3: title, artist, album, comment, source_url, genre, publisher
2026-05-26 21:00:13,825 - Yiddish24Scraper - INFO - Page 1 summary: 7 new out of 99 total articles
2026-05-26 21:00:13,826 - Yiddish24Scraper - INFO - Page 1: 7/99 new items
2026-05-26 21:00:13,826 - Yiddish24Scraper - INFO - Low new item ratio (7.1%), stopping pagination
2026-05-26 21:00:13,827 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 7
2026-05-26 21:00:14,235 - IveltScraper - INFO - Found 50 active topics on ivelt.com
2026-05-26 21:00:25,752 - IveltScraper - INFO - Ivelt scrape complete. Checked 2 topics, found 10 new posts.
2026-05-26 21:00:25,752 - __main__ - INFO - Scraper rss completed: 3 results
2026-05-26 21:00:25,752 - __main__ - INFO - Scraper yiddish24 completed: 7 results
2026-05-26 21:00:25,752 - __main__ - INFO - Scraper ivelt completed: 10 results
2026-05-26 21:00:26,423 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-26 21:00:26.423065
2026-05-26 21:00:26,423 - __main__ - INFO - Email sent successfully
2026-05-26 21:00:26,423 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-05-26 21:00:26,423 - __main__ - INFO - Monitor complete. Found 20 total results: 3 new rss results, 7 new yiddish24 results, 10 new ivelt results.
2026-05-26 21:00:26,423 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-05-26 21:00:26,423 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-26 21:00:26,613 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-05-26 21:00:26,613 - __main__ - INFO - Closed all database connections
2026-05-26 21:00:26,615 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-26 21:00:26,615 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-05-26 22:00:02,629 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-26.log
2026-05-26 22:00:02,637 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-26.log
2026-05-26 22:00:02,637 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-26.log
2026-05-26 22:00:02,638 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-05-26 22:00:02,665 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-05-26 22:00:02,665 - __main__ - INFO - Configuration loaded and validated successfully
2026-05-26 22:00:02,676 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-05-26 22:00:02,685 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-05-26 22:00:02,767 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-05-26 22:00:02,767 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-05-26 22:00:02,811 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-05-26 22:00:02,815 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0
2026-05-26 22:00:02,815 - __main__ - INFO - RSS scraper initialized and enabled
2026-05-26 22:00:02,836 - Yiddish24Scraper - INFO - File downloader initialized with 30 terms, prefix 'Y2', and file type organization enabled
2026-05-26 22:00:02,836 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=30, exclude_terms=0
2026-05-26 22:00:02,836 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-05-26 22:00:02,838 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0
2026-05-26 22:00:02,843 - TorahAnytimeScraper - INFO - File downloader initialized with 51 terms, prefix 'TA', and file type organization enabled
2026-05-26 22:00:02,843 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=51, exclude_terms=3
2026-05-26 22:00:02,845 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-05-26 22:00:02,845 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0
2026-05-26 22:00:02,845 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-05-26 22:00:02,845 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-05-26 22:00:02,847 - __main__ - INFO - Running 3 scrapers concurrently...
2026-05-26 22:00:02,847 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-05-26 22:00:02,983 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-05-26 22:00:02,992 - IveltScraper - INFO - Loaded 178 include, 0 exclude filters from DB topic_filters
2026-05-26 22:00:02,992 - IveltScraper - INFO - Fetching ivelt.com active topics...
2026-05-26 22:00:02,994 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-05-26 22:00:03,662 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-05-26 22:00:04,112 - RSSFeedScraper - INFO - Total RSS/HTML results: 4
2026-05-26 22:00:12,465 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-05-26 22:00:12,646 - Yiddish24Scraper - INFO - Received response with 500784 characters
2026-05-26 22:00:12,647 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (320387 chars)
2026-05-26 22:00:12,650 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-05-26 22:00:12,730 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-05-26 22:00:12,778 - Yiddish24Scraper - INFO - Page 1 extraction: 99 successful, 1 failed out of 100 elements
2026-05-26 22:00:12,778 - Yiddish24Scraper - INFO - Parsed 99 articles from HTML on page 1
2026-05-26 22:00:12,799 - Yiddish24Scraper - INFO - Term 'ืฉืžืขืœืฆืขืจ' matched in TITLE: 'ืžื•ื–ื™ืง ืฉืžื•ืขืก: ืจ' ื•ื•ืขืœื•ื•ืœ ืฉืžืขืœืฆืขืจ, ืจ' ืืœื™ืžืœืš ื ื™ื™ืžืืŸ ืื•ืŸ ืจ' ืฉืžื•ืืœื™'
2026-05-26 22:00:12,799 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ืžื•ื–ื™ืง ืฉืžื•ืขืก: ืจ' ื•ื•ืขืœื•ื•ืœ ืฉืžืขืœืฆืขืจ, ืจ' ืืœื™ืžืœืš ื ื™ื™ืžืืŸ
2026-05-26 22:00:13,596 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/Music_nusoi_3_135_260526055938.wav
2026-05-26 22:00:15,943 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_Music_nusoi_3_135_260526055938.wav (53.1 MB)
2026-05-26 22:00:15,949 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/x-wav)
2026-05-26 22:00:15,990 - Yiddish24Scraper - INFO - Term 'ื”ื›ืœ ื‘ื›ืœ' matched in TITLE: 'ื”ื›ืœ ื‘ื›ืœ'
2026-05-26 22:00:15,990 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ื”ื›ืœ ื‘ื›ืœ
2026-05-26 22:00:16,491 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/tus_dsdfghjesv250pbgmmusicm_260_260526055919.mp3
2026-05-26 22:00:17,967 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_tus_dsdfghjesv250pbgmmusicm_260_260526055919.mp3 (20.1 MB)
2026-05-26 22:00:17,969 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-05-26 22:00:17,993 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_tus_dsdfghjesv250pbgmmusicm_260_260526055919.mp3: title, artist, album, comment, source_url, genre, publisher
2026-05-26 22:00:18,013 - Yiddish24Scraper - INFO - Term 'ื”ืจื‘' matched in DESCRIPTION: 'ื”ืจื‘ ื™ื•ืฉืข ื”ืขืฉื™ืœ ื”ื™ื™ืžืืŸ'
2026-05-26 22:00:18,013 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ืื™ื ื˜ืขืจื•ื•ื™ื•: ื ืคืจื™ืฉืข ื—ืœื•ื ืื™ื– ื“ื™ ื’ืขืฉืคืจืขืš ืคื•ืŸ ื˜ืื’ ืื™
2026-05-26 22:00:18,513 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/KM_N114_291_1779831883.mp3
2026-05-26 22:00:19,367 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_KM_N114_291_1779831883.mp3 (923.2 KB)
2026-05-26 22:00:19,368 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-05-26 22:00:19,370 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_KM_N114_291_1779831883.mp3: title, artist, album, comment, source_url, genre, publisher
2026-05-26 22:00:19,382 - Yiddish24Scraper - INFO - Term 'ื”ื›ืœ ื‘ื›ืœ' matched in TITLE: 'ื”ื›ืœ ื‘ื›ืœ'
2026-05-26 22:00:19,383 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ื”ื›ืœ ื‘ื›ืœ
2026-05-26 22:00:19,883 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/_________________260_260526015448.mp3
2026-05-26 22:00:20,013 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2__________________260_260526015448.mp3 (10.5 MB)
2026-05-26 22:00:20,015 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-05-26 22:00:20,021 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2__________________260_260526015448.mp3: title, artist, album, comment, source_url, genre, publisher
2026-05-26 22:00:20,036 - Yiddish24Scraper - INFO - Term 'ื”ื›ืœ ื‘ื›ืœ' matched in TITLE: 'ื”ื›ืœ ื‘ื›ืœ'
2026-05-26 22:00:20,036 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ื”ื›ืœ ื‘ื›ืœ
2026-05-26 22:00:20,883 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/local_tus_sdfgesv250pbgmmusicm_260_260526055838.mp3
2026-05-26 22:00:21,924 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_local_tus_sdfgesv250pbgmmusicm_260_260526055838.mp3 (4.2 MB)
2026-05-26 22:00:21,925 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-05-26 22:00:21,929 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_local_tus_sdfgesv250pbgmmusicm_260_260526055838.mp3: title, artist, album, comment, source_url, genre, publisher
2026-05-26 22:00:21,985 - Yiddish24Scraper - INFO - Term 'ื”ื›ืœ ื‘ื›ืœ' matched in TITLE: 'ื”ื›ืœ ื‘ื›ืœ'
2026-05-26 22:00:21,985 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ื”ื›ืœ ื‘ื›ืœ
2026-05-26 22:00:22,485 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/052626_yid_260_260526055713.mp3
2026-05-26 22:00:25,839 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_052626_yid_260_260526055713.mp3 (95.4 MB)
2026-05-26 22:00:25,847 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-05-26 22:00:25,848 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_052626_yid_260_260526055713.mp3: title, artist, album, comment, source_url, genre, publisher
2026-05-26 22:00:26,866 - Yiddish24Scraper - INFO - Page 1 summary: 12 new out of 99 total articles
2026-05-26 22:00:26,866 - Yiddish24Scraper - INFO - Page 1: 12/99 new items
2026-05-26 22:00:26,866 - Yiddish24Scraper - INFO - Low new item ratio (12.1%), stopping pagination
2026-05-26 22:00:26,867 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 12
2026-05-26 22:00:26,870 - IveltScraper - INFO - Found 50 active topics on ivelt.com
2026-05-26 22:00:39,133 - IveltScraper - INFO - Ivelt scrape complete. Checked 3 topics, found 20 new posts.
2026-05-26 22:00:39,134 - __main__ - INFO - Scraper rss completed: 4 results
2026-05-26 22:00:39,134 - __main__ - INFO - Scraper yiddish24 completed: 12 results
2026-05-26 22:00:39,134 - __main__ - INFO - Scraper ivelt completed: 20 results
2026-05-26 22:00:39,797 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-26 22:00:39.797497
2026-05-26 22:00:39,797 - __main__ - INFO - Email sent successfully
2026-05-26 22:00:39,799 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-05-26 22:00:39,799 - __main__ - INFO - Monitor complete. Found 36 total results: 4 new rss results, 12 new yiddish24 results, 20 new ivelt results.
2026-05-26 22:00:39,799 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-05-26 22:00:39,799 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-26 22:00:39,929 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-05-26 22:00:39,929 - __main__ - INFO - Closed all database connections
2026-05-26 22:00:39,931 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-26 22:00:39,931 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-05-26 22:32:14,637 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-26.log
2026-05-26 22:32:14,641 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-26.log
2026-05-26 22:32:14,641 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-26.log
2026-05-26 22:32:14,641 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-05-26 22:32:14,666 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-05-26 22:32:14,666 - social_media_monitor.config.settings - WARNING - Twitter monitoring enabled but credentials validation not implemented
2026-05-26 22:32:14,666 - __main__ - INFO - Configuration loaded and validated successfully
2026-05-26 22:32:14,677 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-05-26 22:32:14,682 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-05-26 22:32:14,750 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-05-26 22:32:14,750 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-05-26 22:32:14,751 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-05-26 22:32:14,751 - __main__ - INFO - Reddit scraper initialized and enabled
2026-05-26 22:32:14,751 - __main__ - INFO - GitHub scraper initialized and enabled
2026-05-26 22:32:14,751 - __main__ - INFO - Twitter scraper initialized and enabled
2026-05-26 22:32:14,755 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0
2026-05-26 22:32:14,755 - __main__ - INFO - LinkedIn scraper initialized and enabled
2026-05-26 22:32:14,755 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled
2026-05-26 22:32:14,759 - Yiddish24Scraper - INFO - File downloader initialized with 30 terms, prefix 'Y2', and file type organization enabled
2026-05-26 22:32:14,759 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=30, exclude_terms=0
2026-05-26 22:32:14,780 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0
2026-05-26 22:32:14,784 - TorahAnytimeScraper - INFO - File downloader initialized with 51 terms, prefix 'TA', and file type organization enabled
2026-05-26 22:32:14,784 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=51, exclude_terms=3
2026-05-26 22:32:14,787 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-05-26 22:32:14,787 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0
2026-05-26 22:32:14,787 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-05-26 22:32:14,787 - __main__ - INFO - Running 5 scrapers concurrently...
2026-05-26 22:32:14,788 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit search monitoring enabled. Running search with terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-26 22:32:14,788 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['"Hermes Agent"']
2026-05-26 22:32:15,606 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term '"Hermes Agent"'
2026-05-26 22:32:15,718 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Hermes Agent model routing guide: Cron scheduling without the stronges
2026-05-26 22:32:15,731 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: How the AI V-tuber "Neuro-Sama" plays games.
2026-05-26 22:32:15,755 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: What are ppl using for local coding instead of Haiku and Opus
2026-05-26 22:32:15,770 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Hermes in Docker: best way to handle all the "should be built-in" depe
2026-05-26 22:32:15,782 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: My Hermes cannot access to certain platform.....help
2026-05-26 22:32:17,003 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 5
2026-05-26 22:32:17,003 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'paperclip' restricted to subreddits: ['PaperClip_AI', 'PaperclipAI']
2026-05-26 22:32:17,003 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['paperclip']
2026-05-26 22:32:17,003 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/PaperClip_AI+PaperclipAI
2026-05-26 22:32:17,858 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'paperclip'
2026-05-26 22:32:17,916 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: [US] Messika Move style paper clip earrings 18K natural diamond from L
2026-05-26 22:32:19,114 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 1
2026-05-26 22:32:19,115 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'multica' restricted to subreddits: ['hermesagent', 'HermesAI']
2026-05-26 22:32:19,115 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['multica']
2026-05-26 22:32:19,115 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/hermesagent+HermesAI
2026-05-26 22:32:19,935 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'multica'
2026-05-26 22:32:21,239 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0
2026-05-26 22:32:21,239 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit subreddit feed monitoring enabled.
2026-05-26 22:32:21,240 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'hermes_agent': r/hermesagent+HermesAI+AI_Agents+aiagents+AgentsOfAI+LocalLLaMA+AutoGPT (limit=25)
2026-05-26 22:32:21,240 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes agent via RSS
2026-05-26 22:32:22,102 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/AI_Agents: Best AI Agent Setup - Hermes + Deepseek-v4-flash? (May 2026)
2026-05-26 22:32:22,115 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/EmsisFeed: ECC v2.0: Elevating Agentic Work with Versatile Operator Systems and O
2026-05-26 22:32:22,129 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/MercuryInstall: Mercury Agent install note: Mercury skill batching without the setup-o
2026-05-26 22:32:23,276 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes AI via RSS
2026-05-26 22:32:25,209 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: nous research hermes via RSS
2026-05-26 22:32:27,533 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: multica via RSS
2026-05-26 22:32:29,485 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'paperclip_ai': r/PaperClip_AI+PaperclipAI+pAIperclip (limit=25)
2026-05-26 22:32:29,485 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip ai via RSS
2026-05-26 22:32:31,786 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip agent via RSS
2026-05-26 22:32:33,747 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: multica via RSS
2026-05-26 22:32:35,617 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'claude_agents': r/vibecoding (limit=25)
2026-05-26 22:32:35,617 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: multica via RSS
2026-05-26 22:32:37,611 - social_media_monitor.scrapers.reddit_scraper - INFO - Total subreddit feed results: 3
2026-05-26 22:32:37,611 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-26 22:32:37,780 - TwitterScraper - INFO - Searching Twitter/X (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-26 22:32:38,226 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'paperclip'
2026-05-26 22:32:52,436 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for '"Hermes Agent"'
2026-05-26 22:33:06,988 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'multica'
2026-05-26 22:33:20,250 - TwitterScraper - INFO - Twitter scrape complete. Found 0 new results.
2026-05-26 22:33:20,250 - LinkedInScraper - INFO - Searching LinkedIn (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-26 22:33:20,824 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'paperclip'
2026-05-26 22:33:22,142 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for '"Hermes Agent"'
2026-05-26 22:33:23,433 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'multica'
2026-05-26 22:33:24,215 - LinkedInScraper - INFO - LinkedIn scrape complete. Found 0 new results.
2026-05-26 22:33:24,216 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)
2026-05-26 22:33:30,253 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-05-26 22:33:30,348 - GitHubScraper - INFO - Found 232 GitHub repositories for term: paperclip
2026-05-26 22:33:31,552 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-05-26 22:33:31,646 - GitHubScraper - INFO - Found 286 GitHub repositories for term: "Hermes Agent"
2026-05-26 22:33:32,883 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-05-26 22:33:32,885 - GitHubScraper - INFO - Found 49 GitHub repositories for term: multica
2026-05-26 22:33:33,073 - GitHubScraper - INFO - Total GitHub results found: 0
2026-05-26 22:33:33,073 - __main__ - INFO - Scraper reddit completed: 9 results
2026-05-26 22:33:33,073 - __main__ - INFO - Scraper github completed: 0 results
2026-05-26 22:33:33,073 - __main__ - INFO - Scraper twitter completed: 0 results
2026-05-26 22:33:33,073 - __main__ - INFO - Scraper linkedin completed: 0 results
2026-05-26 22:33:33,073 - __main__ - INFO - Scraper linkedin_feed completed: 0 results
2026-05-26 22:33:34,421 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-26 22:33:34.421815
2026-05-26 22:33:34,422 - __main__ - INFO - Email sent successfully
2026-05-26 22:33:34,422 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-05-26 22:33:34,422 - __main__ - INFO - Monitor complete. Found 9 total results: 9 new reddit results.
2026-05-26 22:33:34,422 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-05-26 22:33:34,422 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-26 22:33:34,725 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-05-26 22:33:34,725 - __main__ - INFO - Closed all database connections
2026-05-26 22:33:34,749 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-26 22:33:34,758 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-05-26 23:00:02,965 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-26.log
2026-05-26 23:00:02,967 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-26.log
2026-05-26 23:00:02,967 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-26.log
2026-05-26 23:00:02,967 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-05-26 23:00:02,995 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-05-26 23:00:02,995 - __main__ - INFO - Configuration loaded and validated successfully
2026-05-26 23:00:03,008 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-05-26 23:00:03,014 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-05-26 23:00:03,330 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-05-26 23:00:03,330 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-05-26 23:00:03,372 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-05-26 23:00:03,376 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0
2026-05-26 23:00:03,376 - __main__ - INFO - RSS scraper initialized and enabled
2026-05-26 23:00:03,392 - Yiddish24Scraper - INFO - File downloader initialized with 30 terms, prefix 'Y2', and file type organization enabled
2026-05-26 23:00:03,393 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=30, exclude_terms=0
2026-05-26 23:00:03,393 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-05-26 23:00:03,395 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0
2026-05-26 23:00:03,400 - TorahAnytimeScraper - INFO - File downloader initialized with 51 terms, prefix 'TA', and file type organization enabled
2026-05-26 23:00:03,400 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=51, exclude_terms=3
2026-05-26 23:00:03,403 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-05-26 23:00:03,403 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0
2026-05-26 23:00:03,403 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-05-26 23:00:03,403 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-05-26 23:00:03,403 - __main__ - INFO - Running 3 scrapers concurrently...
2026-05-26 23:00:03,403 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-05-26 23:00:03,572 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-05-26 23:00:03,587 - IveltScraper - INFO - Loaded 178 include, 0 exclude filters from DB topic_filters
2026-05-26 23:00:03,587 - IveltScraper - INFO - Fetching ivelt.com active topics...
2026-05-26 23:00:03,591 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-05-26 23:00:04,273 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-05-26 23:00:04,828 - RSSFeedScraper - INFO - Total RSS/HTML results: 3
2026-05-26 23:00:05,182 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-05-26 23:00:05,359 - Yiddish24Scraper - INFO - Received response with 500784 characters
2026-05-26 23:00:05,363 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (320387 chars)
2026-05-26 23:00:05,369 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-05-26 23:00:05,508 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-05-26 23:00:05,559 - Yiddish24Scraper - INFO - Page 1 extraction: 99 successful, 1 failed out of 100 elements
2026-05-26 23:00:05,559 - Yiddish24Scraper - INFO - Parsed 99 articles from HTML on page 1
2026-05-26 23:00:06,802 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 99 total articles
2026-05-26 23:00:06,802 - Yiddish24Scraper - INFO - Page 1: 0/99 new items
2026-05-26 23:00:06,802 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination
2026-05-26 23:00:06,802 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0
2026-05-26 23:00:16,106 - IveltScraper - INFO - Found 50 active topics on ivelt.com
2026-05-26 23:00:32,870 - IveltScraper - INFO - Ivelt scrape complete. Checked 2 topics, found 8 new posts.
2026-05-26 23:00:32,870 - __main__ - INFO - Scraper rss completed: 3 results
2026-05-26 23:00:32,871 - __main__ - INFO - Scraper yiddish24 completed: 0 results
2026-05-26 23:00:32,871 - __main__ - INFO - Scraper ivelt completed: 8 results
2026-05-26 23:00:33,488 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-26 23:00:33.488325
2026-05-26 23:00:33,488 - __main__ - INFO - Email sent successfully
2026-05-26 23:00:33,489 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-05-26 23:00:33,489 - __main__ - INFO - Monitor complete. Found 11 total results: 3 new rss results, 8 new ivelt results.
2026-05-26 23:00:33,489 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-05-26 23:00:33,489 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-26 23:00:33,664 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-05-26 23:00:33,665 - __main__ - INFO - Closed all database connections
2026-05-26 23:00:33,667 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-26 23:00:33,667 - social_media_monitor.database.connection - INFO - Closed 0 database connections