โ† Logs

social_media_monitor_2026-06-11.log

2026-06-11 20:30:08,468 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit subreddit feed monitoring enabled.
2026-06-11 20:30:08,468 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'hermes_agent': r/hermesagent+HermesAI+AI_Agents+aiagents+AgentsOfAI+LocalLLaMA+AutoGPT (limit=25)
2026-06-11 20:30:08,468 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes agent via RSS
2026-06-11 20:30:09,618 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes AI via RSS
2026-06-11 20:30:10,775 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: nous research hermes via RSS
2026-06-11 20:30:11,926 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: multica via RSS
2026-06-11 20:30:13,078 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'paperclip_ai': r/PaperClip_AI+PaperclipAI+pAIperclip (limit=25)
2026-06-11 20:30:13,078 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip ai via RSS
2026-06-11 20:30:14,225 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip agent via RSS
2026-06-11 20:30:15,380 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: multica via RSS
2026-06-11 20:30:16,540 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'claude_agents': r/vibecoding (limit=25)
2026-06-11 20:30:16,540 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: multica via RSS
2026-06-11 20:30:17,693 - social_media_monitor.scrapers.reddit_scraper - INFO - Total subreddit feed results: 0
2026-06-11 20:30:17,694 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-11 20:30:17,876 - TwitterScraper - INFO - Searching Twitter/X (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-11 20:30:18,374 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'paperclip'
2026-06-11 20:30:24,163 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for '"Hermes Agent"'
2026-06-11 20:30:30,476 - TwitterScraper - INFO - Twitter/X RSS: 93 entries for 'multica'
2026-06-11 20:30:35,668 - TwitterScraper - INFO - Twitter scrape complete. Found 0 new results.
2026-06-11 20:30:35,669 - LinkedInScraper - INFO - Searching LinkedIn (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-11 20:30:36,261 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'paperclip'
2026-06-11 20:30:37,956 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for '"Hermes Agent"'
2026-06-11 20:30:39,358 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'multica'
2026-06-11 20:30:39,709 - LinkedInScraper - INFO - New LinkedIn post: Yujiao Wang - LinkedIn
2026-06-11 20:30:40,120 - LinkedInScraper - INFO - New LinkedIn post: Sandra Kozlowski - Department Administrator and Director of Operations
2026-06-11 20:30:40,175 - LinkedInScraper - INFO - LinkedIn scrape complete. Found 2 new results.
2026-06-11 20:30:40,176 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)
2026-06-11 20:30:45,085 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-11 20:30:45,110 - GitHubScraper - INFO - Found 237 GitHub repositories for term: paperclip
2026-06-11 20:30:46,271 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-11 20:30:46,273 - GitHubScraper - INFO - Found 352 GitHub repositories for term: "Hermes Agent"
2026-06-11 20:30:47,471 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-11 20:30:47,561 - GitHubScraper - INFO - Found 49 GitHub repositories for term: multica
2026-06-11 20:30:47,717 - GitHubScraper - INFO - Total GitHub results found: 0
2026-06-11 20:30:47,717 - __main__ - INFO - Scraper reddit completed: 5 results
2026-06-11 20:30:47,717 - __main__ - INFO - Scraper github completed: 0 results
2026-06-11 20:30:47,717 - __main__ - INFO - Scraper twitter completed: 0 results
2026-06-11 20:30:47,717 - __main__ - INFO - Scraper linkedin completed: 2 results
2026-06-11 20:30:47,717 - __main__ - INFO - Scraper linkedin_feed completed: 0 results
2026-06-11 20:30:48,350 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-11 20:30:48.350915
2026-06-11 20:30:48,351 - __main__ - INFO - Email sent successfully
2026-06-11 20:30:48,351 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-11 20:30:48,351 - __main__ - INFO - Monitor complete. Found 7 total results: 5 new reddit results, 2 new linkedin results.
2026-06-11 20:30:48,351 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-11 20:30:48,351 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-11 20:30:48,449 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-11 20:30:48,449 - __main__ - INFO - Closed all database connections
2026-06-11 20:30:48,451 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-11 20:30:48,451 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-11 20:55:39,182 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-11.log
2026-06-11 20:55:39,183 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-11.log
2026-06-11 20:55:39,183 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-11.log
2026-06-11 20:55:39,183 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-11 20:55:39,229 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-11 20:55:39,229 - social_media_monitor.config.settings - WARNING - Twitter monitoring enabled but credentials validation not implemented
2026-06-11 20:55:39,229 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-11 20:55:39,232 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-11 20:55:39,235 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-11 20:55:39,250 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-11 20:55:39,250 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-11 20:55:39,251 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-11 20:55:39,251 - __main__ - INFO - Reddit scraper initialized and enabled
2026-06-11 20:55:39,251 - __main__ - INFO - GitHub scraper initialized and enabled
2026-06-11 20:55:39,251 - __main__ - INFO - Twitter scraper initialized and enabled
2026-06-11 20:55:39,252 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-11 20:55:39,252 - __main__ - INFO - LinkedIn scraper initialized and enabled
2026-06-11 20:55:39,252 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled
2026-06-11 20:55:39,254 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-11 20:55:39,255 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-11 20:55:39,257 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-11 20:55:39,261 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-11 20:55:39,262 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=5
2026-06-11 20:55:39,264 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-11 20:55:39,264 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-11 20:55:39,264 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-11 20:55:39,264 - __main__ - INFO - Running 5 scrapers concurrently...
2026-06-11 20:55:39,264 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit search monitoring enabled. Running search with terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-11 20:55:39,264 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['"Hermes Agent"']
2026-06-11 20:55:40,107 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term '"Hermes Agent"'
2026-06-11 20:55:40,154 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Struggling to get AI to be able to use the API properly to create and
2026-06-11 20:55:40,171 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: This Hermes Agent Update Changes The Game
2026-06-11 20:55:40,184 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: How To Install FREE Hermes Agent Skills
2026-06-11 20:55:40,199 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: The Biggest Hermes Agent Update Yet (V0.16)
2026-06-11 20:55:41,383 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 4
2026-06-11 20:55:41,383 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'paperclip' restricted to subreddits: ['PaperClip_AI', 'PaperclipAI']
2026-06-11 20:55:41,383 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['paperclip']
2026-06-11 20:55:41,383 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/PaperClip_AI+PaperclipAI
2026-06-11 20:55:41,539 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 0 entries for term 'paperclip'
2026-06-11 20:55:42,540 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0
2026-06-11 20:55:42,540 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'multica' restricted to subreddits: ['hermesagent', 'HermesAI']
2026-06-11 20:55:42,540 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['multica']
2026-06-11 20:55:42,540 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/hermesagent+HermesAI
2026-06-11 20:55:42,688 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 0 entries for term 'multica'
2026-06-11 20:55:43,689 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0
2026-06-11 20:55:43,689 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit subreddit feed monitoring enabled.
2026-06-11 20:55:43,689 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'hermes_agent': r/hermesagent+HermesAI+AI_Agents+aiagents+AgentsOfAI+LocalLLaMA+AutoGPT (limit=25)
2026-06-11 20:55:43,689 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes agent via RSS
2026-06-11 20:55:44,838 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes AI via RSS
2026-06-11 20:55:45,999 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: nous research hermes via RSS
2026-06-11 20:55:47,151 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: multica via RSS
2026-06-11 20:55:48,307 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'paperclip_ai': r/PaperClip_AI+PaperclipAI+pAIperclip (limit=25)
2026-06-11 20:55:48,308 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip ai via RSS
2026-06-11 20:55:49,463 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip agent via RSS
2026-06-11 20:55:50,616 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: multica via RSS
2026-06-11 20:55:51,778 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'claude_agents': r/vibecoding (limit=25)
2026-06-11 20:55:51,778 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: multica via RSS
2026-06-11 20:55:52,929 - social_media_monitor.scrapers.reddit_scraper - INFO - Total subreddit feed results: 0
2026-06-11 20:55:52,929 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-11 20:55:53,094 - TwitterScraper - INFO - Searching Twitter/X (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-11 20:55:53,558 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'paperclip'
2026-06-11 20:56:11,793 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for '"Hermes Agent"'
2026-06-11 20:56:30,701 - TwitterScraper - INFO - Twitter/X RSS: 93 entries for 'multica'
2026-06-11 20:56:48,284 - TwitterScraper - INFO - Twitter scrape complete. Found 0 new results.
2026-06-11 20:56:48,285 - LinkedInScraper - INFO - Searching LinkedIn (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-11 20:56:48,794 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'paperclip'
2026-06-11 20:56:50,214 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for '"Hermes Agent"'
2026-06-11 20:56:50,398 - LinkedInScraper - INFO - New LinkedIn post: Steel City AI - Hermes Agent vs OpenClaw - LinkedIn
2026-06-11 20:56:51,098 - LinkedInScraper - INFO - New LinkedIn post: 1/ 2 Patterns need to work to improve team coordination and save time
2026-06-11 20:56:51,550 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'multica'
2026-06-11 20:56:52,342 - LinkedInScraper - INFO - LinkedIn scrape complete. Found 2 new results.
2026-06-11 20:56:52,343 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)
2026-06-11 20:56:52,700 - LinkedInFeedScraper - INFO - Successfully auto-grabbed fresh LinkedIn cookies and User-Agent from running Chrome!
2026-06-11 20:56:59,182 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Ashley Zhang - This is the first public demonstration of a robot's jump-jump switching technology by a Chinese tech
2026-06-11 20:56:59,193 - LinkedInFeedScraper - INFO - New LinkedIn feed post: None - IMAGE
2026-06-11 20:56:59,202 - LinkedInFeedScraper - INFO - New LinkedIn feed post: TWZ - Germanyโ€™s Cobra 600 Is A Jet Powered Interceptor Drone That Slings An IRIS-T Missile
A novel kind o
2026-06-11 20:56:59,210 - LinkedInFeedScraper - INFO - New LinkedIn feed post: None - IMAGE
2026-06-11 20:56:59,218 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Adarsh Mishra - The UK has successfully tested DragonFire, its first laser weapon, capable of destroying airborne dr
2026-06-11 20:56:59,228 - LinkedInFeedScraper - INFO - New LinkedIn feed post: WP More! - GoDaddy researchers have found malware on roughly 2,000 WordPress sites that hides its command-and-c
2026-06-11 20:56:59,239 - LinkedInFeedScraper - INFO - New LinkedIn feed post: CTO ROBOTICS Media - This drone looks like it was designed by an engineer who got bored of normal drones ๐Ÿ‘€
Instead of fi
2026-06-11 20:56:59,247 - LinkedInFeedScraper - INFO - New LinkedIn feed post: heise online English - Google is removing the last internal switches for Manifest V2 in Chromium 150 and 151 โ€“ and thus rem
2026-06-11 20:56:59,255 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Sjeel K. - A Head of Sales agreed to run marketing for one week.
Here's the diary.
Monday.
"Easy. I'll just la
2026-06-11 20:56:59,263 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Expo - ๐Ÿ’ก Pro Tip: Use The Expo MCP Server to go through our documentation to update your app to SDK 56 - th
2026-06-11 20:56:59,271 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Sergey Kochnev - The future of drone manufacturing may not be factories. It may be print farms.
Imagine a facility w
2026-06-11 20:56:59,282 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Chrome for Developers - The WebMCP origin trial is open in Chrome 149 โ†’ https://goo.gle/4x97wMK
This time limited program o
2026-06-11 20:56:59,291 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Yuri Pierine de Souza - Understanding the differences between VLOS, EVLOS, and BVLOS is essential for safe and efficient dro
2026-06-11 20:56:59,300 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Roman Tsehynka - Hi everyone. For the past few months I've been heads-down on one thing โ€” SmartFront. And I finally w
2026-06-11 20:56:59,311 - LinkedInFeedScraper - INFO - New LinkedIn feed post: CTO ROBOTICS Media - A human hand can be incredibly precise. This robot is trying to be even more precise ๐Ÿ‘€
Sony's micro
2026-06-11 20:56:59,321 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Monirul Islam - I built a free tool to solve my own problem โ€” and now it's live for everyone.
I had 300+ important
2026-06-11 20:56:59,331 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Iana Pugachova - A robotic arm + display screen + physical interface for AI agents.
AI assistants are fired.
AI agent
2026-06-11 20:56:59,343 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Mike W. - Yume: A programmable, explicit world model & game engine (built on Godot 4.6.1), that takes instruct
2026-06-11 20:56:59,355 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Ramesh Enduri - โœˆ๏ธ Understanding Aerodynamic Friction: The Forces That Slow an Aircraft Down
Every aircraft, from d
2026-06-11 20:56:59,365 - LinkedInFeedScraper - INFO - New LinkedIn feed post: David Faure - A website should not weigh more than a single photo from your phone. Most weigh more than 20. Here i
2026-06-11 20:56:59,365 - LinkedInFeedScraper - INFO - LinkedIn Feed scrape complete. Found 20 new posts.
2026-06-11 20:57:00,412 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-11 20:57:00,501 - GitHubScraper - INFO - Found 237 GitHub repositories for term: paperclip
2026-06-11 20:57:00,512 - GitHubScraper - INFO - Added new GitHub repository: eldev
2026-06-11 20:57:01,728 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-11 20:57:01,819 - GitHubScraper - INFO - Found 352 GitHub repositories for term: "Hermes Agent"
2026-06-11 20:57:02,961 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-11 20:57:03,054 - GitHubScraper - INFO - Found 49 GitHub repositories for term: multica
2026-06-11 20:57:03,227 - GitHubScraper - INFO - Total GitHub results found: 1
2026-06-11 20:57:03,228 - __main__ - INFO - Scraper reddit completed: 4 results
2026-06-11 20:57:03,228 - __main__ - INFO - Scraper github completed: 1 results
2026-06-11 20:57:03,228 - __main__ - INFO - Scraper twitter completed: 0 results
2026-06-11 20:57:03,228 - __main__ - INFO - Scraper linkedin completed: 2 results
2026-06-11 20:57:03,228 - __main__ - INFO - Scraper linkedin_feed completed: 20 results
2026-06-11 20:57:03,880 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-11 20:57:03.880478
2026-06-11 20:57:03,880 - __main__ - INFO - Email sent successfully
2026-06-11 20:57:03,881 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-11 20:57:03,881 - __main__ - INFO - Monitor complete. Found 27 total results: 4 new reddit results, 1 new github results, 2 new linkedin results, 20 new linkedin feed results.
2026-06-11 20:57:03,881 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-11 20:57:03,881 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-11 20:57:03,986 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-11 20:57:03,986 - __main__ - INFO - Closed all database connections
2026-06-11 20:57:03,988 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-11 20:57:03,988 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-11 21:00:02,763 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-11.log
2026-06-11 21:00:02,763 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-11.log
2026-06-11 21:00:02,763 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-11.log
2026-06-11 21:00:02,763 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-11 21:00:02,787 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-11 21:00:02,787 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-11 21:00:02,789 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-11 21:00:02,790 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-11 21:00:02,827 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-11 21:00:02,827 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-11 21:00:02,899 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-11 21:00:02,900 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-11 21:00:02,901 - __main__ - INFO - RSS scraper initialized and enabled
2026-06-11 21:00:02,906 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-11 21:00:02,906 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-11 21:00:02,906 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-06-11 21:00:02,911 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-11 21:00:02,916 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-11 21:00:02,916 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=5
2026-06-11 21:00:02,918 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-11 21:00:02,918 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-11 21:00:02,919 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-11 21:00:02,919 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-06-11 21:00:02,919 - __main__ - INFO - Running 3 scrapers concurrently...
2026-06-11 21:00:02,919 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-06-11 21:00:03,054 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-06-11 21:00:03,063 - IveltScraper - INFO - Loaded 181 include, 0 exclude filters from DB topic_filters
2026-06-11 21:00:03,063 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-06-11 21:00:03,065 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-06-11 21:00:03,340 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-06-11 21:00:03,799 - RSSFeedScraper - INFO - Total RSS/HTML results: 5
2026-06-11 21:00:07,084 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-06-11 21:00:07,299 - Yiddish24Scraper - INFO - Received response with 492065 characters
2026-06-11 21:00:07,300 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (311951 chars)
2026-06-11 21:00:07,302 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-06-11 21:00:07,366 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-06-11 21:00:07,406 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-06-11 21:00:07,406 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-06-11 21:00:07,422 - Yiddish24Scraper - INFO - Term 'ืคื•ืŸ ื“ื™ ืžื’ื™ื“'ืก ื˜ื™ืฉืœ' matched in DESCRIPTION: 'ืคื•ืŸ ื“ื™ ืžื’ื™ื“'ืก ื˜ื™ืฉืœ - ืก'ื’ื™ื™ื˜ ืžื™ืจ ื ื™ืฉื˜ ืืŸ ื•ื•ืืก ื™ืขื ืขืจ ื˜ืจืื›ื˜'
2026-06-11 21:00:07,422 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ื”ื›ืœ ื‘ื›ืœ
2026-06-11 21:00:08,495 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/SHPITZER_260_260611015340.mp3
2026-06-11 21:00:08,662 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_SHPITZER_260_260611015340.mp3 (19.6 MB)
2026-06-11 21:00:08,667 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-06-11 21:00:08,677 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_SHPITZER_260_260611015340.mp3: title, artist, album, comment, source_url, genre, publisher
2026-06-11 21:00:08,678 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2_SHPITZER_260_260611015340_ืคื•ืŸ_ื“ื™_ืžื’ื™ื“_ืก_ื˜ื™ืฉืœ.mp3
2026-06-11 21:00:08,824 - Yiddish24Scraper - INFO - Term 'ื•ื•ืขืœื•ื•ืœ ืคืขืœื“ืžืืŸ' matched in TITLE: 'ืฉื‘ืช ืคืขืงืœ - ื•ื•ืขืœื•ื•ืœ ืคืขืœื“ืžืืŸ'
2026-06-11 21:00:08,824 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ืฉื‘ืช ืคืขืงืœ - ื•ื•ืขืœื•ื•ืœ ืคืขืœื“ืžืืŸ
2026-06-11 21:00:09,495 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/New_Recording_82_4544_162_260611041426.mp3
2026-06-11 21:00:09,653 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_New_Recording_82_4544_162_260611041426.mp3 (17.3 MB)
2026-06-11 21:00:09,654 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-06-11 21:00:09,662 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_New_Recording_82_4544_162_260611041426.mp3: title, artist, album, source_url, genre, publisher
2026-06-11 21:00:09,663 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2_New_Recording_82_4544_162_260611041426_ื•ื•ืขืœื•ื•ืœ_ืคืขืœื“ืžืืŸ.mp3
2026-06-11 21:00:10,342 - Yiddish24Scraper - INFO - Page 1 summary: 6 new out of 100 total articles
2026-06-11 21:00:10,342 - Yiddish24Scraper - INFO - Page 1: 6/100 new items
2026-06-11 21:00:10,342 - Yiddish24Scraper - INFO - Low new item ratio (6.0%), stopping pagination
2026-06-11 21:00:10,342 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 6
2026-06-11 21:00:14,832 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-06-11 21:00:28,873 - IveltScraper - INFO - Filtering post containing exclude term: '*ื‘ื™ื˜ืข ืžืื›ื˜ ื–ื™ื›ืขืจ ื‘ืœื•ื™ื– ืฆื• ื‘ืืจื™ื›ื˜ืŸ ืงืจืื ื˜ืข ื ื™ื™ืขืก*'
2026-06-11 21:00:32,057 - IveltScraper - INFO - Filtering post containing exclude term: '*ื‘ื™ื˜ืข ืžืื›ื˜ ื–ื™ื›ืขืจ ื‘ืœื•ื™ื– ืฆื• ื‘ืืจื™ื›ื˜ืŸ ืงืจืื ื˜ืข ื ื™ื™ืขืก*'
2026-06-11 21:01:23,751 - IveltScraper - INFO - ivelt scrape complete. Checked 8 topics.
2026-06-11 21:01:23,752 - IveltScraper - INFO - All forums scrape complete. Found 42 new posts.
2026-06-11 21:01:23,752 - __main__ - INFO - Scraper rss completed: 5 results
2026-06-11 21:01:23,752 - __main__ - INFO - Scraper yiddish24 completed: 6 results
2026-06-11 21:01:23,752 - __main__ - INFO - Scraper ivelt completed: 42 results
2026-06-11 21:01:24,492 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-11 21:01:24.492588
2026-06-11 21:01:24,492 - __main__ - INFO - Email sent successfully
2026-06-11 21:01:24,493 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-11 21:01:24,493 - __main__ - INFO - Monitor complete. Found 53 total results: 5 new rss results, 6 new yiddish24 results, 42 new ivelt results.
2026-06-11 21:01:24,493 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-11 21:01:24,493 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-11 21:01:24,676 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-11 21:01:24,677 - __main__ - INFO - Closed all database connections
2026-06-11 21:01:24,678 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-11 21:01:24,678 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-11 22:00:02,264 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-11.log
2026-06-11 22:00:02,264 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-11.log
2026-06-11 22:00:02,265 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-11.log
2026-06-11 22:00:02,265 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-11 22:00:02,288 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-11 22:00:02,289 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-11 22:00:02,291 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-11 22:00:02,292 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-11 22:00:02,307 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-11 22:00:02,307 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-11 22:00:02,308 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-11 22:00:02,309 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-11 22:00:02,309 - __main__ - INFO - RSS scraper initialized and enabled
2026-06-11 22:00:02,312 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-11 22:00:02,312 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-11 22:00:02,312 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-06-11 22:00:02,315 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-11 22:00:02,319 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-11 22:00:02,319 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=5
2026-06-11 22:00:02,322 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-11 22:00:02,322 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-11 22:00:02,322 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-11 22:00:02,322 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-06-11 22:00:02,322 - __main__ - INFO - Running 3 scrapers concurrently...
2026-06-11 22:00:02,322 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-06-11 22:00:02,442 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-06-11 22:00:02,451 - IveltScraper - INFO - Loaded 181 include, 0 exclude filters from DB topic_filters
2026-06-11 22:00:02,451 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-06-11 22:00:02,452 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-06-11 22:00:02,775 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-06-11 22:00:03,204 - RSSFeedScraper - INFO - Total RSS/HTML results: 4
2026-06-11 22:00:06,999 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-06-11 22:00:07,229 - Yiddish24Scraper - INFO - Received response with 509507 characters
2026-06-11 22:00:07,232 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (319545 chars)
2026-06-11 22:00:07,235 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-06-11 22:00:07,324 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-06-11 22:00:07,369 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-06-11 22:00:07,369 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-06-11 22:00:07,532 - Yiddish24Scraper - INFO - Term 'ืขื ื™ื ื™ื ืฉื•ื ื™ื' matched in DESCRIPTION: 'ืขื ื™ื ื™ื ืฉื•ื ื™ื - ื“ืขืจ ื—ื™ืœื•ืง ืฆื•ื•ื™ืฉืŸ ื“ืขื 'ื‘ื™ืŸ' ืื™ืŸ ื“ืขืจ 'ืกืคื™ื™ื“ืขืจ''
2026-06-11 22:00:07,532 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ื”ื›ืœ ื‘ื›ืœ
2026-06-11 22:00:08,283 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/Shmiris_Einyem_260_260611020641.mp3
2026-06-11 22:00:09,748 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_Shmiris_Einyem_260_260611020641.mp3 (21.6 MB)
2026-06-11 22:00:09,749 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-06-11 22:00:09,775 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_Shmiris_Einyem_260_260611020641.mp3: title, artist, album, comment, source_url, genre, publisher
2026-06-11 22:00:09,776 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2_Shmiris_Einyem_260_260611020641_ืขื ื™ื ื™ื_ืฉื•ื ื™ื.mp3
2026-06-11 22:00:10,942 - Yiddish24Scraper - INFO - Page 1 summary: 11 new out of 100 total articles
2026-06-11 22:00:10,943 - Yiddish24Scraper - INFO - Page 1: 11/100 new items
2026-06-11 22:00:10,943 - Yiddish24Scraper - INFO - Low new item ratio (11.0%), stopping pagination
2026-06-11 22:00:10,943 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 11
2026-06-11 22:00:14,991 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-06-11 22:00:29,150 - IveltScraper - INFO - Filtering post containing exclude term: '*ื‘ื™ื˜ืข ืžืื›ื˜ ื–ื™ื›ืขืจ ื‘ืœื•ื™ื– ืฆื• ื‘ืืจื™ื›ื˜ืŸ ืงืจืื ื˜ืข ื ื™ื™ืขืก*'
2026-06-11 22:00:37,998 - IveltScraper - INFO - ivelt scrape complete. Checked 4 topics.
2026-06-11 22:00:37,998 - IveltScraper - INFO - All forums scrape complete. Found 26 new posts.
2026-06-11 22:00:37,998 - __main__ - INFO - Scraper rss completed: 4 results
2026-06-11 22:00:37,998 - __main__ - INFO - Scraper yiddish24 completed: 11 results
2026-06-11 22:00:37,998 - __main__ - INFO - Scraper ivelt completed: 26 results
2026-06-11 22:00:38,775 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-11 22:00:38.775886
2026-06-11 22:00:38,776 - __main__ - INFO - Email sent successfully
2026-06-11 22:00:38,776 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-11 22:00:38,776 - __main__ - INFO - Monitor complete. Found 41 total results: 4 new rss results, 11 new yiddish24 results, 26 new ivelt results.
2026-06-11 22:00:38,776 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-11 22:00:38,776 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-11 22:00:38,839 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-11 22:00:38,840 - __main__ - INFO - Closed all database connections
2026-06-11 22:00:38,842 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-11 22:00:38,842 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-11 22:30:02,490 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-11.log
2026-06-11 22:30:02,490 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-11.log
2026-06-11 22:30:02,490 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-11.log
2026-06-11 22:30:02,490 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-11 22:30:02,514 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-11 22:30:02,514 - social_media_monitor.config.settings - WARNING - Twitter monitoring enabled but credentials validation not implemented
2026-06-11 22:30:02,514 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-11 22:30:02,517 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-11 22:30:02,522 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-11 22:30:02,537 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-11 22:30:02,537 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-11 22:30:02,603 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-11 22:30:02,603 - __main__ - INFO - Reddit scraper initialized and enabled
2026-06-11 22:30:02,603 - __main__ - INFO - GitHub scraper initialized and enabled
2026-06-11 22:30:02,603 - __main__ - INFO - Twitter scraper initialized and enabled
2026-06-11 22:30:02,607 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-11 22:30:02,608 - __main__ - INFO - LinkedIn scraper initialized and enabled
2026-06-11 22:30:02,608 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled
2026-06-11 22:30:02,617 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-11 22:30:02,618 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-11 22:30:02,627 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-11 22:30:02,641 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-11 22:30:02,642 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=5
2026-06-11 22:30:02,647 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-11 22:30:02,647 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-11 22:30:02,647 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-11 22:30:02,647 - __main__ - INFO - Running 5 scrapers concurrently...
2026-06-11 22:30:02,648 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit search monitoring enabled. Running search with terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-11 22:30:02,648 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['"Hermes Agent"']
2026-06-11 22:30:03,382 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term '"Hermes Agent"'
2026-06-11 22:30:04,630 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0
2026-06-11 22:30:04,631 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'paperclip' restricted to subreddits: ['PaperClip_AI', 'PaperclipAI']
2026-06-11 22:30:04,631 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['paperclip']
2026-06-11 22:30:04,631 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/PaperClip_AI+PaperclipAI
2026-06-11 22:30:04,772 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 0 entries for term 'paperclip'
2026-06-11 22:30:05,772 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0
2026-06-11 22:30:05,773 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'multica' restricted to subreddits: ['hermesagent', 'HermesAI']
2026-06-11 22:30:05,773 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['multica']
2026-06-11 22:30:05,773 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/hermesagent+HermesAI
2026-06-11 22:30:05,924 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 0 entries for term 'multica'
2026-06-11 22:30:06,924 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0
2026-06-11 22:30:06,924 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit subreddit feed monitoring enabled.
2026-06-11 22:30:06,924 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'hermes_agent': r/hermesagent+HermesAI+AI_Agents+aiagents+AgentsOfAI+LocalLLaMA+AutoGPT (limit=25)
2026-06-11 22:30:06,925 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes agent via RSS
2026-06-11 22:30:08,076 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes AI via RSS
2026-06-11 22:30:09,228 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: nous research hermes via RSS
2026-06-11 22:30:10,381 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: multica via RSS
2026-06-11 22:30:11,527 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'paperclip_ai': r/PaperClip_AI+PaperclipAI+pAIperclip (limit=25)
2026-06-11 22:30:11,527 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip ai via RSS
2026-06-11 22:30:12,671 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip agent via RSS
2026-06-11 22:30:13,823 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: multica via RSS
2026-06-11 22:30:14,970 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'claude_agents': r/vibecoding (limit=25)
2026-06-11 22:30:14,970 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: multica via RSS
2026-06-11 22:30:16,124 - social_media_monitor.scrapers.reddit_scraper - INFO - Total subreddit feed results: 0
2026-06-11 22:30:16,124 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-11 22:30:16,321 - TwitterScraper - INFO - Searching Twitter/X (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-11 22:30:16,773 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'paperclip'
2026-06-11 22:30:18,851 - TwitterScraper - INFO - New tweet/X post: Paperclip + Hermes just changed SEO forever.
Stop guessing keywords a
2026-06-11 22:30:23,144 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for '"Hermes Agent"'
2026-06-11 22:30:29,379 - TwitterScraper - INFO - Twitter/X RSS: 92 entries for 'multica'
2026-06-11 22:30:35,144 - TwitterScraper - INFO - Twitter scrape complete. Found 1 new results.
2026-06-11 22:30:35,144 - LinkedInScraper - INFO - Searching LinkedIn (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-11 22:30:35,780 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'paperclip'
2026-06-11 22:30:37,086 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for '"Hermes Agent"'
2026-06-11 22:30:37,283 - LinkedInScraper - INFO - New LinkedIn post: I gave my Hermes agent (Scout) a new task this week. Growing up in Sou
2026-06-11 22:30:38,573 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'multica'
2026-06-11 22:30:39,252 - LinkedInScraper - INFO - New LinkedIn post: Really interesting work by Jeevan ๐Ÿ‘ As AI coding agents become more co
2026-06-11 22:30:39,300 - LinkedInScraper - INFO - New LinkedIn post: Claude Code - Superserve - LinkedIn
2026-06-11 22:30:39,332 - LinkedInScraper - INFO - New LinkedIn post: Venkat Rajasurya - ICU Medical Director @ MultiCare Health System | MP
2026-06-11 22:30:39,467 - LinkedInScraper - INFO - LinkedIn scrape complete. Found 4 new results.
2026-06-11 22:30:39,468 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)
2026-06-11 22:30:40,347 - LinkedInFeedScraper - INFO - Successfully auto-grabbed fresh LinkedIn cookies and User-Agent from running Chrome!
2026-06-11 22:30:46,087 - LinkedInFeedScraper - INFO - New LinkedIn feed post: None - IMAGE
2026-06-11 22:30:46,176 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Prof. Dr.-Ing. Lars N. Josler - The future of robotics is geography.
Based on the overview of the US robotics landscape compiled by
2026-06-11 22:30:46,194 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Alok Jain - 3D printing is moving beyond rigid objects and flat build plates.
Rapid Liquid Printing allows soft
2026-06-11 22:30:46,226 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Petri Anttila - My take on AI is probably not what you'd expect from a photographer.
I think it's going to change t
2026-06-11 22:30:46,239 - LinkedInFeedScraper - INFO - LinkedIn Feed scrape complete. Found 4 new posts.
2026-06-11 22:30:47,257 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-11 22:30:47,282 - GitHubScraper - INFO - Found 237 GitHub repositories for term: paperclip
2026-06-11 22:30:48,342 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-11 22:30:48,346 - GitHubScraper - INFO - Found 353 GitHub repositories for term: "Hermes Agent"
2026-06-11 22:30:48,361 - GitHubScraper - INFO - Added new GitHub repository: vellum-assistant
2026-06-11 22:30:49,347 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-11 22:30:49,438 - GitHubScraper - INFO - Found 49 GitHub repositories for term: multica
2026-06-11 22:30:49,599 - GitHubScraper - INFO - Total GitHub results found: 1
2026-06-11 22:30:49,599 - __main__ - INFO - Scraper reddit completed: 0 results
2026-06-11 22:30:49,600 - __main__ - INFO - Scraper github completed: 1 results
2026-06-11 22:30:49,600 - __main__ - INFO - Scraper twitter completed: 1 results
2026-06-11 22:30:49,600 - __main__ - INFO - Scraper linkedin completed: 4 results
2026-06-11 22:30:49,600 - __main__ - INFO - Scraper linkedin_feed completed: 4 results
2026-06-11 22:30:50,190 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-11 22:30:50.190291
2026-06-11 22:30:50,190 - __main__ - INFO - Email sent successfully
2026-06-11 22:30:50,190 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-11 22:30:50,191 - __main__ - INFO - Monitor complete. Found 10 total results: 1 new github results, 1 new twitter results, 4 new linkedin results, 4 new linkedin feed results.
2026-06-11 22:30:50,191 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-11 22:30:50,191 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-11 22:30:50,294 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-11 22:30:50,295 - __main__ - INFO - Closed all database connections
2026-06-11 22:30:50,297 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-11 22:30:50,297 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-11 23:00:01,920 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-11.log
2026-06-11 23:00:01,920 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-11.log
2026-06-11 23:00:01,920 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-11.log
2026-06-11 23:00:01,920 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-11 23:00:01,946 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-11 23:00:01,946 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-11 23:00:01,949 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-11 23:00:01,949 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-11 23:00:01,966 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-11 23:00:01,967 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-11 23:00:01,969 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-11 23:00:01,971 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-11 23:00:01,971 - __main__ - INFO - RSS scraper initialized and enabled
2026-06-11 23:00:01,980 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-11 23:00:01,980 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-11 23:00:01,980 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-06-11 23:00:01,986 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-11 23:00:01,994 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-11 23:00:01,994 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=5
2026-06-11 23:00:01,997 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-11 23:00:01,998 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-11 23:00:01,998 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-11 23:00:01,998 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-06-11 23:00:01,998 - __main__ - INFO - Running 3 scrapers concurrently...
2026-06-11 23:00:01,998 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-06-11 23:00:02,108 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-06-11 23:00:02,116 - IveltScraper - INFO - Loaded 181 include, 0 exclude filters from DB topic_filters
2026-06-11 23:00:02,116 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-06-11 23:00:02,117 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-06-11 23:00:02,415 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-06-11 23:00:02,813 - RSSFeedScraper - INFO - Total RSS/HTML results: 3
2026-06-11 23:00:12,420 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-06-11 23:00:12,644 - Yiddish24Scraper - INFO - Received response with 509496 characters
2026-06-11 23:00:12,647 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (319553 chars)
2026-06-11 23:00:12,651 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-06-11 23:00:12,726 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-06-11 23:00:12,767 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-06-11 23:00:12,767 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-06-11 23:00:12,840 - Yiddish24Scraper - INFO - Term 'ื ื’ื•ื˜ ื•ื•ืืจื˜' matched in DESCRIPTION: 'ื ื’ื•ื˜ ื•ื•ืืจื˜ - ื™ืขื“ืขืจ ืžืขื ื˜ืฉ ื•ื•ื™ืœ ื”ืขืจืŸ ื ื™ื™ืฉืจ ื›ื—'
2026-06-11 23:00:12,840 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ื”ื›ืœ ื‘ื›ืœ
2026-06-11 23:00:13,340 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/yoelsh332323_260_260611023117.mp3
2026-06-11 23:00:13,446 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_yoelsh332323_260_260611023117.mp3 (5.2 MB)
2026-06-11 23:00:13,449 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-06-11 23:00:13,457 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_yoelsh332323_260_260611023117.mp3: title, artist, album, comment, source_url, genre, publisher
2026-06-11 23:00:13,458 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2_yoelsh332323_260_260611023117_ื_ื’ื•ื˜_ื•ื•ืืจื˜.mp3
2026-06-11 23:00:14,524 - Yiddish24Scraper - INFO - Page 1 summary: 6 new out of 100 total articles
2026-06-11 23:00:14,525 - Yiddish24Scraper - INFO - Page 1: 6/100 new items
2026-06-11 23:00:14,525 - Yiddish24Scraper - INFO - Low new item ratio (6.0%), stopping pagination
2026-06-11 23:00:14,525 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 6
2026-06-11 23:00:14,533 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-06-11 23:00:26,795 - IveltScraper - INFO - Filtering post containing exclude term: '*ื‘ื™ื˜ืข ืžืื›ื˜ ื–ื™ื›ืขืจ ื‘ืœื•ื™ื– ืฆื• ื‘ืืจื™ื›ื˜ืŸ ืงืจืื ื˜ืข ื ื™ื™ืขืก*'
2026-06-11 23:00:36,333 - IveltScraper - INFO - ivelt scrape complete. Checked 6 topics.
2026-06-11 23:00:36,334 - IveltScraper - INFO - All forums scrape complete. Found 21 new posts.
2026-06-11 23:00:36,334 - __main__ - INFO - Scraper rss completed: 3 results
2026-06-11 23:00:36,334 - __main__ - INFO - Scraper yiddish24 completed: 6 results
2026-06-11 23:00:36,334 - __main__ - INFO - Scraper ivelt completed: 21 results
2026-06-11 23:00:36,962 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-11 23:00:36.962926
2026-06-11 23:00:36,963 - __main__ - INFO - Email sent successfully
2026-06-11 23:00:36,963 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-11 23:00:36,963 - __main__ - INFO - Monitor complete. Found 30 total results: 3 new rss results, 6 new yiddish24 results, 21 new ivelt results.
2026-06-11 23:00:36,963 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-11 23:00:36,963 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-11 23:00:37,186 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-11 23:00:37,186 - __main__ - INFO - Closed all database connections
2026-06-11 23:00:37,188 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-11 23:00:37,188 - social_media_monitor.database.connection - INFO - Closed 0 database connections