← Logs

social_media_monitor_2026-06-19.log

2026-06-19 21:00:06,778 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-06-19 21:00:06,778 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-06-19 21:00:07,469 - Yiddish24Scraper - INFO - Page 1 summary: 1 new out of 100 total articles
2026-06-19 21:00:07,470 - Yiddish24Scraper - INFO - Page 1: 1/100 new items
2026-06-19 21:00:07,470 - Yiddish24Scraper - INFO - Low new item ratio (1.0%), stopping pagination
2026-06-19 21:00:07,470 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 1
2026-06-19 21:00:13,962 - IveltScraper - INFO - Found 50 active topics on ivelt.com
2026-06-19 21:00:31,667 - IveltScraper - INFO - Ivelt scrape complete. Checked 4 topics, found 37 new posts.
2026-06-19 21:00:31,668 - __main__ - INFO - Scraper rss completed: 3 results
2026-06-19 21:00:31,668 - __main__ - INFO - Scraper yiddish24 completed: 1 results
2026-06-19 21:00:31,668 - __main__ - INFO - Scraper ivelt completed: 37 results
2026-06-19 21:00:32,622 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-19 21:00:32.622796
2026-06-19 21:00:32,623 - __main__ - INFO - Email sent successfully
2026-06-19 21:00:32,623 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-19 21:00:32,623 - __main__ - INFO - Monitor complete. Found 41 total results: 3 new rss results, 1 new yiddish24 results, 37 new ivelt results.
2026-06-19 21:00:32,623 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-19 21:00:32,623 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-19 21:00:32,688 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-19 21:00:32,689 - __main__ - INFO - Closed all database connections
2026-06-19 21:00:32,690 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-19 21:00:32,690 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-19 21:30:01,901 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-19.log
2026-06-19 21:30:01,902 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-19.log
2026-06-19 21:30:01,902 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-19.log
2026-06-19 21:30:01,902 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-19 21:30:01,930 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-19 21:30:01,930 - social_media_monitor.config.settings - WARNING - Twitter monitoring enabled but credentials validation not implemented
2026-06-19 21:30:01,930 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-19 21:30:01,933 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-19 21:30:01,933 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-19 21:30:01,947 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-19 21:30:01,947 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-19 21:30:01,948 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-19 21:30:01,948 - __main__ - INFO - Reddit scraper initialized and enabled
2026-06-19 21:30:01,948 - __main__ - INFO - GitHub scraper initialized and enabled
2026-06-19 21:30:01,948 - __main__ - INFO - Twitter scraper initialized and enabled
2026-06-19 21:30:01,949 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-19 21:30:01,949 - __main__ - INFO - LinkedIn scraper initialized and enabled
2026-06-19 21:30:01,949 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled
2026-06-19 21:30:01,952 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-19 21:30:01,952 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-19 21:30:01,955 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-19 21:30:01,961 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-19 21:30:01,961 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=10
2026-06-19 21:30:01,963 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-19 21:30:01,963 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-19 21:30:01,964 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-19 21:30:01,964 - __main__ - INFO - Running 5 scrapers concurrently...
2026-06-19 21:30:01,964 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit search monitoring enabled. Running search with terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-19 21:30:01,964 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['"Hermes Agent"']
2026-06-19 21:30:02,859 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term '"Hermes Agent"'
2026-06-19 21:30:02,899 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: How I’m using Hermes Agent + LaunchChair agent API to go from SaaS ide
2026-06-19 21:30:02,909 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: I need help to run local Hermes Agent on my rig. llama-cpp self compil
2026-06-19 21:30:02,921 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: I need help to run local Hermes Agent on my rig. llama-cpp self compil
2026-06-19 21:30:02,955 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: I need help to run local Hermes Agent on my rig. llama-cpp self compil
2026-06-19 21:30:04,111 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 4
2026-06-19 21:30:04,111 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'paperclip' restricted to subreddits: ['PaperClip_AI', 'PaperclipAI']
2026-06-19 21:30:04,111 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['paperclip']
2026-06-19 21:30:04,111 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/PaperClip_AI+PaperclipAI
2026-06-19 21:30:04,266 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 0 entries for term 'paperclip'
2026-06-19 21:30:05,266 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0
2026-06-19 21:30:05,266 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'multica' restricted to subreddits: ['hermesagent', 'HermesAI']
2026-06-19 21:30:05,266 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['multica']
2026-06-19 21:30:05,266 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/hermesagent+HermesAI
2026-06-19 21:30:05,412 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 0 entries for term 'multica'
2026-06-19 21:30:06,412 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0
2026-06-19 21:30:06,412 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit subreddit feed monitoring enabled.
2026-06-19 21:30:06,412 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'hermes_agent': r/hermesagent+HermesAI+AI_Agents+aiagents+AgentsOfAI+LocalLLaMA+AutoGPT (limit=25)
2026-06-19 21:30:06,413 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes agent via RSS
2026-06-19 21:30:07,565 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes AI via RSS
2026-06-19 21:30:08,714 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: nous research hermes via RSS
2026-06-19 21:30:09,862 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: multica via RSS
2026-06-19 21:30:11,009 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'paperclip_ai': r/PaperClip_AI+PaperclipAI+pAIperclip (limit=25)
2026-06-19 21:30:11,009 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip ai via RSS
2026-06-19 21:30:12,165 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip agent via RSS
2026-06-19 21:30:13,316 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: multica via RSS
2026-06-19 21:30:14,487 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'claude_agents': r/vibecoding (limit=25)
2026-06-19 21:30:14,487 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: multica via RSS
2026-06-19 21:30:15,638 - social_media_monitor.scrapers.reddit_scraper - INFO - Total subreddit feed results: 0
2026-06-19 21:30:15,638 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit top feed monitoring enabled (t=day).
2026-06-19 21:30:15,639 - social_media_monitor.scrapers.reddit_scraper - INFO - Fetching top/day posts from feed 'hermes_agent': ['hermesagent', 'HermesAI', 'AI_Agents', 'aiagents', 'AgentsOfAI', 'LocalLLaMA', 'AutoGPT']
2026-06-19 21:30:46,097 - social_media_monitor.scrapers.reddit_scraper - WARNING - Could not fetch top RSS for r/hermesagent after retries
2026-06-19 21:31:01,598 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit top RSS: 0 entries for r/HermesAI
2026-06-19 21:31:35,061 - social_media_monitor.scrapers.reddit_scraper - WARNING - Could not fetch top RSS for r/AI_Agents after retries
2026-06-19 21:32:05,522 - social_media_monitor.scrapers.reddit_scraper - WARNING - Could not fetch top RSS for r/aiagents after retries
2026-06-19 21:32:05,879 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit top RSS: 5 entries for r/AgentsOfAI
2026-06-19 21:32:39,402 - social_media_monitor.scrapers.reddit_scraper - WARNING - Could not fetch top RSS for r/LocalLLaMA after retries
2026-06-19 21:33:09,866 - social_media_monitor.scrapers.reddit_scraper - WARNING - Could not fetch top RSS for r/AutoGPT after retries
2026-06-19 21:33:09,867 - social_media_monitor.scrapers.reddit_scraper - INFO - Fetching top/day posts from feed 'paperclip_ai': ['PaperClip_AI', 'PaperclipAI', 'pAIperclip']
2026-06-19 21:33:10,120 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit top RSS: 0 entries for r/PaperClip_AI
2026-06-19 21:33:43,564 - social_media_monitor.scrapers.reddit_scraper - WARNING - Could not fetch top RSS for r/PaperclipAI after retries
2026-06-19 21:34:14,018 - social_media_monitor.scrapers.reddit_scraper - WARNING - Could not fetch top RSS for r/pAIperclip after retries
2026-06-19 21:34:14,019 - social_media_monitor.scrapers.reddit_scraper - INFO - Fetching top/day posts from feed 'claude_agents': ['vibecoding']
2026-06-19 21:34:14,763 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit top RSS: 25 entries for r/vibecoding
2026-06-19 21:34:14,834 - social_media_monitor.scrapers.reddit_scraper - INFO - New top post from feed 'claude_agents' r/vibecoding: Subagents in a nutshell
2026-06-19 21:34:14,894 - social_media_monitor.scrapers.reddit_scraper - INFO - New top post from feed 'claude_agents' r/vibecoding: How doing yard work lead to this... Stripe - Lawn Path Planner
2026-06-19 21:34:14,904 - social_media_monitor.scrapers.reddit_scraper - INFO - New top post from feed 'claude_agents' r/vibecoding: I like opencode desktop app - any similar tools like that?
2026-06-19 21:34:17,957 - social_media_monitor.scrapers.reddit_scraper - INFO - Total top feed results: 3
2026-06-19 21:34:17,960 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-19 21:34:18,094 - TwitterScraper - INFO - Searching Twitter/X (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-19 21:34:18,556 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'paperclip'
2026-06-19 21:34:32,573 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for '"Hermes Agent"'
2026-06-19 21:34:46,411 - TwitterScraper - INFO - Twitter/X RSS: 96 entries for 'multica'
2026-06-19 21:34:59,027 - TwitterScraper - INFO - Twitter scrape complete. Found 0 new results.
2026-06-19 21:34:59,028 - LinkedInScraper - INFO - Searching LinkedIn (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-19 21:34:59,632 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'paperclip'
2026-06-19 21:35:00,797 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for '"Hermes Agent"'
2026-06-19 21:35:02,178 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'multica'
2026-06-19 21:35:02,592 - LinkedInScraper - INFO - New LinkedIn post: Agent orchestration explained: how enterprises manage multi-agent AI w
2026-06-19 21:35:02,609 - LinkedInScraper - INFO - New LinkedIn post: Big news for Cleveland County! CaroMont Health is announcing plans for
2026-06-19 21:35:02,720 - LinkedInScraper - INFO - New LinkedIn post: Do you know what your LLM is adding to your codebase? When you look at
2026-06-19 21:35:02,845 - LinkedInScraper - INFO - LinkedIn scrape complete. Found 3 new results.
2026-06-19 21:35:02,846 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)
2026-06-19 21:35:03,110 - LinkedInFeedScraper - INFO - Successfully auto-grabbed fresh LinkedIn cookies and User-Agent from running Chrome!
2026-06-19 21:35:11,973 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Cassandra Clift, RAC-CT - I'm excited to announce I'm returning to Marquis Health Care as a Regional Director of Case Management.
2026-06-19 21:35:12,040 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Eugenio Zabell - 🚨 BREAKING: Claude just changed how Amazon works.
I built a Claude system that maps every buyer angle, generates the full image stack per angle, and lets Amazon's algorithm pick the winner.
Now I sh
2026-06-19 21:35:12,107 - LinkedInFeedScraper - INFO - LinkedIn Feed scrape complete. Found 2 new posts.
2026-06-19 21:35:12,983 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-19 21:35:13,009 - GitHubScraper - INFO - Found 241 GitHub repositories for term: paperclip
2026-06-19 21:35:14,038 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-19 21:35:14,040 - GitHubScraper - INFO - Found 382 GitHub repositories for term: "Hermes Agent"
2026-06-19 21:35:15,154 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-19 21:35:15,160 - GitHubScraper - INFO - Found 52 GitHub repositories for term: multica
2026-06-19 21:35:15,291 - GitHubScraper - INFO - Total GitHub results found: 0
2026-06-19 21:35:15,291 - __main__ - INFO - Scraper reddit completed: 7 results
2026-06-19 21:35:15,291 - __main__ - INFO - Scraper github completed: 0 results
2026-06-19 21:35:15,291 - __main__ - INFO - Scraper twitter completed: 0 results
2026-06-19 21:35:15,291 - __main__ - INFO - Scraper linkedin completed: 3 results
2026-06-19 21:35:15,291 - __main__ - INFO - Scraper linkedin_feed completed: 2 results
2026-06-19 21:35:16,095 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-19 21:35:16.095274
2026-06-19 21:35:16,095 - __main__ - INFO - Email sent successfully
2026-06-19 21:35:16,095 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-19 21:35:16,096 - __main__ - INFO - Monitor complete. Found 12 total results: 7 new reddit results, 3 new linkedin results, 2 new linkedin feed results.
2026-06-19 21:35:16,096 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-19 21:35:16,096 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-19 21:35:16,172 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-19 21:35:16,172 - __main__ - INFO - Closed all database connections
2026-06-19 21:35:16,176 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-19 21:35:16,177 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-19 22:00:01,824 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-19.log
2026-06-19 22:00:01,824 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-19.log
2026-06-19 22:00:01,825 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-19.log
2026-06-19 22:00:01,825 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-19 22:00:01,852 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-19 22:00:01,852 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-19 22:00:01,854 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-19 22:00:01,855 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-19 22:00:01,872 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-19 22:00:01,873 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-19 22:00:01,926 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-19 22:00:01,928 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-19 22:00:01,928 - __main__ - INFO - RSS scraper initialized and enabled
2026-06-19 22:00:01,936 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-19 22:00:01,936 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-19 22:00:01,936 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-06-19 22:00:01,939 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-19 22:00:01,944 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-19 22:00:01,944 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=10
2026-06-19 22:00:01,947 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-19 22:00:01,947 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-19 22:00:01,947 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-19 22:00:01,947 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-06-19 22:00:01,947 - __main__ - INFO - Running 3 scrapers concurrently...
2026-06-19 22:00:01,947 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-06-19 22:00:02,046 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-06-19 22:00:02,052 - IveltScraper - INFO - Loaded 181 include, 0 exclude filters from DB topic_filters
2026-06-19 22:00:02,052 - IveltScraper - INFO - Fetching ivelt.com active topics...
2026-06-19 22:00:02,053 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-06-19 22:00:02,308 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-06-19 22:00:02,757 - RSSFeedScraper - INFO - Total RSS/HTML results: 3
2026-06-19 22:00:06,716 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-06-19 22:00:06,930 - Yiddish24Scraper - INFO - Received response with 455942 characters
2026-06-19 22:00:06,933 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (299851 chars)
2026-06-19 22:00:06,936 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-06-19 22:00:07,025 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-06-19 22:00:07,064 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-06-19 22:00:07,064 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-06-19 22:00:07,091 - Yiddish24Scraper - INFO - Term 'פרשת השבוע' matched in DESCRIPTION: 'פרשת השבוע - ווי איז די לאך פון קרח?'
2026-06-19 22:00:07,091 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: הכל בכל
2026-06-19 22:00:07,627 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/INUNIM_SHOINIM_korach_260_260619054037.mp3
2026-06-19 22:00:10,170 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_INUNIM_SHOINIM_korach_260_260619054037.mp3 (59.0 MB)
2026-06-19 22:00:10,171 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-06-19 22:00:10,213 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_INUNIM_SHOINIM_korach_260_260619054037.mp3: title, artist, album, comment, source_url, genre, publisher
2026-06-19 22:00:10,213 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2_INUNIM_SHOINIM_korach_260_260619054037_פרשת_השבוע.mp3
2026-06-19 22:00:10,909 - Yiddish24Scraper - INFO - Page 1 summary: 10 new out of 100 total articles
2026-06-19 22:00:10,909 - Yiddish24Scraper - INFO - Page 1: 10/100 new items
2026-06-19 22:00:10,909 - Yiddish24Scraper - INFO - Low new item ratio (10.0%), stopping pagination
2026-06-19 22:00:10,910 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 10
2026-06-19 22:00:13,713 - IveltScraper - INFO - Found 50 active topics on ivelt.com
2026-06-19 22:00:30,180 - IveltScraper - INFO - Ivelt scrape complete. Checked 4 topics, found 3 new posts.
2026-06-19 22:00:30,180 - __main__ - INFO - Scraper rss completed: 3 results
2026-06-19 22:00:30,180 - __main__ - INFO - Scraper yiddish24 completed: 10 results
2026-06-19 22:00:30,180 - __main__ - INFO - Scraper ivelt completed: 3 results
2026-06-19 22:00:31,511 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-19 22:00:31.511050
2026-06-19 22:00:31,511 - __main__ - INFO - Email sent successfully
2026-06-19 22:00:31,511 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-19 22:00:31,511 - __main__ - INFO - Monitor complete. Found 16 total results: 3 new rss results, 10 new yiddish24 results, 3 new ivelt results.
2026-06-19 22:00:31,511 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-19 22:00:31,511 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-19 22:00:31,653 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-19 22:00:31,653 - __main__ - INFO - Closed all database connections
2026-06-19 22:00:31,655 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-19 22:00:31,655 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-19 22:30:02,215 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-19.log
2026-06-19 22:30:02,216 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-19.log
2026-06-19 22:30:02,216 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-19.log
2026-06-19 22:30:02,216 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-19 22:30:02,243 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-19 22:30:02,243 - social_media_monitor.config.settings - WARNING - Twitter monitoring enabled but credentials validation not implemented
2026-06-19 22:30:02,243 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-19 22:30:02,246 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-19 22:30:02,247 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-19 22:30:02,268 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-19 22:30:02,268 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-19 22:30:02,269 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-19 22:30:02,269 - __main__ - INFO - Reddit scraper initialized and enabled
2026-06-19 22:30:02,269 - __main__ - INFO - GitHub scraper initialized and enabled
2026-06-19 22:30:02,269 - __main__ - INFO - Twitter scraper initialized and enabled
2026-06-19 22:30:02,270 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-19 22:30:02,270 - __main__ - INFO - LinkedIn scraper initialized and enabled
2026-06-19 22:30:02,270 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled
2026-06-19 22:30:02,273 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-19 22:30:02,273 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-19 22:30:02,276 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-19 22:30:02,280 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-19 22:30:02,280 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=10
2026-06-19 22:30:02,282 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-19 22:30:02,282 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-19 22:30:02,282 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-19 22:30:02,283 - __main__ - INFO - Running 5 scrapers concurrently...
2026-06-19 22:30:02,283 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit search monitoring enabled. Running search with terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-19 22:30:02,283 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['"Hermes Agent"']
2026-06-19 22:30:03,155 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term '"Hermes Agent"'
2026-06-19 22:30:03,191 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: The Reach Release — Hermes Agent v0.17.0
2026-06-19 22:30:04,391 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 1
2026-06-19 22:30:04,392 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'paperclip' restricted to subreddits: ['PaperClip_AI', 'PaperclipAI']
2026-06-19 22:30:04,392 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['paperclip']
2026-06-19 22:30:04,392 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/PaperClip_AI+PaperclipAI
2026-06-19 22:30:04,542 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 0 entries for term 'paperclip'
2026-06-19 22:30:05,543 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0
2026-06-19 22:30:05,543 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'multica' restricted to subreddits: ['hermesagent', 'HermesAI']
2026-06-19 22:30:05,543 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['multica']
2026-06-19 22:30:05,543 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/hermesagent+HermesAI
2026-06-19 22:30:05,696 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 0 entries for term 'multica'
2026-06-19 22:30:06,697 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0
2026-06-19 22:30:06,697 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit subreddit feed monitoring enabled.
2026-06-19 22:30:06,697 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'hermes_agent': r/hermesagent+HermesAI+AI_Agents+aiagents+AgentsOfAI+LocalLLaMA+AutoGPT (limit=25)
2026-06-19 22:30:06,697 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes agent via RSS
2026-06-19 22:30:07,859 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes AI via RSS
2026-06-19 22:30:09,011 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: nous research hermes via RSS
2026-06-19 22:30:10,160 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: multica via RSS
2026-06-19 22:30:11,319 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'paperclip_ai': r/PaperClip_AI+PaperclipAI+pAIperclip (limit=25)
2026-06-19 22:30:11,320 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip ai via RSS
2026-06-19 22:30:12,472 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip agent via RSS
2026-06-19 22:30:13,637 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: multica via RSS
2026-06-19 22:30:14,816 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'claude_agents': r/vibecoding (limit=25)
2026-06-19 22:30:14,816 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: multica via RSS
2026-06-19 22:30:15,963 - social_media_monitor.scrapers.reddit_scraper - INFO - Total subreddit feed results: 0
2026-06-19 22:30:15,964 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit top feed monitoring enabled (t=day).
2026-06-19 22:30:15,964 - social_media_monitor.scrapers.reddit_scraper - INFO - Fetching top/day posts from feed 'hermes_agent': ['hermesagent', 'HermesAI', 'AI_Agents', 'aiagents', 'AgentsOfAI', 'LocalLLaMA', 'AutoGPT']
2026-06-19 22:30:46,424 - social_media_monitor.scrapers.reddit_scraper - WARNING - Could not fetch top RSS for r/hermesagent after retries
2026-06-19 22:31:02,176 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit top RSS: 0 entries for r/HermesAI
2026-06-19 22:31:35,612 - social_media_monitor.scrapers.reddit_scraper - WARNING - Could not fetch top RSS for r/AI_Agents after retries
2026-06-19 22:32:06,061 - social_media_monitor.scrapers.reddit_scraper - WARNING - Could not fetch top RSS for r/aiagents after retries
2026-06-19 22:32:06,438 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit top RSS: 5 entries for r/AgentsOfAI
2026-06-19 22:32:39,935 - social_media_monitor.scrapers.reddit_scraper - WARNING - Could not fetch top RSS for r/LocalLLaMA after retries
2026-06-19 22:33:10,377 - social_media_monitor.scrapers.reddit_scraper - WARNING - Could not fetch top RSS for r/AutoGPT after retries
2026-06-19 22:33:10,378 - social_media_monitor.scrapers.reddit_scraper - INFO - Fetching top/day posts from feed 'paperclip_ai': ['PaperClip_AI', 'PaperclipAI', 'pAIperclip']
2026-06-19 22:33:10,644 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit top RSS: 0 entries for r/PaperClip_AI
2026-06-19 22:33:44,102 - social_media_monitor.scrapers.reddit_scraper - WARNING - Could not fetch top RSS for r/PaperclipAI after retries
2026-06-19 22:34:14,553 - social_media_monitor.scrapers.reddit_scraper - WARNING - Could not fetch top RSS for r/pAIperclip after retries
2026-06-19 22:34:14,553 - social_media_monitor.scrapers.reddit_scraper - INFO - Fetching top/day posts from feed 'claude_agents': ['vibecoding']
2026-06-19 22:34:15,290 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit top RSS: 25 entries for r/vibecoding
2026-06-19 22:34:18,500 - social_media_monitor.scrapers.reddit_scraper - INFO - Total top feed results: 0
2026-06-19 22:34:18,502 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-19 22:34:18,626 - TwitterScraper - INFO - Searching Twitter/X (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-19 22:34:19,080 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'paperclip'
2026-06-19 22:34:33,247 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for '"Hermes Agent"'
2026-06-19 22:34:47,626 - TwitterScraper - INFO - Twitter/X RSS: 97 entries for 'multica'
2026-06-19 22:35:00,832 - TwitterScraper - INFO - Twitter scrape complete. Found 0 new results.
2026-06-19 22:35:00,832 - LinkedInScraper - INFO - Searching LinkedIn (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-19 22:35:01,269 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'paperclip'
2026-06-19 22:35:02,526 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for '"Hermes Agent"'
2026-06-19 22:35:02,539 - LinkedInScraper - INFO - New LinkedIn post: Release Hermes Agent v0.17.0 (v2026.6.19) · NousResearch/hermes-agent
2026-06-19 22:35:03,695 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'multica'
2026-06-19 22:35:04,142 - LinkedInScraper - INFO - New LinkedIn post: On Friday I finally published a really information-dense and (hopefull
2026-06-19 22:35:04,298 - LinkedInScraper - INFO - New LinkedIn post: GitHub - KhaledSMQ/greplm: Fast, offline code search and code intellig
2026-06-19 22:35:04,329 - LinkedInScraper - INFO - LinkedIn scrape complete. Found 3 new results.
2026-06-19 22:35:04,330 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)
2026-06-19 22:35:04,716 - LinkedInFeedScraper - INFO - Successfully auto-grabbed fresh LinkedIn cookies and User-Agent from running Chrome!
2026-06-19 22:35:12,803 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Michelle Cortina Quattrocchi - Come Join us! Amazing Opportunity!!
2026-06-19 22:35:12,810 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Chesky Wertzberger - 75 Units. One Building. One Standard.
From the statement staircase to the amenity spaces and residences, every element contributes to the experience of the building.
Proud to have contributed the st
2026-06-19 22:35:12,821 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Ian David Rossi - I’m opening up availability for a new role and actively looking for my next opportunity — W2, contract, or consulting.
My background is in platform engineering, DevOps, infrastructure automation, dev
2026-06-19 22:35:12,849 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Vince Cersosimo - Cannes Lions created a new award category this year. It's not for the best campaign. It's for the best creative infrastructure.
The Creative Brand Lion goes to brands with exceptional internal system
2026-06-19 22:35:12,944 - LinkedInFeedScraper - INFO - LinkedIn Feed scrape complete. Found 4 new posts.
2026-06-19 22:35:13,897 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-19 22:35:13,923 - GitHubScraper - INFO - Found 241 GitHub repositories for term: paperclip
2026-06-19 22:35:14,975 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-19 22:35:14,979 - GitHubScraper - INFO - Found 382 GitHub repositories for term: "Hermes Agent"
2026-06-19 22:35:16,130 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-19 22:35:16,133 - GitHubScraper - INFO - Found 52 GitHub repositories for term: multica
2026-06-19 22:35:16,272 - GitHubScraper - INFO - Total GitHub results found: 0
2026-06-19 22:35:16,272 - __main__ - INFO - Scraper reddit completed: 1 results
2026-06-19 22:35:16,272 - __main__ - INFO - Scraper github completed: 0 results
2026-06-19 22:35:16,272 - __main__ - INFO - Scraper twitter completed: 0 results
2026-06-19 22:35:16,272 - __main__ - INFO - Scraper linkedin completed: 3 results
2026-06-19 22:35:16,272 - __main__ - INFO - Scraper linkedin_feed completed: 4 results
2026-06-19 22:35:17,273 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-19 22:35:17.273239
2026-06-19 22:35:17,273 - __main__ - INFO - Email sent successfully
2026-06-19 22:35:17,273 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-19 22:35:17,274 - __main__ - INFO - Monitor complete. Found 8 total results: 1 new reddit results, 3 new linkedin results, 4 new linkedin feed results.
2026-06-19 22:35:17,274 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-19 22:35:17,274 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-19 22:35:17,398 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-19 22:35:17,398 - __main__ - INFO - Closed all database connections
2026-06-19 22:35:17,402 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-19 22:35:17,402 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-19 23:00:02,086 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-19.log
2026-06-19 23:00:02,086 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-19.log
2026-06-19 23:00:02,086 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-19.log
2026-06-19 23:00:02,086 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-19 23:00:02,113 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-19 23:00:02,113 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-19 23:00:02,116 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-19 23:00:02,116 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-19 23:00:02,142 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-19 23:00:02,143 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-19 23:00:02,207 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-19 23:00:02,209 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-19 23:00:02,209 - __main__ - INFO - RSS scraper initialized and enabled
2026-06-19 23:00:02,215 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-19 23:00:02,215 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-19 23:00:02,215 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-06-19 23:00:02,221 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-19 23:00:02,231 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-19 23:00:02,231 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=10
2026-06-19 23:00:02,233 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-19 23:00:02,233 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-19 23:00:02,234 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-19 23:00:02,234 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-06-19 23:00:02,234 - __main__ - INFO - Running 3 scrapers concurrently...
2026-06-19 23:00:02,234 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-06-19 23:00:02,348 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-06-19 23:00:02,353 - IveltScraper - INFO - Loaded 181 include, 0 exclude filters from DB topic_filters
2026-06-19 23:00:02,353 - IveltScraper - INFO - Fetching ivelt.com active topics...
2026-06-19 23:00:02,356 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-06-19 23:00:02,633 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-06-19 23:00:03,015 - RSSFeedScraper - INFO - Total RSS/HTML results: 3
2026-06-19 23:00:06,288 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-06-19 23:00:06,493 - Yiddish24Scraper - INFO - Received response with 455942 characters
2026-06-19 23:00:06,496 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (299851 chars)
2026-06-19 23:00:06,499 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-06-19 23:00:06,587 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-06-19 23:00:06,627 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-06-19 23:00:06,627 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-06-19 23:00:07,382 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 100 total articles
2026-06-19 23:00:07,382 - Yiddish24Scraper - INFO - Page 1: 0/100 new items
2026-06-19 23:00:07,382 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination
2026-06-19 23:00:07,382 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0
2026-06-19 23:00:14,121 - IveltScraper - INFO - Found 50 active topics on ivelt.com
2026-06-19 23:00:27,883 - IveltScraper - INFO - Ivelt scrape complete. Checked 4 topics, found 14 new posts.
2026-06-19 23:00:27,883 - __main__ - INFO - Scraper rss completed: 3 results
2026-06-19 23:00:27,883 - __main__ - INFO - Scraper yiddish24 completed: 0 results
2026-06-19 23:00:27,883 - __main__ - INFO - Scraper ivelt completed: 14 results
2026-06-19 23:00:28,688 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-19 23:00:28.688810
2026-06-19 23:00:28,689 - __main__ - INFO - Email sent successfully
2026-06-19 23:00:28,689 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-19 23:00:28,689 - __main__ - INFO - Monitor complete. Found 17 total results: 3 new rss results, 14 new ivelt results.
2026-06-19 23:00:28,689 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-19 23:00:28,689 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-19 23:00:28,746 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-19 23:00:28,746 - __main__ - INFO - Closed all database connections
2026-06-19 23:00:28,748 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-19 23:00:28,748 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-19 23:30:01,793 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-19.log
2026-06-19 23:30:01,794 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-19.log
2026-06-19 23:30:01,794 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-19.log
2026-06-19 23:30:01,794 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-19 23:30:01,820 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-19 23:30:01,820 - social_media_monitor.config.settings - WARNING - Twitter monitoring enabled but credentials validation not implemented
2026-06-19 23:30:01,820 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-19 23:30:01,823 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-19 23:30:01,823 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-19 23:30:01,838 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-19 23:30:01,838 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-19 23:30:01,839 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-19 23:30:01,839 - __main__ - INFO - Reddit scraper initialized and enabled
2026-06-19 23:30:01,839 - __main__ - INFO - GitHub scraper initialized and enabled
2026-06-19 23:30:01,840 - __main__ - INFO - Twitter scraper initialized and enabled
2026-06-19 23:30:01,840 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-19 23:30:01,840 - __main__ - INFO - LinkedIn scraper initialized and enabled
2026-06-19 23:30:01,840 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled
2026-06-19 23:30:01,843 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-19 23:30:01,843 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-19 23:30:01,845 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-19 23:30:01,850 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-19 23:30:01,850 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=10
2026-06-19 23:30:01,852 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-19 23:30:01,852 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-19 23:30:01,852 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-19 23:30:01,852 - __main__ - INFO - Running 5 scrapers concurrently...
2026-06-19 23:30:01,853 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit search monitoring enabled. Running search with terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-19 23:30:01,853 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['"Hermes Agent"']
2026-06-19 23:30:02,628 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term '"Hermes Agent"'
2026-06-19 23:30:02,836 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Is it possible to teach Hermes agent to edit videos using editing appl
2026-06-19 23:30:03,936 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 1
2026-06-19 23:30:03,936 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'paperclip' restricted to subreddits: ['PaperClip_AI', 'PaperclipAI']
2026-06-19 23:30:03,936 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['paperclip']
2026-06-19 23:30:03,936 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/PaperClip_AI+PaperclipAI
2026-06-19 23:30:04,083 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 0 entries for term 'paperclip'
2026-06-19 23:30:05,083 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0
2026-06-19 23:30:05,083 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'multica' restricted to subreddits: ['hermesagent', 'HermesAI']
2026-06-19 23:30:05,083 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['multica']
2026-06-19 23:30:05,083 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/hermesagent+HermesAI
2026-06-19 23:30:05,235 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 0 entries for term 'multica'
2026-06-19 23:30:06,235 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0
2026-06-19 23:30:06,236 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit subreddit feed monitoring enabled.
2026-06-19 23:30:06,236 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'hermes_agent': r/hermesagent+HermesAI+AI_Agents+aiagents+AgentsOfAI+LocalLLaMA+AutoGPT (limit=25)
2026-06-19 23:30:06,236 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes agent via RSS
2026-06-19 23:30:07,387 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes AI via RSS
2026-06-19 23:30:08,537 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: nous research hermes via RSS
2026-06-19 23:30:09,690 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: multica via RSS
2026-06-19 23:30:10,844 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'paperclip_ai': r/PaperClip_AI+PaperclipAI+pAIperclip (limit=25)
2026-06-19 23:30:10,844 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip ai via RSS
2026-06-19 23:30:11,996 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip agent via RSS
2026-06-19 23:30:13,144 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: multica via RSS
2026-06-19 23:30:14,298 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'claude_agents': r/vibecoding (limit=25)
2026-06-19 23:30:14,298 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: multica via RSS
2026-06-19 23:30:15,450 - social_media_monitor.scrapers.reddit_scraper - INFO - Total subreddit feed results: 0
2026-06-19 23:30:15,450 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit top feed monitoring enabled (t=day).
2026-06-19 23:30:15,451 - social_media_monitor.scrapers.reddit_scraper - INFO - Fetching top/day posts from feed 'hermes_agent': ['hermesagent', 'HermesAI', 'AI_Agents', 'aiagents', 'AgentsOfAI', 'LocalLLaMA', 'AutoGPT']
2026-06-19 23:30:46,103 - social_media_monitor.scrapers.reddit_scraper - WARNING - Could not fetch top RSS for r/hermesagent after retries
2026-06-19 23:31:01,671 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit top RSS: 0 entries for r/HermesAI
2026-06-19 23:31:35,118 - social_media_monitor.scrapers.reddit_scraper - WARNING - Could not fetch top RSS for r/AI_Agents after retries
2026-06-19 23:32:05,567 - social_media_monitor.scrapers.reddit_scraper - WARNING - Could not fetch top RSS for r/aiagents after retries
2026-06-19 23:32:05,945 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit top RSS: 5 entries for r/AgentsOfAI
2026-06-19 23:32:39,445 - social_media_monitor.scrapers.reddit_scraper - WARNING - Could not fetch top RSS for r/LocalLLaMA after retries
2026-06-19 23:33:09,901 - social_media_monitor.scrapers.reddit_scraper - WARNING - Could not fetch top RSS for r/AutoGPT after retries
2026-06-19 23:33:09,902 - social_media_monitor.scrapers.reddit_scraper - INFO - Fetching top/day posts from feed 'paperclip_ai': ['PaperClip_AI', 'PaperclipAI', 'pAIperclip']
2026-06-19 23:33:10,149 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit top RSS: 0 entries for r/PaperClip_AI
2026-06-19 23:33:43,602 - social_media_monitor.scrapers.reddit_scraper - WARNING - Could not fetch top RSS for r/PaperclipAI after retries
2026-06-19 23:34:14,041 - social_media_monitor.scrapers.reddit_scraper - WARNING - Could not fetch top RSS for r/pAIperclip after retries
2026-06-19 23:34:14,042 - social_media_monitor.scrapers.reddit_scraper - INFO - Fetching top/day posts from feed 'claude_agents': ['vibecoding']
2026-06-19 23:34:14,815 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit top RSS: 25 entries for r/vibecoding
2026-06-19 23:34:14,998 - social_media_monitor.scrapers.reddit_scraper - INFO - New top post from feed 'claude_agents' r/vibecoding: Okay Claude I get it, Fable 5 isn’t an option anymore
2026-06-19 23:34:15,016 - social_media_monitor.scrapers.reddit_scraper - INFO - New top post from feed 'claude_agents' r/vibecoding: Rate my design skills please
2026-06-19 23:34:18,071 - social_media_monitor.scrapers.reddit_scraper - INFO - Total top feed results: 2
2026-06-19 23:34:18,074 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-19 23:34:18,195 - TwitterScraper - INFO - Searching Twitter/X (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-19 23:34:18,660 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'paperclip'
2026-06-19 23:34:32,786 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for '"Hermes Agent"'
2026-06-19 23:34:46,177 - TwitterScraper - INFO - Twitter/X RSS: 56 entries for 'multica'
2026-06-19 23:34:53,968 - TwitterScraper - INFO - Twitter scrape complete. Found 0 new results.
2026-06-19 23:34:53,969 - LinkedInScraper - INFO - Searching LinkedIn (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-19 23:34:54,373 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'paperclip'
2026-06-19 23:34:55,452 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for '"Hermes Agent"'
2026-06-19 23:34:55,508 - LinkedInScraper - INFO - New LinkedIn post: Hermes Agent v0.17.0 - The Reach Release Full Release Notes: https://l
2026-06-19 23:34:55,525 - LinkedInScraper - INFO - New LinkedIn post: GLM 5.2 + Hermes Agent: Build a Multi‑Agent Content Machine! - LinkedI
2026-06-19 23:34:56,585 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'multica'
2026-06-19 23:34:57,345 - LinkedInScraper - INFO - LinkedIn scrape complete. Found 2 new results.
2026-06-19 23:34:57,346 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)
2026-06-19 23:34:57,617 - LinkedInFeedScraper - INFO - Successfully auto-grabbed fresh LinkedIn cookies and User-Agent from running Chrome!
2026-06-19 23:35:04,321 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Jason Abrishami - Proud to share that the Minsky | Abrishami Team was recently recognized as No. 21 of the Top 25 Real Estate Teams in New York City, including Brooklyn, for Team Sales in May 2026 at our firm.
This re
2026-06-19 23:35:04,378 - LinkedInFeedScraper - INFO - LinkedIn Feed scrape complete. Found 1 new posts.
2026-06-19 23:35:05,402 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-19 23:35:05,426 - GitHubScraper - INFO - Found 241 GitHub repositories for term: paperclip
2026-06-19 23:35:06,460 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-19 23:35:06,464 - GitHubScraper - INFO - Found 382 GitHub repositories for term: "Hermes Agent"
2026-06-19 23:35:07,373 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-19 23:35:07,377 - GitHubScraper - INFO - Found 52 GitHub repositories for term: multica
2026-06-19 23:35:07,519 - GitHubScraper - INFO - Total GitHub results found: 0
2026-06-19 23:35:07,519 - __main__ - INFO - Scraper reddit completed: 3 results
2026-06-19 23:35:07,519 - __main__ - INFO - Scraper github completed: 0 results
2026-06-19 23:35:07,519 - __main__ - INFO - Scraper twitter completed: 0 results
2026-06-19 23:35:07,520 - __main__ - INFO - Scraper linkedin completed: 2 results
2026-06-19 23:35:07,520 - __main__ - INFO - Scraper linkedin_feed completed: 1 results
2026-06-19 23:35:08,544 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-19 23:35:08.544893
2026-06-19 23:35:08,545 - __main__ - INFO - Email sent successfully
2026-06-19 23:35:08,545 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-19 23:35:08,545 - __main__ - INFO - Monitor complete. Found 6 total results: 3 new reddit results, 2 new linkedin results, 1 new linkedin feed results.
2026-06-19 23:35:08,545 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-19 23:35:08,545 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-19 23:35:08,633 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-19 23:35:08,634 - __main__ - INFO - Closed all database connections
2026-06-19 23:35:08,637 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-19 23:35:08,637 - social_media_monitor.database.connection - INFO - Closed 0 database connections