โ Logs
social_media_monitor_2026-06-15.log
Nobody explains what they actually are.
Let me fix that in
2026-06-15 20:10:10,429 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Mark Biz - The founding story most people imagine for an AI startup involves ML engineers, cloud budgets, and a
2026-06-15 20:10:10,439 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Joel Gottlieb - Good storyโฆ
I reached out to a customer (that I didnโt hear from in the last few months)about an ol
2026-06-15 20:10:10,468 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Chris Parsons - Replacing your SaaS with an in-house build is the most expensive way to find out what you were actua
2026-06-15 20:10:10,469 - LinkedInFeedScraper - INFO - LinkedIn Feed scrape complete. Found 11 new posts.
2026-06-15 20:10:10,469 - __main__ - INFO - Scraper linkedin_feed completed: 11 results
2026-06-15 20:10:11,022 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-15 20:10:11.022680
2026-06-15 20:10:11,023 - __main__ - INFO - Email sent successfully
2026-06-15 20:10:11,023 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-15 20:10:11,023 - __main__ - INFO - Monitor complete. Found 11 total results: 11 new linkedin feed results.
2026-06-15 20:10:11,023 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-15 20:10:11,023 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-15 20:10:11,048 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-15 20:10:11,048 - __main__ - INFO - Closed all database connections
2026-06-15 20:10:11,049 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-15 20:10:11,049 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-15 20:30:02,485 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-15.log
2026-06-15 20:30:02,485 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-15.log
2026-06-15 20:30:02,485 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-15.log
2026-06-15 20:30:02,485 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-15 20:30:02,509 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-15 20:30:02,511 - social_media_monitor.config.settings - WARNING - Twitter monitoring enabled but credentials validation not implemented
2026-06-15 20:30:02,511 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-15 20:30:02,513 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-15 20:30:02,514 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-15 20:30:02,528 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-15 20:30:02,528 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-15 20:30:02,530 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-15 20:30:02,530 - __main__ - INFO - Reddit scraper initialized and enabled
2026-06-15 20:30:02,530 - __main__ - INFO - GitHub scraper initialized and enabled
2026-06-15 20:30:02,530 - __main__ - INFO - Twitter scraper initialized and enabled
2026-06-15 20:30:02,531 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-15 20:30:02,531 - __main__ - INFO - LinkedIn scraper initialized and enabled
2026-06-15 20:30:02,535 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-15 20:30:02,537 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-15 20:30:02,541 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-15 20:30:02,549 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-15 20:30:02,549 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=5
2026-06-15 20:30:02,552 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-15 20:30:02,552 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-15 20:30:02,553 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-15 20:30:02,553 - __main__ - INFO - Running 4 scrapers concurrently...
2026-06-15 20:30:02,553 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit search monitoring enabled. Running search with terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-15 20:30:02,553 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['"Hermes Agent"']
2026-06-15 20:30:03,676 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term '"Hermes Agent"'
2026-06-15 20:30:03,717 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Hermes-Agent users be like:
2026-06-15 20:30:03,730 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Using Hermes-Agent be like:
2026-06-15 20:30:03,744 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Saving on API usage and handling quota issues
2026-06-15 20:30:03,757 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Hermes Desktop v0.6.1 โ New Release Available
2026-06-15 20:30:04,969 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 4
2026-06-15 20:30:04,970 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'paperclip' restricted to subreddits: ['PaperClip_AI', 'PaperclipAI']
2026-06-15 20:30:04,970 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['paperclip']
2026-06-15 20:30:04,970 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/PaperClip_AI+PaperclipAI
2026-06-15 20:30:05,127 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 0 entries for term 'paperclip'
2026-06-15 20:30:06,127 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0
2026-06-15 20:30:06,128 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'multica' restricted to subreddits: ['hermesagent', 'HermesAI']
2026-06-15 20:30:06,128 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['multica']
2026-06-15 20:30:06,128 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/hermesagent+HermesAI
2026-06-15 20:30:06,280 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 0 entries for term 'multica'
2026-06-15 20:30:07,281 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0
2026-06-15 20:30:07,281 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit subreddit feed monitoring enabled.
2026-06-15 20:30:07,281 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'hermes_agent': r/hermesagent+HermesAI+AI_Agents+aiagents+AgentsOfAI+LocalLLaMA+AutoGPT (limit=25)
2026-06-15 20:30:07,281 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes agent via RSS
2026-06-15 20:30:08,435 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes AI via RSS
2026-06-15 20:30:09,579 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: nous research hermes via RSS
2026-06-15 20:30:10,729 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: multica via RSS
2026-06-15 20:30:11,883 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'paperclip_ai': r/PaperClip_AI+PaperclipAI+pAIperclip (limit=25)
2026-06-15 20:30:11,883 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip ai via RSS
2026-06-15 20:30:13,026 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip agent via RSS
2026-06-15 20:30:14,171 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: multica via RSS
2026-06-15 20:30:15,318 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'claude_agents': r/vibecoding (limit=25)
2026-06-15 20:30:15,318 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: multica via RSS
2026-06-15 20:30:16,473 - social_media_monitor.scrapers.reddit_scraper - INFO - Total subreddit feed results: 0
2026-06-15 20:30:16,474 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-15 20:30:16,616 - TwitterScraper - INFO - Searching Twitter/X (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-15 20:30:17,014 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'paperclip'
2026-06-15 20:30:23,084 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for '"Hermes Agent"'
2026-06-15 20:30:28,988 - TwitterScraper - INFO - Twitter/X RSS: 92 entries for 'multica'
2026-06-15 20:30:34,420 - TwitterScraper - INFO - Twitter scrape complete. Found 0 new results.
2026-06-15 20:30:34,421 - LinkedInScraper - INFO - Searching LinkedIn (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-15 20:30:34,912 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'paperclip'
2026-06-15 20:30:36,325 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for '"Hermes Agent"'
2026-06-15 20:30:36,571 - LinkedInScraper - INFO - New LinkedIn post: ๐๐ก๐๐ญ ๐ข๐ฌ ๐๐๐ซ๐ฆ๐๐ฌ ๐๐ ๐๐ง๐ญ - ๐๐ก๐ฒ ๐ข๐ฌ ๐๐ฏ๐๐ซ๐ฒ๐จ๐ง๐ ๐ญ๐๐ฅ๐ค๐ข๐ง๐ ๐๐๐จ๐ฎ๐ญ ๐ข๐ญ ? At first, I
2026-06-15 20:30:36,732 - LinkedInScraper - INFO - New LinkedIn post: NEW Hermes Agent Update Changes EVERYTHING! - LinkedIn
2026-06-15 20:30:36,861 - LinkedInScraper - INFO - New LinkedIn post: ๐จ BREAKING: The Ultimate Hermes Agent Guide for e-Commerce Managers I'
2026-06-15 20:30:36,880 - LinkedInScraper - INFO - New LinkedIn post: FREE Hermes Skills That Save Hours Of Work - LinkedIn
2026-06-15 20:30:36,946 - LinkedInScraper - INFO - New LinkedIn post: Hermes Agent just dropped an Automation Blueprints update. It turns an
2026-06-15 20:30:37,727 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'multica'
2026-06-15 20:30:38,423 - LinkedInScraper - INFO - New LinkedIn post: Lisa Nono - Northwestern Medicine - LinkedIn
2026-06-15 20:30:38,455 - LinkedInScraper - INFO - New LinkedIn post: 3 things I've learnt on Claude Code as an absolute beginner. 1. Contex
2026-06-15 20:30:38,550 - LinkedInScraper - INFO - LinkedIn scrape complete. Found 7 new results.
2026-06-15 20:30:39,709 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-15 20:30:39,734 - GitHubScraper - INFO - Found 239 GitHub repositories for term: paperclip
2026-06-15 20:30:41,035 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-15 20:30:41,039 - GitHubScraper - INFO - Found 365 GitHub repositories for term: "Hermes Agent"
2026-06-15 20:30:42,136 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-15 20:30:42,140 - GitHubScraper - INFO - Found 52 GitHub repositories for term: multica
2026-06-15 20:30:42,289 - GitHubScraper - INFO - Total GitHub results found: 0
2026-06-15 20:30:42,289 - __main__ - INFO - Scraper reddit completed: 4 results
2026-06-15 20:30:42,289 - __main__ - INFO - Scraper github completed: 0 results
2026-06-15 20:30:42,289 - __main__ - INFO - Scraper twitter completed: 0 results
2026-06-15 20:30:42,289 - __main__ - INFO - Scraper linkedin completed: 7 results
2026-06-15 20:30:42,917 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-15 20:30:42.917002
2026-06-15 20:30:42,917 - __main__ - INFO - Email sent successfully
2026-06-15 20:30:42,917 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-15 20:30:42,917 - __main__ - INFO - Monitor complete. Found 11 total results: 4 new reddit results, 7 new linkedin results.
2026-06-15 20:30:42,917 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-15 20:30:42,917 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-15 20:30:43,038 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-15 20:30:43,038 - __main__ - INFO - Closed all database connections
2026-06-15 20:30:43,040 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-15 20:30:43,040 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-15 21:00:01,670 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-15.log
2026-06-15 21:00:01,671 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-15.log
2026-06-15 21:00:01,671 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-15.log
2026-06-15 21:00:01,672 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-15 21:00:01,695 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-15 21:00:01,695 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-15 21:00:01,698 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-15 21:00:01,699 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-15 21:00:01,722 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-15 21:00:01,723 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-15 21:00:01,724 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-15 21:00:01,725 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-15 21:00:01,725 - __main__ - INFO - RSS scraper initialized and enabled
2026-06-15 21:00:01,727 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-15 21:00:01,727 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-15 21:00:01,727 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-06-15 21:00:01,730 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-15 21:00:01,734 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-15 21:00:01,734 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=5
2026-06-15 21:00:01,737 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-15 21:00:01,737 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-15 21:00:01,737 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-15 21:00:01,737 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-06-15 21:00:01,737 - __main__ - INFO - Running 3 scrapers concurrently...
2026-06-15 21:00:01,737 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-06-15 21:00:01,867 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-06-15 21:00:01,877 - IveltScraper - INFO - Loaded 181 include, 0 exclude filters from DB topic_filters
2026-06-15 21:00:01,877 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-06-15 21:00:01,881 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-06-15 21:00:02,491 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-06-15 21:00:03,186 - RSSFeedScraper - INFO - Total RSS/HTML results: 4
2026-06-15 21:00:06,897 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-06-15 21:00:07,127 - Yiddish24Scraper - INFO - Received response with 472439 characters
2026-06-15 21:00:07,130 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (301099 chars)
2026-06-15 21:00:07,132 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-06-15 21:00:07,213 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-06-15 21:00:07,252 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-06-15 21:00:07,252 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-06-15 21:00:08,090 - Yiddish24Scraper - INFO - Page 1 summary: 11 new out of 100 total articles
2026-06-15 21:00:08,091 - Yiddish24Scraper - INFO - Page 1: 11/100 new items
2026-06-15 21:00:08,091 - Yiddish24Scraper - INFO - Low new item ratio (11.0%), stopping pagination
2026-06-15 21:00:08,091 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 11
2026-06-15 21:00:13,454 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-06-15 21:00:16,344 - IveltScraper - INFO - Filtering post containing exclude term: '*ืืืืข ืืืื ืืืืขืจ ืืืืื ืฆื ืืืจืืืื ืงืจืื ืืข ื ืืืขืก*'
2026-06-15 21:00:48,611 - IveltScraper - INFO - ivelt scrape complete. Checked 2 topics.
2026-06-15 21:00:48,612 - IveltScraper - INFO - All forums scrape complete. Found 20 new posts.
2026-06-15 21:00:48,612 - __main__ - INFO - Scraper rss completed: 4 results
2026-06-15 21:00:48,612 - __main__ - INFO - Scraper yiddish24 completed: 11 results
2026-06-15 21:00:48,612 - __main__ - INFO - Scraper ivelt completed: 20 results
2026-06-15 21:00:49,282 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-15 21:00:49.282007
2026-06-15 21:00:49,282 - __main__ - INFO - Email sent successfully
2026-06-15 21:00:49,282 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-15 21:00:49,282 - __main__ - INFO - Monitor complete. Found 35 total results: 4 new rss results, 11 new yiddish24 results, 20 new ivelt results.
2026-06-15 21:00:49,282 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-15 21:00:49,282 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-15 21:00:49,427 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-15 21:00:49,427 - __main__ - INFO - Closed all database connections
2026-06-15 21:00:49,430 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-15 21:00:49,430 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-15 21:10:01,714 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-15.log
2026-06-15 21:10:01,714 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-15.log
2026-06-15 21:10:01,714 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-15.log
2026-06-15 21:10:01,714 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-15 21:10:01,738 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-15 21:10:01,738 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-15 21:10:01,740 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-15 21:10:01,741 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-15 21:10:01,756 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-15 21:10:01,756 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-15 21:10:01,757 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-15 21:10:01,758 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-15 21:10:01,758 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled
2026-06-15 21:10:01,760 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-15 21:10:01,760 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-15 21:10:01,763 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-15 21:10:01,767 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-15 21:10:01,767 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=5
2026-06-15 21:10:01,769 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-15 21:10:01,769 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-15 21:10:01,769 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-15 21:10:01,769 - __main__ - INFO - Running 1 scrapers concurrently...
2026-06-15 21:10:01,769 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)
2026-06-15 21:10:04,643 - LinkedInFeedScraper - ERROR - LinkedIn feed fetch failed: Unauthorized: LinkedIn session cookies are expired or invalid.
2026-06-15 21:10:04,643 - __main__ - INFO - Scraper linkedin_feed completed: 0 results
2026-06-15 21:10:04,643 - __main__ - INFO - No new results found across all enabled sources
2026-06-15 21:10:04,643 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-15 21:10:04,644 - __main__ - INFO - Monitor complete. No new results found across all sources.
2026-06-15 21:10:04,644 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-15 21:10:04,644 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-15 21:10:04,659 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-15 21:10:04,659 - __main__ - INFO - Closed all database connections
2026-06-15 21:10:04,660 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-15 21:10:04,660 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-15 22:00:01,754 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-15.log
2026-06-15 22:00:01,754 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-15.log
2026-06-15 22:00:01,754 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-15.log
2026-06-15 22:00:01,755 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-15 22:00:01,777 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-15 22:00:01,778 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-15 22:00:01,780 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-15 22:00:01,780 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-15 22:00:01,806 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-15 22:00:01,806 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-15 22:00:01,870 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-15 22:00:01,872 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-15 22:00:01,872 - __main__ - INFO - RSS scraper initialized and enabled
2026-06-15 22:00:01,878 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-15 22:00:01,878 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-15 22:00:01,878 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-06-15 22:00:01,883 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-15 22:00:01,890 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-15 22:00:01,890 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=5
2026-06-15 22:00:01,892 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-15 22:00:01,892 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-15 22:00:01,892 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-15 22:00:01,892 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-06-15 22:00:01,892 - __main__ - INFO - Running 3 scrapers concurrently...
2026-06-15 22:00:01,892 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-06-15 22:00:01,984 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-06-15 22:00:01,989 - IveltScraper - INFO - Loaded 181 include, 0 exclude filters from DB topic_filters
2026-06-15 22:00:01,989 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-06-15 22:00:01,991 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-06-15 22:00:02,240 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-06-15 22:00:02,640 - RSSFeedScraper - INFO - Total RSS/HTML results: 3
2026-06-15 22:00:05,928 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-06-15 22:00:06,138 - Yiddish24Scraper - INFO - Received response with 462959 characters
2026-06-15 22:00:06,141 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (298637 chars)
2026-06-15 22:00:06,144 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-06-15 22:00:06,229 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-06-15 22:00:06,268 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-06-15 22:00:06,268 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-06-15 22:00:06,278 - Yiddish24Scraper - INFO - Term 'ืืืืขืจ ืืืก ืืื ืืขื ืฅ -' matched in DESCRIPTION: 'ืืืืขืจ ืืืก ืืื ืืขื ืฅ - ืืื ืฉืืคื ืืขื ืืคืืจ ืืืืขืจ?'
2026-06-15 22:00:06,278 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ืืื ืืื
2026-06-15 22:00:07,029 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/DUS_IN_YENTZ_gelt_1_260_260615055605.mp3
2026-06-15 22:00:07,179 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_DUS_IN_YENTZ_gelt_1_260_260615055605.mp3 (14.1 MB)
2026-06-15 22:00:07,179 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-06-15 22:00:07,189 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_DUS_IN_YENTZ_gelt_1_260_260615055605.mp3: title, artist, album, comment, source_url, genre, publisher
2026-06-15 22:00:07,190 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2_DUS_IN_YENTZ_gelt_1_260_260615055605_ืืืืขืจ_ืืืก_ืืื_ืืขื ืฅ_-.mp3
2026-06-15 22:00:07,848 - Yiddish24Scraper - INFO - Page 1 summary: 6 new out of 100 total articles
2026-06-15 22:00:07,849 - Yiddish24Scraper - INFO - Page 1: 6/100 new items
2026-06-15 22:00:07,849 - Yiddish24Scraper - INFO - Low new item ratio (6.0%), stopping pagination
2026-06-15 22:00:07,849 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 6
2026-06-15 22:00:13,606 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-06-15 22:00:23,534 - IveltScraper - INFO - Filtering post containing exclude term: '*ืืืืข ืืืื ืืืืขืจ ืืืืื ืฆื ืืืจืืืื ืงืจืื ืืข ื ืืืขืก*'
2026-06-15 22:00:36,373 - IveltScraper - INFO - ivelt scrape complete. Checked 4 topics.
2026-06-15 22:00:36,373 - IveltScraper - INFO - All forums scrape complete. Found 21 new posts.
2026-06-15 22:00:36,374 - __main__ - INFO - Scraper rss completed: 3 results
2026-06-15 22:00:36,374 - __main__ - INFO - Scraper yiddish24 completed: 6 results
2026-06-15 22:00:36,374 - __main__ - INFO - Scraper ivelt completed: 21 results
2026-06-15 22:00:37,071 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-15 22:00:37.071833
2026-06-15 22:00:37,072 - __main__ - INFO - Email sent successfully
2026-06-15 22:00:37,072 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-15 22:00:37,072 - __main__ - INFO - Monitor complete. Found 30 total results: 3 new rss results, 6 new yiddish24 results, 21 new ivelt results.
2026-06-15 22:00:37,072 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-15 22:00:37,072 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-15 22:00:37,216 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-15 22:00:37,216 - __main__ - INFO - Closed all database connections
2026-06-15 22:00:37,219 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-15 22:00:37,219 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-15 22:10:02,535 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-15.log
2026-06-15 22:10:02,535 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-15.log
2026-06-15 22:10:02,535 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-15.log
2026-06-15 22:10:02,535 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-15 22:10:02,558 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-15 22:10:02,558 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-15 22:10:02,560 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-15 22:10:02,561 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-15 22:10:02,581 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-15 22:10:02,582 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-15 22:10:02,583 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-15 22:10:02,583 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-15 22:10:02,584 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled
2026-06-15 22:10:02,586 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-15 22:10:02,586 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-15 22:10:02,588 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-15 22:10:02,593 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-15 22:10:02,593 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=5
2026-06-15 22:10:02,595 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-15 22:10:02,595 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-15 22:10:02,595 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-15 22:10:02,595 - __main__ - INFO - Running 1 scrapers concurrently...
2026-06-15 22:10:02,595 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)
2026-06-15 22:10:05,594 - LinkedInFeedScraper - ERROR - LinkedIn feed fetch failed: Unauthorized: LinkedIn session cookies are expired or invalid.
2026-06-15 22:10:05,595 - __main__ - INFO - Scraper linkedin_feed completed: 0 results
2026-06-15 22:10:05,595 - __main__ - INFO - No new results found across all enabled sources
2026-06-15 22:10:05,595 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-15 22:10:05,595 - __main__ - INFO - Monitor complete. No new results found across all sources.
2026-06-15 22:10:05,595 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-15 22:10:05,595 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-15 22:10:05,608 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-15 22:10:05,609 - __main__ - INFO - Closed all database connections
2026-06-15 22:10:05,610 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-15 22:10:05,610 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-15 22:30:02,085 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-15.log
2026-06-15 22:30:02,085 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-15.log
2026-06-15 22:30:02,085 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-15.log
2026-06-15 22:30:02,085 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-15 22:30:02,108 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-15 22:30:02,108 - social_media_monitor.config.settings - WARNING - Twitter monitoring enabled but credentials validation not implemented
2026-06-15 22:30:02,108 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-15 22:30:02,110 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-15 22:30:02,111 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-15 22:30:02,125 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-15 22:30:02,125 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-15 22:30:02,126 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-15 22:30:02,126 - __main__ - INFO - Reddit scraper initialized and enabled
2026-06-15 22:30:02,126 - __main__ - INFO - GitHub scraper initialized and enabled
2026-06-15 22:30:02,126 - __main__ - INFO - Twitter scraper initialized and enabled
2026-06-15 22:30:02,127 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-15 22:30:02,127 - __main__ - INFO - LinkedIn scraper initialized and enabled
2026-06-15 22:30:02,130 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-15 22:30:02,130 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-15 22:30:02,133 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-15 22:30:02,138 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-15 22:30:02,138 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=5
2026-06-15 22:30:02,140 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-15 22:30:02,141 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-15 22:30:02,141 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-15 22:30:02,141 - __main__ - INFO - Running 4 scrapers concurrently...
2026-06-15 22:30:02,141 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit search monitoring enabled. Running search with terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-15 22:30:02,141 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['"Hermes Agent"']
2026-06-15 22:30:02,965 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term '"Hermes Agent"'
2026-06-15 22:30:03,181 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: I got tired of my AI agents getting blocked by every website, so I bui
2026-06-15 22:30:03,194 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Need genuine feedback or roast
2026-06-15 22:30:04,443 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 2
2026-06-15 22:30:04,443 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'paperclip' restricted to subreddits: ['PaperClip_AI', 'PaperclipAI']
2026-06-15 22:30:04,443 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['paperclip']
2026-06-15 22:30:04,443 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/PaperClip_AI+PaperclipAI
2026-06-15 22:30:04,589 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 0 entries for term 'paperclip'
2026-06-15 22:30:05,589 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0
2026-06-15 22:30:05,589 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'multica' restricted to subreddits: ['hermesagent', 'HermesAI']
2026-06-15 22:30:05,589 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['multica']
2026-06-15 22:30:05,590 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/hermesagent+HermesAI
2026-06-15 22:30:05,742 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 0 entries for term 'multica'
2026-06-15 22:30:06,742 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0
2026-06-15 22:30:06,742 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit subreddit feed monitoring enabled.
2026-06-15 22:30:06,742 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'hermes_agent': r/hermesagent+HermesAI+AI_Agents+aiagents+AgentsOfAI+LocalLLaMA+AutoGPT (limit=25)
2026-06-15 22:30:06,742 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes agent via RSS
2026-06-15 22:30:07,890 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes AI via RSS
2026-06-15 22:30:09,045 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: nous research hermes via RSS
2026-06-15 22:30:10,401 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: multica via RSS
2026-06-15 22:30:11,552 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'paperclip_ai': r/PaperClip_AI+PaperclipAI+pAIperclip (limit=25)
2026-06-15 22:30:11,553 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip ai via RSS
2026-06-15 22:30:12,698 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip agent via RSS
2026-06-15 22:30:13,847 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: multica via RSS
2026-06-15 22:30:14,997 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'claude_agents': r/vibecoding (limit=25)
2026-06-15 22:30:14,998 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: multica via RSS
2026-06-15 22:30:16,150 - social_media_monitor.scrapers.reddit_scraper - INFO - Total subreddit feed results: 0
2026-06-15 22:30:16,151 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-15 22:30:16,292 - TwitterScraper - INFO - Searching Twitter/X (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-15 22:30:16,720 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'paperclip'
2026-06-15 22:30:22,816 - TwitterScraper - INFO - New tweet/X post: The Microsoft Paperclip is not amused with its new career as a General
2026-06-15 22:30:23,293 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for '"Hermes Agent"'
2026-06-15 22:30:26,751 - TwitterScraper - INFO - New tweet/X post: Hermes Agent pro tip:
Don't just read this article.
Paste the entire
2026-06-15 22:30:29,322 - TwitterScraper - INFO - New tweet/X post: Last Saturday, we hosted Build with Hermes Agent at @2586labs, bringin
2026-06-15 22:30:31,246 - TwitterScraper - INFO - Twitter/X RSS: 91 entries for 'multica'
2026-06-15 22:30:36,875 - TwitterScraper - INFO - Twitter scrape complete. Found 3 new results.
2026-06-15 22:30:36,876 - LinkedInScraper - INFO - Searching LinkedIn (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-15 22:30:37,467 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'paperclip'
2026-06-15 22:30:38,582 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for '"Hermes Agent"'
2026-06-15 22:30:38,700 - LinkedInScraper - INFO - New LinkedIn post: What have I learned running 3 weeks with Hermes โ the open-source agen
2026-06-15 22:30:39,793 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'multica'
2026-06-15 22:30:40,426 - LinkedInScraper - INFO - LinkedIn scrape complete. Found 1 new results.
2026-06-15 22:30:41,575 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-15 22:30:41,600 - GitHubScraper - INFO - Found 239 GitHub repositories for term: paperclip
2026-06-15 22:30:42,756 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-15 22:30:42,758 - GitHubScraper - INFO - Found 365 GitHub repositories for term: "Hermes Agent"
2026-06-15 22:30:42,822 - GitHubScraper - INFO - Added new GitHub repository: computer-use-linux
2026-06-15 22:30:43,806 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-15 22:30:43,811 - GitHubScraper - INFO - Found 52 GitHub repositories for term: multica
2026-06-15 22:30:43,985 - GitHubScraper - INFO - Total GitHub results found: 1
2026-06-15 22:30:43,985 - __main__ - INFO - Scraper reddit completed: 2 results
2026-06-15 22:30:43,985 - __main__ - INFO - Scraper github completed: 1 results
2026-06-15 22:30:43,985 - __main__ - INFO - Scraper twitter completed: 3 results
2026-06-15 22:30:43,985 - __main__ - INFO - Scraper linkedin completed: 1 results
2026-06-15 22:30:44,563 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-15 22:30:44.563038
2026-06-15 22:30:44,563 - __main__ - INFO - Email sent successfully
2026-06-15 22:30:44,563 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-15 22:30:44,563 - __main__ - INFO - Monitor complete. Found 7 total results: 2 new reddit results, 1 new github results, 3 new twitter results, 1 new linkedin results.
2026-06-15 22:30:44,563 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-15 22:30:44,563 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-15 22:30:44,675 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-15 22:30:44,675 - __main__ - INFO - Closed all database connections
2026-06-15 22:30:44,677 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-15 22:30:44,677 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-15 23:00:02,147 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-15.log
2026-06-15 23:00:02,149 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-15.log
2026-06-15 23:00:02,149 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-15.log
2026-06-15 23:00:02,149 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-15 23:00:02,174 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-15 23:00:02,174 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-15 23:00:02,176 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-15 23:00:02,177 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-15 23:00:02,196 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-15 23:00:02,196 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-15 23:00:02,245 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-15 23:00:02,246 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-15 23:00:02,246 - __main__ - INFO - RSS scraper initialized and enabled
2026-06-15 23:00:02,248 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-15 23:00:02,248 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-15 23:00:02,248 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-06-15 23:00:02,251 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-15 23:00:02,255 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-15 23:00:02,255 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=5
2026-06-15 23:00:02,257 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-15 23:00:02,257 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-15 23:00:02,258 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-15 23:00:02,258 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-06-15 23:00:02,258 - __main__ - INFO - Running 3 scrapers concurrently...
2026-06-15 23:00:02,258 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-06-15 23:00:02,350 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-06-15 23:00:02,357 - IveltScraper - INFO - Loaded 181 include, 0 exclude filters from DB topic_filters
2026-06-15 23:00:02,357 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-06-15 23:00:02,358 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-06-15 23:00:03,908 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-06-15 23:00:04,309 - RSSFeedScraper - INFO - Total RSS/HTML results: 3
2026-06-15 23:00:09,357 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-06-15 23:00:09,569 - Yiddish24Scraper - INFO - Received response with 477542 characters
2026-06-15 23:00:09,570 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (305745 chars)
2026-06-15 23:00:09,571 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-06-15 23:00:09,634 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-06-15 23:00:09,674 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-06-15 23:00:09,674 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-06-15 23:00:10,747 - Yiddish24Scraper - INFO - Page 1 summary: 12 new out of 100 total articles
2026-06-15 23:00:10,747 - Yiddish24Scraper - INFO - Page 1: 12/100 new items
2026-06-15 23:00:10,747 - Yiddish24Scraper - INFO - Low new item ratio (12.0%), stopping pagination
2026-06-15 23:00:10,748 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 12
2026-06-15 23:00:15,039 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-06-15 23:00:59,092 - IveltScraper - INFO - ivelt scrape complete. Checked 5 topics.
2026-06-15 23:00:59,092 - IveltScraper - INFO - All forums scrape complete. Found 15 new posts.
2026-06-15 23:00:59,092 - __main__ - INFO - Scraper rss completed: 3 results
2026-06-15 23:00:59,093 - __main__ - INFO - Scraper yiddish24 completed: 12 results
2026-06-15 23:00:59,093 - __main__ - INFO - Scraper ivelt completed: 15 results
2026-06-15 23:00:59,758 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-15 23:00:59.758247
2026-06-15 23:00:59,758 - __main__ - INFO - Email sent successfully
2026-06-15 23:00:59,758 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-15 23:00:59,759 - __main__ - INFO - Monitor complete. Found 30 total results: 3 new rss results, 12 new yiddish24 results, 15 new ivelt results.
2026-06-15 23:00:59,759 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-15 23:00:59,759 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-15 23:00:59,821 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-15 23:00:59,822 - __main__ - INFO - Closed all database connections
2026-06-15 23:00:59,823 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-15 23:00:59,823 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-15 23:10:02,177 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-15.log
2026-06-15 23:10:02,178 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-15.log
2026-06-15 23:10:02,178 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-15.log
2026-06-15 23:10:02,178 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-15 23:10:02,201 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-15 23:10:02,201 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-15 23:10:02,203 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-15 23:10:02,203 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-15 23:10:02,240 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-15 23:10:02,240 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-15 23:10:02,242 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-15 23:10:02,243 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-15 23:10:02,243 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled
2026-06-15 23:10:02,246 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-15 23:10:02,246 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-15 23:10:02,249 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-15 23:10:02,253 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-15 23:10:02,253 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=5
2026-06-15 23:10:02,255 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-15 23:10:02,256 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-15 23:10:02,256 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-15 23:10:02,256 - __main__ - INFO - Running 1 scrapers concurrently...
2026-06-15 23:10:02,256 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)
2026-06-15 23:10:08,342 - LinkedInFeedScraper - ERROR - LinkedIn feed fetch failed: Unauthorized: LinkedIn session cookies are expired or invalid.
2026-06-15 23:10:08,343 - __main__ - INFO - Scraper linkedin_feed completed: 0 results
2026-06-15 23:10:08,343 - __main__ - INFO - No new results found across all enabled sources
2026-06-15 23:10:08,343 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-15 23:10:08,343 - __main__ - INFO - Monitor complete. No new results found across all sources.
2026-06-15 23:10:08,343 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-15 23:10:08,343 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-15 23:10:08,356 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-15 23:10:08,356 - __main__ - INFO - Closed all database connections
2026-06-15 23:10:08,357 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-15 23:10:08,357 - social_media_monitor.database.connection - INFO - Closed 0 database connections
Live tail active โ waiting for new lines...