← Logs

social_media_monitor_2026-05-30.log

2026-05-30 18:45:04,802 - __main__ - INFO - Scraper ahblicklive completed: 1 results
2026-05-30 18:45:05,472 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-30 18:45:05.472474
2026-05-30 18:45:05,472 - __main__ - INFO - Email sent successfully
2026-05-30 18:45:05,473 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-05-30 18:45:05,473 - __main__ - INFO - Monitor complete. Found 1 total results: 1 new ahblicklive results.
2026-05-30 18:45:05,473 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-05-30 18:45:05,473 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-30 18:45:05,483 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-05-30 18:45:05,483 - __main__ - INFO - Closed all database connections
2026-05-30 18:45:05,486 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-30 18:45:05,487 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-05-30 19:00:02,437 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-30.log
2026-05-30 19:00:02,437 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-30.log
2026-05-30 19:00:02,437 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-30.log
2026-05-30 19:00:02,437 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-05-30 19:00:02,473 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-05-30 19:00:02,474 - __main__ - INFO - Configuration loaded and validated successfully
2026-05-30 19:00:02,476 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-05-30 19:00:02,477 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-05-30 19:00:02,497 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-05-30 19:00:02,497 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-05-30 19:00:02,498 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-05-30 19:00:02,499 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0
2026-05-30 19:00:02,499 - __main__ - INFO - RSS scraper initialized and enabled
2026-05-30 19:00:02,501 - Yiddish24Scraper - INFO - File downloader initialized with 30 terms, prefix 'Y2', and file type organization enabled
2026-05-30 19:00:02,502 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=30, exclude_terms=0
2026-05-30 19:00:02,502 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-05-30 19:00:02,504 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0
2026-05-30 19:00:02,509 - TorahAnytimeScraper - INFO - File downloader initialized with 51 terms, prefix 'TA', and file type organization enabled
2026-05-30 19:00:02,509 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=51, exclude_terms=3
2026-05-30 19:00:02,511 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-05-30 19:00:02,511 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0
2026-05-30 19:00:02,511 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-05-30 19:00:02,511 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-05-30 19:00:02,511 - __main__ - INFO - Running 3 scrapers concurrently...
2026-05-30 19:00:02,511 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-05-30 19:00:02,598 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-05-30 19:00:02,603 - IveltScraper - INFO - Loaded 178 include, 0 exclude filters from DB topic_filters
2026-05-30 19:00:02,603 - IveltScraper - INFO - Fetching ivelt.com active topics...
2026-05-30 19:00:02,605 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-05-30 19:00:02,933 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-05-30 19:00:03,408 - RSSFeedScraper - INFO - Total RSS/HTML results: 3
2026-05-30 19:00:03,808 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-05-30 19:00:03,998 - Yiddish24Scraper - INFO - Received response with 521999 characters
2026-05-30 19:00:04,001 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (319115 chars)
2026-05-30 19:00:04,004 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-05-30 19:00:04,093 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-05-30 19:00:04,135 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-05-30 19:00:04,135 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-05-30 19:00:04,812 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 100 total articles
2026-05-30 19:00:04,812 - Yiddish24Scraper - INFO - Page 1: 0/100 new items
2026-05-30 19:00:04,813 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination
2026-05-30 19:00:04,813 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0
2026-05-30 19:00:14,435 - IveltScraper - INFO - Found 50 active topics on ivelt.com
2026-05-30 19:00:37,600 - IveltScraper - INFO - Ivelt scrape complete. Checked 7 topics, found 0 new posts.
2026-05-30 19:00:37,600 - __main__ - INFO - Scraper rss completed: 3 results
2026-05-30 19:00:37,600 - __main__ - INFO - Scraper yiddish24 completed: 0 results
2026-05-30 19:00:37,600 - __main__ - INFO - Scraper ivelt completed: 0 results
2026-05-30 19:00:38,335 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-30 19:00:38.335345
2026-05-30 19:00:38,335 - __main__ - INFO - Email sent successfully
2026-05-30 19:00:38,336 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-05-30 19:00:38,336 - __main__ - INFO - Monitor complete. Found 3 total results: 3 new rss results.
2026-05-30 19:00:38,336 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-05-30 19:00:38,336 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-30 19:00:38,465 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-05-30 19:00:38,465 - __main__ - INFO - Closed all database connections
2026-05-30 19:00:38,468 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-30 19:00:38,468 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-05-30 20:00:01,895 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-30.log
2026-05-30 20:00:01,895 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-30.log
2026-05-30 20:00:01,895 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-30.log
2026-05-30 20:00:01,895 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-05-30 20:00:01,938 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-05-30 20:00:01,939 - __main__ - INFO - Configuration loaded and validated successfully
2026-05-30 20:00:01,942 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-05-30 20:00:01,943 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-05-30 20:00:01,962 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-05-30 20:00:01,962 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-05-30 20:00:02,009 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-05-30 20:00:02,011 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0
2026-05-30 20:00:02,011 - __main__ - INFO - RSS scraper initialized and enabled
2026-05-30 20:00:02,015 - Yiddish24Scraper - INFO - File downloader initialized with 30 terms, prefix 'Y2', and file type organization enabled
2026-05-30 20:00:02,015 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=30, exclude_terms=0
2026-05-30 20:00:02,015 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-05-30 20:00:02,017 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0
2026-05-30 20:00:02,022 - TorahAnytimeScraper - INFO - File downloader initialized with 51 terms, prefix 'TA', and file type organization enabled
2026-05-30 20:00:02,022 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=51, exclude_terms=3
2026-05-30 20:00:02,024 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-05-30 20:00:02,024 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0
2026-05-30 20:00:02,024 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-05-30 20:00:02,024 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-05-30 20:00:02,024 - __main__ - INFO - Running 3 scrapers concurrently...
2026-05-30 20:00:02,024 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-05-30 20:00:02,111 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-05-30 20:00:02,115 - IveltScraper - INFO - Loaded 178 include, 0 exclude filters from DB topic_filters
2026-05-30 20:00:02,115 - IveltScraper - INFO - Fetching ivelt.com active topics...
2026-05-30 20:00:02,116 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-05-30 20:00:02,435 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-05-30 20:00:02,900 - RSSFeedScraper - INFO - Total RSS/HTML results: 3
2026-05-30 20:00:03,273 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-05-30 20:00:03,463 - Yiddish24Scraper - INFO - Received response with 521999 characters
2026-05-30 20:00:03,466 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (319115 chars)
2026-05-30 20:00:03,469 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-05-30 20:00:03,558 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-05-30 20:00:03,602 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-05-30 20:00:03,602 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-05-30 20:00:04,271 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 100 total articles
2026-05-30 20:00:04,271 - Yiddish24Scraper - INFO - Page 1: 0/100 new items
2026-05-30 20:00:04,271 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination
2026-05-30 20:00:04,271 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0
2026-05-30 20:00:14,034 - IveltScraper - INFO - Found 50 active topics on ivelt.com
2026-05-30 20:00:34,987 - IveltScraper - INFO - Ivelt scrape complete. Checked 6 topics, found 0 new posts.
2026-05-30 20:00:34,987 - __main__ - INFO - Scraper rss completed: 3 results
2026-05-30 20:00:34,987 - __main__ - INFO - Scraper yiddish24 completed: 0 results
2026-05-30 20:00:34,987 - __main__ - INFO - Scraper ivelt completed: 0 results
2026-05-30 20:00:35,624 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-30 20:00:35.624411
2026-05-30 20:00:35,624 - __main__ - INFO - Email sent successfully
2026-05-30 20:00:35,625 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-05-30 20:00:35,625 - __main__ - INFO - Monitor complete. Found 3 total results: 3 new rss results.
2026-05-30 20:00:35,625 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-05-30 20:00:35,625 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-30 20:00:35,752 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-05-30 20:00:35,753 - __main__ - INFO - Closed all database connections
2026-05-30 20:00:35,755 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-30 20:00:35,755 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-05-30 20:30:02,050 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-30.log
2026-05-30 20:30:02,051 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-30.log
2026-05-30 20:30:02,051 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-30.log
2026-05-30 20:30:02,051 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-05-30 20:30:02,087 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-05-30 20:30:02,087 - social_media_monitor.config.settings - WARNING - Twitter monitoring enabled but credentials validation not implemented
2026-05-30 20:30:02,087 - __main__ - INFO - Configuration loaded and validated successfully
2026-05-30 20:30:02,089 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-05-30 20:30:02,090 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-05-30 20:30:02,112 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-05-30 20:30:02,112 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-05-30 20:30:02,113 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-05-30 20:30:02,113 - __main__ - INFO - Reddit scraper initialized and enabled
2026-05-30 20:30:02,113 - __main__ - INFO - GitHub scraper initialized and enabled
2026-05-30 20:30:02,113 - __main__ - INFO - Twitter scraper initialized and enabled
2026-05-30 20:30:02,114 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0
2026-05-30 20:30:02,114 - __main__ - INFO - LinkedIn scraper initialized and enabled
2026-05-30 20:30:02,114 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled
2026-05-30 20:30:02,117 - Yiddish24Scraper - INFO - File downloader initialized with 30 terms, prefix 'Y2', and file type organization enabled
2026-05-30 20:30:02,117 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=30, exclude_terms=0
2026-05-30 20:30:02,119 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0
2026-05-30 20:30:02,124 - TorahAnytimeScraper - INFO - File downloader initialized with 51 terms, prefix 'TA', and file type organization enabled
2026-05-30 20:30:02,124 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=51, exclude_terms=3
2026-05-30 20:30:02,126 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-05-30 20:30:02,126 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0
2026-05-30 20:30:02,126 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-05-30 20:30:02,126 - __main__ - INFO - Running 5 scrapers concurrently...
2026-05-30 20:30:02,126 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit search monitoring enabled. Running search with terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-30 20:30:02,126 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['"Hermes Agent"']
2026-05-30 20:30:03,079 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term '"Hermes Agent"'
2026-05-30 20:30:03,119 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Frona v2026.5.5 – self-hosted personal AI assistant
2026-05-30 20:30:03,145 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Hermes Agent memory tip: Hugging Face model watchlist without the stal
2026-05-30 20:30:04,294 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 2
2026-05-30 20:30:04,295 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'paperclip' restricted to subreddits: ['PaperClip_AI', 'PaperclipAI']
2026-05-30 20:30:04,295 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['paperclip']
2026-05-30 20:30:04,295 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/PaperClip_AI+PaperclipAI
2026-05-30 20:30:05,542 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'paperclip'
2026-05-30 20:30:05,576 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Need help to understand why my PC doesn't start.
2026-05-30 20:30:05,588 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: PS_ON sent to motherboard, but MB doesn't start
2026-05-30 20:30:05,596 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Would you rather be able to earn money for pain but it is measured by
2026-05-30 20:30:05,606 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: I'm done with Rustoleum
2026-05-30 20:30:06,780 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 4
2026-05-30 20:30:06,781 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'multica' restricted to subreddits: ['hermesagent', 'HermesAI']
2026-05-30 20:30:06,781 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['multica']
2026-05-30 20:30:06,781 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/hermesagent+HermesAI
2026-05-30 20:30:07,700 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'multica'
2026-05-30 20:30:08,916 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0
2026-05-30 20:30:08,916 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit subreddit feed monitoring enabled.
2026-05-30 20:30:08,916 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'hermes_agent': r/hermesagent+HermesAI+AI_Agents+aiagents+AgentsOfAI+LocalLLaMA+AutoGPT (limit=25)
2026-05-30 20:30:08,917 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes agent via RSS
2026-05-30 20:30:09,713 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/AI_Agents: If you use Hermes long enough you will hit the MEMORY md wall. Here is
2026-05-30 20:30:09,741 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/softwareengineer: AI Framework that competes With Hermes! Not A promo i want to help oth
2026-05-30 20:30:09,751 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/google_antigravity: Kenbun-agent
2026-05-30 20:30:09,760 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/google_antigravity: Struggling with token usage?
2026-05-30 20:30:10,900 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes AI via RSS
2026-05-30 20:30:12,889 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: nous research hermes via RSS
2026-05-30 20:30:14,039 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/CATHELP: Do my cats hate each other or are they just roommates?
2026-05-30 20:30:15,194 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: multica via RSS
2026-05-30 20:30:17,177 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'paperclip_ai': r/PaperClip_AI+PaperclipAI+pAIperclip (limit=25)
2026-05-30 20:30:17,177 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip ai via RSS
2026-05-30 20:30:19,376 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip agent via RSS
2026-05-30 20:30:21,397 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: multica via RSS
2026-05-30 20:30:23,349 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'claude_agents': r/vibecoding (limit=25)
2026-05-30 20:30:23,349 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: multica via RSS
2026-05-30 20:30:25,288 - social_media_monitor.scrapers.reddit_scraper - INFO - Total subreddit feed results: 5
2026-05-30 20:30:25,289 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-30 20:30:25,405 - TwitterScraper - INFO - Searching Twitter/X (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-30 20:30:25,903 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'paperclip'
2026-05-30 20:30:40,603 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for '"Hermes Agent"'
2026-05-30 20:30:55,136 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'multica'
2026-05-30 20:31:09,314 - TwitterScraper - INFO - Twitter scrape complete. Found 0 new results.
2026-05-30 20:31:09,315 - LinkedInScraper - INFO - Searching LinkedIn (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-30 20:31:09,805 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'paperclip'
2026-05-30 20:31:09,879 - LinkedInScraper - INFO - New LinkedIn post: Hermes Agent and Paperclip Revolutionize AI Automation | Julian Goldie
2026-05-30 20:31:09,990 - LinkedInScraper - INFO - New LinkedIn post: Hermes, OpenClaw and Paperclip promise to handle the hard thinking for
2026-05-30 20:31:10,996 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for '"Hermes Agent"'
2026-05-30 20:31:11,303 - LinkedInScraper - INFO - New LinkedIn post: Hermes Agent: Your Persistent AI Teammate - LinkedIn
2026-05-30 20:31:11,556 - LinkedInScraper - INFO - New LinkedIn post: Why Hermes Agent Beat OpenClaw So Fast (3 Reasons) OpenRouter has a ne
2026-05-30 20:31:12,344 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'multica'
2026-05-30 20:31:13,211 - LinkedInScraper - INFO - LinkedIn scrape complete. Found 4 new results.
2026-05-30 20:31:13,212 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)
2026-05-30 20:31:18,404 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-05-30 20:31:18,428 - GitHubScraper - INFO - Found 232 GitHub repositories for term: paperclip
2026-05-30 20:31:19,468 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-05-30 20:31:19,563 - GitHubScraper - INFO - Found 299 GitHub repositories for term: "Hermes Agent"
2026-05-30 20:31:20,492 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-05-30 20:31:20,495 - GitHubScraper - INFO - Found 48 GitHub repositories for term: multica
2026-05-30 20:31:20,641 - GitHubScraper - INFO - Total GitHub results found: 0
2026-05-30 20:31:20,641 - __main__ - INFO - Scraper reddit completed: 11 results
2026-05-30 20:31:20,642 - __main__ - INFO - Scraper github completed: 0 results
2026-05-30 20:31:20,642 - __main__ - INFO - Scraper twitter completed: 0 results
2026-05-30 20:31:20,642 - __main__ - INFO - Scraper linkedin completed: 4 results
2026-05-30 20:31:20,642 - __main__ - INFO - Scraper linkedin_feed completed: 0 results
2026-05-30 20:31:21,279 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-30 20:31:21.279195
2026-05-30 20:31:21,279 - __main__ - INFO - Email sent successfully
2026-05-30 20:31:21,279 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-05-30 20:31:21,279 - __main__ - INFO - Monitor complete. Found 15 total results: 11 new reddit results, 4 new linkedin results.
2026-05-30 20:31:21,280 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-05-30 20:31:21,280 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-30 20:31:21,384 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-05-30 20:31:21,384 - __main__ - INFO - Closed all database connections
2026-05-30 20:31:21,434 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-30 20:31:21,446 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-05-30 21:00:02,149 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-30.log
2026-05-30 21:00:02,150 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-30.log
2026-05-30 21:00:02,150 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-30.log
2026-05-30 21:00:02,150 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-05-30 21:00:02,188 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-05-30 21:00:02,188 - __main__ - INFO - Configuration loaded and validated successfully
2026-05-30 21:00:02,190 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-05-30 21:00:02,191 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-05-30 21:00:02,208 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-05-30 21:00:02,208 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-05-30 21:00:02,251 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-05-30 21:00:02,252 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0
2026-05-30 21:00:02,252 - __main__ - INFO - RSS scraper initialized and enabled
2026-05-30 21:00:02,255 - Yiddish24Scraper - INFO - File downloader initialized with 30 terms, prefix 'Y2', and file type organization enabled
2026-05-30 21:00:02,255 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=30, exclude_terms=0
2026-05-30 21:00:02,255 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-05-30 21:00:02,257 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0
2026-05-30 21:00:02,261 - TorahAnytimeScraper - INFO - File downloader initialized with 51 terms, prefix 'TA', and file type organization enabled
2026-05-30 21:00:02,261 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=51, exclude_terms=3
2026-05-30 21:00:02,263 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-05-30 21:00:02,263 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0
2026-05-30 21:00:02,264 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-05-30 21:00:02,264 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-05-30 21:00:02,264 - __main__ - INFO - Running 3 scrapers concurrently...
2026-05-30 21:00:02,264 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-05-30 21:00:02,351 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-05-30 21:00:02,356 - IveltScraper - INFO - Loaded 178 include, 0 exclude filters from DB topic_filters
2026-05-30 21:00:02,356 - IveltScraper - INFO - Fetching ivelt.com active topics...
2026-05-30 21:00:02,357 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-05-30 21:00:02,652 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-05-30 21:00:03,031 - RSSFeedScraper - INFO - Total RSS/HTML results: 3
2026-05-30 21:00:03,375 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-05-30 21:00:03,558 - Yiddish24Scraper - INFO - Received response with 521999 characters
2026-05-30 21:00:03,560 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (319115 chars)
2026-05-30 21:00:03,561 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-05-30 21:00:03,634 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-05-30 21:00:03,687 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-05-30 21:00:03,687 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-05-30 21:00:04,350 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 100 total articles
2026-05-30 21:00:04,350 - Yiddish24Scraper - INFO - Page 1: 0/100 new items
2026-05-30 21:00:04,350 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination
2026-05-30 21:00:04,351 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0
2026-05-30 21:00:14,120 - IveltScraper - INFO - Found 50 active topics on ivelt.com
2026-05-30 21:00:34,158 - IveltScraper - INFO - Ivelt scrape complete. Checked 6 topics, found 0 new posts.
2026-05-30 21:00:34,158 - __main__ - INFO - Scraper rss completed: 3 results
2026-05-30 21:00:34,158 - __main__ - INFO - Scraper yiddish24 completed: 0 results
2026-05-30 21:00:34,158 - __main__ - INFO - Scraper ivelt completed: 0 results
2026-05-30 21:00:34,896 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-30 21:00:34.896601
2026-05-30 21:00:34,896 - __main__ - INFO - Email sent successfully
2026-05-30 21:00:34,897 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-05-30 21:00:34,897 - __main__ - INFO - Monitor complete. Found 3 total results: 3 new rss results.
2026-05-30 21:00:34,897 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-05-30 21:00:34,897 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-30 21:00:34,977 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-05-30 21:00:34,978 - __main__ - INFO - Closed all database connections
2026-05-30 21:00:34,980 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-30 21:00:34,980 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-05-30 22:00:02,436 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-30.log
2026-05-30 22:00:02,436 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-30.log
2026-05-30 22:00:02,436 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-30.log
2026-05-30 22:00:02,436 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-05-30 22:00:02,475 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-05-30 22:00:02,475 - __main__ - INFO - Configuration loaded and validated successfully
2026-05-30 22:00:02,478 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-05-30 22:00:02,478 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-05-30 22:00:02,503 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-05-30 22:00:02,503 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-05-30 22:00:02,544 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-05-30 22:00:02,545 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0
2026-05-30 22:00:02,545 - __main__ - INFO - RSS scraper initialized and enabled
2026-05-30 22:00:02,547 - Yiddish24Scraper - INFO - File downloader initialized with 30 terms, prefix 'Y2', and file type organization enabled
2026-05-30 22:00:02,547 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=30, exclude_terms=0
2026-05-30 22:00:02,547 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-05-30 22:00:02,550 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0
2026-05-30 22:00:02,554 - TorahAnytimeScraper - INFO - File downloader initialized with 51 terms, prefix 'TA', and file type organization enabled
2026-05-30 22:00:02,554 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=51, exclude_terms=3
2026-05-30 22:00:02,556 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-05-30 22:00:02,556 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0
2026-05-30 22:00:02,556 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-05-30 22:00:02,556 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-05-30 22:00:02,556 - __main__ - INFO - Running 3 scrapers concurrently...
2026-05-30 22:00:02,557 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-05-30 22:00:02,638 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-05-30 22:00:02,642 - IveltScraper - INFO - Loaded 178 include, 0 exclude filters from DB topic_filters
2026-05-30 22:00:02,643 - IveltScraper - INFO - Fetching ivelt.com active topics...
2026-05-30 22:00:02,644 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-05-30 22:00:02,966 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-05-30 22:00:03,357 - RSSFeedScraper - INFO - Total RSS/HTML results: 3
2026-05-30 22:00:03,647 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-05-30 22:00:03,824 - Yiddish24Scraper - INFO - Received response with 521999 characters
2026-05-30 22:00:03,827 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (319115 chars)
2026-05-30 22:00:03,830 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-05-30 22:00:03,920 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-05-30 22:00:03,962 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-05-30 22:00:03,963 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-05-30 22:00:04,642 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 100 total articles
2026-05-30 22:00:04,642 - Yiddish24Scraper - INFO - Page 1: 0/100 new items
2026-05-30 22:00:04,642 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination
2026-05-30 22:00:04,643 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0
2026-05-30 22:00:14,411 - IveltScraper - INFO - Found 50 active topics on ivelt.com
2026-05-30 22:00:31,568 - IveltScraper - INFO - Ivelt scrape complete. Checked 5 topics, found 0 new posts.
2026-05-30 22:00:31,569 - __main__ - INFO - Scraper rss completed: 3 results
2026-05-30 22:00:31,569 - __main__ - INFO - Scraper yiddish24 completed: 0 results
2026-05-30 22:00:31,569 - __main__ - INFO - Scraper ivelt completed: 0 results
2026-05-30 22:00:32,348 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-30 22:00:32.348058
2026-05-30 22:00:32,348 - __main__ - INFO - Email sent successfully
2026-05-30 22:00:32,348 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-05-30 22:00:32,348 - __main__ - INFO - Monitor complete. Found 3 total results: 3 new rss results.
2026-05-30 22:00:32,348 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-05-30 22:00:32,348 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-30 22:00:32,499 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-05-30 22:00:32,499 - __main__ - INFO - Closed all database connections
2026-05-30 22:00:32,501 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-30 22:00:32,502 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-05-30 22:30:01,834 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-30.log
2026-05-30 22:30:01,834 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-30.log
2026-05-30 22:30:01,834 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-30.log
2026-05-30 22:30:01,834 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-05-30 22:30:01,870 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-05-30 22:30:01,871 - social_media_monitor.config.settings - WARNING - Twitter monitoring enabled but credentials validation not implemented
2026-05-30 22:30:01,871 - __main__ - INFO - Configuration loaded and validated successfully
2026-05-30 22:30:01,873 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-05-30 22:30:01,874 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-05-30 22:30:01,895 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-05-30 22:30:01,896 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-05-30 22:30:01,898 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-05-30 22:30:01,898 - __main__ - INFO - Reddit scraper initialized and enabled
2026-05-30 22:30:01,898 - __main__ - INFO - GitHub scraper initialized and enabled
2026-05-30 22:30:01,898 - __main__ - INFO - Twitter scraper initialized and enabled
2026-05-30 22:30:01,900 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0
2026-05-30 22:30:01,900 - __main__ - INFO - LinkedIn scraper initialized and enabled
2026-05-30 22:30:01,900 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled
2026-05-30 22:30:01,905 - Yiddish24Scraper - INFO - File downloader initialized with 30 terms, prefix 'Y2', and file type organization enabled
2026-05-30 22:30:01,906 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=30, exclude_terms=0
2026-05-30 22:30:01,911 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0
2026-05-30 22:30:01,922 - TorahAnytimeScraper - INFO - File downloader initialized with 51 terms, prefix 'TA', and file type organization enabled
2026-05-30 22:30:01,922 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=51, exclude_terms=3
2026-05-30 22:30:01,926 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-05-30 22:30:01,926 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0
2026-05-30 22:30:01,927 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-05-30 22:30:01,927 - __main__ - INFO - Running 5 scrapers concurrently...
2026-05-30 22:30:01,927 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit search monitoring enabled. Running search with terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-30 22:30:01,927 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['"Hermes Agent"']
2026-05-30 22:30:02,827 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term '"Hermes Agent"'
2026-05-30 22:30:02,863 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Hermes Agent model routing guide: Hugging Face model watchlist without
2026-05-30 22:30:02,873 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Introducing Machinaos[Fully Opensource]: OS to Control Claude Code Age
2026-05-30 22:30:02,891 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Hermes Agent Memory In 5 Simple Steps
2026-05-30 22:30:02,911 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: How An AI Operating System Turns Tasks Into Agents
2026-05-30 22:30:02,920 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Getting two (or more) Hermes agents to talk to each other
2026-05-30 22:30:02,929 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Introducing Machinaos[Fully Opensource]: OS That converts LLM Tokens t
2026-05-30 22:30:04,052 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 6
2026-05-30 22:30:04,052 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'paperclip' restricted to subreddits: ['PaperClip_AI', 'PaperclipAI']
2026-05-30 22:30:04,052 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['paperclip']
2026-05-30 22:30:04,052 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/PaperClip_AI+PaperclipAI
2026-05-30 22:30:05,070 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'paperclip'
2026-05-30 22:30:05,096 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Whether a Super Ai will destroy humanity or keep it is 50/50.
2026-05-30 22:30:05,106 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: New addition to the 'familia'
2026-05-30 22:30:05,127 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: PS_ON sent to motherboard, but MB doesn't start
2026-05-30 22:30:06,298 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 3
2026-05-30 22:30:06,299 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'multica' restricted to subreddits: ['hermesagent', 'HermesAI']
2026-05-30 22:30:06,299 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['multica']
2026-05-30 22:30:06,299 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/hermesagent+HermesAI
2026-05-30 22:30:07,010 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'multica'
2026-05-30 22:30:08,222 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0
2026-05-30 22:30:08,223 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit subreddit feed monitoring enabled.
2026-05-30 22:30:08,223 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'hermes_agent': r/hermesagent+HermesAI+AI_Agents+aiagents+AgentsOfAI+LocalLLaMA+AutoGPT (limit=25)
2026-05-30 22:30:08,223 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes agent via RSS
2026-05-30 22:30:09,193 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/MercuryInstall: Mercury Agent install note: Mercury agent launch checklist without the
2026-05-30 22:30:09,243 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/AISEOInsider: Build AI Agents From Scratch Using Agent OS
2026-05-30 22:30:09,277 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/AI_Agents: I built a cyberpunk agent matcher because I got tired of cloning broke
2026-05-30 22:30:10,385 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes AI via RSS
2026-05-30 22:30:12,425 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: nous research hermes via RSS
2026-05-30 22:30:14,531 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: multica via RSS
2026-05-30 22:30:16,613 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'paperclip_ai': r/PaperClip_AI+PaperclipAI+pAIperclip (limit=25)
2026-05-30 22:30:16,613 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip ai via RSS
2026-05-30 22:30:18,807 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip agent via RSS
2026-05-30 22:30:20,769 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: multica via RSS
2026-05-30 22:30:22,762 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'claude_agents': r/vibecoding (limit=25)
2026-05-30 22:30:22,762 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: multica via RSS
2026-05-30 22:30:24,574 - social_media_monitor.scrapers.reddit_scraper - INFO - Total subreddit feed results: 3
2026-05-30 22:30:24,575 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-30 22:30:24,715 - TwitterScraper - INFO - Searching Twitter/X (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-30 22:30:25,225 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'paperclip'
2026-05-30 22:30:39,200 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for '"Hermes Agent"'
2026-05-30 22:30:53,241 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'multica'
2026-05-30 22:31:06,637 - TwitterScraper - INFO - Twitter scrape complete. Found 0 new results.
2026-05-30 22:31:06,637 - LinkedInScraper - INFO - Searching LinkedIn (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-30 22:31:07,314 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'paperclip'
2026-05-30 22:31:08,570 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for '"Hermes Agent"'
2026-05-30 22:31:10,346 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'multica'
2026-05-30 22:31:10,439 - LinkedInScraper - INFO - New LinkedIn post: My last post was about AI agents which led to how to run multiple agen
2026-05-30 22:31:11,041 - LinkedInScraper - INFO - LinkedIn scrape complete. Found 1 new results.
2026-05-30 22:31:11,042 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)
2026-05-30 22:31:17,655 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-05-30 22:31:17,682 - GitHubScraper - INFO - Found 232 GitHub repositories for term: paperclip
2026-05-30 22:31:18,744 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-05-30 22:31:18,748 - GitHubScraper - INFO - Found 299 GitHub repositories for term: "Hermes Agent"
2026-05-30 22:31:19,669 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-05-30 22:31:19,673 - GitHubScraper - INFO - Found 48 GitHub repositories for term: multica
2026-05-30 22:31:19,818 - GitHubScraper - INFO - Total GitHub results found: 0
2026-05-30 22:31:19,819 - __main__ - INFO - Scraper reddit completed: 12 results
2026-05-30 22:31:19,819 - __main__ - INFO - Scraper github completed: 0 results
2026-05-30 22:31:19,819 - __main__ - INFO - Scraper twitter completed: 0 results
2026-05-30 22:31:19,819 - __main__ - INFO - Scraper linkedin completed: 1 results
2026-05-30 22:31:19,819 - __main__ - INFO - Scraper linkedin_feed completed: 0 results
2026-05-30 22:31:20,743 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-30 22:31:20.743198
2026-05-30 22:31:20,743 - __main__ - INFO - Email sent successfully
2026-05-30 22:31:20,744 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-05-30 22:31:20,744 - __main__ - INFO - Monitor complete. Found 13 total results: 12 new reddit results, 1 new linkedin results.
2026-05-30 22:31:20,744 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-05-30 22:31:20,744 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-30 22:31:20,876 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-05-30 22:31:20,876 - __main__ - INFO - Closed all database connections
2026-05-30 22:31:20,914 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-30 22:31:20,926 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-05-30 23:00:02,605 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-30.log
2026-05-30 23:00:02,605 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-30.log
2026-05-30 23:00:02,605 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-30.log
2026-05-30 23:00:02,605 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-05-30 23:00:02,645 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-05-30 23:00:02,645 - __main__ - INFO - Configuration loaded and validated successfully
2026-05-30 23:00:02,648 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-05-30 23:00:02,648 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-05-30 23:00:02,678 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-05-30 23:00:02,679 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-05-30 23:00:02,719 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-05-30 23:00:02,734 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0
2026-05-30 23:00:02,734 - __main__ - INFO - RSS scraper initialized and enabled
2026-05-30 23:00:02,743 - Yiddish24Scraper - INFO - File downloader initialized with 30 terms, prefix 'Y2', and file type organization enabled
2026-05-30 23:00:02,745 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=30, exclude_terms=0
2026-05-30 23:00:02,745 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-05-30 23:00:02,752 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0
2026-05-30 23:00:02,765 - TorahAnytimeScraper - INFO - File downloader initialized with 51 terms, prefix 'TA', and file type organization enabled
2026-05-30 23:00:02,777 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=51, exclude_terms=3
2026-05-30 23:00:02,782 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-05-30 23:00:02,782 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0
2026-05-30 23:00:02,783 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-05-30 23:00:02,783 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-05-30 23:00:02,783 - __main__ - INFO - Running 3 scrapers concurrently...
2026-05-30 23:00:02,783 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-05-30 23:00:02,877 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-05-30 23:00:02,882 - IveltScraper - INFO - Loaded 178 include, 0 exclude filters from DB topic_filters
2026-05-30 23:00:02,882 - IveltScraper - INFO - Fetching ivelt.com active topics...
2026-05-30 23:00:02,883 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-05-30 23:00:03,289 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-05-30 23:00:03,798 - RSSFeedScraper - INFO - Total RSS/HTML results: 3
2026-05-30 23:00:04,155 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-05-30 23:00:04,339 - Yiddish24Scraper - INFO - Received response with 521999 characters
2026-05-30 23:00:04,343 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (319115 chars)
2026-05-30 23:00:04,346 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-05-30 23:00:04,431 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-05-30 23:00:04,471 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-05-30 23:00:04,472 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-05-30 23:00:05,854 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 100 total articles
2026-05-30 23:00:05,854 - Yiddish24Scraper - INFO - Page 1: 0/100 new items
2026-05-30 23:00:05,854 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination
2026-05-30 23:00:05,854 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0
2026-05-30 23:00:14,650 - IveltScraper - INFO - Found 50 active topics on ivelt.com
2026-05-30 23:00:31,232 - IveltScraper - INFO - Ivelt scrape complete. Checked 5 topics, found 0 new posts.
2026-05-30 23:00:31,232 - __main__ - INFO - Scraper rss completed: 3 results
2026-05-30 23:00:31,233 - __main__ - INFO - Scraper yiddish24 completed: 0 results
2026-05-30 23:00:31,233 - __main__ - INFO - Scraper ivelt completed: 0 results
2026-05-30 23:00:31,885 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-30 23:00:31.885174
2026-05-30 23:00:31,885 - __main__ - INFO - Email sent successfully
2026-05-30 23:00:31,885 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-05-30 23:00:31,885 - __main__ - INFO - Monitor complete. Found 3 total results: 3 new rss results.
2026-05-30 23:00:31,886 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-05-30 23:00:31,886 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-30 23:00:32,024 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-05-30 23:00:32,025 - __main__ - INFO - Closed all database connections
2026-05-30 23:00:32,027 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-30 23:00:32,027 - social_media_monitor.database.connection - INFO - Closed 0 database connections