← Logs

social_media_monitor_2026-05-22.log

2026-05-22 18:45:08,566 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://ahblicklive.com/new_ded_video/26/21/2J8GrDMesmc4huQO3yL/hdjcab/hdjcab.mp4
2026-05-22 18:45:08,802 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: BL_hdjcab.mp4 (3.7 MB)
2026-05-22 18:45:08,802 - social_media_monitor.utils.file_downloader - INFO - Organized video file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Video (video/mp4)
2026-05-22 18:45:08,810 - social_media_monitor.utils.media_tagger - INFO - Tagged BL_hdjcab.mp4: title, album, comment, genre
2026-05-22 18:45:08,811 - AhBlickLiveScraper - INFO - Total AhBlickLive results: 5
2026-05-22 18:45:08,811 - __main__ - INFO - Scraper ahblicklive completed: 5 results
2026-05-22 18:45:09,643 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-22 18:45:09.643440
2026-05-22 18:45:09,643 - __main__ - INFO - Email sent successfully
2026-05-22 18:45:09,644 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-05-22 18:45:09,644 - __main__ - INFO - Monitor complete. Found 5 total results: 5 new ahblicklive results.
2026-05-22 18:45:09,644 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-05-22 18:45:09,644 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-22 18:45:09,656 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-05-22 18:45:09,657 - __main__ - INFO - Closed all database connections
2026-05-22 18:45:09,660 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-22 18:45:09,660 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-05-22 19:00:02,048 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-22.log
2026-05-22 19:00:02,049 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-22.log
2026-05-22 19:00:02,049 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-22.log
2026-05-22 19:00:02,049 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-05-22 19:00:02,073 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-05-22 19:00:02,073 - __main__ - INFO - Configuration loaded and validated successfully
2026-05-22 19:00:02,075 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-05-22 19:00:02,078 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-05-22 19:00:02,372 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-05-22 19:00:02,372 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-05-22 19:00:02,375 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-05-22 19:00:02,377 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0
2026-05-22 19:00:02,378 - __main__ - INFO - RSS scraper initialized and enabled
2026-05-22 19:00:02,385 - Yiddish24Scraper - INFO - File downloader initialized with 30 terms, prefix 'Y2', and file type organization enabled
2026-05-22 19:00:02,385 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=30, exclude_terms=0
2026-05-22 19:00:02,385 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-05-22 19:00:02,413 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0
2026-05-22 19:00:02,421 - TorahAnytimeScraper - INFO - File downloader initialized with 51 terms, prefix 'TA', and file type organization enabled
2026-05-22 19:00:02,421 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=51, exclude_terms=3
2026-05-22 19:00:02,424 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-05-22 19:00:02,424 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0
2026-05-22 19:00:02,424 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-05-22 19:00:02,424 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-05-22 19:00:02,424 - __main__ - INFO - Running 3 scrapers concurrently...
2026-05-22 19:00:02,424 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-05-22 19:00:02,557 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-05-22 19:00:02,566 - IveltScraper - INFO - Loaded 178 include, 0 exclude filters from DB topic_filters
2026-05-22 19:00:02,566 - IveltScraper - INFO - Fetching ivelt.com active topics...
2026-05-22 19:00:02,567 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-05-22 19:00:03,144 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-05-22 19:00:03,586 - RSSFeedScraper - INFO - Total RSS/HTML results: 3
2026-05-22 19:00:04,029 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-05-22 19:00:04,254 - Yiddish24Scraper - INFO - Received response with 493044 characters
2026-05-22 19:00:04,258 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (313604 chars)
2026-05-22 19:00:04,264 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-05-22 19:00:04,358 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-05-22 19:00:04,402 - Yiddish24Scraper - INFO - Page 1 extraction: 99 successful, 1 failed out of 100 elements
2026-05-22 19:00:04,402 - Yiddish24Scraper - INFO - Parsed 99 articles from HTML on page 1
2026-05-22 19:00:05,380 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 99 total articles
2026-05-22 19:00:05,380 - Yiddish24Scraper - INFO - Page 1: 0/99 new items
2026-05-22 19:00:05,380 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination
2026-05-22 19:00:05,381 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0
2026-05-22 19:00:15,138 - IveltScraper - INFO - Found 50 active topics on ivelt.com
2026-05-22 19:00:24,279 - IveltScraper - INFO - Ivelt scrape complete. Checked 3 topics, found 0 new posts.
2026-05-22 19:00:24,280 - __main__ - INFO - Scraper rss completed: 3 results
2026-05-22 19:00:24,280 - __main__ - INFO - Scraper yiddish24 completed: 0 results
2026-05-22 19:00:24,280 - __main__ - INFO - Scraper ivelt completed: 0 results
2026-05-22 19:00:24,869 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-22 19:00:24.868895
2026-05-22 19:00:24,869 - __main__ - INFO - Email sent successfully
2026-05-22 19:00:24,869 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-05-22 19:00:24,869 - __main__ - INFO - Monitor complete. Found 3 total results: 3 new rss results.
2026-05-22 19:00:24,869 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-05-22 19:00:24,869 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-22 19:00:24,953 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-05-22 19:00:24,953 - __main__ - INFO - Closed all database connections
2026-05-22 19:00:24,955 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-22 19:00:24,955 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-05-22 20:00:02,306 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-22.log
2026-05-22 20:00:02,308 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-22.log
2026-05-22 20:00:02,309 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-22.log
2026-05-22 20:00:02,309 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-05-22 20:00:02,333 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-05-22 20:00:02,333 - __main__ - INFO - Configuration loaded and validated successfully
2026-05-22 20:00:02,336 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-05-22 20:00:02,339 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-05-22 20:00:02,361 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-05-22 20:00:02,361 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-05-22 20:00:02,405 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-05-22 20:00:02,406 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0
2026-05-22 20:00:02,406 - __main__ - INFO - RSS scraper initialized and enabled
2026-05-22 20:00:02,418 - Yiddish24Scraper - INFO - File downloader initialized with 30 terms, prefix 'Y2', and file type organization enabled
2026-05-22 20:00:02,418 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=30, exclude_terms=0
2026-05-22 20:00:02,418 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-05-22 20:00:02,421 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0
2026-05-22 20:00:02,425 - TorahAnytimeScraper - INFO - File downloader initialized with 51 terms, prefix 'TA', and file type organization enabled
2026-05-22 20:00:02,425 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=51, exclude_terms=3
2026-05-22 20:00:02,427 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-05-22 20:00:02,427 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0
2026-05-22 20:00:02,427 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-05-22 20:00:02,427 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-05-22 20:00:02,427 - __main__ - INFO - Running 3 scrapers concurrently...
2026-05-22 20:00:02,427 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-05-22 20:00:02,621 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-05-22 20:00:02,633 - IveltScraper - INFO - Loaded 178 include, 0 exclude filters from DB topic_filters
2026-05-22 20:00:02,633 - IveltScraper - INFO - Fetching ivelt.com active topics...
2026-05-22 20:00:02,634 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-05-22 20:00:02,923 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-05-22 20:00:03,475 - RSSFeedScraper - INFO - Total RSS/HTML results: 3
2026-05-22 20:00:03,834 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-05-22 20:00:04,047 - Yiddish24Scraper - INFO - Received response with 493044 characters
2026-05-22 20:00:04,050 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (313604 chars)
2026-05-22 20:00:04,054 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-05-22 20:00:04,155 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-05-22 20:00:04,196 - Yiddish24Scraper - INFO - Page 1 extraction: 99 successful, 1 failed out of 100 elements
2026-05-22 20:00:04,196 - Yiddish24Scraper - INFO - Parsed 99 articles from HTML on page 1
2026-05-22 20:00:05,183 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 99 total articles
2026-05-22 20:00:05,183 - Yiddish24Scraper - INFO - Page 1: 0/99 new items
2026-05-22 20:00:05,184 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination
2026-05-22 20:00:05,184 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0
2026-05-22 20:00:14,219 - IveltScraper - INFO - Found 50 active topics on ivelt.com
2026-05-22 20:00:23,462 - IveltScraper - INFO - Ivelt scrape complete. Checked 3 topics, found 0 new posts.
2026-05-22 20:00:23,463 - __main__ - INFO - Scraper rss completed: 3 results
2026-05-22 20:00:23,463 - __main__ - INFO - Scraper yiddish24 completed: 0 results
2026-05-22 20:00:23,463 - __main__ - INFO - Scraper ivelt completed: 0 results
2026-05-22 20:00:24,079 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-22 20:00:24.079485
2026-05-22 20:00:24,079 - __main__ - INFO - Email sent successfully
2026-05-22 20:00:24,080 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-05-22 20:00:24,080 - __main__ - INFO - Monitor complete. Found 3 total results: 3 new rss results.
2026-05-22 20:00:24,080 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-05-22 20:00:24,080 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-22 20:00:24,153 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-05-22 20:00:24,153 - __main__ - INFO - Closed all database connections
2026-05-22 20:00:24,155 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-22 20:00:24,155 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-05-22 20:30:02,029 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-22.log
2026-05-22 20:30:02,030 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-22.log
2026-05-22 20:30:02,030 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-22.log
2026-05-22 20:30:02,030 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-05-22 20:30:02,065 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-05-22 20:30:02,066 - social_media_monitor.config.settings - WARNING - Twitter monitoring enabled but credentials validation not implemented
2026-05-22 20:30:02,066 - __main__ - INFO - Configuration loaded and validated successfully
2026-05-22 20:30:02,072 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-05-22 20:30:02,080 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-05-22 20:30:02,121 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-05-22 20:30:02,121 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-05-22 20:30:02,123 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-05-22 20:30:02,123 - __main__ - INFO - Reddit scraper initialized and enabled
2026-05-22 20:30:02,123 - __main__ - INFO - GitHub scraper initialized and enabled
2026-05-22 20:30:02,123 - __main__ - INFO - Twitter scraper initialized and enabled
2026-05-22 20:30:02,124 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0
2026-05-22 20:30:02,124 - __main__ - INFO - LinkedIn scraper initialized and enabled
2026-05-22 20:30:02,124 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled
2026-05-22 20:30:02,129 - Yiddish24Scraper - INFO - File downloader initialized with 30 terms, prefix 'Y2', and file type organization enabled
2026-05-22 20:30:02,129 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=30, exclude_terms=0
2026-05-22 20:30:02,146 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0
2026-05-22 20:30:02,150 - TorahAnytimeScraper - INFO - File downloader initialized with 51 terms, prefix 'TA', and file type organization enabled
2026-05-22 20:30:02,150 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=51, exclude_terms=3
2026-05-22 20:30:02,156 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-05-22 20:30:02,156 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0
2026-05-22 20:30:02,156 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-05-22 20:30:02,156 - __main__ - INFO - Running 5 scrapers concurrently...
2026-05-22 20:30:02,156 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit search monitoring enabled. Running search with terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-22 20:30:02,156 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['"Hermes Agent"']
2026-05-22 20:30:03,441 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term '"Hermes Agent"'
2026-05-22 20:30:03,587 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Sudden input token use spikes? - Go Subscription
2026-05-22 20:30:03,597 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: When I hit a usage limit, after limits reset can I just send a simple
2026-05-22 20:30:03,608 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Hermes Agent memory tip: Hermes skills without the stale context trap
2026-05-22 20:30:03,826 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: hal0.dev - A Strix Halo Optimized Homelab Inference Platform
2026-05-22 20:30:04,962 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 4
2026-05-22 20:30:04,962 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'paperclip' restricted to subreddits: ['PaperClip_AI', 'PaperclipAI']
2026-05-22 20:30:04,962 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['paperclip']
2026-05-22 20:30:04,962 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/PaperClip_AI+PaperclipAI
2026-05-22 20:30:06,091 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'paperclip'
2026-05-22 20:30:06,156 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: 1200x
2026-05-22 20:30:06,209 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: PTS not working?
2026-05-22 20:30:06,225 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Welll this happened
2026-05-22 20:30:07,405 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 3
2026-05-22 20:30:07,405 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'multica' restricted to subreddits: ['hermesagent', 'HermesAI']
2026-05-22 20:30:07,405 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['multica']
2026-05-22 20:30:07,405 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/hermesagent+HermesAI
2026-05-22 20:30:08,545 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'multica'
2026-05-22 20:30:09,838 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0
2026-05-22 20:30:09,839 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit subreddit feed monitoring enabled.
2026-05-22 20:30:09,839 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'hermes_agent': r/hermesagent+HermesAI+AI_Agents+aiagents+AgentsOfAI+LocalLLaMA+AutoGPT (limit=25)
2026-05-22 20:30:09,839 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes agent via RSS
2026-05-22 20:30:11,009 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/CryptoTradingBot: Endsems vs. My 5BTC Bot: 7 Days of Bug Hunting & "Zombie Whales"
2026-05-22 20:30:11,032 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/hermesagent: First party CLI vs Hermes usage?
2026-05-22 20:30:11,065 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/ClaudeCode: Local Claude Code and Claude Desktop history search, with other agents
2026-05-22 20:30:12,227 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes AI via RSS
2026-05-22 20:30:14,432 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: nous research hermes via RSS
2026-05-22 20:30:16,734 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: multica via RSS
2026-05-22 20:30:18,864 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'paperclip_ai': r/PaperClip_AI+PaperclipAI+pAIperclip (limit=25)
2026-05-22 20:30:18,865 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip ai via RSS
2026-05-22 20:30:21,361 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip agent via RSS
2026-05-22 20:30:23,461 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: multica via RSS
2026-05-22 20:30:25,513 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'claude_agents': r/vibecoding (limit=25)
2026-05-22 20:30:25,514 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: multica via RSS
2026-05-22 20:30:27,406 - social_media_monitor.scrapers.reddit_scraper - INFO - Total subreddit feed results: 3
2026-05-22 20:30:27,406 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-22 20:30:27,586 - TwitterScraper - INFO - Searching Twitter/X (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-22 20:30:28,010 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'paperclip'
2026-05-22 20:30:42,551 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for '"Hermes Agent"'
2026-05-22 20:30:56,337 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'multica'
2026-05-22 20:31:07,933 - TwitterScraper - INFO - Twitter scrape complete. Found 0 new results.
2026-05-22 20:31:07,933 - LinkedInScraper - INFO - Searching LinkedIn (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-22 20:31:08,602 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'paperclip'
2026-05-22 20:31:10,043 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for '"Hermes Agent"'
2026-05-22 20:31:11,564 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'multica'
2026-05-22 20:31:12,421 - LinkedInScraper - INFO - LinkedIn scrape complete. Found 0 new results.
2026-05-22 20:31:12,422 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)
2026-05-22 20:31:16,295 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-05-22 20:31:16,319 - GitHubScraper - INFO - Found 232 GitHub repositories for term: paperclip
2026-05-22 20:31:17,692 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-05-22 20:31:17,791 - GitHubScraper - INFO - Found 274 GitHub repositories for term: "Hermes Agent"
2026-05-22 20:31:17,912 - GitHubScraper - INFO - Added new GitHub repository: ClawBench
2026-05-22 20:31:19,188 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-05-22 20:31:20,441 - GitHubScraper - INFO - Found 47 GitHub repositories for term: multica
2026-05-22 20:31:20,622 - GitHubScraper - INFO - Total GitHub results found: 1
2026-05-22 20:31:20,623 - __main__ - INFO - Scraper reddit completed: 10 results
2026-05-22 20:31:20,623 - __main__ - INFO - Scraper github completed: 1 results
2026-05-22 20:31:20,623 - __main__ - INFO - Scraper twitter completed: 0 results
2026-05-22 20:31:20,623 - __main__ - INFO - Scraper linkedin completed: 0 results
2026-05-22 20:31:20,623 - __main__ - INFO - Scraper linkedin_feed completed: 0 results
2026-05-22 20:31:21,521 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-22 20:31:21.521155
2026-05-22 20:31:21,521 - __main__ - INFO - Email sent successfully
2026-05-22 20:31:21,521 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-05-22 20:31:21,521 - __main__ - INFO - Monitor complete. Found 11 total results: 10 new reddit results, 1 new github results.
2026-05-22 20:31:21,521 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-05-22 20:31:21,522 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-22 20:31:21,678 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-05-22 20:31:21,678 - __main__ - INFO - Closed all database connections
2026-05-22 20:31:21,726 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-22 20:31:21,741 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-05-22 21:00:03,167 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-22.log
2026-05-22 21:00:03,170 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-22.log
2026-05-22 21:00:03,170 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-22.log
2026-05-22 21:00:03,170 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-05-22 21:00:03,194 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-05-22 21:00:03,194 - __main__ - INFO - Configuration loaded and validated successfully
2026-05-22 21:00:03,207 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-05-22 21:00:03,213 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-05-22 21:00:03,641 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-05-22 21:00:03,641 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-05-22 21:00:03,689 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-05-22 21:00:03,693 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0
2026-05-22 21:00:03,693 - __main__ - INFO - RSS scraper initialized and enabled
2026-05-22 21:00:03,708 - Yiddish24Scraper - INFO - File downloader initialized with 30 terms, prefix 'Y2', and file type organization enabled
2026-05-22 21:00:03,708 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=30, exclude_terms=0
2026-05-22 21:00:03,708 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-05-22 21:00:03,712 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0
2026-05-22 21:00:03,716 - TorahAnytimeScraper - INFO - File downloader initialized with 51 terms, prefix 'TA', and file type organization enabled
2026-05-22 21:00:03,716 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=51, exclude_terms=3
2026-05-22 21:00:03,718 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-05-22 21:00:03,719 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0
2026-05-22 21:00:03,720 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-05-22 21:00:03,720 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-05-22 21:00:03,720 - __main__ - INFO - Running 3 scrapers concurrently...
2026-05-22 21:00:03,720 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-05-22 21:00:03,878 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-05-22 21:00:03,891 - IveltScraper - INFO - Loaded 178 include, 0 exclude filters from DB topic_filters
2026-05-22 21:00:03,891 - IveltScraper - INFO - Fetching ivelt.com active topics...
2026-05-22 21:00:03,893 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-05-22 21:00:04,505 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-05-22 21:00:04,993 - RSSFeedScraper - INFO - Total RSS/HTML results: 3
2026-05-22 21:00:05,348 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-05-22 21:00:05,558 - Yiddish24Scraper - INFO - Received response with 493044 characters
2026-05-22 21:00:05,562 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (313604 chars)
2026-05-22 21:00:05,567 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-05-22 21:00:05,657 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-05-22 21:00:05,710 - Yiddish24Scraper - INFO - Page 1 extraction: 99 successful, 1 failed out of 100 elements
2026-05-22 21:00:05,710 - Yiddish24Scraper - INFO - Parsed 99 articles from HTML on page 1
2026-05-22 21:00:07,656 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 99 total articles
2026-05-22 21:00:07,656 - Yiddish24Scraper - INFO - Page 1: 0/99 new items
2026-05-22 21:00:07,656 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination
2026-05-22 21:00:07,656 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0
2026-05-22 21:00:16,144 - IveltScraper - INFO - Found 50 active topics on ivelt.com
2026-05-22 21:00:25,514 - IveltScraper - INFO - Ivelt scrape complete. Checked 3 topics, found 0 new posts.
2026-05-22 21:00:25,514 - __main__ - INFO - Scraper rss completed: 3 results
2026-05-22 21:00:25,514 - __main__ - INFO - Scraper yiddish24 completed: 0 results
2026-05-22 21:00:25,514 - __main__ - INFO - Scraper ivelt completed: 0 results
2026-05-22 21:00:26,344 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-22 21:00:26.344307
2026-05-22 21:00:26,344 - __main__ - INFO - Email sent successfully
2026-05-22 21:00:26,344 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-05-22 21:00:26,345 - __main__ - INFO - Monitor complete. Found 3 total results: 3 new rss results.
2026-05-22 21:00:26,345 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-05-22 21:00:26,345 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-22 21:00:26,443 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-05-22 21:00:26,443 - __main__ - INFO - Closed all database connections
2026-05-22 21:00:26,445 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-22 21:00:26,445 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-05-22 22:00:02,542 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-22.log
2026-05-22 22:00:02,544 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-22.log
2026-05-22 22:00:02,544 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-22.log
2026-05-22 22:00:02,544 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-05-22 22:00:02,568 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-05-22 22:00:02,568 - __main__ - INFO - Configuration loaded and validated successfully
2026-05-22 22:00:02,574 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-05-22 22:00:02,581 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-05-22 22:00:02,692 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-05-22 22:00:02,693 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-05-22 22:00:02,696 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-05-22 22:00:02,701 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0
2026-05-22 22:00:02,702 - __main__ - INFO - RSS scraper initialized and enabled
2026-05-22 22:00:02,711 - Yiddish24Scraper - INFO - File downloader initialized with 30 terms, prefix 'Y2', and file type organization enabled
2026-05-22 22:00:02,711 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=30, exclude_terms=0
2026-05-22 22:00:02,711 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-05-22 22:00:02,739 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0
2026-05-22 22:00:02,745 - TorahAnytimeScraper - INFO - File downloader initialized with 51 terms, prefix 'TA', and file type organization enabled
2026-05-22 22:00:02,745 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=51, exclude_terms=3
2026-05-22 22:00:02,747 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-05-22 22:00:02,748 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0
2026-05-22 22:00:02,748 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-05-22 22:00:02,748 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-05-22 22:00:02,748 - __main__ - INFO - Running 3 scrapers concurrently...
2026-05-22 22:00:02,748 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-05-22 22:00:02,948 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-05-22 22:00:02,956 - IveltScraper - INFO - Loaded 178 include, 0 exclude filters from DB topic_filters
2026-05-22 22:00:02,956 - IveltScraper - INFO - Fetching ivelt.com active topics...
2026-05-22 22:00:02,957 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-05-22 22:00:03,413 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-05-22 22:00:03,935 - RSSFeedScraper - INFO - Total RSS/HTML results: 4
2026-05-22 22:00:04,394 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-05-22 22:00:04,626 - Yiddish24Scraper - INFO - Received response with 493044 characters
2026-05-22 22:00:04,629 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (313604 chars)
2026-05-22 22:00:04,635 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-05-22 22:00:04,725 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-05-22 22:00:04,767 - Yiddish24Scraper - INFO - Page 1 extraction: 99 successful, 1 failed out of 100 elements
2026-05-22 22:00:04,767 - Yiddish24Scraper - INFO - Parsed 99 articles from HTML on page 1
2026-05-22 22:00:05,817 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 99 total articles
2026-05-22 22:00:05,818 - Yiddish24Scraper - INFO - Page 1: 0/99 new items
2026-05-22 22:00:05,818 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination
2026-05-22 22:00:05,818 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0
2026-05-22 22:00:16,375 - IveltScraper - INFO - Found 50 active topics on ivelt.com
2026-05-22 22:00:26,927 - IveltScraper - INFO - Ivelt scrape complete. Checked 3 topics, found 0 new posts.
2026-05-22 22:00:26,927 - __main__ - INFO - Scraper rss completed: 4 results
2026-05-22 22:00:26,927 - __main__ - INFO - Scraper yiddish24 completed: 0 results
2026-05-22 22:00:26,927 - __main__ - INFO - Scraper ivelt completed: 0 results
2026-05-22 22:00:27,559 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-22 22:00:27.558907
2026-05-22 22:00:27,559 - __main__ - INFO - Email sent successfully
2026-05-22 22:00:27,559 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-05-22 22:00:27,559 - __main__ - INFO - Monitor complete. Found 4 total results: 4 new rss results.
2026-05-22 22:00:27,559 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-05-22 22:00:27,559 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-22 22:00:27,615 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-05-22 22:00:27,615 - __main__ - INFO - Closed all database connections
2026-05-22 22:00:27,617 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-22 22:00:27,617 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-05-22 22:30:02,590 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-22.log
2026-05-22 22:30:02,594 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-22.log
2026-05-22 22:30:02,594 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-22.log
2026-05-22 22:30:02,595 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-05-22 22:30:02,621 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-05-22 22:30:02,621 - social_media_monitor.config.settings - WARNING - Twitter monitoring enabled but credentials validation not implemented
2026-05-22 22:30:02,621 - __main__ - INFO - Configuration loaded and validated successfully
2026-05-22 22:30:02,631 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-05-22 22:30:02,637 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-05-22 22:30:02,845 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-05-22 22:30:02,845 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-05-22 22:30:02,895 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-05-22 22:30:02,895 - __main__ - INFO - Reddit scraper initialized and enabled
2026-05-22 22:30:02,895 - __main__ - INFO - GitHub scraper initialized and enabled
2026-05-22 22:30:02,895 - __main__ - INFO - Twitter scraper initialized and enabled
2026-05-22 22:30:02,898 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0
2026-05-22 22:30:02,898 - __main__ - INFO - LinkedIn scraper initialized and enabled
2026-05-22 22:30:02,898 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled
2026-05-22 22:30:02,915 - Yiddish24Scraper - INFO - File downloader initialized with 30 terms, prefix 'Y2', and file type organization enabled
2026-05-22 22:30:02,915 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=30, exclude_terms=0
2026-05-22 22:30:02,917 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0
2026-05-22 22:30:02,922 - TorahAnytimeScraper - INFO - File downloader initialized with 51 terms, prefix 'TA', and file type organization enabled
2026-05-22 22:30:02,922 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=51, exclude_terms=3
2026-05-22 22:30:02,924 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-05-22 22:30:02,924 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0
2026-05-22 22:30:02,924 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-05-22 22:30:02,924 - __main__ - INFO - Running 5 scrapers concurrently...
2026-05-22 22:30:02,924 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit search monitoring enabled. Running search with terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-22 22:30:02,924 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['"Hermes Agent"']
2026-05-22 22:30:03,862 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term '"Hermes Agent"'
2026-05-22 22:30:03,996 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Hermes Agent model routing guide: Hermes skills without the strongest-
2026-05-22 22:30:04,013 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Hermes Agent x BitWarden Secrets make it easy to manage and rotate you
2026-05-22 22:30:04,032 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Ditching OpenClaw for Hermes Agent . Need Insights From People Actuall
2026-05-22 22:30:04,051 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Ditching OpenClaw for Hermes Agent . Need Insights From People Actuall
2026-05-22 22:30:05,319 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 4
2026-05-22 22:30:05,319 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'paperclip' restricted to subreddits: ['PaperClip_AI', 'PaperclipAI']
2026-05-22 22:30:05,319 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['paperclip']
2026-05-22 22:30:05,319 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/PaperClip_AI+PaperclipAI
2026-05-22 22:30:08,680 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'paperclip'
2026-05-22 22:30:08,726 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Best Case to Use
2026-05-22 22:30:09,936 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 1
2026-05-22 22:30:09,937 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'multica' restricted to subreddits: ['hermesagent', 'HermesAI']
2026-05-22 22:30:09,937 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['multica']
2026-05-22 22:30:09,937 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/hermesagent+HermesAI
2026-05-22 22:30:10,999 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'multica'
2026-05-22 22:30:12,284 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0
2026-05-22 22:30:12,284 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit subreddit feed monitoring enabled.
2026-05-22 22:30:12,284 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'hermes_agent': r/hermesagent+HermesAI+AI_Agents+aiagents+AgentsOfAI+LocalLLaMA+AutoGPT (limit=25)
2026-05-22 22:30:12,284 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes agent via RSS
2026-05-22 22:30:13,305 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/MercuryInstall: Mercury Agent install note: Mercury memory graph without the setup-onl
2026-05-22 22:30:13,316 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/hermesagent: Docker limitations - let's talk deployment
2026-05-22 22:30:14,525 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes AI via RSS
2026-05-22 22:30:16,747 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: nous research hermes via RSS
2026-05-22 22:30:19,234 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: multica via RSS
2026-05-22 22:30:21,272 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'paperclip_ai': r/PaperClip_AI+PaperclipAI+pAIperclip (limit=25)
2026-05-22 22:30:21,272 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip ai via RSS
2026-05-22 22:30:23,586 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip agent via RSS
2026-05-22 22:30:25,677 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: multica via RSS
2026-05-22 22:30:27,566 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'claude_agents': r/vibecoding (limit=25)
2026-05-22 22:30:27,566 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: multica via RSS
2026-05-22 22:30:29,631 - social_media_monitor.scrapers.reddit_scraper - INFO - Total subreddit feed results: 2
2026-05-22 22:30:29,631 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-22 22:30:29,797 - TwitterScraper - INFO - Searching Twitter/X (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-22 22:30:30,213 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'paperclip'
2026-05-22 22:30:42,745 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for '"Hermes Agent"'
2026-05-22 22:30:56,461 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'multica'
2026-05-22 22:31:09,803 - TwitterScraper - INFO - Twitter scrape complete. Found 0 new results.
2026-05-22 22:31:09,803 - LinkedInScraper - INFO - Searching LinkedIn (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-22 22:31:10,500 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'paperclip'
2026-05-22 22:31:10,545 - LinkedInScraper - INFO - New LinkedIn post: Paperclip — The human control plane for AI labor - LinkedIn
2026-05-22 22:31:11,974 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for '"Hermes Agent"'
2026-05-22 22:31:12,643 - LinkedInScraper - INFO - New LinkedIn post: Deploying Hermes Agent for Free on AMD Developer Cloud with open model
2026-05-22 22:31:12,722 - LinkedInScraper - INFO - New LinkedIn post: Hermes Agent - LinkedIn
2026-05-22 22:31:13,573 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'multica'
2026-05-22 22:31:13,994 - LinkedInScraper - INFO - New LinkedIn post: Eclipse Foundation Gives Details of OCX 2026 Agenda Continuing to prom
2026-05-22 22:31:14,488 - LinkedInScraper - INFO - LinkedIn scrape complete. Found 4 new results.
2026-05-22 22:31:14,489 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)
2026-05-22 22:31:18,479 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-05-22 22:31:18,504 - GitHubScraper - INFO - Found 232 GitHub repositories for term: paperclip
2026-05-22 22:31:18,530 - GitHubScraper - INFO - Added new GitHub repository: paperclip
2026-05-22 22:31:19,615 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-05-22 22:31:19,619 - GitHubScraper - INFO - Found 274 GitHub repositories for term: "Hermes Agent"
2026-05-22 22:31:20,671 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-05-22 22:31:20,674 - GitHubScraper - INFO - Found 47 GitHub repositories for term: multica
2026-05-22 22:31:20,859 - GitHubScraper - INFO - Total GitHub results found: 1
2026-05-22 22:31:20,859 - __main__ - INFO - Scraper reddit completed: 7 results
2026-05-22 22:31:20,859 - __main__ - INFO - Scraper github completed: 1 results
2026-05-22 22:31:20,859 - __main__ - INFO - Scraper twitter completed: 0 results
2026-05-22 22:31:20,860 - __main__ - INFO - Scraper linkedin completed: 4 results
2026-05-22 22:31:20,860 - __main__ - INFO - Scraper linkedin_feed completed: 0 results
2026-05-22 22:31:21,458 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-22 22:31:21.457950
2026-05-22 22:31:21,458 - __main__ - INFO - Email sent successfully
2026-05-22 22:31:21,458 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-05-22 22:31:21,458 - __main__ - INFO - Monitor complete. Found 12 total results: 7 new reddit results, 1 new github results, 4 new linkedin results.
2026-05-22 22:31:21,458 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-05-22 22:31:21,458 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-22 22:31:21,589 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-05-22 22:31:21,589 - __main__ - INFO - Closed all database connections
2026-05-22 22:31:21,621 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-22 22:31:21,638 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-05-22 23:00:03,187 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-22.log
2026-05-22 23:00:03,208 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-22.log
2026-05-22 23:00:03,208 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-22.log
2026-05-22 23:00:03,209 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-05-22 23:00:03,235 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-05-22 23:00:03,235 - __main__ - INFO - Configuration loaded and validated successfully
2026-05-22 23:00:03,248 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-05-22 23:00:03,254 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-05-22 23:00:03,599 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-05-22 23:00:03,600 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-05-22 23:00:03,603 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-05-22 23:00:03,608 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0
2026-05-22 23:00:03,608 - __main__ - INFO - RSS scraper initialized and enabled
2026-05-22 23:00:03,614 - Yiddish24Scraper - INFO - File downloader initialized with 30 terms, prefix 'Y2', and file type organization enabled
2026-05-22 23:00:03,614 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=30, exclude_terms=0
2026-05-22 23:00:03,614 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-05-22 23:00:03,642 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0
2026-05-22 23:00:03,650 - TorahAnytimeScraper - INFO - File downloader initialized with 51 terms, prefix 'TA', and file type organization enabled
2026-05-22 23:00:03,650 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=51, exclude_terms=3
2026-05-22 23:00:03,652 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-05-22 23:00:03,652 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0
2026-05-22 23:00:03,652 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-05-22 23:00:03,652 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-05-22 23:00:03,652 - __main__ - INFO - Running 3 scrapers concurrently...
2026-05-22 23:00:03,653 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-05-22 23:00:03,834 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-05-22 23:00:03,861 - IveltScraper - INFO - Loaded 178 include, 0 exclude filters from DB topic_filters
2026-05-22 23:00:03,861 - IveltScraper - INFO - Fetching ivelt.com active topics...
2026-05-22 23:00:03,862 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-05-22 23:00:04,425 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-05-22 23:00:04,943 - RSSFeedScraper - INFO - Total RSS/HTML results: 2
2026-05-22 23:00:05,341 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-05-22 23:00:05,576 - Yiddish24Scraper - INFO - Received response with 493044 characters
2026-05-22 23:00:05,579 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (313604 chars)
2026-05-22 23:00:05,585 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-05-22 23:00:05,676 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-05-22 23:00:05,713 - Yiddish24Scraper - INFO - Page 1 extraction: 99 successful, 1 failed out of 100 elements
2026-05-22 23:00:05,714 - Yiddish24Scraper - INFO - Parsed 99 articles from HTML on page 1
2026-05-22 23:00:07,237 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 99 total articles
2026-05-22 23:00:07,238 - Yiddish24Scraper - INFO - Page 1: 0/99 new items
2026-05-22 23:00:07,238 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination
2026-05-22 23:00:07,238 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0
2026-05-22 23:00:16,225 - IveltScraper - INFO - Found 50 active topics on ivelt.com
2026-05-22 23:00:25,134 - IveltScraper - INFO - Ivelt scrape complete. Checked 3 topics, found 0 new posts.
2026-05-22 23:00:25,134 - __main__ - INFO - Scraper rss completed: 2 results
2026-05-22 23:00:25,134 - __main__ - INFO - Scraper yiddish24 completed: 0 results
2026-05-22 23:00:25,134 - __main__ - INFO - Scraper ivelt completed: 0 results
2026-05-22 23:00:25,701 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-22 23:00:25.701417
2026-05-22 23:00:25,701 - __main__ - INFO - Email sent successfully
2026-05-22 23:00:25,702 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-05-22 23:00:25,702 - __main__ - INFO - Monitor complete. Found 2 total results: 2 new rss results.
2026-05-22 23:00:25,702 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-05-22 23:00:25,702 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-22 23:00:25,764 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-05-22 23:00:25,764 - __main__ - INFO - Closed all database connections
2026-05-22 23:00:25,766 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-22 23:00:25,766 - social_media_monitor.database.connection - INFO - Closed 0 database connections