โ Logs
social_media_monitor_2026-06-14.log
2026-06-14 20:30:02,057 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=5
2026-06-14 20:30:02,061 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-14 20:30:02,062 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-14 20:30:02,062 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-14 20:30:02,062 - __main__ - INFO - Running 4 scrapers concurrently...
2026-06-14 20:30:02,062 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit search monitoring enabled. Running search with terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-14 20:30:02,062 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['"Hermes Agent"']
2026-06-14 20:30:03,036 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term '"Hermes Agent"'
2026-06-14 20:30:03,079 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Frona v2026.6.0 โ self-hosted personal AI assistant
2026-06-14 20:30:03,089 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: My Hermes Agent is Managing a Youtube Channel lol
2026-06-14 20:30:03,101 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Hermes Agent (and others) default Installs are silently routing web tr
2026-06-14 20:30:03,113 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Hermes is a great agent - I just wanted an HTTP API in front of it. So
2026-06-14 20:30:03,131 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Frona v2026.6.0 - self-hosted personal AI assistant
2026-06-14 20:30:03,142 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Models, Models! Anthropic Billing Change Tomorrow (Mon 15th) โ New Kim
2026-06-14 20:30:03,157 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Any suggestions for agents to 'partner' with a small startup team of c
2026-06-14 20:30:04,304 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 7
2026-06-14 20:30:04,304 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'paperclip' restricted to subreddits: ['PaperClip_AI', 'PaperclipAI']
2026-06-14 20:30:04,304 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['paperclip']
2026-06-14 20:30:04,304 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/PaperClip_AI+PaperclipAI
2026-06-14 20:30:04,452 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 0 entries for term 'paperclip'
2026-06-14 20:30:05,452 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0
2026-06-14 20:30:05,452 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'multica' restricted to subreddits: ['hermesagent', 'HermesAI']
2026-06-14 20:30:05,452 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['multica']
2026-06-14 20:30:05,452 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/hermesagent+HermesAI
2026-06-14 20:30:05,608 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 0 entries for term 'multica'
2026-06-14 20:30:06,608 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0
2026-06-14 20:30:06,609 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit subreddit feed monitoring enabled.
2026-06-14 20:30:06,609 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'hermes_agent': r/hermesagent+HermesAI+AI_Agents+aiagents+AgentsOfAI+LocalLLaMA+AutoGPT (limit=25)
2026-06-14 20:30:06,609 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes agent via RSS
2026-06-14 20:30:07,767 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes AI via RSS
2026-06-14 20:30:08,921 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: nous research hermes via RSS
2026-06-14 20:30:10,074 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: multica via RSS
2026-06-14 20:30:11,229 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'paperclip_ai': r/PaperClip_AI+PaperclipAI+pAIperclip (limit=25)
2026-06-14 20:30:11,229 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip ai via RSS
2026-06-14 20:30:12,386 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip agent via RSS
2026-06-14 20:30:13,535 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: multica via RSS
2026-06-14 20:30:14,691 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'claude_agents': r/vibecoding (limit=25)
2026-06-14 20:30:14,691 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: multica via RSS
2026-06-14 20:30:15,847 - social_media_monitor.scrapers.reddit_scraper - INFO - Total subreddit feed results: 0
2026-06-14 20:30:15,847 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-14 20:30:15,988 - TwitterScraper - INFO - Searching Twitter/X (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-14 20:30:16,504 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'paperclip'
2026-06-14 20:30:22,949 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for '"Hermes Agent"'
2026-06-14 20:30:26,977 - TwitterScraper - INFO - New tweet/X post: my โwonderlandsโ project is now open source.
this is the next iterati
2026-06-14 20:30:31,761 - TwitterScraper - INFO - Twitter/X RSS: 95 entries for 'multica'
2026-06-14 20:30:37,327 - TwitterScraper - INFO - Twitter scrape complete. Found 1 new results.
2026-06-14 20:30:37,327 - LinkedInScraper - INFO - Searching LinkedIn (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-14 20:30:37,846 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'paperclip'
2026-06-14 20:30:39,183 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for '"Hermes Agent"'
2026-06-14 20:30:39,422 - LinkedInScraper - INFO - New LinkedIn post: ๐ My Experience Using the Hermes Agent for the Past Two Months Over th
2026-06-14 20:30:39,677 - LinkedInScraper - INFO - New LinkedIn post: New Google AI Studio Managed Agents AI that gets its own computer in t
2026-06-14 20:30:40,359 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'multica'
2026-06-14 20:30:41,154 - LinkedInScraper - INFO - LinkedIn scrape complete. Found 2 new results.
2026-06-14 20:30:42,173 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-14 20:30:42,264 - GitHubScraper - INFO - Found 238 GitHub repositories for term: paperclip
2026-06-14 20:30:43,387 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-14 20:30:43,392 - GitHubScraper - INFO - Found 361 GitHub repositories for term: "Hermes Agent"
2026-06-14 20:30:43,548 - GitHubScraper - INFO - Added new GitHub repository: immunity-agent
2026-06-14 20:30:44,406 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-14 20:30:44,409 - GitHubScraper - INFO - Found 52 GitHub repositories for term: multica
2026-06-14 20:30:44,559 - GitHubScraper - INFO - Total GitHub results found: 1
2026-06-14 20:30:44,559 - __main__ - INFO - Scraper reddit completed: 7 results
2026-06-14 20:30:44,560 - __main__ - INFO - Scraper github completed: 1 results
2026-06-14 20:30:44,560 - __main__ - INFO - Scraper twitter completed: 1 results
2026-06-14 20:30:44,560 - __main__ - INFO - Scraper linkedin completed: 2 results
2026-06-14 20:30:45,240 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-14 20:30:45.240134
2026-06-14 20:30:45,240 - __main__ - INFO - Email sent successfully
2026-06-14 20:30:45,240 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-14 20:30:45,240 - __main__ - INFO - Monitor complete. Found 11 total results: 7 new reddit results, 1 new github results, 1 new twitter results, 2 new linkedin results.
2026-06-14 20:30:45,240 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-14 20:30:45,241 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-14 20:30:45,345 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-14 20:30:45,345 - __main__ - INFO - Closed all database connections
2026-06-14 20:30:45,347 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-14 20:30:45,347 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-14 21:00:01,835 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-14.log
2026-06-14 21:00:01,835 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-14.log
2026-06-14 21:00:01,835 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-14.log
2026-06-14 21:00:01,835 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-14 21:00:01,861 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-14 21:00:01,862 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-14 21:00:01,864 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-14 21:00:01,864 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-14 21:00:01,879 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-14 21:00:01,880 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-14 21:00:01,881 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-14 21:00:01,882 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-14 21:00:01,882 - __main__ - INFO - RSS scraper initialized and enabled
2026-06-14 21:00:01,886 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-14 21:00:01,886 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-14 21:00:01,886 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-06-14 21:00:01,889 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-14 21:00:01,896 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-14 21:00:01,896 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=5
2026-06-14 21:00:01,900 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-14 21:00:01,900 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-14 21:00:01,900 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-14 21:00:01,900 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-06-14 21:00:01,900 - __main__ - INFO - Running 3 scrapers concurrently...
2026-06-14 21:00:01,900 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-06-14 21:00:01,992 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-06-14 21:00:01,996 - IveltScraper - INFO - Loaded 181 include, 0 exclude filters from DB topic_filters
2026-06-14 21:00:01,996 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-06-14 21:00:01,997 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-06-14 21:00:02,238 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-06-14 21:00:02,630 - RSSFeedScraper - INFO - Total RSS/HTML results: 3
2026-06-14 21:00:05,910 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-06-14 21:00:06,124 - Yiddish24Scraper - INFO - Received response with 451229 characters
2026-06-14 21:00:06,127 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (302582 chars)
2026-06-14 21:00:06,131 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-06-14 21:00:06,221 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-06-14 21:00:06,263 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-06-14 21:00:06,263 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-06-14 21:00:06,290 - Yiddish24Scraper - INFO - Term 'ืขื ืื ื ืืืืื' matched in DESCRIPTION: 'ืขื ืื ื ืืืืื - ืืขืืกืื ืฆืืจืืง ืืื ืืื, ืืืื ื ืืฉื ืืขื ืืื ืืืจ ืืื'ื ืฉืืขืงื'
2026-06-14 21:00:06,290 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ืืื ืืื
2026-06-14 21:00:06,790 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/chune_freidman_260_260614024807.mp3
2026-06-14 21:00:06,994 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_chune_freidman_260_260614024807.mp3 (18.4 MB)
2026-06-14 21:00:06,997 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-06-14 21:00:07,008 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_chune_freidman_260_260614024807.mp3: title, artist, album, comment, source_url, genre, publisher
2026-06-14 21:00:07,009 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2_chune_freidman_260_260614024807_ืขื ืื ื_ืืืืื.mp3
2026-06-14 21:00:07,760 - Yiddish24Scraper - INFO - Page 1 summary: 3 new out of 100 total articles
2026-06-14 21:00:07,761 - Yiddish24Scraper - INFO - Page 1: 3/100 new items
2026-06-14 21:00:07,761 - Yiddish24Scraper - INFO - Low new item ratio (3.0%), stopping pagination
2026-06-14 21:00:07,761 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 3
2026-06-14 21:00:13,672 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-06-14 21:00:27,518 - IveltScraper - INFO - Filtering post containing exclude term: '*ืืืืข ืืืื ืืืืขืจ ืืืืื ืฆื ืืืจืืืื ืงืจืื ืืข ื ืืืขืก*'
2026-06-14 21:00:41,185 - IveltScraper - INFO - ivelt scrape complete. Checked 3 topics.
2026-06-14 21:00:41,185 - IveltScraper - INFO - All forums scrape complete. Found 45 new posts.
2026-06-14 21:00:41,185 - __main__ - INFO - Scraper rss completed: 3 results
2026-06-14 21:00:41,186 - __main__ - INFO - Scraper yiddish24 completed: 3 results
2026-06-14 21:00:41,186 - __main__ - INFO - Scraper ivelt completed: 45 results
2026-06-14 21:00:41,951 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-14 21:00:41.950996
2026-06-14 21:00:41,951 - __main__ - INFO - Email sent successfully
2026-06-14 21:00:41,951 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-14 21:00:41,951 - __main__ - INFO - Monitor complete. Found 51 total results: 3 new rss results, 3 new yiddish24 results, 45 new ivelt results.
2026-06-14 21:00:41,951 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-14 21:00:41,951 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-14 21:00:42,078 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-14 21:00:42,078 - __main__ - INFO - Closed all database connections
2026-06-14 21:00:42,080 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-14 21:00:42,080 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-14 21:10:02,342 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-14.log
2026-06-14 21:10:02,343 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-14.log
2026-06-14 21:10:02,343 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-14.log
2026-06-14 21:10:02,343 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-14 21:10:02,369 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-14 21:10:02,369 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-14 21:10:02,371 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-14 21:10:02,372 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-14 21:10:02,386 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-14 21:10:02,386 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-14 21:10:02,432 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-14 21:10:02,433 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-14 21:10:02,433 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled
2026-06-14 21:10:02,436 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-14 21:10:02,436 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-14 21:10:02,439 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-14 21:10:02,444 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-14 21:10:02,444 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=5
2026-06-14 21:10:02,446 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-14 21:10:02,446 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-14 21:10:02,446 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-14 21:10:02,446 - __main__ - INFO - Running 1 scrapers concurrently...
2026-06-14 21:10:02,446 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)
2026-06-14 21:10:02,820 - LinkedInFeedScraper - INFO - Successfully auto-grabbed fresh LinkedIn cookies and User-Agent from running Chrome!
2026-06-14 21:10:15,296 - LinkedInFeedScraper - INFO - Successfully sorted fetched LinkedIn posts chronologically (most recent first)
2026-06-14 21:10:15,309 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Eliezer Gruen - Your children are quietly downloading your relationship script every single day
2026-06-14 21:10:15,357 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Shai Snir - ืงืืืืชื ืืืืงืจ ืืฉืืื ืืช ื-Cloudflare. ืืกืืื ืืชืฉืืื: $0.00.
ืืกืชืืืชื ืขืืื ืืืื ืชื ืฉืื ืืืืืง ืืืื ืืฉืืจืจ ืืช
2026-06-14 21:10:15,398 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Michael Kisilenko - I've loved football for as long as I can
remember. But tech has made it worse.
The mistakes have m
2026-06-14 21:10:15,407 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Amir Davidson - Every American Jew already has a neighborhood in Israel.
They just haven't seen the map yet.
Upper
2026-06-14 21:10:15,429 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Founder Arc - The AI agent ecosystem is growing incredibly fast.
Every week, a new platform claims to be the best
2026-06-14 21:10:15,461 - LinkedInFeedScraper - INFO - LinkedIn Feed scrape complete. Found 5 new posts.
2026-06-14 21:10:15,461 - __main__ - INFO - Scraper linkedin_feed completed: 5 results
2026-06-14 21:10:16,050 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-14 21:10:16.050247
2026-06-14 21:10:16,050 - __main__ - INFO - Email sent successfully
2026-06-14 21:10:16,050 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-14 21:10:16,050 - __main__ - INFO - Monitor complete. Found 5 total results: 5 new linkedin feed results.
2026-06-14 21:10:16,050 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-14 21:10:16,050 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-14 21:10:16,066 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-14 21:10:16,066 - __main__ - INFO - Closed all database connections
2026-06-14 21:10:16,067 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-14 21:10:16,067 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-14 22:00:02,306 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-14.log
2026-06-14 22:00:02,306 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-14.log
2026-06-14 22:00:02,306 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-14.log
2026-06-14 22:00:02,306 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-14 22:00:02,329 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-14 22:00:02,330 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-14 22:00:02,332 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-14 22:00:02,332 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-14 22:00:02,347 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-14 22:00:02,347 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-14 22:00:02,349 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-14 22:00:02,351 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-14 22:00:02,351 - __main__ - INFO - RSS scraper initialized and enabled
2026-06-14 22:00:02,357 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-14 22:00:02,357 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-14 22:00:02,357 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-06-14 22:00:02,363 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-14 22:00:02,372 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-14 22:00:02,372 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=5
2026-06-14 22:00:02,376 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-14 22:00:02,376 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-14 22:00:02,376 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-14 22:00:02,376 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-06-14 22:00:02,376 - __main__ - INFO - Running 3 scrapers concurrently...
2026-06-14 22:00:02,377 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-06-14 22:00:02,473 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-06-14 22:00:02,477 - IveltScraper - INFO - Loaded 181 include, 0 exclude filters from DB topic_filters
2026-06-14 22:00:02,477 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-06-14 22:00:02,479 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-06-14 22:00:02,781 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-06-14 22:00:03,368 - RSSFeedScraper - INFO - Total RSS/HTML results: 3
2026-06-14 22:00:12,546 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-06-14 22:00:12,770 - Yiddish24Scraper - INFO - Received response with 476705 characters
2026-06-14 22:00:12,774 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (310401 chars)
2026-06-14 22:00:12,777 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-06-14 22:00:12,876 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-06-14 22:00:12,918 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-06-14 22:00:12,918 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-06-14 22:00:12,996 - Yiddish24Scraper - INFO - Term 'ืืจื"ื' matched in TITLE: 'ืืื ืืขืจืืืื: ืืจื"ื ืจืื ืืขื ืื ืขื ืืืืจื ืจืืฉ ืืืืื ืืืืื, ืืื ืืืืื ืืขืืืืจื ืืื ื ืืจืื ืืื ืืขืจ ืื ืืืคื ืคืื ื ืคืจืืืขืจ ืืชื ื ืืืืขื ืืืืก ืืขื ืขืจ ืืื ืืื ืืขืงืืืขื ืื ืื ืืื ืืืื ืืืื ืฉืืืืขืจืืืื ืืกืื ืืืจืื'
2026-06-14 22:00:12,996 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ืืื ืืขืจืืืื: ืืจื"ื ืจืื ืืขื ืื ืขื ืืืืจื ืจืืฉ ืืืืื ืืืื
2026-06-14 22:00:13,496 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/KM_N114_125_1781471600.mp3
2026-06-14 22:00:13,652 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_KM_N114_125_1781471600.mp3 (2.5 MB)
2026-06-14 22:00:13,653 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-06-14 22:00:13,665 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_KM_N114_125_1781471600.mp3: title, artist, album, comment, source_url, genre, publisher
2026-06-14 22:00:13,665 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2_KM_N114_125_1781471600_ืืจื_ื.mp3
2026-06-14 22:00:14,363 - Yiddish24Scraper - INFO - Page 1 summary: 12 new out of 100 total articles
2026-06-14 22:00:14,363 - Yiddish24Scraper - INFO - Page 1: 12/100 new items
2026-06-14 22:00:14,363 - Yiddish24Scraper - INFO - Low new item ratio (12.0%), stopping pagination
2026-06-14 22:00:14,364 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 12
2026-06-14 22:00:14,372 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-06-14 22:00:17,249 - IveltScraper - INFO - Filtering post containing exclude term: '*ืืืืข ืืืื ืืืืขืจ ืืืืื ืฆื ืืืจืืืื ืงืจืื ืืข ื ืืืขืก*'
2026-06-14 22:00:26,916 - IveltScraper - INFO - Filtering post containing exclude term: '*ืืืืข ืืืื ืืืืขืจ ืืืืื ืฆื ืืืจืืืื ืงืจืื ืืข ื ืืืขืก*'
2026-06-14 22:00:42,788 - IveltScraper - INFO - ivelt scrape complete. Checked 4 topics.
2026-06-14 22:00:42,789 - IveltScraper - INFO - All forums scrape complete. Found 27 new posts.
2026-06-14 22:00:42,789 - __main__ - INFO - Scraper rss completed: 3 results
2026-06-14 22:00:42,789 - __main__ - INFO - Scraper yiddish24 completed: 12 results
2026-06-14 22:00:42,789 - __main__ - INFO - Scraper ivelt completed: 27 results
2026-06-14 22:00:43,612 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-14 22:00:43.612708
2026-06-14 22:00:43,613 - __main__ - INFO - Email sent successfully
2026-06-14 22:00:43,613 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-14 22:00:43,613 - __main__ - INFO - Monitor complete. Found 42 total results: 3 new rss results, 12 new yiddish24 results, 27 new ivelt results.
2026-06-14 22:00:43,613 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-14 22:00:43,613 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-14 22:00:43,694 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-14 22:00:43,694 - __main__ - INFO - Closed all database connections
2026-06-14 22:00:43,696 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-14 22:00:43,697 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-14 22:10:02,020 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-14.log
2026-06-14 22:10:02,020 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-14.log
2026-06-14 22:10:02,021 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-14.log
2026-06-14 22:10:02,021 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-14 22:10:02,044 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-14 22:10:02,044 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-14 22:10:02,046 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-14 22:10:02,047 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-14 22:10:02,062 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-14 22:10:02,063 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-14 22:10:02,065 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-14 22:10:02,066 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-14 22:10:02,067 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled
2026-06-14 22:10:02,073 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-14 22:10:02,073 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-14 22:10:02,083 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-14 22:10:02,100 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-14 22:10:02,101 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=5
2026-06-14 22:10:02,108 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-14 22:10:02,108 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-14 22:10:02,108 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-14 22:10:02,108 - __main__ - INFO - Running 1 scrapers concurrently...
2026-06-14 22:10:02,109 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)
2026-06-14 22:10:02,511 - LinkedInFeedScraper - INFO - Successfully auto-grabbed fresh LinkedIn cookies and User-Agent from running Chrome!
2026-06-14 22:10:11,525 - LinkedInFeedScraper - INFO - Successfully sorted fetched LinkedIn posts chronologically (most recent first)
2026-06-14 22:10:11,598 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Hamid S. - ๐ Can you run a multi-label Edge AI model on a $5 microcontroller to disaggregate home power consump
2026-06-14 22:10:11,655 - LinkedInFeedScraper - INFO - LinkedIn Feed scrape complete. Found 1 new posts.
2026-06-14 22:10:11,656 - __main__ - INFO - Scraper linkedin_feed completed: 1 results
2026-06-14 22:10:12,160 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-14 22:10:12.160134
2026-06-14 22:10:12,160 - __main__ - INFO - Email sent successfully
2026-06-14 22:10:12,160 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-14 22:10:12,160 - __main__ - INFO - Monitor complete. Found 1 total results: 1 new linkedin feed results.
2026-06-14 22:10:12,160 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-14 22:10:12,160 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-14 22:10:12,173 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-14 22:10:12,173 - __main__ - INFO - Closed all database connections
2026-06-14 22:10:12,175 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-14 22:10:12,175 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-14 22:30:02,576 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-14.log
2026-06-14 22:30:02,576 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-14.log
2026-06-14 22:30:02,577 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-14.log
2026-06-14 22:30:02,577 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-14 22:30:02,606 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-14 22:30:02,606 - social_media_monitor.config.settings - WARNING - Twitter monitoring enabled but credentials validation not implemented
2026-06-14 22:30:02,606 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-14 22:30:02,608 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-14 22:30:02,609 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-14 22:30:02,623 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-14 22:30:02,623 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-14 22:30:02,672 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-14 22:30:02,672 - __main__ - INFO - Reddit scraper initialized and enabled
2026-06-14 22:30:02,672 - __main__ - INFO - GitHub scraper initialized and enabled
2026-06-14 22:30:02,672 - __main__ - INFO - Twitter scraper initialized and enabled
2026-06-14 22:30:02,673 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-14 22:30:02,673 - __main__ - INFO - LinkedIn scraper initialized and enabled
2026-06-14 22:30:02,675 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-14 22:30:02,675 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-14 22:30:02,677 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-14 22:30:02,689 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-14 22:30:02,689 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=5
2026-06-14 22:30:02,694 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-14 22:30:02,696 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-14 22:30:02,697 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-14 22:30:02,697 - __main__ - INFO - Running 4 scrapers concurrently...
2026-06-14 22:30:02,697 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit search monitoring enabled. Running search with terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-14 22:30:02,697 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['"Hermes Agent"']
2026-06-14 22:30:03,698 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term '"Hermes Agent"'
2026-06-14 22:30:03,885 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Hermes Agent (and others) default Installs are silently routing web tr
2026-06-14 22:30:03,900 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Hermes Android v1.0.6 - now with voice dictation and spoken replies
2026-06-14 22:30:03,911 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: OpenAI with Hermes agent is unusable?
2026-06-14 22:30:03,924 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Hello All-NPU, Browser problems.
2026-06-14 22:30:03,943 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Hermes Updates destroy Hermes
2026-06-14 22:30:05,133 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 5
2026-06-14 22:30:05,133 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'paperclip' restricted to subreddits: ['PaperClip_AI', 'PaperclipAI']
2026-06-14 22:30:05,133 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['paperclip']
2026-06-14 22:30:05,133 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/PaperClip_AI+PaperclipAI
2026-06-14 22:30:05,282 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 0 entries for term 'paperclip'
2026-06-14 22:30:06,283 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0
2026-06-14 22:30:06,283 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'multica' restricted to subreddits: ['hermesagent', 'HermesAI']
2026-06-14 22:30:06,283 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['multica']
2026-06-14 22:30:06,283 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/hermesagent+HermesAI
2026-06-14 22:30:06,434 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 0 entries for term 'multica'
2026-06-14 22:30:07,435 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0
2026-06-14 22:30:07,435 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit subreddit feed monitoring enabled.
2026-06-14 22:30:07,435 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'hermes_agent': r/hermesagent+HermesAI+AI_Agents+aiagents+AgentsOfAI+LocalLLaMA+AutoGPT (limit=25)
2026-06-14 22:30:07,435 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes agent via RSS
2026-06-14 22:30:08,588 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes AI via RSS
2026-06-14 22:30:09,744 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: nous research hermes via RSS
2026-06-14 22:30:10,895 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: multica via RSS
2026-06-14 22:30:12,051 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'paperclip_ai': r/PaperClip_AI+PaperclipAI+pAIperclip (limit=25)
2026-06-14 22:30:12,052 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip ai via RSS
2026-06-14 22:30:13,202 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip agent via RSS
2026-06-14 22:30:14,351 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: multica via RSS
2026-06-14 22:30:15,502 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'claude_agents': r/vibecoding (limit=25)
2026-06-14 22:30:15,502 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: multica via RSS
2026-06-14 22:30:16,648 - social_media_monitor.scrapers.reddit_scraper - INFO - Total subreddit feed results: 0
2026-06-14 22:30:16,648 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-14 22:30:16,806 - TwitterScraper - INFO - Searching Twitter/X (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-14 22:30:17,270 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'paperclip'
2026-06-14 22:30:23,920 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for '"Hermes Agent"'
2026-06-14 22:30:24,902 - TwitterScraper - INFO - New tweet/X post: Had Hermes Agent with the Manim Video skill plus it's TTS tool create
2026-06-14 22:30:29,853 - TwitterScraper - INFO - New tweet/X post: Hermes Agent now support this out-of-the-box in Telegram.
This is wh
2026-06-14 22:30:31,156 - TwitterScraper - INFO - Twitter/X RSS: 95 entries for 'multica'
2026-06-14 22:30:36,769 - TwitterScraper - INFO - Twitter scrape complete. Found 2 new results.
2026-06-14 22:30:36,770 - LinkedInScraper - INFO - Searching LinkedIn (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-14 22:30:37,407 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'paperclip'
2026-06-14 22:30:38,679 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for '"Hermes Agent"'
2026-06-14 22:30:39,986 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'multica'
2026-06-14 22:30:40,731 - LinkedInScraper - INFO - LinkedIn scrape complete. Found 0 new results.
2026-06-14 22:30:41,869 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-14 22:30:41,962 - GitHubScraper - INFO - Found 238 GitHub repositories for term: paperclip
2026-06-14 22:30:43,142 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-14 22:30:43,234 - GitHubScraper - INFO - Found 361 GitHub repositories for term: "Hermes Agent"
2026-06-14 22:30:44,247 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-14 22:30:44,252 - GitHubScraper - INFO - Found 52 GitHub repositories for term: multica
2026-06-14 22:30:44,393 - GitHubScraper - INFO - Total GitHub results found: 0
2026-06-14 22:30:44,394 - __main__ - INFO - Scraper reddit completed: 5 results
2026-06-14 22:30:44,394 - __main__ - INFO - Scraper github completed: 0 results
2026-06-14 22:30:44,394 - __main__ - INFO - Scraper twitter completed: 2 results
2026-06-14 22:30:44,394 - __main__ - INFO - Scraper linkedin completed: 0 results
2026-06-14 22:30:45,018 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-14 22:30:45.018663
2026-06-14 22:30:45,019 - __main__ - INFO - Email sent successfully
2026-06-14 22:30:45,019 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-14 22:30:45,019 - __main__ - INFO - Monitor complete. Found 7 total results: 5 new reddit results, 2 new twitter results.
2026-06-14 22:30:45,019 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-14 22:30:45,019 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-14 22:30:45,115 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-14 22:30:45,116 - __main__ - INFO - Closed all database connections
2026-06-14 22:30:45,117 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-14 22:30:45,118 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-14 23:00:02,578 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-14.log
2026-06-14 23:00:02,578 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-14.log
2026-06-14 23:00:02,579 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-14.log
2026-06-14 23:00:02,579 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-14 23:00:02,604 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-14 23:00:02,605 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-14 23:00:02,607 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-14 23:00:02,607 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-14 23:00:02,641 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-14 23:00:02,641 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-14 23:00:02,643 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-14 23:00:02,645 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-14 23:00:02,645 - __main__ - INFO - RSS scraper initialized and enabled
2026-06-14 23:00:02,652 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-14 23:00:02,652 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-14 23:00:02,652 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-06-14 23:00:02,658 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-14 23:00:02,668 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-14 23:00:02,669 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=5
2026-06-14 23:00:02,673 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-14 23:00:02,673 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-14 23:00:02,673 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-14 23:00:02,673 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-06-14 23:00:02,673 - __main__ - INFO - Running 3 scrapers concurrently...
2026-06-14 23:00:02,674 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-06-14 23:00:02,768 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-06-14 23:00:02,772 - IveltScraper - INFO - Loaded 181 include, 0 exclude filters from DB topic_filters
2026-06-14 23:00:02,773 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-06-14 23:00:02,774 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-06-14 23:00:03,036 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-06-14 23:00:03,545 - RSSFeedScraper - INFO - Total RSS/HTML results: 4
2026-06-14 23:00:13,991 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-06-14 23:00:14,201 - Yiddish24Scraper - INFO - Received response with 461242 characters
2026-06-14 23:00:14,204 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (305332 chars)
2026-06-14 23:00:14,208 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-06-14 23:00:14,310 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-06-14 23:00:14,355 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-06-14 23:00:14,355 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-06-14 23:00:15,160 - Yiddish24Scraper - INFO - Page 1 summary: 9 new out of 100 total articles
2026-06-14 23:00:15,160 - Yiddish24Scraper - INFO - Page 1: 9/100 new items
2026-06-14 23:00:15,160 - Yiddish24Scraper - INFO - Low new item ratio (9.0%), stopping pagination
2026-06-14 23:00:15,160 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 9
2026-06-14 23:00:15,168 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-06-14 23:00:17,438 - IveltScraper - INFO - Filtering post containing exclude term: '*ืืืืข ืืืื ืืืืขืจ ืืืืื ืฆื ืืืจืืืื ืงืจืื ืืข ื ืืืขืก*'
2026-06-14 23:00:20,764 - IveltScraper - INFO - Filtering post containing exclude term: '*ืืืืข ืืืื ืืืืขืจ ืืืืื ืฆื ืืืจืืืื ืงืจืื ืืข ื ืืืขืก*'
2026-06-14 23:00:53,516 - IveltScraper - INFO - ivelt scrape complete. Checked 5 topics.
2026-06-14 23:00:53,517 - IveltScraper - INFO - All forums scrape complete. Found 70 new posts.
2026-06-14 23:00:53,517 - __main__ - INFO - Scraper rss completed: 4 results
2026-06-14 23:00:53,517 - __main__ - INFO - Scraper yiddish24 completed: 9 results
2026-06-14 23:00:53,518 - __main__ - INFO - Scraper ivelt completed: 70 results
2026-06-14 23:00:54,321 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-14 23:00:54.321039
2026-06-14 23:00:54,321 - __main__ - INFO - Email sent successfully
2026-06-14 23:00:54,321 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-14 23:00:54,321 - __main__ - INFO - Monitor complete. Found 83 total results: 4 new rss results, 9 new yiddish24 results, 70 new ivelt results.
2026-06-14 23:00:54,321 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-14 23:00:54,321 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-14 23:00:54,431 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-14 23:00:54,431 - __main__ - INFO - Closed all database connections
2026-06-14 23:00:54,433 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-14 23:00:54,433 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-14 23:10:01,710 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-14.log
2026-06-14 23:10:01,711 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-14.log
2026-06-14 23:10:01,711 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-14.log
2026-06-14 23:10:01,711 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-14 23:10:01,734 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-14 23:10:01,734 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-14 23:10:01,736 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-14 23:10:01,737 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-14 23:10:01,750 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-14 23:10:01,750 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-14 23:10:01,751 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-14 23:10:01,752 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-14 23:10:01,752 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled
2026-06-14 23:10:01,754 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-14 23:10:01,755 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-14 23:10:01,757 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-14 23:10:01,762 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-14 23:10:01,762 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=5
2026-06-14 23:10:01,764 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-14 23:10:01,764 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-14 23:10:01,764 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-14 23:10:01,764 - __main__ - INFO - Running 1 scrapers concurrently...
2026-06-14 23:10:01,764 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)
2026-06-14 23:10:01,998 - LinkedInFeedScraper - INFO - Successfully auto-grabbed fresh LinkedIn cookies and User-Agent from running Chrome!
2026-06-14 23:10:11,077 - LinkedInFeedScraper - INFO - Successfully sorted fetched LinkedIn posts chronologically (most recent first)
2026-06-14 23:10:11,116 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Shai Snir - ืงืืืืชื ืืืืงืจ ืืฉืืื ืืช ื-Cloudflare. ืืกืืื ืืชืฉืืื: $0.00.
ืืกืชืืืชื ืขืืื ืืืื ืชื ืฉืื ืืืืืง ืืืื ืืฉืืจืจ ืืช
2026-06-14 23:10:11,152 - LinkedInFeedScraper - INFO - New LinkedIn feed post: ๐ฅ Danny Shaket - ืงืืืื ื ืืฆืฆื ืืขืชืื.
ื ืืื, ืื ืืื ืจืืข ืงืฆืจ, ืืื ืืฉืืขืืชื.
ืืฉื ืชืชื ืืคืืืื ืคืจืืืคื ืืื ืืืฆืืจ ืื ืืฉืืง ืขื "ืืจื
2026-06-14 23:10:11,184 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Jobs USA - BA, DA, PO, AC, SM, PM.... - ๐จ Hiring: Business Analyst | Local Candidates Only
๐ Location: Indianapolis, IN (Hybrid โ Mostly Rem
2026-06-14 23:10:11,198 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Ankush Chauhan - Autonomous AI agents are the next big thing โ and most companies are already doing them wrong.
If yo
2026-06-14 23:10:11,230 - LinkedInFeedScraper - INFO - LinkedIn Feed scrape complete. Found 4 new posts.
2026-06-14 23:10:11,231 - __main__ - INFO - Scraper linkedin_feed completed: 4 results
2026-06-14 23:10:11,812 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-14 23:10:11.812313
2026-06-14 23:10:11,812 - __main__ - INFO - Email sent successfully
2026-06-14 23:10:11,813 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-14 23:10:11,813 - __main__ - INFO - Monitor complete. Found 4 total results: 4 new linkedin feed results.
2026-06-14 23:10:11,813 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-14 23:10:11,813 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-14 23:10:11,825 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-14 23:10:11,826 - __main__ - INFO - Closed all database connections
2026-06-14 23:10:11,827 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-14 23:10:11,827 - social_media_monitor.database.connection - INFO - Closed 0 database connections
Live tail active โ waiting for new lines...