โ Logs
social_media_monitor_2026-06-22.log
2026-06-22 20:33:10,943 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit top RSS: 0 entries for r/PaperClip_AI
2026-06-22 20:33:44,392 - social_media_monitor.scrapers.reddit_scraper - WARNING - Could not fetch top RSS for r/PaperclipAI after retries
2026-06-22 20:34:14,839 - social_media_monitor.scrapers.reddit_scraper - WARNING - Could not fetch top RSS for r/pAIperclip after retries
2026-06-22 20:34:14,840 - social_media_monitor.scrapers.reddit_scraper - INFO - Fetching top/day posts from feed 'claude_agents': ['vibecoding']
2026-06-22 20:34:16,505 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit top RSS: 25 entries for r/vibecoding
2026-06-22 20:34:16,646 - social_media_monitor.scrapers.reddit_scraper - INFO - New top post from feed 'claude_agents' r/vibecoding: Considering a new service LAAS
2026-06-22 20:34:16,704 - social_media_monitor.scrapers.reddit_scraper - INFO - New top post from feed 'claude_agents' r/vibecoding: Nextjs or Tanstack Start
2026-06-22 20:34:16,713 - social_media_monitor.scrapers.reddit_scraper - INFO - New top post from feed 'claude_agents' r/vibecoding: Built a wizard-CLI for scaffolding a vibe-coding tech stack
2026-06-22 20:34:19,714 - social_media_monitor.scrapers.reddit_scraper - INFO - Total top feed results: 3
2026-06-22 20:34:19,716 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-22 20:34:19,847 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)
2026-06-22 20:35:19,977 - LinkedInFeedScraper - ERROR - LinkedIn cookies not configured (li_at / JSESSIONID)
2026-06-22 20:35:21,164 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-22 20:35:21,255 - GitHubScraper - INFO - Found 242 GitHub repositories for term: paperclip
2026-06-22 20:35:21,383 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100 "HTTP/1.1 200 OK"
2026-06-22 20:35:22,147 - GitHubScraper - INFO - GitHub feed: 99 fetched, 99 new events for abeperl
2026-06-22 20:35:22,457 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-22 20:35:22,461 - GitHubScraper - INFO - Found 388 GitHub repositories for term: "Hermes Agent"
2026-06-22 20:35:23,541 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-22 20:35:23,544 - GitHubScraper - INFO - Found 53 GitHub repositories for term: multica
2026-06-22 20:35:23,686 - GitHubScraper - INFO - Total GitHub results found: 0
2026-06-22 20:35:23,687 - __main__ - INFO - Scraper reddit completed: 7 results
2026-06-22 20:35:23,687 - __main__ - INFO - Scraper github completed: 0 results
2026-06-22 20:35:23,687 - __main__ - INFO - Scraper github_feed completed: 99 results
2026-06-22 20:35:23,687 - __main__ - INFO - Scraper linkedin_feed completed: 0 results
2026-06-22 20:35:24,614 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-22 20:35:24.614858
2026-06-22 20:35:24,615 - __main__ - INFO - Email sent successfully
2026-06-22 20:35:24,615 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-22 20:35:24,615 - __main__ - INFO - Monitor complete. Found 106 total results: 7 new reddit results, 99 new github feed results.
2026-06-22 20:35:24,615 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-22 20:35:24,615 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-22 20:35:24,672 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-22 20:35:24,672 - __main__ - INFO - Closed all database connections
2026-06-22 20:35:24,673 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-22 20:35:24,674 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-22 21:00:02,751 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-22.log
2026-06-22 21:00:02,751 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-22.log
2026-06-22 21:00:02,751 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-22.log
2026-06-22 21:00:02,751 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-22 21:00:02,796 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-22 21:00:02,796 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-22 21:00:02,798 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-22 21:00:02,799 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-22 21:00:02,820 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-22 21:00:02,820 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-22 21:00:02,874 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-22 21:00:02,875 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-22 21:00:02,875 - __main__ - INFO - RSS scraper initialized and enabled
2026-06-22 21:00:02,881 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-22 21:00:02,881 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-22 21:00:02,881 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-06-22 21:00:02,886 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-22 21:00:02,897 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-22 21:00:02,897 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=10
2026-06-22 21:00:02,902 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-22 21:00:02,903 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-22 21:00:02,903 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-22 21:00:02,903 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-06-22 21:00:02,903 - __main__ - INFO - Running 3 scrapers concurrently...
2026-06-22 21:00:02,903 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-06-22 21:00:03,019 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-06-22 21:00:03,024 - IveltScraper - INFO - Loaded 181 include, 0 exclude filters from DB topic_filters
2026-06-22 21:00:03,024 - IveltScraper - INFO - Fetching ivelt.com active topics...
2026-06-22 21:00:03,027 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-06-22 21:00:03,378 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-06-22 21:00:04,074 - RSSFeedScraper - INFO - Total RSS/HTML results: 4
2026-06-22 21:00:07,803 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-06-22 21:00:08,033 - Yiddish24Scraper - INFO - Received response with 510999 characters
2026-06-22 21:00:08,035 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (315561 chars)
2026-06-22 21:00:08,036 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-06-22 21:00:08,116 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-06-22 21:00:08,162 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-06-22 21:00:08,162 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-06-22 21:00:08,819 - Yiddish24Scraper - INFO - Page 1 summary: 5 new out of 100 total articles
2026-06-22 21:00:08,819 - Yiddish24Scraper - INFO - Page 1: 5/100 new items
2026-06-22 21:00:08,819 - Yiddish24Scraper - INFO - Low new item ratio (5.0%), stopping pagination
2026-06-22 21:00:08,820 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 5
2026-06-22 21:00:14,891 - IveltScraper - INFO - Found 50 active topics on ivelt.com
2026-06-22 21:00:21,760 - IveltScraper - INFO - Ivelt scrape complete. Checked 2 topics, found 12 new posts.
2026-06-22 21:00:21,761 - __main__ - INFO - Scraper rss completed: 4 results
2026-06-22 21:00:21,761 - __main__ - INFO - Scraper yiddish24 completed: 5 results
2026-06-22 21:00:21,761 - __main__ - INFO - Scraper ivelt completed: 12 results
2026-06-22 21:00:22,691 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-22 21:00:22.691855
2026-06-22 21:00:22,692 - __main__ - INFO - Email sent successfully
2026-06-22 21:00:22,692 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-22 21:00:22,692 - __main__ - INFO - Monitor complete. Found 21 total results: 4 new rss results, 5 new yiddish24 results, 12 new ivelt results.
2026-06-22 21:00:22,692 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-22 21:00:22,692 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-22 21:00:22,805 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-22 21:00:22,806 - __main__ - INFO - Closed all database connections
2026-06-22 21:00:22,807 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-22 21:00:22,808 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-22 21:30:01,912 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-22.log
2026-06-22 21:30:01,912 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-22.log
2026-06-22 21:30:01,912 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-22.log
2026-06-22 21:30:01,912 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-22 21:30:01,942 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-22 21:30:01,944 - social_media_monitor.config.settings - WARNING - Twitter monitoring enabled but credentials validation not implemented
2026-06-22 21:30:01,944 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-22 21:30:01,947 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-22 21:30:01,947 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-22 21:30:01,972 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-22 21:30:01,973 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-22 21:30:01,974 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-22 21:30:01,974 - __main__ - INFO - Reddit scraper initialized and enabled
2026-06-22 21:30:01,974 - __main__ - INFO - GitHub scraper initialized and enabled
2026-06-22 21:30:01,974 - __main__ - INFO - GitHub feed scraper initialized and enabled
2026-06-22 21:30:01,975 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-22 21:30:01,975 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled
2026-06-22 21:30:01,977 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-22 21:30:01,977 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-22 21:30:01,980 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-22 21:30:01,985 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-22 21:30:01,985 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=10
2026-06-22 21:30:01,987 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-22 21:30:01,987 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-22 21:30:01,987 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-22 21:30:01,987 - __main__ - INFO - Running 4 scrapers concurrently...
2026-06-22 21:30:01,988 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit search monitoring enabled. Running search with terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-22 21:30:01,988 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['"Hermes Agent"']
2026-06-22 21:30:03,141 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term '"Hermes Agent"'
2026-06-22 21:30:03,212 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: UDM 1st gen. OoM crashes and restarts.
2026-06-22 21:30:03,232 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: (new use cases) Hermes + Android + Tasker = OVERPOWERED
2026-06-22 21:30:04,490 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 2
2026-06-22 21:30:04,491 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'paperclip' restricted to subreddits: ['PaperClip_AI', 'PaperclipAI']
2026-06-22 21:30:04,491 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['paperclip']
2026-06-22 21:30:04,491 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/PaperClip_AI+PaperclipAI
2026-06-22 21:30:04,637 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 0 entries for term 'paperclip'
2026-06-22 21:30:05,637 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0
2026-06-22 21:30:05,638 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'multica' restricted to subreddits: ['hermesagent', 'HermesAI']
2026-06-22 21:30:05,638 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['multica']
2026-06-22 21:30:05,638 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/hermesagent+HermesAI
2026-06-22 21:30:05,792 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 0 entries for term 'multica'
2026-06-22 21:30:06,792 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0
2026-06-22 21:30:06,793 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit subreddit feed monitoring enabled.
2026-06-22 21:30:06,793 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'hermes_agent': r/hermesagent+HermesAI+AI_Agents+aiagents+AgentsOfAI+LocalLLaMA+AutoGPT (limit=25)
2026-06-22 21:30:06,793 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes agent via RSS
2026-06-22 21:30:07,938 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes AI via RSS
2026-06-22 21:30:09,087 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: nous research hermes via RSS
2026-06-22 21:30:10,222 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: multica via RSS
2026-06-22 21:30:11,373 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'paperclip_ai': r/PaperClip_AI+PaperclipAI+pAIperclip (limit=25)
2026-06-22 21:30:11,373 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip ai via RSS
2026-06-22 21:30:12,506 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip agent via RSS
2026-06-22 21:30:13,652 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: multica via RSS
2026-06-22 21:30:14,804 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'claude_agents': r/vibecoding (limit=25)
2026-06-22 21:30:14,804 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: multica via RSS
2026-06-22 21:30:15,959 - social_media_monitor.scrapers.reddit_scraper - INFO - Total subreddit feed results: 0
2026-06-22 21:30:15,959 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit top feed monitoring enabled (t=day).
2026-06-22 21:30:15,960 - social_media_monitor.scrapers.reddit_scraper - INFO - Fetching top/day posts from feed 'hermes_agent': ['hermesagent', 'HermesAI', 'AI_Agents', 'aiagents', 'AgentsOfAI', 'LocalLLaMA', 'AutoGPT']
2026-06-22 21:30:46,395 - social_media_monitor.scrapers.reddit_scraper - WARNING - Could not fetch top RSS for r/hermesagent after retries
2026-06-22 21:31:01,943 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit top RSS: 0 entries for r/HermesAI
2026-06-22 21:31:05,582 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit top RSS: 25 entries for r/AI_Agents
2026-06-22 21:31:05,621 - social_media_monitor.scrapers.reddit_scraper - INFO - New top post from feed 'hermes_agent' r/AI_Agents: 20 actually-useful agents I'm running right now (no theory, just worki
2026-06-22 21:31:05,702 - social_media_monitor.scrapers.reddit_scraper - INFO - New top post from feed 'hermes_agent' r/AI_Agents: I think many AI startups are losing money without realizing it
2026-06-22 21:31:05,793 - social_media_monitor.scrapers.reddit_scraper - INFO - New top post from feed 'hermes_agent' r/AI_Agents: Having difficulty finding customers so I decided to release my busines
2026-06-22 21:31:05,806 - social_media_monitor.scrapers.reddit_scraper - INFO - New top post from feed 'hermes_agent' r/AI_Agents: zero knowledge
2026-06-22 21:31:05,819 - social_media_monitor.scrapers.reddit_scraper - INFO - New top post from feed 'hermes_agent' r/AI_Agents: Silly question about taxes and AI
2026-06-22 21:31:05,833 - social_media_monitor.scrapers.reddit_scraper - INFO - New top post from feed 'hermes_agent' r/AI_Agents: How to create my own AI real estate analysis agent?
2026-06-22 21:31:05,846 - social_media_monitor.scrapers.reddit_scraper - INFO - New top post from feed 'hermes_agent' r/AI_Agents: What should teams ask before trusting an AI agent in real workflows?
2026-06-22 21:31:05,858 - social_media_monitor.scrapers.reddit_scraper - INFO - New top post from feed 'hermes_agent' r/AI_Agents: Weekly Hiring Thread
2026-06-22 21:31:05,875 - social_media_monitor.scrapers.reddit_scraper - INFO - New top post from feed 'hermes_agent' r/AI_Agents: How do you choose between competing MCP tools for the same task?
2026-06-22 21:31:05,886 - social_media_monitor.scrapers.reddit_scraper - INFO - New top post from feed 'hermes_agent' r/AI_Agents: Anyone else lose track of which version of a prompt is the "good" one?
2026-06-22 21:31:05,899 - social_media_monitor.scrapers.reddit_scraper - INFO - New top post from feed 'hermes_agent' r/AI_Agents: You can see how your agent performed. Can you see how it performed for
2026-06-22 21:31:39,550 - social_media_monitor.scrapers.reddit_scraper - WARNING - Could not fetch top RSS for r/aiagents after retries
2026-06-22 21:32:09,982 - social_media_monitor.scrapers.reddit_scraper - WARNING - Could not fetch top RSS for r/AgentsOfAI after retries
2026-06-22 21:32:12,838 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit top RSS: 25 entries for r/LocalLLaMA
2026-06-22 21:32:12,848 - social_media_monitor.scrapers.reddit_scraper - INFO - New top post from feed 'hermes_agent' r/LocalLLaMA: Chinese Hackers Latest Masterpiece with NVIDIA
2026-06-22 21:32:12,922 - social_media_monitor.scrapers.reddit_scraper - INFO - New top post from feed 'hermes_agent' r/LocalLLaMA: Same model, same prompt, 4 different agents
2026-06-22 21:32:12,942 - social_media_monitor.scrapers.reddit_scraper - INFO - New top post from feed 'hermes_agent' r/LocalLLaMA: TMax: A Simple Recipe for Terminal Agents
2026-06-22 21:32:12,954 - social_media_monitor.scrapers.reddit_scraper - INFO - New top post from feed 'hermes_agent' r/LocalLLaMA: Top-N-Sigma: Remove unconditional softmax+sort by TimNN ยท Pull Request
2026-06-22 21:32:12,968 - social_media_monitor.scrapers.reddit_scraper - INFO - New top post from feed 'hermes_agent' r/LocalLLaMA: GLM-5.2 UD-IQ1_M on llama.cpp โ 5090 + 3090 Ti speed test (~ 579 t/s p
2026-06-22 21:32:12,997 - social_media_monitor.scrapers.reddit_scraper - INFO - New top post from feed 'hermes_agent' r/LocalLLaMA: Moebius: 0.2B Lightweight Image Inpainting Framework with 10B-Level Pe
2026-06-22 21:32:13,013 - social_media_monitor.scrapers.reddit_scraper - INFO - New top post from feed 'hermes_agent' r/LocalLLaMA: NEX-N2-mini: "There is no Pareto frontier. I am Pareto". This Qwen3.5-
2026-06-22 21:32:13,030 - social_media_monitor.scrapers.reddit_scraper - INFO - New top post from feed 'hermes_agent' r/LocalLLaMA: GLM-5.2 vs Claude Opus
2026-06-22 21:32:13,056 - social_media_monitor.scrapers.reddit_scraper - INFO - New top post from feed 'hermes_agent' r/LocalLLaMA: Add Laguna M.1 GGUF support by empty-quiver ยท Pull Request #2003 ยท ika
2026-06-22 21:32:46,517 - social_media_monitor.scrapers.reddit_scraper - WARNING - Could not fetch top RSS for r/AutoGPT after retries
2026-06-22 21:32:46,518 - social_media_monitor.scrapers.reddit_scraper - INFO - Fetching top/day posts from feed 'paperclip_ai': ['PaperClip_AI', 'PaperclipAI', 'pAIperclip']
2026-06-22 21:33:02,069 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit top RSS: 0 entries for r/PaperClip_AI
2026-06-22 21:33:35,513 - social_media_monitor.scrapers.reddit_scraper - WARNING - Could not fetch top RSS for r/PaperclipAI after retries
2026-06-22 21:34:05,952 - social_media_monitor.scrapers.reddit_scraper - WARNING - Could not fetch top RSS for r/pAIperclip after retries
2026-06-22 21:34:05,953 - social_media_monitor.scrapers.reddit_scraper - INFO - Fetching top/day posts from feed 'claude_agents': ['vibecoding']
2026-06-22 21:34:06,659 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit top RSS: 25 entries for r/vibecoding
2026-06-22 21:34:06,803 - social_media_monitor.scrapers.reddit_scraper - INFO - New top post from feed 'claude_agents' r/vibecoding: What's the most interesting thing you've built with AI?
2026-06-22 21:34:06,861 - social_media_monitor.scrapers.reddit_scraper - INFO - New top post from feed 'claude_agents' r/vibecoding: making vibe coded app these days , share it with us!
2026-06-22 21:34:06,876 - social_media_monitor.scrapers.reddit_scraper - INFO - New top post from feed 'claude_agents' r/vibecoding: Was putting off launching because the LLC and banking setup felt like
2026-06-22 21:34:09,885 - social_media_monitor.scrapers.reddit_scraper - INFO - Total top feed results: 23
2026-06-22 21:34:09,887 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-22 21:34:10,017 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)
2026-06-22 21:34:10,461 - LinkedInFeedScraper - INFO - Successfully auto-grabbed fresh LinkedIn cookies and User-Agent from running Chrome!
2026-06-22 21:34:19,278 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Rabbi Avi Bernstein - If anyone is looking to hire a highly skilled, intelligent, and hard working professional with experience in tax and audit who is moving to the NY/NJ area, please message me for a resume.
2026-06-22 21:34:19,287 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Meadowbrook Care Center - It was our pleasure to celebrate our amazing CNAs last week! ๐ Thank you for your compassion, hard work, and unwavering dedication to our residents. Your commitment makes a difference every day, and w
2026-06-22 21:34:19,293 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Heshy Israel - If a client slips in your office...
If your work causes property damage...
If someone sues your business over an advertising claim...
General liability is what stands between you and paying that out
2026-06-22 21:34:19,300 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Solomon Reisman - For more than 20 years, I have had the privilege of serving as a volunteer paramedic with Hatzoloh. During that time, I have responded to hundreds of emergency calls and witnessed firsthand what it me
2026-06-22 21:34:19,306 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Ptex Group - A huge congratulations to the entire QFS - Quality Facility Solutions team. Projects like this don't happen overnight. They take vision, persistence, and years of hard work to bring to life.
QFS no l
2026-06-22 21:34:19,314 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Rosa B Glanz - We just finished a qualifications and exclusions review for a project.
40+ subcontractor proposals.
958 exclusions.
Read that again.
958 separate ways for someone to say, "That's not included."
B
2026-06-22 21:34:19,321 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Sam Berkovicz - Being slow to respond to emails is not something anyone has ever accused me of.
Iโm practically instantaneous.
So when someone tells me they emailed me and never heard back, there are only two exp
2026-06-22 21:34:19,327 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Moshe Freund - https://lnkd.in/eseGMk_t
2026-06-22 21:34:19,334 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Sol Jacobs - Job #1872: Tax Department Manager | Monsey, NY
Are you a CPA with at least 5 years of progressive tax experience in public accounting, along with strong technical knowledge of individual, corporate,
2026-06-22 21:34:19,340 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Chaim Geldzahler - ๐ฆ๏ธ Weather update for tonight's event!
Due to the weather, we've moved indoors โ we will NOT be on the rooftop. The event will now take place on the 11th Floor.
All other details remain the same. We
2026-06-22 21:34:19,347 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Charles Silver - IMAGE
2026-06-22 21:34:19,354 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Steven Abbass - Very proud to say our company ranked 109 in the Fortune 500!
This recognition is well deserved for such a hardworking team.
#Fortune500 #NM050 #FinanceCareers #NorthwesternMutual
2026-06-22 21:34:19,362 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Principles Venture - Principles Venture is now on LinkedIn.
We invest in what AI depends on โ not the models, but what makes them run.
Several investments made. More in the works.
Building something in that space? We w
2026-06-22 21:34:19,369 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Yaakov Astor - After months of expected interest rate cuts, the Federal Reserve is shifting its focus back to managing inflation. This "higher-for-longer" interest rate environment may present compelling opportuniti
2026-06-22 21:34:19,384 - LinkedInFeedScraper - INFO - New LinkedIn feed post: AMP Residential - ๐จ We're Hiring in Port Charlotte, FL! ๐จ
Are you an experienced multifamily professional ready to take the next step in your career? AMP Residential is looking for an Assistant Property Manager to joi
2026-06-22 21:34:19,394 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Chana Binder - While everyone else is winding down, Lehman College's new student residences, The Lehman Grand, is gearing up to open for the upcoming school year.
Students will have access to a co-working lounge,
2026-06-22 21:34:19,403 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Chaim Geldzahler - We're excited to share that we'll be joined by two of New York City's dedicated public servants at our upcoming event! ๐
๐ฃ๏ธ Brooklyn Borough President Antonio Reynoso will stop by at 6:00 PM for a sh
2026-06-22 21:34:19,403 - LinkedInFeedScraper - INFO - LinkedIn Feed scrape complete. Found 17 new posts.
2026-06-22 21:34:20,514 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-22 21:34:20,539 - GitHubScraper - INFO - Found 242 GitHub repositories for term: paperclip
2026-06-22 21:34:20,676 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100 "HTTP/1.1 200 OK"
2026-06-22 21:34:21,415 - GitHubScraper - INFO - GitHub feed: 99 fetched, 2 new events for abeperl
2026-06-22 21:34:21,805 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-22 21:34:21,809 - GitHubScraper - INFO - Found 388 GitHub repositories for term: "Hermes Agent"
2026-06-22 21:34:21,876 - GitHubScraper - INFO - Added new GitHub repository: pi-hermes-memory
2026-06-22 21:34:22,915 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-22 21:34:22,919 - GitHubScraper - INFO - Found 53 GitHub repositories for term: multica
2026-06-22 21:34:23,128 - GitHubScraper - INFO - Total GitHub results found: 1
2026-06-22 21:34:23,128 - __main__ - INFO - Scraper reddit completed: 25 results
2026-06-22 21:34:23,128 - __main__ - INFO - Scraper github completed: 1 results
2026-06-22 21:34:23,128 - __main__ - INFO - Scraper github_feed completed: 2 results
2026-06-22 21:34:23,128 - __main__ - INFO - Scraper linkedin_feed completed: 17 results
2026-06-22 21:34:23,129 - social_media_monitor.sheets.webinar_sheets_writer - INFO - Checking 17 LinkedIn feed posts for webinar/course mentions...
2026-06-22 21:34:24,275 - social_media_monitor.sheets.webinar_sheets_writer - INFO - Loaded 11 existing URLs from sheet for dedup
2026-06-22 21:34:24,276 - social_media_monitor.sheets.webinar_sheets_writer - INFO - Webinar/course match: Sol Jacobs - keyword 'learn' - https://www.linkedin.com/feed/update/urn:li:activity:7474914166890397696
2026-06-22 21:34:25,294 - social_media_monitor.sheets.webinar_sheets_writer - INFO - Appended 1 rows to Google Sheet 'Webinar Recording DMs'
2026-06-22 21:34:25,294 - __main__ - INFO - Webinar/Course: appended 1 posts to Google Sheet
2026-06-22 21:34:26,231 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-22 21:34:26.231187
2026-06-22 21:34:26,231 - __main__ - INFO - Email sent successfully
2026-06-22 21:34:26,231 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-22 21:34:26,231 - __main__ - INFO - Monitor complete. Found 45 total results: 25 new reddit results, 1 new github results, 2 new github feed results, 17 new linkedin feed results.
2026-06-22 21:34:26,232 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-22 21:34:26,232 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-22 21:34:26,332 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-22 21:34:26,333 - __main__ - INFO - Closed all database connections
2026-06-22 21:34:26,334 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-22 21:34:26,335 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-22 22:00:02,437 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-22.log
2026-06-22 22:00:02,437 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-22.log
2026-06-22 22:00:02,437 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-22.log
2026-06-22 22:00:02,437 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-22 22:00:02,472 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-22 22:00:02,472 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-22 22:00:02,475 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-22 22:00:02,476 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-22 22:00:02,490 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-22 22:00:02,491 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-22 22:00:02,492 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-22 22:00:02,493 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-22 22:00:02,493 - __main__ - INFO - RSS scraper initialized and enabled
2026-06-22 22:00:02,495 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-22 22:00:02,495 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-22 22:00:02,495 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-06-22 22:00:02,499 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-22 22:00:02,504 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-22 22:00:02,504 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=10
2026-06-22 22:00:02,506 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-22 22:00:02,506 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-22 22:00:02,506 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-22 22:00:02,506 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-06-22 22:00:02,506 - __main__ - INFO - Running 3 scrapers concurrently...
2026-06-22 22:00:02,507 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-06-22 22:00:02,600 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-06-22 22:00:02,605 - IveltScraper - INFO - Loaded 181 include, 0 exclude filters from DB topic_filters
2026-06-22 22:00:02,605 - IveltScraper - INFO - Fetching ivelt.com active topics...
2026-06-22 22:00:02,607 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-06-22 22:00:03,108 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-06-22 22:00:03,539 - RSSFeedScraper - INFO - Total RSS/HTML results: 3
2026-06-22 22:00:09,476 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-06-22 22:00:09,697 - Yiddish24Scraper - INFO - Received response with 500484 characters
2026-06-22 22:00:09,698 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (312432 chars)
2026-06-22 22:00:09,700 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-06-22 22:00:09,784 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-06-22 22:00:09,824 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-06-22 22:00:09,824 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-06-22 22:00:10,522 - Yiddish24Scraper - INFO - Page 1 summary: 6 new out of 100 total articles
2026-06-22 22:00:10,523 - Yiddish24Scraper - INFO - Page 1: 6/100 new items
2026-06-22 22:00:10,523 - Yiddish24Scraper - INFO - Low new item ratio (6.0%), stopping pagination
2026-06-22 22:00:10,523 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 6
2026-06-22 22:00:14,329 - IveltScraper - INFO - Found 50 active topics on ivelt.com
2026-06-22 22:00:24,889 - IveltScraper - INFO - Ivelt scrape complete. Checked 3 topics, found 10 new posts.
2026-06-22 22:00:24,890 - __main__ - INFO - Scraper rss completed: 3 results
2026-06-22 22:00:24,890 - __main__ - INFO - Scraper yiddish24 completed: 6 results
2026-06-22 22:00:24,890 - __main__ - INFO - Scraper ivelt completed: 10 results
2026-06-22 22:00:25,840 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-22 22:00:25.840792
2026-06-22 22:00:25,841 - __main__ - INFO - Email sent successfully
2026-06-22 22:00:25,841 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-22 22:00:25,841 - __main__ - INFO - Monitor complete. Found 19 total results: 3 new rss results, 6 new yiddish24 results, 10 new ivelt results.
2026-06-22 22:00:25,841 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-22 22:00:25,841 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-22 22:00:25,930 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-22 22:00:25,930 - __main__ - INFO - Closed all database connections
2026-06-22 22:00:25,933 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-22 22:00:25,933 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-22 22:30:02,237 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-22.log
2026-06-22 22:30:02,238 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-22.log
2026-06-22 22:30:02,238 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-22.log
2026-06-22 22:30:02,238 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-22 22:30:02,265 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-22 22:30:02,265 - social_media_monitor.config.settings - WARNING - Twitter monitoring enabled but credentials validation not implemented
2026-06-22 22:30:02,265 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-22 22:30:02,267 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-22 22:30:02,268 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-22 22:30:02,289 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-22 22:30:02,289 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-22 22:30:02,330 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-22 22:30:02,330 - __main__ - INFO - GitHub scraper initialized and enabled
2026-06-22 22:30:02,330 - __main__ - INFO - GitHub feed scraper initialized and enabled
2026-06-22 22:30:02,331 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-22 22:30:02,331 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled
2026-06-22 22:30:02,334 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-22 22:30:02,334 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-22 22:30:02,337 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-22 22:30:02,341 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-22 22:30:02,341 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=10
2026-06-22 22:30:02,343 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-22 22:30:02,343 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-22 22:30:02,344 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-22 22:30:02,344 - __main__ - INFO - Running 3 scrapers concurrently...
2026-06-22 22:30:02,344 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-22 22:30:02,439 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)
2026-06-22 22:30:02,642 - LinkedInFeedScraper - ERROR - LinkedIn cookies not configured (li_at / JSESSIONID)
2026-06-22 22:30:03,720 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-22 22:30:03,745 - GitHubScraper - INFO - Found 242 GitHub repositories for term: paperclip
2026-06-22 22:30:03,909 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100 "HTTP/1.1 200 OK"
2026-06-22 22:30:04,706 - GitHubScraper - INFO - GitHub feed: 99 fetched, 0 new events for abeperl
2026-06-22 22:30:05,041 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-22 22:30:05,045 - GitHubScraper - INFO - Found 388 GitHub repositories for term: "Hermes Agent"
2026-06-22 22:30:06,076 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-22 22:30:06,089 - GitHubScraper - INFO - Found 53 GitHub repositories for term: multica
2026-06-22 22:30:06,240 - GitHubScraper - INFO - Total GitHub results found: 0
2026-06-22 22:30:06,240 - __main__ - INFO - Scraper github completed: 0 results
2026-06-22 22:30:06,240 - __main__ - INFO - Scraper github_feed completed: 0 results
2026-06-22 22:30:06,240 - __main__ - INFO - Scraper linkedin_feed completed: 0 results
2026-06-22 22:30:06,240 - __main__ - INFO - No new results found across all enabled sources
2026-06-22 22:30:06,240 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-22 22:30:06,240 - __main__ - INFO - Monitor complete. No new results found across all sources.
2026-06-22 22:30:06,240 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-22 22:30:06,240 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-22 22:30:06,278 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-22 22:30:06,278 - __main__ - INFO - Closed all database connections
2026-06-22 22:30:06,280 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-22 22:30:06,280 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-22 23:00:01,754 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-22.log
2026-06-22 23:00:01,755 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-22.log
2026-06-22 23:00:01,755 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-22.log
2026-06-22 23:00:01,755 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-22 23:00:01,787 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-22 23:00:01,787 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-22 23:00:01,789 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-22 23:00:01,790 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-22 23:00:01,806 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-22 23:00:01,808 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-22 23:00:01,810 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-22 23:00:01,811 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-22 23:00:01,811 - __main__ - INFO - RSS scraper initialized and enabled
2026-06-22 23:00:01,813 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-22 23:00:01,813 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-22 23:00:01,813 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-06-22 23:00:01,817 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-22 23:00:01,822 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-22 23:00:01,822 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=10
2026-06-22 23:00:01,824 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-22 23:00:01,825 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-22 23:00:01,825 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-22 23:00:01,825 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-06-22 23:00:01,825 - __main__ - INFO - Running 3 scrapers concurrently...
2026-06-22 23:00:01,825 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-06-22 23:00:01,930 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-06-22 23:00:01,939 - IveltScraper - INFO - Loaded 181 include, 0 exclude filters from DB topic_filters
2026-06-22 23:00:01,939 - IveltScraper - INFO - Fetching ivelt.com active topics...
2026-06-22 23:00:01,941 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-06-22 23:00:02,288 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-06-22 23:00:03,092 - RSSFeedScraper - INFO - Total RSS/HTML results: 3
2026-06-22 23:00:06,395 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-06-22 23:00:06,603 - Yiddish24Scraper - INFO - Received response with 495024 characters
2026-06-22 23:00:06,604 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (310539 chars)
2026-06-22 23:00:06,605 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-06-22 23:00:06,677 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-06-22 23:00:06,716 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-06-22 23:00:06,716 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-06-22 23:00:06,740 - Yiddish24Scraper - INFO - Term 'ืฉืืขืืฆืขืจ' matched in DESCRIPTION: 'ืจ' ืืจื ืฉืืขืืฆืขืจ'
2026-06-22 23:00:06,740 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ืืื ืืขืจืืืื: "ืืื ืืื ืืขื ืฉืืช ืืขืืขืื ืืืืื ืคืืจ ืจ' ื
2026-06-22 23:00:07,254 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/KM_N114_192_1782168309.mp3
2026-06-22 23:00:07,339 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_KM_N114_192_1782168309.mp3 (1.8 MB)
2026-06-22 23:00:07,339 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-06-22 23:00:07,346 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_KM_N114_192_1782168309.mp3: title, artist, album, comment, source_url, genre, publisher
2026-06-22 23:00:07,346 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2_KM_N114_192_1782168309_ืฉืืขืืฆืขืจ.mp3
2026-06-22 23:00:07,995 - Yiddish24Scraper - INFO - Page 1 summary: 8 new out of 100 total articles
2026-06-22 23:00:07,996 - Yiddish24Scraper - INFO - Page 1: 8/100 new items
2026-06-22 23:00:07,996 - Yiddish24Scraper - INFO - Low new item ratio (8.0%), stopping pagination
2026-06-22 23:00:07,996 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 8
2026-06-22 23:00:13,608 - IveltScraper - INFO - Found 50 active topics on ivelt.com
2026-06-22 23:00:31,556 - IveltScraper - INFO - Ivelt scrape complete. Checked 3 topics, found 8 new posts.
2026-06-22 23:00:31,556 - __main__ - INFO - Scraper rss completed: 3 results
2026-06-22 23:00:31,556 - __main__ - INFO - Scraper yiddish24 completed: 8 results
2026-06-22 23:00:31,556 - __main__ - INFO - Scraper ivelt completed: 8 results
2026-06-22 23:00:32,438 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-22 23:00:32.438161
2026-06-22 23:00:32,438 - __main__ - INFO - Email sent successfully
2026-06-22 23:00:32,438 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-22 23:00:32,438 - __main__ - INFO - Monitor complete. Found 19 total results: 3 new rss results, 8 new yiddish24 results, 8 new ivelt results.
2026-06-22 23:00:32,438 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-22 23:00:32,438 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-22 23:00:32,524 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-22 23:00:32,524 - __main__ - INFO - Closed all database connections
2026-06-22 23:00:32,527 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-22 23:00:32,527 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-22 23:30:01,948 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-22.log
2026-06-22 23:30:01,950 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-22.log
2026-06-22 23:30:01,950 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-22.log
2026-06-22 23:30:01,950 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-22 23:30:01,977 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-22 23:30:01,977 - social_media_monitor.config.settings - WARNING - Twitter monitoring enabled but credentials validation not implemented
2026-06-22 23:30:01,977 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-22 23:30:01,979 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-22 23:30:01,979 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-22 23:30:01,992 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-22 23:30:01,993 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-22 23:30:01,993 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-22 23:30:01,994 - __main__ - INFO - GitHub scraper initialized and enabled
2026-06-22 23:30:01,994 - __main__ - INFO - GitHub feed scraper initialized and enabled
2026-06-22 23:30:01,994 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-22 23:30:01,994 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled
2026-06-22 23:30:01,997 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-22 23:30:01,997 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-22 23:30:01,999 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-22 23:30:02,004 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-22 23:30:02,004 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=10
2026-06-22 23:30:02,006 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-22 23:30:02,006 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-22 23:30:02,006 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-22 23:30:02,006 - __main__ - INFO - Running 3 scrapers concurrently...
2026-06-22 23:30:02,006 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-22 23:30:02,123 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)
2026-06-22 23:30:02,570 - LinkedInFeedScraper - ERROR - LinkedIn cookies not configured (li_at / JSESSIONID)
2026-06-22 23:30:03,553 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100 "HTTP/1.1 200 OK"
2026-06-22 23:30:04,450 - GitHubScraper - INFO - GitHub feed: 99 fetched, 4 new events for abeperl
2026-06-22 23:30:04,453 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-22 23:30:04,457 - GitHubScraper - INFO - Found 242 GitHub repositories for term: paperclip
2026-06-22 23:30:04,516 - GitHubScraper - INFO - Added new GitHub repository: hermeshub
2026-06-22 23:30:05,662 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-22 23:30:05,666 - GitHubScraper - INFO - Found 388 GitHub repositories for term: "Hermes Agent"
2026-06-22 23:30:06,735 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-22 23:30:06,739 - GitHubScraper - INFO - Found 53 GitHub repositories for term: multica
2026-06-22 23:30:06,887 - GitHubScraper - INFO - Total GitHub results found: 1
2026-06-22 23:30:06,887 - __main__ - INFO - Scraper github completed: 1 results
2026-06-22 23:30:06,887 - __main__ - INFO - Scraper github_feed completed: 4 results
2026-06-22 23:30:06,887 - __main__ - INFO - Scraper linkedin_feed completed: 0 results
2026-06-22 23:30:07,573 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-22 23:30:07.573802
2026-06-22 23:30:07,574 - __main__ - INFO - Email sent successfully
2026-06-22 23:30:07,575 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-22 23:30:07,575 - __main__ - INFO - Monitor complete. Found 5 total results: 1 new github results, 4 new github feed results.
2026-06-22 23:30:07,575 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-22 23:30:07,575 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-22 23:30:07,851 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-22 23:30:07,851 - __main__ - INFO - Closed all database connections
2026-06-22 23:30:07,854 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-22 23:30:07,854 - social_media_monitor.database.connection - INFO - Closed 0 database connections
Live tail active โ waiting for new lines...