โ Logs
social_media_monitor_2026-06-05.log
2026-06-05 20:00:38,933 - __main__ - INFO - Scraper rss completed: 4 results
2026-06-05 20:00:38,933 - __main__ - INFO - Scraper yiddish24 completed: 9 results
2026-06-05 20:00:38,933 - __main__ - INFO - Scraper ivelt completed: 7 results
2026-06-05 20:00:39,592 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-05 20:00:39.592495
2026-06-05 20:00:39,592 - __main__ - INFO - Email sent successfully
2026-06-05 20:00:39,592 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-05 20:00:39,592 - __main__ - INFO - Monitor complete. Found 20 total results: 4 new rss results, 9 new yiddish24 results, 7 new ivelt results.
2026-06-05 20:00:39,593 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-05 20:00:39,593 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-05 20:00:39,639 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-05 20:00:39,639 - __main__ - INFO - Closed all database connections
2026-06-05 20:00:39,641 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-05 20:00:39,642 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-05 20:30:02,228 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-05.log
2026-06-05 20:30:02,228 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-05.log
2026-06-05 20:30:02,228 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-05.log
2026-06-05 20:30:02,228 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-05 20:30:02,261 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-05 20:30:02,261 - social_media_monitor.config.settings - WARNING - Twitter monitoring enabled but credentials validation not implemented
2026-06-05 20:30:02,261 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-05 20:30:02,264 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-05 20:30:02,264 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-05 20:30:02,277 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-05 20:30:02,277 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-05 20:30:02,278 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-05 20:30:02,278 - __main__ - INFO - Reddit scraper initialized and enabled
2026-06-05 20:30:02,278 - __main__ - INFO - GitHub scraper initialized and enabled
2026-06-05 20:30:02,278 - __main__ - INFO - Twitter scraper initialized and enabled
2026-06-05 20:30:02,279 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-05 20:30:02,279 - __main__ - INFO - LinkedIn scraper initialized and enabled
2026-06-05 20:30:02,279 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled
2026-06-05 20:30:02,281 - Yiddish24Scraper - INFO - File downloader initialized with 29 terms, prefix 'Y2', and file type organization enabled
2026-06-05 20:30:02,281 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=29, exclude_terms=0
2026-06-05 20:30:02,284 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-05 20:30:02,288 - TorahAnytimeScraper - INFO - File downloader initialized with 51 terms, prefix 'TA', and file type organization enabled
2026-06-05 20:30:02,288 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=51, exclude_terms=3
2026-06-05 20:30:02,290 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-05 20:30:02,290 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0
2026-06-05 20:30:02,290 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-05 20:30:02,290 - __main__ - INFO - Running 5 scrapers concurrently...
2026-06-05 20:30:02,290 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit search monitoring enabled. Running search with terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-05 20:30:02,290 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['"Hermes Agent"']
2026-06-05 20:30:03,360 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term '"Hermes Agent"'
2026-06-05 20:30:03,396 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: How To Use PewDiePie Odysseus AI Agent With Hermes
2026-06-05 20:30:03,416 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Free Nvidia NeMatron 3 Ultra Runs Long-Horizon Tasks
2026-06-05 20:30:03,425 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Nvidia + Hermes Agent is Insane (FREE!)
2026-06-05 20:30:03,445 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Run Free Claude Code AI In One Terminal Command
2026-06-05 20:30:03,458 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: FREE Claude Code + Hermes Agent is INSANE ๐คฏ
2026-06-05 20:30:04,665 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 5
2026-06-05 20:30:04,665 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'paperclip' restricted to subreddits: ['PaperClip_AI', 'PaperclipAI']
2026-06-05 20:30:04,665 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['paperclip']
2026-06-05 20:30:04,665 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/PaperClip_AI+PaperclipAI
2026-06-05 20:30:05,708 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'paperclip'
2026-06-05 20:30:05,743 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: The Inversion of Power and Faith
2026-06-05 20:30:06,907 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 1
2026-06-05 20:30:06,908 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'multica' restricted to subreddits: ['hermesagent', 'HermesAI']
2026-06-05 20:30:06,908 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['multica']
2026-06-05 20:30:06,908 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/hermesagent+HermesAI
2026-06-05 20:30:07,738 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'multica'
2026-06-05 20:30:08,963 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0
2026-06-05 20:30:08,963 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit subreddit feed monitoring enabled.
2026-06-05 20:30:08,963 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'hermes_agent': r/hermesagent+HermesAI+AI_Agents+aiagents+AgentsOfAI+LocalLLaMA+AutoGPT (limit=25)
2026-06-05 20:30:08,963 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes agent via RSS
2026-06-05 20:30:10,015 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/builderstudio: Aurelius agent is coming soon
2026-06-05 20:30:10,040 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/AISEOInsider: Claude Code With Hyperframes Makes Video Automation Simple
2026-06-05 20:30:10,054 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/IntelArcPro: Just got a B70 :)
2026-06-05 20:30:10,102 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/hermesagent: Use a tiling OS for agent work.
2026-06-05 20:30:10,146 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/hermesagent: Owl Alpha Stealth issues
2026-06-05 20:30:11,287 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes AI via RSS
2026-06-05 20:30:12,344 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/ModernNRPDiplo: Italy Emerges ๐ฎ๐น ๐ค | 6/5/26
2026-06-05 20:30:12,353 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/legalcatadvice: Two cats one pikkel
2026-06-05 20:30:13,435 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: nous research hermes via RSS
2026-06-05 20:30:14,477 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/GreekMythology: Odysseus' lineage?
2026-06-05 20:30:15,581 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: multica via RSS
2026-06-05 20:30:17,598 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'paperclip_ai': r/PaperClip_AI+PaperclipAI+pAIperclip (limit=25)
2026-06-05 20:30:17,599 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip ai via RSS
2026-06-05 20:30:19,975 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip agent via RSS
2026-06-05 20:30:22,227 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: multica via RSS
2026-06-05 20:30:24,451 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'claude_agents': r/vibecoding (limit=25)
2026-06-05 20:30:24,451 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: multica via RSS
2026-06-05 20:30:26,427 - social_media_monitor.scrapers.reddit_scraper - INFO - Total subreddit feed results: 8
2026-06-05 20:30:26,428 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-05 20:30:26,558 - TwitterScraper - INFO - Searching Twitter/X (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-05 20:30:27,046 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'paperclip'
2026-06-05 20:30:41,017 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for '"Hermes Agent"'
2026-06-05 20:30:55,147 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'multica'
2026-06-05 20:31:09,088 - TwitterScraper - INFO - Twitter scrape complete. Found 0 new results.
2026-06-05 20:31:09,088 - LinkedInScraper - INFO - Searching LinkedIn (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-05 20:31:09,609 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'paperclip'
2026-06-05 20:31:10,756 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for '"Hermes Agent"'
2026-06-05 20:31:10,795 - LinkedInScraper - INFO - New LinkedIn post: How to Connect Hermes Agent to GitHub MCP - LinkedIn
2026-06-05 20:31:10,912 - LinkedInScraper - INFO - New LinkedIn post: GitHub - NousResearch/hermes-agent: The agent that grows with you - Li
2026-06-05 20:31:11,190 - LinkedInScraper - INFO - New LinkedIn post: Summer camp assistant Hermes Agent to the rescue ๐ฅ๐ฅ๐ฅ - LinkedIn
2026-06-05 20:31:11,442 - LinkedInScraper - INFO - New LinkedIn post: ๐จ I ranked SEO content while I was AFK with Hermes Agent ๐จ Hereโs how
2026-06-05 20:31:12,169 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'multica'
2026-06-05 20:31:12,325 - LinkedInScraper - INFO - New LinkedIn post: The fastest way to fix a coding agent isn't a better model. It's givin
2026-06-05 20:31:13,008 - LinkedInScraper - INFO - LinkedIn scrape complete. Found 5 new results.
2026-06-05 20:31:13,009 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)
2026-06-05 20:31:18,028 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-05 20:31:18,053 - GitHubScraper - INFO - Found 236 GitHub repositories for term: paperclip
2026-06-05 20:31:19,210 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-05 20:31:19,214 - GitHubScraper - INFO - Found 325 GitHub repositories for term: "Hermes Agent"
2026-06-05 20:31:20,284 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-05 20:31:20,288 - GitHubScraper - INFO - Found 48 GitHub repositories for term: multica
2026-06-05 20:31:20,423 - GitHubScraper - INFO - Total GitHub results found: 0
2026-06-05 20:31:20,424 - __main__ - INFO - Scraper reddit completed: 14 results
2026-06-05 20:31:20,424 - __main__ - INFO - Scraper github completed: 0 results
2026-06-05 20:31:20,424 - __main__ - INFO - Scraper twitter completed: 0 results
2026-06-05 20:31:20,424 - __main__ - INFO - Scraper linkedin completed: 5 results
2026-06-05 20:31:20,424 - __main__ - INFO - Scraper linkedin_feed completed: 0 results
2026-06-05 20:31:21,151 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-05 20:31:21.151239
2026-06-05 20:31:21,151 - __main__ - INFO - Email sent successfully
2026-06-05 20:31:21,151 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-05 20:31:21,151 - __main__ - INFO - Monitor complete. Found 19 total results: 14 new reddit results, 5 new linkedin results.
2026-06-05 20:31:21,151 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-05 20:31:21,151 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-05 20:31:21,242 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-05 20:31:21,242 - __main__ - INFO - Closed all database connections
2026-06-05 20:31:21,271 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-05 20:31:21,285 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-05 21:00:02,355 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-05.log
2026-06-05 21:00:02,355 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-05.log
2026-06-05 21:00:02,355 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-05.log
2026-06-05 21:00:02,355 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-05 21:00:02,388 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-05 21:00:02,388 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-05 21:00:02,391 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-05 21:00:02,391 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-05 21:00:02,409 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-05 21:00:02,409 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-05 21:00:02,462 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-05 21:00:02,463 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-05 21:00:02,463 - __main__ - INFO - RSS scraper initialized and enabled
2026-06-05 21:00:02,466 - Yiddish24Scraper - INFO - File downloader initialized with 29 terms, prefix 'Y2', and file type organization enabled
2026-06-05 21:00:02,466 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=29, exclude_terms=0
2026-06-05 21:00:02,466 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-06-05 21:00:02,468 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-05 21:00:02,472 - TorahAnytimeScraper - INFO - File downloader initialized with 51 terms, prefix 'TA', and file type organization enabled
2026-06-05 21:00:02,472 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=51, exclude_terms=3
2026-06-05 21:00:02,474 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-05 21:00:02,475 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0
2026-06-05 21:00:02,475 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-05 21:00:02,475 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-06-05 21:00:02,475 - __main__ - INFO - Running 3 scrapers concurrently...
2026-06-05 21:00:02,475 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-06-05 21:00:02,584 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-06-05 21:00:02,589 - IveltScraper - INFO - Loaded 181 include, 0 exclude filters from DB topic_filters
2026-06-05 21:00:02,589 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-06-05 21:00:02,590 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-06-05 21:00:02,876 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-06-05 21:00:03,300 - RSSFeedScraper - INFO - Total RSS/HTML results: 3
2026-06-05 21:00:14,064 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-06-05 21:00:37,537 - Yiddish24Scraper - ERROR - Error fetching Yiddish24 page 1:
2026-06-05 21:00:37,547 - Yiddish24Scraper - ERROR - Traceback (most recent call last):
File "/home/openclaw/Social_Media_Monitor/venv/lib/python3.14/site-packages/httpx/_transports/default.py", line 101, in map_httpcore_exceptions
yield
File "/home/openclaw/Social_Media_Monitor/venv/lib/python3.14/site-packages/httpx/_transports/default.py", line 394, in handle_async_request
resp = await self._pool.handle_async_request(req)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/openclaw/Social_Media_Monitor/venv/lib/python3.14/site-packages/httpcore/_async/connection_pool.py", line 256, in handle_async_request
raise exc from None
File "/home/openclaw/Social_Media_Monitor/venv/lib/python3.14/site-packages/httpcore/_async/connection_pool.py", line 236, in handle_async_request
response = await connection.handle_async_request(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
pool_request.request
^^^^^^^^^^^^^^^^^^^^
)
^
File "/home/openclaw/Social_Media_Monitor/venv/lib/python3.14/site-packages/httpcore/_async/connection.py", line 103, in handle_async_request
return await self._connection.handle_async_request(request)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/openclaw/Social_Media_Monitor/venv/lib/python3.14/site-packages/httpcore/_async/http11.py", line 136, in handle_async_request
raise exc
File "/home/openclaw/Social_Media_Monitor/venv/lib/python3.14/site-packages/httpcore/_async/http11.py", line 106, in handle_async_request
) = await self._receive_response_headers(**kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/openclaw/Social_Media_Monitor/venv/lib/python3.14/site-packages/httpcore/_async/http11.py", line 177, in _receive_response_headers
event = await self._receive_event(timeout=timeout)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/openclaw/Social_Media_Monitor/venv/lib/python3.14/site-packages/httpcore/_async/http11.py", line 217, in _receive_event
data = await self._network_stream.read(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
self.READ_NUM_BYTES, timeout=timeout
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
)
^
File "/home/openclaw/Social_Media_Monitor/venv/lib/python3.14/site-packages/httpcore/_backends/anyio.py", line 32, in read
with map_exceptions(exc_map):
~~~~~~~~~~~~~~^^^^^^^^^
File "/home/linuxbrew/.linuxbrew/opt/python@3.14/lib/python3.14/contextlib.py", line 162, in __exit__
self.gen.throw(value)
~~~~~~~~~~~~~~^^^^^^^
File "/home/openclaw/Social_Media_Monitor/venv/lib/python3.14/site-packages/httpcore/_exceptions.py", line 14, in map_exceptions
raise to_exc(exc) from exc
httpcore.ReadTimeout
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/home/openclaw/Social_Media_Monitor/src/social_media_monitor/scrapers/yiddish24_scraper.py", line 207, in _fetch_page
response = await self.make_request(
^^^^^^^^^^^^^^^^^^^^^^^^
...<5 lines>...
)
^
File "/home/openclaw/Social_Media_Monitor/src/social_media_monitor/scrapers/base_scraper.py", line 231, in make_request
response = await session.post(url, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/openclaw/Social_Media_Monitor/venv/lib/python3.14/site-packages/httpx/_client.py", line 1859, in post
return await self.request(
^^^^^^^^^^^^^^^^^^^
...<13 lines>...
)
^
File "/home/openclaw/Social_Media_Monitor/venv/lib/python3.14/site-packages/httpx/_client.py", line 1540, in request
return await self.send(request, auth=auth, follow_redirects=follow_redirects)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/openclaw/Social_Media_Monitor/venv/lib/python3.14/site-packages/httpx/_client.py", line 1629, in send
response = await self._send_handling_auth(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
...<4 lines>...
)
^
File "/home/openclaw/Social_Media_Monitor/venv/lib/python3.14/site-packages/httpx/_client.py", line 1657, in _send_handling_auth
response = await self._send_handling_redirects(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
...<3 lines>...
)
^
File "/home/openclaw/Social_Media_Monitor/venv/lib/python3.14/site-packages/httpx/_client.py", line 1694, in _send_handling_redirects
response = await self._send_single_request(request)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/openclaw/Social_Media_Monitor/venv/lib/python3.14/site-packages/httpx/_client.py", line 1730, in _send_single_request
response = await transport.handle_async_request(request)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/openclaw/Social_Media_Monitor/venv/lib/python3.14/site-packages/httpx/_transports/default.py", line 393, in handle_async_request
with map_httpcore_exceptions():
~~~~~~~~~~~~~~~~~~~~~~~^^
File "/home/linuxbrew/.linuxbrew/opt/python@3.14/lib/python3.14/contextlib.py", line 162, in __exit__
self.gen.throw(value)
~~~~~~~~~~~~~~^^^^^^^
File "/home/openclaw/Social_Media_Monitor/venv/lib/python3.14/site-packages/httpx/_transports/default.py", line 118, in map_httpcore_exceptions
raise mapped_exc(message) from exc
httpx.ReadTimeout
2026-06-05 21:00:37,548 - Yiddish24Scraper - INFO - Page 1: 0/0 new items
2026-06-05 21:00:37,548 - Yiddish24Scraper - INFO - No more results found at page 1, stopping pagination
2026-06-05 21:00:37,548 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0
2026-06-05 21:00:43,013 - IveltScraper - INFO - ivelt scrape complete. Checked 4 topics.
2026-06-05 21:00:43,013 - IveltScraper - INFO - Fetching yidtish active topics from https://forum.yidtish.com/search.php?search_id=active_topics...
2026-06-05 21:00:43,863 - IveltScraper - INFO - Found 50 active topics on yidtish
2026-06-05 21:00:46,388 - IveltScraper - INFO - yidtish scrape complete. Checked 2 topics.
2026-06-05 21:00:46,389 - IveltScraper - INFO - All forums scrape complete. Found 58 new posts.
2026-06-05 21:00:46,389 - __main__ - INFO - Scraper rss completed: 3 results
2026-06-05 21:00:46,390 - __main__ - INFO - Scraper yiddish24 completed: 0 results
2026-06-05 21:00:46,390 - __main__ - INFO - Scraper ivelt completed: 58 results
2026-06-05 21:00:47,127 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-05 21:00:47.127364
2026-06-05 21:00:47,127 - __main__ - INFO - Email sent successfully
2026-06-05 21:00:47,127 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-05 21:00:47,127 - __main__ - INFO - Monitor complete. Found 61 total results: 3 new rss results, 58 new ivelt results.
2026-06-05 21:00:47,127 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-05 21:00:47,127 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-05 21:00:47,181 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-05 21:00:47,182 - __main__ - INFO - Closed all database connections
2026-06-05 21:00:47,184 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-05 21:00:47,184 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-05 22:00:02,564 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-05.log
2026-06-05 22:00:02,564 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-05.log
2026-06-05 22:00:02,564 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-05.log
2026-06-05 22:00:02,564 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-05 22:00:02,607 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-05 22:00:02,607 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-05 22:00:02,610 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-05 22:00:02,610 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-05 22:00:02,632 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-05 22:00:02,632 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-05 22:00:02,676 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-05 22:00:02,677 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-05 22:00:02,677 - __main__ - INFO - RSS scraper initialized and enabled
2026-06-05 22:00:02,680 - Yiddish24Scraper - INFO - File downloader initialized with 29 terms, prefix 'Y2', and file type organization enabled
2026-06-05 22:00:02,680 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=29, exclude_terms=0
2026-06-05 22:00:02,680 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-06-05 22:00:02,682 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-05 22:00:02,686 - TorahAnytimeScraper - INFO - File downloader initialized with 51 terms, prefix 'TA', and file type organization enabled
2026-06-05 22:00:02,686 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=51, exclude_terms=3
2026-06-05 22:00:02,688 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-05 22:00:02,688 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0
2026-06-05 22:00:02,689 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-05 22:00:02,689 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-06-05 22:00:02,689 - __main__ - INFO - Running 3 scrapers concurrently...
2026-06-05 22:00:02,689 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-06-05 22:00:02,772 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-06-05 22:00:02,776 - IveltScraper - INFO - Loaded 181 include, 0 exclude filters from DB topic_filters
2026-06-05 22:00:02,777 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-06-05 22:00:02,778 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-06-05 22:00:03,098 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-06-05 22:00:03,650 - RSSFeedScraper - INFO - Total RSS/HTML results: 3
2026-06-05 22:00:06,924 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-06-05 22:00:07,085 - Yiddish24Scraper - INFO - Received response with 440965 characters
2026-06-05 22:00:07,087 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (295176 chars)
2026-06-05 22:00:07,089 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-06-05 22:00:07,176 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-06-05 22:00:07,217 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-06-05 22:00:07,217 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-06-05 22:00:07,491 - Yiddish24Scraper - INFO - Term 'ืืื ืืื' matched in TITLE: 'ืืื ืืื'
2026-06-05 22:00:07,491 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ืืื ืืื
2026-06-05 22:00:08,322 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/Fridayesv268pbgmmusicm_260_260605044942.mp3
2026-06-05 22:00:09,565 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_Fridayesv268pbgmmusicm_260_260605044942.mp3 (10.5 MB)
2026-06-05 22:00:09,566 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-06-05 22:00:09,590 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_Fridayesv268pbgmmusicm_260_260605044942.mp3: title, artist, album, comment, source_url, genre, publisher
2026-06-05 22:00:09,590 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2_Fridayesv268pbgmmusicm_260_260605044942_ืืื_ืืื.mp3
2026-06-05 22:00:09,834 - Yiddish24Scraper - INFO - Term 'ืฉืืื' matched in TITLE: 'ืืจื ืืืจื ืืจืืกืืื ืฉืืื"ื'
2026-06-05 22:00:09,834 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ืืจื ืืืจื ืืจืืกืืื ืฉืืื"ื
2026-06-05 22:00:10,334 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/__73_____237_1780690261519_844_0_26060504_754398163.mp3
2026-06-05 22:00:11,504 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2___73_____237_1780690261519_844_0_26060504_754398163.mp3 (9.3 MB)
2026-06-05 22:00:11,504 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-06-05 22:00:11,512 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2___73_____237_1780690261519_844_0_26060504_754398163.mp3: title, artist, album, comment, source_url, genre, publisher
2026-06-05 22:00:11,512 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2___73_____237_1780690261519_844_0_26060504_754398163_ืฉืืื.mp3
2026-06-05 22:00:11,861 - Yiddish24Scraper - INFO - Page 1 summary: 15 new out of 100 total articles
2026-06-05 22:00:11,861 - Yiddish24Scraper - INFO - Page 1: 15/100 new items
2026-06-05 22:00:11,861 - Yiddish24Scraper - INFO - Low new item ratio (15.0%), stopping pagination
2026-06-05 22:00:11,862 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 15
2026-06-05 22:00:14,401 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-06-05 22:00:34,926 - IveltScraper - INFO - ivelt scrape complete. Checked 5 topics.
2026-06-05 22:00:34,926 - IveltScraper - INFO - Fetching yidtish active topics from https://forum.yidtish.com/search.php?search_id=active_topics...
2026-06-05 22:00:35,963 - IveltScraper - INFO - Found 50 active topics on yidtish
2026-06-05 22:01:13,167 - IveltScraper - INFO - yidtish scrape complete. Checked 3 topics.
2026-06-05 22:01:13,167 - IveltScraper - INFO - All forums scrape complete. Found 47 new posts.
2026-06-05 22:01:13,168 - __main__ - INFO - Scraper rss completed: 3 results
2026-06-05 22:01:13,168 - __main__ - INFO - Scraper yiddish24 completed: 15 results
2026-06-05 22:01:13,168 - __main__ - INFO - Scraper ivelt completed: 47 results
2026-06-05 22:01:15,697 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-05 22:01:15.696945
2026-06-05 22:01:15,697 - __main__ - INFO - Email sent successfully
2026-06-05 22:01:15,697 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-05 22:01:15,697 - __main__ - INFO - Monitor complete. Found 65 total results: 3 new rss results, 15 new yiddish24 results, 47 new ivelt results.
2026-06-05 22:01:15,697 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-05 22:01:15,697 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-05 22:01:15,851 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-05 22:01:15,851 - __main__ - INFO - Closed all database connections
2026-06-05 22:01:15,855 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-05 22:01:15,855 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-05 22:30:02,269 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-05.log
2026-06-05 22:30:02,269 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-05.log
2026-06-05 22:30:02,269 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-05.log
2026-06-05 22:30:02,269 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-05 22:30:02,303 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-05 22:30:02,303 - social_media_monitor.config.settings - WARNING - Twitter monitoring enabled but credentials validation not implemented
2026-06-05 22:30:02,303 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-05 22:30:02,305 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-05 22:30:02,305 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-05 22:30:02,325 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-05 22:30:02,325 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-05 22:30:02,326 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-05 22:30:02,326 - __main__ - INFO - Reddit scraper initialized and enabled
2026-06-05 22:30:02,326 - __main__ - INFO - GitHub scraper initialized and enabled
2026-06-05 22:30:02,326 - __main__ - INFO - Twitter scraper initialized and enabled
2026-06-05 22:30:02,326 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-05 22:30:02,327 - __main__ - INFO - LinkedIn scraper initialized and enabled
2026-06-05 22:30:02,327 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled
2026-06-05 22:30:02,329 - Yiddish24Scraper - INFO - File downloader initialized with 29 terms, prefix 'Y2', and file type organization enabled
2026-06-05 22:30:02,329 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=29, exclude_terms=0
2026-06-05 22:30:02,331 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-05 22:30:02,335 - TorahAnytimeScraper - INFO - File downloader initialized with 51 terms, prefix 'TA', and file type organization enabled
2026-06-05 22:30:02,335 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=51, exclude_terms=3
2026-06-05 22:30:02,338 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-05 22:30:02,338 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0
2026-06-05 22:30:02,338 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-05 22:30:02,338 - __main__ - INFO - Running 5 scrapers concurrently...
2026-06-05 22:30:02,338 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit search monitoring enabled. Running search with terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-05 22:30:02,338 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['"Hermes Agent"']
2026-06-05 22:30:03,295 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term '"Hermes Agent"'
2026-06-05 22:30:03,332 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: HermesMac - a native macOS client for managing multiple agents/profile
2026-06-05 22:30:03,347 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Hermes Agent meetup in Arlington next Wednesday โ self-improving AI ag
2026-06-05 22:30:03,358 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Hermeskill wont let your agents dump .env into chat
2026-06-05 22:30:03,369 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Aurelius Agent is live ๐ช
2026-06-05 22:30:04,606 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 4
2026-06-05 22:30:04,607 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'paperclip' restricted to subreddits: ['PaperClip_AI', 'PaperclipAI']
2026-06-05 22:30:04,607 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['paperclip']
2026-06-05 22:30:04,607 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/PaperClip_AI+PaperclipAI
2026-06-05 22:30:05,650 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'paperclip'
2026-06-05 22:30:05,828 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Can this broken pin be repaired, or must both D-sub connectors be repl
2026-06-05 22:30:07,013 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 1
2026-06-05 22:30:07,013 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'multica' restricted to subreddits: ['hermesagent', 'HermesAI']
2026-06-05 22:30:07,013 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['multica']
2026-06-05 22:30:07,013 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/hermesagent+HermesAI
2026-06-05 22:30:07,832 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'multica'
2026-06-05 22:30:09,064 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0
2026-06-05 22:30:09,065 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit subreddit feed monitoring enabled.
2026-06-05 22:30:09,065 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'hermes_agent': r/hermesagent+HermesAI+AI_Agents+aiagents+AgentsOfAI+LocalLLaMA+AutoGPT (limit=25)
2026-06-05 22:30:09,065 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes agent via RSS
2026-06-05 22:30:10,007 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/hermesagent: LLM competition within Hermes: a recommended idea you should try
2026-06-05 22:30:10,043 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/LocalLLM: Thanks for the AMD help : Here's what I've actually been up to
2026-06-05 22:30:10,071 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/MercuryInstall: Mercury Agent install note: Mercury permission mode without the setup-
2026-06-05 22:30:10,094 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/learnmachinelearning: I built a small local-first harness OS for agents because agentic RL i
2026-06-05 22:30:10,110 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/LocalLLaMA: OpenLumara - A different kind of AI agent, written from scratch, not v
2026-06-05 22:30:11,271 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes AI via RSS
2026-06-05 22:30:13,915 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: nous research hermes via RSS
2026-06-05 22:30:16,087 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: multica via RSS
2026-06-05 22:30:18,012 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'paperclip_ai': r/PaperClip_AI+PaperclipAI+pAIperclip (limit=25)
2026-06-05 22:30:18,012 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip ai via RSS
2026-06-05 22:30:20,534 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip agent via RSS
2026-06-05 22:30:22,773 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: multica via RSS
2026-06-05 22:30:24,758 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'claude_agents': r/vibecoding (limit=25)
2026-06-05 22:30:24,759 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: multica via RSS
2026-06-05 22:30:26,809 - social_media_monitor.scrapers.reddit_scraper - INFO - Total subreddit feed results: 5
2026-06-05 22:30:26,809 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-05 22:30:26,938 - TwitterScraper - INFO - Searching Twitter/X (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-05 22:30:27,410 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'paperclip'
2026-06-05 22:30:41,074 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for '"Hermes Agent"'
2026-06-05 22:30:54,668 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'multica'
2026-06-05 22:31:07,889 - TwitterScraper - INFO - Twitter scrape complete. Found 0 new results.
2026-06-05 22:31:07,890 - LinkedInScraper - INFO - Searching LinkedIn (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-05 22:31:08,434 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'paperclip'
2026-06-05 22:31:09,609 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for '"Hermes Agent"'
2026-06-05 22:31:10,852 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'multica'
2026-06-05 22:31:11,545 - LinkedInScraper - INFO - LinkedIn scrape complete. Found 0 new results.
2026-06-05 22:31:11,545 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)
2026-06-05 22:31:15,222 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-05 22:31:15,248 - GitHubScraper - INFO - Found 236 GitHub repositories for term: paperclip
2026-06-05 22:31:16,313 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-05 22:31:16,316 - GitHubScraper - INFO - Found 325 GitHub repositories for term: "Hermes Agent"
2026-06-05 22:31:17,375 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-05 22:31:17,379 - GitHubScraper - INFO - Found 48 GitHub repositories for term: multica
2026-06-05 22:31:17,507 - GitHubScraper - INFO - Total GitHub results found: 0
2026-06-05 22:31:17,508 - __main__ - INFO - Scraper reddit completed: 10 results
2026-06-05 22:31:17,508 - __main__ - INFO - Scraper github completed: 0 results
2026-06-05 22:31:17,508 - __main__ - INFO - Scraper twitter completed: 0 results
2026-06-05 22:31:17,508 - __main__ - INFO - Scraper linkedin completed: 0 results
2026-06-05 22:31:17,508 - __main__ - INFO - Scraper linkedin_feed completed: 0 results
2026-06-05 22:31:18,162 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-05 22:31:18.162386
2026-06-05 22:31:18,162 - __main__ - INFO - Email sent successfully
2026-06-05 22:31:18,163 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-05 22:31:18,163 - __main__ - INFO - Monitor complete. Found 10 total results: 10 new reddit results.
2026-06-05 22:31:18,163 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-05 22:31:18,163 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-05 22:31:18,275 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-05 22:31:18,275 - __main__ - INFO - Closed all database connections
2026-06-05 22:31:18,314 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-05 22:31:18,331 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-05 23:00:02,248 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-05.log
2026-06-05 23:00:02,248 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-05.log
2026-06-05 23:00:02,248 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-05.log
2026-06-05 23:00:02,248 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-05 23:00:02,281 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-05 23:00:02,281 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-05 23:00:02,283 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-05 23:00:02,283 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-05 23:00:02,300 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-05 23:00:02,301 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-05 23:00:02,301 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-05 23:00:02,302 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-05 23:00:02,302 - __main__ - INFO - RSS scraper initialized and enabled
2026-06-05 23:00:02,305 - Yiddish24Scraper - INFO - File downloader initialized with 29 terms, prefix 'Y2', and file type organization enabled
2026-06-05 23:00:02,305 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=29, exclude_terms=0
2026-06-05 23:00:02,305 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-06-05 23:00:02,307 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-05 23:00:02,311 - TorahAnytimeScraper - INFO - File downloader initialized with 51 terms, prefix 'TA', and file type organization enabled
2026-06-05 23:00:02,311 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=51, exclude_terms=3
2026-06-05 23:00:02,313 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-05 23:00:02,313 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0
2026-06-05 23:00:02,313 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-05 23:00:02,313 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-06-05 23:00:02,313 - __main__ - INFO - Running 3 scrapers concurrently...
2026-06-05 23:00:02,313 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-06-05 23:00:02,395 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-06-05 23:00:02,399 - IveltScraper - INFO - Loaded 181 include, 0 exclude filters from DB topic_filters
2026-06-05 23:00:02,399 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-06-05 23:00:02,401 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-06-05 23:00:02,719 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-06-05 23:00:03,435 - RSSFeedScraper - INFO - Total RSS/HTML results: 4
2026-06-05 23:00:07,005 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-06-05 23:00:07,178 - Yiddish24Scraper - INFO - Received response with 450210 characters
2026-06-05 23:00:07,181 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (299246 chars)
2026-06-05 23:00:07,184 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-06-05 23:00:07,264 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-06-05 23:00:07,303 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-06-05 23:00:07,303 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-06-05 23:00:08,092 - Yiddish24Scraper - INFO - Page 1 summary: 6 new out of 100 total articles
2026-06-05 23:00:08,092 - Yiddish24Scraper - INFO - Page 1: 6/100 new items
2026-06-05 23:00:08,092 - Yiddish24Scraper - INFO - Low new item ratio (6.0%), stopping pagination
2026-06-05 23:00:08,092 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 6
2026-06-05 23:00:14,089 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-06-05 23:00:39,942 - IveltScraper - INFO - ivelt scrape complete. Checked 6 topics.
2026-06-05 23:00:39,942 - IveltScraper - INFO - Fetching yidtish active topics from https://forum.yidtish.com/search.php?search_id=active_topics...
2026-06-05 23:00:40,840 - IveltScraper - INFO - Found 50 active topics on yidtish
2026-06-05 23:00:44,749 - IveltScraper - INFO - yidtish scrape complete. Checked 3 topics.
2026-06-05 23:00:44,749 - IveltScraper - INFO - All forums scrape complete. Found 16 new posts.
2026-06-05 23:00:44,750 - __main__ - INFO - Scraper rss completed: 4 results
2026-06-05 23:00:44,750 - __main__ - INFO - Scraper yiddish24 completed: 6 results
2026-06-05 23:00:44,750 - __main__ - INFO - Scraper ivelt completed: 16 results
2026-06-05 23:00:45,505 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-05 23:00:45.505624
2026-06-05 23:00:45,506 - __main__ - INFO - Email sent successfully
2026-06-05 23:00:45,506 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-05 23:00:45,506 - __main__ - INFO - Monitor complete. Found 26 total results: 4 new rss results, 6 new yiddish24 results, 16 new ivelt results.
2026-06-05 23:00:45,506 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-05 23:00:45,506 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-05 23:00:45,588 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-05 23:00:45,588 - __main__ - INFO - Closed all database connections
2026-06-05 23:00:45,590 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-05 23:00:45,590 - social_media_monitor.database.connection - INFO - Closed 0 database connections
Live tail active โ waiting for new lines...