โ† Logs

social_media_monitor_2026-06-08.log

File "/home/openclaw/Social_Media_Monitor/venv/lib/python3.14/site-packages/httpcore/_backends/anyio.py", line 32, in read
with map_exceptions(exc_map):
~~~~~~~~~~~~~~^^^^^^^^^
File "/home/linuxbrew/.linuxbrew/opt/python@3.14/lib/python3.14/contextlib.py", line 162, in __exit__
self.gen.throw(value)
~~~~~~~~~~~~~~^^^^^^^
File "/home/openclaw/Social_Media_Monitor/venv/lib/python3.14/site-packages/httpcore/_exceptions.py", line 14, in map_exceptions
raise to_exc(exc) from exc
httpcore.ReadTimeout
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/home/openclaw/Social_Media_Monitor/src/social_media_monitor/scrapers/yiddish24_scraper.py", line 207, in _fetch_page
response = await self.make_request(
^^^^^^^^^^^^^^^^^^^^^^^^
...<5 lines>...
)
^
File "/home/openclaw/Social_Media_Monitor/src/social_media_monitor/scrapers/base_scraper.py", line 231, in make_request
response = await session.post(url, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/openclaw/Social_Media_Monitor/venv/lib/python3.14/site-packages/httpx/_client.py", line 1859, in post
return await self.request(
^^^^^^^^^^^^^^^^^^^
...<13 lines>...
)
^
File "/home/openclaw/Social_Media_Monitor/venv/lib/python3.14/site-packages/httpx/_client.py", line 1540, in request
return await self.send(request, auth=auth, follow_redirects=follow_redirects)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/openclaw/Social_Media_Monitor/venv/lib/python3.14/site-packages/httpx/_client.py", line 1629, in send
response = await self._send_handling_auth(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
...<4 lines>...
)
^
File "/home/openclaw/Social_Media_Monitor/venv/lib/python3.14/site-packages/httpx/_client.py", line 1657, in _send_handling_auth
response = await self._send_handling_redirects(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
...<3 lines>...
)
^
File "/home/openclaw/Social_Media_Monitor/venv/lib/python3.14/site-packages/httpx/_client.py", line 1694, in _send_handling_redirects
response = await self._send_single_request(request)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/openclaw/Social_Media_Monitor/venv/lib/python3.14/site-packages/httpx/_client.py", line 1730, in _send_single_request
response = await transport.handle_async_request(request)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/openclaw/Social_Media_Monitor/venv/lib/python3.14/site-packages/httpx/_transports/default.py", line 393, in handle_async_request
with map_httpcore_exceptions():
~~~~~~~~~~~~~~~~~~~~~~~^^
File "/home/linuxbrew/.linuxbrew/opt/python@3.14/lib/python3.14/contextlib.py", line 162, in __exit__
self.gen.throw(value)
~~~~~~~~~~~~~~^^^^^^^
File "/home/openclaw/Social_Media_Monitor/venv/lib/python3.14/site-packages/httpx/_transports/default.py", line 118, in map_httpcore_exceptions
raise mapped_exc(message) from exc
httpx.ReadTimeout
2026-06-08 20:00:33,282 - Yiddish24Scraper - INFO - Page 1: 0/0 new items
2026-06-08 20:00:33,282 - Yiddish24Scraper - INFO - No more results found at page 1, stopping pagination
2026-06-08 20:00:33,282 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0
2026-06-08 20:00:33,282 - __main__ - INFO - Scraper rss completed: 4 results
2026-06-08 20:00:33,282 - __main__ - INFO - Scraper yiddish24 completed: 0 results
2026-06-08 20:00:33,282 - __main__ - INFO - Scraper ivelt completed: 8 results
2026-06-08 20:00:34,005 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-08 20:00:34.005600
2026-06-08 20:00:34,005 - __main__ - INFO - Email sent successfully
2026-06-08 20:00:34,006 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-08 20:00:34,006 - __main__ - INFO - Monitor complete. Found 12 total results: 4 new rss results, 8 new ivelt results.
2026-06-08 20:00:34,006 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-08 20:00:34,006 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-08 20:00:34,057 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-08 20:00:34,058 - __main__ - INFO - Closed all database connections
2026-06-08 20:00:34,060 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-08 20:00:34,060 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-08 20:30:02,508 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-08.log
2026-06-08 20:30:02,509 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-08.log
2026-06-08 20:30:02,509 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-08.log
2026-06-08 20:30:02,509 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-08 20:30:02,545 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-08 20:30:02,546 - social_media_monitor.config.settings - WARNING - Twitter monitoring enabled but credentials validation not implemented
2026-06-08 20:30:02,546 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-08 20:30:02,548 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-08 20:30:02,548 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-08 20:30:02,567 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-08 20:30:02,567 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-08 20:30:02,568 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-08 20:30:02,568 - __main__ - INFO - Reddit scraper initialized and enabled
2026-06-08 20:30:02,568 - __main__ - INFO - GitHub scraper initialized and enabled
2026-06-08 20:30:02,568 - __main__ - INFO - Twitter scraper initialized and enabled
2026-06-08 20:30:02,569 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-08 20:30:02,569 - __main__ - INFO - LinkedIn scraper initialized and enabled
2026-06-08 20:30:02,569 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled
2026-06-08 20:30:02,572 - Yiddish24Scraper - INFO - File downloader initialized with 52 terms, prefix 'Y2', and file type organization enabled
2026-06-08 20:30:02,572 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=52, exclude_terms=0
2026-06-08 20:30:02,574 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-08 20:30:02,579 - TorahAnytimeScraper - INFO - File downloader initialized with 52 terms, prefix 'TA', and file type organization enabled
2026-06-08 20:30:02,579 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=52, exclude_terms=4
2026-06-08 20:30:02,581 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-08 20:30:02,581 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0
2026-06-08 20:30:02,581 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-08 20:30:02,581 - __main__ - INFO - Running 5 scrapers concurrently...
2026-06-08 20:30:02,581 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit search monitoring enabled. Running search with terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-08 20:30:02,581 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['"Hermes Agent"']
2026-06-08 20:30:03,529 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term '"Hermes Agent"'
2026-06-08 20:30:03,611 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Is Hermes Workspace currently usable?
2026-06-08 20:30:03,629 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: opencode-go / deepseek-v4-flash being ridiculously slow today
2026-06-08 20:30:03,659 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: I treated my cron jobs like a corporation and built a Hermes skill aro
2026-06-08 20:30:03,680 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: My iClaw Agent is Managing a Youtube Channel lol
2026-06-08 20:30:04,181 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Hermes Agent REPLACED My SEO Teamโ€ฆ
2026-06-08 20:30:05,296 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 5
2026-06-08 20:30:05,297 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'paperclip' restricted to subreddits: ['PaperClip_AI', 'PaperclipAI']
2026-06-08 20:30:05,297 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['paperclip']
2026-06-08 20:30:05,297 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/PaperClip_AI+PaperclipAI
2026-06-08 20:30:06,087 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'paperclip'
2026-06-08 20:30:06,266 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Anyone use HyperAgent or similar platforms?
2026-06-08 20:30:06,278 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Thought you might enjoy a "Doomer" AI Short Film...Made with AI.
2026-06-08 20:30:07,508 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 2
2026-06-08 20:30:07,509 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'multica' restricted to subreddits: ['hermesagent', 'HermesAI']
2026-06-08 20:30:07,509 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['multica']
2026-06-08 20:30:07,509 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/hermesagent+HermesAI
2026-06-08 20:30:08,595 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'multica'
2026-06-08 20:30:09,821 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0
2026-06-08 20:30:09,821 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit subreddit feed monitoring enabled.
2026-06-08 20:30:09,821 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'hermes_agent': r/hermesagent+HermesAI+AI_Agents+aiagents+AgentsOfAI+LocalLLaMA+AutoGPT (limit=25)
2026-06-08 20:30:09,821 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes agent via RSS
2026-06-08 20:30:10,689 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/hermesagent: How to get Hermes to process answer from a cron job?
2026-06-08 20:30:10,700 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/SaaS: Be real and tell me if this idea could sell
2026-06-08 20:30:10,725 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/hermesagent: I'd like to share an updated methodology for building agents.
2026-06-08 20:30:11,848 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes AI via RSS
2026-06-08 20:30:12,669 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/DefundAidtoIsrael: Palestine Updates from Drop Site News, June 8, 2026
2026-06-08 20:30:13,748 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: nous research hermes via RSS
2026-06-08 20:30:14,758 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/HermesRepsTruth: First time buying Hermes reps? Mistakes to avoid
2026-06-08 20:30:15,871 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: multica via RSS
2026-06-08 20:30:17,923 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'paperclip_ai': r/PaperClip_AI+PaperclipAI+pAIperclip (limit=25)
2026-06-08 20:30:17,924 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip ai via RSS
2026-06-08 20:30:20,406 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip agent via RSS
2026-06-08 20:30:22,620 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: multica via RSS
2026-06-08 20:30:24,496 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'claude_agents': r/vibecoding (limit=25)
2026-06-08 20:30:24,496 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: multica via RSS
2026-06-08 20:30:26,411 - social_media_monitor.scrapers.reddit_scraper - INFO - Total subreddit feed results: 5
2026-06-08 20:30:26,411 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-08 20:30:26,534 - TwitterScraper - INFO - Using XAI (Grok) for real-time Twitter/X search
2026-06-08 20:30:26,538 - LinkedInScraper - INFO - Searching LinkedIn (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-08 20:30:27,152 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'paperclip'
2026-06-08 20:30:28,431 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for '"Hermes Agent"'
2026-06-08 20:30:28,554 - LinkedInScraper - INFO - New LinkedIn post: ๐Ÿ‘‰ I just upgraded my Hermes Agent environments (local Hermes TUI and D
2026-06-08 20:30:28,770 - LinkedInScraper - INFO - New LinkedIn post: Hermes Agent 101 - LinkedIn
2026-06-08 20:30:29,021 - LinkedInScraper - INFO - New LinkedIn post: Hermes Agent Desktop: Full Setup + Real Use Cases - LinkedIn
2026-06-08 20:30:29,854 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'multica'
2026-06-08 20:30:30,708 - LinkedInScraper - INFO - LinkedIn scrape complete. Found 3 new results.
2026-06-08 20:30:30,709 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)
2026-06-08 20:30:35,651 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-08 20:30:35,676 - GitHubScraper - INFO - Found 236 GitHub repositories for term: paperclip
2026-06-08 20:30:36,027 - httpx - INFO - HTTP Request: POST https://api.x.ai/v1/chat/completions "HTTP/1.1 200 OK"
2026-06-08 20:30:36,029 - TwitterScraper - INFO - XAI Search: found 0 tweets for 'paperclip'
2026-06-08 20:30:37,069 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-08 20:30:37,159 - GitHubScraper - INFO - Found 335 GitHub repositories for term: "Hermes Agent"
2026-06-08 20:30:37,888 - httpx - INFO - HTTP Request: POST https://api.x.ai/v1/chat/completions "HTTP/1.1 200 OK"
2026-06-08 20:30:37,889 - TwitterScraper - INFO - XAI Search: found 0 tweets for '"Hermes Agent"'
2026-06-08 20:30:38,246 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-08 20:30:38,253 - GitHubScraper - INFO - Found 49 GitHub repositories for term: multica
2026-06-08 20:30:38,383 - GitHubScraper - INFO - Total GitHub results found: 0
2026-06-08 20:30:39,404 - httpx - INFO - HTTP Request: POST https://api.x.ai/v1/chat/completions "HTTP/1.1 200 OK"
2026-06-08 20:30:39,405 - TwitterScraper - INFO - XAI Search: found 0 tweets for 'multica'
2026-06-08 20:30:39,406 - TwitterScraper - INFO - Twitter scrape complete. Found 0 new results.
2026-06-08 20:30:39,406 - __main__ - INFO - Scraper reddit completed: 12 results
2026-06-08 20:30:39,406 - __main__ - INFO - Scraper github completed: 0 results
2026-06-08 20:30:39,406 - __main__ - INFO - Scraper twitter completed: 0 results
2026-06-08 20:30:39,406 - __main__ - INFO - Scraper linkedin completed: 3 results
2026-06-08 20:30:39,406 - __main__ - INFO - Scraper linkedin_feed completed: 0 results
2026-06-08 20:30:40,068 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-08 20:30:40.068121
2026-06-08 20:30:40,068 - __main__ - INFO - Email sent successfully
2026-06-08 20:30:40,068 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-08 20:30:40,068 - __main__ - INFO - Monitor complete. Found 15 total results: 12 new reddit results, 3 new linkedin results.
2026-06-08 20:30:40,068 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-08 20:30:40,068 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-08 20:30:40,200 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-08 20:30:40,200 - __main__ - INFO - Closed all database connections
2026-06-08 20:30:40,202 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-08 20:30:40,202 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-08 21:00:01,849 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-08.log
2026-06-08 21:00:01,849 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-08.log
2026-06-08 21:00:01,849 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-08.log
2026-06-08 21:00:01,849 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-08 21:00:01,889 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-08 21:00:01,889 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-08 21:00:01,891 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-08 21:00:01,892 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-08 21:00:02,011 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-08 21:00:02,011 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-08 21:00:02,013 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-08 21:00:02,015 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-08 21:00:02,016 - __main__ - INFO - RSS scraper initialized and enabled
2026-06-08 21:00:02,021 - Yiddish24Scraper - INFO - File downloader initialized with 52 terms, prefix 'Y2', and file type organization enabled
2026-06-08 21:00:02,021 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=52, exclude_terms=0
2026-06-08 21:00:02,021 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-06-08 21:00:02,026 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-08 21:00:02,031 - TorahAnytimeScraper - INFO - File downloader initialized with 52 terms, prefix 'TA', and file type organization enabled
2026-06-08 21:00:02,033 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=52, exclude_terms=4
2026-06-08 21:00:02,035 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-08 21:00:02,035 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0
2026-06-08 21:00:02,035 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-08 21:00:02,035 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-06-08 21:00:02,035 - __main__ - INFO - Running 3 scrapers concurrently...
2026-06-08 21:00:02,035 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-06-08 21:00:02,142 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-06-08 21:00:02,147 - IveltScraper - INFO - Loaded 181 include, 0 exclude filters from DB topic_filters
2026-06-08 21:00:02,147 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-06-08 21:00:02,148 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-06-08 21:00:02,538 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-06-08 21:00:03,042 - RSSFeedScraper - INFO - Total RSS/HTML results: 2
2026-06-08 21:00:06,619 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-06-08 21:00:06,853 - Yiddish24Scraper - INFO - Received response with 496318 characters
2026-06-08 21:00:06,855 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (313273 chars)
2026-06-08 21:00:06,859 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-06-08 21:00:06,970 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-06-08 21:00:07,012 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-06-08 21:00:07,012 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-06-08 21:00:07,091 - Yiddish24Scraper - INFO - Term 'ืคืจื˜ื™ืช' matched in TITLE: 'ืื™ื ื˜ืขืจื•ื•ื™ื•: ื ื—ืจื“ื™ืฉืขืจ ืื™ื“ ืคื•ืŸ ื‘ืืจื ืคืืจืง ืื™ื– ื‘ื”ืฉื’ื—ื” ืคืจื˜ื™ืช ืืจืืค ืคื•ืŸ ื ื”ืขืœื™ืงืืคื˜ืขืจ ืžื™ื ื•ื˜ืŸ ืคืืจ ืขืก ื”ืื˜ ื’ืขืงืจืื›ื˜ ืื™ืŸ ื•ื•ืืœื“'
2026-06-08 21:00:07,092 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ืื™ื ื˜ืขืจื•ื•ื™ื•: ื ื—ืจื“ื™ืฉืขืจ ืื™ื“ ืคื•ืŸ ื‘ืืจื ืคืืจืง ืื™ื– ื‘ื”ืฉื’ื—ื”
2026-06-08 21:00:07,834 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/KM_N114_84_1780950562.mp3
2026-06-08 21:00:07,963 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_KM_N114_84_1780950562.mp3 (2.6 MB)
2026-06-08 21:00:07,963 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-06-08 21:00:07,973 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_KM_N114_84_1780950562.mp3: title, artist, album, comment, source_url, genre, publisher
2026-06-08 21:00:07,974 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2_KM_N114_84_1780950562_ืคืจื˜ื™ืช.mp3
2026-06-08 21:00:08,697 - Yiddish24Scraper - INFO - Page 1 summary: 16 new out of 100 total articles
2026-06-08 21:00:08,698 - Yiddish24Scraper - INFO - Page 1: 16/100 new items
2026-06-08 21:00:08,698 - Yiddish24Scraper - INFO - Low new item ratio (16.0%), stopping pagination
2026-06-08 21:00:08,698 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 16
2026-06-08 21:00:13,763 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-06-08 21:00:30,222 - IveltScraper - INFO - ivelt scrape complete. Checked 3 topics.
2026-06-08 21:00:30,222 - IveltScraper - INFO - Fetching yidtish active topics from https://forum.yidtish.com/search.php?search_id=active_topics...
2026-06-08 21:00:31,055 - IveltScraper - INFO - Found 50 active topics on yidtish
2026-06-08 21:00:32,306 - IveltScraper - INFO - yidtish scrape complete. Checked 1 topics.
2026-06-08 21:00:32,306 - IveltScraper - INFO - All forums scrape complete. Found 25 new posts.
2026-06-08 21:00:32,306 - __main__ - INFO - Scraper rss completed: 2 results
2026-06-08 21:00:32,306 - __main__ - INFO - Scraper yiddish24 completed: 16 results
2026-06-08 21:00:32,306 - __main__ - INFO - Scraper ivelt completed: 25 results
2026-06-08 21:00:33,071 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-08 21:00:33.071683
2026-06-08 21:00:33,072 - __main__ - INFO - Email sent successfully
2026-06-08 21:00:33,072 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-08 21:00:33,072 - __main__ - INFO - Monitor complete. Found 43 total results: 2 new rss results, 16 new yiddish24 results, 25 new ivelt results.
2026-06-08 21:00:33,072 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-08 21:00:33,072 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-08 21:00:33,123 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-08 21:00:33,123 - __main__ - INFO - Closed all database connections
2026-06-08 21:00:33,125 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-08 21:00:33,125 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-08 22:00:02,608 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-08.log
2026-06-08 22:00:02,608 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-08.log
2026-06-08 22:00:02,608 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-08.log
2026-06-08 22:00:02,608 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-08 22:00:02,646 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-08 22:00:02,646 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-08 22:00:02,649 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-08 22:00:02,649 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-08 22:00:02,670 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-08 22:00:02,670 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-08 22:00:02,732 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-08 22:00:02,734 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-08 22:00:02,734 - __main__ - INFO - RSS scraper initialized and enabled
2026-06-08 22:00:02,738 - Yiddish24Scraper - INFO - File downloader initialized with 52 terms, prefix 'Y2', and file type organization enabled
2026-06-08 22:00:02,738 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=52, exclude_terms=0
2026-06-08 22:00:02,738 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-06-08 22:00:02,740 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-08 22:00:02,746 - TorahAnytimeScraper - INFO - File downloader initialized with 52 terms, prefix 'TA', and file type organization enabled
2026-06-08 22:00:02,746 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=52, exclude_terms=4
2026-06-08 22:00:02,749 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-08 22:00:02,749 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0
2026-06-08 22:00:02,749 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-08 22:00:02,749 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-06-08 22:00:02,749 - __main__ - INFO - Running 3 scrapers concurrently...
2026-06-08 22:00:02,750 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-06-08 22:00:02,831 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-06-08 22:00:02,836 - IveltScraper - INFO - Loaded 181 include, 0 exclude filters from DB topic_filters
2026-06-08 22:00:02,836 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-06-08 22:00:02,838 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-06-08 22:00:03,145 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-06-08 22:00:03,657 - RSSFeedScraper - INFO - Total RSS/HTML results: 3
2026-06-08 22:00:10,359 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-06-08 22:00:10,567 - Yiddish24Scraper - INFO - Received response with 491180 characters
2026-06-08 22:00:10,569 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (311231 chars)
2026-06-08 22:00:10,572 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-06-08 22:00:10,661 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-06-08 22:00:10,708 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-06-08 22:00:10,708 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-06-08 22:00:10,717 - Yiddish24Scraper - INFO - Term 'ืขื ื™ื ื™ ื“ื™ื•ืžื' matched in DESCRIPTION: 'ืขื ื™ื ื™ ื“ื™ื•ืžื - ืชื›ืœืช ื”ื™ื™ื ื˜ื™ื’ืข ืฆื™ื™ื˜ืŸ'
2026-06-08 22:00:10,717 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ื”ื›ืœ ื‘ื›ืœ
2026-06-08 22:00:11,448 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/__________________260_260608021404.mp3
2026-06-08 22:00:13,044 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2___________________260_260608021404.mp3 (28.9 MB)
2026-06-08 22:00:13,045 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-06-08 22:00:13,064 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2___________________260_260608021404.mp3: title, artist, album, comment, source_url, genre, publisher
2026-06-08 22:00:13,064 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2___________________260_260608021404_ืขื ื™ื ื™_ื“ื™ื•ืžื.mp3
2026-06-08 22:00:13,798 - Yiddish24Scraper - INFO - Page 1 summary: 2 new out of 100 total articles
2026-06-08 22:00:13,798 - Yiddish24Scraper - INFO - Page 1: 2/100 new items
2026-06-08 22:00:13,798 - Yiddish24Scraper - INFO - Low new item ratio (2.0%), stopping pagination
2026-06-08 22:00:13,799 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 2
2026-06-08 22:00:14,614 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-06-08 22:00:43,161 - IveltScraper - INFO - ivelt scrape complete. Checked 5 topics.
2026-06-08 22:00:43,161 - IveltScraper - INFO - Fetching yidtish active topics from https://forum.yidtish.com/search.php?search_id=active_topics...
2026-06-08 22:00:43,980 - IveltScraper - INFO - Found 50 active topics on yidtish
2026-06-08 22:00:45,254 - IveltScraper - INFO - yidtish scrape complete. Checked 1 topics.
2026-06-08 22:00:45,254 - IveltScraper - INFO - All forums scrape complete. Found 38 new posts.
2026-06-08 22:00:45,255 - __main__ - INFO - Scraper rss completed: 3 results
2026-06-08 22:00:45,255 - __main__ - INFO - Scraper yiddish24 completed: 2 results
2026-06-08 22:00:45,255 - __main__ - INFO - Scraper ivelt completed: 38 results
2026-06-08 22:00:45,905 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-08 22:00:45.905108
2026-06-08 22:00:45,905 - __main__ - INFO - Email sent successfully
2026-06-08 22:00:45,905 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-08 22:00:45,905 - __main__ - INFO - Monitor complete. Found 43 total results: 3 new rss results, 2 new yiddish24 results, 38 new ivelt results.
2026-06-08 22:00:45,906 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-08 22:00:45,906 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-08 22:00:45,981 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-08 22:00:45,981 - __main__ - INFO - Closed all database connections
2026-06-08 22:00:45,984 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-08 22:00:45,984 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-08 22:30:02,243 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-08.log
2026-06-08 22:30:02,247 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-08.log
2026-06-08 22:30:02,247 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-08.log
2026-06-08 22:30:02,247 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-08 22:30:02,285 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-08 22:30:02,285 - social_media_monitor.config.settings - WARNING - Twitter monitoring enabled but credentials validation not implemented
2026-06-08 22:30:02,285 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-08 22:30:02,295 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-08 22:30:02,302 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-08 22:30:02,323 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-08 22:30:02,323 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-08 22:30:02,324 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-08 22:30:02,325 - __main__ - INFO - Reddit scraper initialized and enabled
2026-06-08 22:30:02,325 - __main__ - INFO - GitHub scraper initialized and enabled
2026-06-08 22:30:02,325 - __main__ - INFO - Twitter scraper initialized and enabled
2026-06-08 22:30:02,332 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-08 22:30:02,333 - __main__ - INFO - LinkedIn scraper initialized and enabled
2026-06-08 22:30:02,333 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled
2026-06-08 22:30:02,345 - Yiddish24Scraper - INFO - File downloader initialized with 52 terms, prefix 'Y2', and file type organization enabled
2026-06-08 22:30:02,345 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=52, exclude_terms=0
2026-06-08 22:30:02,351 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-08 22:30:02,360 - TorahAnytimeScraper - INFO - File downloader initialized with 52 terms, prefix 'TA', and file type organization enabled
2026-06-08 22:30:02,360 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=52, exclude_terms=4
2026-06-08 22:30:02,362 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-08 22:30:02,362 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0
2026-06-08 22:30:02,362 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-08 22:30:02,362 - __main__ - INFO - Running 5 scrapers concurrently...
2026-06-08 22:30:02,362 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit search monitoring enabled. Running search with terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-08 22:30:02,362 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['"Hermes Agent"']
2026-06-08 22:30:03,292 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term '"Hermes Agent"'
2026-06-08 22:30:03,350 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Anyone Got Hermes Agent / Himalya to work with an Outlook.com Email
2026-06-08 22:30:03,366 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Hermes Agent is crazyโ€ฆ 180,000+ github stars
2026-06-08 22:30:03,386 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Mercury Agent install note: Mercury skills without the setup-only trap
2026-06-08 22:30:03,402 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: How I automated my entire dynamic IPv6 self-hosting nightmare with an
2026-06-08 22:30:04,625 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 4
2026-06-08 22:30:04,625 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'paperclip' restricted to subreddits: ['PaperClip_AI', 'PaperclipAI']
2026-06-08 22:30:04,625 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['paperclip']
2026-06-08 22:30:04,626 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/PaperClip_AI+PaperclipAI
2026-06-08 22:30:05,785 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'paperclip'
2026-06-08 22:30:05,822 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Paperclip Heart: An AI Doomer Short Film Made with AI...and love.
2026-06-08 22:30:07,026 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 1
2026-06-08 22:30:07,027 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'multica' restricted to subreddits: ['hermesagent', 'HermesAI']
2026-06-08 22:30:07,027 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['multica']
2026-06-08 22:30:07,027 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/hermesagent+HermesAI
2026-06-08 22:30:07,860 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'multica'
2026-06-08 22:30:09,207 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0
2026-06-08 22:30:09,207 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit subreddit feed monitoring enabled.
2026-06-08 22:30:09,208 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'hermes_agent': r/hermesagent+HermesAI+AI_Agents+aiagents+AgentsOfAI+LocalLLaMA+AutoGPT (limit=25)
2026-06-08 22:30:09,208 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes agent via RSS
2026-06-08 22:30:10,259 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/hermesagent: Hermes at work in xcode-beta macOS Golden Gate (with settings config.)
2026-06-08 22:30:10,273 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/FolkApp: pov: ai agents in may 2026
2026-06-08 22:30:10,287 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/mcp: A landscape overview of 70+ open-source memory systems for AI agents
2026-06-08 22:30:11,433 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes AI via RSS
2026-06-08 22:30:13,414 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: nous research hermes via RSS
2026-06-08 22:30:14,517 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/hermesagent: Model Provider for Hermes
2026-06-08 22:30:15,645 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: multica via RSS
2026-06-08 22:30:17,658 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'paperclip_ai': r/PaperClip_AI+PaperclipAI+pAIperclip (limit=25)
2026-06-08 22:30:17,659 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip ai via RSS
2026-06-08 22:30:20,349 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip agent via RSS
2026-06-08 22:30:22,702 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: multica via RSS
2026-06-08 22:30:24,675 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'claude_agents': r/vibecoding (limit=25)
2026-06-08 22:30:24,675 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: multica via RSS
2026-06-08 22:30:26,691 - social_media_monitor.scrapers.reddit_scraper - INFO - Total subreddit feed results: 4
2026-06-08 22:30:26,691 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-08 22:30:26,888 - TwitterScraper - INFO - Using XAI (Grok) for real-time Twitter/X search
2026-06-08 22:30:26,893 - LinkedInScraper - INFO - Searching LinkedIn (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-08 22:30:27,539 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'paperclip'
2026-06-08 22:30:28,771 - LinkedInScraper - INFO - LinkedIn RSS: 84 entries for '"Hermes Agent"'
2026-06-08 22:30:29,278 - LinkedInScraper - INFO - New LinkedIn post: Claude just became a browser automation agent. Hereโ€™s what Browser Use
2026-06-08 22:30:29,288 - LinkedInScraper - INFO - New LinkedIn post: NVIDIA AI - LinkedIn
2026-06-08 22:30:29,306 - LinkedInScraper - INFO - New LinkedIn post: I used 1 free Google AI tool to rank in 5 different placesโ€ฆ Hereโ€™s how
2026-06-08 22:30:29,318 - LinkedInScraper - INFO - New LinkedIn post: Kimi K2.5 AI uses agent swarm technology to spawn 100 AI agents that w
2026-06-08 22:30:29,329 - LinkedInScraper - INFO - New LinkedIn post: I haven't gone looking for AI news in weeks. It comes to me โ€” every mo
2026-06-08 22:30:29,350 - LinkedInScraper - INFO - New LinkedIn post: Inside AWS Summit: The Hidden Security Risk Nobody Talks About in MCP
2026-06-08 22:30:29,362 - LinkedInScraper - INFO - New LinkedIn post: The value in these 10 free AI tools is incredible. Anyone building wit
2026-06-08 22:30:29,371 - LinkedInScraper - INFO - New LinkedIn post: NVIDIAโ€™s Nemotron 3 Ultra is available on Ollamaโ€™s cloud! Itโ€™s a 550 b
2026-06-08 22:30:29,383 - LinkedInScraper - INFO - New LinkedIn post: AMDevs Weekly Updates - LinkedIn
2026-06-08 22:30:29,393 - LinkedInScraper - INFO - New LinkedIn post: ๐Ÿ”ฅ Cohere just dropped a SECRET coding model โ€” before the official laun
2026-06-08 22:30:29,402 - LinkedInScraper - INFO - New LinkedIn post: AI-powered junkie / AI Agent & Automation Expert / Cold email strategi
2026-06-08 22:30:29,414 - LinkedInScraper - INFO - New LinkedIn post: Lior Alexander - Helping devs stay up to date with AI. CEO at AlphaSig
2026-06-08 22:30:29,425 - LinkedInScraper - INFO - New LinkedIn post: Jeff Sutherland - Inventor of Scrum & Scrum@Scale | Founder, ScrumAI |
2026-06-08 22:30:29,438 - LinkedInScraper - INFO - New LinkedIn post: Today we're releasing Monitoring in Firecrawl ๐Ÿ“ก Just enter a URL, desc
2026-06-08 22:30:29,448 - LinkedInScraper - INFO - New LinkedIn post: Google just dropped a free AI voice dictation app with every premium f
2026-06-08 22:30:29,458 - LinkedInScraper - INFO - New LinkedIn post: Aakash Gupta - Helping you succeed in your career + land your next job
2026-06-08 22:30:29,469 - LinkedInScraper - INFO - New LinkedIn post: On my way back home from Google I/O last week, I met Moses โ€” a machine
2026-06-08 22:30:29,481 - LinkedInScraper - INFO - New LinkedIn post: Every Claude Connector Worth Using ๐—•๐—ฒ๐—ฐ๐—ผ๐—บ๐—ฒ ๐—ฏ๐—ฒ๐˜๐˜๐—ฒ๐—ฟ ๐—ฎ๐˜ ๐—”๐—œ ๐—ถ๐—ป ๐—ท๐˜‚๐˜€๐˜ ๐Ÿญ ๐—บ๐—ถ๐—ป๐˜‚๐˜
2026-06-08 22:30:29,493 - LinkedInScraper - INFO - New LinkedIn post: I swear โ€œquick tutorial videosโ€ are never actually quick. You hit reco
2026-06-08 22:30:29,505 - LinkedInScraper - INFO - New LinkedIn post: Today at BUILD, Satya Nadella introduced Web IQ, a moment weโ€™ve been w
2026-06-08 22:30:29,514 - LinkedInScraper - INFO - New LinkedIn post: Divyanshi Sharma - Your go-to for GTM, AI & Lead gen! - LinkedIn
2026-06-08 22:30:29,526 - LinkedInScraper - INFO - New LinkedIn post: Hasanpreet Singh Toor - AI & Tech Educator | Follow me to learn about
2026-06-08 22:30:30,220 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'multica'
2026-06-08 22:30:30,981 - LinkedInScraper - INFO - LinkedIn scrape complete. Found 22 new results.
2026-06-08 22:30:30,982 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)
2026-06-08 22:30:36,000 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-08 22:30:36,092 - GitHubScraper - INFO - Found 236 GitHub repositories for term: paperclip
2026-06-08 22:30:36,668 - httpx - INFO - HTTP Request: POST https://api.x.ai/v1/chat/completions "HTTP/1.1 200 OK"
2026-06-08 22:30:36,669 - TwitterScraper - INFO - XAI Search: found 0 tweets for 'paperclip'
2026-06-08 22:30:37,336 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-08 22:30:37,338 - GitHubScraper - INFO - Found 335 GitHub repositories for term: "Hermes Agent"
2026-06-08 22:30:38,580 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-08 22:30:38,664 - httpx - INFO - HTTP Request: POST https://api.x.ai/v1/chat/completions "HTTP/1.1 200 OK"
2026-06-08 22:30:38,665 - TwitterScraper - INFO - XAI Search: found 0 tweets for '"Hermes Agent"'
2026-06-08 22:30:38,681 - GitHubScraper - INFO - Found 49 GitHub repositories for term: multica
2026-06-08 22:30:38,839 - GitHubScraper - INFO - Total GitHub results found: 0
2026-06-08 22:30:41,153 - httpx - INFO - HTTP Request: POST https://api.x.ai/v1/chat/completions "HTTP/1.1 200 OK"
2026-06-08 22:30:41,154 - TwitterScraper - INFO - XAI Search: found 0 tweets for 'multica'
2026-06-08 22:30:41,155 - TwitterScraper - INFO - Twitter scrape complete. Found 0 new results.
2026-06-08 22:30:41,155 - __main__ - INFO - Scraper reddit completed: 9 results
2026-06-08 22:30:41,155 - __main__ - INFO - Scraper github completed: 0 results
2026-06-08 22:30:41,155 - __main__ - INFO - Scraper twitter completed: 0 results
2026-06-08 22:30:41,155 - __main__ - INFO - Scraper linkedin completed: 22 results
2026-06-08 22:30:41,155 - __main__ - INFO - Scraper linkedin_feed completed: 0 results
2026-06-08 22:30:41,875 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-08 22:30:41.875011
2026-06-08 22:30:41,875 - __main__ - INFO - Email sent successfully
2026-06-08 22:30:41,875 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-08 22:30:41,875 - __main__ - INFO - Monitor complete. Found 31 total results: 9 new reddit results, 22 new linkedin results.
2026-06-08 22:30:41,875 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-08 22:30:41,875 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-08 22:30:42,124 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-08 22:30:42,124 - __main__ - INFO - Closed all database connections
2026-06-08 22:30:42,126 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-08 22:30:42,126 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-08 23:00:02,580 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-08.log
2026-06-08 23:00:02,580 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-08.log
2026-06-08 23:00:02,580 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-08.log
2026-06-08 23:00:02,580 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-08 23:00:02,622 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-08 23:00:02,622 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-08 23:00:02,624 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-08 23:00:02,625 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-08 23:00:02,663 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-08 23:00:02,664 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-08 23:00:02,665 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-08 23:00:02,667 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-08 23:00:02,667 - __main__ - INFO - RSS scraper initialized and enabled
2026-06-08 23:00:02,671 - Yiddish24Scraper - INFO - File downloader initialized with 52 terms, prefix 'Y2', and file type organization enabled
2026-06-08 23:00:02,671 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=52, exclude_terms=0
2026-06-08 23:00:02,671 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-06-08 23:00:02,676 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-08 23:00:02,684 - TorahAnytimeScraper - INFO - File downloader initialized with 52 terms, prefix 'TA', and file type organization enabled
2026-06-08 23:00:02,687 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=52, exclude_terms=4
2026-06-08 23:00:02,689 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-08 23:00:02,689 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=0
2026-06-08 23:00:02,689 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-08 23:00:02,689 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-06-08 23:00:02,689 - __main__ - INFO - Running 3 scrapers concurrently...
2026-06-08 23:00:02,689 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-06-08 23:00:02,776 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-06-08 23:00:02,785 - IveltScraper - INFO - Loaded 181 include, 0 exclude filters from DB topic_filters
2026-06-08 23:00:02,785 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-06-08 23:00:02,786 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-06-08 23:00:03,160 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-06-08 23:00:03,796 - RSSFeedScraper - INFO - Total RSS/HTML results: 3
2026-06-08 23:00:14,493 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-06-08 23:00:14,711 - Yiddish24Scraper - INFO - Received response with 473893 characters
2026-06-08 23:00:14,714 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (306315 chars)
2026-06-08 23:00:14,718 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-06-08 23:00:14,814 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-06-08 23:00:14,855 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-06-08 23:00:14,855 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-06-08 23:00:15,810 - Yiddish24Scraper - INFO - Page 1 summary: 14 new out of 100 total articles
2026-06-08 23:00:15,810 - Yiddish24Scraper - INFO - Page 1: 14/100 new items
2026-06-08 23:00:15,810 - Yiddish24Scraper - INFO - Low new item ratio (14.0%), stopping pagination
2026-06-08 23:00:15,810 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 14
2026-06-08 23:00:15,814 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-06-08 23:00:19,217 - IveltScraper - INFO - ivelt scrape complete. Checked 1 topics.
2026-06-08 23:00:19,217 - IveltScraper - INFO - Fetching yidtish active topics from https://forum.yidtish.com/search.php?search_id=active_topics...
2026-06-08 23:00:20,072 - IveltScraper - INFO - Found 50 active topics on yidtish
2026-06-08 23:00:21,359 - IveltScraper - INFO - yidtish scrape complete. Checked 1 topics.
2026-06-08 23:00:21,359 - IveltScraper - INFO - All forums scrape complete. Found 5 new posts.
2026-06-08 23:00:21,359 - __main__ - INFO - Scraper rss completed: 3 results
2026-06-08 23:00:21,359 - __main__ - INFO - Scraper yiddish24 completed: 14 results
2026-06-08 23:00:21,359 - __main__ - INFO - Scraper ivelt completed: 5 results
2026-06-08 23:00:21,999 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-08 23:00:21.999807
2026-06-08 23:00:22,000 - __main__ - INFO - Email sent successfully
2026-06-08 23:00:22,000 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-08 23:00:22,000 - __main__ - INFO - Monitor complete. Found 22 total results: 3 new rss results, 14 new yiddish24 results, 5 new ivelt results.
2026-06-08 23:00:22,000 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-08 23:00:22,000 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-08 23:00:22,050 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-08 23:00:22,051 - __main__ - INFO - Closed all database connections
2026-06-08 23:00:22,053 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-08 23:00:22,053 - social_media_monitor.database.connection - INFO - Closed 0 database connections