โ† Logs

social_media_monitor_2026-06-12.log

2026-06-12 20:30:05,365 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'multica' restricted to subreddits: ['hermesagent', 'HermesAI']
2026-06-12 20:30:05,365 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['multica']
2026-06-12 20:30:05,365 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/hermesagent+HermesAI
2026-06-12 20:30:05,506 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 0 entries for term 'multica'
2026-06-12 20:30:06,506 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0
2026-06-12 20:30:06,506 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit subreddit feed monitoring enabled.
2026-06-12 20:30:06,506 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'hermes_agent': r/hermesagent+HermesAI+AI_Agents+aiagents+AgentsOfAI+LocalLLaMA+AutoGPT (limit=25)
2026-06-12 20:30:06,507 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes agent via RSS
2026-06-12 20:30:07,662 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes AI via RSS
2026-06-12 20:30:08,821 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: nous research hermes via RSS
2026-06-12 20:30:09,977 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: multica via RSS
2026-06-12 20:30:11,133 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'paperclip_ai': r/PaperClip_AI+PaperclipAI+pAIperclip (limit=25)
2026-06-12 20:30:11,133 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip ai via RSS
2026-06-12 20:30:12,290 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip agent via RSS
2026-06-12 20:30:13,450 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: multica via RSS
2026-06-12 20:30:14,601 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'claude_agents': r/vibecoding (limit=25)
2026-06-12 20:30:14,602 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: multica via RSS
2026-06-12 20:30:15,758 - social_media_monitor.scrapers.reddit_scraper - INFO - Total subreddit feed results: 0
2026-06-12 20:30:15,758 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-12 20:30:15,909 - TwitterScraper - INFO - Searching Twitter/X (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-12 20:30:16,334 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'paperclip'
2026-06-12 20:30:22,308 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for '"Hermes Agent"'
2026-06-12 20:30:28,297 - TwitterScraper - INFO - Twitter/X RSS: 99 entries for 'multica'
2026-06-12 20:30:33,566 - TwitterScraper - INFO - Twitter scrape complete. Found 0 new results.
2026-06-12 20:30:33,567 - LinkedInScraper - INFO - Searching LinkedIn (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-12 20:30:34,032 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'paperclip'
2026-06-12 20:30:35,276 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for '"Hermes Agent"'
2026-06-12 20:30:35,301 - LinkedInScraper - INFO - New LinkedIn post: Ever heard of Hermes Agent by Nous Research? It is an open-source fram
2026-06-12 20:30:35,381 - LinkedInScraper - INFO - New LinkedIn post: 5 FREE Hermes Agent Use Cases! - LinkedIn
2026-06-12 20:30:35,832 - LinkedInScraper - INFO - New LinkedIn post: Hermes Agent Computer Use Runs Background Tasks For FREE - LinkedIn
2026-06-12 20:30:36,722 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'multica'
2026-06-12 20:30:37,519 - LinkedInScraper - INFO - LinkedIn scrape complete. Found 3 new results.
2026-06-12 20:30:37,519 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)
2026-06-12 20:30:37,859 - LinkedInFeedScraper - INFO - Successfully auto-grabbed fresh LinkedIn cookies and User-Agent from running Chrome!
2026-06-12 20:30:45,787 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Amir Davidson - Every American Jew already has a neighborhood in Israel.
They just haven't seen the map yet.
Upper
2026-06-12 20:30:45,806 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Brian Gates - ** AI Media Studio LLC **
Private Cyber Security Testing
Wi-Fi Testing
Penetration Testing
2026-06-12 20:30:45,815 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Isaac Weinberger - ๐Ÿ•๏ธ Building for the Next Generation
We're proud to have completed this incredible project in record
2026-06-12 20:30:45,825 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Salik Ahmed - 7 ways AI is changing software development in 2026
๐Ÿ”ฎ Software development in 2026 looks nothing lik
2026-06-12 20:30:45,843 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Saviour Henry - There is a version of AI that impresses people in demos.
And there is a version that actually works
2026-06-12 20:30:45,853 - LinkedInFeedScraper - INFO - New LinkedIn feed post: The Neuron - AI News - AI is moving faster than most people can keep up with.
That's why 700,000+ readers start their morn
2026-06-12 20:30:45,862 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Abdur-Rahman Bilal - Donโ€™t Build Your Whole App on One AI Tool
Claude is powerful, but it should not be your entire work
2026-06-12 20:30:45,869 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Miten Shah - Shopify has been quietly building out its B2B infrastructure.
And most brands with even a small who
2026-06-12 20:30:45,878 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Cuong Nguyen - Most Developers Answer This Wrong
IEnumerable<T> vs IQueryable<T>
Many developers use them interchan
2026-06-12 20:30:45,888 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Nachum Meth - What comes to mind when you think of Corona Beer? Chances are, the answer is exactly what the compan
2026-06-12 20:30:45,898 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Parvez Mohammed - Most AI agents forget what they learned last week.
Hermes Agent is different โ€” it builds a learning
2026-06-12 20:30:45,914 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Spencer Thomason - The AI industry is scaling fast, but something unusual is happening under the surface.
Valuations a
2026-06-12 20:30:45,924 - LinkedInFeedScraper - INFO - New LinkedIn feed post: None - IMAGE
2026-06-12 20:30:45,936 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Thomas Terronez - We find dentists trying to drink the AI Kool-Aid based solely on hype.
When someone asks me where t
2026-06-12 20:30:45,936 - LinkedInFeedScraper - INFO - LinkedIn Feed scrape complete. Found 14 new posts.
2026-06-12 20:30:47,163 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-12 20:30:47,193 - GitHubScraper - INFO - Found 237 GitHub repositories for term: paperclip
2026-06-12 20:30:48,399 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-12 20:30:48,402 - GitHubScraper - INFO - Found 354 GitHub repositories for term: "Hermes Agent"
2026-06-12 20:30:49,545 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-12 20:30:49,549 - GitHubScraper - INFO - Found 50 GitHub repositories for term: multica
2026-06-12 20:30:49,698 - GitHubScraper - INFO - Total GitHub results found: 0
2026-06-12 20:30:49,698 - __main__ - INFO - Scraper reddit completed: 4 results
2026-06-12 20:30:49,698 - __main__ - INFO - Scraper github completed: 0 results
2026-06-12 20:30:49,698 - __main__ - INFO - Scraper twitter completed: 0 results
2026-06-12 20:30:49,698 - __main__ - INFO - Scraper linkedin completed: 3 results
2026-06-12 20:30:49,698 - __main__ - INFO - Scraper linkedin_feed completed: 14 results
2026-06-12 20:30:50,478 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-12 20:30:50.478803
2026-06-12 20:30:50,479 - __main__ - INFO - Email sent successfully
2026-06-12 20:30:50,479 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-12 20:30:50,479 - __main__ - INFO - Monitor complete. Found 21 total results: 4 new reddit results, 3 new linkedin results, 14 new linkedin feed results.
2026-06-12 20:30:50,479 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-12 20:30:50,479 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-12 20:30:50,571 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-12 20:30:50,571 - __main__ - INFO - Closed all database connections
2026-06-12 20:30:50,573 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-12 20:30:50,573 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-12 21:00:02,042 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-12.log
2026-06-12 21:00:02,042 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-12.log
2026-06-12 21:00:02,042 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-12.log
2026-06-12 21:00:02,042 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-12 21:00:02,069 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-12 21:00:02,069 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-12 21:00:02,071 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-12 21:00:02,072 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-12 21:00:02,113 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-12 21:00:02,113 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-12 21:00:02,114 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-12 21:00:02,115 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-12 21:00:02,115 - __main__ - INFO - RSS scraper initialized and enabled
2026-06-12 21:00:02,118 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-12 21:00:02,118 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-12 21:00:02,118 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-06-12 21:00:02,121 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-12 21:00:02,125 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-12 21:00:02,125 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=5
2026-06-12 21:00:02,127 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-12 21:00:02,127 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-12 21:00:02,127 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-12 21:00:02,131 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-06-12 21:00:02,131 - __main__ - INFO - Running 3 scrapers concurrently...
2026-06-12 21:00:02,131 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-06-12 21:00:02,225 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-06-12 21:00:02,229 - IveltScraper - INFO - Loaded 181 include, 0 exclude filters from DB topic_filters
2026-06-12 21:00:02,229 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-06-12 21:00:02,230 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-06-12 21:00:02,505 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-06-12 21:00:03,009 - RSSFeedScraper - INFO - Total RSS/HTML results: 3
2026-06-12 21:00:13,954 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-06-12 21:00:16,769 - IveltScraper - INFO - Filtering post containing exclude term: '*ื‘ื™ื˜ืข ืžืื›ื˜ ื–ื™ื›ืขืจ ื‘ืœื•ื™ื– ืฆื• ื‘ืืจื™ื›ื˜ืŸ ืงืจืื ื˜ืข ื ื™ื™ืขืก*'
2026-06-12 21:00:30,577 - IveltScraper - INFO - ivelt scrape complete. Checked 3 topics.
2026-06-12 21:00:30,577 - IveltScraper - INFO - All forums scrape complete. Found 42 new posts.
2026-06-12 21:00:33,124 - Yiddish24Scraper - ERROR - Error fetching Yiddish24 page 1:
2026-06-12 21:00:33,138 - Yiddish24Scraper - ERROR - Traceback (most recent call last):
File "/home/openclaw/.local/lib/python3.12/site-packages/httpx/_transports/default.py", line 101, in map_httpcore_exceptions
yield
File "/home/openclaw/.local/lib/python3.12/site-packages/httpx/_transports/default.py", line 394, in handle_async_request
resp = await self._pool.handle_async_request(req)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/openclaw/.local/lib/python3.12/site-packages/httpcore/_async/connection_pool.py", line 256, in handle_async_request
raise exc from None
File "/home/openclaw/.local/lib/python3.12/site-packages/httpcore/_async/connection_pool.py", line 236, in handle_async_request
response = await connection.handle_async_request(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
pool_request.request
^^^^^^^^^^^^^^^^^^^^
)
^
File "/home/openclaw/.local/lib/python3.12/site-packages/httpcore/_async/connection.py", line 103, in handle_async_request
return await self._connection.handle_async_request(request)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/openclaw/.local/lib/python3.12/site-packages/httpcore/_async/http11.py", line 136, in handle_async_request
raise exc
File "/home/openclaw/.local/lib/python3.12/site-packages/httpcore/_async/http11.py", line 106, in handle_async_request
) = await self._receive_response_headers(**kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/openclaw/.local/lib/python3.12/site-packages/httpcore/_async/http11.py", line 177, in _receive_response_headers
event = await self._receive_event(timeout=timeout)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/openclaw/.local/lib/python3.12/site-packages/httpcore/_async/http11.py", line 217, in _receive_event
data = await self._network_stream.read(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
self.READ_NUM_BYTES, timeout=timeout
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
)
^
File "/home/openclaw/.local/lib/python3.12/site-packages/httpcore/_backends/anyio.py", line 32, in read
with map_exceptions(exc_map):
~~~~~~~~~~~~~~^^^^^^^^^
File "/home/linuxbrew/.linuxbrew/opt/python@3.14/lib/python3.14/contextlib.py", line 162, in __exit__
self.gen.throw(value)
~~~~~~~~~~~~~~^^^^^^^
File "/home/openclaw/.local/lib/python3.12/site-packages/httpcore/_exceptions.py", line 14, in map_exceptions
raise to_exc(exc) from exc
httpcore.ReadTimeout
The above exception was the direct cause of the following exception:
Traceback (most recent call last):
File "/home/openclaw/Social_Media_Monitor/src/social_media_monitor/scrapers/yiddish24_scraper.py", line 207, in _fetch_page
response = await self.make_request(
^^^^^^^^^^^^^^^^^^^^^^^^
...<5 lines>...
)
^
File "/home/openclaw/Social_Media_Monitor/src/social_media_monitor/scrapers/base_scraper.py", line 231, in make_request
response = await session.post(url, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/openclaw/.local/lib/python3.12/site-packages/httpx/_client.py", line 1859, in post
return await self.request(
^^^^^^^^^^^^^^^^^^^
...<13 lines>...
)
^
File "/home/openclaw/.local/lib/python3.12/site-packages/httpx/_client.py", line 1540, in request
return await self.send(request, auth=auth, follow_redirects=follow_redirects)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/openclaw/.local/lib/python3.12/site-packages/httpx/_client.py", line 1629, in send
response = await self._send_handling_auth(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
...<4 lines>...
)
^
File "/home/openclaw/.local/lib/python3.12/site-packages/httpx/_client.py", line 1657, in _send_handling_auth
response = await self._send_handling_redirects(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
...<3 lines>...
)
^
File "/home/openclaw/.local/lib/python3.12/site-packages/httpx/_client.py", line 1694, in _send_handling_redirects
response = await self._send_single_request(request)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/openclaw/.local/lib/python3.12/site-packages/httpx/_client.py", line 1730, in _send_single_request
response = await transport.handle_async_request(request)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/openclaw/.local/lib/python3.12/site-packages/httpx/_transports/default.py", line 393, in handle_async_request
with map_httpcore_exceptions():
~~~~~~~~~~~~~~~~~~~~~~~^^
File "/home/linuxbrew/.linuxbrew/opt/python@3.14/lib/python3.14/contextlib.py", line 162, in __exit__
self.gen.throw(value)
~~~~~~~~~~~~~~^^^^^^^
File "/home/openclaw/.local/lib/python3.12/site-packages/httpx/_transports/default.py", line 118, in map_httpcore_exceptions
raise mapped_exc(message) from exc
httpx.ReadTimeout
2026-06-12 21:00:33,138 - Yiddish24Scraper - INFO - Page 1: 0/0 new items
2026-06-12 21:00:33,138 - Yiddish24Scraper - INFO - No more results found at page 1, stopping pagination
2026-06-12 21:00:33,138 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0
2026-06-12 21:00:33,140 - __main__ - INFO - Scraper rss completed: 3 results
2026-06-12 21:00:33,140 - __main__ - INFO - Scraper yiddish24 completed: 0 results
2026-06-12 21:00:33,141 - __main__ - INFO - Scraper ivelt completed: 42 results
2026-06-12 21:00:33,885 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-12 21:00:33.885333
2026-06-12 21:00:33,885 - __main__ - INFO - Email sent successfully
2026-06-12 21:00:33,886 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-12 21:00:33,886 - __main__ - INFO - Monitor complete. Found 45 total results: 3 new rss results, 42 new ivelt results.
2026-06-12 21:00:33,886 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-12 21:00:33,886 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-12 21:00:34,008 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-12 21:00:34,009 - __main__ - INFO - Closed all database connections
2026-06-12 21:00:34,011 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-12 21:00:34,011 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-12 22:00:01,855 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-12.log
2026-06-12 22:00:01,855 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-12.log
2026-06-12 22:00:01,855 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-12.log
2026-06-12 22:00:01,855 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-12 22:00:01,880 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-12 22:00:01,880 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-12 22:00:01,882 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-12 22:00:01,884 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-12 22:00:01,913 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-12 22:00:01,913 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-12 22:00:01,967 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-12 22:00:01,969 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-12 22:00:01,969 - __main__ - INFO - RSS scraper initialized and enabled
2026-06-12 22:00:01,974 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-12 22:00:01,974 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-12 22:00:01,974 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-06-12 22:00:01,980 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-12 22:00:01,988 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-12 22:00:01,988 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=5
2026-06-12 22:00:01,991 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-12 22:00:01,991 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-12 22:00:01,992 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-12 22:00:01,992 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-06-12 22:00:01,992 - __main__ - INFO - Running 3 scrapers concurrently...
2026-06-12 22:00:01,992 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-06-12 22:00:02,083 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-06-12 22:00:02,088 - IveltScraper - INFO - Loaded 181 include, 0 exclude filters from DB topic_filters
2026-06-12 22:00:02,088 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-06-12 22:00:02,089 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-06-12 22:00:02,422 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-06-12 22:00:02,905 - RSSFeedScraper - INFO - Total RSS/HTML results: 3
2026-06-12 22:00:06,251 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-06-12 22:00:06,464 - Yiddish24Scraper - INFO - Received response with 468665 characters
2026-06-12 22:00:06,467 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (306509 chars)
2026-06-12 22:00:06,470 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-06-12 22:00:06,563 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-06-12 22:00:06,604 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-06-12 22:00:06,604 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-06-12 22:00:07,340 - Yiddish24Scraper - INFO - Page 1 summary: 20 new out of 100 total articles
2026-06-12 22:00:07,340 - Yiddish24Scraper - INFO - Page 1: 20/100 new items
2026-06-12 22:00:07,341 - Yiddish24Scraper - INFO - Low new item ratio (20.0%), stopping pagination
2026-06-12 22:00:07,341 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 20
2026-06-12 22:00:13,774 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-06-12 22:00:34,076 - IveltScraper - INFO - Filtering post containing exclude term: '*ื‘ื™ื˜ืข ืžืื›ื˜ ื–ื™ื›ืขืจ ื‘ืœื•ื™ื– ืฆื• ื‘ืืจื™ื›ื˜ืŸ ืงืจืื ื˜ืข ื ื™ื™ืขืก*'
2026-06-12 22:00:36,575 - IveltScraper - INFO - ivelt scrape complete. Checked 5 topics.
2026-06-12 22:00:36,575 - IveltScraper - INFO - All forums scrape complete. Found 14 new posts.
2026-06-12 22:00:36,575 - __main__ - INFO - Scraper rss completed: 3 results
2026-06-12 22:00:36,575 - __main__ - INFO - Scraper yiddish24 completed: 20 results
2026-06-12 22:00:36,576 - __main__ - INFO - Scraper ivelt completed: 14 results
2026-06-12 22:00:37,292 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-12 22:00:37.291940
2026-06-12 22:00:37,292 - __main__ - INFO - Email sent successfully
2026-06-12 22:00:37,292 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-12 22:00:37,292 - __main__ - INFO - Monitor complete. Found 37 total results: 3 new rss results, 20 new yiddish24 results, 14 new ivelt results.
2026-06-12 22:00:37,292 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-12 22:00:37,292 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-12 22:00:37,400 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-12 22:00:37,400 - __main__ - INFO - Closed all database connections
2026-06-12 22:00:37,402 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-12 22:00:37,402 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-12 22:30:01,956 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-12.log
2026-06-12 22:30:01,956 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-12.log
2026-06-12 22:30:01,957 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-12.log
2026-06-12 22:30:01,957 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-12 22:30:01,981 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-12 22:30:01,982 - social_media_monitor.config.settings - WARNING - Twitter monitoring enabled but credentials validation not implemented
2026-06-12 22:30:01,982 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-12 22:30:01,984 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-12 22:30:01,984 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-12 22:30:02,009 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-12 22:30:02,009 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-12 22:30:02,010 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-12 22:30:02,010 - __main__ - INFO - Reddit scraper initialized and enabled
2026-06-12 22:30:02,010 - __main__ - INFO - GitHub scraper initialized and enabled
2026-06-12 22:30:02,010 - __main__ - INFO - Twitter scraper initialized and enabled
2026-06-12 22:30:02,011 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-12 22:30:02,011 - __main__ - INFO - LinkedIn scraper initialized and enabled
2026-06-12 22:30:02,011 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled
2026-06-12 22:30:02,013 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-12 22:30:02,013 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-12 22:30:02,016 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-12 22:30:02,022 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-12 22:30:02,023 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=5
2026-06-12 22:30:02,025 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-12 22:30:02,025 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-12 22:30:02,025 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-12 22:30:02,025 - __main__ - INFO - Running 5 scrapers concurrently...
2026-06-12 22:30:02,025 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit search monitoring enabled. Running search with terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-12 22:30:02,025 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['"Hermes Agent"']
2026-06-12 22:30:02,768 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term '"Hermes Agent"'
2026-06-12 22:30:02,806 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Models for RTX 3090 with Hermes agent
2026-06-12 22:30:02,815 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Hermes Agent + Local Gemma4:12b takes a lot of time
2026-06-12 22:30:02,828 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Is VPS option good for privacy & security?
2026-06-12 22:30:02,839 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: I Built an AI Hacking Team with Hermes Agent (And YOU can too)
2026-06-12 22:30:02,857 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: ๐ŸŽ‰ Hermes Desktop is now officially released!
2026-06-12 22:30:02,869 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: ๐ŸŽ‰ Hermes Desktop is now officially released!
2026-06-12 22:30:02,881 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Building my own system around Hermes. How do you handle Git / updates?
2026-06-12 22:30:02,895 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: What subscription to choose
2026-06-12 22:30:04,034 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 8
2026-06-12 22:30:04,034 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'paperclip' restricted to subreddits: ['PaperClip_AI', 'PaperclipAI']
2026-06-12 22:30:04,034 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['paperclip']
2026-06-12 22:30:04,034 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/PaperClip_AI+PaperclipAI
2026-06-12 22:30:04,186 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 0 entries for term 'paperclip'
2026-06-12 22:30:05,186 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0
2026-06-12 22:30:05,186 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'multica' restricted to subreddits: ['hermesagent', 'HermesAI']
2026-06-12 22:30:05,186 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['multica']
2026-06-12 22:30:05,186 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/hermesagent+HermesAI
2026-06-12 22:30:05,334 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 0 entries for term 'multica'
2026-06-12 22:30:06,334 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0
2026-06-12 22:30:06,334 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit subreddit feed monitoring enabled.
2026-06-12 22:30:06,334 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'hermes_agent': r/hermesagent+HermesAI+AI_Agents+aiagents+AgentsOfAI+LocalLLaMA+AutoGPT (limit=25)
2026-06-12 22:30:06,335 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes agent via RSS
2026-06-12 22:30:07,488 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes AI via RSS
2026-06-12 22:30:08,645 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: nous research hermes via RSS
2026-06-12 22:30:09,805 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: multica via RSS
2026-06-12 22:30:10,959 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'paperclip_ai': r/PaperClip_AI+PaperclipAI+pAIperclip (limit=25)
2026-06-12 22:30:10,959 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip ai via RSS
2026-06-12 22:30:12,113 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip agent via RSS
2026-06-12 22:30:13,257 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: multica via RSS
2026-06-12 22:30:14,412 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'claude_agents': r/vibecoding (limit=25)
2026-06-12 22:30:14,412 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: multica via RSS
2026-06-12 22:30:15,569 - social_media_monitor.scrapers.reddit_scraper - INFO - Total subreddit feed results: 0
2026-06-12 22:30:15,569 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-12 22:30:15,708 - TwitterScraper - INFO - Searching Twitter/X (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-12 22:30:16,122 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'paperclip'
2026-06-12 22:30:17,370 - TwitterScraper - INFO - New tweet/X post: ONE HERMES AGENT IS NOT ENOUGH ANYMORE
The real move is turning Herme
2026-06-12 22:30:22,236 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for '"Hermes Agent"'
2026-06-12 22:30:22,898 - TwitterScraper - INFO - New tweet/X post: Hermes Agent now has a production-grade WhatsApp Business Cloud integr
2026-06-12 22:30:24,866 - TwitterScraper - INFO - New tweet/X post: Love hearing stories like this!
I want to hear more, what are you bui
2026-06-12 22:30:29,379 - TwitterScraper - INFO - New tweet/X post: @Teknium @pocarles This is a relief because I fucking love Hermes Agen
2026-06-12 22:30:29,736 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'multica'
2026-06-12 22:30:33,175 - TwitterScraper - INFO - New tweet/X post: Multica is built for looping!
https://github.com/multica-ai/multica/
2026-06-12 22:30:35,602 - TwitterScraper - INFO - Twitter scrape complete. Found 5 new results.
2026-06-12 22:30:35,603 - LinkedInScraper - INFO - Searching LinkedIn (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-12 22:30:36,137 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'paperclip'
2026-06-12 22:30:37,341 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for '"Hermes Agent"'
2026-06-12 22:30:37,707 - LinkedInScraper - INFO - New LinkedIn post: Hermes Agent Free Runs Claude, Browser Tasks, And Files - LinkedIn
2026-06-12 22:30:38,799 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'multica'
2026-06-12 22:30:39,506 - LinkedInScraper - INFO - LinkedIn scrape complete. Found 1 new results.
2026-06-12 22:30:39,507 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)
2026-06-12 22:30:39,940 - LinkedInFeedScraper - INFO - Successfully auto-grabbed fresh LinkedIn cookies and User-Agent from running Chrome!
2026-06-12 22:30:50,521 - LinkedInFeedScraper - INFO - New LinkedIn feed post: David Genger - Natural language is the new programming language.
Natural language is hard.
You are not getting fi
2026-06-12 22:30:50,536 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Martin Schwartz - Hereโ€™s a crazy thought:
Friday is now technically integrated with almost every platform out there.
2026-06-12 22:30:50,544 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Moshe Meisner - Our social media manager posted this today on Instagram and Facebook.
When I saw this post it made
2026-06-12 22:30:50,560 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Priya Markand - My 2 cents before the week...ends. :)
2026-06-12 22:30:50,569 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Muhammad Yousaf - ๐Ÿ’ก Building With Initiatives & Creativity! ๐Ÿคฏ
To maximize small spaces, focus on smart space managemen
2026-06-12 22:30:50,585 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Abdul Samad - Is your team shipping code faster with AI, but not seeing product improvements at the same pace? You
2026-06-12 22:30:50,600 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Radoslav Krehlik - Jack Dorseyโ€™s company Block built **Goose**, a powerful local AI agent that goes far beyond code sug
2026-06-12 22:30:50,608 - LinkedInFeedScraper - INFO - New LinkedIn feed post: James M. Janzen - Another opinion about the Iran conflict
2026-06-12 22:30:50,616 - LinkedInFeedScraper - INFO - New LinkedIn feed post: DevOpsChat - AWS Unfurls Open Source AI Agent to Enable Better AI Coding Outcomes: AWS has introduced an innovati
2026-06-12 22:30:50,625 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Yeshaya Kraus - (shared with permission, identifying information removed)
"My son just told me that he started ther
2026-06-12 22:30:50,635 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Peter Guagenti - For decades, developers have relied almost entirely on human communities like Reddit, Inc., GitHub,
2026-06-12 22:30:50,644 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Abhishek Ray - Andrej Karpathy said recently that he's never felt more behind as a programmer.
Coming from him, th
2026-06-12 22:30:50,651 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Akiva Wasser - What could make the spies change from great men to sowers of mistrust in G-d in just a short time?
2026-06-12 22:30:50,651 - LinkedInFeedScraper - INFO - LinkedIn Feed scrape complete. Found 13 new posts.
2026-06-12 22:30:51,752 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-12 22:30:51,781 - GitHubScraper - INFO - Found 237 GitHub repositories for term: paperclip
2026-06-12 22:30:52,969 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-12 22:30:52,973 - GitHubScraper - INFO - Found 355 GitHub repositories for term: "Hermes Agent"
2026-06-12 22:30:53,975 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-12 22:30:53,979 - GitHubScraper - INFO - Found 50 GitHub repositories for term: multica
2026-06-12 22:30:54,137 - GitHubScraper - INFO - Total GitHub results found: 0
2026-06-12 22:30:54,137 - __main__ - INFO - Scraper reddit completed: 8 results
2026-06-12 22:30:54,137 - __main__ - INFO - Scraper github completed: 0 results
2026-06-12 22:30:54,138 - __main__ - INFO - Scraper twitter completed: 5 results
2026-06-12 22:30:54,138 - __main__ - INFO - Scraper linkedin completed: 1 results
2026-06-12 22:30:54,138 - __main__ - INFO - Scraper linkedin_feed completed: 13 results
2026-06-12 22:30:54,799 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-12 22:30:54.799137
2026-06-12 22:30:54,799 - __main__ - INFO - Email sent successfully
2026-06-12 22:30:54,799 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-12 22:30:54,799 - __main__ - INFO - Monitor complete. Found 27 total results: 8 new reddit results, 5 new twitter results, 1 new linkedin results, 13 new linkedin feed results.
2026-06-12 22:30:54,799 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-12 22:30:54,800 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-12 22:30:54,902 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-12 22:30:54,903 - __main__ - INFO - Closed all database connections
2026-06-12 22:30:54,904 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-12 22:30:54,904 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-12 23:00:02,331 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-12.log
2026-06-12 23:00:02,331 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-12.log
2026-06-12 23:00:02,331 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-12.log
2026-06-12 23:00:02,331 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-12 23:00:02,357 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-12 23:00:02,357 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-12 23:00:02,359 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-12 23:00:02,359 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-12 23:00:02,371 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-12 23:00:02,371 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-12 23:00:02,419 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-12 23:00:02,421 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-12 23:00:02,421 - __main__ - INFO - RSS scraper initialized and enabled
2026-06-12 23:00:02,427 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-12 23:00:02,429 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-12 23:00:02,429 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-06-12 23:00:02,436 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-12 23:00:02,447 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-12 23:00:02,447 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=5
2026-06-12 23:00:02,452 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-12 23:00:02,452 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-12 23:00:02,452 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-12 23:00:02,452 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-06-12 23:00:02,452 - __main__ - INFO - Running 3 scrapers concurrently...
2026-06-12 23:00:02,453 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-06-12 23:00:02,548 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-06-12 23:00:02,552 - IveltScraper - INFO - Loaded 181 include, 0 exclude filters from DB topic_filters
2026-06-12 23:00:02,552 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-06-12 23:00:02,553 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-06-12 23:00:02,844 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-06-12 23:00:03,371 - RSSFeedScraper - INFO - Total RSS/HTML results: 3
2026-06-12 23:00:06,733 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-06-12 23:00:06,955 - Yiddish24Scraper - INFO - Received response with 468667 characters
2026-06-12 23:00:06,958 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (306511 chars)
2026-06-12 23:00:06,961 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-06-12 23:00:07,056 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-06-12 23:00:07,098 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-06-12 23:00:07,098 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-06-12 23:00:08,103 - Yiddish24Scraper - INFO - Page 1 summary: 1 new out of 100 total articles
2026-06-12 23:00:08,104 - Yiddish24Scraper - INFO - Page 1: 1/100 new items
2026-06-12 23:00:08,104 - Yiddish24Scraper - INFO - Low new item ratio (1.0%), stopping pagination
2026-06-12 23:00:08,104 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 1
2026-06-12 23:00:14,275 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-06-12 23:00:34,199 - IveltScraper - INFO - Filtering post containing exclude term: '*ื‘ื™ื˜ืข ืžืื›ื˜ ื–ื™ื›ืขืจ ื‘ืœื•ื™ื– ืฆื• ื‘ืืจื™ื›ื˜ืŸ ืงืจืื ื˜ืข ื ื™ื™ืขืก*'
2026-06-12 23:00:38,898 - IveltScraper - INFO - Filtering post containing exclude term: '*ื‘ื™ื˜ืข ืžืื›ื˜ ื–ื™ื›ืขืจ ื‘ืœื•ื™ื– ืฆื• ื‘ืืจื™ื›ื˜ืŸ ืงืจืื ื˜ืข ื ื™ื™ืขืก*'
2026-06-12 23:00:54,824 - IveltScraper - INFO - ivelt scrape complete. Checked 8 topics.
2026-06-12 23:00:54,824 - IveltScraper - INFO - All forums scrape complete. Found 18 new posts.
2026-06-12 23:00:54,825 - __main__ - INFO - Scraper rss completed: 3 results
2026-06-12 23:00:54,825 - __main__ - INFO - Scraper yiddish24 completed: 1 results
2026-06-12 23:00:54,825 - __main__ - INFO - Scraper ivelt completed: 18 results
2026-06-12 23:00:55,570 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-12 23:00:55.570556
2026-06-12 23:00:55,570 - __main__ - INFO - Email sent successfully
2026-06-12 23:00:55,571 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-12 23:00:55,571 - __main__ - INFO - Monitor complete. Found 22 total results: 3 new rss results, 1 new yiddish24 results, 18 new ivelt results.
2026-06-12 23:00:55,571 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-12 23:00:55,571 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-12 23:00:55,685 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-12 23:00:55,685 - __main__ - INFO - Closed all database connections
2026-06-12 23:00:55,687 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-12 23:00:55,687 - social_media_monitor.database.connection - INFO - Closed 0 database connections