โ† Logs

social_media_monitor_2026-06-27.log

2026-06-27 20:00:04,884 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0
2026-06-27 20:02:02,870 - IveltScraper - ERROR - FlareSolverr error: Error: Error solving the challenge. Timeout after 120.0 seconds. (attempt 1)
2026-06-27 20:02:02,871 - IveltScraper - INFO - Retrying in 3s...
2026-06-27 20:02:18,045 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-06-27 20:02:28,601 - IveltScraper - INFO - Filtering post containing exclude term: '*ื‘ื™ื˜ืข ืžืื›ื˜ ื–ื™ื›ืขืจ ื‘ืœื•ื™ื– ืฆื• ื‘ืืจื™ื›ื˜ืŸ ืงืจืื ื˜ืข ื ื™ื™ืขืก*'
2026-06-27 20:02:29,162 - IveltScraper - INFO - ivelt scrape complete. Checked 3 topics.
2026-06-27 20:02:29,162 - IveltScraper - INFO - All forums scrape complete. Found 0 new posts.
2026-06-27 20:02:29,162 - __main__ - INFO - Scraper rss completed: 4 results
2026-06-27 20:02:29,163 - __main__ - INFO - Scraper yiddish24 completed: 0 results
2026-06-27 20:02:29,163 - __main__ - INFO - Scraper ivelt completed: 0 results
2026-06-27 20:02:30,045 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-27 20:02:30.045456
2026-06-27 20:02:30,045 - __main__ - INFO - Email sent successfully
2026-06-27 20:02:30,046 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-27 20:02:30,046 - __main__ - INFO - Monitor complete. Found 4 total results: 4 new rss results.
2026-06-27 20:02:30,046 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-27 20:02:30,046 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-27 20:02:30,093 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-27 20:02:30,093 - __main__ - INFO - Closed all database connections
2026-06-27 20:02:30,095 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-27 20:02:30,096 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-27 20:30:02,595 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-27.log
2026-06-27 20:30:02,596 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-27.log
2026-06-27 20:30:02,596 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-27.log
2026-06-27 20:30:02,596 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-27 20:30:02,621 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-27 20:30:02,621 - social_media_monitor.config.settings - WARNING - Twitter monitoring enabled but credentials validation not implemented
2026-06-27 20:30:02,621 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-27 20:30:02,623 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-27 20:30:02,624 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-27 20:30:02,643 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-27 20:30:02,643 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-27 20:30:02,692 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-27 20:30:02,693 - __main__ - INFO - GitHub scraper initialized and enabled
2026-06-27 20:30:02,693 - __main__ - INFO - GitHub feed scraper initialized and enabled
2026-06-27 20:30:02,694 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-27 20:30:02,694 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled
2026-06-27 20:30:02,701 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-27 20:30:02,701 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-27 20:30:02,706 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-27 20:30:02,712 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-27 20:30:02,712 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=10
2026-06-27 20:30:02,714 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-27 20:30:02,714 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-27 20:30:02,715 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-27 20:30:02,715 - __main__ - INFO - Running 3 scrapers concurrently...
2026-06-27 20:30:02,715 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-27 20:30:02,816 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)
2026-06-27 20:31:03,076 - LinkedInFeedScraper - ERROR - LinkedIn cookie auto-grab from Chrome (port 9224) failed: Message: session not created: cannot connect to chrome at 127.0.0.1:9224
from chrome not reachable; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5fcf293f33da <unknown>
#1 0x5fcf28dd4ef0 <unknown>
#2 0x5fcf28dc076c <unknown>
#3 0x5fcf28e18b3e <unknown>
#4 0x5fcf28e0dca1 <unknown>
#5 0x5fcf28e5dd96 <unknown>
#6 0x5fcf28e5d47c <unknown>
#7 0x5fcf28e1ce4f <unknown>
#8 0x5fcf28e1dc31 <unknown>
#9 0x5fcf293b99f7 <unknown>
#10 0x5fcf293b8203 <unknown>
#11 0x5fcf293a2f16 <unknown>
#12 0x5fcf293b8d9a <unknown>
#13 0x5fcf2938aeb0 <unknown>
#14 0x5fcf293dfd58 <unknown>
#15 0x5fcf293dfef5 <unknown>
#16 0x5fcf293f1f5e <unknown>
#17 0x731f99c9caa4 <unknown>
#18 0x731f99d29c6c <unknown>
2026-06-27 20:31:03,077 - LinkedInFeedScraper - ERROR - LinkedIn cookies not configured (li_at / JSESSIONID)
2026-06-27 20:31:03,085 - LinkedInFeedScraper - INFO - LinkedIn Feed scrape complete. Found 0 new posts.
2026-06-27 20:31:04,011 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-27 20:31:04,026 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"
2026-06-27 20:31:04,036 - GitHubScraper - INFO - Found 242 GitHub repositories for term: paperclip
2026-06-27 20:31:05,174 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-27 20:31:05,268 - GitHubScraper - INFO - Found 405 GitHub repositories for term: "Hermes Agent"
2026-06-27 20:31:05,686 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"
2026-06-27 20:31:06,085 - GitHubScraper - INFO - GitHub feed: 152 fetched across pages, 0 new events for abeperl
2026-06-27 20:31:06,449 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-27 20:31:06,452 - GitHubScraper - INFO - Found 54 GitHub repositories for term: multica
2026-06-27 20:31:06,583 - GitHubScraper - INFO - Total GitHub results found: 0
2026-06-27 20:31:06,583 - __main__ - INFO - Scraper github completed: 0 results
2026-06-27 20:31:06,583 - __main__ - INFO - Scraper github_feed completed: 0 results
2026-06-27 20:31:06,583 - __main__ - INFO - Scraper linkedin_feed completed: 0 results
2026-06-27 20:31:06,584 - __main__ - WARNING - LinkedIn Feed: 6 consecutive failures (0 results)
2026-06-27 20:31:06,584 - __main__ - INFO - No new results found across all enabled sources
2026-06-27 20:31:06,584 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-27 20:31:06,584 - __main__ - INFO - Monitor complete. No new results found across all sources.
2026-06-27 20:31:06,584 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-27 20:31:06,584 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-27 20:31:06,666 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-27 20:31:06,667 - __main__ - INFO - Closed all database connections
2026-06-27 20:31:06,668 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-27 20:31:06,669 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-27 21:00:02,275 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-27.log
2026-06-27 21:00:02,275 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-27.log
2026-06-27 21:00:02,275 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-27.log
2026-06-27 21:00:02,275 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-27 21:00:02,301 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-27 21:00:02,302 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-27 21:00:02,304 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-27 21:00:02,304 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-27 21:00:02,318 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-27 21:00:02,318 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-27 21:00:02,320 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-27 21:00:02,321 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-27 21:00:02,321 - __main__ - INFO - RSS scraper initialized and enabled
2026-06-27 21:00:02,323 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-27 21:00:02,323 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-27 21:00:02,324 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-06-27 21:00:02,326 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-27 21:00:02,330 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-27 21:00:02,330 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=10
2026-06-27 21:00:02,332 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-27 21:00:02,332 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-27 21:00:02,333 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-27 21:00:02,333 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-06-27 21:00:02,333 - __main__ - INFO - Running 3 scrapers concurrently...
2026-06-27 21:00:02,333 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-06-27 21:00:02,419 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-06-27 21:00:02,424 - IveltScraper - INFO - Loaded 181 include, 0 exclude filters from DB topic_filters
2026-06-27 21:00:02,424 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-06-27 21:00:02,425 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-06-27 21:00:02,700 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-06-27 21:00:03,334 - RSSFeedScraper - INFO - Total RSS/HTML results: 3
2026-06-27 21:00:03,723 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-06-27 21:00:03,924 - Yiddish24Scraper - INFO - Received response with 449641 characters
2026-06-27 21:00:03,926 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (300482 chars)
2026-06-27 21:00:03,929 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-06-27 21:00:04,024 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-06-27 21:00:04,065 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-06-27 21:00:04,065 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-06-27 21:00:04,862 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 100 total articles
2026-06-27 21:00:04,862 - Yiddish24Scraper - INFO - Page 1: 0/100 new items
2026-06-27 21:00:04,862 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination
2026-06-27 21:00:04,863 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0
2026-06-27 21:02:08,834 - IveltScraper - ERROR - FlareSolverr error: Error: Error solving the challenge. Timeout after 120.0 seconds. (attempt 1)
2026-06-27 21:02:08,834 - IveltScraper - INFO - Retrying in 3s...
2026-06-27 21:04:12,465 - IveltScraper - ERROR - FlareSolverr error: Error: Error solving the challenge. Timeout after 120.0 seconds. (attempt 2)
2026-06-27 21:04:12,465 - IveltScraper - INFO - FlareSolverr failed, trying curl_cffi cookie fallback...
2026-06-27 21:04:12,465 - IveltScraper - WARNING - No cf_clearance cookie set โ€” skipping curl_cffi fallback
2026-06-27 21:04:12,466 - IveltScraper - ERROR - Failed to fetch ivelt active topics page
2026-06-27 21:04:12,466 - IveltScraper - INFO - All forums scrape complete. Found 0 new posts.
2026-06-27 21:04:12,466 - __main__ - INFO - Scraper rss completed: 3 results
2026-06-27 21:04:12,466 - __main__ - INFO - Scraper yiddish24 completed: 0 results
2026-06-27 21:04:12,466 - __main__ - INFO - Scraper ivelt completed: 0 results
2026-06-27 21:04:13,316 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-27 21:04:13.316019
2026-06-27 21:04:13,316 - __main__ - INFO - Email sent successfully
2026-06-27 21:04:13,316 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-27 21:04:13,316 - __main__ - INFO - Monitor complete. Found 3 total results: 3 new rss results.
2026-06-27 21:04:13,316 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-27 21:04:13,316 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-27 21:04:13,356 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-27 21:04:13,356 - __main__ - INFO - Closed all database connections
2026-06-27 21:04:13,358 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-27 21:04:13,358 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-27 21:30:01,908 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-27.log
2026-06-27 21:30:01,908 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-27.log
2026-06-27 21:30:01,908 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-27.log
2026-06-27 21:30:01,908 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-27 21:30:01,934 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-27 21:30:01,934 - social_media_monitor.config.settings - WARNING - Twitter monitoring enabled but credentials validation not implemented
2026-06-27 21:30:01,934 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-27 21:30:01,936 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-27 21:30:01,937 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-27 21:30:01,954 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-27 21:30:01,954 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-27 21:30:01,956 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-27 21:30:01,957 - __main__ - INFO - GitHub scraper initialized and enabled
2026-06-27 21:30:01,957 - __main__ - INFO - GitHub feed scraper initialized and enabled
2026-06-27 21:30:01,958 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-27 21:30:01,958 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled
2026-06-27 21:30:01,960 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-27 21:30:01,960 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-27 21:30:01,966 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-27 21:30:01,970 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-27 21:30:01,970 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=10
2026-06-27 21:30:01,973 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-27 21:30:01,973 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-27 21:30:01,973 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-27 21:30:01,973 - __main__ - INFO - Running 3 scrapers concurrently...
2026-06-27 21:30:01,973 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-27 21:30:02,073 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)
2026-06-27 21:31:02,223 - LinkedInFeedScraper - ERROR - LinkedIn cookie auto-grab from Chrome (port 9224) failed: Message: session not created: cannot connect to chrome at 127.0.0.1:9224
from chrome not reachable; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x647e05c0c3da <unknown>
#1 0x647e055edef0 <unknown>
#2 0x647e055d976c <unknown>
#3 0x647e05631b3e <unknown>
#4 0x647e05626ca1 <unknown>
#5 0x647e05676d96 <unknown>
#6 0x647e0567647c <unknown>
#7 0x647e05635e4f <unknown>
#8 0x647e05636c31 <unknown>
#9 0x647e05bd29f7 <unknown>
#10 0x647e05bd1203 <unknown>
#11 0x647e05bbbf16 <unknown>
#12 0x647e05bd1d9a <unknown>
#13 0x647e05ba3eb0 <unknown>
#14 0x647e05bf8d58 <unknown>
#15 0x647e05bf8ef5 <unknown>
#16 0x647e05c0af5e <unknown>
#17 0x7c8f4c89caa4 <unknown>
#18 0x7c8f4c929c6c <unknown>
2026-06-27 21:31:02,224 - LinkedInFeedScraper - ERROR - LinkedIn cookies not configured (li_at / JSESSIONID)
2026-06-27 21:31:02,232 - LinkedInFeedScraper - INFO - LinkedIn Feed scrape complete. Found 0 new posts.
2026-06-27 21:31:03,195 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"
2026-06-27 21:31:03,871 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-27 21:31:03,876 - GitHubScraper - INFO - Found 242 GitHub repositories for term: paperclip
2026-06-27 21:31:04,586 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"
2026-06-27 21:31:04,926 - GitHubScraper - INFO - GitHub feed: 152 fetched across pages, 0 new events for abeperl
2026-06-27 21:31:04,928 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-27 21:31:04,969 - GitHubScraper - INFO - Found 405 GitHub repositories for term: "Hermes Agent"
2026-06-27 21:31:05,793 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-27 21:31:05,796 - GitHubScraper - INFO - Found 54 GitHub repositories for term: multica
2026-06-27 21:31:05,926 - GitHubScraper - INFO - Total GitHub results found: 0
2026-06-27 21:31:05,926 - __main__ - INFO - Scraper github completed: 0 results
2026-06-27 21:31:05,926 - __main__ - INFO - Scraper github_feed completed: 0 results
2026-06-27 21:31:05,926 - __main__ - INFO - Scraper linkedin_feed completed: 0 results
2026-06-27 21:31:05,927 - __main__ - WARNING - LinkedIn Feed: 7 consecutive failures (0 results)
2026-06-27 21:31:05,927 - __main__ - INFO - No new results found across all enabled sources
2026-06-27 21:31:05,927 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-27 21:31:05,927 - __main__ - INFO - Monitor complete. No new results found across all sources.
2026-06-27 21:31:05,927 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-27 21:31:05,927 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-27 21:31:05,973 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-27 21:31:05,973 - __main__ - INFO - Closed all database connections
2026-06-27 21:31:05,974 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-27 21:31:05,974 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-27 22:00:02,505 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-27.log
2026-06-27 22:00:02,505 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-27.log
2026-06-27 22:00:02,505 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-27.log
2026-06-27 22:00:02,505 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-27 22:00:02,531 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-27 22:00:02,531 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-27 22:00:02,534 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-27 22:00:02,534 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-27 22:00:02,555 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-27 22:00:02,556 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-27 22:00:02,603 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-27 22:00:02,604 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-27 22:00:02,604 - __main__ - INFO - RSS scraper initialized and enabled
2026-06-27 22:00:02,607 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-27 22:00:02,607 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-27 22:00:02,607 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-06-27 22:00:02,610 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-27 22:00:02,614 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-27 22:00:02,614 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=10
2026-06-27 22:00:02,617 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-27 22:00:02,617 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-27 22:00:02,617 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-27 22:00:02,617 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-06-27 22:00:02,617 - __main__ - INFO - Running 3 scrapers concurrently...
2026-06-27 22:00:02,617 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-06-27 22:00:02,704 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-06-27 22:00:02,709 - IveltScraper - INFO - Loaded 181 include, 0 exclude filters from DB topic_filters
2026-06-27 22:00:02,709 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-06-27 22:00:02,710 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-06-27 22:00:02,927 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-06-27 22:00:03,300 - RSSFeedScraper - INFO - Total RSS/HTML results: 3
2026-06-27 22:00:03,685 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-06-27 22:00:03,900 - Yiddish24Scraper - INFO - Received response with 449641 characters
2026-06-27 22:00:03,902 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (300482 chars)
2026-06-27 22:00:03,904 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-06-27 22:00:04,000 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-06-27 22:00:04,043 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-06-27 22:00:04,043 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-06-27 22:00:04,709 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 100 total articles
2026-06-27 22:00:04,710 - Yiddish24Scraper - INFO - Page 1: 0/100 new items
2026-06-27 22:00:04,710 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination
2026-06-27 22:00:04,710 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0
2026-06-27 22:00:14,704 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-06-27 22:00:22,053 - IveltScraper - INFO - ivelt scrape complete. Checked 2 topics.
2026-06-27 22:00:22,053 - IveltScraper - INFO - All forums scrape complete. Found 0 new posts.
2026-06-27 22:00:22,054 - __main__ - INFO - Scraper rss completed: 3 results
2026-06-27 22:00:22,054 - __main__ - INFO - Scraper yiddish24 completed: 0 results
2026-06-27 22:00:22,054 - __main__ - INFO - Scraper ivelt completed: 0 results
2026-06-27 22:00:22,877 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-27 22:00:22.877181
2026-06-27 22:00:22,877 - __main__ - INFO - Email sent successfully
2026-06-27 22:00:22,877 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-27 22:00:22,878 - __main__ - INFO - Monitor complete. Found 3 total results: 3 new rss results.
2026-06-27 22:00:22,878 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-27 22:00:22,878 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-27 22:00:22,974 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-27 22:00:22,974 - __main__ - INFO - Closed all database connections
2026-06-27 22:00:22,976 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-27 22:00:22,976 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-27 22:30:02,550 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-27.log
2026-06-27 22:30:02,550 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-27.log
2026-06-27 22:30:02,551 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-27.log
2026-06-27 22:30:02,551 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-27 22:30:02,578 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-27 22:30:02,579 - social_media_monitor.config.settings - WARNING - Twitter monitoring enabled but credentials validation not implemented
2026-06-27 22:30:02,579 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-27 22:30:02,581 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-27 22:30:02,582 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-27 22:30:02,595 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-27 22:30:02,596 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-27 22:30:02,598 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-27 22:30:02,598 - __main__ - INFO - GitHub scraper initialized and enabled
2026-06-27 22:30:02,598 - __main__ - INFO - GitHub feed scraper initialized and enabled
2026-06-27 22:30:02,599 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-27 22:30:02,599 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled
2026-06-27 22:30:02,602 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-27 22:30:02,602 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-27 22:30:02,604 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-27 22:30:02,609 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-27 22:30:02,609 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=10
2026-06-27 22:30:02,611 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-27 22:30:02,612 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-27 22:30:02,612 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-27 22:30:02,612 - __main__ - INFO - Running 3 scrapers concurrently...
2026-06-27 22:30:02,612 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-27 22:30:02,717 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)
2026-06-27 22:31:03,001 - LinkedInFeedScraper - ERROR - LinkedIn cookie auto-grab from Chrome (port 9224) failed: Message: session not created: cannot connect to chrome at 127.0.0.1:9224
from chrome not reachable; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5fc06c8283da <unknown>
#1 0x5fc06c209ef0 <unknown>
#2 0x5fc06c1f576c <unknown>
#3 0x5fc06c24db3e <unknown>
#4 0x5fc06c242ca1 <unknown>
#5 0x5fc06c292d96 <unknown>
#6 0x5fc06c29247c <unknown>
#7 0x5fc06c251e4f <unknown>
#8 0x5fc06c252c31 <unknown>
#9 0x5fc06c7ee9f7 <unknown>
#10 0x5fc06c7ed203 <unknown>
#11 0x5fc06c7d7f16 <unknown>
#12 0x5fc06c7edd9a <unknown>
#13 0x5fc06c7bfeb0 <unknown>
#14 0x5fc06c814d58 <unknown>
#15 0x5fc06c814ef5 <unknown>
#16 0x5fc06c826f5e <unknown>
#17 0x7ca11b69caa4 <unknown>
#18 0x7ca11b729c6c <unknown>
2026-06-27 22:31:03,001 - LinkedInFeedScraper - ERROR - LinkedIn cookies not configured (li_at / JSESSIONID)
2026-06-27 22:31:03,010 - LinkedInFeedScraper - INFO - LinkedIn Feed scrape complete. Found 0 new posts.
2026-06-27 22:31:03,919 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-27 22:31:03,943 - GitHubScraper - INFO - Found 242 GitHub repositories for term: paperclip
2026-06-27 22:31:04,102 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"
2026-06-27 22:31:05,326 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-27 22:31:05,419 - GitHubScraper - INFO - Found 405 GitHub repositories for term: "Hermes Agent"
2026-06-27 22:31:05,607 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"
2026-06-27 22:31:05,980 - GitHubScraper - INFO - GitHub feed: 153 fetched across pages, 6 new events for abeperl
2026-06-27 22:31:06,440 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-27 22:31:06,442 - GitHubScraper - INFO - Found 54 GitHub repositories for term: multica
2026-06-27 22:31:06,582 - GitHubScraper - INFO - Total GitHub results found: 0
2026-06-27 22:31:06,582 - __main__ - INFO - Scraper github completed: 0 results
2026-06-27 22:31:06,582 - __main__ - INFO - Scraper github_feed completed: 6 results
2026-06-27 22:31:06,582 - __main__ - INFO - Scraper linkedin_feed completed: 0 results
2026-06-27 22:31:06,583 - __main__ - WARNING - LinkedIn Feed: 8 consecutive failures (0 results)
2026-06-27 22:31:07,395 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-27 22:31:07.395081
2026-06-27 22:31:07,395 - __main__ - INFO - Email sent successfully
2026-06-27 22:31:07,395 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-27 22:31:07,395 - __main__ - INFO - Monitor complete. Found 6 total results: 6 new github feed results.
2026-06-27 22:31:07,395 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-27 22:31:07,396 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-27 22:31:07,444 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-27 22:31:07,445 - __main__ - INFO - Closed all database connections
2026-06-27 22:31:07,446 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-27 22:31:07,447 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-27 23:00:02,076 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-27.log
2026-06-27 23:00:02,076 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-27.log
2026-06-27 23:00:02,076 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-27.log
2026-06-27 23:00:02,076 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-27 23:00:02,109 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-27 23:00:02,109 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-27 23:00:02,111 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-27 23:00:02,112 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-27 23:00:02,128 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-27 23:00:02,129 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-27 23:00:02,132 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-27 23:00:02,133 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-27 23:00:02,133 - __main__ - INFO - RSS scraper initialized and enabled
2026-06-27 23:00:02,138 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-27 23:00:02,138 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-27 23:00:02,138 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-06-27 23:00:02,141 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-27 23:00:02,147 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-27 23:00:02,147 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=10
2026-06-27 23:00:02,150 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-27 23:00:02,150 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-27 23:00:02,150 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-27 23:00:02,150 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-06-27 23:00:02,150 - __main__ - INFO - Running 3 scrapers concurrently...
2026-06-27 23:00:02,150 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-06-27 23:00:02,256 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-06-27 23:00:02,263 - IveltScraper - INFO - Loaded 181 include, 0 exclude filters from DB topic_filters
2026-06-27 23:00:02,263 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-06-27 23:00:02,266 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-06-27 23:00:02,513 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-06-27 23:00:02,901 - RSSFeedScraper - INFO - Total RSS/HTML results: 3
2026-06-27 23:00:03,333 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-06-27 23:00:03,546 - Yiddish24Scraper - INFO - Received response with 449641 characters
2026-06-27 23:00:03,549 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (300482 chars)
2026-06-27 23:00:03,551 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-06-27 23:00:03,628 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-06-27 23:00:03,668 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-06-27 23:00:03,669 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-06-27 23:00:04,433 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 100 total articles
2026-06-27 23:00:04,433 - Yiddish24Scraper - INFO - Page 1: 0/100 new items
2026-06-27 23:00:04,433 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination
2026-06-27 23:00:04,433 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0
2026-06-27 23:00:14,273 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-06-27 23:00:17,886 - IveltScraper - INFO - ivelt scrape complete. Checked 1 topics.
2026-06-27 23:00:17,887 - IveltScraper - INFO - All forums scrape complete. Found 0 new posts.
2026-06-27 23:00:17,887 - __main__ - INFO - Scraper rss completed: 3 results
2026-06-27 23:00:17,887 - __main__ - INFO - Scraper yiddish24 completed: 0 results
2026-06-27 23:00:17,887 - __main__ - INFO - Scraper ivelt completed: 0 results
2026-06-27 23:00:18,803 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-27 23:00:18.802939
2026-06-27 23:00:18,803 - __main__ - INFO - Email sent successfully
2026-06-27 23:00:18,803 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-27 23:00:18,803 - __main__ - INFO - Monitor complete. Found 3 total results: 3 new rss results.
2026-06-27 23:00:18,803 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-27 23:00:18,803 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-27 23:00:18,840 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-27 23:00:18,840 - __main__ - INFO - Closed all database connections
2026-06-27 23:00:18,842 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-27 23:00:18,842 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-27 23:30:02,277 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-27.log
2026-06-27 23:30:02,277 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-27.log
2026-06-27 23:30:02,277 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-27.log
2026-06-27 23:30:02,278 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-27 23:30:02,303 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-27 23:30:02,303 - social_media_monitor.config.settings - WARNING - Twitter monitoring enabled but credentials validation not implemented
2026-06-27 23:30:02,303 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-27 23:30:02,306 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-27 23:30:02,308 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-27 23:30:02,324 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-27 23:30:02,324 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-27 23:30:02,373 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-27 23:30:02,373 - __main__ - INFO - GitHub scraper initialized and enabled
2026-06-27 23:30:02,373 - __main__ - INFO - GitHub feed scraper initialized and enabled
2026-06-27 23:30:02,374 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-27 23:30:02,374 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled
2026-06-27 23:30:02,378 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-27 23:30:02,378 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-27 23:30:02,380 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-27 23:30:02,385 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-27 23:30:02,385 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=10
2026-06-27 23:30:02,387 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-27 23:30:02,387 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-27 23:30:02,387 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-27 23:30:02,388 - __main__ - INFO - Running 3 scrapers concurrently...
2026-06-27 23:30:02,388 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-27 23:30:02,485 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)
2026-06-27 23:31:02,768 - LinkedInFeedScraper - ERROR - LinkedIn cookie auto-grab from Chrome (port 9224) failed: Message: session not created: cannot connect to chrome at 127.0.0.1:9224
from chrome not reachable; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x592a583573da <unknown>
#1 0x592a57d38ef0 <unknown>
#2 0x592a57d2476c <unknown>
#3 0x592a57d7cb3e <unknown>
#4 0x592a57d71ca1 <unknown>
#5 0x592a57dc1d96 <unknown>
#6 0x592a57dc147c <unknown>
#7 0x592a57d80e4f <unknown>
#8 0x592a57d81c31 <unknown>
#9 0x592a5831d9f7 <unknown>
#10 0x592a5831c203 <unknown>
#11 0x592a58306f16 <unknown>
#12 0x592a5831cd9a <unknown>
#13 0x592a582eeeb0 <unknown>
#14 0x592a58343d58 <unknown>
#15 0x592a58343ef5 <unknown>
#16 0x592a58355f5e <unknown>
#17 0x7e111c49caa4 <unknown>
#18 0x7e111c529c6c <unknown>
2026-06-27 23:31:02,768 - LinkedInFeedScraper - ERROR - LinkedIn cookies not configured (li_at / JSESSIONID)
2026-06-27 23:31:02,777 - LinkedInFeedScraper - INFO - LinkedIn Feed scrape complete. Found 0 new posts.
2026-06-27 23:31:03,715 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"
2026-06-27 23:31:04,401 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-27 23:31:04,404 - GitHubScraper - INFO - Found 242 GitHub repositories for term: paperclip
2026-06-27 23:31:05,033 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"
2026-06-27 23:31:05,423 - GitHubScraper - INFO - GitHub feed: 153 fetched across pages, 1 new events for abeperl
2026-06-27 23:31:05,424 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-27 23:31:05,426 - GitHubScraper - INFO - Found 405 GitHub repositories for term: "Hermes Agent"
2026-06-27 23:31:06,465 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-27 23:31:06,469 - GitHubScraper - INFO - Found 54 GitHub repositories for term: multica
2026-06-27 23:31:06,616 - GitHubScraper - INFO - Total GitHub results found: 0
2026-06-27 23:31:06,616 - __main__ - INFO - Scraper github completed: 0 results
2026-06-27 23:31:06,616 - __main__ - INFO - Scraper github_feed completed: 1 results
2026-06-27 23:31:06,616 - __main__ - INFO - Scraper linkedin_feed completed: 0 results
2026-06-27 23:31:06,617 - __main__ - WARNING - LinkedIn Feed: 9 consecutive failures (0 results)
2026-06-27 23:31:07,413 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-27 23:31:07.413246
2026-06-27 23:31:07,413 - __main__ - INFO - Email sent successfully
2026-06-27 23:31:07,413 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-27 23:31:07,414 - __main__ - INFO - Monitor complete. Found 1 total results: 1 new github feed results.
2026-06-27 23:31:07,414 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-27 23:31:07,414 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-27 23:31:07,547 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-27 23:31:07,548 - __main__ - INFO - Closed all database connections
2026-06-27 23:31:07,550 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-27 23:31:07,550 - social_media_monitor.database.connection - INFO - Closed 0 database connections