โ Logs
social_media_monitor_2026-06-29.log
2026-06-29 20:00:11,841 - Yiddish24Scraper - INFO - Page 1: 13/99 new items
2026-06-29 20:00:11,841 - Yiddish24Scraper - INFO - Low new item ratio (13.1%), stopping pagination
2026-06-29 20:00:11,841 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 13
2026-06-29 20:00:14,118 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-06-29 20:00:35,280 - IveltScraper - INFO - Filtering post containing exclude term: '*ืืืืข ืืืื ืืืืขืจ ืืืืื ืฆื ืืืจืืืื ืงืจืื ืืข ื ืืืขืก*'
2026-06-29 20:00:35,862 - IveltScraper - INFO - ivelt scrape complete. Checked 3 topics.
2026-06-29 20:00:35,862 - IveltScraper - INFO - All forums scrape complete. Found 17 new posts.
2026-06-29 20:00:35,862 - __main__ - INFO - Scraper rss completed: 4 results
2026-06-29 20:00:35,862 - __main__ - INFO - Scraper yiddish24 completed: 13 results
2026-06-29 20:00:35,862 - __main__ - INFO - Scraper ivelt completed: 17 results
2026-06-29 20:00:36,728 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-29 20:00:36.728741
2026-06-29 20:00:36,728 - __main__ - INFO - Email sent successfully
2026-06-29 20:00:36,729 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-29 20:00:36,729 - __main__ - INFO - Monitor complete. Found 34 total results: 4 new rss results, 13 new yiddish24 results, 17 new ivelt results.
2026-06-29 20:00:36,729 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-29 20:00:36,729 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-29 20:00:36,812 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-29 20:00:36,813 - __main__ - INFO - Closed all database connections
2026-06-29 20:00:36,814 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-29 20:00:36,814 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-29 20:30:02,729 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-29.log
2026-06-29 20:30:02,731 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-29.log
2026-06-29 20:30:02,731 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-29.log
2026-06-29 20:30:02,731 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-29 20:30:02,758 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-29 20:30:02,758 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-29 20:30:02,766 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-29 20:30:02,773 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-29 20:30:02,787 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-29 20:30:02,787 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-29 20:30:02,856 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-29 20:30:02,856 - __main__ - INFO - GitHub scraper initialized and enabled
2026-06-29 20:30:02,856 - __main__ - INFO - GitHub feed scraper initialized and enabled
2026-06-29 20:30:02,858 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-29 20:30:02,859 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled
2026-06-29 20:30:02,867 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-29 20:30:02,868 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-29 20:30:02,875 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-29 20:30:02,886 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-29 20:30:02,886 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=10
2026-06-29 20:30:02,891 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-29 20:30:02,891 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-29 20:30:02,892 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-29 20:30:02,892 - __main__ - INFO - Running 3 scrapers concurrently...
2026-06-29 20:30:02,892 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-29 20:30:03,032 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)
2026-06-29 20:30:03,491 - LinkedInFeedScraper - INFO - Auto-grabbed fresh LinkedIn cookies from running Chrome (fallback).
2026-06-29 20:30:14,555 - LinkedInFeedScraper - INFO - Successfully sorted fetched LinkedIn posts chronologically (most recent first)
2026-06-29 20:30:14,570 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Moishy D. - Today is the day we all remember from when we were kids.
That peak summer excitementโthe most excit
2026-06-29 20:30:14,580 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Yaakov Astor - How should investors position amid today's competing market forces? Our Senior Economist James McCan
2026-06-29 20:30:14,590 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Natan Bensoussan - Hi everyone! Iโm seeking a new role and would appreciate your support. If you hear of any opportunit
2026-06-29 20:30:14,605 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Jay Friedmann - We built Shabbify because Shopify merchants shouldn't have to choose between running their store and
2026-06-29 20:30:14,617 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Esther Walter - It's July 4 weekend!
Take advantage!
2026-06-29 20:30:14,711 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Nichy Silber - Iโve been hearing from a lot of people who recently lost their jobs. A couple of them reached out be
2026-06-29 20:30:14,721 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Sam Press - The entire face of Bahamas is about to change for the Kosher traveler.
๐ Baha Mar resorts have bee
2026-06-29 20:30:14,730 - LinkedInFeedScraper - INFO - LinkedIn Feed scrape complete. Found 7 new posts.
2026-06-29 20:30:15,565 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"
2026-06-29 20:30:16,083 - GitHubScraper - INFO - GitHub feed: 53 fetched across pages, 0 new events for abeperl
2026-06-29 20:30:16,085 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-29 20:30:16,089 - GitHubScraper - INFO - Found 242 GitHub repositories for term: paperclip
2026-06-29 20:30:17,258 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-29 20:30:17,262 - GitHubScraper - INFO - Found 407 GitHub repositories for term: "Hermes Agent"
2026-06-29 20:30:17,381 - GitHubScraper - INFO - Added new GitHub repository: metaharness
2026-06-29 20:30:18,441 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-29 20:30:18,540 - GitHubScraper - INFO - Found 55 GitHub repositories for term: multica
2026-06-29 20:30:18,701 - GitHubScraper - INFO - Total GitHub results found: 1
2026-06-29 20:30:18,701 - __main__ - INFO - Scraper github completed: 1 results
2026-06-29 20:30:18,701 - __main__ - INFO - Scraper github_feed completed: 0 results
2026-06-29 20:30:18,701 - __main__ - INFO - Scraper linkedin_feed completed: 7 results
2026-06-29 20:30:18,703 - social_media_monitor.sheets.webinar_sheets_writer - INFO - Checking 7 LinkedIn feed posts for webinar/course + Torah mentions...
2026-06-29 20:30:19,981 - social_media_monitor.sheets.webinar_sheets_writer - INFO - Loaded 51 existing URLs from sheet for dedup
2026-06-29 20:30:20,989 - social_media_monitor.sheets.webinar_sheets_writer - INFO - Loaded 11 existing links from Torah Matches sheet for dedup
2026-06-29 20:30:20,989 - social_media_monitor.sheets.webinar_sheets_writer - INFO - Torah match: Jay Friedmann - keyword 'shabbos' - https://www.linkedin.com/feed/update/urn:li:activity:7477457507095863296
2026-06-29 20:30:20,990 - social_media_monitor.sheets.webinar_sheets_writer - INFO - No webinar/course mentions found in LinkedIn feed posts
2026-06-29 20:30:21,995 - social_media_monitor.sheets.webinar_sheets_writer - INFO - Appended 1 rows to Google Sheet 'Torah Matches'
2026-06-29 20:30:21,995 - __main__ - INFO - Webinar/Course: appended 1 posts to Google Sheet
2026-06-29 20:30:22,784 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-29 20:30:22.784414
2026-06-29 20:30:22,784 - __main__ - INFO - Email sent successfully
2026-06-29 20:30:22,785 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-29 20:30:22,785 - __main__ - INFO - Monitor complete. Found 8 total results: 1 new github results, 7 new linkedin feed results.
2026-06-29 20:30:22,785 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-29 20:30:22,785 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-29 20:30:22,853 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-29 20:30:22,853 - __main__ - INFO - Closed all database connections
2026-06-29 20:30:22,855 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-29 20:30:22,855 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-29 21:00:02,458 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-29.log
2026-06-29 21:00:02,458 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-29.log
2026-06-29 21:00:02,459 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-29.log
2026-06-29 21:00:02,459 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-29 21:00:02,484 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-29 21:00:02,484 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-29 21:00:02,486 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-29 21:00:02,487 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-29 21:00:02,501 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-29 21:00:02,501 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-29 21:00:02,503 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-29 21:00:02,504 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-29 21:00:02,504 - __main__ - INFO - RSS scraper initialized and enabled
2026-06-29 21:00:02,507 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-29 21:00:02,507 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-29 21:00:02,507 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-06-29 21:00:02,509 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-29 21:00:02,514 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-29 21:00:02,514 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=10
2026-06-29 21:00:02,516 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-29 21:00:02,516 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-29 21:00:02,516 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-29 21:00:02,516 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-06-29 21:00:02,516 - __main__ - INFO - Running 3 scrapers concurrently...
2026-06-29 21:00:02,516 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-06-29 21:00:02,602 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-06-29 21:00:02,611 - IveltScraper - INFO - Loaded 181 include, 0 exclude filters from DB topic_filters
2026-06-29 21:00:02,611 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-06-29 21:00:02,612 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-06-29 21:00:02,996 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-06-29 21:00:03,482 - RSSFeedScraper - INFO - Total RSS/HTML results: 3
2026-06-29 21:00:08,020 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-06-29 21:00:08,251 - Yiddish24Scraper - INFO - Received response with 453372 characters
2026-06-29 21:00:08,254 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (295487 chars)
2026-06-29 21:00:08,258 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-06-29 21:00:08,344 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-06-29 21:00:08,386 - Yiddish24Scraper - INFO - Page 1 extraction: 99 successful, 1 failed out of 100 elements
2026-06-29 21:00:08,386 - Yiddish24Scraper - INFO - Parsed 99 articles from HTML on page 1
2026-06-29 21:00:09,190 - Yiddish24Scraper - INFO - Page 1 summary: 3 new out of 99 total articles
2026-06-29 21:00:09,191 - Yiddish24Scraper - INFO - Page 1: 3/99 new items
2026-06-29 21:00:09,191 - Yiddish24Scraper - INFO - Low new item ratio (3.0%), stopping pagination
2026-06-29 21:00:09,191 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 3
2026-06-29 21:02:09,181 - IveltScraper - INFO - FlareSolverr error: Error: Error solving the challenge. Timeout after 120.0 seconds. (attempt 1)
2026-06-29 21:02:09,181 - IveltScraper - INFO - Retrying in 3s...
2026-06-29 21:04:12,737 - IveltScraper - ERROR - FlareSolverr error: Error: Error solving the challenge. Timeout after 120.0 seconds. (attempt 2)
2026-06-29 21:04:12,737 - IveltScraper - INFO - FlareSolverr failed, trying curl_cffi cookie fallback...
2026-06-29 21:04:12,737 - IveltScraper - WARNING - No cf_clearance cookie set โ skipping curl_cffi fallback
2026-06-29 21:04:12,738 - IveltScraper - ERROR - Failed to fetch ivelt active topics page
2026-06-29 21:04:12,738 - IveltScraper - INFO - All forums scrape complete. Found 0 new posts.
2026-06-29 21:04:12,738 - __main__ - INFO - Scraper rss completed: 3 results
2026-06-29 21:04:12,738 - __main__ - INFO - Scraper yiddish24 completed: 3 results
2026-06-29 21:04:12,738 - __main__ - INFO - Scraper ivelt completed: 0 results
2026-06-29 21:04:13,743 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-29 21:04:13.743497
2026-06-29 21:04:13,743 - __main__ - INFO - Email sent successfully
2026-06-29 21:04:13,744 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-29 21:04:13,744 - __main__ - INFO - Monitor complete. Found 6 total results: 3 new rss results, 3 new yiddish24 results.
2026-06-29 21:04:13,744 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-29 21:04:13,744 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-29 21:04:13,769 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-29 21:04:13,769 - __main__ - INFO - Closed all database connections
2026-06-29 21:04:13,771 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-29 21:04:13,771 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-29 21:30:02,402 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-29.log
2026-06-29 21:30:02,402 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-29.log
2026-06-29 21:30:02,402 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-29.log
2026-06-29 21:30:02,402 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-29 21:30:02,433 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-29 21:30:02,434 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-29 21:30:02,436 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-29 21:30:02,436 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-29 21:30:02,453 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-29 21:30:02,453 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-29 21:30:02,458 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-29 21:30:02,459 - __main__ - INFO - GitHub scraper initialized and enabled
2026-06-29 21:30:02,459 - __main__ - INFO - GitHub feed scraper initialized and enabled
2026-06-29 21:30:02,460 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-29 21:30:02,461 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled
2026-06-29 21:30:02,468 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-29 21:30:02,468 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-29 21:30:02,475 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-29 21:30:02,485 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-29 21:30:02,486 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=10
2026-06-29 21:30:02,491 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-29 21:30:02,493 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-29 21:30:02,494 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-29 21:30:02,494 - __main__ - INFO - Running 3 scrapers concurrently...
2026-06-29 21:30:02,494 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-29 21:30:02,617 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)
2026-06-29 21:30:02,836 - LinkedInFeedScraper - INFO - Auto-grabbed fresh LinkedIn cookies from running Chrome (fallback).
2026-06-29 21:30:10,603 - LinkedInFeedScraper - INFO - Successfully sorted fetched LinkedIn posts chronologically (most recent first)
2026-06-29 21:30:10,614 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Effy Weissmandl - Senior Tax Accountant / Tax Manager โ Full-Time
๐ Monsey
๐ฐ Up to $150K | CPA Preferred (Not Required
2026-06-29 21:30:10,624 - LinkedInFeedScraper - INFO - New LinkedIn feed post: The School of Hard Knocks - The $1 trillion opportunity nobody is talking about!
I interviewed a private equity mogul in Niger
2026-06-29 21:30:10,636 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Moishy D. - Today is the day we all remember from when we were kids.
That peak summer excitement - the most exc
2026-06-29 21:30:10,658 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Simon Sinek - It is in our best interest to learn how to recognize the game we are in, and what it takes to lead w
2026-06-29 21:30:10,679 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Meir Greenfeld - Many people define a successful relationship by how little conflict it has.
I define it differently
2026-06-29 21:30:10,691 - LinkedInFeedScraper - INFO - New LinkedIn feed post: David Steinwurzel - We're Hiring at Asteroid Health! ๐
If you're passionate about making a difference in mental health
2026-06-29 21:30:10,743 - LinkedInFeedScraper - INFO - LinkedIn Feed scrape complete. Found 6 new posts.
2026-06-29 21:30:11,517 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"
2026-06-29 21:30:12,042 - GitHubScraper - INFO - GitHub feed: 53 fetched across pages, 0 new events for abeperl
2026-06-29 21:30:12,044 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-29 21:30:12,047 - GitHubScraper - INFO - Found 242 GitHub repositories for term: paperclip
2026-06-29 21:30:13,122 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-29 21:30:13,211 - GitHubScraper - INFO - Found 407 GitHub repositories for term: "Hermes Agent"
2026-06-29 21:30:14,496 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-29 21:30:14,499 - GitHubScraper - INFO - Found 55 GitHub repositories for term: multica
2026-06-29 21:30:14,702 - GitHubScraper - INFO - Total GitHub results found: 0
2026-06-29 21:30:14,702 - __main__ - INFO - Scraper github completed: 0 results
2026-06-29 21:30:14,702 - __main__ - INFO - Scraper github_feed completed: 0 results
2026-06-29 21:30:14,702 - __main__ - INFO - Scraper linkedin_feed completed: 6 results
2026-06-29 21:30:14,703 - social_media_monitor.sheets.webinar_sheets_writer - INFO - Checking 6 LinkedIn feed posts for webinar/course + Torah mentions...
2026-06-29 21:30:15,988 - social_media_monitor.sheets.webinar_sheets_writer - INFO - Loaded 51 existing URLs from sheet for dedup
2026-06-29 21:30:16,417 - social_media_monitor.sheets.webinar_sheets_writer - INFO - Loaded 12 existing links from Torah Matches sheet for dedup
2026-06-29 21:30:16,417 - social_media_monitor.sheets.webinar_sheets_writer - INFO - Torah match: Effy Weissmandl - keyword 'ger' - https://www.linkedin.com/feed/update/urn:li:activity:7477468847147495424
2026-06-29 21:30:16,417 - social_media_monitor.sheets.webinar_sheets_writer - INFO - Webinar/course match: The School of Hard Knocks - keyword 'lesson' - https://www.linkedin.com/feed/update/urn:li:activity:7477467398200074241
2026-06-29 21:30:16,417 - social_media_monitor.sheets.webinar_sheets_writer - INFO - Torah match: The School of Hard Knocks - keyword 'ger' - https://www.linkedin.com/feed/update/urn:li:activity:7477467398200074241
2026-06-29 21:30:16,418 - social_media_monitor.sheets.webinar_sheets_writer - INFO - Webinar/course match: Simon Sinek - keyword 'summit' - https://www.linkedin.com/feed/update/urn:li:activity:7477460454907260929
2026-06-29 21:30:17,452 - social_media_monitor.sheets.webinar_sheets_writer - INFO - Appended 2 column-G URLs to Google Sheet 'Webinar Recording DMs'
2026-06-29 21:30:19,106 - social_media_monitor.sheets.webinar_sheets_writer - INFO - Appended 2 rows to Google Sheet 'Torah Matches'
2026-06-29 21:30:19,106 - __main__ - INFO - Webinar/Course: appended 4 posts to Google Sheet
2026-06-29 21:30:19,877 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-29 21:30:19.877911
2026-06-29 21:30:19,878 - __main__ - INFO - Email sent successfully
2026-06-29 21:30:19,878 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-29 21:30:19,878 - __main__ - INFO - Monitor complete. Found 6 total results: 6 new linkedin feed results.
2026-06-29 21:30:19,878 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-29 21:30:19,878 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-29 21:30:19,930 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-29 21:30:19,930 - __main__ - INFO - Closed all database connections
2026-06-29 21:30:19,932 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-29 21:30:19,932 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-29 22:00:02,507 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-29.log
2026-06-29 22:00:02,507 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-29.log
2026-06-29 22:00:02,507 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-29.log
2026-06-29 22:00:02,507 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-29 22:00:02,532 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-29 22:00:02,532 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-29 22:00:02,534 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-29 22:00:02,535 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-29 22:00:02,548 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-29 22:00:02,548 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-29 22:00:02,594 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-29 22:00:02,595 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-29 22:00:02,595 - __main__ - INFO - RSS scraper initialized and enabled
2026-06-29 22:00:02,598 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-29 22:00:02,598 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-29 22:00:02,598 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-06-29 22:00:02,601 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-29 22:00:02,605 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-29 22:00:02,605 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=10
2026-06-29 22:00:02,607 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-29 22:00:02,607 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-29 22:00:02,608 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-29 22:00:02,608 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-06-29 22:00:02,608 - __main__ - INFO - Running 3 scrapers concurrently...
2026-06-29 22:00:02,608 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-06-29 22:00:02,699 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-06-29 22:00:02,704 - IveltScraper - INFO - Loaded 181 include, 0 exclude filters from DB topic_filters
2026-06-29 22:00:02,704 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-06-29 22:00:02,705 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-06-29 22:00:02,940 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-06-29 22:00:03,332 - RSSFeedScraper - INFO - Total RSS/HTML results: 3
2026-06-29 22:00:14,598 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-06-29 22:00:17,547 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-06-29 22:00:17,549 - Yiddish24Scraper - INFO - Received response with 16 characters
2026-06-29 22:00:17,549 - Yiddish24Scraper - WARNING - No 'result' field in JSON response
2026-06-29 22:00:17,550 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-06-29 22:00:17,550 - Yiddish24Scraper - INFO - No bulletin-news-des-row found, trying generic article containers
2026-06-29 22:00:17,551 - Yiddish24Scraper - INFO - Found 0 potential article elements on page 1
2026-06-29 22:00:17,551 - Yiddish24Scraper - INFO - Page 1 extraction: 0 successful, 0 failed out of 0 elements
2026-06-29 22:00:17,551 - Yiddish24Scraper - INFO - Parsed 0 articles from HTML on page 1
2026-06-29 22:00:17,551 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 0 total articles
2026-06-29 22:00:17,551 - Yiddish24Scraper - INFO - Page 1: 0/0 new items
2026-06-29 22:00:17,551 - Yiddish24Scraper - INFO - No more results found at page 1, stopping pagination
2026-06-29 22:00:17,551 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0
2026-06-29 22:00:43,335 - IveltScraper - INFO - ivelt scrape complete. Checked 6 topics.
2026-06-29 22:00:43,336 - IveltScraper - INFO - All forums scrape complete. Found 16 new posts.
2026-06-29 22:00:43,336 - __main__ - INFO - Scraper rss completed: 3 results
2026-06-29 22:00:43,336 - __main__ - INFO - Scraper yiddish24 completed: 0 results
2026-06-29 22:00:43,336 - __main__ - INFO - Scraper ivelt completed: 16 results
2026-06-29 22:00:44,273 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-29 22:00:44.272975
2026-06-29 22:00:44,273 - __main__ - INFO - Email sent successfully
2026-06-29 22:00:44,273 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-29 22:00:44,273 - __main__ - INFO - Monitor complete. Found 19 total results: 3 new rss results, 16 new ivelt results.
2026-06-29 22:00:44,273 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-29 22:00:44,274 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-29 22:00:44,344 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-29 22:00:44,344 - __main__ - INFO - Closed all database connections
2026-06-29 22:00:44,346 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-29 22:00:44,346 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-29 22:30:01,773 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-29.log
2026-06-29 22:30:01,773 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-29.log
2026-06-29 22:30:01,773 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-29.log
2026-06-29 22:30:01,773 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-29 22:30:01,801 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-29 22:30:01,801 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-29 22:30:01,803 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-29 22:30:01,803 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-29 22:30:01,820 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-29 22:30:01,820 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-29 22:30:01,823 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-29 22:30:01,823 - __main__ - INFO - GitHub scraper initialized and enabled
2026-06-29 22:30:01,823 - __main__ - INFO - GitHub feed scraper initialized and enabled
2026-06-29 22:30:01,823 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-29 22:30:01,824 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled
2026-06-29 22:30:01,826 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-29 22:30:01,826 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-29 22:30:01,829 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-29 22:30:01,833 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-29 22:30:01,833 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=10
2026-06-29 22:30:01,835 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-29 22:30:01,835 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-29 22:30:01,835 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-29 22:30:01,835 - __main__ - INFO - Running 3 scrapers concurrently...
2026-06-29 22:30:01,835 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-29 22:30:01,927 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)
2026-06-29 22:31:02,236 - LinkedInFeedScraper - ERROR - LinkedIn cookie auto-grab from Chrome (port 9224) failed: Message: session not created: cannot connect to chrome at 127.0.0.1:9224
from chrome not reachable; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x586e9f3523da <unknown>
#1 0x586e9ed33ef0 <unknown>
#2 0x586e9ed1f76c <unknown>
#3 0x586e9ed77b3e <unknown>
#4 0x586e9ed6cca1 <unknown>
#5 0x586e9edbcd96 <unknown>
#6 0x586e9edbc47c <unknown>
#7 0x586e9ed7be4f <unknown>
#8 0x586e9ed7cc31 <unknown>
#9 0x586e9f3189f7 <unknown>
#10 0x586e9f317203 <unknown>
#11 0x586e9f301f16 <unknown>
#12 0x586e9f317d9a <unknown>
#13 0x586e9f2e9eb0 <unknown>
#14 0x586e9f33ed58 <unknown>
#15 0x586e9f33eef5 <unknown>
#16 0x586e9f350f5e <unknown>
#17 0x7fe17369caa4 <unknown>
#18 0x7fe173729c6c <unknown>
2026-06-29 22:31:02,237 - LinkedInFeedScraper - ERROR - LinkedIn cookies not configured (li_at / JSESSIONID)
2026-06-29 22:31:02,267 - LinkedInFeedScraper - INFO - LinkedIn Feed scrape complete. Found 0 new posts.
2026-06-29 22:31:03,242 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"
2026-06-29 22:31:04,232 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-29 22:31:04,236 - GitHubScraper - INFO - Found 242 GitHub repositories for term: paperclip
2026-06-29 22:31:05,007 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"
2026-06-29 22:31:05,881 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-29 22:31:05,883 - GitHubScraper - INFO - Found 407 GitHub repositories for term: "Hermes Agent"
2026-06-29 22:31:05,906 - GitHubScraper - INFO - Added new GitHub repository: prismor
2026-06-29 22:31:06,775 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 200 OK"
2026-06-29 22:31:06,950 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-29 22:31:06,954 - GitHubScraper - INFO - Found 55 GitHub repositories for term: multica
2026-06-29 22:31:07,076 - GitHubScraper - INFO - Total GitHub results found: 1
2026-06-29 22:31:08,003 - GitHubScraper - INFO - GitHub feed: 299 fetched across pages, 293 new events for abeperl
2026-06-29 22:31:08,005 - __main__ - INFO - Scraper github completed: 1 results
2026-06-29 22:31:08,005 - __main__ - INFO - Scraper github_feed completed: 293 results
2026-06-29 22:31:08,005 - __main__ - INFO - Scraper linkedin_feed completed: 0 results
2026-06-29 22:31:08,006 - __main__ - WARNING - LinkedIn Feed: 1 consecutive failures (0 results)
2026-06-29 22:31:09,712 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-29 22:31:09.712795
2026-06-29 22:31:09,713 - __main__ - INFO - Email sent successfully
2026-06-29 22:31:09,713 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-29 22:31:09,713 - __main__ - INFO - Monitor complete. Found 294 total results: 1 new github results, 293 new github feed results.
2026-06-29 22:31:09,713 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-29 22:31:09,713 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-29 22:31:09,763 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-29 22:31:09,763 - __main__ - INFO - Closed all database connections
2026-06-29 22:31:09,765 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-29 22:31:09,765 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-29 23:00:02,292 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-29.log
2026-06-29 23:00:02,293 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-29.log
2026-06-29 23:00:02,293 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-29.log
2026-06-29 23:00:02,293 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-29 23:00:02,318 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-29 23:00:02,318 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-29 23:00:02,320 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-29 23:00:02,321 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-29 23:00:02,336 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-29 23:00:02,337 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-29 23:00:02,342 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-29 23:00:02,344 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-29 23:00:02,344 - __main__ - INFO - RSS scraper initialized and enabled
2026-06-29 23:00:02,350 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-29 23:00:02,350 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-29 23:00:02,351 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-06-29 23:00:02,357 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-29 23:00:02,368 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-29 23:00:02,368 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=10
2026-06-29 23:00:02,373 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-29 23:00:02,373 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-29 23:00:02,373 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-29 23:00:02,373 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-06-29 23:00:02,373 - __main__ - INFO - Running 3 scrapers concurrently...
2026-06-29 23:00:02,374 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-06-29 23:00:02,476 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-06-29 23:00:02,481 - IveltScraper - INFO - Loaded 181 include, 0 exclude filters from DB topic_filters
2026-06-29 23:00:02,481 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-06-29 23:00:02,482 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-06-29 23:00:02,727 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-06-29 23:00:03,081 - RSSFeedScraper - INFO - Total RSS/HTML results: 3
2026-06-29 23:00:14,592 - IveltScraper - INFO - Found 50 active topics on ivelt
2026-06-29 23:00:31,128 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-06-29 23:00:31,344 - Yiddish24Scraper - INFO - Received response with 447396 characters
2026-06-29 23:00:31,346 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (294453 chars)
2026-06-29 23:00:31,347 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-06-29 23:00:31,431 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-06-29 23:00:31,474 - Yiddish24Scraper - INFO - Page 1 extraction: 99 successful, 1 failed out of 100 elements
2026-06-29 23:00:31,474 - Yiddish24Scraper - INFO - Parsed 99 articles from HTML on page 1
2026-06-29 23:00:32,196 - Yiddish24Scraper - INFO - Page 1 summary: 14 new out of 99 total articles
2026-06-29 23:00:32,196 - Yiddish24Scraper - INFO - Page 1: 14/99 new items
2026-06-29 23:00:32,196 - Yiddish24Scraper - INFO - Low new item ratio (14.1%), stopping pagination
2026-06-29 23:00:32,197 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 14
2026-06-29 23:00:54,567 - IveltScraper - INFO - ivelt scrape complete. Checked 5 topics.
2026-06-29 23:00:54,567 - IveltScraper - INFO - All forums scrape complete. Found 40 new posts.
2026-06-29 23:00:54,567 - __main__ - INFO - Scraper rss completed: 3 results
2026-06-29 23:00:54,568 - __main__ - INFO - Scraper yiddish24 completed: 14 results
2026-06-29 23:00:54,568 - __main__ - INFO - Scraper ivelt completed: 40 results
2026-06-29 23:00:55,424 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-29 23:00:55.424008
2026-06-29 23:00:55,424 - __main__ - INFO - Email sent successfully
2026-06-29 23:00:55,424 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-29 23:00:55,424 - __main__ - INFO - Monitor complete. Found 57 total results: 3 new rss results, 14 new yiddish24 results, 40 new ivelt results.
2026-06-29 23:00:55,424 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-29 23:00:55,424 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-29 23:00:55,501 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-29 23:00:55,502 - __main__ - INFO - Closed all database connections
2026-06-29 23:00:55,503 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-29 23:00:55,504 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-29 23:30:02,008 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-29.log
2026-06-29 23:30:02,009 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-29.log
2026-06-29 23:30:02,009 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-29.log
2026-06-29 23:30:02,009 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-29 23:30:02,034 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-29 23:30:02,034 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-29 23:30:02,037 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-29 23:30:02,037 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-29 23:30:02,051 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-29 23:30:02,051 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-29 23:30:02,096 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-29 23:30:02,096 - __main__ - INFO - GitHub scraper initialized and enabled
2026-06-29 23:30:02,096 - __main__ - INFO - GitHub feed scraper initialized and enabled
2026-06-29 23:30:02,096 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-29 23:30:02,097 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled
2026-06-29 23:30:02,100 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-29 23:30:02,100 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-29 23:30:02,102 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-29 23:30:02,107 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-29 23:30:02,107 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=10
2026-06-29 23:30:02,109 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-29 23:30:02,109 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-29 23:30:02,109 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-29 23:30:02,109 - __main__ - INFO - Running 3 scrapers concurrently...
2026-06-29 23:30:02,110 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-29 23:30:02,208 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)
2026-06-29 23:31:02,518 - LinkedInFeedScraper - ERROR - LinkedIn cookie auto-grab from Chrome (port 9224) failed: Message: session not created: cannot connect to chrome at 127.0.0.1:9224
from chrome not reachable; For documentation on this error, please visit: https://www.selenium.dev/documentation/webdriver/troubleshooting/errors#sessionnotcreatedexception
Stacktrace:
#0 0x5a46d0bd33da <unknown>
#1 0x5a46d05b4ef0 <unknown>
#2 0x5a46d05a076c <unknown>
#3 0x5a46d05f8b3e <unknown>
#4 0x5a46d05edca1 <unknown>
#5 0x5a46d063dd96 <unknown>
#6 0x5a46d063d47c <unknown>
#7 0x5a46d05fce4f <unknown>
#8 0x5a46d05fdc31 <unknown>
#9 0x5a46d0b999f7 <unknown>
#10 0x5a46d0b98203 <unknown>
#11 0x5a46d0b82f16 <unknown>
#12 0x5a46d0b98d9a <unknown>
#13 0x5a46d0b6aeb0 <unknown>
#14 0x5a46d0bbfd58 <unknown>
#15 0x5a46d0bbfef5 <unknown>
#16 0x5a46d0bd1f5e <unknown>
#17 0x7a895569caa4 <unknown>
#18 0x7a8955729c6c <unknown>
2026-06-29 23:31:02,519 - LinkedInFeedScraper - ERROR - LinkedIn cookies not configured (li_at / JSESSIONID)
2026-06-29 23:31:02,532 - LinkedInFeedScraper - INFO - LinkedIn Feed scrape complete. Found 0 new posts.
2026-06-29 23:31:03,366 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"
2026-06-29 23:31:04,069 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-29 23:31:04,073 - GitHubScraper - INFO - Found 242 GitHub repositories for term: paperclip
2026-06-29 23:31:04,934 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"
2026-06-29 23:31:05,701 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-29 23:31:05,705 - GitHubScraper - INFO - Found 406 GitHub repositories for term: "Hermes Agent"
2026-06-29 23:31:06,666 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 200 OK"
2026-06-29 23:31:07,338 - GitHubScraper - INFO - GitHub feed: 299 fetched across pages, 2 new events for abeperl
2026-06-29 23:31:07,340 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-29 23:31:07,343 - GitHubScraper - INFO - Found 55 GitHub repositories for term: multica
2026-06-29 23:31:07,476 - GitHubScraper - INFO - Total GitHub results found: 0
2026-06-29 23:31:07,476 - __main__ - INFO - Scraper github completed: 0 results
2026-06-29 23:31:07,476 - __main__ - INFO - Scraper github_feed completed: 2 results
2026-06-29 23:31:07,476 - __main__ - INFO - Scraper linkedin_feed completed: 0 results
2026-06-29 23:31:07,477 - __main__ - WARNING - LinkedIn Feed: 2 consecutive failures (0 results)
2026-06-29 23:31:08,194 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-29 23:31:08.194357
2026-06-29 23:31:08,194 - __main__ - INFO - Email sent successfully
2026-06-29 23:31:08,194 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-29 23:31:08,194 - __main__ - INFO - Monitor complete. Found 2 total results: 2 new github feed results.
2026-06-29 23:31:08,194 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-29 23:31:08,194 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-29 23:31:08,265 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-29 23:31:08,266 - __main__ - INFO - Closed all database connections
2026-06-29 23:31:08,267 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-29 23:31:08,268 - social_media_monitor.database.connection - INFO - Closed 0 database connections
Live tail active โ waiting for new lines...