โ Logs
social_media_monitor_2026-07-07.log
The file was ready, the clo
2026-07-07 20:30:13,009 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Yossi Neuman - What Is IOS?
The Hottest Thing in Industrial Real Estate Right Now
For years, industrial real estate
2026-07-07 20:30:13,028 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Moshe Zeffren - Just a warning to all the other vertically integrated consulting, design and contracting firms.
I'm
2026-07-07 20:30:13,035 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Andrey Eidelman - The end of one journey and the beginning of another.
After 5 amazing years, I said goodbye to Gong l
2026-07-07 20:30:13,102 - LinkedInFeedScraper - INFO - LinkedIn Feed scrape complete. Found 6 new posts.
2026-07-07 20:30:13,903 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"
2026-07-07 20:30:14,592 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-07-07 20:30:14,600 - GitHubScraper - INFO - Found 242 GitHub repositories for term: paperclip
2026-07-07 20:30:15,444 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"
2026-07-07 20:30:16,198 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-07-07 20:30:16,202 - GitHubScraper - INFO - Found 430 GitHub repositories for term: "Hermes Agent"
2026-07-07 20:30:16,255 - GitHubScraper - INFO - Added new GitHub repository: dio-agent
2026-07-07 20:30:17,186 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 200 OK"
2026-07-07 20:30:17,850 - GitHubScraper - INFO - GitHub feed: 298 fetched across pages, 4 new events for abeperl
2026-07-07 20:30:17,852 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-07-07 20:30:17,856 - GitHubScraper - INFO - Found 56 GitHub repositories for term: multica
2026-07-07 20:30:17,983 - GitHubScraper - INFO - Total GitHub results found: 1
2026-07-07 20:30:17,984 - __main__ - INFO - Scraper github completed: 1 results
2026-07-07 20:30:17,984 - __main__ - INFO - Scraper github_feed completed: 4 results
2026-07-07 20:30:17,984 - __main__ - INFO - Scraper linkedin_feed completed: 6 results
2026-07-07 20:30:17,985 - social_media_monitor.sheets.webinar_sheets_writer - INFO - Checking 6 LinkedIn feed posts for webinar/course + Torah mentions...
2026-07-07 20:30:19,087 - social_media_monitor.sheets.webinar_sheets_writer - INFO - Loaded 17 existing URLs from sheet for dedup
2026-07-07 20:30:20,094 - social_media_monitor.sheets.webinar_sheets_writer - INFO - Loaded 39 existing links from Torah Matches sheet for dedup
2026-07-07 20:30:20,094 - social_media_monitor.sheets.webinar_sheets_writer - INFO - Torah match: Sol Jacobs - keyword 'ger' - https://www.linkedin.com/feed/update/urn:li:activity:7480349937793232897
2026-07-07 20:30:20,094 - social_media_monitor.sheets.webinar_sheets_writer - INFO - Webinar/course match: Yossi Neuman - keyword 'class' - https://www.linkedin.com/feed/update/urn:li:activity:7480345288268840960
2026-07-07 20:30:20,095 - social_media_monitor.sheets.webinar_sheets_writer - INFO - Webinar/course match: Andrey Eidelman - keyword 'lesson' - https://www.linkedin.com/feed/update/urn:li:activity:7480348784275644418
2026-07-07 20:30:20,095 - social_media_monitor.sheets.webinar_sheets_writer - INFO - Torah match: Andrey Eidelman - keyword 'ger' - https://www.linkedin.com/feed/update/urn:li:activity:7480348784275644418
2026-07-07 20:30:21,127 - social_media_monitor.sheets.webinar_sheets_writer - INFO - Appended 2 column-G URLs to Google Sheet 'Webinar Recording DMs'
2026-07-07 20:30:22,517 - social_media_monitor.sheets.webinar_sheets_writer - INFO - Appended 2 rows to Google Sheet 'Torah Matches'
2026-07-07 20:30:22,518 - __main__ - INFO - Webinar/Course: appended 4 posts to Google Sheet
2026-07-07 20:30:23,205 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-07-07 20:30:23.205255
2026-07-07 20:30:23,205 - __main__ - INFO - Email sent successfully
2026-07-07 20:30:23,205 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-07-07 20:30:23,206 - __main__ - INFO - Monitor complete. Found 11 total results: 1 new github results, 4 new github feed results, 6 new linkedin feed results.
2026-07-07 20:30:23,206 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-07-07 20:30:23,206 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-07-07 20:30:23,289 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-07-07 20:30:23,289 - __main__ - INFO - Closed all database connections
2026-07-07 20:30:23,290 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-07-07 20:30:23,290 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-07-07 21:04:39,360 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-07-07.log
2026-07-07 21:04:39,360 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-07-07.log
2026-07-07 21:04:39,360 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-07-07.log
2026-07-07 21:04:39,360 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-07-07 21:04:39,400 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-07-07 21:04:39,400 - __main__ - INFO - Configuration loaded and validated successfully
2026-07-07 21:04:39,403 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-07-07 21:04:39,403 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-07-07 21:04:39,421 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-07-07 21:04:39,421 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-07-07 21:04:39,470 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-07-07 21:04:39,470 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-07-07 21:04:39,471 - __main__ - INFO - RSS scraper initialized and enabled
2026-07-07 21:04:39,474 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-07-07 21:04:39,475 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-07-07 21:04:39,475 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-07-07 21:04:39,477 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-07-07 21:04:39,482 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-07-07 21:04:39,482 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=10
2026-07-07 21:04:39,484 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-07-07 21:04:39,484 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-07-07 21:04:39,485 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-07-07 21:04:39,485 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-07-07 21:04:39,485 - __main__ - INFO - Running 3 scrapers concurrently...
2026-07-07 21:04:39,485 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-07-07 21:04:39,583 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-07-07 21:04:39,588 - IveltScraper - INFO - Loaded 181 include, 0 exclude filters from DB topic_filters
2026-07-07 21:04:39,588 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-07-07 21:04:39,591 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-07-07 21:04:39,891 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-07-07 21:04:40,297 - RSSFeedScraper - INFO - Total RSS/HTML results: 4
2026-07-07 21:04:43,660 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-07-07 21:04:43,869 - Yiddish24Scraper - INFO - Received response with 463121 characters
2026-07-07 21:04:43,873 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (298203 chars)
2026-07-07 21:04:43,876 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-07-07 21:04:43,961 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-07-07 21:04:43,999 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-07-07 21:04:43,999 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-07-07 21:04:44,052 - Yiddish24Scraper - INFO - Term 'ืืืจืื ืืืืคืจืื' matched in DESCRIPTION: 'ืืจื ืืืจืื ืืืืคืจืื'
2026-07-07 21:04:44,052 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ืืื ืืขืจืืืื: "ืื ื ืืื ืืืขื ืืืื ืืฉืืื ืืืืคื ืขืฆื ืคื
2026-07-07 21:04:44,552 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/KM_N114_24_1783454699.mp3
2026-07-07 21:04:44,645 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_KM_N114_24_1783454699.mp3 (1.5 MB)
2026-07-07 21:04:44,645 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-07-07 21:04:44,653 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_KM_N114_24_1783454699.mp3: title, artist, album, comment, source_url, genre, publisher
2026-07-07 21:04:44,653 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2_KM_N114_24_1783454699_ืืืจืื_ืืืืคืจืื.mp3
2026-07-07 21:04:44,700 - Yiddish24Scraper - INFO - Term 'ืืืจืื ืืืืคืจืื' matched in DESCRIPTION: 'ืืขืืื ืงื ืืื ืืืืขืจืืืืฆืืขืก - ืจ' ืืืื ืืืื ืคืจืขื ืงื ืืื ืจ' ืืืจืื ืืืืคืจืื'
2026-07-07 21:04:44,700 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ืืื ืืื
2026-07-07 21:04:45,553 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/leiby_avrumy_260_260707035729.mp3
2026-07-07 21:04:45,660 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_leiby_avrumy_260_260707035729.mp3 (8.2 MB)
2026-07-07 21:04:45,660 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-07-07 21:04:45,665 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_leiby_avrumy_260_260707035729.mp3: title, artist, album, comment, source_url, genre, publisher
2026-07-07 21:04:45,665 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2_leiby_avrumy_260_260707035729_ืืืจืื_ืืืืคืจืื.mp3
2026-07-07 21:04:45,731 - Yiddish24Scraper - INFO - Term 'ืืืืกืฆืืื ืืื ืงืจืืฉืงืขืืขื' matched in DESCRIPTION: 'ืืืืกืฆืืื ืืื ืงืจืืฉืงืขืืขื - ืก'ืืื ืืืื ื ืงืฉืจ ืฉื ืงืืืื'
2026-07-07 21:04:45,731 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ืืื ืืื
2026-07-07 21:04:46,553 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/_____3_260_260707021035.mp3
2026-07-07 21:04:46,685 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2______3_260_260707021035.mp3 (3.5 MB)
2026-07-07 21:04:46,686 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-07-07 21:04:46,690 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2______3_260_260707021035.mp3: title, artist, album, comment, source_url, genre, publisher
2026-07-07 21:04:46,690 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2______3_260_260707021035_ืืืืกืฆืืื_ืืื_ืงืจืืฉืงืขืืขื.mp3
2026-07-07 21:04:47,301 - Yiddish24Scraper - INFO - Page 1 summary: 19 new out of 100 total articles
2026-07-07 21:04:47,301 - Yiddish24Scraper - INFO - Page 1: 19/100 new items
2026-07-07 21:04:47,301 - Yiddish24Scraper - INFO - Low new item ratio (19.0%), stopping pagination
2026-07-07 21:04:47,301 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 19
2026-07-07 21:06:40,185 - IveltScraper - INFO - FlareSolverr error: Error: Error solving the challenge. Timeout after 120.0 seconds. (attempt 1)
2026-07-07 21:06:40,185 - IveltScraper - INFO - Retrying in 3s...
2026-07-07 21:08:43,770 - IveltScraper - ERROR - FlareSolverr error: Error: Error solving the challenge. Timeout after 120.0 seconds. (attempt 2)
2026-07-07 21:08:43,771 - IveltScraper - INFO - FlareSolverr failed, trying curl_cffi cookie fallback...
2026-07-07 21:08:43,771 - IveltScraper - WARNING - No cf_clearance cookie set โ skipping curl_cffi fallback
2026-07-07 21:08:43,771 - IveltScraper - ERROR - Failed to fetch ivelt active topics page
2026-07-07 21:08:43,771 - IveltScraper - INFO - All forums scrape complete. Found 0 new posts.
2026-07-07 21:08:43,772 - __main__ - INFO - Scraper rss completed: 4 results
2026-07-07 21:08:43,772 - __main__ - INFO - Scraper yiddish24 completed: 19 results
2026-07-07 21:08:43,772 - __main__ - INFO - Scraper ivelt completed: 0 results
2026-07-07 21:08:44,561 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-07-07 21:08:44.561452
2026-07-07 21:08:44,561 - __main__ - INFO - Email sent successfully
2026-07-07 21:08:44,562 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-07-07 21:08:44,562 - __main__ - INFO - Monitor complete. Found 23 total results: 4 new rss results, 19 new yiddish24 results.
2026-07-07 21:08:44,562 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-07-07 21:08:44,562 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-07-07 21:08:44,661 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-07-07 21:08:44,661 - __main__ - INFO - Closed all database connections
2026-07-07 21:08:44,663 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-07-07 21:08:44,663 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-07-07 21:30:00,681 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-07-07.log
2026-07-07 21:30:00,681 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-07-07.log
2026-07-07 21:30:00,682 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-07-07.log
2026-07-07 21:30:00,682 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-07-07 21:30:00,712 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-07-07 21:30:00,713 - __main__ - INFO - Configuration loaded and validated successfully
2026-07-07 21:30:00,715 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-07-07 21:30:00,715 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-07-07 21:30:00,727 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-07-07 21:30:00,727 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-07-07 21:30:00,729 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-07-07 21:30:00,729 - __main__ - INFO - GitHub scraper initialized and enabled
2026-07-07 21:30:00,730 - __main__ - INFO - GitHub feed scraper initialized and enabled
2026-07-07 21:30:00,730 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-07-07 21:30:00,730 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled
2026-07-07 21:30:00,733 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-07-07 21:30:00,733 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-07-07 21:30:00,735 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-07-07 21:30:00,739 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-07-07 21:30:00,740 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=10
2026-07-07 21:30:00,742 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-07-07 21:30:00,742 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-07-07 21:30:00,742 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-07-07 21:30:00,744 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-07-07 21:30:00,744 - __main__ - INFO - Running 3 scrapers concurrently...
2026-07-07 21:30:00,744 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-07-07 21:30:00,837 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)
2026-07-07 21:30:01,526 - LinkedInFeedScraper - INFO - Auto-grabbed fresh LinkedIn cookies from running Chrome (preferred).
2026-07-07 21:30:07,894 - LinkedInFeedScraper - INFO - Successfully sorted fetched LinkedIn posts chronologically (most recent first)
2026-07-07 21:30:07,905 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Joel Goldstein - Most people are stuck because they are asking the wrong question.
They say I do not have a plan. I
2026-07-07 21:30:07,913 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Hershy Goldstein - Elon Musk says he works 16 hours a day, 7 days a week, and people still call him luckyโฆ
But you kn
2026-07-07 21:30:07,920 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Ari Torenheim - Hi Everyone,
Looking To Buy Brand-Name Beverages,
Hershey's Kisses CHOCOLATE.
Large Quantities,
2026-07-07 21:30:07,926 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Moshe Bochner - Thereโs a moment when you stop looking at the big number.
Revenue looks strong.
Totals seem clear.
2026-07-07 21:30:07,932 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Ralph Burton - Check out this great song about Claude Code.
Has those funny jokes that I know from experience.
L
2026-07-07 21:30:07,945 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Shloime Weinfeld - Every Salesforce admin I know has the same recurring ticket:
"Can you pull me a report ofโฆ"
I've b
2026-07-07 21:30:08,003 - LinkedInFeedScraper - INFO - LinkedIn Feed scrape complete. Found 6 new posts.
2026-07-07 21:30:08,763 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"
2026-07-07 21:30:09,501 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-07-07 21:30:09,507 - GitHubScraper - INFO - Found 242 GitHub repositories for term: paperclip
2026-07-07 21:30:10,333 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"
2026-07-07 21:30:11,018 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-07-07 21:30:11,022 - GitHubScraper - INFO - Found 430 GitHub repositories for term: "Hermes Agent"
2026-07-07 21:30:12,056 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-07-07 21:30:12,122 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 200 OK"
2026-07-07 21:30:12,815 - GitHubScraper - INFO - GitHub feed: 298 fetched across pages, 2 new events for abeperl
2026-07-07 21:30:12,819 - GitHubScraper - INFO - Found 56 GitHub repositories for term: multica
2026-07-07 21:30:12,942 - GitHubScraper - INFO - Total GitHub results found: 0
2026-07-07 21:30:12,942 - __main__ - INFO - Scraper github completed: 0 results
2026-07-07 21:30:12,942 - __main__ - INFO - Scraper github_feed completed: 2 results
2026-07-07 21:30:12,942 - __main__ - INFO - Scraper linkedin_feed completed: 6 results
2026-07-07 21:30:12,943 - social_media_monitor.sheets.webinar_sheets_writer - INFO - Checking 6 LinkedIn feed posts for webinar/course + Torah mentions...
2026-07-07 21:30:14,061 - social_media_monitor.sheets.webinar_sheets_writer - INFO - Loaded 17 existing URLs from sheet for dedup
2026-07-07 21:30:14,483 - social_media_monitor.sheets.webinar_sheets_writer - INFO - Loaded 41 existing links from Torah Matches sheet for dedup
2026-07-07 21:30:14,484 - social_media_monitor.sheets.webinar_sheets_writer - INFO - Webinar/course match: Joel Goldstein - keyword 'session' - https://www.linkedin.com/feed/update/urn:li:activity:7480371492803985408
2026-07-07 21:30:14,484 - social_media_monitor.sheets.webinar_sheets_writer - INFO - Webinar/course match: Hershy Goldstein - keyword 'lesson' - https://www.linkedin.com/feed/update/urn:li:activity:7480363410157883392
2026-07-07 21:30:15,500 - social_media_monitor.sheets.webinar_sheets_writer - INFO - Appended 2 column-G URLs to Google Sheet 'Webinar Recording DMs'
2026-07-07 21:30:15,501 - social_media_monitor.sheets.webinar_sheets_writer - INFO - No Torah/Talmud/Hasidic mentions found in LinkedIn feed posts
2026-07-07 21:30:15,501 - __main__ - INFO - Webinar/Course: appended 2 posts to Google Sheet
2026-07-07 21:30:16,328 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-07-07 21:30:16.328094
2026-07-07 21:30:16,328 - __main__ - INFO - Email sent successfully
2026-07-07 21:30:16,328 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-07-07 21:30:16,328 - __main__ - INFO - Monitor complete. Found 8 total results: 2 new github feed results, 6 new linkedin feed results.
2026-07-07 21:30:16,328 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-07-07 21:30:16,329 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-07-07 21:30:16,445 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-07-07 21:30:16,445 - __main__ - INFO - Closed all database connections
2026-07-07 21:30:16,447 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-07-07 21:30:16,447 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-07-07 22:04:39,291 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-07-07.log
2026-07-07 22:04:39,292 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-07-07.log
2026-07-07 22:04:39,292 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-07-07.log
2026-07-07 22:04:39,292 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-07-07 22:04:39,325 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-07-07 22:04:39,325 - __main__ - INFO - Configuration loaded and validated successfully
2026-07-07 22:04:39,327 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-07-07 22:04:39,328 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-07-07 22:04:39,340 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-07-07 22:04:39,341 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-07-07 22:04:39,343 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-07-07 22:04:39,344 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-07-07 22:04:39,344 - __main__ - INFO - RSS scraper initialized and enabled
2026-07-07 22:04:39,347 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-07-07 22:04:39,347 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-07-07 22:04:39,347 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-07-07 22:04:39,350 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-07-07 22:04:39,354 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-07-07 22:04:39,354 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=10
2026-07-07 22:04:39,356 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-07-07 22:04:39,356 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-07-07 22:04:39,356 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-07-07 22:04:39,359 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-07-07 22:04:39,359 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-07-07 22:04:39,359 - __main__ - INFO - Running 3 scrapers concurrently...
2026-07-07 22:04:39,359 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-07-07 22:04:39,452 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-07-07 22:04:39,457 - IveltScraper - INFO - Loaded 181 include, 0 exclude filters from DB topic_filters
2026-07-07 22:04:39,457 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-07-07 22:04:39,458 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-07-07 22:04:39,728 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-07-07 22:04:40,159 - RSSFeedScraper - INFO - Total RSS/HTML results: 3
2026-07-07 22:04:43,415 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-07-07 22:04:43,633 - Yiddish24Scraper - INFO - Received response with 471435 characters
2026-07-07 22:04:43,634 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (304027 chars)
2026-07-07 22:04:43,636 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-07-07 22:04:43,709 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-07-07 22:04:43,750 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-07-07 22:04:43,750 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-07-07 22:04:43,828 - Yiddish24Scraper - INFO - Term 'ืคืื ืื ืืืื'ืก ืืืฉื' matched in DESCRIPTION: 'ืคืื ืื ืืืื'ืก ืืืฉื - ืืืืืืื ืืืื ืืขื ืืื ืคืจืืฉ ืืื ืืื ืขืืืขืจ?'
2026-07-07 22:04:43,828 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ืืื ืืื
2026-07-07 22:04:44,328 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/__________________________________________950749649.mp3
2026-07-07 22:04:44,481 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2___________________________________________950749649.mp3 (13.7 MB)
2026-07-07 22:04:44,482 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-07-07 22:04:44,491 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2___________________________________________950749649.mp3: title, artist, album, comment, source_url, genre, publisher
2026-07-07 22:04:44,491 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2___________________________________________950749649_ืคืื_ืื_ืืืื_ืก_ืืืฉื.mp3
2026-07-07 22:04:45,362 - Yiddish24Scraper - INFO - Page 1 summary: 8 new out of 100 total articles
2026-07-07 22:04:45,363 - Yiddish24Scraper - INFO - Page 1: 8/100 new items
2026-07-07 22:04:45,363 - Yiddish24Scraper - INFO - Low new item ratio (8.0%), stopping pagination
2026-07-07 22:04:45,363 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 8
2026-07-07 22:06:40,146 - IveltScraper - INFO - FlareSolverr error: Error: Error solving the challenge. Timeout after 120.0 seconds. (attempt 1)
2026-07-07 22:06:40,146 - IveltScraper - INFO - Retrying in 3s...
2026-07-07 22:08:43,848 - IveltScraper - ERROR - FlareSolverr error: Error: Error solving the challenge. Timeout after 120.0 seconds. (attempt 2)
2026-07-07 22:08:43,848 - IveltScraper - INFO - FlareSolverr failed, trying curl_cffi cookie fallback...
2026-07-07 22:08:43,848 - IveltScraper - WARNING - No cf_clearance cookie set โ skipping curl_cffi fallback
2026-07-07 22:08:43,849 - IveltScraper - ERROR - Failed to fetch ivelt active topics page
2026-07-07 22:08:43,849 - IveltScraper - INFO - All forums scrape complete. Found 0 new posts.
2026-07-07 22:08:43,849 - __main__ - INFO - Scraper rss completed: 3 results
2026-07-07 22:08:43,849 - __main__ - INFO - Scraper yiddish24 completed: 8 results
2026-07-07 22:08:43,849 - __main__ - INFO - Scraper ivelt completed: 0 results
2026-07-07 22:08:44,656 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-07-07 22:08:44.656601
2026-07-07 22:08:44,656 - __main__ - INFO - Email sent successfully
2026-07-07 22:08:44,657 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-07-07 22:08:44,657 - __main__ - INFO - Monitor complete. Found 11 total results: 3 new rss results, 8 new yiddish24 results.
2026-07-07 22:08:44,657 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-07-07 22:08:44,657 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-07-07 22:08:44,719 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-07-07 22:08:44,719 - __main__ - INFO - Closed all database connections
2026-07-07 22:08:44,721 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-07-07 22:08:44,721 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-07-07 22:30:00,635 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-07-07.log
2026-07-07 22:30:00,635 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-07-07.log
2026-07-07 22:30:00,636 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-07-07.log
2026-07-07 22:30:00,636 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-07-07 22:30:00,666 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-07-07 22:30:00,666 - __main__ - INFO - Configuration loaded and validated successfully
2026-07-07 22:30:00,668 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-07-07 22:30:00,669 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-07-07 22:30:00,683 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-07-07 22:30:00,683 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-07-07 22:30:00,824 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-07-07 22:30:00,825 - __main__ - INFO - GitHub scraper initialized and enabled
2026-07-07 22:30:00,825 - __main__ - INFO - GitHub feed scraper initialized and enabled
2026-07-07 22:30:00,827 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-07-07 22:30:00,827 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled
2026-07-07 22:30:00,835 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-07-07 22:30:00,835 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-07-07 22:30:00,841 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-07-07 22:30:00,851 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-07-07 22:30:00,851 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=10
2026-07-07 22:30:00,855 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-07-07 22:30:00,855 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-07-07 22:30:00,856 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-07-07 22:30:00,860 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-07-07 22:30:00,860 - __main__ - INFO - Running 3 scrapers concurrently...
2026-07-07 22:30:00,860 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-07-07 22:30:00,955 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)
2026-07-07 22:30:01,443 - LinkedInFeedScraper - INFO - Auto-grabbed fresh LinkedIn cookies from running Chrome (preferred).
2026-07-07 22:30:12,343 - LinkedInFeedScraper - INFO - Successfully sorted fetched LinkedIn posts chronologically (most recent first)
2026-07-07 22:30:12,353 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Moshe Bochner - Thereโs a point where growth starts to feel different.
Youโre building.
Youโre moving forward.
Youโ
2026-07-07 22:30:12,360 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Raphael Lasry - "Software is basically free to build now. Why would I pay someone to plan it?"
I hear this weekly.
2026-07-07 22:30:12,367 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Shyam Sankar - Veterans: you were the Man in the Arena protecting your country.
You endured the slings and arrows
2026-07-07 22:30:12,412 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Yossi Farro - A 36-year-old Chassidic real estate mogul from Brooklyn is reportedly on the verge of acquiring one
2026-07-07 22:30:12,453 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Linas Beliลซnas - Wild: Somebody spent 37 years at Microsoft, led the team that built Xbox Backward Compatibility, the
2026-07-07 22:30:12,460 - LinkedInFeedScraper - INFO - LinkedIn Feed scrape complete. Found 5 new posts.
2026-07-07 22:30:13,202 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"
2026-07-07 22:30:13,942 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-07-07 22:30:13,947 - GitHubScraper - INFO - Found 242 GitHub repositories for term: paperclip
2026-07-07 22:30:14,743 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"
2026-07-07 22:30:15,475 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-07-07 22:30:15,477 - GitHubScraper - INFO - Found 430 GitHub repositories for term: "Hermes Agent"
2026-07-07 22:30:16,482 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 200 OK"
2026-07-07 22:30:16,484 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-07-07 22:30:17,301 - GitHubScraper - INFO - GitHub feed: 298 fetched across pages, 6 new events for abeperl
2026-07-07 22:30:17,305 - GitHubScraper - INFO - Found 56 GitHub repositories for term: multica
2026-07-07 22:30:17,484 - GitHubScraper - INFO - Total GitHub results found: 0
2026-07-07 22:30:17,485 - __main__ - INFO - Scraper github completed: 0 results
2026-07-07 22:30:17,485 - __main__ - INFO - Scraper github_feed completed: 6 results
2026-07-07 22:30:17,485 - __main__ - INFO - Scraper linkedin_feed completed: 5 results
2026-07-07 22:30:17,486 - social_media_monitor.sheets.webinar_sheets_writer - INFO - Checking 5 LinkedIn feed posts for webinar/course + Torah mentions...
2026-07-07 22:30:18,751 - social_media_monitor.sheets.webinar_sheets_writer - INFO - Loaded 17 existing URLs from sheet for dedup
2026-07-07 22:30:19,190 - social_media_monitor.sheets.webinar_sheets_writer - INFO - Loaded 41 existing links from Torah Matches sheet for dedup
2026-07-07 22:30:19,190 - social_media_monitor.sheets.webinar_sheets_writer - INFO - Torah match: Moshe Bochner - keyword 'ger' - https://www.linkedin.com/feed/update/urn:li:activity:7480386035022143489
2026-07-07 22:30:19,191 - social_media_monitor.sheets.webinar_sheets_writer - INFO - Torah match: Yossi Farro - keyword 'shabbos' - https://www.linkedin.com/feed/update/urn:li:aggregate:(urn:li:activity:748037458
2026-07-07 22:30:19,192 - social_media_monitor.sheets.webinar_sheets_writer - INFO - No webinar/course mentions found in LinkedIn feed posts
2026-07-07 22:30:20,375 - social_media_monitor.sheets.webinar_sheets_writer - INFO - Appended 2 rows to Google Sheet 'Torah Matches'
2026-07-07 22:30:20,375 - __main__ - INFO - Webinar/Course: appended 2 posts to Google Sheet
2026-07-07 22:30:21,153 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-07-07 22:30:21.153223
2026-07-07 22:30:21,153 - __main__ - INFO - Email sent successfully
2026-07-07 22:30:21,153 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-07-07 22:30:21,154 - __main__ - INFO - Monitor complete. Found 11 total results: 6 new github feed results, 5 new linkedin feed results.
2026-07-07 22:30:21,154 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-07-07 22:30:21,154 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-07-07 22:30:21,298 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-07-07 22:30:21,298 - __main__ - INFO - Closed all database connections
2026-07-07 22:30:21,300 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-07-07 22:30:21,300 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-07-07 23:04:39,282 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-07-07.log
2026-07-07 23:04:39,282 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-07-07.log
2026-07-07 23:04:39,282 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-07-07.log
2026-07-07 23:04:39,282 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-07-07 23:04:39,315 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-07-07 23:04:39,315 - __main__ - INFO - Configuration loaded and validated successfully
2026-07-07 23:04:39,317 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-07-07 23:04:39,317 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-07-07 23:04:39,331 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-07-07 23:04:39,331 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-07-07 23:04:39,334 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-07-07 23:04:39,334 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-07-07 23:04:39,334 - __main__ - INFO - RSS scraper initialized and enabled
2026-07-07 23:04:39,337 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-07-07 23:04:39,337 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-07-07 23:04:39,337 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-07-07 23:04:39,340 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-07-07 23:04:39,344 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-07-07 23:04:39,344 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=10
2026-07-07 23:04:39,346 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-07-07 23:04:39,347 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-07-07 23:04:39,347 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-07-07 23:04:39,349 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-07-07 23:04:39,349 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-07-07 23:04:39,349 - __main__ - INFO - Running 3 scrapers concurrently...
2026-07-07 23:04:39,349 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-07-07 23:04:39,437 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-07-07 23:04:39,441 - IveltScraper - INFO - Loaded 181 include, 0 exclude filters from DB topic_filters
2026-07-07 23:04:39,441 - IveltScraper - INFO - Fetching ivelt active topics from https://www.ivelt.com/forum/search.php?search_id=active_topics...
2026-07-07 23:04:39,442 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-07-07 23:04:39,716 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-07-07 23:04:40,157 - RSSFeedScraper - INFO - Total RSS/HTML results: 4
2026-07-07 23:04:43,746 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-07-07 23:04:43,968 - Yiddish24Scraper - INFO - Received response with 465133 characters
2026-07-07 23:04:43,972 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (300685 chars)
2026-07-07 23:04:43,975 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-07-07 23:04:44,065 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-07-07 23:04:44,110 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-07-07 23:04:44,111 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-07-07 23:04:44,132 - Yiddish24Scraper - INFO - Term 'ืืืืขืจ ืืืก ืืื ืืขื ืฅ -' matched in DESCRIPTION: 'ืืืืขืจ ืืืก ืืื ืืขื ืฅ - ืืจืืืฃ ืืจืขื ืื ื ืฉืืืืื ืืื ืืืื ืืฉืจืื'
2026-07-07 23:04:44,133 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ืืื ืืื
2026-07-07 23:04:44,633 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/_______________________2_260_260707044346.mp3
2026-07-07 23:04:45,743 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2________________________2_260_260707044346.mp3 (5.1 MB)
2026-07-07 23:04:45,744 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-07-07 23:04:45,759 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2________________________2_260_260707044346.mp3: title, artist, album, comment, source_url, genre, publisher
2026-07-07 23:04:45,760 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2________________________2_260_260707044346_ืืืืขืจ_ืืืก_ืืื_ืืขื ืฅ_-.mp3
2026-07-07 23:04:46,447 - Yiddish24Scraper - INFO - Page 1 summary: 3 new out of 100 total articles
2026-07-07 23:04:46,448 - Yiddish24Scraper - INFO - Page 1: 3/100 new items
2026-07-07 23:04:46,448 - Yiddish24Scraper - INFO - Low new item ratio (3.0%), stopping pagination
2026-07-07 23:04:46,448 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 3
2026-07-07 23:06:40,011 - IveltScraper - INFO - FlareSolverr error: Error: Error solving the challenge. Timeout after 120.0 seconds. (attempt 1)
2026-07-07 23:06:40,011 - IveltScraper - INFO - Retrying in 3s...
2026-07-07 23:08:49,582 - IveltScraper - ERROR - FlareSolverr error: Error: Error solving the challenge. Timeout after 120.0 seconds. (attempt 2)
2026-07-07 23:08:49,583 - IveltScraper - INFO - FlareSolverr failed, trying curl_cffi cookie fallback...
2026-07-07 23:08:49,583 - IveltScraper - WARNING - No cf_clearance cookie set โ skipping curl_cffi fallback
2026-07-07 23:08:49,583 - IveltScraper - ERROR - Failed to fetch ivelt active topics page
2026-07-07 23:08:49,583 - IveltScraper - INFO - All forums scrape complete. Found 0 new posts.
2026-07-07 23:08:49,584 - __main__ - INFO - Scraper rss completed: 4 results
2026-07-07 23:08:49,584 - __main__ - INFO - Scraper yiddish24 completed: 3 results
2026-07-07 23:08:49,584 - __main__ - INFO - Scraper ivelt completed: 0 results
2026-07-07 23:08:50,437 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-07-07 23:08:50.437157
2026-07-07 23:08:50,437 - __main__ - INFO - Email sent successfully
2026-07-07 23:08:50,438 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-07-07 23:08:50,438 - __main__ - INFO - Monitor complete. Found 7 total results: 4 new rss results, 3 new yiddish24 results.
2026-07-07 23:08:50,438 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-07-07 23:08:50,438 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-07-07 23:08:50,515 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-07-07 23:08:50,515 - __main__ - INFO - Closed all database connections
2026-07-07 23:08:50,518 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-07-07 23:08:50,518 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-07-07 23:30:00,649 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-07-07.log
2026-07-07 23:30:00,649 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-07-07.log
2026-07-07 23:30:00,649 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-07-07.log
2026-07-07 23:30:00,649 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-07-07 23:30:00,682 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-07-07 23:30:00,682 - __main__ - INFO - Configuration loaded and validated successfully
2026-07-07 23:30:00,684 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-07-07 23:30:00,685 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-07-07 23:30:00,703 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-07-07 23:30:00,703 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-07-07 23:30:00,706 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-07-07 23:30:00,706 - __main__ - INFO - GitHub scraper initialized and enabled
2026-07-07 23:30:00,706 - __main__ - INFO - GitHub feed scraper initialized and enabled
2026-07-07 23:30:00,707 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-07-07 23:30:00,707 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled
2026-07-07 23:30:00,710 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-07-07 23:30:00,710 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-07-07 23:30:00,713 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-07-07 23:30:00,718 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-07-07 23:30:00,718 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=10
2026-07-07 23:30:00,720 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-07-07 23:30:00,720 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-07-07 23:30:00,720 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-07-07 23:30:00,722 - AllDafScraper - INFO - All Daf scraper initialized: enabled=True sections=['Daf Yomi Shiurim', 'Supplemental Clips', 'Reference Materials'] skip_terms=0 include_terms=0
2026-07-07 23:30:00,722 - __main__ - INFO - Running 3 scrapers concurrently...
2026-07-07 23:30:00,723 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-07-07 23:30:00,825 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)
2026-07-07 23:30:01,300 - LinkedInFeedScraper - INFO - Auto-grabbed fresh LinkedIn cookies from running Chrome (preferred).
2026-07-07 23:30:07,166 - LinkedInFeedScraper - INFO - Successfully sorted fetched LinkedIn posts chronologically (most recent first)
2026-07-07 23:30:07,176 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Abe Orgel - The CPSC requirement does not mean that you simply copy paste everything that is on your test report
2026-07-07 23:30:07,185 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Minjae Jang - Recently, I wrapped up my internship at Energy CX as part of the Engineering City Scholars program.
2026-07-07 23:30:07,251 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Mo Berger - I'm so happy to share that I've joined Gradual Behavioral Health this month and will be helping to g
2026-07-07 23:30:07,282 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Nate Meyers - Maintaining your coding agent costs more than using it! I fixed that. ๐
Skills to curate. Instruct
2026-07-07 23:30:07,289 - LinkedInFeedScraper - INFO - LinkedIn Feed scrape complete. Found 4 new posts.
2026-07-07 23:30:08,033 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=1 "HTTP/1.1 200 OK"
2026-07-07 23:30:08,709 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-07-07 23:30:08,717 - GitHubScraper - INFO - Found 242 GitHub repositories for term: paperclip
2026-07-07 23:30:09,405 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=2 "HTTP/1.1 200 OK"
2026-07-07 23:30:10,242 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-07-07 23:30:10,246 - GitHubScraper - INFO - Found 431 GitHub repositories for term: "Hermes Agent"
2026-07-07 23:30:11,211 - httpx - INFO - HTTP Request: GET https://api.github.com/users/abeperl/received_events?per_page=100&page=3 "HTTP/1.1 200 OK"
2026-07-07 23:30:12,107 - GitHubScraper - INFO - GitHub feed: 298 fetched across pages, 0 new events for abeperl
2026-07-07 23:30:12,109 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-07-07 23:30:12,113 - GitHubScraper - INFO - Found 56 GitHub repositories for term: multica
2026-07-07 23:30:12,272 - GitHubScraper - INFO - Total GitHub results found: 0
2026-07-07 23:30:12,272 - __main__ - INFO - Scraper github completed: 0 results
2026-07-07 23:30:12,273 - __main__ - INFO - Scraper github_feed completed: 0 results
2026-07-07 23:30:12,273 - __main__ - INFO - Scraper linkedin_feed completed: 4 results
2026-07-07 23:30:12,274 - social_media_monitor.sheets.webinar_sheets_writer - INFO - Checking 4 LinkedIn feed posts for webinar/course + Torah mentions...
2026-07-07 23:30:13,522 - social_media_monitor.sheets.webinar_sheets_writer - INFO - Loaded 17 existing URLs from sheet for dedup
2026-07-07 23:30:14,466 - social_media_monitor.sheets.webinar_sheets_writer - INFO - Loaded 43 existing links from Torah Matches sheet for dedup
2026-07-07 23:30:14,467 - social_media_monitor.sheets.webinar_sheets_writer - INFO - No webinar/course mentions found in LinkedIn feed posts
2026-07-07 23:30:14,467 - social_media_monitor.sheets.webinar_sheets_writer - INFO - No Torah/Talmud/Hasidic mentions found in LinkedIn feed posts
2026-07-07 23:30:15,128 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-07-07 23:30:15.128636
2026-07-07 23:30:15,129 - __main__ - INFO - Email sent successfully
2026-07-07 23:30:15,129 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-07-07 23:30:15,129 - __main__ - INFO - Monitor complete. Found 4 total results: 4 new linkedin feed results.
2026-07-07 23:30:15,129 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-07-07 23:30:15,129 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-07-07 23:30:15,299 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-07-07 23:30:15,299 - __main__ - INFO - Closed all database connections
2026-07-07 23:30:15,301 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-07-07 23:30:15,301 - social_media_monitor.database.connection - INFO - Closed 0 database connections
Live tail active โ waiting for new lines...