← Logs

social_media_monitor_2026-05-06.log

2026-05-06 20:30:02,801 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term '"Hermes Agent"'
2026-05-06 20:30:02,832 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Hermes agent stopped being a toy the moment I got it running 24/7 on a
2026-05-06 20:30:03,999 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 1
2026-05-06 20:30:04,000 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'paperclip' restricted to subreddits: ['PaperClip_AI', 'PaperclipAI', 'pAIperclip', 'singularity', 'ControlProblem', 'AIalignment', 'localLLaMA', 'ArtificialInteligence', 'MachineLearning']
2026-05-06 20:30:04,000 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['paperclip']
2026-05-06 20:30:04,000 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/PaperClip_AI+PaperclipAI+pAIperclip+singularity+ControlProblem+AIalignment+localLLaMA+ArtificialInteligence+MachineLearning
2026-05-06 20:30:04,927 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'paperclip'
2026-05-06 20:30:04,961 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: I built a 5-agent "Zero-Human Company." The architecture works — but e
2026-05-06 20:30:04,971 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Using a wire to switch on radiator fan
2026-05-06 20:30:06,128 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 2
2026-05-06 20:30:06,129 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'multica' restricted to subreddits: ['hermesagent', 'HermesAI', 'AI_Agents', 'aiagents', 'AgentsOfAI', 'LocalLLaMA', 'AutoGPT', 'ClaudeCode', 'ClaudeAI', 'claude', 'vibecoding']
2026-05-06 20:30:06,129 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['multica']
2026-05-06 20:30:06,129 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/hermesagent+HermesAI+AI_Agents+aiagents+AgentsOfAI+LocalLLaMA+AutoGPT+ClaudeCode+ClaudeAI+claude+vibecoding
2026-05-06 20:30:06,986 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'multica'
2026-05-06 20:30:08,190 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0
2026-05-06 20:30:08,191 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit subreddit feed monitoring enabled.
2026-05-06 20:30:08,191 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'hermes_agent': r/hermesagent+HermesAI+AI_Agents+aiagents+AgentsOfAI+LocalLLaMA+AutoGPT (limit=25)
2026-05-06 20:30:08,191 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes agent via RSS
2026-05-06 20:30:09,204 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/ClaudeCode: I built a non-LLM memory server for Claude Code because I got tired of
2026-05-06 20:30:09,217 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/AI_Agents: Hermes agent stopped being a toy the moment I got it running 24/7 on a
2026-05-06 20:30:10,368 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes AI via RSS
2026-05-06 20:30:12,431 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: nous research hermes via RSS
2026-05-06 20:30:13,660 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/Starcitizen_trades: [WTS] ⚜️⚜️⚜️Freeman Shipyard Store vol.4⚜️⚜️⚜️ Hull E CCU ⚜️UTV +Recko
2026-05-06 20:30:14,763 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: multica via RSS
2026-05-06 20:30:16,810 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'paperclip_ai': r/PaperClip_AI+PaperclipAI+pAIperclip (limit=25)
2026-05-06 20:30:16,810 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip ai via RSS
2026-05-06 20:30:17,940 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'paperclip_ai' r/AI_Agents: I built a 5-agent "Zero-Human Company." The architecture works — but e
2026-05-06 20:30:19,139 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip agent via RSS
2026-05-06 20:30:21,091 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: multica via RSS
2026-05-06 20:30:22,959 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'claude_agents': r/ClaudeCode+ClaudeAI+claude+vibecoding (limit=25)
2026-05-06 20:30:22,960 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: claude agent via RSS
2026-05-06 20:30:23,844 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeCode: Claude Code built and deployed this keyboard simulator in one session
2026-05-06 20:30:23,857 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeCode: I built a free Claude Code toolkit (50 skills, 7 agents, 11 slash comm
2026-05-06 20:30:23,867 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/mcp: Unique MCP usage idea - getting crowdsourced data on LLM failures. Ext
2026-05-06 20:30:23,878 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/claudeskills: I built a free Claude Code toolkit — 50 skills, 7 agents, 11 slash com
2026-05-06 20:30:23,888 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeCode: I built a non-LLM memory server for Claude Code because I got tired of
2026-05-06 20:30:23,900 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/LinkedInLunatics: The recommendation on LinkedIn Claude wrote for me is real because it
2026-05-06 20:30:23,910 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/automation: I finally get MCP after a year
2026-05-06 20:30:23,921 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/jobhuntify: Remote Job - Binance - Software Engineer (Backend, Java) - Risk
2026-05-06 20:30:23,930 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/openclaw: i tracked every dollar my openclaw agent spent for 2 weeks. heres exac
2026-05-06 20:30:23,942 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ayautomate: What this community is about (and what we're building here)
2026-05-06 20:30:23,951 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/AIDiscussion: LLM platforms are getting weird and I'm kind of here for it
2026-05-06 20:30:23,962 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/FlutterDev: Flutter & Dart just dropped official Agent Skills repos and I think th
2026-05-06 20:30:23,976 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/AI_Agents: Built Council (alpha) — visual chain runner with scheduled re-runs acr
2026-05-06 20:30:23,987 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/CIO: AI is moving too fast to keep up. Here’s the bi-weekly system we’re tr
2026-05-06 20:30:24,001 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeCode: "Auto mode says move fast"
2026-05-06 20:30:24,010 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/Claudeopus: opus 4.7 is now default on max and team. but claude code v2.1.100+ is
2026-05-06 20:30:24,025 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/AI_Agents: I built a 5-agent "Zero-Human Company." The architecture works — but e
2026-05-06 20:30:24,036 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/Yosemite: So, people are obviously booking campsites and permits on rec.gov usin
2026-05-06 20:30:24,060 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/SmarterWebsites: SmartBlocks / Vexal Progress Summary & Full Feature Roadmap
2026-05-06 20:30:24,068 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/udemyfreebies: Vibe Coding to Claude Code Mastery: Build AI Apps & Agents
2026-05-06 20:30:24,077 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/udemyfreebies: Mastering Claude AI: Build AI Apps, Agents & MCP Systems
2026-05-06 20:30:24,085 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/AI_Agents: Want to build an agent that gets TikTok scripts + makes vids+posts. Wh
2026-05-06 20:30:25,085 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: claude code agent via RSS
2026-05-06 20:30:25,946 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/nocode: My First No Code Project is Shipped Today!
2026-05-06 20:30:25,954 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/u_JasonEll: No longer Vibe Coding!
2026-05-06 20:30:25,963 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/GithubCopilot: Claude Partnership with xAI
2026-05-06 20:30:25,973 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ZenlessZoneZero: Every main story Chapter of Season 1 ranked. (Read desc)
2026-05-06 20:30:25,987 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/jobhuntify: Remote Job - Calendly - Software Engineer - Security
2026-05-06 20:30:25,998 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeAI: Followup to the kanban for Claude Code - now vibeyard's home screen is
2026-05-06 20:30:26,010 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/opencodeCLI: Which model for hobby use
2026-05-06 20:30:26,021 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/alphaandbetausers: S.o.S. I am stuck on a loophole and can’t get out of it.
2026-05-06 20:30:26,032 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/razr: Micro1 AI training job for Motorola razr users (20-30$/hr)
2026-05-06 20:30:26,041 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/softwarearchitecture: The monolith vs microservices decision should be operational, not arch
2026-05-06 20:30:27,041 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: AI coding agent via RSS
2026-05-06 20:30:27,944 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/BestLaptopSuggestions: ASUS Vivobook X1607QA – A Smart Everyday Laptop Choice for the UK?
2026-05-06 20:30:27,952 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/indiebiz: I’m building Apollo Deploy - Real-time Release Intelligence to make de
2026-05-06 20:30:27,960 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/AgentsOfAI: How do you grow your AI-Native agency and put it out there?
2026-05-06 20:30:27,968 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ExperiencedDevs: Interview prep: Advice on general code prep.
2026-05-06 20:30:27,978 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/CrazyDiscountClub: 🔥 UNLOCK CODERABBIT PRO+ FOR 12 MONTHS — PREMIUM AI CODE REVIEW ACCESS
2026-05-06 20:30:28,014 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/u_MelleWanna: CHAPITRE 9 / P5
2026-05-06 20:30:28,021 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/AskProgramming: How realistic is it to get a coding job in the UK without a degree?
2026-05-06 20:30:28,029 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/curriculos: Currículo para vaga de Estágio e Júnior como Dev Java
2026-05-06 20:30:28,042 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/jobhuntify: Remote Job - Binance - Risk Operations AI Specialist
2026-05-06 20:30:28,054 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/Aging: What do medical studies show about what helps facial skin appearance,
2026-05-06 20:30:28,067 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/buildinpublic: I’m building Apollo Deploy - Real-time Release Intelligence to make de
2026-05-06 20:30:28,076 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/vintagecomputing: Not sure if this is the right place to ask this, but how do I insert s
2026-05-06 20:30:28,085 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/DeveloperJobs: Stop the Monster Before It Ships: A Petition for Developers Against Fo
2026-05-06 20:30:29,085 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: multica via RSS
2026-05-06 20:30:31,098 - social_media_monitor.scrapers.reddit_scraper - INFO - Total subreddit feed results: 49
2026-05-06 20:30:31,099 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-06 20:30:31,234 - TwitterScraper - INFO - Searching Twitter/X (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-06 20:30:31,687 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'paperclip'
2026-05-06 20:30:46,958 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for '"Hermes Agent"'
2026-05-06 20:31:01,777 - TwitterScraper - INFO - Twitter/X RSS: 94 entries for 'multica'
2026-05-06 20:31:15,245 - TwitterScraper - INFO - Twitter scrape complete. Found 0 new results.
2026-05-06 20:31:15,247 - LinkedInScraper - INFO - Searching LinkedIn (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-06 20:31:15,965 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'paperclip'
2026-05-06 20:31:17,307 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for '"Hermes Agent"'
2026-05-06 20:31:18,732 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'multica'
2026-05-06 20:31:18,776 - LinkedInScraper - INFO - New LinkedIn post: GitHub - multica-ai/multica: The open-source managed agents platform.
2026-05-06 20:31:19,414 - LinkedInScraper - INFO - New LinkedIn post: Today marks the beginning of National Nurses Week. Exceptional care re
2026-05-06 20:31:19,493 - LinkedInScraper - INFO - LinkedIn scrape complete. Found 2 new results.
2026-05-06 20:31:19,494 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)
2026-05-06 20:31:24,340 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-05-06 20:31:24,366 - GitHubScraper - INFO - Found 226 GitHub repositories for term: paperclip
2026-05-06 20:31:25,586 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-05-06 20:31:25,590 - GitHubScraper - INFO - Found 177 GitHub repositories for term: "Hermes Agent"
2026-05-06 20:31:25,605 - GitHubScraper - INFO - Added new GitHub repository: destructive_command_guard
2026-05-06 20:31:26,614 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-05-06 20:31:26,618 - GitHubScraper - INFO - Found 40 GitHub repositories for term: multica
2026-05-06 20:31:26,827 - GitHubScraper - INFO - Total GitHub results found: 1
2026-05-06 20:31:26,828 - __main__ - INFO - Scraper reddit completed: 52 results
2026-05-06 20:31:26,828 - __main__ - INFO - Scraper github completed: 1 results
2026-05-06 20:31:26,828 - __main__ - INFO - Scraper twitter completed: 0 results
2026-05-06 20:31:26,828 - __main__ - INFO - Scraper linkedin completed: 2 results
2026-05-06 20:31:26,828 - __main__ - INFO - Scraper linkedin_feed completed: 0 results
2026-05-06 20:31:27,830 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-06 20:31:27.830358
2026-05-06 20:31:27,830 - __main__ - INFO - Email sent successfully
2026-05-06 20:31:27,830 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-05-06 20:31:27,830 - __main__ - INFO - Monitor complete. Found 55 total results: 52 new reddit results, 1 new github results, 2 new linkedin results.
2026-05-06 20:31:27,831 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-05-06 20:31:27,831 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-06 20:31:27,983 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-05-06 20:31:27,983 - __main__ - INFO - Closed all database connections
2026-05-06 20:31:28,033 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-06 20:31:28,047 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-05-06 21:00:01,641 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-06.log
2026-05-06 21:00:01,641 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-06.log
2026-05-06 21:00:01,641 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-06.log
2026-05-06 21:00:01,641 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-05-06 21:00:01,668 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-05-06 21:00:01,669 - __main__ - INFO - Configuration loaded and validated successfully
2026-05-06 21:00:01,671 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-05-06 21:00:01,672 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-05-06 21:00:01,698 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-05-06 21:00:01,698 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-05-06 21:00:01,700 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-05-06 21:00:01,701 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=3, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0
2026-05-06 21:00:01,701 - __main__ - INFO - RSS scraper initialized and enabled
2026-05-06 21:00:01,703 - Yiddish24Scraper - INFO - File downloader initialized with 1 terms, prefix 'Y2', and file type organization enabled
2026-05-06 21:00:01,703 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=1, exclude_terms=0
2026-05-06 21:00:01,703 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-05-06 21:00:01,705 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0
2026-05-06 21:00:01,710 - TorahAnytimeScraper - INFO - File downloader initialized with 1 terms, prefix 'TA', and file type organization enabled
2026-05-06 21:00:01,710 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=1, exclude_terms=0
2026-05-06 21:00:01,712 - BatorahScraper - INFO - File downloader initialized with 1 terms, prefix 'BT', and file type organization enabled
2026-05-06 21:00:01,712 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=1, exclude_terms=0
2026-05-06 21:00:01,712 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=1
2026-05-06 21:00:01,712 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-05-06 21:00:01,712 - __main__ - INFO - Running 3 scrapers concurrently...
2026-05-06 21:00:01,712 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-05-06 21:00:01,819 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-05-06 21:00:01,823 - IveltScraper - INFO - Loaded 177 include, 0 exclude filters from DB topic_filters
2026-05-06 21:00:01,823 - IveltScraper - INFO - Fetching ivelt.com active topics...
2026-05-06 21:00:01,825 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-05-06 21:00:01,828 - IveltScraper - ERROR - FlareSolverr not reachable at http://localhost:8191/v1 — is the Docker container running? Start with: docker run -d --name flaresolverr --restart unless-stopped -p 8191:8191 -e LOG_LEVEL=info ghcr.io/flaresolverr/flaresolverr:latest
2026-05-06 21:00:01,829 - IveltScraper - INFO - FlareSolverr failed, trying curl_cffi cookie fallback...
2026-05-06 21:00:01,829 - IveltScraper - WARNING - No cf_clearance cookie set — skipping curl_cffi fallback
2026-05-06 21:00:02,128 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-05-06 21:00:02,593 - RSSFeedScraper - INFO - Fetching RSS feed: https://github.com/BuilderPulse/BuilderPulse/commits/main.atom
2026-05-06 21:00:03,047 - IveltScraper - ERROR - Failed to fetch ivelt.com active topics page
2026-05-06 21:00:03,216 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-06.md "HTTP/1.1 200 OK"
2026-05-06 21:00:04,060 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-06.md "HTTP/1.1 200 OK"
2026-05-06 21:00:05,192 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-05.md "HTTP/1.1 200 OK"
2026-05-06 21:00:06,061 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-05.md "HTTP/1.1 200 OK"
2026-05-06 21:00:07,211 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-04.md "HTTP/1.1 200 OK"
2026-05-06 21:00:08,064 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-04.md "HTTP/1.1 200 OK"
2026-05-06 21:00:09,197 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-03.md "HTTP/1.1 200 OK"
2026-05-06 21:00:10,070 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-03.md "HTTP/1.1 200 OK"
2026-05-06 21:00:11,196 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-02.md "HTTP/1.1 200 OK"
2026-05-06 21:00:12,073 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-02.md "HTTP/1.1 200 OK"
2026-05-06 21:00:12,098 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-05-06 21:00:12,306 - Yiddish24Scraper - INFO - Received response with 515676 characters
2026-05-06 21:00:12,309 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (318091 chars)
2026-05-06 21:00:12,312 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-05-06 21:00:12,398 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-05-06 21:00:12,437 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-05-06 21:00:12,437 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-05-06 21:00:13,183 - Yiddish24Scraper - INFO - Page 1 summary: 6 new out of 100 total articles
2026-05-06 21:00:13,183 - Yiddish24Scraper - INFO - Page 1: 6/100 new items
2026-05-06 21:00:13,183 - Yiddish24Scraper - INFO - Low new item ratio (6.0%), stopping pagination
2026-05-06 21:00:13,184 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 6
2026-05-06 21:00:13,321 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-01.md "HTTP/1.1 200 OK"
2026-05-06 21:00:14,196 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-01.md "HTTP/1.1 200 OK"
2026-05-06 21:00:15,340 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-04-30.md "HTTP/1.1 200 OK"
2026-05-06 21:00:16,198 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-04-30.md "HTTP/1.1 200 OK"
2026-05-06 21:00:17,347 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-04-29.md "HTTP/1.1 200 OK"
2026-05-06 21:00:18,203 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-04-29.md "HTTP/1.1 200 OK"
2026-05-06 21:00:19,329 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-04-28.md "HTTP/1.1 200 OK"
2026-05-06 21:00:19,351 - RSSFeedScraper - INFO - Total RSS/HTML results: 3
2026-05-06 21:00:19,351 - __main__ - INFO - Scraper rss completed: 3 results
2026-05-06 21:00:19,351 - __main__ - INFO - Scraper yiddish24 completed: 6 results
2026-05-06 21:00:19,352 - __main__ - INFO - Scraper ivelt completed: 0 results
2026-05-06 21:00:20,533 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-06 21:00:20.532941
2026-05-06 21:00:20,533 - __main__ - INFO - Email sent successfully
2026-05-06 21:00:20,533 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-05-06 21:00:20,533 - __main__ - INFO - Monitor complete. Found 9 total results: 3 new rss results, 6 new yiddish24 results.
2026-05-06 21:00:20,533 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-05-06 21:00:20,533 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-06 21:00:20,613 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-05-06 21:00:20,613 - __main__ - INFO - Closed all database connections
2026-05-06 21:00:20,615 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-06 21:00:20,616 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-05-06 22:00:02,178 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-06.log
2026-05-06 22:00:02,179 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-06.log
2026-05-06 22:00:02,179 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-06.log
2026-05-06 22:00:02,179 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-05-06 22:00:02,202 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-05-06 22:00:02,202 - __main__ - INFO - Configuration loaded and validated successfully
2026-05-06 22:00:02,204 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-05-06 22:00:02,205 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-05-06 22:00:02,218 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-05-06 22:00:02,218 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-05-06 22:00:02,261 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-05-06 22:00:02,262 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=3, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0
2026-05-06 22:00:02,262 - __main__ - INFO - RSS scraper initialized and enabled
2026-05-06 22:00:02,264 - Yiddish24Scraper - INFO - File downloader initialized with 1 terms, prefix 'Y2', and file type organization enabled
2026-05-06 22:00:02,264 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=1, exclude_terms=0
2026-05-06 22:00:02,264 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-05-06 22:00:02,267 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0
2026-05-06 22:00:02,271 - TorahAnytimeScraper - INFO - File downloader initialized with 1 terms, prefix 'TA', and file type organization enabled
2026-05-06 22:00:02,271 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=1, exclude_terms=0
2026-05-06 22:00:02,273 - BatorahScraper - INFO - File downloader initialized with 1 terms, prefix 'BT', and file type organization enabled
2026-05-06 22:00:02,273 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=1, exclude_terms=0
2026-05-06 22:00:02,273 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=1
2026-05-06 22:00:02,273 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-05-06 22:00:02,273 - __main__ - INFO - Running 3 scrapers concurrently...
2026-05-06 22:00:02,273 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-05-06 22:00:02,368 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-05-06 22:00:02,372 - IveltScraper - INFO - Loaded 177 include, 0 exclude filters from DB topic_filters
2026-05-06 22:00:02,372 - IveltScraper - INFO - Fetching ivelt.com active topics...
2026-05-06 22:00:02,374 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-05-06 22:00:02,375 - IveltScraper - ERROR - FlareSolverr not reachable at http://localhost:8191/v1 — is the Docker container running? Start with: docker run -d --name flaresolverr --restart unless-stopped -p 8191:8191 -e LOG_LEVEL=info ghcr.io/flaresolverr/flaresolverr:latest
2026-05-06 22:00:02,375 - IveltScraper - INFO - FlareSolverr failed, trying curl_cffi cookie fallback...
2026-05-06 22:00:02,375 - IveltScraper - WARNING - No cf_clearance cookie set — skipping curl_cffi fallback
2026-05-06 22:00:02,677 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-05-06 22:00:03,132 - RSSFeedScraper - INFO - Fetching RSS feed: https://github.com/BuilderPulse/BuilderPulse/commits/main.atom
2026-05-06 22:00:03,567 - IveltScraper - ERROR - Failed to fetch ivelt.com active topics page
2026-05-06 22:00:03,730 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-06.md "HTTP/1.1 200 OK"
2026-05-06 22:00:04,578 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-06.md "HTTP/1.1 200 OK"
2026-05-06 22:00:05,715 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-05.md "HTTP/1.1 200 OK"
2026-05-06 22:00:06,583 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-05.md "HTTP/1.1 200 OK"
2026-05-06 22:00:06,775 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-05-06 22:00:06,971 - Yiddish24Scraper - INFO - Received response with 511471 characters
2026-05-06 22:00:06,973 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (317162 chars)
2026-05-06 22:00:06,975 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-05-06 22:00:07,036 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-05-06 22:00:07,075 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-05-06 22:00:07,075 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-05-06 22:00:07,813 - Yiddish24Scraper - INFO - Page 1 summary: 4 new out of 100 total articles
2026-05-06 22:00:07,813 - Yiddish24Scraper - INFO - Page 1: 4/100 new items
2026-05-06 22:00:07,813 - Yiddish24Scraper - INFO - Low new item ratio (4.0%), stopping pagination
2026-05-06 22:00:07,813 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 4
2026-05-06 22:00:07,970 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-04.md "HTTP/1.1 200 OK"
2026-05-06 22:00:08,825 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-04.md "HTTP/1.1 200 OK"
2026-05-06 22:00:09,958 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-03.md "HTTP/1.1 200 OK"
2026-05-06 22:00:10,829 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-03.md "HTTP/1.1 200 OK"
2026-05-06 22:00:11,962 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-02.md "HTTP/1.1 200 OK"
2026-05-06 22:00:12,832 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-02.md "HTTP/1.1 200 OK"
2026-05-06 22:00:13,965 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-01.md "HTTP/1.1 200 OK"
2026-05-06 22:00:14,835 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-01.md "HTTP/1.1 200 OK"
2026-05-06 22:00:15,972 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-04-30.md "HTTP/1.1 200 OK"
2026-05-06 22:00:16,838 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-04-30.md "HTTP/1.1 200 OK"
2026-05-06 22:00:17,980 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-04-29.md "HTTP/1.1 200 OK"
2026-05-06 22:00:18,842 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-04-29.md "HTTP/1.1 200 OK"
2026-05-06 22:00:19,995 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-04-28.md "HTTP/1.1 200 OK"
2026-05-06 22:00:20,017 - RSSFeedScraper - INFO - Total RSS/HTML results: 3
2026-05-06 22:00:20,017 - __main__ - INFO - Scraper rss completed: 3 results
2026-05-06 22:00:20,017 - __main__ - INFO - Scraper yiddish24 completed: 4 results
2026-05-06 22:00:20,017 - __main__ - INFO - Scraper ivelt completed: 0 results
2026-05-06 22:00:20,806 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-06 22:00:20.806261
2026-05-06 22:00:20,806 - __main__ - INFO - Email sent successfully
2026-05-06 22:00:20,806 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-05-06 22:00:20,807 - __main__ - INFO - Monitor complete. Found 7 total results: 3 new rss results, 4 new yiddish24 results.
2026-05-06 22:00:20,807 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-05-06 22:00:20,807 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-06 22:00:20,883 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-05-06 22:00:20,883 - __main__ - INFO - Closed all database connections
2026-05-06 22:00:20,885 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-06 22:00:20,885 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-05-06 22:30:02,345 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-06.log
2026-05-06 22:30:02,347 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-06.log
2026-05-06 22:30:02,347 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-06.log
2026-05-06 22:30:02,347 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-05-06 22:30:02,369 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-05-06 22:30:02,370 - social_media_monitor.config.settings - WARNING - Twitter monitoring enabled but credentials validation not implemented
2026-05-06 22:30:02,370 - __main__ - INFO - Configuration loaded and validated successfully
2026-05-06 22:30:02,372 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-05-06 22:30:02,372 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-05-06 22:30:02,395 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-05-06 22:30:02,395 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-05-06 22:30:02,396 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-05-06 22:30:02,396 - __main__ - INFO - Reddit scraper initialized and enabled
2026-05-06 22:30:02,396 - __main__ - INFO - GitHub scraper initialized and enabled
2026-05-06 22:30:02,396 - __main__ - INFO - Twitter scraper initialized and enabled
2026-05-06 22:30:02,397 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=3, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0
2026-05-06 22:30:02,397 - __main__ - INFO - LinkedIn scraper initialized and enabled
2026-05-06 22:30:02,397 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled
2026-05-06 22:30:02,399 - Yiddish24Scraper - INFO - File downloader initialized with 1 terms, prefix 'Y2', and file type organization enabled
2026-05-06 22:30:02,399 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=1, exclude_terms=0
2026-05-06 22:30:02,402 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0
2026-05-06 22:30:02,406 - TorahAnytimeScraper - INFO - File downloader initialized with 1 terms, prefix 'TA', and file type organization enabled
2026-05-06 22:30:02,406 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=1, exclude_terms=0
2026-05-06 22:30:02,408 - BatorahScraper - INFO - File downloader initialized with 1 terms, prefix 'BT', and file type organization enabled
2026-05-06 22:30:02,408 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=1, exclude_terms=0
2026-05-06 22:30:02,408 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=1
2026-05-06 22:30:02,408 - __main__ - INFO - Running 5 scrapers concurrently...
2026-05-06 22:30:02,408 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit search monitoring enabled. Running search with terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-06 22:30:02,408 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['"Hermes Agent"']
2026-05-06 22:30:03,270 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term '"Hermes Agent"'
2026-05-06 22:30:03,309 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: The 7 Levels of Hermes Agent Explained
2026-05-06 22:30:03,325 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: How to use Hermes Agent for FREE!
2026-05-06 22:30:04,521 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 2
2026-05-06 22:30:04,521 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'paperclip' restricted to subreddits: ['PaperClip_AI', 'PaperclipAI', 'pAIperclip', 'singularity', 'ControlProblem', 'AIalignment', 'localLLaMA', 'ArtificialInteligence', 'MachineLearning']
2026-05-06 22:30:04,521 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['paperclip']
2026-05-06 22:30:04,521 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/PaperClip_AI+PaperclipAI+pAIperclip+singularity+ControlProblem+AIalignment+localLLaMA+ArtificialInteligence+MachineLearning
2026-05-06 22:30:05,841 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'paperclip'
2026-05-06 22:30:05,880 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: help with modding an already modded 360slim
2026-05-06 22:30:07,048 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 1
2026-05-06 22:30:07,049 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'multica' restricted to subreddits: ['hermesagent', 'HermesAI', 'AI_Agents', 'aiagents', 'AgentsOfAI', 'LocalLLaMA', 'AutoGPT', 'ClaudeCode', 'ClaudeAI', 'claude', 'vibecoding']
2026-05-06 22:30:07,049 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['multica']
2026-05-06 22:30:07,049 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/hermesagent+HermesAI+AI_Agents+aiagents+AgentsOfAI+LocalLLaMA+AutoGPT+ClaudeCode+ClaudeAI+claude+vibecoding
2026-05-06 22:30:08,193 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'multica'
2026-05-06 22:30:09,422 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0
2026-05-06 22:30:09,423 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit subreddit feed monitoring enabled.
2026-05-06 22:30:09,423 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'hermes_agent': r/hermesagent+HermesAI+AI_Agents+aiagents+AgentsOfAI+LocalLLaMA+AutoGPT (limit=25)
2026-05-06 22:30:09,423 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes agent via RSS
2026-05-06 22:30:10,318 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/PostAI: The 7 Levels of Hermes Agent Explained
2026-05-06 22:30:10,328 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/AISEOInsider: How to use Hermes Agent for FREE!
2026-05-06 22:30:11,489 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes AI via RSS
2026-05-06 22:30:13,685 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: nous research hermes via RSS
2026-05-06 22:30:16,165 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: multica via RSS
2026-05-06 22:30:18,203 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'paperclip_ai': r/PaperClip_AI+PaperclipAI+pAIperclip (limit=25)
2026-05-06 22:30:18,203 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip ai via RSS
2026-05-06 22:30:20,966 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip agent via RSS
2026-05-06 22:30:23,029 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: multica via RSS
2026-05-06 22:30:24,958 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'claude_agents': r/ClaudeCode+ClaudeAI+claude+vibecoding (limit=25)
2026-05-06 22:30:24,958 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: claude agent via RSS
2026-05-06 22:30:25,915 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/LocalLLM: I benchmarked LLMs on browser-harness and open-weight models are actua
2026-05-06 22:30:25,929 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/vibecoding: Vibecoding from nothing to a app in 27 days...
2026-05-06 22:30:25,942 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeCode: In the era of 1B-token flexing, I saved 1B tokens in Claude code!
2026-05-06 22:30:25,954 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/u_aalejos: Claude Code: Agente AI para depurar Kubernetes con VictoriaMetrics
2026-05-06 22:30:25,963 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/HomeServer: tested 200+ self hosted apps so you dont have to (collected all the pr
2026-05-06 22:30:25,974 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeAI: Email Skill – give Claude a safe way to email you
2026-05-06 22:30:25,987 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/Gentmind: The 5 Stages of AI that 99% of people don't know about! ✨
2026-05-06 22:30:25,997 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/brdev: A explosão da Bolha IA - segurem as cadeiras
2026-05-06 22:30:26,010 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/LocalLLaMA: what's genuinely so special about claude?
2026-05-06 22:30:26,022 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/Gentoo: Nope, the machine hasn't given up, yet! A whopping 23 hrs...🤣
2026-05-06 22:30:26,035 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeCode: Claude Recall v0.6: searchable index of every Claude Code session on y
2026-05-06 22:30:26,049 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/servicenow: Knowledge 2026 day 2 keynote. data fabric, autonomous governance, cont
2026-05-06 22:30:26,059 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/MacOS: iCloud's 2.99$ 200GB filled up, so macOS silently deleted 25.000+ of m
2026-05-06 22:30:26,068 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/emacsporn: Scanning .....and Eric Clapton 🎸🎸 #linuxadmin #tool #rss #emacs #elfee
2026-05-06 22:30:26,080 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeCode: Are we still calling these things "AI coding assistants"? I think the
2026-05-06 22:30:26,091 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeCode: Opus speed running me a ban
2026-05-06 22:30:26,105 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/AIBizHub: Claude Opus 4.7 vs GPT-5.5 : for Founders running a Brand day to day
2026-05-06 22:30:26,120 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/singularity: Three key areas Anthropic is working on for their next models
2026-05-06 22:30:26,137 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/VibeCodeDevs: Made a workflow to deploy websites directly from Claude Design
2026-05-06 22:30:27,137 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: claude code agent via RSS
2026-05-06 22:30:28,239 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ChatGPT: Accidentally built something useful trying to fix my own terrible prom
2026-05-06 22:30:28,250 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeAI: Accidentally built something useful trying to fix my own terrible prom
2026-05-06 22:30:28,261 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeCode: Do I have flow-state fatigue?
2026-05-06 22:30:28,274 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/FactoryAi: Questions and a bug I found with Droid in Zed
2026-05-06 22:30:28,286 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/startups: Building with kids (I will not promote)
2026-05-06 22:30:28,298 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/claudeskills: after 6 months of claude code i finally figured out what i was doing w
2026-05-06 22:30:28,321 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/OpenHFY: Firentis Family Vacation: Day 5, The Handover
2026-05-06 22:30:28,357 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/vibecoding: I built an open-source persistent memory system for Claude Code it giv
2026-05-06 22:30:28,370 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/SaasDevelopers: I was juggling 7 different API keys and billing accounts every month.
2026-05-06 22:30:28,380 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeCode: How do you connect Adobe to claude code terminal?
2026-05-06 22:30:28,390 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeCode: Cant sign into Desktop for months
2026-05-06 22:30:28,408 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/codex: I Almost Built an OpenClaw Killer by Accident, Using Codex App Server
2026-05-06 22:30:28,419 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/hermesagent: Gpt 5.5 personality and writing
2026-05-06 22:30:28,430 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/skopx_: Claude Code Conversations - AI Assisted Development
2026-05-06 22:30:28,443 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/oMLX: Is this performance on par?
2026-05-06 22:30:28,455 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/vibecoding: In the era of 1B-token flexing, I saved 1B tokens in Claude code!
2026-05-06 22:30:28,468 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/cybersecurity: Hot-take. Mythos is not discovering zero vulnerabilities, it is recogn
2026-05-06 22:30:29,468 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: AI coding agent via RSS
2026-05-06 22:30:30,888 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/hiking: Hi does anyone know of another company making a compressible vented pa
2026-05-06 22:30:30,904 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/AISEOInsider: This Manus Cloud Computer AI Update Will Blow Your Mind
2026-05-06 22:30:30,916 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/vibecoding: How do you vibe code at work?
2026-05-06 22:30:30,927 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/vibecoding: AI = DUMBER ?
2026-05-06 22:30:30,936 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/CitizenWatchNews: FBI SWAT storms Virginia Senate President Pro Tempore L. Louise Lucas
2026-05-06 22:30:30,946 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/burnaby: Free AI Builder Event at SFU
2026-05-06 22:30:30,959 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/facebook: Overthinking PANIC!! Meta support chat / agent link. Any advice please
2026-05-06 22:30:30,972 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/gamers: I built AI agents that are born, live, fall in love, create art, and d
2026-05-06 22:30:31,005 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/SouthFLOrthodontist: 2026’s Best Kept Secret for Kids’ Braces in Pembroke Pines: SMILE-FX®
2026-05-06 22:30:31,015 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/laravel: Laravel AI SDK in action in Jarvis
2026-05-06 22:30:31,025 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/skopx_: Why AI Agents Will Replace Dashboards by 2027
2026-05-06 22:30:31,037 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/altcoins: Here’s what I can tell you after using nanos wallet agents for over 2
2026-05-06 22:30:31,047 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/skopx_: What Is an AI Agent? Complete Guide
2026-05-06 22:30:31,058 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/skopx_: Best AI Tools for Data Analysis Without Coding
2026-05-06 22:30:32,058 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: multica via RSS
2026-05-06 22:30:34,050 - social_media_monitor.scrapers.reddit_scraper - INFO - Total subreddit feed results: 52
2026-05-06 22:30:34,051 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-06 22:30:34,187 - TwitterScraper - INFO - Searching Twitter/X (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-06 22:30:34,629 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'paperclip'
2026-05-06 22:30:48,903 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for '"Hermes Agent"'
2026-05-06 22:31:03,000 - TwitterScraper - INFO - Twitter/X RSS: 94 entries for 'multica'
2026-05-06 22:31:15,669 - TwitterScraper - INFO - Twitter scrape complete. Found 0 new results.
2026-05-06 22:31:15,670 - LinkedInScraper - INFO - Searching LinkedIn (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-06 22:31:16,242 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'paperclip'
2026-05-06 22:31:16,339 - LinkedInScraper - INFO - New LinkedIn post: Just posted a fun new working paper with Chris Berg on the AI papercli
2026-05-06 22:31:16,384 - LinkedInScraper - INFO - New LinkedIn post: Opus 4.7 feels like paperclip maximizer 1. User says X 2. Model implic
2026-05-06 22:31:16,414 - LinkedInScraper - INFO - New LinkedIn post: How I interact with #Paperclip ▶️ Create an issue See if you can recei
2026-05-06 22:31:17,521 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for '"Hermes Agent"'
2026-05-06 22:31:17,610 - LinkedInScraper - INFO - New LinkedIn post: How Hermes Agent Solves Skill Drift and Context Rot as a Self-Improvin
2026-05-06 22:31:18,055 - LinkedInScraper - INFO - New LinkedIn post: AI coding agents have a HUGE memory problem. You make 30 decisions acr
2026-05-06 22:31:18,826 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'multica'
2026-05-06 22:31:19,647 - LinkedInScraper - INFO - LinkedIn scrape complete. Found 5 new results.
2026-05-06 22:31:19,648 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)
2026-05-06 22:31:23,296 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-05-06 22:31:23,321 - GitHubScraper - INFO - Found 226 GitHub repositories for term: paperclip
2026-05-06 22:31:23,356 - GitHubScraper - INFO - Added new GitHub repository: awesome-ruby
2026-05-06 22:31:24,343 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-05-06 22:31:24,347 - GitHubScraper - INFO - Found 179 GitHub repositories for term: "Hermes Agent"
2026-05-06 22:31:25,420 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-05-06 22:31:25,512 - GitHubScraper - INFO - Found 40 GitHub repositories for term: multica
2026-05-06 22:31:25,688 - GitHubScraper - INFO - Total GitHub results found: 1
2026-05-06 22:31:25,688 - __main__ - INFO - Scraper reddit completed: 55 results
2026-05-06 22:31:25,688 - __main__ - INFO - Scraper github completed: 1 results
2026-05-06 22:31:25,688 - __main__ - INFO - Scraper twitter completed: 0 results
2026-05-06 22:31:25,688 - __main__ - INFO - Scraper linkedin completed: 5 results
2026-05-06 22:31:25,688 - __main__ - INFO - Scraper linkedin_feed completed: 0 results
2026-05-06 22:31:26,535 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-06 22:31:26.535440
2026-05-06 22:31:26,535 - __main__ - INFO - Email sent successfully
2026-05-06 22:31:26,536 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-05-06 22:31:26,536 - __main__ - INFO - Monitor complete. Found 61 total results: 55 new reddit results, 1 new github results, 5 new linkedin results.
2026-05-06 22:31:26,536 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-05-06 22:31:26,536 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-06 22:31:26,680 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-05-06 22:31:26,681 - __main__ - INFO - Closed all database connections
2026-05-06 22:31:26,712 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-06 22:31:26,728 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-05-06 23:00:01,682 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-06.log
2026-05-06 23:00:01,682 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-06.log
2026-05-06 23:00:01,682 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-06.log
2026-05-06 23:00:01,682 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-05-06 23:00:01,707 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-05-06 23:00:01,707 - __main__ - INFO - Configuration loaded and validated successfully
2026-05-06 23:00:01,709 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-05-06 23:00:01,710 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-05-06 23:00:01,729 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-05-06 23:00:01,729 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-05-06 23:00:01,730 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-05-06 23:00:01,731 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=3, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0
2026-05-06 23:00:01,731 - __main__ - INFO - RSS scraper initialized and enabled
2026-05-06 23:00:01,733 - Yiddish24Scraper - INFO - File downloader initialized with 1 terms, prefix 'Y2', and file type organization enabled
2026-05-06 23:00:01,733 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=1, exclude_terms=0
2026-05-06 23:00:01,733 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-05-06 23:00:01,736 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0
2026-05-06 23:00:01,740 - TorahAnytimeScraper - INFO - File downloader initialized with 1 terms, prefix 'TA', and file type organization enabled
2026-05-06 23:00:01,740 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=1, exclude_terms=0
2026-05-06 23:00:01,742 - BatorahScraper - INFO - File downloader initialized with 1 terms, prefix 'BT', and file type organization enabled
2026-05-06 23:00:01,742 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=1, exclude_terms=0
2026-05-06 23:00:01,742 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=1
2026-05-06 23:00:01,742 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-05-06 23:00:01,743 - __main__ - INFO - Running 3 scrapers concurrently...
2026-05-06 23:00:01,743 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-05-06 23:00:01,844 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-05-06 23:00:01,848 - IveltScraper - INFO - Loaded 177 include, 0 exclude filters from DB topic_filters
2026-05-06 23:00:01,848 - IveltScraper - INFO - Fetching ivelt.com active topics...
2026-05-06 23:00:01,850 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-05-06 23:00:01,854 - IveltScraper - ERROR - FlareSolverr not reachable at http://localhost:8191/v1 — is the Docker container running? Start with: docker run -d --name flaresolverr --restart unless-stopped -p 8191:8191 -e LOG_LEVEL=info ghcr.io/flaresolverr/flaresolverr:latest
2026-05-06 23:00:01,854 - IveltScraper - INFO - FlareSolverr failed, trying curl_cffi cookie fallback...
2026-05-06 23:00:01,854 - IveltScraper - WARNING - No cf_clearance cookie set — skipping curl_cffi fallback
2026-05-06 23:00:02,229 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-05-06 23:00:02,733 - RSSFeedScraper - INFO - Fetching RSS feed: https://github.com/BuilderPulse/BuilderPulse/commits/main.atom
2026-05-06 23:00:03,103 - IveltScraper - ERROR - Failed to fetch ivelt.com active topics page
2026-05-06 23:00:03,273 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-06.md "HTTP/1.1 200 OK"
2026-05-06 23:00:04,113 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-06.md "HTTP/1.1 200 OK"
2026-05-06 23:00:05,270 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-05.md "HTTP/1.1 200 OK"
2026-05-06 23:00:06,117 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-05.md "HTTP/1.1 200 OK"
2026-05-06 23:00:06,307 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-05-06 23:00:06,516 - Yiddish24Scraper - INFO - Received response with 520562 characters
2026-05-06 23:00:06,519 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (320896 chars)
2026-05-06 23:00:06,522 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-05-06 23:00:06,623 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-05-06 23:00:06,673 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-05-06 23:00:06,673 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-05-06 23:00:07,598 - Yiddish24Scraper - INFO - Page 1 summary: 4 new out of 100 total articles
2026-05-06 23:00:07,598 - Yiddish24Scraper - INFO - Page 1: 4/100 new items
2026-05-06 23:00:07,598 - Yiddish24Scraper - INFO - Low new item ratio (4.0%), stopping pagination
2026-05-06 23:00:07,599 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 4
2026-05-06 23:00:07,757 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-04.md "HTTP/1.1 200 OK"
2026-05-06 23:00:08,611 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-04.md "HTTP/1.1 200 OK"
2026-05-06 23:00:09,752 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-03.md "HTTP/1.1 200 OK"
2026-05-06 23:00:10,615 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-03.md "HTTP/1.1 200 OK"
2026-05-06 23:00:11,771 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-02.md "HTTP/1.1 200 OK"
2026-05-06 23:00:12,618 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-02.md "HTTP/1.1 200 OK"
2026-05-06 23:00:13,768 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-01.md "HTTP/1.1 200 OK"
2026-05-06 23:00:14,622 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-01.md "HTTP/1.1 200 OK"
2026-05-06 23:00:15,793 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-04-30.md "HTTP/1.1 200 OK"
2026-05-06 23:00:16,626 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-04-30.md "HTTP/1.1 200 OK"
2026-05-06 23:00:17,783 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-04-29.md "HTTP/1.1 200 OK"
2026-05-06 23:00:18,630 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-04-29.md "HTTP/1.1 200 OK"
2026-05-06 23:00:19,769 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-04-28.md "HTTP/1.1 200 OK"
2026-05-06 23:00:19,790 - RSSFeedScraper - INFO - Total RSS/HTML results: 3
2026-05-06 23:00:19,791 - __main__ - INFO - Scraper rss completed: 3 results
2026-05-06 23:00:19,791 - __main__ - INFO - Scraper yiddish24 completed: 4 results
2026-05-06 23:00:19,791 - __main__ - INFO - Scraper ivelt completed: 0 results
2026-05-06 23:00:20,496 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-06 23:00:20.496666
2026-05-06 23:00:20,497 - __main__ - INFO - Email sent successfully
2026-05-06 23:00:20,497 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-05-06 23:00:20,497 - __main__ - INFO - Monitor complete. Found 7 total results: 3 new rss results, 4 new yiddish24 results.
2026-05-06 23:00:20,497 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-05-06 23:00:20,497 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-06 23:00:20,632 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-05-06 23:00:20,632 - __main__ - INFO - Closed all database connections
2026-05-06 23:00:20,634 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-06 23:00:20,634 - social_media_monitor.database.connection - INFO - Closed 0 database connections