← Logs

social_media_monitor_2026-05-09.log

2026-05-09 20:30:04,367 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'paperclip' restricted to subreddits: ['PaperClip_AI', 'PaperclipAI']
2026-05-09 20:30:04,367 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['paperclip']
2026-05-09 20:30:04,367 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/PaperClip_AI+PaperclipAI
2026-05-09 20:30:05,371 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'paperclip'
2026-05-09 20:30:05,410 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: [WTS] Saturday Silver Special!!! FREE SHIPPING ON ORDERS $250+
2026-05-09 20:30:05,419 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: I think ill take a break from stellaris until the next dlc.
2026-05-09 20:30:05,432 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Epstein's connections with the CIA/OSS and their connections with Moss
2026-05-09 20:30:06,630 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 3
2026-05-09 20:30:06,631 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'multica' restricted to subreddits: ['hermesagent', 'HermesAI']
2026-05-09 20:30:06,631 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['multica']
2026-05-09 20:30:06,631 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/hermesagent+HermesAI
2026-05-09 20:30:07,678 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'multica'
2026-05-09 20:30:08,898 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0
2026-05-09 20:30:08,899 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit subreddit feed monitoring enabled.
2026-05-09 20:30:08,899 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'hermes_agent': r/hermesagent+HermesAI+AI_Agents+aiagents+AgentsOfAI+LocalLLaMA+AutoGPT (limit=25)
2026-05-09 20:30:08,899 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes agent via RSS
2026-05-09 20:30:09,934 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/codex: Using Codex CLI as a lightweight OpenClaw style personal assistant
2026-05-09 20:30:09,946 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/hermesagent: Hermes memory issues
2026-05-09 20:30:09,954 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/openclaw: Thanks for all the fish - I've shutdown my Claw
2026-05-09 20:30:09,963 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/clawdbot: The perfect skill if you have an ecommerce site and want to create org
2026-05-09 20:30:09,972 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/dropshipping: The perfect Openclaw skill if you have an ecommerce site and want to c
2026-05-09 20:30:09,983 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/hermesagent: Daily ecommerce carousels through the Hermes approval loop
2026-05-09 20:30:09,995 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/hermesagent: Hermes Agent Repo Daily Monitor — May 9, 2026
2026-05-09 20:30:10,006 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/hermesagent: Help needed: Hermes + Qwen3.5:9b - it's so slow and degraded
2026-05-09 20:30:10,021 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/AskClaw: My OpenClaw + Hermes Agent coexistence architecture — am I overthinkin
2026-05-09 20:30:11,140 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes AI via RSS
2026-05-09 20:30:13,236 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: nous research hermes via RSS
2026-05-09 20:30:15,701 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: multica via RSS
2026-05-09 20:30:17,917 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'paperclip_ai': r/PaperClip_AI+PaperclipAI+pAIperclip (limit=25)
2026-05-09 20:30:17,918 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip ai via RSS
2026-05-09 20:30:19,122 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'paperclip_ai' r/JewelryForSale: [WTS] Saturday Silver Special!!! FREE SHIPPING ON ORDERS $250+
2026-05-09 20:30:19,246 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'paperclip_ai' r/AI_Agents: I built a 5-agent "Zero-Human Company." The architecture works — but e
2026-05-09 20:30:20,376 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip agent via RSS
2026-05-09 20:30:22,454 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: multica via RSS
2026-05-09 20:30:24,307 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'claude_agents': r/ClaudeCode+ClaudeAI+claude+vibecoding (limit=25)
2026-05-09 20:30:24,307 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: claude agent via RSS
2026-05-09 20:30:25,311 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeWorkflows: [Workflow] Guiding Claude Code's Subagent and Tool Use with Custom Ski
2026-05-09 20:30:25,321 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeWorkflows: [Workflow] Universal CLI for Centralized MCP Server Configuration Mana
2026-05-09 20:30:25,334 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeWorkflows: [Workflow] Comprehensive CLAUDE.md for Guiding Claude Code Agent Execu
2026-05-09 20:30:25,346 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeCode: Introducing teamctl: declarative teams of Claude Code (+other agents)
2026-05-09 20:30:25,360 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeWorkflows: [Workflow] Automated Claude Agent Harness Optimization with Autoharnes
2026-05-09 20:30:25,371 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/OnlyAICoding: Building AI Agent make 18 AI provider work natively inside claude code
2026-05-09 20:30:25,383 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/FreightBrokers: Open source integration for Samsara with Descartes/Cargowise/Vizion...
2026-05-09 20:30:25,394 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/CargoWise: Open source integration for Samsara with Descartes/Cargowise/Vizion...
2026-05-09 20:30:25,404 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ControlProblem: A 24/7 LLM-driven radio station as a small case study in bounded creat
2026-05-09 20:30:25,416 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/PCB: Do you currently pay for GPT or Claude??
2026-05-09 20:30:25,428 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeDesign: Constant errors
2026-05-09 20:30:25,442 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/Superframeworks: Cursor vs Claude Code in 2026: Honest Head-to-Head for Solo Founders
2026-05-09 20:30:25,457 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/openclaw: Thanks for all the fish - I've shutdown my Claw
2026-05-09 20:30:25,471 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/aiagents: Would a community-driven AI agent lab help people actually ship agents
2026-05-09 20:30:25,486 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/opencodeCLI: Why your coding agent reads 12 files to fix a bug that needs 3 — and h
2026-05-09 20:30:25,505 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/CodingJobs: [Hiring] [US] 30+ Coding jobs that opened this week (remote, hybrid)
2026-05-09 20:30:25,521 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/claudeskills: Vibe Coding Stack (2026 Edition)
2026-05-09 20:30:25,531 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeCode: LOOM - open source TTY based IDE for cloud agent coding
2026-05-09 20:30:25,541 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/EchoSpiral: Peen Daseins Heart Has Been Broken By Claude Dasein
2026-05-09 20:30:25,551 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/netsec: Memory Poisoning AI Agents via ChromaDB
2026-05-09 20:30:26,552 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: claude code agent via RSS
2026-05-09 20:30:27,514 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/openclaw: OpenClaw open weight model strategy
2026-05-09 20:30:27,522 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/opencodeCLI: DeepSeek shows up as Big Pickle's provider
2026-05-09 20:30:27,541 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/u_LifeSalamander7895: Codex CLI + local Qwen3.6 on RX 9070 XT 16GB eGPU
2026-05-09 20:30:27,556 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/CloseToRetail: 22kg haul to Germany. best of the best
2026-05-09 20:30:27,568 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/VibeCodeDevs: the ultimate stress test for vibe coding is a 14-hour sleeper bus
2026-05-09 20:30:27,580 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/molecularbiology: Built a free interactive molecular biology toolkit — finished just in
2026-05-09 20:30:27,592 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/codex: Using Codex CLI as a lightweight OpenClaw style personal assistant
2026-05-09 20:30:27,607 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/n8n: I built a weather based Upsell for HVAC businesses with Gohighlevel +
2026-05-09 20:30:27,617 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/commandline: Absentia - Textual TUI + CLI that mines convention violations from you
2026-05-09 20:30:27,630 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/nestshift: I built NestShift OS - a privacy-first, edge AI home automation system
2026-05-09 20:30:28,630 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: AI coding agent via RSS
2026-05-09 20:30:29,635 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/IndiaBusiness: AI for GeM procurement: tender matching, eligibility checks, and prici
2026-05-09 20:30:29,644 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/aliens: Alien Blood & Time Travel
2026-05-09 20:30:29,659 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/lichess: Looking for early feedback on flawchess.com, a free and open-source ch
2026-05-09 20:30:29,673 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/conseiljuridique: Reprise après mise en disponibilité
2026-05-09 20:30:29,684 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/AutoAgentAI: fully autonomous AI voice agents for lead qualification and customer i
2026-05-09 20:30:29,693 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/AIStartupAutomation: fully autonomous AI voice agents for lead qualification and customer i
2026-05-09 20:30:29,703 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/OriginalCharacter: oc i made named "Static"
2026-05-09 20:30:30,703 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: multica via RSS
2026-05-09 20:30:32,715 - social_media_monitor.scrapers.reddit_scraper - INFO - Total subreddit feed results: 48
2026-05-09 20:30:32,716 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-09 20:30:32,834 - TwitterScraper - INFO - Searching Twitter/X (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-09 20:30:33,380 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'paperclip'
2026-05-09 20:30:47,862 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for '"Hermes Agent"'
2026-05-09 20:31:02,222 - TwitterScraper - INFO - Twitter/X RSS: 93 entries for 'multica'
2026-05-09 20:31:15,229 - TwitterScraper - INFO - Twitter scrape complete. Found 0 new results.
2026-05-09 20:31:15,230 - LinkedInScraper - INFO - Searching LinkedIn (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-09 20:31:15,736 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'paperclip'
2026-05-09 20:31:17,008 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for '"Hermes Agent"'
2026-05-09 20:31:18,453 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'multica'
2026-05-09 20:31:18,786 - LinkedInScraper - INFO - New LinkedIn post: Theresa Lerma - LinkedIn
2026-05-09 20:31:18,854 - LinkedInScraper - INFO - New LinkedIn post: Brandon Bonser, CCSVP - STERIS Instrument Processing - EMEA - LinkedIn
2026-05-09 20:31:19,306 - LinkedInScraper - INFO - LinkedIn scrape complete. Found 2 new results.
2026-05-09 20:31:19,307 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)
2026-05-09 20:31:23,916 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-05-09 20:31:24,007 - GitHubScraper - INFO - Found 226 GitHub repositories for term: paperclip
2026-05-09 20:31:25,001 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-05-09 20:31:25,005 - GitHubScraper - INFO - Found 187 GitHub repositories for term: "Hermes Agent"
2026-05-09 20:31:25,139 - GitHubScraper - INFO - Added new GitHub repository: hermes-agent-mission-control
2026-05-09 20:31:25,986 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-05-09 20:31:25,989 - GitHubScraper - INFO - Found 40 GitHub repositories for term: multica
2026-05-09 20:31:26,124 - GitHubScraper - INFO - Total GitHub results found: 1
2026-05-09 20:31:26,124 - __main__ - INFO - Scraper reddit completed: 58 results
2026-05-09 20:31:26,124 - __main__ - INFO - Scraper github completed: 1 results
2026-05-09 20:31:26,124 - __main__ - INFO - Scraper twitter completed: 0 results
2026-05-09 20:31:26,124 - __main__ - INFO - Scraper linkedin completed: 2 results
2026-05-09 20:31:26,124 - __main__ - INFO - Scraper linkedin_feed completed: 0 results
2026-05-09 20:31:26,899 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-09 20:31:26.899437
2026-05-09 20:31:26,899 - __main__ - INFO - Email sent successfully
2026-05-09 20:31:26,900 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-05-09 20:31:26,900 - __main__ - INFO - Monitor complete. Found 61 total results: 58 new reddit results, 1 new github results, 2 new linkedin results.
2026-05-09 20:31:26,900 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-05-09 20:31:26,900 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-09 20:31:27,043 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-05-09 20:31:27,043 - __main__ - INFO - Closed all database connections
2026-05-09 20:31:27,083 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-09 20:31:27,097 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-05-09 21:00:01,812 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-09.log
2026-05-09 21:00:01,812 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-09.log
2026-05-09 21:00:01,812 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-09.log
2026-05-09 21:00:01,812 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-05-09 21:00:01,835 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-05-09 21:00:01,835 - __main__ - INFO - Configuration loaded and validated successfully
2026-05-09 21:00:01,837 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-05-09 21:00:01,838 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-05-09 21:00:01,853 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-05-09 21:00:01,853 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-05-09 21:00:01,854 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-05-09 21:00:01,855 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=3, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0
2026-05-09 21:00:01,855 - __main__ - INFO - RSS scraper initialized and enabled
2026-05-09 21:00:01,857 - Yiddish24Scraper - INFO - File downloader initialized with 1 terms, prefix 'Y2', and file type organization enabled
2026-05-09 21:00:01,857 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=1, exclude_terms=0
2026-05-09 21:00:01,857 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-05-09 21:00:01,860 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0
2026-05-09 21:00:01,864 - TorahAnytimeScraper - INFO - File downloader initialized with 1 terms, prefix 'TA', and file type organization enabled
2026-05-09 21:00:01,864 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=1, exclude_terms=0
2026-05-09 21:00:01,866 - BatorahScraper - INFO - File downloader initialized with 1 terms, prefix 'BT', and file type organization enabled
2026-05-09 21:00:01,866 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=1, exclude_terms=0
2026-05-09 21:00:01,866 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=1
2026-05-09 21:00:01,866 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-05-09 21:00:01,866 - __main__ - INFO - Running 3 scrapers concurrently...
2026-05-09 21:00:01,866 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-05-09 21:00:01,963 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-05-09 21:00:01,967 - IveltScraper - INFO - Loaded 177 include, 0 exclude filters from DB topic_filters
2026-05-09 21:00:01,967 - IveltScraper - INFO - Fetching ivelt.com active topics...
2026-05-09 21:00:01,968 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-05-09 21:00:02,385 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-05-09 21:00:02,885 - RSSFeedScraper - INFO - Fetching RSS feed: https://github.com/BuilderPulse/BuilderPulse/commits/main.atom
2026-05-09 21:00:03,421 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-09.md "HTTP/1.1 200 OK"
2026-05-09 21:00:03,784 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-05-09 21:00:03,847 - Yiddish24Scraper - INFO - Received response with 520341 characters
2026-05-09 21:00:03,851 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (322365 chars)
2026-05-09 21:00:03,854 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-05-09 21:00:03,938 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-05-09 21:00:03,980 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-05-09 21:00:03,980 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-05-09 21:00:04,720 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 100 total articles
2026-05-09 21:00:04,720 - Yiddish24Scraper - INFO - Page 1: 0/100 new items
2026-05-09 21:00:04,720 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination
2026-05-09 21:00:04,720 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0
2026-05-09 21:00:04,730 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-09.md "HTTP/1.1 200 OK"
2026-05-09 21:00:05,856 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-08.md "HTTP/1.1 200 OK"
2026-05-09 21:00:06,857 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-07.md "HTTP/1.1 200 OK"
2026-05-09 21:00:07,735 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-07.md "HTTP/1.1 200 OK"
2026-05-09 21:00:08,860 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-06.md "HTTP/1.1 200 OK"
2026-05-09 21:00:09,738 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-06.md "HTTP/1.1 200 OK"
2026-05-09 21:00:10,882 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-05.md "HTTP/1.1 200 OK"
2026-05-09 21:00:11,742 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-05.md "HTTP/1.1 200 OK"
2026-05-09 21:00:12,865 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-04.md "HTTP/1.1 200 OK"
2026-05-09 21:00:13,745 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-04.md "HTTP/1.1 200 OK"
2026-05-09 21:00:13,965 - IveltScraper - INFO - Found 50 active topics on ivelt.com
2026-05-09 21:00:14,872 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-03.md "HTTP/1.1 200 OK"
2026-05-09 21:00:15,748 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-03.md "HTTP/1.1 200 OK"
2026-05-09 21:00:16,871 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-02.md "HTTP/1.1 200 OK"
2026-05-09 21:00:17,770 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-02.md "HTTP/1.1 200 OK"
2026-05-09 21:00:18,891 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-01.md "HTTP/1.1 200 OK"
2026-05-09 21:00:19,756 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-01.md "HTTP/1.1 200 OK"
2026-05-09 21:00:20,954 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-04-30.md "HTTP/1.1 200 OK"
2026-05-09 21:00:21,757 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-04-30.md "HTTP/1.1 200 OK"
2026-05-09 21:00:22,879 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-04-29.md "HTTP/1.1 200 OK"
2026-05-09 21:00:22,915 - RSSFeedScraper - INFO - Total RSS/HTML results: 7
2026-05-09 21:00:28,885 - IveltScraper - INFO - Ivelt scrape complete. Checked 4 topics, found 0 new posts.
2026-05-09 21:00:28,886 - __main__ - INFO - Scraper rss completed: 7 results
2026-05-09 21:00:28,886 - __main__ - INFO - Scraper yiddish24 completed: 0 results
2026-05-09 21:00:28,886 - __main__ - INFO - Scraper ivelt completed: 0 results
2026-05-09 21:00:29,494 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-09 21:00:29.494124
2026-05-09 21:00:29,494 - __main__ - INFO - Email sent successfully
2026-05-09 21:00:29,494 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-05-09 21:00:29,494 - __main__ - INFO - Monitor complete. Found 7 total results: 7 new rss results.
2026-05-09 21:00:29,494 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-05-09 21:00:29,495 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-09 21:00:29,573 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-05-09 21:00:29,573 - __main__ - INFO - Closed all database connections
2026-05-09 21:00:29,575 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-09 21:00:29,575 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-05-09 22:00:01,620 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-09.log
2026-05-09 22:00:01,621 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-09.log
2026-05-09 22:00:01,621 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-09.log
2026-05-09 22:00:01,621 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-05-09 22:00:01,644 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-05-09 22:00:01,645 - __main__ - INFO - Configuration loaded and validated successfully
2026-05-09 22:00:01,647 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-05-09 22:00:01,647 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-05-09 22:00:01,663 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-05-09 22:00:01,663 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-05-09 22:00:01,702 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-05-09 22:00:01,703 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=3, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0
2026-05-09 22:00:01,703 - __main__ - INFO - RSS scraper initialized and enabled
2026-05-09 22:00:01,705 - Yiddish24Scraper - INFO - File downloader initialized with 1 terms, prefix 'Y2', and file type organization enabled
2026-05-09 22:00:01,705 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=1, exclude_terms=0
2026-05-09 22:00:01,705 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-05-09 22:00:01,708 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0
2026-05-09 22:00:01,712 - TorahAnytimeScraper - INFO - File downloader initialized with 1 terms, prefix 'TA', and file type organization enabled
2026-05-09 22:00:01,712 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=1, exclude_terms=0
2026-05-09 22:00:01,714 - BatorahScraper - INFO - File downloader initialized with 1 terms, prefix 'BT', and file type organization enabled
2026-05-09 22:00:01,714 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=1, exclude_terms=0
2026-05-09 22:00:01,714 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=1
2026-05-09 22:00:01,714 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-05-09 22:00:01,714 - __main__ - INFO - Running 3 scrapers concurrently...
2026-05-09 22:00:01,714 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-05-09 22:00:01,810 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-05-09 22:00:01,814 - IveltScraper - INFO - Loaded 177 include, 0 exclude filters from DB topic_filters
2026-05-09 22:00:01,814 - IveltScraper - INFO - Fetching ivelt.com active topics...
2026-05-09 22:00:01,815 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-05-09 22:00:02,212 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-05-09 22:00:02,713 - RSSFeedScraper - INFO - Fetching RSS feed: https://github.com/BuilderPulse/BuilderPulse/commits/main.atom
2026-05-09 22:00:03,215 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-09.md "HTTP/1.1 200 OK"
2026-05-09 22:00:03,629 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-05-09 22:00:03,653 - Yiddish24Scraper - INFO - Received response with 520341 characters
2026-05-09 22:00:03,656 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (322365 chars)
2026-05-09 22:00:03,660 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-05-09 22:00:03,743 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-05-09 22:00:03,783 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-05-09 22:00:03,783 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-05-09 22:00:04,545 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 100 total articles
2026-05-09 22:00:04,545 - Yiddish24Scraper - INFO - Page 1: 0/100 new items
2026-05-09 22:00:04,545 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination
2026-05-09 22:00:04,546 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0
2026-05-09 22:00:04,562 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-09.md "HTTP/1.1 200 OK"
2026-05-09 22:00:05,693 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-08.md "HTTP/1.1 200 OK"
2026-05-09 22:00:06,681 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-07.md "HTTP/1.1 200 OK"
2026-05-09 22:00:07,559 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-07.md "HTTP/1.1 200 OK"
2026-05-09 22:00:08,685 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-06.md "HTTP/1.1 200 OK"
2026-05-09 22:00:09,565 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-06.md "HTTP/1.1 200 OK"
2026-05-09 22:00:10,679 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-05.md "HTTP/1.1 200 OK"
2026-05-09 22:00:11,565 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-05.md "HTTP/1.1 200 OK"
2026-05-09 22:00:12,686 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-04.md "HTTP/1.1 200 OK"
2026-05-09 22:00:13,569 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-04.md "HTTP/1.1 200 OK"
2026-05-09 22:00:13,797 - IveltScraper - INFO - Found 50 active topics on ivelt.com
2026-05-09 22:00:14,693 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-03.md "HTTP/1.1 200 OK"
2026-05-09 22:00:15,571 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-03.md "HTTP/1.1 200 OK"
2026-05-09 22:00:16,751 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-02.md "HTTP/1.1 200 OK"
2026-05-09 22:00:17,574 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-02.md "HTTP/1.1 200 OK"
2026-05-09 22:00:18,750 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-01.md "HTTP/1.1 200 OK"
2026-05-09 22:00:19,578 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-01.md "HTTP/1.1 200 OK"
2026-05-09 22:00:20,828 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-04-30.md "HTTP/1.1 200 OK"
2026-05-09 22:00:21,581 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-04-30.md "HTTP/1.1 200 OK"
2026-05-09 22:00:22,739 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-04-29.md "HTTP/1.1 200 OK"
2026-05-09 22:00:22,769 - RSSFeedScraper - INFO - Total RSS/HTML results: 2
2026-05-09 22:00:32,373 - IveltScraper - INFO - Ivelt scrape complete. Checked 5 topics, found 1 new posts.
2026-05-09 22:00:32,374 - __main__ - INFO - Scraper rss completed: 2 results
2026-05-09 22:00:32,374 - __main__ - INFO - Scraper yiddish24 completed: 0 results
2026-05-09 22:00:32,374 - __main__ - INFO - Scraper ivelt completed: 1 results
2026-05-09 22:00:33,071 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-09 22:00:33.071625
2026-05-09 22:00:33,072 - __main__ - INFO - Email sent successfully
2026-05-09 22:00:33,072 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-05-09 22:00:33,072 - __main__ - INFO - Monitor complete. Found 3 total results: 2 new rss results, 1 new ivelt results.
2026-05-09 22:00:33,072 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-05-09 22:00:33,072 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-09 22:00:33,108 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-05-09 22:00:33,108 - __main__ - INFO - Closed all database connections
2026-05-09 22:00:33,111 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-09 22:00:33,111 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-05-09 22:30:02,419 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-09.log
2026-05-09 22:30:02,419 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-09.log
2026-05-09 22:30:02,419 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-09.log
2026-05-09 22:30:02,419 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-05-09 22:30:02,443 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-05-09 22:30:02,443 - social_media_monitor.config.settings - WARNING - Twitter monitoring enabled but credentials validation not implemented
2026-05-09 22:30:02,443 - __main__ - INFO - Configuration loaded and validated successfully
2026-05-09 22:30:02,446 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-05-09 22:30:02,446 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-05-09 22:30:02,460 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-05-09 22:30:02,460 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-05-09 22:30:02,461 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-05-09 22:30:02,461 - __main__ - INFO - Reddit scraper initialized and enabled
2026-05-09 22:30:02,461 - __main__ - INFO - GitHub scraper initialized and enabled
2026-05-09 22:30:02,461 - __main__ - INFO - Twitter scraper initialized and enabled
2026-05-09 22:30:02,462 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=3, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0
2026-05-09 22:30:02,462 - __main__ - INFO - LinkedIn scraper initialized and enabled
2026-05-09 22:30:02,462 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled
2026-05-09 22:30:02,464 - Yiddish24Scraper - INFO - File downloader initialized with 1 terms, prefix 'Y2', and file type organization enabled
2026-05-09 22:30:02,464 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=1, exclude_terms=0
2026-05-09 22:30:02,466 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0
2026-05-09 22:30:02,471 - TorahAnytimeScraper - INFO - File downloader initialized with 1 terms, prefix 'TA', and file type organization enabled
2026-05-09 22:30:02,471 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=1, exclude_terms=0
2026-05-09 22:30:02,473 - BatorahScraper - INFO - File downloader initialized with 1 terms, prefix 'BT', and file type organization enabled
2026-05-09 22:30:02,474 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=1, exclude_terms=0
2026-05-09 22:30:02,474 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=1
2026-05-09 22:30:02,474 - __main__ - INFO - Running 5 scrapers concurrently...
2026-05-09 22:30:02,474 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit search monitoring enabled. Running search with terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-09 22:30:02,474 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['"Hermes Agent"']
2026-05-09 22:30:03,270 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term '"Hermes Agent"'
2026-05-09 22:30:03,314 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Hermes Agent HUD UI is INSANE 🤯 (FREE!)
2026-05-09 22:30:03,322 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Hermes Agent DESTROYS OpenClaw?
2026-05-09 22:30:03,332 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: This is the BEST FREE MODEL for Hermes - ATM
2026-05-09 22:30:03,341 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Hermes agents + Shopify/Gmail access - how are you guys handling priva
2026-05-09 22:30:03,352 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Hermes agents + Shopify/Gmail access - how are you guys handling priva
2026-05-09 22:30:03,363 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: How long did it take you to set up hermes?
2026-05-09 22:30:04,519 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 6
2026-05-09 22:30:04,519 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'paperclip' restricted to subreddits: ['PaperClip_AI', 'PaperclipAI']
2026-05-09 22:30:04,520 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['paperclip']
2026-05-09 22:30:04,520 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/PaperClip_AI+PaperclipAI
2026-05-09 22:30:05,644 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'paperclip'
2026-05-09 22:30:05,676 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Still We Know Each Other So Well - Chapter 16
2026-05-09 22:30:05,687 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Title
2026-05-09 22:30:05,697 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: Lenovo IdeaPad 1 15ALC7 Black Screen On Boot
2026-05-09 22:30:06,920 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 3
2026-05-09 22:30:06,921 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'multica' restricted to subreddits: ['hermesagent', 'HermesAI']
2026-05-09 22:30:06,921 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['multica']
2026-05-09 22:30:06,921 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/hermesagent+HermesAI
2026-05-09 22:30:07,742 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term 'multica'
2026-05-09 22:30:08,966 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0
2026-05-09 22:30:08,966 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit subreddit feed monitoring enabled.
2026-05-09 22:30:08,967 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'hermes_agent': r/hermesagent+HermesAI+AI_Agents+aiagents+AgentsOfAI+LocalLLaMA+AutoGPT (limit=25)
2026-05-09 22:30:08,967 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes agent via RSS
2026-05-09 22:30:09,785 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/AISEOInsider: Hermes Agent HUD UI is INSANE 🤯 (FREE!)
2026-05-09 22:30:09,794 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/AISEOInsider: Hermes Agent DESTROYS OpenClaw?
2026-05-09 22:30:09,804 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/hermesagent: This is the BEST FREE MODEL for Hermes - ATM
2026-05-09 22:30:09,812 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/VPS: Hermes agents + Shopify/Gmail access - how are you guys handling priva
2026-05-09 22:30:09,828 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/hermesagent: Hermes agents + Shopify/Gmail access - how are you guys handling priva
2026-05-09 22:30:09,838 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/hermesagent: How long did it take you to set up hermes?
2026-05-09 22:30:10,992 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes AI via RSS
2026-05-09 22:30:11,996 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/hermesagent: Best way to maintain quality but reduce costs
2026-05-09 22:30:12,005 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/u_astroyou_app: Welcome to u/AstroYou
2026-05-09 22:30:13,162 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: nous research hermes via RSS
2026-05-09 22:30:14,331 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/aussie: A shift from butter to guns to thrive in a dangerous world
2026-05-09 22:30:14,340 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/Terraria: Lilith's Necklace
2026-05-09 22:30:14,348 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'hermes_agent' r/Hermetics: The pale white horse
2026-05-09 22:30:15,520 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: multica via RSS
2026-05-09 22:30:17,625 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'paperclip_ai': r/PaperClip_AI+PaperclipAI+pAIperclip (limit=25)
2026-05-09 22:30:17,625 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip ai via RSS
2026-05-09 22:30:20,125 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip agent via RSS
2026-05-09 22:30:22,260 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: multica via RSS
2026-05-09 22:30:24,367 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'claude_agents': r/ClaudeCode+ClaudeAI+claude+vibecoding (limit=25)
2026-05-09 22:30:24,367 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: claude agent via RSS
2026-05-09 22:30:25,253 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeWorkflows: [Workflow] Team Lead's Plugin-Based Workflow for Project Quality and S
2026-05-09 22:30:25,265 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeWorkflows: [Workflow] Strict Code Quality and Testing Workflow for Python/TypeScr
2026-05-09 22:30:25,278 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeWorkflows: [Workflow] Declarative Multi-Agent Orchestration with `teamctl` for Cl
2026-05-09 22:30:25,296 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeWorkflows: [Workflow] Structured Workflow for Large Projects with Claude Code: Ar
2026-05-09 22:30:25,306 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/AISEOInsider: Claude + Ruflo Agent Swarms is Insane (FREE!)
2026-05-09 22:30:25,318 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeWorkflows: [Workflow] Structured Workflow for Large Claude Code Projects: Plan Fi
2026-05-09 22:30:25,331 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeWorkflows: [Workflow] Run Claude Code for Free: Local Proxy with NVIDIA NIM and K
2026-05-09 22:30:25,341 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/PublicApp: Connecting the Public MCP Server to Claude Desktop
2026-05-09 22:30:25,352 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/hermesagent: This is the BEST FREE MODEL for Hermes - ATM
2026-05-09 22:30:25,363 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/microsoft_365_copilot: Memory with Copilot Cowork
2026-05-09 22:30:25,374 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/OnlineMCIT: MAS-CS - Profile Review
2026-05-09 22:30:25,394 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/GithubCopilot: Escape GitHub Rate Limits: A $10/Week Powerful Alternative IDE Setup
2026-05-09 22:30:25,406 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeCode: Dispatch solves remote control. It doesn’t fully solve attention/conte
2026-05-09 22:30:25,415 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/u_Cute_Jicama_5554: Orbit — AI engineering orchestration for parallel coding workflows
2026-05-09 22:30:25,446 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/amd_fundamentals: @Sean14978416 (Arcuri @) UBS: “Net, we see $ARM as the biggest benefic
2026-05-09 22:30:25,457 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/AIToolsTipsNews: AI Roundup — May 09: Anthropic eyes $900B valuation, Meta debuts Muse
2026-05-09 22:30:25,466 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeCode: What's everyone's favorite harness set up?
2026-05-09 22:30:25,476 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeCode: AI royally sucked at building data grids. We finally cracked it, and i
2026-05-09 22:30:25,486 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/vibecoding: Codex vs Claude Code for vibe coding
2026-05-09 22:30:25,496 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeAI: Claude Code vs Codex from a builder angle
2026-05-09 22:30:26,496 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: claude code agent via RSS
2026-05-09 22:30:27,264 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeWorkflows: [Workflow] Custom Linter Creation and Backlog Management with Claude.a
2026-05-09 22:30:27,275 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeWorkflows: [Workflow] Robust Code Quality & Testing Harness for LLM-Assisted Deve
2026-05-09 22:30:27,285 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/reactjs: LyteNyte Grid v2.1 is Out! You might never need to manually build a da
2026-05-09 22:30:27,296 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeWorkflows: [Workflow] Claude Code Skill for SEO-Driven Blog Article Generation (K
2026-05-09 22:30:27,306 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/framer: Framer and Claude Code any good?
2026-05-09 22:30:27,316 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/ClaudeAI: I built an MCP server that connects Claude Code & Claude Desktop to Ap
2026-05-09 22:30:27,325 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/brdev: Fiz um servidor MCP que conecta o Claude Code e o Claude Desktop no Ap
2026-05-09 22:30:27,337 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/mac: Macbook Air M5 32GB vs Macbook Pro M5 Pro 48GB
2026-05-09 22:30:27,345 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/metrovlauncher: Don't you use Cursor or claude code? to ramp up the develpment?
2026-05-09 22:30:27,356 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/Supabase: I built an open-source Postgres SQL guardrail for AI-generated queries
2026-05-09 22:30:28,357 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: AI coding agent via RSS
2026-05-09 22:30:29,114 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/AISEOInsider: This OpenSwarm AI Agent Feels Like The Future
2026-05-09 22:30:29,123 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/AISEOInsider: New OpenAI Browser Use Agent is WILD!
2026-05-09 22:30:29,132 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/IndieDev: Most people online just consume. We want builders.
2026-05-09 22:30:29,149 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/AiStackClinic: Welcome to AiStackClinic
2026-05-09 22:30:29,164 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/startups_promotion: The people around you change your future
2026-05-09 22:30:29,179 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/n8n: 🚨 I built an AI system that detects refund fraud for Shopify & Amazon
2026-05-09 22:30:29,189 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/AiBuilders: [FOR HIRE] Senior ML Engineer | GenAI, LLMs, Stable Diffusion, Compute
2026-05-09 22:30:29,200 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/AmazingYamaguchi: FOR SALE
2026-05-09 22:30:29,213 - social_media_monitor.scrapers.reddit_scraper - INFO - New from RSS feed 'claude_agents' r/freelance_forhire: [HIRING] an extremely large team of TikTok clippers, ai creators AND u
2026-05-09 22:30:30,213 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: multica via RSS
2026-05-09 22:30:32,099 - social_media_monitor.scrapers.reddit_scraper - INFO - Total subreddit feed results: 50
2026-05-09 22:30:32,100 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-09 22:30:32,229 - TwitterScraper - INFO - Searching Twitter/X (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-09 22:30:32,655 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'paperclip'
2026-05-09 22:30:46,670 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for '"Hermes Agent"'
2026-05-09 22:31:01,225 - TwitterScraper - INFO - Twitter/X RSS: 93 entries for 'multica'
2026-05-09 22:31:14,087 - TwitterScraper - INFO - Twitter scrape complete. Found 0 new results.
2026-05-09 22:31:14,088 - LinkedInScraper - INFO - Searching LinkedIn (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-05-09 22:31:14,610 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'paperclip'
2026-05-09 22:31:15,909 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for '"Hermes Agent"'
2026-05-09 22:31:17,099 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'multica'
2026-05-09 22:31:17,360 - LinkedInScraper - INFO - New LinkedIn post: Chun-Kit Yeung - Hong Kong Monetary Authority (HKMA) - LinkedIn
2026-05-09 22:31:17,828 - LinkedInScraper - INFO - New LinkedIn post: Megan Farley, MPT - Ivy Rehab Network - LinkedIn
2026-05-09 22:31:17,835 - LinkedInScraper - INFO - LinkedIn scrape complete. Found 2 new results.
2026-05-09 22:31:17,835 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)
2026-05-09 22:31:21,649 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-05-09 22:31:21,744 - GitHubScraper - INFO - Found 226 GitHub repositories for term: paperclip
2026-05-09 22:31:22,797 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-05-09 22:31:22,800 - GitHubScraper - INFO - Found 188 GitHub repositories for term: "Hermes Agent"
2026-05-09 22:31:23,711 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-05-09 22:31:23,714 - GitHubScraper - INFO - Found 40 GitHub repositories for term: multica
2026-05-09 22:31:23,870 - GitHubScraper - INFO - Total GitHub results found: 0
2026-05-09 22:31:23,870 - __main__ - INFO - Scraper reddit completed: 59 results
2026-05-09 22:31:23,871 - __main__ - INFO - Scraper github completed: 0 results
2026-05-09 22:31:23,871 - __main__ - INFO - Scraper twitter completed: 0 results
2026-05-09 22:31:23,871 - __main__ - INFO - Scraper linkedin completed: 2 results
2026-05-09 22:31:23,871 - __main__ - INFO - Scraper linkedin_feed completed: 0 results
2026-05-09 22:31:24,713 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-09 22:31:24.713278
2026-05-09 22:31:24,713 - __main__ - INFO - Email sent successfully
2026-05-09 22:31:24,713 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-05-09 22:31:24,714 - __main__ - INFO - Monitor complete. Found 61 total results: 59 new reddit results, 2 new linkedin results.
2026-05-09 22:31:24,714 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-05-09 22:31:24,714 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-09 22:31:24,839 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-05-09 22:31:24,839 - __main__ - INFO - Closed all database connections
2026-05-09 22:31:24,880 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-09 22:31:24,897 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-05-09 23:00:01,574 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-05-09.log
2026-05-09 23:00:01,575 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-05-09.log
2026-05-09 23:00:01,575 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-05-09.log
2026-05-09 23:00:01,575 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-05-09 23:00:01,599 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-05-09 23:00:01,600 - __main__ - INFO - Configuration loaded and validated successfully
2026-05-09 23:00:01,602 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-05-09 23:00:01,602 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-05-09 23:00:01,632 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-05-09 23:00:01,632 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-05-09 23:00:01,633 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-05-09 23:00:01,634 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=3, html_urls=0 (0 with custom selectors), include_terms=1, exclude_terms=0
2026-05-09 23:00:01,634 - __main__ - INFO - RSS scraper initialized and enabled
2026-05-09 23:00:01,637 - Yiddish24Scraper - INFO - File downloader initialized with 1 terms, prefix 'Y2', and file type organization enabled
2026-05-09 23:00:01,637 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=1, exclude_terms=0
2026-05-09 23:00:01,637 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-05-09 23:00:01,639 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=1, exclude_terms=0
2026-05-09 23:00:01,643 - TorahAnytimeScraper - INFO - File downloader initialized with 1 terms, prefix 'TA', and file type organization enabled
2026-05-09 23:00:01,643 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=1, exclude_terms=0
2026-05-09 23:00:01,645 - BatorahScraper - INFO - File downloader initialized with 1 terms, prefix 'BT', and file type organization enabled
2026-05-09 23:00:01,645 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=1, exclude_terms=0
2026-05-09 23:00:01,645 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=1
2026-05-09 23:00:01,645 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-05-09 23:00:01,646 - __main__ - INFO - Running 3 scrapers concurrently...
2026-05-09 23:00:01,646 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-05-09 23:00:01,744 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-05-09 23:00:01,748 - IveltScraper - INFO - Loaded 177 include, 0 exclude filters from DB topic_filters
2026-05-09 23:00:01,748 - IveltScraper - INFO - Fetching ivelt.com active topics...
2026-05-09 23:00:01,751 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-05-09 23:00:02,110 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-05-09 23:00:02,558 - RSSFeedScraper - INFO - Fetching RSS feed: https://github.com/BuilderPulse/BuilderPulse/commits/main.atom
2026-05-09 23:00:03,138 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-09.md "HTTP/1.1 200 OK"
2026-05-09 23:00:03,487 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-05-09 23:00:03,507 - Yiddish24Scraper - INFO - Received response with 520341 characters
2026-05-09 23:00:03,509 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (322365 chars)
2026-05-09 23:00:03,511 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-05-09 23:00:03,597 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-05-09 23:00:03,645 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-05-09 23:00:03,646 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-05-09 23:00:04,481 - Yiddish24Scraper - INFO - Page 1 summary: 0 new out of 100 total articles
2026-05-09 23:00:04,481 - Yiddish24Scraper - INFO - Page 1: 0/100 new items
2026-05-09 23:00:04,481 - Yiddish24Scraper - INFO - Low new item ratio (0.0%), stopping pagination
2026-05-09 23:00:04,482 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 0
2026-05-09 23:00:04,493 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-09.md "HTTP/1.1 200 OK"
2026-05-09 23:00:05,639 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-08.md "HTTP/1.1 200 OK"
2026-05-09 23:00:06,632 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-07.md "HTTP/1.1 200 OK"
2026-05-09 23:00:07,498 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-07.md "HTTP/1.1 200 OK"
2026-05-09 23:00:08,625 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-06.md "HTTP/1.1 200 OK"
2026-05-09 23:00:09,502 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-06.md "HTTP/1.1 200 OK"
2026-05-09 23:00:10,634 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-05.md "HTTP/1.1 200 OK"
2026-05-09 23:00:11,505 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-05.md "HTTP/1.1 200 OK"
2026-05-09 23:00:12,643 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-04.md "HTTP/1.1 200 OK"
2026-05-09 23:00:13,508 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-04.md "HTTP/1.1 200 OK"
2026-05-09 23:00:13,581 - IveltScraper - INFO - Found 50 active topics on ivelt.com
2026-05-09 23:00:14,642 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-03.md "HTTP/1.1 200 OK"
2026-05-09 23:00:15,511 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-03.md "HTTP/1.1 200 OK"
2026-05-09 23:00:16,652 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-02.md "HTTP/1.1 200 OK"
2026-05-09 23:00:17,514 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-02.md "HTTP/1.1 200 OK"
2026-05-09 23:00:18,654 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-01.md "HTTP/1.1 200 OK"
2026-05-09 23:00:19,519 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-05-01.md "HTTP/1.1 200 OK"
2026-05-09 23:00:20,653 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-04-30.md "HTTP/1.1 200 OK"
2026-05-09 23:00:21,519 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-04-30.md "HTTP/1.1 200 OK"
2026-05-09 23:00:22,646 - httpx - INFO - HTTP Request: GET https://raw.githubusercontent.com/BuilderPulse/BuilderPulse/main/en/2026/2026-04-29.md "HTTP/1.1 200 OK"
2026-05-09 23:00:22,658 - RSSFeedScraper - INFO - Total RSS/HTML results: 3
2026-05-09 23:00:32,114 - IveltScraper - INFO - Ivelt scrape complete. Checked 5 topics, found 2 new posts.
2026-05-09 23:00:32,114 - __main__ - INFO - Scraper rss completed: 3 results
2026-05-09 23:00:32,114 - __main__ - INFO - Scraper yiddish24 completed: 0 results
2026-05-09 23:00:32,114 - __main__ - INFO - Scraper ivelt completed: 2 results
2026-05-09 23:00:32,734 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-05-09 23:00:32.734748
2026-05-09 23:00:32,735 - __main__ - INFO - Email sent successfully
2026-05-09 23:00:32,735 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-05-09 23:00:32,735 - __main__ - INFO - Monitor complete. Found 5 total results: 3 new rss results, 2 new ivelt results.
2026-05-09 23:00:32,735 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-05-09 23:00:32,735 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-09 23:00:32,869 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-05-09 23:00:32,869 - __main__ - INFO - Closed all database connections
2026-05-09 23:00:32,871 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-05-09 23:00:32,872 - social_media_monitor.database.connection - INFO - Closed 0 database connections