โ† Logs

social_media_monitor_2026-06-21.log

2026-06-21 21:56:57,124 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://siyum.hasatmarmonsey.org/dashboard
2026-06-21 21:56:58,864 - social_media_monitor.utils.file_downloader - INFO - URL redirected from https://us.list-manage.com/GRnfDVyGWKe?e=c4f089d00a&c2id=5f4325fab65f822f7785b7c0b09e1dc3 to https://drive.google.com/drive/folders/1Sk0d0uV7iVwexVV1XjvssSrIO0zD3x3v
2026-06-21 21:56:58,864 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://drive.google.com/drive/folders/1Sk0d0uV7iVwexVV1XjvssSrIO0zD3x3v
2026-06-21 21:56:59,345 - social_media_monitor.utils.file_downloader - INFO - Downloaded content is HTML, discarding: GM_GRnfDVyGWKe
2026-06-21 21:57:04,229 - social_media_monitor.utils.file_downloader - INFO - Skipping URL - final URL after redirect matches ignore terms: https://list-manage.us20.list-manage.com/subscribe?u=e6e42e80742351a6895575ca0&id=2d9628ed01
2026-06-21 21:57:04,241 - social_media_monitor.scrapers.gmail_scraper - INFO - Marked email as processed: ืกืื˜ืžืืจ ื‘ืœืขื˜ืœ I ื ื˜ืื’ ืคื•ืŸ ื”ื›ื ื” ืคืืจืŸ ืงื•ืžืขื ื“ื™ื’ืŸ ื–ื•ื ื˜ืื’ - ื™ื•ืžื ื˜ื‘ื I ื”ื™ื™ื ื˜ ื–ื•ื ื˜ืื’
2026-06-21 21:57:04,616 - social_media_monitor.scrapers.gmail_scraper - INFO - Added label 'Processed' to email 48
2026-06-21 21:57:04,706 - social_media_monitor.scrapers.gmail_scraper - INFO - Successfully removed label 'Z0TorahLinks' from email 48
2026-06-21 21:57:04,706 - social_media_monitor.scrapers.gmail_scraper - INFO - Successfully processed email: ืกืื˜ืžืืจ ื‘ืœืขื˜ืœ I ื ื˜ืื’ ืคื•ืŸ ื”ื›ื ื” ืคืืจืŸ ืงื•ืžืขื ื“ื™ื’ืŸ ื–ื•ื ื˜ืื’ - ื™ื•ืžื ื˜ื‘ื I ื”ื™ื™ื ื˜ ื–ื•ื ื˜ืื’
2026-06-21 21:57:04,787 - social_media_monitor.scrapers.gmail_scraper - INFO - Processing email: ื™ื•ื ื' ืคืจืฉืช ื—ืง"ื‘ ืชืฉืค"ื• (2026-06-21) from ืงื•ืœ ื”ืงื”ืœ <email@satmer.org>
2026-06-21 21:57:04,821 - social_media_monitor.utils.link_extractor - INFO - Extracted 6 links with context from email
2026-06-21 21:57:06,341 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://mailchi.mp/satmer.org/bggvi882bw-10982720?e=c949f925ce
2026-06-21 21:57:08,890 - social_media_monitor.utils.file_downloader - INFO - Skipping URL - final URL after redirect matches ignore terms: https://satmer.us1.list-manage.com/subscribe?u=c76ab07c1f9a3ca1d2ce2fb28&id=d83ccb3f3f
2026-06-21 21:57:10,290 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://airtable.com/apphGSZLSbWARpmCF/pagDHXswMSXQrlAWa/form
2026-06-21 21:57:11,510 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://airtable.com/apphGSZLSbWARpmCF/pagDHXswMSXQrlAWa/form
2026-06-21 21:57:12,821 - social_media_monitor.utils.file_downloader - INFO - Converted Dropbox URL to direct download: https://www.dropbox.com/scl/fi/2cheb16r6mvzsc67v2ecc/1.mp3?rlkey=0x4viqwdenrm33tdeezkifwhz&dl=0 -> https://www.dropbox.com/scl/fi/2cheb16r6mvzsc67v2ecc/1.mp3?rlkey=0x4viqwdenrm33tdeezkifwhz&dl=1
2026-06-21 21:57:13,804 - social_media_monitor.utils.file_downloader - INFO - URL redirected from https://us.list-manage.com/hDxJHNS0rqX?e=c949f925ce&c2id=6f4c5a698e5683afbf7e3f1e7968786c to https://ucde39a1c5ae1b21e62d653b5e13.dl.dropboxusercontent.com/cd/0/get/DC0BwYlDJGeK2lKsDRxGTb2ntGRNjKH5rzQnPtNUjziWOz9JHihHYz9vpVg-7dIV2O9IoLxVamsEMVRRtn2UBcjRp_VVsmjO9eTuZ3KwxlxIWnp0ql4NUjFqXqP2PZXNh84EGI7QXZgqzBPQHSFBm0SK/file?dl=1
2026-06-21 21:57:13,804 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://ucde39a1c5ae1b21e62d653b5e13.dl.dropboxusercontent.com/cd/0/get/DC0BwYlDJGeK2lKsDRxGTb2ntGRNjKH5rzQnPtNUjziWOz9JHihHYz9vpVg-7dIV2O9IoLxVamsEMVRRtn2UBcjRp_VVsmjO9eTuZ3KwxlxIWnp0ql4NUjFqXqP2PZXNh84EGI7QXZgqzBPQHSFBm0SK/file?dl=1
2026-06-21 21:57:14,175 - social_media_monitor.utils.file_downloader - ERROR - HTTP error 403: Forbidden: https://us.list-manage.com/hDxJHNS0rqX?e=c949f925ce&c2id=6f4c5a698e5683afbf7e3f1e7968786c
2026-06-21 21:57:16,835 - social_media_monitor.utils.file_downloader - INFO - Skipping URL - final URL after redirect matches ignore terms: https://satmer.us1.list-manage.com/subscribe?u=c76ab07c1f9a3ca1d2ce2fb28&id=d83ccb3f3f
2026-06-21 21:57:16,849 - social_media_monitor.scrapers.gmail_scraper - INFO - Marked email as processed: ื™ื•ื ื' ืคืจืฉืช ื—ืง"ื‘ ืชืฉืค"ื•
2026-06-21 21:57:17,272 - social_media_monitor.scrapers.gmail_scraper - INFO - Added label 'Processed' to email 49
2026-06-21 21:57:17,342 - social_media_monitor.scrapers.gmail_scraper - INFO - Successfully removed label 'Z0TorahLinks' from email 49
2026-06-21 21:57:17,343 - social_media_monitor.scrapers.gmail_scraper - INFO - Successfully processed email: ื™ื•ื ื' ืคืจืฉืช ื—ืง"ื‘ ืชืฉืค"ื•
2026-06-21 21:57:17,465 - social_media_monitor.scrapers.gmail_scraper - INFO - Processing email: ื' ื—ืงืช ื‘ืœืง ืชืฉืค"ื• ืœืค"ืง (2026-06-21) from ืžื•ื“ืขื•ืช ืงื”ืœื™ื ื• <ke@satmarky.com>
2026-06-21 21:57:17,496 - social_media_monitor.utils.link_extractor - INFO - Extracted 8 links with context from email
2026-06-21 21:57:19,109 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://mailchi.mp/satmarky/v13eizg17q-13055859?e=8ecee2e55a
2026-06-21 21:57:20,923 - social_media_monitor.utils.file_downloader - INFO - Skipping URL - final URL after redirect matches ignore terms: https://mailchi.mp/satmarky/subscribe
2026-06-21 21:57:22,471 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://mailchi.mp/satmarky/v13eizg17q-13055859?e=8ecee2e55a
2026-06-21 21:57:24,743 - social_media_monitor.utils.file_downloader - INFO - Skipping URL - final URL after redirect matches ignore terms: https://satmer.us1.list-manage.com/subscribe?u=c76ab07c1f9a3ca1d2ce2fb28&id=91890082f8
2026-06-21 21:57:26,022 - social_media_monitor.utils.file_downloader - INFO - Converted Dropbox URL to direct download: https://www.dropbox.com/scl/fi/78zzyhpapp64z2k1867kn/2.pdf?rlkey=q0pko0ikn7djmxmqy5fe4lvb8&st=d46ct5jd&dl=0 -> https://www.dropbox.com/scl/fi/78zzyhpapp64z2k1867kn/2.pdf?rlkey=q0pko0ikn7djmxmqy5fe4lvb8&st=d46ct5jd&dl=1
2026-06-21 21:57:27,152 - social_media_monitor.utils.file_downloader - INFO - URL redirected from https://us.list-manage.com/PS0eGjOs4VJ?e=8ecee2e55a&c2id=335fd8078d3deb6c21ee26a688770bfa to https://uc4c64fbba63a245d8835d646d2f.dl.dropboxusercontent.com/cd/0/get/DC0ZwkYvajkNkq9I7ypO1D-HNDKwgM5UwVq053hM77h0-Tb6gMvtWJ6zDZEf7gbRHI8zkzmWkiibh-rnHaZr7tm568XXgdaKuQ8XVt1ioSv7WRMCB7d77eKNvlknOLeDbcMEmsRf0HFDKHUr7_3xaE0Z/file?dl=1
2026-06-21 21:57:27,152 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://uc4c64fbba63a245d8835d646d2f.dl.dropboxusercontent.com/cd/0/get/DC0ZwkYvajkNkq9I7ypO1D-HNDKwgM5UwVq053hM77h0-Tb6gMvtWJ6zDZEf7gbRHI8zkzmWkiibh-rnHaZr7tm568XXgdaKuQ8XVt1ioSv7WRMCB7d77eKNvlknOLeDbcMEmsRf0HFDKHUr7_3xaE0Z/file?dl=1
2026-06-21 21:57:27,860 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: GM_____ _____ _______ ___ _''_ - ______ ______ (2).pdf (10.6 MB)
2026-06-21 21:57:27,861 - social_media_monitor.scrapers.gmail_scraper - INFO - Skipping PDF file from link: GM_____ _____ _______ ___ _''_ - ______ ______ (2).pdf
2026-06-21 21:57:29,259 - social_media_monitor.utils.file_downloader - INFO - Converted Dropbox URL to direct download: https://www.dropbox.com/scl/fi/1k2aoxtw4j5aprkruzitw/.mp3?rlkey=e6xiwz83d1l1uvslq6rvf4pmc&st=x0sjtdo3&dl=0 -> https://www.dropbox.com/scl/fi/1k2aoxtw4j5aprkruzitw/.mp3?rlkey=e6xiwz83d1l1uvslq6rvf4pmc&st=x0sjtdo3&dl=1
2026-06-21 21:57:30,277 - social_media_monitor.utils.file_downloader - INFO - URL redirected from https://us.list-manage.com/Z9CzVzfdjWH?e=8ecee2e55a&c2id=335fd8078d3deb6c21ee26a688770bfa to https://ucec64164033e1731f6bb68f2670.dl.dropboxusercontent.com/cd/0/get/DC1xKuslb5L1U15iM8WMyXSmpgZEmEz4DNGC7veBxTHQem93p6EeOP2EBOCeYY2HUjvvwiMtyhD_MUTkPJYp_v6qVyhd9fSLEVE3-Dtm8Eq6SfIDAAhf_PkY_xs7irq1JvMygR04GwgpOiqvKQAToxwe/file?dl=1
2026-06-21 21:57:30,277 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://ucec64164033e1731f6bb68f2670.dl.dropboxusercontent.com/cd/0/get/DC1xKuslb5L1U15iM8WMyXSmpgZEmEz4DNGC7veBxTHQem93p6EeOP2EBOCeYY2HUjvvwiMtyhD_MUTkPJYp_v6qVyhd9fSLEVE3-Dtm8Eq6SfIDAAhf_PkY_xs7irq1JvMygR04GwgpOiqvKQAToxwe/file?dl=1
2026-06-21 21:57:31,149 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: GM__ ___.mp3 (8.6 MB)
2026-06-21 21:57:31,151 - social_media_monitor.utils.media_tagger - INFO - Tagged GM__ ___.mp3: title, artist, album, date, comment, source_url, genre, publisher
2026-06-21 21:57:31,202 - social_media_monitor.scrapers.gmail_scraper - INFO - Routing audio file (audio/mpeg) to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio
2026-06-21 21:57:31,202 - social_media_monitor.scrapers.gmail_scraper - INFO - Moved URL download to type-specific folder: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio
2026-06-21 21:57:32,515 - social_media_monitor.utils.file_downloader - INFO - Converted Dropbox URL to direct download: https://www.dropbox.com/scl/fi/mjjh3tenqeod9utbmof3h/.wav?rlkey=asz0px0t5a8zjolsrjl4vmkmz&st=w1ej0ncd&dl=0 -> https://www.dropbox.com/scl/fi/mjjh3tenqeod9utbmof3h/.wav?rlkey=asz0px0t5a8zjolsrjl4vmkmz&st=w1ej0ncd&dl=1
2026-06-21 21:57:33,895 - social_media_monitor.utils.file_downloader - INFO - URL redirected from https://us.list-manage.com/4XlbcbvhaGv?e=8ecee2e55a&c2id=335fd8078d3deb6c21ee26a688770bfa to https://uc4d0be4ca925ba4a558043b5934.dl.dropboxusercontent.com/cd/0/get/DC1ZWaim68Fa8c0oTUlm9OmBHzv9lF7f5ponkLhgcvzjyewSpZSLBVuiIsiKOHz19HhD3I2gD9MBX1NpJt9NmWM9q2pCbGyEK9CZYIfHfydSHie1iH2CZp7KEjWCC8lcBvUf6NUo5UZo0auaops4rNI8/file?dl=1
2026-06-21 21:57:33,895 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://uc4d0be4ca925ba4a558043b5934.dl.dropboxusercontent.com/cd/0/get/DC1ZWaim68Fa8c0oTUlm9OmBHzv9lF7f5ponkLhgcvzjyewSpZSLBVuiIsiKOHz19HhD3I2gD9MBX1NpJt9NmWM9q2pCbGyEK9CZYIfHfydSHie1iH2CZp7KEjWCC8lcBvUf6NUo5UZo0auaops4rNI8/file?dl=1
2026-06-21 21:57:34,201 - social_media_monitor.utils.file_downloader - ERROR - HTTP error 403: Forbidden: https://us.list-manage.com/4XlbcbvhaGv?e=8ecee2e55a&c2id=335fd8078d3deb6c21ee26a688770bfa
2026-06-21 21:57:35,608 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://satmarky.us21.list-manage.com/about?u=2960561ef4b08b01b2dbe089a&id=88cde25c77&e=8ecee2e55a&c=15ffe07fd7
2026-06-21 21:57:35,618 - social_media_monitor.scrapers.gmail_scraper - INFO - Marked email as processed: ื' ื—ืงืช ื‘ืœืง ืชืฉืค"ื• ืœืค"ืง
2026-06-21 21:57:35,960 - social_media_monitor.scrapers.gmail_scraper - INFO - Added label 'Processed' to email 50
2026-06-21 21:57:35,989 - social_media_monitor.scrapers.gmail_scraper - INFO - Successfully removed label 'Z0TorahLinks' from email 50
2026-06-21 21:57:35,989 - social_media_monitor.scrapers.gmail_scraper - INFO - Successfully processed email: ื' ื—ืงืช ื‘ืœืง ืชืฉืค"ื• ืœืค"ืง
2026-06-21 21:57:36,032 - social_media_monitor.scrapers.gmail_scraper - INFO - Processing email: ื’ื™ื™ื˜ ื”ื™ื™ื ื˜ ืืจื•ื™ืก ืฉื˜ื™ืžืขืŸ ื•ื•ืขืŸ ืื™ืจ ืึทืจื‘ืขื˜ ื ื™ืฉื˜!! (2026-06-21) from ืžืขืจื›ืช ืกืื˜ืžืืจ <news@satmarinfo.org>
2026-06-21 21:57:36,044 - social_media_monitor.utils.link_extractor - INFO - Extracted 2 links with context from email
2026-06-21 21:57:37,642 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://mailchi.mp/satmarinfo/signup
2026-06-21 21:57:39,380 - social_media_monitor.utils.file_downloader - INFO - Skipping HTML URL (not a download site): https://satmarinfo.us19.list-manage.com/about?u=9053358de9cb901cf618b6d6a&id=a43c2f6705&e=810cdd4ad0&c=f798393635
2026-06-21 21:57:39,392 - social_media_monitor.scrapers.gmail_scraper - INFO - Marked email as processed: ื’ื™ื™ื˜ ื”ื™ื™ื ื˜ ืืจื•ื™ืก ืฉื˜ื™ืžืขืŸ ื•ื•ืขืŸ ืื™ืจ ืึทืจื‘ืขื˜ ื ื™ืฉื˜!!
2026-06-21 21:57:39,749 - social_media_monitor.scrapers.gmail_scraper - INFO - Added label 'Processed' to email 51
2026-06-21 21:57:39,801 - social_media_monitor.scrapers.gmail_scraper - INFO - Successfully removed label 'Z0TorahLinks' from email 51
2026-06-21 21:57:39,802 - social_media_monitor.scrapers.gmail_scraper - INFO - Successfully processed email: ื’ื™ื™ื˜ ื”ื™ื™ื ื˜ ืืจื•ื™ืก ืฉื˜ื™ืžืขืŸ ื•ื•ืขืŸ ืื™ืจ ืึทืจื‘ืขื˜ ื ื™ืฉื˜!!
2026-06-21 21:57:39,965 - social_media_monitor.scrapers.gmail_scraper - INFO - Processing email: ื™ื•ื ื' ืค' ื—ืงืช-ื‘ืœืง - ืชืฉืค"ื• - 4712 (2026-06-21) from Satmar News <news@bechatsrossatmar.com>
2026-06-21 21:57:40,031 - social_media_monitor.utils.link_extractor - INFO - Extracted 13 links with context from email
2026-06-21 21:57:41,495 - social_media_monitor.utils.file_downloader - INFO - URL redirected from https://ymlpcdn7.net/28b03eswhuaraeqjsmaoamseafaumjqj/click.php to http://www.bechatsrossatmar.com/PDF/4712
2026-06-21 21:57:41,496 - social_media_monitor.utils.file_downloader - INFO - Starting download from: http://www.bechatsrossatmar.com/PDF/4712
2026-06-21 21:57:43,711 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: GM_click.php (32.5 MB)
2026-06-21 21:57:43,928 - social_media_monitor.utils.file_type_detector - INFO - Corrected file extension: GM_2026-06-21_click.php -> GM_2026-06-21_click.pdf (MIME: application/pdf)
2026-06-21 21:57:43,929 - social_media_monitor.scrapers.gmail_scraper - INFO - Routing document file (application/pdf) to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Documents
2026-06-21 21:57:43,929 - social_media_monitor.scrapers.gmail_scraper - INFO - Moved URL download to type-specific folder: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Documents
2026-06-21 21:57:44,175 - social_media_monitor.scrapers.gmail_scraper - INFO - URL already downloaded, skipping: https://ymlpcdn7.net/28b03eswhuaraeqjsmaoamseafaumjqj/click.php
2026-06-21 21:57:44,175 - social_media_monitor.scrapers.gmail_scraper - INFO - URL already downloaded, skipping: https://ymlpcdn7.net/28b03eswhuaraeqjsmaoamseafaumjqj/click.php
2026-06-21 21:57:44,942 - social_media_monitor.utils.file_downloader - INFO - URL redirected from https://ymlpcdn7.net/5b0b2eswheafaeqjsmaxamsealaumjqj/click.php to http://www.bechatsrossatmar.com/PDF/Luach-Eirivin5786
2026-06-21 21:57:45,182 - social_media_monitor.utils.file_downloader - INFO - Starting download from: http://www.bechatsrossatmar.com/PDF/Luach-Eirivin5786
2026-06-21 21:57:45,343 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: GM_click.php (472.8 KB)
2026-06-21 21:57:45,356 - social_media_monitor.scrapers.gmail_scraper - INFO - File content already downloaded, deleting duplicate: GM_click.php
2026-06-21 21:57:46,154 - social_media_monitor.utils.file_downloader - INFO - URL redirected from https://ymlpcdn7.net/08c67eswhmagaeqjsmapamseaiaumjqj/click.php to http://www.bechatsrossatmar.com/PDF/LuachShonehSmr5786
2026-06-21 21:57:46,406 - social_media_monitor.utils.file_downloader - INFO - Starting download from: http://www.bechatsrossatmar.com/PDF/LuachShonehSmr5786
2026-06-21 21:57:46,696 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: GM_click.php (3.4 MB)
2026-06-21 21:57:46,724 - social_media_monitor.scrapers.gmail_scraper - INFO - File content already downloaded, deleting duplicate: GM_click.php
2026-06-21 21:57:47,828 - social_media_monitor.utils.file_downloader - INFO - URL redirected from https://ymlpcdn7.net/13981eswhjaraeqjsmanamseacaumjqj/click.php to http://www.bechatsrossatmar.com/Audio/RHMTBKorach-5786
2026-06-21 21:57:47,943 - social_media_monitor.utils.file_downloader - INFO - Starting download from: http://www.bechatsrossatmar.com/Audio/RHMTBKorach-5786
2026-06-21 21:57:50,483 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: GM_click.php (71.4 MB)
2026-06-21 21:57:50,977 - social_media_monitor.scrapers.gmail_scraper - INFO - File content already downloaded, deleting duplicate: GM_click.php
2026-06-21 21:57:52,126 - social_media_monitor.utils.file_downloader - INFO - URL redirected from https://ymlpcdn7.net/19dd3eswhbaxaeqjsmaoamsearaumjqj/click.php to http://www.bechatsrossatmar.com/Audio/RYWeiss-Korach-5786
2026-06-21 21:57:52,221 - social_media_monitor.utils.file_downloader - INFO - Starting download from: http://www.bechatsrossatmar.com/Audio/RYWeiss-Korach-5786
2026-06-21 21:57:54,294 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: GM_click.php (57.8 MB)
2026-06-21 21:57:54,704 - social_media_monitor.scrapers.gmail_scraper - INFO - File content already downloaded, deleting duplicate: GM_click.php
2026-06-21 21:57:55,749 - social_media_monitor.utils.file_downloader - INFO - URL redirected from https://ymlpcdn7.net/65d00eswhhaiaeqjsmaramseazaumjqj/click.php to http://www.bechatsrossatmar.com/Audio/RYHF-BabaKma-75-02
2026-06-21 21:57:55,868 - social_media_monitor.utils.file_downloader - INFO - Starting download from: http://www.bechatsrossatmar.com/Audio/RYHF-BabaKma-75-02
2026-06-21 21:57:57,071 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: GM_click.php (31.8 MB)
2026-06-21 21:57:57,282 - social_media_monitor.utils.file_type_detector - INFO - Corrected file extension: GM_2026-06-21_click.php -> GM_2026-06-21_click.mp3 (MIME: audio/mpeg)
2026-06-21 21:57:57,283 - social_media_monitor.scrapers.gmail_scraper - INFO - Routing audio file (audio/mpeg) to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio
2026-06-21 21:57:57,283 - social_media_monitor.scrapers.gmail_scraper - INFO - Moved URL download to type-specific folder: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio
2026-06-21 21:57:58,608 - social_media_monitor.utils.file_downloader - INFO - URL redirected from https://ymlpcdn7.net/5c351eswhwaxaeqjsmagamseaaaumjqj/click.php to http://www.bechatsrossatmar.com/Audio/RYHF-BabaKma-76-01
2026-06-21 21:57:58,713 - social_media_monitor.utils.file_downloader - INFO - Starting download from: http://www.bechatsrossatmar.com/Audio/RYHF-BabaKma-76-01
2026-06-21 21:57:59,705 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: GM_click.php (25.5 MB)
2026-06-21 21:57:59,870 - social_media_monitor.utils.file_type_detector - INFO - Corrected file extension: GM_2026-06-21_click.php -> GM_2026-06-21_click.mp3 (MIME: audio/mpeg)
2026-06-21 21:57:59,870 - social_media_monitor.scrapers.gmail_scraper - INFO - Routing audio file (audio/mpeg) to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio
2026-06-21 21:57:59,870 - social_media_monitor.scrapers.gmail_scraper - INFO - Moved URL download to type-specific folder: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio
2026-06-21 21:58:00,051 - social_media_monitor.scrapers.gmail_scraper - INFO - URL already downloaded, skipping: https://ymlpcdn7.net/5c351eswhwaxaeqjsmagamseaaaumjqj/click.php
2026-06-21 21:58:01,144 - social_media_monitor.utils.file_downloader - INFO - URL redirected from https://ymlpcdn7.net/1f1e5eswhqapaeqjsmaxamseavaumjqj/click.php to http://www.bechatsrossatmar.com/Audio/RYHF-BabaKma-77-01
2026-06-21 21:58:01,257 - social_media_monitor.utils.file_downloader - INFO - Starting download from: http://www.bechatsrossatmar.com/Audio/RYHF-BabaKma-77-01
2026-06-21 21:58:01,877 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: GM_click.php (14.4 MB)
2026-06-21 21:58:01,950 - social_media_monitor.utils.file_type_detector - INFO - Corrected file extension: GM_2026-06-21_click.php -> GM_2026-06-21_click.mp3 (MIME: audio/mpeg)
2026-06-21 21:58:01,950 - social_media_monitor.scrapers.gmail_scraper - INFO - Routing audio file (audio/mpeg) to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio
2026-06-21 21:58:01,951 - social_media_monitor.scrapers.gmail_scraper - INFO - Moved URL download to type-specific folder: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio
2026-06-21 21:58:03,105 - social_media_monitor.utils.file_downloader - INFO - URL redirected from https://ymlpcdn7.net/11873eswhyagaeqjsmalamsealaumjqj/click.php to http://www.bechatsrossatmar.com/Audio/RYHF-BabaKma-75-01
2026-06-21 21:58:03,225 - social_media_monitor.utils.file_downloader - INFO - Starting download from: http://www.bechatsrossatmar.com/Audio/RYHF-BabaKma-75-01
2026-06-21 21:58:04,262 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: GM_click.php (26.8 MB)
2026-06-21 21:58:04,451 - social_media_monitor.scrapers.gmail_scraper - INFO - File content already downloaded, deleting duplicate: GM_click.php
2026-06-21 21:58:04,473 - social_media_monitor.scrapers.gmail_scraper - INFO - URL already downloaded, skipping: https://ymlpcdn7.net/1f1e5eswhqapaeqjsmaxamseavaumjqj/click.php
2026-06-21 21:58:04,480 - social_media_monitor.scrapers.gmail_scraper - INFO - Marked email as processed: ื™ื•ื ื' ืค' ื—ืงืช-ื‘ืœืง - ืชืฉืค"ื• - 4712
2026-06-21 21:58:04,991 - social_media_monitor.scrapers.gmail_scraper - INFO - Added label 'Processed' to email 52
2026-06-21 21:58:05,037 - social_media_monitor.scrapers.gmail_scraper - INFO - Successfully removed label 'Z0TorahLinks' from email 52
2026-06-21 21:58:05,038 - social_media_monitor.scrapers.gmail_scraper - INFO - Successfully processed email: ื™ื•ื ื' ืค' ื—ืงืช-ื‘ืœืง - ืชืฉืค"ื• - 4712
2026-06-21 21:58:05,038 - social_media_monitor.scrapers.gmail_scraper - INFO - Processed 52 emails, 537 downloads
2026-06-21 21:58:05,045 - social_media_monitor.scrapers.gmail_scraper - INFO - Disconnected from Gmail IMAP
2026-06-21 21:58:05,062 - __main__ - INFO - Scraper gmail completed: 537 results
2026-06-21 21:58:05,062 - __main__ - INFO - Scraper torahanytime completed: 22 results
2026-06-21 21:58:05,062 - __main__ - INFO - Scraper batorah completed: 1 results
2026-06-21 21:58:05,965 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-21 21:58:05.965470
2026-06-21 21:58:05,965 - __main__ - INFO - Email sent successfully
2026-06-21 21:58:05,966 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-21 21:58:05,966 - __main__ - INFO - Monitor complete. Found 560 total results: 1 new batorah results, 22 new torahanytime results, 537 new gmail downloads.
2026-06-21 21:58:05,966 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-21 21:58:05,966 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-21 21:58:06,024 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-21 21:58:06,024 - __main__ - INFO - Closed all database connections
2026-06-21 21:58:06,028 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-21 21:58:06,028 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-21 22:00:02,731 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-21.log
2026-06-21 22:00:02,732 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-21.log
2026-06-21 22:00:02,732 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-21.log
2026-06-21 22:00:02,732 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-21 22:00:02,771 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-21 22:00:02,772 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-21 22:00:02,775 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-21 22:00:02,776 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-21 22:00:02,789 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-21 22:00:02,790 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-21 22:00:02,791 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-21 22:00:02,792 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-21 22:00:02,792 - __main__ - INFO - RSS scraper initialized and enabled
2026-06-21 22:00:02,794 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-21 22:00:02,794 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-21 22:00:02,794 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-06-21 22:00:02,797 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-21 22:00:02,802 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-21 22:00:02,802 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=10
2026-06-21 22:00:02,804 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-21 22:00:02,804 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-21 22:00:02,804 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-21 22:00:02,804 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-06-21 22:00:02,804 - __main__ - INFO - Running 3 scrapers concurrently...
2026-06-21 22:00:02,805 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-06-21 22:00:02,899 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-06-21 22:00:02,908 - IveltScraper - INFO - Loaded 181 include, 0 exclude filters from DB topic_filters
2026-06-21 22:00:02,908 - IveltScraper - INFO - Fetching ivelt.com active topics...
2026-06-21 22:00:02,910 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-06-21 22:00:03,265 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-06-21 22:00:03,685 - RSSFeedScraper - INFO - Total RSS/HTML results: 3
2026-06-21 22:00:06,981 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-06-21 22:00:07,197 - Yiddish24Scraper - INFO - Received response with 434811 characters
2026-06-21 22:00:07,201 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (294322 chars)
2026-06-21 22:00:07,205 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-06-21 22:00:07,289 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-06-21 22:00:07,330 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-06-21 22:00:07,330 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-06-21 22:00:08,191 - Yiddish24Scraper - INFO - Page 1 summary: 7 new out of 100 total articles
2026-06-21 22:00:08,191 - Yiddish24Scraper - INFO - Page 1: 7/100 new items
2026-06-21 22:00:08,192 - Yiddish24Scraper - INFO - Low new item ratio (7.0%), stopping pagination
2026-06-21 22:00:08,192 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 7
2026-06-21 22:00:15,244 - IveltScraper - INFO - Found 50 active topics on ivelt.com
2026-06-21 22:00:18,623 - IveltScraper - INFO - Ivelt scrape complete. Checked 1 topics, found 1 new posts.
2026-06-21 22:00:18,624 - __main__ - INFO - Scraper rss completed: 3 results
2026-06-21 22:00:18,624 - __main__ - INFO - Scraper yiddish24 completed: 7 results
2026-06-21 22:00:18,624 - __main__ - INFO - Scraper ivelt completed: 1 results
2026-06-21 22:00:19,317 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-21 22:00:19.317442
2026-06-21 22:00:19,317 - __main__ - INFO - Email sent successfully
2026-06-21 22:00:19,318 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-21 22:00:19,318 - __main__ - INFO - Monitor complete. Found 11 total results: 3 new rss results, 7 new yiddish24 results, 1 new ivelt results.
2026-06-21 22:00:19,318 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-21 22:00:19,318 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-21 22:00:19,406 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-21 22:00:19,406 - __main__ - INFO - Closed all database connections
2026-06-21 22:00:19,408 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-21 22:00:19,408 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-21 22:30:01,891 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-21.log
2026-06-21 22:30:01,891 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-21.log
2026-06-21 22:30:01,891 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-21.log
2026-06-21 22:30:01,891 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-21 22:30:01,918 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-21 22:30:01,918 - social_media_monitor.config.settings - WARNING - Twitter monitoring enabled but credentials validation not implemented
2026-06-21 22:30:01,918 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-21 22:30:01,921 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-21 22:30:01,921 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-21 22:30:01,948 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-21 22:30:01,948 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-21 22:30:01,991 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-21 22:30:01,991 - __main__ - INFO - Reddit scraper initialized and enabled
2026-06-21 22:30:01,992 - __main__ - INFO - GitHub scraper initialized and enabled
2026-06-21 22:30:01,992 - __main__ - INFO - Twitter scraper initialized and enabled
2026-06-21 22:30:01,992 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-21 22:30:01,992 - __main__ - INFO - LinkedIn scraper initialized and enabled
2026-06-21 22:30:01,993 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled
2026-06-21 22:30:01,995 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-21 22:30:01,995 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-21 22:30:01,998 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-21 22:30:02,002 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-21 22:30:02,002 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=10
2026-06-21 22:30:02,004 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-21 22:30:02,004 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-21 22:30:02,005 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-21 22:30:02,005 - __main__ - INFO - Running 5 scrapers concurrently...
2026-06-21 22:30:02,005 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit search monitoring enabled. Running search with terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-21 22:30:02,005 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['"Hermes Agent"']
2026-06-21 22:30:02,883 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term '"Hermes Agent"'
2026-06-21 22:30:02,936 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: I'm starting to understand the complaints
2026-06-21 22:30:02,950 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: My first Home Server
2026-06-21 22:30:04,123 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 2
2026-06-21 22:30:04,123 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'paperclip' restricted to subreddits: ['PaperClip_AI', 'PaperclipAI']
2026-06-21 22:30:04,123 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['paperclip']
2026-06-21 22:30:04,123 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/PaperClip_AI+PaperclipAI
2026-06-21 22:30:04,268 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 0 entries for term 'paperclip'
2026-06-21 22:30:05,269 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0
2026-06-21 22:30:05,269 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'multica' restricted to subreddits: ['hermesagent', 'HermesAI']
2026-06-21 22:30:05,269 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['multica']
2026-06-21 22:30:05,269 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/hermesagent+HermesAI
2026-06-21 22:30:05,415 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 0 entries for term 'multica'
2026-06-21 22:30:06,415 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0
2026-06-21 22:30:06,415 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit subreddit feed monitoring enabled.
2026-06-21 22:30:06,415 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'hermes_agent': r/hermesagent+HermesAI+AI_Agents+aiagents+AgentsOfAI+LocalLLaMA+AutoGPT (limit=25)
2026-06-21 22:30:06,416 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes agent via RSS
2026-06-21 22:30:07,559 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes AI via RSS
2026-06-21 22:30:08,707 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: nous research hermes via RSS
2026-06-21 22:30:09,851 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: multica via RSS
2026-06-21 22:30:11,183 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'paperclip_ai': r/PaperClip_AI+PaperclipAI+pAIperclip (limit=25)
2026-06-21 22:30:11,183 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip ai via RSS
2026-06-21 22:30:12,325 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip agent via RSS
2026-06-21 22:30:13,474 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: multica via RSS
2026-06-21 22:30:14,626 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'claude_agents': r/vibecoding (limit=25)
2026-06-21 22:30:14,626 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: multica via RSS
2026-06-21 22:30:15,776 - social_media_monitor.scrapers.reddit_scraper - INFO - Total subreddit feed results: 0
2026-06-21 22:30:15,777 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit top feed monitoring enabled (t=day).
2026-06-21 22:30:15,779 - social_media_monitor.scrapers.reddit_scraper - INFO - Fetching top/day posts from feed 'hermes_agent': ['hermesagent', 'HermesAI', 'AI_Agents', 'aiagents', 'AgentsOfAI', 'LocalLLaMA', 'AutoGPT']
2026-06-21 22:30:46,211 - social_media_monitor.scrapers.reddit_scraper - WARNING - Could not fetch top RSS for r/hermesagent after retries
2026-06-21 22:31:01,754 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit top RSS: 0 entries for r/HermesAI
2026-06-21 22:31:35,183 - social_media_monitor.scrapers.reddit_scraper - WARNING - Could not fetch top RSS for r/AI_Agents after retries
2026-06-21 22:32:05,639 - social_media_monitor.scrapers.reddit_scraper - WARNING - Could not fetch top RSS for r/aiagents after retries
2026-06-21 22:32:06,115 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit top RSS: 6 entries for r/AgentsOfAI
2026-06-21 22:32:06,147 - social_media_monitor.scrapers.reddit_scraper - INFO - New top post from feed 'hermes_agent' r/AgentsOfAI: Why self-reflection ReAct loops fail on long-horizon tasks, and the Ag
2026-06-21 22:32:06,154 - social_media_monitor.scrapers.reddit_scraper - INFO - New top post from feed 'hermes_agent' r/AgentsOfAI: Anyone know of an existing open-source project appropriate for a custo
2026-06-21 22:32:39,634 - social_media_monitor.scrapers.reddit_scraper - WARNING - Could not fetch top RSS for r/LocalLLaMA after retries
2026-06-21 22:32:39,892 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit top RSS: 1 entries for r/AutoGPT
2026-06-21 22:32:39,902 - social_media_monitor.scrapers.reddit_scraper - INFO - New top post from feed 'hermes_agent' r/AutoGPT: Alibaba Chairman Joseph Tsai says AI Agents will become the Next Digit
2026-06-21 22:32:42,902 - social_media_monitor.scrapers.reddit_scraper - INFO - Fetching top/day posts from feed 'paperclip_ai': ['PaperClip_AI', 'PaperclipAI', 'pAIperclip']
2026-06-21 22:33:13,339 - social_media_monitor.scrapers.reddit_scraper - WARNING - Could not fetch top RSS for r/PaperClip_AI after retries
2026-06-21 22:33:13,667 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit top RSS: 1 entries for r/PaperclipAI
2026-06-21 22:33:13,680 - social_media_monitor.scrapers.reddit_scraper - INFO - New top post from feed 'paperclip_ai' r/PaperclipAI: Ran into a nasty validation bug with Paperclip's gemini_local adapter
2026-06-21 22:33:47,113 - social_media_monitor.scrapers.reddit_scraper - WARNING - Could not fetch top RSS for r/pAIperclip after retries
2026-06-21 22:33:47,114 - social_media_monitor.scrapers.reddit_scraper - INFO - Fetching top/day posts from feed 'claude_agents': ['vibecoding']
2026-06-21 22:34:03,218 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit top RSS: 25 entries for r/vibecoding
2026-06-21 22:34:03,382 - social_media_monitor.scrapers.reddit_scraper - INFO - New top post from feed 'claude_agents' r/vibecoding: I built a football app thatโ€™s lets you follow the World Cup through an
2026-06-21 22:34:06,416 - social_media_monitor.scrapers.reddit_scraper - INFO - Total top feed results: 5
2026-06-21 22:34:06,419 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-21 22:34:06,561 - TwitterScraper - INFO - Searching Twitter/X (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-21 22:34:06,975 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'paperclip'
2026-06-21 22:34:21,271 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for '"Hermes Agent"'
2026-06-21 22:34:35,431 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'multica'
2026-06-21 22:34:48,883 - TwitterScraper - INFO - Twitter scrape complete. Found 0 new results.
2026-06-21 22:34:48,884 - LinkedInScraper - INFO - Searching LinkedIn (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-21 22:34:49,436 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'paperclip'
2026-06-21 22:34:50,513 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for '"Hermes Agent"'
2026-06-21 22:34:51,529 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'multica'
2026-06-21 22:34:52,159 - LinkedInScraper - INFO - LinkedIn scrape complete. Found 0 new results.
2026-06-21 22:34:52,159 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)
2026-06-21 22:34:52,431 - LinkedInFeedScraper - INFO - Successfully auto-grabbed fresh LinkedIn cookies and User-Agent from running Chrome!
2026-06-21 22:34:59,993 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Swift Acquistions - Featured Business Listings 6/20/26
(To stay updated with all businesses for sale, WhatsApp 732-800-7633 for the group link)
2026-06-21 22:35:00,011 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Menachem Rabinowitz ๐Ÿ˜ - It's not just a ChatGPT invention, it's a long-used writing style.
The truth?
These sentence structures weren't made by AI
โ€”ย they were made ๐˜ธ๐˜ฐ๐˜ณ๐˜ด๐˜ฆ by it.
For years, copywriters have used:
โ— Em
2026-06-21 22:35:00,018 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Ami Rosen - "Your challenges aren't accidents.
They're your assignment."
I spent 20 years as a top mortgage originator chasing the bigger number. When everything came apart at midlife โ€” the marriage, the house, t
2026-06-21 22:35:00,057 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Dov Brafman - However you celebrate, and whoever youโ€™re lucky enough to celebrate with,
Happy Fatherโ€™s Day.
Chaya Brafman
2026-06-21 22:35:00,119 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Ben Lutz - Grateful to be a dad.
One of the biggest lessons fatherhood has taught me is patience. There are moments when itโ€™s easier to react quickly or be strict, but Iโ€™ve learned that the better path is usual
2026-06-21 22:35:00,126 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Adam Levi - ืื•ืคืŸ ืกืคื™ื™ืก - ืคืจืง 4:
ืขื•ื‘ื“ ื—ื“ืฉ
ืชื•ื“ื” ืœRei Luz ืขืœ ื”ืขื–ืจื” ื‘ื›ืชื™ื‘ื”!
2026-06-21 22:35:00,126 - LinkedInFeedScraper - INFO - LinkedIn Feed scrape complete. Found 6 new posts.
2026-06-21 22:35:01,085 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-21 22:35:01,110 - GitHubScraper - INFO - Found 241 GitHub repositories for term: paperclip
2026-06-21 22:35:02,308 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-21 22:35:02,312 - GitHubScraper - INFO - Found 386 GitHub repositories for term: "Hermes Agent"
2026-06-21 22:35:03,358 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-21 22:35:03,362 - GitHubScraper - INFO - Found 53 GitHub repositories for term: multica
2026-06-21 22:35:03,498 - GitHubScraper - INFO - Total GitHub results found: 0
2026-06-21 22:35:03,498 - __main__ - INFO - Scraper reddit completed: 7 results
2026-06-21 22:35:03,498 - __main__ - INFO - Scraper github completed: 0 results
2026-06-21 22:35:03,498 - __main__ - INFO - Scraper twitter completed: 0 results
2026-06-21 22:35:03,498 - __main__ - INFO - Scraper linkedin completed: 0 results
2026-06-21 22:35:03,498 - __main__ - INFO - Scraper linkedin_feed completed: 6 results
2026-06-21 22:35:04,300 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-21 22:35:04.300653
2026-06-21 22:35:04,300 - __main__ - INFO - Email sent successfully
2026-06-21 22:35:04,301 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-21 22:35:04,301 - __main__ - INFO - Monitor complete. Found 13 total results: 7 new reddit results, 6 new linkedin feed results.
2026-06-21 22:35:04,301 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-21 22:35:04,301 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-21 22:35:04,397 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-21 22:35:04,398 - __main__ - INFO - Closed all database connections
2026-06-21 22:35:04,401 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-21 22:35:04,402 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-21 23:00:02,172 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-21.log
2026-06-21 23:00:02,172 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-21.log
2026-06-21 23:00:02,172 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-21.log
2026-06-21 23:00:02,173 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-21 23:00:02,199 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-21 23:00:02,199 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-21 23:00:02,201 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-21 23:00:02,202 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-21 23:00:02,231 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-21 23:00:02,231 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-21 23:00:02,232 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-21 23:00:02,233 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-21 23:00:02,233 - __main__ - INFO - RSS scraper initialized and enabled
2026-06-21 23:00:02,235 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-21 23:00:02,235 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-21 23:00:02,235 - __main__ - INFO - Yiddish24 scraper initialized and enabled
2026-06-21 23:00:02,238 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-21 23:00:02,243 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-21 23:00:02,243 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=10
2026-06-21 23:00:02,245 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-21 23:00:02,245 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-21 23:00:02,246 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-21 23:00:02,246 - __main__ - INFO - Ivelt scraper initialized and enabled
2026-06-21 23:00:02,246 - __main__ - INFO - Running 3 scrapers concurrently...
2026-06-21 23:00:02,246 - Yiddish24Scraper - INFO - Starting Yiddish24 scraping (max 10 pages, limit 100 items)
2026-06-21 23:00:02,334 - Yiddish24Scraper - INFO - Fetching Yiddish24 page 1 with data_id='latest', page_limit=100
2026-06-21 23:00:02,339 - IveltScraper - INFO - Loaded 181 include, 0 exclude filters from DB topic_filters
2026-06-21 23:00:02,339 - IveltScraper - INFO - Fetching ivelt.com active topics...
2026-06-21 23:00:02,341 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.theyeshivaworld.com/feed
2026-06-21 23:00:02,645 - RSSFeedScraper - INFO - Fetching RSS feed: https://www.thegatewaypundit.com/feed/
2026-06-21 23:00:03,117 - RSSFeedScraper - INFO - Total RSS/HTML results: 3
2026-06-21 23:00:06,644 - httpx - INFO - HTTP Request: POST https://www.yiddish24.com/ajax/cat_pagination.php "HTTP/1.1 200 OK"
2026-06-21 23:00:06,847 - Yiddish24Scraper - INFO - Received response with 444744 characters
2026-06-21 23:00:06,850 - Yiddish24Scraper - INFO - Extracted HTML from JSON result field (296240 chars)
2026-06-21 23:00:06,854 - Yiddish24Scraper - INFO - Saved HTML debug file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/debug/yiddish24_page1_response.html
2026-06-21 23:00:06,948 - Yiddish24Scraper - INFO - Found 100 potential article elements on page 1
2026-06-21 23:00:06,996 - Yiddish24Scraper - INFO - Page 1 extraction: 100 successful, 0 failed out of 100 elements
2026-06-21 23:00:06,997 - Yiddish24Scraper - INFO - Parsed 100 articles from HTML on page 1
2026-06-21 23:00:07,072 - Yiddish24Scraper - INFO - Term 'ืฉืœื™ื˜' matched in TITLE: 'ืื™ื ื˜ืขืจื•ื•ื™ื•: "ื‘ืจื•ืš ืžืชื™ืจ ืืกื•ืจื™ื",ื”ื‘ื—ื•ืจ ื™ื—ื™ืืœ ืงื•ื˜ื™ื™ื ืจ, ืžื—ืฉื•ื‘ื™ ืชืœืžื™ื“ื™ ื’ื•ืจ, ืื™ื– ื”ื™ื™ื ื˜ ื‘ืืคืจื™ื™ื˜ ื’ืขื•ื•ืืจืŸ ืคื•ืŸ ื˜ื•ืจืžืข ื ื•ืžืขืจ 10 ื ืื›ืŸ ืฉืžืื›ื˜ืŸ ื ื•ื•ืืš ืื•ืŸ ื’ืขื‘ืจืขื ื’ื˜ ืฆื• ืฉื˜ื•ืจืขืžื™ืฉืข ื”ืคื’ื ื•ืช ื‘ื”ืฉืชืชืคื•ืช ื›"ืง ืื“ืžื•"ืจ ืžื’ื•ืจ ืฉืœื™ื˜"ื'
2026-06-21 23:00:07,072 - Yiddish24Scraper - INFO - Downloading 1 media file(s) for article: ืื™ื ื˜ืขืจื•ื•ื™ื•: "ื‘ืจื•ืš ืžืชื™ืจ ืืกื•ืจื™ื",ื”ื‘ื—ื•ืจ ื™ื—ื™ืืœ ืงื•ื˜ื™ื™ื ืจ
2026-06-21 23:00:07,826 - social_media_monitor.utils.file_downloader - INFO - Starting download from: https://cloudfront.yiddish24.com/KM_N114_179_1782079810.mp3
2026-06-21 23:00:07,910 - social_media_monitor.utils.file_downloader - INFO - Successfully downloaded: Y2_KM_N114_179_1782079810.mp3 (1.1 MB)
2026-06-21 23:00:07,911 - social_media_monitor.utils.file_downloader - INFO - Organized audio file to: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/downloads/Audio (audio/mpeg)
2026-06-21 23:00:07,920 - social_media_monitor.utils.media_tagger - INFO - Tagged Y2_KM_N114_179_1782079810.mp3: title, artist, album, comment, source_url, genre, publisher
2026-06-21 23:00:07,920 - Yiddish24Scraper - INFO - Renamed downloaded file to include match term: Y2_KM_N114_179_1782079810_ืฉืœื™ื˜.mp3
2026-06-21 23:00:08,759 - Yiddish24Scraper - INFO - Page 1 summary: 11 new out of 100 total articles
2026-06-21 23:00:08,759 - Yiddish24Scraper - INFO - Page 1: 11/100 new items
2026-06-21 23:00:08,760 - Yiddish24Scraper - INFO - Low new item ratio (11.0%), stopping pagination
2026-06-21 23:00:08,760 - Yiddish24Scraper - INFO - Total Yiddish24 results found: 11
2026-06-21 23:00:13,913 - IveltScraper - INFO - Found 50 active topics on ivelt.com
2026-06-21 23:00:23,603 - IveltScraper - INFO - Ivelt scrape complete. Checked 3 topics, found 8 new posts.
2026-06-21 23:00:23,603 - __main__ - INFO - Scraper rss completed: 3 results
2026-06-21 23:00:23,603 - __main__ - INFO - Scraper yiddish24 completed: 11 results
2026-06-21 23:00:23,603 - __main__ - INFO - Scraper ivelt completed: 8 results
2026-06-21 23:00:24,362 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-21 23:00:24.361958
2026-06-21 23:00:24,362 - __main__ - INFO - Email sent successfully
2026-06-21 23:00:24,362 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-21 23:00:24,362 - __main__ - INFO - Monitor complete. Found 22 total results: 3 new rss results, 11 new yiddish24 results, 8 new ivelt results.
2026-06-21 23:00:24,362 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-21 23:00:24,362 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-21 23:00:24,616 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-21 23:00:24,617 - __main__ - INFO - Closed all database connections
2026-06-21 23:00:24,618 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-21 23:00:24,618 - social_media_monitor.database.connection - INFO - Closed 0 database connections
2026-06-21 23:30:01,835 - social_media_monitor.utils.logging_config - INFO - Posts log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_posts_2026-06-21.log
2026-06-21 23:30:01,835 - social_media_monitor.utils.logging_config - INFO - Downloads log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_downloads_2026-06-21.log
2026-06-21 23:30:01,836 - social_media_monitor.utils.logging_config - INFO - Logging configured with level INFO, log file: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/logs/social_media_monitor_2026-06-21.log
2026-06-21 23:30:01,836 - __main__ - INFO - === Social Media Monitor v2.0 (Async) Started ===
2026-06-21 23:30:01,873 - social_media_monitor.config.settings - INFO - Configuration loaded from /home/openclaw/Social_Media_Monitor/config.yaml
2026-06-21 23:30:01,874 - social_media_monitor.config.settings - WARNING - Twitter monitoring enabled but credentials validation not implemented
2026-06-21 23:30:01,874 - __main__ - INFO - Configuration loaded and validated successfully
2026-06-21 23:30:01,876 - social_media_monitor.database.connection - INFO - Database connection pool initialized with 5 connections
2026-06-21 23:30:01,877 - social_media_monitor.database.connection - INFO - add_speaker_filters column already exists
2026-06-21 23:30:01,896 - social_media_monitor.database.connection - INFO - Database setup completed successfully
2026-06-21 23:30:01,896 - __main__ - INFO - Database initialized at: /mnt/data/openclaw-shared/home/shared/Social_Media_Monitor/social_media_monitor.db
2026-06-21 23:30:01,897 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit API initialized successfully
2026-06-21 23:30:01,897 - __main__ - INFO - Reddit scraper initialized and enabled
2026-06-21 23:30:01,897 - __main__ - INFO - GitHub scraper initialized and enabled
2026-06-21 23:30:01,897 - __main__ - INFO - Twitter scraper initialized and enabled
2026-06-21 23:30:01,898 - RSSFeedScraper - INFO - RSS scraper initialized: feeds=2, html_urls=0 (0 with custom selectors), include_terms=0, exclude_terms=0
2026-06-21 23:30:01,898 - __main__ - INFO - LinkedIn scraper initialized and enabled
2026-06-21 23:30:01,898 - __main__ - INFO - LinkedIn Feed scraper initialized and enabled
2026-06-21 23:30:01,900 - Yiddish24Scraper - INFO - File downloader initialized with 55 terms, prefix 'Y2', and file type organization enabled
2026-06-21 23:30:01,900 - Yiddish24Scraper - INFO - Yiddish24 scraper initialized: data_id='latest', page_limit=100, total_pages=10, debug_html=True, include_terms=55, exclude_terms=0
2026-06-21 23:30:01,903 - AhBlickLiveScraper - INFO - AhBlickLive scraper initialized: urls=1, max_items=100, include_terms=49, exclude_terms=0
2026-06-21 23:30:01,909 - TorahAnytimeScraper - INFO - File downloader initialized with 53 terms, prefix 'TA', and file type organization enabled
2026-06-21 23:30:01,909 - TorahAnytimeScraper - INFO - TorahAnytime scraper initialized: limit=400, offset=0, project_id=1, include_terms=53, exclude_terms=10
2026-06-21 23:30:01,911 - BatorahScraper - INFO - File downloader initialized with 19 terms, prefix 'BT', and file type organization enabled
2026-06-21 23:30:01,913 - BatorahScraper - INFO - Batorah scraper initialized: api_urls=2, page_size=100, include_terms=19, exclude_terms=1
2026-06-21 23:30:01,913 - KolHalashonScraper - INFO - Kol Halashon scraper initialized: base_url=https://www2.kolhalashon.com, max_shiurim=50, fetch_all_speakers=True, headless=False, exclude_filters=1, include_filters=0
2026-06-21 23:30:01,913 - __main__ - INFO - Running 5 scrapers concurrently...
2026-06-21 23:30:01,913 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit search monitoring enabled. Running search with terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-21 23:30:01,913 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['"Hermes Agent"']
2026-06-21 23:30:02,819 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 25 entries for term '"Hermes Agent"'
2026-06-21 23:30:02,874 - social_media_monitor.scrapers.reddit_scraper - INFO - New Reddit post: anyone building serious stuff with hermes agent?
2026-06-21 23:30:04,140 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 1
2026-06-21 23:30:04,140 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'paperclip' restricted to subreddits: ['PaperClip_AI', 'PaperclipAI']
2026-06-21 23:30:04,140 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['paperclip']
2026-06-21 23:30:04,140 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/PaperClip_AI+PaperclipAI
2026-06-21 23:30:04,284 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 0 entries for term 'paperclip'
2026-06-21 23:30:05,284 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0
2026-06-21 23:30:05,284 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching 'multica' restricted to subreddits: ['hermesagent', 'HermesAI']
2026-06-21 23:30:05,285 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching Reddit RSS for terms: ['multica']
2026-06-21 23:30:05,285 - social_media_monitor.scrapers.reddit_scraper - INFO - Restricting Reddit search to subreddits: r/hermesagent+HermesAI
2026-06-21 23:30:05,431 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit RSS: 0 entries for term 'multica'
2026-06-21 23:30:06,431 - social_media_monitor.scrapers.reddit_scraper - INFO - Total Reddit RSS results found: 0
2026-06-21 23:30:06,432 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit subreddit feed monitoring enabled.
2026-06-21 23:30:06,432 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'hermes_agent': r/hermesagent+HermesAI+AI_Agents+aiagents+AgentsOfAI+LocalLLaMA+AutoGPT (limit=25)
2026-06-21 23:30:06,432 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes agent via RSS
2026-06-21 23:30:07,578 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: hermes AI via RSS
2026-06-21 23:30:08,726 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: nous research hermes via RSS
2026-06-21 23:30:09,873 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'hermes_agent' for: multica via RSS
2026-06-21 23:30:11,025 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'paperclip_ai': r/PaperClip_AI+PaperclipAI+pAIperclip (limit=25)
2026-06-21 23:30:11,025 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip ai via RSS
2026-06-21 23:30:12,169 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: paperclip agent via RSS
2026-06-21 23:30:13,317 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'paperclip_ai' for: multica via RSS
2026-06-21 23:30:14,467 - social_media_monitor.scrapers.reddit_scraper - INFO - Monitoring feed 'claude_agents': r/vibecoding (limit=25)
2026-06-21 23:30:14,467 - social_media_monitor.scrapers.reddit_scraper - INFO - Searching feed 'claude_agents' for: multica via RSS
2026-06-21 23:30:15,614 - social_media_monitor.scrapers.reddit_scraper - INFO - Total subreddit feed results: 0
2026-06-21 23:30:15,615 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit top feed monitoring enabled (t=day).
2026-06-21 23:30:15,615 - social_media_monitor.scrapers.reddit_scraper - INFO - Fetching top/day posts from feed 'hermes_agent': ['hermesagent', 'HermesAI', 'AI_Agents', 'aiagents', 'AgentsOfAI', 'LocalLLaMA', 'AutoGPT']
2026-06-21 23:30:46,064 - social_media_monitor.scrapers.reddit_scraper - WARNING - Could not fetch top RSS for r/hermesagent after retries
2026-06-21 23:31:01,608 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit top RSS: 0 entries for r/HermesAI
2026-06-21 23:31:35,047 - social_media_monitor.scrapers.reddit_scraper - WARNING - Could not fetch top RSS for r/AI_Agents after retries
2026-06-21 23:32:05,480 - social_media_monitor.scrapers.reddit_scraper - WARNING - Could not fetch top RSS for r/aiagents after retries
2026-06-21 23:32:05,889 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit top RSS: 6 entries for r/AgentsOfAI
2026-06-21 23:32:39,406 - social_media_monitor.scrapers.reddit_scraper - WARNING - Could not fetch top RSS for r/LocalLLaMA after retries
2026-06-21 23:33:09,850 - social_media_monitor.scrapers.reddit_scraper - WARNING - Could not fetch top RSS for r/AutoGPT after retries
2026-06-21 23:33:09,851 - social_media_monitor.scrapers.reddit_scraper - INFO - Fetching top/day posts from feed 'paperclip_ai': ['PaperClip_AI', 'PaperclipAI', 'pAIperclip']
2026-06-21 23:33:10,091 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit top RSS: 0 entries for r/PaperClip_AI
2026-06-21 23:33:43,521 - social_media_monitor.scrapers.reddit_scraper - WARNING - Could not fetch top RSS for r/PaperclipAI after retries
2026-06-21 23:33:59,051 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit top RSS: 0 entries for r/pAIperclip
2026-06-21 23:34:02,051 - social_media_monitor.scrapers.reddit_scraper - INFO - Fetching top/day posts from feed 'claude_agents': ['vibecoding']
2026-06-21 23:34:02,823 - social_media_monitor.scrapers.reddit_scraper - INFO - Reddit top RSS: 25 entries for r/vibecoding
2026-06-21 23:34:06,054 - social_media_monitor.scrapers.reddit_scraper - INFO - Total top feed results: 0
2026-06-21 23:34:06,057 - GitHubScraper - INFO - Searching GitHub for terms: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-21 23:34:06,185 - TwitterScraper - INFO - Searching Twitter/X (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-21 23:34:06,570 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'paperclip'
2026-06-21 23:34:20,859 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for '"Hermes Agent"'
2026-06-21 23:34:35,217 - TwitterScraper - INFO - Twitter/X RSS: 100 entries for 'multica'
2026-06-21 23:34:48,887 - TwitterScraper - INFO - Twitter scrape complete. Found 0 new results.
2026-06-21 23:34:48,888 - LinkedInScraper - INFO - Searching LinkedIn (Google News RSS) for: ['paperclip', '"Hermes Agent"', 'multica']
2026-06-21 23:34:49,481 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'paperclip'
2026-06-21 23:34:50,664 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for '"Hermes Agent"'
2026-06-21 23:34:51,752 - LinkedInScraper - INFO - LinkedIn RSS: 100 entries for 'multica'
2026-06-21 23:34:52,330 - LinkedInScraper - INFO - New LinkedIn post: Jamie Brogan - IBD Nurse Practitioner at Northwestern Medicine - Linke
2026-06-21 23:34:52,407 - LinkedInScraper - INFO - LinkedIn scrape complete. Found 1 new results.
2026-06-21 23:34:52,408 - LinkedInFeedScraper - INFO - Fetching LinkedIn feed (25 posts)
2026-06-21 23:34:52,835 - LinkedInFeedScraper - INFO - Successfully auto-grabbed fresh LinkedIn cookies and User-Agent from running Chrome!
2026-06-21 23:35:01,576 - LinkedInFeedScraper - INFO - New LinkedIn feed post: Sam Rosenberg - NYC Housing Lottery Alert โ€“ 173 Tompkins Avenue
Live in a newly constructed Brooklyn residence featuring modern finishes, in-unit washer/dryer, smart heating & cooling, hardwood floors, and private o
2026-06-21 23:35:01,688 - LinkedInFeedScraper - INFO - LinkedIn Feed scrape complete. Found 1 new posts.
2026-06-21 23:35:02,649 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=paperclip+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-21 23:35:02,740 - GitHubScraper - INFO - Found 241 GitHub repositories for term: paperclip
2026-06-21 23:35:04,017 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=%22Hermes+Agent%22+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-21 23:35:04,021 - GitHubScraper - INFO - Found 386 GitHub repositories for term: "Hermes Agent"
2026-06-21 23:35:04,943 - httpx - INFO - HTTP Request: GET https://api.github.com/search/repositories?q=multica+in%3Aname%2Cdescription%2Creadme+stars%3A%3E150&sort=updated&order=desc&per_page=20 "HTTP/1.1 200 OK"
2026-06-21 23:35:04,946 - GitHubScraper - INFO - Found 53 GitHub repositories for term: multica
2026-06-21 23:35:05,068 - GitHubScraper - INFO - Total GitHub results found: 0
2026-06-21 23:35:05,068 - __main__ - INFO - Scraper reddit completed: 1 results
2026-06-21 23:35:05,068 - __main__ - INFO - Scraper github completed: 0 results
2026-06-21 23:35:05,068 - __main__ - INFO - Scraper twitter completed: 0 results
2026-06-21 23:35:05,068 - __main__ - INFO - Scraper linkedin completed: 1 results
2026-06-21 23:35:05,068 - __main__ - INFO - Scraper linkedin_feed completed: 1 results
2026-06-21 23:35:05,765 - social_media_monitor.email.sender - INFO - Email sent successfully at 2026-06-21 23:35:05.765665
2026-06-21 23:35:05,766 - __main__ - INFO - Email sent successfully
2026-06-21 23:35:05,766 - __main__ - INFO - Cache stats: 0 items in memory, 0 files on disk
2026-06-21 23:35:05,766 - __main__ - INFO - Monitor complete. Found 3 total results: 1 new reddit results, 1 new linkedin results, 1 new linkedin feed results.
2026-06-21 23:35:05,766 - __main__ - INFO - === Social Media Monitor v2.0 Complete ===
2026-06-21 23:35:05,766 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-21 23:35:05,886 - social_media_monitor.database.connection - INFO - Closed 5 database connections
2026-06-21 23:35:05,886 - __main__ - INFO - Closed all database connections
2026-06-21 23:35:05,890 - social_media_monitor.database.connection - INFO - Closing all database connections
2026-06-21 23:35:05,891 - social_media_monitor.database.connection - INFO - Closed 0 database connections