수집현황
최근 실행한 크롤링 작업의 상태입니다. 실행 중인 작업이 있어 5초마다 자동 새로고침됩니다.
| 작업 | 대상 | 상태 | 수집 건수 | 시작 | 소요 |
|---|---|---|---|---|---|
| focused | 경제 (스케줄) | 성공 | +0 | 2026-08-08 04:46:38 | 131초 |
로그 보기2026-08-07 19:46:39 [focused] INFO: [진단] 수집할 카테고리: ['경제']
2026-08-07 19:46:39 [focused] INFO: [진단] '경제' 직접 RSS: https://www.hankyung.com/feed/economy
2026-08-07 19:46:39 [focused] INFO: [진단] '경제' 직접 RSS: https://rss.etnews.com/02.xml
2026-08-07 19:47:44 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying <GET https://www.hankyung.com/robots.txt> (failed 4 times): DNS lookup failed: no results for hostname lookup: www.hankyung.com.
2026-08-07 19:47:44 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying <GET https://rss.etnews.com/robots.txt> (failed 4 times): DNS lookup failed: no results for hostname lookup: rss.etnews.com.
2026-08-07 19:47:44 [scrapy.downloadermiddlewares.robotstxt] ERROR: Error downloading <GET https://www.hankyung.com/feed/economy>: DNS lookup failed: no results for hostname lookup: www.hankyung.com.
Traceback (most recent call last):
Traceback (most recent call last):
2026-08-07 19:47:44 [scrapy.downloadermiddlewares.robotstxt] ERROR: Error downloading <GET https://rss.etnews.com/02.xml>: DNS lookup failed: no results for hostname lookup: rss.etnews.com.
Traceback (most recent call last):
Traceback (most recent call last):
2026-08-07 19:48:49 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying <GET https://www.hankyung.com/feed/economy> (failed 4 times): DNS lookup failed: no results for hostname lookup: www.hankyung.com.
2026-08-07 19:48:49 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying <GET https://rss.etnews.com/02.xml> (failed 4 times): DNS lookup failed: no results for hostname lookup: rss.etnews.com.
2026-08-07 19:48:49 [scrapy.core.scraper] ERROR: Error downloading <GET https://www.hankyung.com/feed/economy>
Traceback (most recent call last):
Traceback (most recent call last):
2026-08-07 19:48:49 [scrapy.core.scraper] ERROR: Error downloading <GET https://rss.etnews.com/02.xml>
Traceback (most recent call last):
Traceback (most recent call last):
'log_count/ERROR': 8,
--- (최근 로그) ---
File "/usr/local/lib/python3.12/site-packages/scrapy/utils/_download_handlers.py", line 63, in wrap_twisted_exceptions
raise CannotResolveHostError(str(e)) from e
scrapy.exceptions.CannotResolveHostError: DNS lookup failed: no results for hostname lookup: rss.etnews.com.
2026-08-07 19:48:49 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-07 19:48:49 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/exception_count': 16,
'downloader/exception_type_count/scrapy.exceptions.CannotResolveHostError': 16,
'downloader/request_bytes': 3848,
'downloader/request_count': 16,
'downloader/request_method_count/GET': 16,
'elapsed_time_seconds': 129.83652049303055,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 7, 19, 48, 49, 175226, tzinfo=datetime.timezone.utc),
'items_per_minute': 0.0,
'log_count/ERROR': 8,
'log_count/INFO': 8,
'memusage/max': 95514624,
'memusage/startup': 94466048,
'responses_per_minute': 0.0,
'retry/count': 12,
'retry/max_reached': 4,
'retry/reason_count/scrapy.exceptions.CannotResolveHostError': 12,
"robotstxt/exception_count/<class 'scrapy.exceptions.CannotResolveHostError'>": 2,
'robotstxt/request_count': 2,
'scheduler/dequeued': 8,
'scheduler/dequeued/memory': 8,
'scheduler/enqueued': 8,
'scheduler/enqueued/memory': 8,
'start_time': datetime.datetime(2026, 8, 7, 19, 46, 39, 338708, tzinfo=datetime.timezone.utc)}
2026-08-07 19:48:49 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | 주식 (스케줄) | 성공 | +0 | 2026-08-08 04:41:26 | 131초 |
로그 보기2026-08-07 19:41:28 [focused] INFO: [진단] 수집할 카테고리: ['주식']
2026-08-07 19:41:28 [focused] INFO: [진단] '주식' 직접 RSS: https://www.hankyung.com/feed/finance
2026-08-07 19:42:32 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying <GET https://www.hankyung.com/robots.txt> (failed 4 times): DNS lookup failed: no results for hostname lookup: www.hankyung.com.
2026-08-07 19:42:32 [scrapy.downloadermiddlewares.robotstxt] ERROR: Error downloading <GET https://www.hankyung.com/feed/finance>: DNS lookup failed: no results for hostname lookup: www.hankyung.com.
Traceback (most recent call last):
Traceback (most recent call last):
2026-08-07 19:43:37 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying <GET https://www.hankyung.com/feed/finance> (failed 4 times): DNS lookup failed: no results for hostname lookup: www.hankyung.com.
2026-08-07 19:43:37 [scrapy.core.scraper] ERROR: Error downloading <GET https://www.hankyung.com/feed/finance>
Traceback (most recent call last):
Traceback (most recent call last):
'log_count/ERROR': 4,
--- (최근 로그) ---
File "/usr/local/lib/python3.12/site-packages/scrapy/utils/_download_handlers.py", line 63, in wrap_twisted_exceptions
raise CannotResolveHostError(str(e)) from e
scrapy.exceptions.CannotResolveHostError: DNS lookup failed: no results for hostname lookup: www.hankyung.com.
2026-08-07 19:43:37 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-07 19:43:37 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/exception_count': 8,
'downloader/exception_type_count/scrapy.exceptions.CannotResolveHostError': 8,
'downloader/request_bytes': 1944,
'downloader/request_count': 8,
'downloader/request_method_count/GET': 8,
'elapsed_time_seconds': 129.7889400308486,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 7, 19, 43, 37, 844414, tzinfo=datetime.timezone.utc),
'items_per_minute': 0.0,
'log_count/ERROR': 4,
'log_count/INFO': 7,
'memusage/max': 95449088,
'memusage/startup': 94531584,
'responses_per_minute': 0.0,
'retry/count': 6,
'retry/max_reached': 2,
'retry/reason_count/scrapy.exceptions.CannotResolveHostError': 6,
"robotstxt/exception_count/<class 'scrapy.exceptions.CannotResolveHostError'>": 1,
'robotstxt/request_count': 1,
'scheduler/dequeued': 4,
'scheduler/dequeued/memory': 4,
'scheduler/enqueued': 4,
'scheduler/enqueued/memory': 4,
'start_time': datetime.datetime(2026, 8, 7, 19, 41, 28, 55477, tzinfo=datetime.timezone.utc)}
2026-08-07 19:43:37 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | 경제 (스케줄) | 성공 | +0 | 2026-08-08 04:36:15 | 131초 |
로그 보기2026-08-07 19:36:16 [focused] INFO: [진단] 수집할 카테고리: ['경제']
2026-08-07 19:36:16 [focused] INFO: [진단] '경제' 직접 RSS: https://www.hankyung.com/feed/economy
2026-08-07 19:36:16 [focused] INFO: [진단] '경제' 직접 RSS: https://rss.etnews.com/02.xml
2026-08-07 19:37:21 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying <GET https://rss.etnews.com/robots.txt> (failed 4 times): DNS lookup failed: no results for hostname lookup: rss.etnews.com.
2026-08-07 19:37:21 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying <GET https://www.hankyung.com/robots.txt> (failed 4 times): DNS lookup failed: no results for hostname lookup: www.hankyung.com.
2026-08-07 19:37:21 [scrapy.downloadermiddlewares.robotstxt] ERROR: Error downloading <GET https://rss.etnews.com/02.xml>: DNS lookup failed: no results for hostname lookup: rss.etnews.com.
Traceback (most recent call last):
Traceback (most recent call last):
2026-08-07 19:37:21 [scrapy.downloadermiddlewares.robotstxt] ERROR: Error downloading <GET https://www.hankyung.com/feed/economy>: DNS lookup failed: no results for hostname lookup: www.hankyung.com.
Traceback (most recent call last):
Traceback (most recent call last):
2026-08-07 19:38:26 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying <GET https://www.hankyung.com/feed/economy> (failed 4 times): DNS lookup failed: no results for hostname lookup: www.hankyung.com.
2026-08-07 19:38:26 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying <GET https://rss.etnews.com/02.xml> (failed 4 times): DNS lookup failed: no results for hostname lookup: rss.etnews.com.
2026-08-07 19:38:26 [scrapy.core.scraper] ERROR: Error downloading <GET https://www.hankyung.com/feed/economy>
Traceback (most recent call last):
Traceback (most recent call last):
2026-08-07 19:38:26 [scrapy.core.scraper] ERROR: Error downloading <GET https://rss.etnews.com/02.xml>
Traceback (most recent call last):
Traceback (most recent call last):
'log_count/ERROR': 8,
--- (최근 로그) ---
File "/usr/local/lib/python3.12/site-packages/scrapy/utils/_download_handlers.py", line 63, in wrap_twisted_exceptions
raise CannotResolveHostError(str(e)) from e
scrapy.exceptions.CannotResolveHostError: DNS lookup failed: no results for hostname lookup: rss.etnews.com.
2026-08-07 19:38:26 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-07 19:38:26 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/exception_count': 16,
'downloader/exception_type_count/scrapy.exceptions.CannotResolveHostError': 16,
'downloader/request_bytes': 3848,
'downloader/request_count': 16,
'downloader/request_method_count/GET': 16,
'elapsed_time_seconds': 129.8210644228384,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 7, 19, 38, 26, 574088, tzinfo=datetime.timezone.utc),
'items_per_minute': 0.0,
'log_count/ERROR': 8,
'log_count/INFO': 8,
'memusage/max': 95653888,
'memusage/startup': 94736384,
'responses_per_minute': 0.0,
'retry/count': 12,
'retry/max_reached': 4,
'retry/reason_count/scrapy.exceptions.CannotResolveHostError': 12,
"robotstxt/exception_count/<class 'scrapy.exceptions.CannotResolveHostError'>": 2,
'robotstxt/request_count': 2,
'scheduler/dequeued': 8,
'scheduler/dequeued/memory': 8,
'scheduler/enqueued': 8,
'scheduler/enqueued/memory': 8,
'start_time': datetime.datetime(2026, 8, 7, 19, 36, 16, 753022, tzinfo=datetime.timezone.utc)}
2026-08-07 19:38:26 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | 주식 (스케줄) | 성공 | +0 | 2026-08-08 04:31:04 | 131초 |
로그 보기2026-08-07 19:31:05 [focused] INFO: [진단] 수집할 카테고리: ['주식']
2026-08-07 19:31:05 [focused] INFO: [진단] '주식' 직접 RSS: https://www.hankyung.com/feed/finance
2026-08-07 19:32:10 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying <GET https://www.hankyung.com/robots.txt> (failed 4 times): DNS lookup failed: no results for hostname lookup: www.hankyung.com.
2026-08-07 19:32:10 [scrapy.downloadermiddlewares.robotstxt] ERROR: Error downloading <GET https://www.hankyung.com/feed/finance>: DNS lookup failed: no results for hostname lookup: www.hankyung.com.
Traceback (most recent call last):
Traceback (most recent call last):
2026-08-07 19:33:15 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying <GET https://www.hankyung.com/feed/finance> (failed 4 times): DNS lookup failed: no results for hostname lookup: www.hankyung.com.
2026-08-07 19:33:15 [scrapy.core.scraper] ERROR: Error downloading <GET https://www.hankyung.com/feed/finance>
Traceback (most recent call last):
Traceback (most recent call last):
'log_count/ERROR': 4,
--- (최근 로그) ---
File "/usr/local/lib/python3.12/site-packages/scrapy/utils/_download_handlers.py", line 63, in wrap_twisted_exceptions
raise CannotResolveHostError(str(e)) from e
scrapy.exceptions.CannotResolveHostError: DNS lookup failed: no results for hostname lookup: www.hankyung.com.
2026-08-07 19:33:15 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-07 19:33:15 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/exception_count': 8,
'downloader/exception_type_count/scrapy.exceptions.CannotResolveHostError': 8,
'downloader/request_bytes': 1944,
'downloader/request_count': 8,
'downloader/request_method_count/GET': 8,
'elapsed_time_seconds': 129.79284410295077,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 7, 19, 33, 15, 247382, tzinfo=datetime.timezone.utc),
'items_per_minute': 0.0,
'log_count/ERROR': 4,
'log_count/INFO': 7,
'memusage/max': 95522816,
'memusage/startup': 94474240,
'responses_per_minute': 0.0,
'retry/count': 6,
'retry/max_reached': 2,
'retry/reason_count/scrapy.exceptions.CannotResolveHostError': 6,
"robotstxt/exception_count/<class 'scrapy.exceptions.CannotResolveHostError'>": 1,
'robotstxt/request_count': 1,
'scheduler/dequeued': 4,
'scheduler/dequeued/memory': 4,
'scheduler/enqueued': 4,
'scheduler/enqueued/memory': 4,
'start_time': datetime.datetime(2026, 8, 7, 19, 31, 5, 454537, tzinfo=datetime.timezone.utc)}
2026-08-07 19:33:15 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | IT (스케줄) | 성공 | +0 | 2026-08-08 04:28:51 | 132초 |
로그 보기2026-08-07 19:28:52 [focused] INFO: [진단] 수집할 카테고리: ['IT']
2026-08-07 19:28:52 [focused] INFO: [진단] 'IT' 직접 RSS: https://www.hankyung.com/feed/it
2026-08-07 19:28:52 [focused] INFO: [진단] 'IT' 직접 RSS: https://rss.etnews.com/03.xml
2026-08-07 19:28:52 [focused] INFO: [진단] 'IT' 직접 RSS: https://rss.etnews.com/04046.xml
2026-08-07 19:29:57 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying <GET https://rss.etnews.com/robots.txt> (failed 4 times): DNS lookup failed: no results for hostname lookup: rss.etnews.com.
2026-08-07 19:29:57 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying <GET https://www.hankyung.com/robots.txt> (failed 4 times): DNS lookup failed: no results for hostname lookup: www.hankyung.com.
2026-08-07 19:29:57 [scrapy.downloadermiddlewares.robotstxt] ERROR: Error downloading <GET https://rss.etnews.com/03.xml>: DNS lookup failed: no results for hostname lookup: rss.etnews.com.
Traceback (most recent call last):
Traceback (most recent call last):
2026-08-07 19:29:57 [scrapy.downloadermiddlewares.robotstxt] ERROR: Error downloading <GET https://www.hankyung.com/feed/it>: DNS lookup failed: no results for hostname lookup: www.hankyung.com.
Traceback (most recent call last):
Traceback (most recent call last):
2026-08-07 19:31:02 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying <GET https://rss.etnews.com/03.xml> (failed 4 times): DNS lookup failed: no results for hostname lookup: rss.etnews.com.
2026-08-07 19:31:02 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying <GET https://www.hankyung.com/feed/it> (failed 4 times): DNS lookup failed: no results for hostname lookup: www.hankyung.com.
2026-08-07 19:31:02 [scrapy.core.scraper] ERROR: Error downloading <GET https://rss.etnews.com/03.xml>
Traceback (most recent call last):
Traceback (most recent call last):
2026-08-07 19:31:02 [scrapy.core.scraper] ERROR: Error downloading <GET https://www.hankyung.com/feed/it>
Traceback (most recent call last):
Traceback (most recent call last):
2026-08-07 19:31:03 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying <GET https://rss.etnews.com/04046.xml> (failed 4 times): DNS lookup failed: no results for hostname lookup: rss.etnews.com.
2026-08-07 19:31:04 [scrapy.core.scraper] ERROR: Error downloading <GET https://rss.etnews.com/04046.xml>
Traceback (most recent call last):
Traceback (most recent call last):
'log_count/ERROR': 10,
--- (최근 로그) ---
File "/usr/local/lib/python3.12/site-packages/scrapy/utils/_download_handlers.py", line 63, in wrap_twisted_exceptions
raise CannotResolveHostError(str(e)) from e
scrapy.exceptions.CannotResolveHostError: DNS lookup failed: no results for hostname lookup: rss.etnews.com.
2026-08-07 19:31:04 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-07 19:31:04 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/exception_count': 20,
'downloader/exception_type_count/scrapy.exceptions.CannotResolveHostError': 20,
'downloader/request_bytes': 4784,
'downloader/request_count': 20,
'downloader/request_method_count/GET': 20,
'elapsed_time_seconds': 131.0614996959921,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 7, 19, 31, 4, 11326, tzinfo=datetime.timezone.utc),
'items_per_minute': 0.0,
'log_count/ERROR': 10,
'log_count/INFO': 9,
'memusage/max': 95006720,
'memusage/startup': 93958144,
'responses_per_minute': 0.0,
'retry/count': 15,
'retry/max_reached': 5,
'retry/reason_count/scrapy.exceptions.CannotResolveHostError': 15,
"robotstxt/exception_count/<class 'scrapy.exceptions.CannotResolveHostError'>": 2,
'robotstxt/request_count': 2,
'scheduler/dequeued': 12,
'scheduler/dequeued/memory': 12,
'scheduler/enqueued': 12,
'scheduler/enqueued/memory': 12,
'start_time': datetime.datetime(2026, 8, 7, 19, 28, 52, 949825, tzinfo=datetime.timezone.utc)}
2026-08-07 19:31:04 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | 경제 (스케줄) | 성공 | +0 | 2026-08-08 04:25:40 | 131초 |
로그 보기2026-08-07 19:25:41 [focused] INFO: [진단] 수집할 카테고리: ['경제']
2026-08-07 19:25:41 [focused] INFO: [진단] '경제' 직접 RSS: https://www.hankyung.com/feed/economy
2026-08-07 19:25:41 [focused] INFO: [진단] '경제' 직접 RSS: https://rss.etnews.com/02.xml
2026-08-07 19:26:46 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying <GET https://www.hankyung.com/robots.txt> (failed 4 times): DNS lookup failed: no results for hostname lookup: www.hankyung.com.
2026-08-07 19:26:46 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying <GET https://rss.etnews.com/robots.txt> (failed 4 times): DNS lookup failed: no results for hostname lookup: rss.etnews.com.
2026-08-07 19:26:46 [scrapy.downloadermiddlewares.robotstxt] ERROR: Error downloading <GET https://www.hankyung.com/feed/economy>: DNS lookup failed: no results for hostname lookup: www.hankyung.com.
Traceback (most recent call last):
Traceback (most recent call last):
2026-08-07 19:26:46 [scrapy.downloadermiddlewares.robotstxt] ERROR: Error downloading <GET https://rss.etnews.com/02.xml>: DNS lookup failed: no results for hostname lookup: rss.etnews.com.
Traceback (most recent call last):
Traceback (most recent call last):
2026-08-07 19:27:51 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying <GET https://rss.etnews.com/02.xml> (failed 4 times): DNS lookup failed: no results for hostname lookup: rss.etnews.com.
2026-08-07 19:27:51 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying <GET https://www.hankyung.com/feed/economy> (failed 4 times): DNS lookup failed: no results for hostname lookup: www.hankyung.com.
2026-08-07 19:27:51 [scrapy.core.scraper] ERROR: Error downloading <GET https://rss.etnews.com/02.xml>
Traceback (most recent call last):
Traceback (most recent call last):
2026-08-07 19:27:51 [scrapy.core.scraper] ERROR: Error downloading <GET https://www.hankyung.com/feed/economy>
Traceback (most recent call last):
Traceback (most recent call last):
'log_count/ERROR': 8,
--- (최근 로그) ---
File "/usr/local/lib/python3.12/site-packages/scrapy/utils/_download_handlers.py", line 63, in wrap_twisted_exceptions
raise CannotResolveHostError(str(e)) from e
scrapy.exceptions.CannotResolveHostError: DNS lookup failed: no results for hostname lookup: www.hankyung.com.
2026-08-07 19:27:51 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-07 19:27:51 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/exception_count': 16,
'downloader/exception_type_count/scrapy.exceptions.CannotResolveHostError': 16,
'downloader/request_bytes': 3848,
'downloader/request_count': 16,
'downloader/request_method_count/GET': 16,
'elapsed_time_seconds': 129.82005442213267,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 7, 19, 27, 51, 490328, tzinfo=datetime.timezone.utc),
'items_per_minute': 0.0,
'log_count/ERROR': 8,
'log_count/INFO': 8,
'memusage/max': 95555584,
'memusage/startup': 94638080,
'responses_per_minute': 0.0,
'retry/count': 12,
'retry/max_reached': 4,
'retry/reason_count/scrapy.exceptions.CannotResolveHostError': 12,
"robotstxt/exception_count/<class 'scrapy.exceptions.CannotResolveHostError'>": 2,
'robotstxt/request_count': 2,
'scheduler/dequeued': 8,
'scheduler/dequeued/memory': 8,
'scheduler/enqueued': 8,
'scheduler/enqueued/memory': 8,
'start_time': datetime.datetime(2026, 8, 7, 19, 25, 41, 670273, tzinfo=datetime.timezone.utc)}
2026-08-07 19:27:51 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | 보안위협 (스케줄) | 성공 | +0 | 2026-08-08 04:23:29 | 131초 |
로그 보기2026-08-07 19:23:30 [focused] INFO: [진단] 수집할 카테고리: ['보안위협']
2026-08-07 19:23:30 [focused] INFO: [진단] '보안위협' 직접 RSS: https://www.boannews.com/media/news_rss.xml
2026-08-07 19:23:30 [focused] INFO: [진단] '보안위협' 직접 RSS: https://rss.etnews.com/04045.xml
2026-08-07 19:24:35 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying <GET https://rss.etnews.com/robots.txt> (failed 4 times): DNS lookup failed: no results for hostname lookup: rss.etnews.com.
2026-08-07 19:24:35 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying <GET https://www.boannews.com/robots.txt> (failed 4 times): DNS lookup failed: no results for hostname lookup: www.boannews.com.
2026-08-07 19:24:35 [scrapy.downloadermiddlewares.robotstxt] ERROR: Error downloading <GET https://rss.etnews.com/04045.xml>: DNS lookup failed: no results for hostname lookup: rss.etnews.com.
Traceback (most recent call last):
Traceback (most recent call last):
2026-08-07 19:24:35 [scrapy.downloadermiddlewares.robotstxt] ERROR: Error downloading <GET https://www.boannews.com/media/news_rss.xml>: DNS lookup failed: no results for hostname lookup: www.boannews.com.
Traceback (most recent call last):
Traceback (most recent call last):
2026-08-07 19:25:40 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying <GET https://rss.etnews.com/04045.xml> (failed 4 times): DNS lookup failed: no results for hostname lookup: rss.etnews.com.
2026-08-07 19:25:40 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying <GET https://www.boannews.com/media/news_rss.xml> (failed 4 times): DNS lookup failed: no results for hostname lookup: www.boannews.com.
2026-08-07 19:25:40 [scrapy.core.scraper] ERROR: Error downloading <GET https://rss.etnews.com/04045.xml>
Traceback (most recent call last):
Traceback (most recent call last):
2026-08-07 19:25:40 [scrapy.core.scraper] ERROR: Error downloading <GET https://www.boannews.com/media/news_rss.xml>
Traceback (most recent call last):
Traceback (most recent call last):
'log_count/ERROR': 8,
--- (최근 로그) ---
File "/usr/local/lib/python3.12/site-packages/scrapy/utils/_download_handlers.py", line 63, in wrap_twisted_exceptions
raise CannotResolveHostError(str(e)) from e
scrapy.exceptions.CannotResolveHostError: DNS lookup failed: no results for hostname lookup: www.boannews.com.
2026-08-07 19:25:40 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-07 19:25:40 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/exception_count': 16,
'downloader/exception_type_count/scrapy.exceptions.CannotResolveHostError': 16,
'downloader/request_bytes': 3884,
'downloader/request_count': 16,
'downloader/request_method_count/GET': 16,
'elapsed_time_seconds': 129.81811548396945,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 7, 19, 25, 40, 243044, tzinfo=datetime.timezone.utc),
'items_per_minute': 0.0,
'log_count/ERROR': 8,
'log_count/INFO': 8,
'memusage/max': 95375360,
'memusage/startup': 94457856,
'responses_per_minute': 0.0,
'retry/count': 12,
'retry/max_reached': 4,
'retry/reason_count/scrapy.exceptions.CannotResolveHostError': 12,
"robotstxt/exception_count/<class 'scrapy.exceptions.CannotResolveHostError'>": 2,
'robotstxt/request_count': 2,
'scheduler/dequeued': 8,
'scheduler/dequeued/memory': 8,
'scheduler/enqueued': 8,
'scheduler/enqueued/memory': 8,
'start_time': datetime.datetime(2026, 8, 7, 19, 23, 30, 424928, tzinfo=datetime.timezone.utc)}
2026-08-07 19:25:40 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | 부동산 (스케줄) | 성공 | +0 | 2026-08-08 04:21:22 | 66초 |
로그 보기2026-08-07 19:21:24 [focused] INFO: [진단] 수집할 카테고리: ['부동산']
2026-08-07 19:21:24 [focused] INFO: [진단] '부동산' 구글 뉴스 폴백 RSS: https://news.google.com/rss/search?q=DSR%20OR%20%EB%8C%80%EC%B6%9C%EA%B7%9C%EC%A0%9C&hl=ko&gl=KR&ceid=KR:ko
2026-08-07 19:22:28 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying <GET https://news.google.com/rss/search?q=DSR%20OR%20%EB%8C%80%EC%B6%9C%EA%B7%9C%EC%A0%9C&hl=ko&gl=KR&ceid=KR:ko> (failed 4 times): DNS lookup failed: no results for hostname lookup: news.google.com.
2026-08-07 19:22:28 [scrapy.core.scraper] ERROR: Error downloading <GET https://news.google.com/rss/search?q=DSR%20OR%20%EB%8C%80%EC%B6%9C%EA%B7%9C%EC%A0%9C&hl=ko&gl=KR&ceid=KR:ko>
Traceback (most recent call last):
Traceback (most recent call last):
'log_count/ERROR': 2,
--- (최근 로그) ---
File "/usr/local/lib/python3.12/contextlib.py", line 158, in __exit__
self.gen.throw(value)
File "/usr/local/lib/python3.12/site-packages/scrapy/utils/_download_handlers.py", line 63, in wrap_twisted_exceptions
raise CannotResolveHostError(str(e)) from e
scrapy.exceptions.CannotResolveHostError: DNS lookup failed: no results for hostname lookup: news.google.com.
2026-08-07 19:22:28 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-07 19:22:28 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/exception_count': 4,
'downloader/exception_type_count/scrapy.exceptions.CannotResolveHostError': 4,
'downloader/request_bytes': 1256,
'downloader/request_count': 4,
'downloader/request_method_count/GET': 4,
'elapsed_time_seconds': 64.96070297714323,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 7, 19, 22, 28, 976835, tzinfo=datetime.timezone.utc),
'items_per_minute': 0.0,
'log_count/ERROR': 2,
'log_count/INFO': 6,
'memusage/max': 94973952,
'memusage/startup': 94711808,
'responses_per_minute': 0.0,
'retry/count': 3,
'retry/max_reached': 1,
'retry/reason_count/scrapy.exceptions.CannotResolveHostError': 3,
'scheduler/dequeued': 4,
'scheduler/dequeued/memory': 4,
'scheduler/enqueued': 4,
'scheduler/enqueued/memory': 4,
'start_time': datetime.datetime(2026, 8, 7, 19, 21, 24, 16134, tzinfo=datetime.timezone.utc)}
2026-08-07 19:22:28 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | 주식 (스케줄) | 성공 | +0 | 2026-08-08 04:17:11 | 131초 |
로그 보기2026-08-07 19:17:12 [focused] INFO: [진단] 수집할 카테고리: ['주식']
2026-08-07 19:17:12 [focused] INFO: [진단] '주식' 직접 RSS: https://www.hankyung.com/feed/finance
2026-08-07 19:18:17 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying <GET https://www.hankyung.com/robots.txt> (failed 4 times): DNS lookup failed: no results for hostname lookup: www.hankyung.com.
2026-08-07 19:18:17 [scrapy.downloadermiddlewares.robotstxt] ERROR: Error downloading <GET https://www.hankyung.com/feed/finance>: DNS lookup failed: no results for hostname lookup: www.hankyung.com.
Traceback (most recent call last):
Traceback (most recent call last):
2026-08-07 19:19:22 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying <GET https://www.hankyung.com/feed/finance> (failed 4 times): DNS lookup failed: no results for hostname lookup: www.hankyung.com.
2026-08-07 19:19:22 [scrapy.core.scraper] ERROR: Error downloading <GET https://www.hankyung.com/feed/finance>
Traceback (most recent call last):
Traceback (most recent call last):
'log_count/ERROR': 4,
--- (최근 로그) ---
File "/usr/local/lib/python3.12/site-packages/scrapy/utils/_download_handlers.py", line 63, in wrap_twisted_exceptions
raise CannotResolveHostError(str(e)) from e
scrapy.exceptions.CannotResolveHostError: DNS lookup failed: no results for hostname lookup: www.hankyung.com.
2026-08-07 19:19:22 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-07 19:19:22 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/exception_count': 8,
'downloader/exception_type_count/scrapy.exceptions.CannotResolveHostError': 8,
'downloader/request_bytes': 1944,
'downloader/request_count': 8,
'downloader/request_method_count/GET': 8,
'elapsed_time_seconds': 129.7891656209249,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 7, 19, 19, 22, 544832, tzinfo=datetime.timezone.utc),
'items_per_minute': 0.0,
'log_count/ERROR': 4,
'log_count/INFO': 7,
'memusage/max': 95494144,
'memusage/startup': 94707712,
'responses_per_minute': 0.0,
'retry/count': 6,
'retry/max_reached': 2,
'retry/reason_count/scrapy.exceptions.CannotResolveHostError': 6,
"robotstxt/exception_count/<class 'scrapy.exceptions.CannotResolveHostError'>": 1,
'robotstxt/request_count': 1,
'scheduler/dequeued': 4,
'scheduler/dequeued/memory': 4,
'scheduler/enqueued': 4,
'scheduler/enqueued/memory': 4,
'start_time': datetime.datetime(2026, 8, 7, 19, 17, 12, 755669, tzinfo=datetime.timezone.utc)}
2026-08-07 19:19:22 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | 경제 (스케줄) | 성공 | +0 | 2026-08-08 04:12:00 | 131초 |
로그 보기2026-08-07 19:12:01 [focused] INFO: [진단] 수집할 카테고리: ['경제']
2026-08-07 19:12:01 [focused] INFO: [진단] '경제' 직접 RSS: https://www.hankyung.com/feed/economy
2026-08-07 19:12:01 [focused] INFO: [진단] '경제' 직접 RSS: https://rss.etnews.com/02.xml
2026-08-07 19:13:06 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying <GET https://rss.etnews.com/robots.txt> (failed 4 times): DNS lookup failed: no results for hostname lookup: rss.etnews.com.
2026-08-07 19:13:06 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying <GET https://www.hankyung.com/robots.txt> (failed 4 times): DNS lookup failed: no results for hostname lookup: www.hankyung.com.
2026-08-07 19:13:06 [scrapy.downloadermiddlewares.robotstxt] ERROR: Error downloading <GET https://rss.etnews.com/02.xml>: DNS lookup failed: no results for hostname lookup: rss.etnews.com.
Traceback (most recent call last):
Traceback (most recent call last):
2026-08-07 19:13:06 [scrapy.downloadermiddlewares.robotstxt] ERROR: Error downloading <GET https://www.hankyung.com/feed/economy>: DNS lookup failed: no results for hostname lookup: www.hankyung.com.
Traceback (most recent call last):
Traceback (most recent call last):
2026-08-07 19:14:11 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying <GET https://www.hankyung.com/feed/economy> (failed 4 times): DNS lookup failed: no results for hostname lookup: www.hankyung.com.
2026-08-07 19:14:11 [scrapy.downloadermiddlewares.retry] ERROR: Gave up retrying <GET https://rss.etnews.com/02.xml> (failed 4 times): DNS lookup failed: no results for hostname lookup: rss.etnews.com.
2026-08-07 19:14:11 [scrapy.core.scraper] ERROR: Error downloading <GET https://www.hankyung.com/feed/economy>
Traceback (most recent call last):
Traceback (most recent call last):
2026-08-07 19:14:11 [scrapy.core.scraper] ERROR: Error downloading <GET https://rss.etnews.com/02.xml>
Traceback (most recent call last):
Traceback (most recent call last):
'log_count/ERROR': 8,
--- (최근 로그) ---
File "/usr/local/lib/python3.12/site-packages/scrapy/utils/_download_handlers.py", line 63, in wrap_twisted_exceptions
raise CannotResolveHostError(str(e)) from e
scrapy.exceptions.CannotResolveHostError: DNS lookup failed: no results for hostname lookup: rss.etnews.com.
2026-08-07 19:14:11 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-07 19:14:11 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/exception_count': 16,
'downloader/exception_type_count/scrapy.exceptions.CannotResolveHostError': 16,
'downloader/request_bytes': 3848,
'downloader/request_count': 16,
'downloader/request_method_count/GET': 16,
'elapsed_time_seconds': 129.82635051803663,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 7, 19, 14, 11, 271708, tzinfo=datetime.timezone.utc),
'items_per_minute': 0.0,
'log_count/ERROR': 8,
'log_count/INFO': 8,
'memusage/max': 95899648,
'memusage/startup': 94851072,
'responses_per_minute': 0.0,
'retry/count': 12,
'retry/max_reached': 4,
'retry/reason_count/scrapy.exceptions.CannotResolveHostError': 12,
"robotstxt/exception_count/<class 'scrapy.exceptions.CannotResolveHostError'>": 2,
'robotstxt/request_count': 2,
'scheduler/dequeued': 8,
'scheduler/dequeued/memory': 8,
'scheduler/enqueued': 8,
'scheduler/enqueued/memory': 8,
'start_time': datetime.datetime(2026, 8, 7, 19, 12, 1, 445355, tzinfo=datetime.timezone.utc)}
2026-08-07 19:14:11 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||