수집현황
최근 실행한 크롤링 작업의 상태입니다. 실행 중인 작업이 있어 5초마다 자동 새로고침됩니다.
| 작업 | 대상 | 상태 | 수집 건수 | 시작 | 소요 |
|---|---|---|---|---|---|
| focused | 경제d17yBTkf'; waitfor delay '0:0:15' -- (스케줄) | 성공 | +0 | 2026-08-17 13:49:19 | 1초 |
로그 보기2026-08-17 04:49:21 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 04:49:21 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-17 04:49:21 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-17 04:49:21 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-17 04:49:21 [scrapy.core.engine] INFO: Spider opened
2026-08-17 04:49:21 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-17 04:49:21 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-17 04:49:21 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 04:49:21 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-17 04:49:21 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-17 04:49:21 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.013158065266907215,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 17, 4, 49, 21, 165367, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90382336,
'memusage/startup': 90382336,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 17, 4, 49, 21, 152208, tzinfo=datetime.timezone.utc)}
2026-08-17 04:49:21 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | 경제MLVmfXgg')) OR 196=(SELECT 196 FROM PG_SLEEP(15))-- (스케줄) | 성공 | +0 | 2026-08-17 13:49:18 | 1초 |
로그 보기2026-08-17 04:49:19 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 04:49:19 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-17 04:49:19 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-17 04:49:19 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-17 04:49:19 [scrapy.core.engine] INFO: Spider opened
2026-08-17 04:49:19 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-17 04:49:19 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-17 04:49:19 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 04:49:19 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-17 04:49:19 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-17 04:49:19 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.012830557767301798,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 17, 4, 49, 19, 729330, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90161152,
'memusage/startup': 90161152,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 17, 4, 49, 19, 716498, tzinfo=datetime.timezone.utc)}
2026-08-17 04:49:19 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | 경제 (스케줄) | 성공 | +0 | 2026-08-17 13:45:16 | 1초 |
로그 보기2026-08-17 04:45:18 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 04:45:18 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-17 04:45:18 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-17 04:45:18 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-17 04:45:18 [scrapy.core.engine] INFO: Spider opened
2026-08-17 04:45:18 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-17 04:45:18 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-17 04:45:18 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 04:45:18 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-17 04:45:18 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-17 04:45:18 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.014428109861910343,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 17, 4, 45, 18, 233179, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90173440,
'memusage/startup': 90173440,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 17, 4, 45, 18, 218751, tzinfo=datetime.timezone.utc)}
2026-08-17 04:45:18 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | 경제QQ0fTJev' OR 803=(SELECT 803 FROM PG_SLEEP(15))-- (스케줄) | 성공 | +0 | 2026-08-17 13:45:15 | 1초 |
로그 보기2026-08-17 04:45:16 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 04:45:16 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-17 04:45:16 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-17 04:45:16 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-17 04:45:16 [scrapy.core.engine] INFO: Spider opened
2026-08-17 04:45:16 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-17 04:45:16 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-17 04:45:16 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 04:45:16 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-17 04:45:16 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-17 04:45:16 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.016560757998377085,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 17, 4, 45, 16, 785385, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90349568,
'memusage/startup': 90349568,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 17, 4, 45, 16, 768823, tzinfo=datetime.timezone.utc)}
2026-08-17 04:45:16 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | IT (스케줄) | 성공 | +0 | 2026-08-17 13:45:14 | 1초 |
로그 보기2026-08-17 04:45:15 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 04:45:15 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-17 04:45:15 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-17 04:45:15 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-17 04:45:15 [scrapy.core.engine] INFO: Spider opened
2026-08-17 04:45:15 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-17 04:45:15 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-17 04:45:15 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 04:45:15 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-17 04:45:15 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-17 04:45:15 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.012115622870624065,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 17, 4, 45, 15, 354988, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 89985024,
'memusage/startup': 89985024,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 17, 4, 45, 15, 342872, tzinfo=datetime.timezone.utc)}
2026-08-17 04:45:15 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | 보안위협 (스케줄) | 성공 | +0 | 2026-08-17 13:45:12 | 1초 |
로그 보기2026-08-17 04:45:13 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 04:45:13 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-17 04:45:13 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-17 04:45:13 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-17 04:45:13 [scrapy.core.engine] INFO: Spider opened
2026-08-17 04:45:13 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-17 04:45:13 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-17 04:45:13 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 04:45:13 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-17 04:45:13 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-17 04:45:13 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.014693727251142263,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 17, 4, 45, 13, 922371, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90378240,
'memusage/startup': 90378240,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 17, 4, 45, 13, 907675, tzinfo=datetime.timezone.utc)}
2026-08-17 04:45:13 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | @@I0WIt (스케줄) | 성공 | +0 | 2026-08-17 13:45:11 | 1초 |
로그 보기2026-08-17 04:45:12 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 04:45:12 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-17 04:45:12 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-17 04:45:12 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-17 04:45:12 [scrapy.core.engine] INFO: Spider opened
2026-08-17 04:45:12 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-17 04:45:12 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-17 04:45:12 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 04:45:12 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-17 04:45:12 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-17 04:45:12 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.014450416900217533,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 17, 4, 45, 12, 490175, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90738688,
'memusage/startup': 90738688,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 17, 4, 45, 12, 475723, tzinfo=datetime.timezone.utc)}
2026-08-17 04:45:12 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | 경제lgvGOBoP')) OR 353=(SELECT 353 FROM PG_SLEEP(15))-- (스케줄) | 성공 | +0 | 2026-08-17 13:44:09 | 1초 |
로그 보기2026-08-17 04:44:11 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 04:44:11 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-17 04:44:10 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-17 04:44:10 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-17 04:44:10 [scrapy.core.engine] INFO: Spider opened
2026-08-17 04:44:11 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-17 04:44:11 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-17 04:44:11 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 04:44:11 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-17 04:44:11 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-17 04:44:11 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.01216839998960495,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 17, 4, 44, 11, 20655, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90279936,
'memusage/startup': 90279936,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 17, 4, 44, 11, 8485, tzinfo=datetime.timezone.utc)}
2026-08-17 04:44:11 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | -1 OR 2+456-456-1=0+0+0+1 -- (스케줄) | 성공 | +0 | 2026-08-17 13:44:08 | 1초 |
로그 보기2026-08-17 04:44:09 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 04:44:09 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-17 04:44:09 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-17 04:44:09 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-17 04:44:09 [scrapy.core.engine] INFO: Spider opened
2026-08-17 04:44:09 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-17 04:44:09 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-17 04:44:09 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 04:44:09 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-17 04:44:09 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-17 04:44:09 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.01231286209076643,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 17, 4, 44, 9, 573172, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90746880,
'memusage/startup': 90746880,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 17, 4, 44, 9, 560858, tzinfo=datetime.timezone.utc)}
2026-08-17 04:44:09 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | 주식 (스케줄) | 성공 | +0 | 2026-08-17 13:44:06 | 1초 |
로그 보기2026-08-17 04:44:08 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 04:44:08 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-17 04:44:08 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-17 04:44:08 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-17 04:44:08 [scrapy.core.engine] INFO: Spider opened
2026-08-17 04:44:08 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-17 04:44:08 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-17 04:44:08 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 04:44:08 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-17 04:44:08 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-17 04:44:08 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.013451759237796068,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 17, 4, 44, 8, 130926, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90763264,
'memusage/startup': 90763264,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 17, 4, 44, 8, 117473, tzinfo=datetime.timezone.utc)}
2026-08-17 04:44:08 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||