수집현황
최근 실행한 크롤링 작업의 상태입니다. 실행 중인 작업이 있어 5초마다 자동 새로고침됩니다.
| 작업 | 대상 | 상태 | 수집 건수 | 시작 | 소요 |
|---|---|---|---|---|---|
| focused | 경제soTt4YhT') OR 620=(SELECT 620 FROM PG_SLEEP(15))-- (스케줄) | 성공 | +0 | 2026-08-17 02:22:58 | 1초 |
로그 보기2026-08-16 17:22:59 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 17:22:59 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-16 17:22:59 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-16 17:22:59 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-16 17:22:59 [scrapy.core.engine] INFO: Spider opened
2026-08-16 17:22:59 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-16 17:22:59 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-16 17:22:59 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 17:22:59 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-16 17:22:59 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-16 17:22:59 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.01239445898681879,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 16, 17, 22, 59, 731498, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90337280,
'memusage/startup': 90337280,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 16, 17, 22, 59, 719102, tzinfo=datetime.timezone.utc)}
2026-08-16 17:22:59 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | 부동산 (스케줄) | 성공 | +0 | 2026-08-17 02:22:57 | 1초 |
로그 보기2026-08-16 17:22:58 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 17:22:58 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-16 17:22:58 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-16 17:22:58 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-16 17:22:58 [scrapy.core.engine] INFO: Spider opened
2026-08-16 17:22:58 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-16 17:22:58 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-16 17:22:58 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 17:22:58 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-16 17:22:58 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-16 17:22:58 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.013644620776176453,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 16, 17, 22, 58, 321683, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90341376,
'memusage/startup': 90341376,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 16, 17, 22, 58, 308038, tzinfo=datetime.timezone.utc)}
2026-08-16 17:22:58 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | 경제lbH819S3'; waitfor delay '0:0:15' -- (스케줄) | 성공 | +0 | 2026-08-17 02:22:55 | 1초 |
로그 보기2026-08-16 17:22:56 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 17:22:56 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-16 17:22:56 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-16 17:22:56 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-16 17:22:56 [scrapy.core.engine] INFO: Spider opened
2026-08-16 17:22:56 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-16 17:22:56 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-16 17:22:56 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 17:22:56 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-16 17:22:56 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-16 17:22:56 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.01218663202598691,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 16, 17, 22, 56, 904891, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90378240,
'memusage/startup': 90378240,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 16, 17, 22, 56, 892703, tzinfo=datetime.timezone.utc)}
2026-08-16 17:22:56 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | 경제lgvGOBoP')) OR 353=(SELECT 353 FROM PG_SLEEP(15))-- (스케줄) | 성공 | +0 | 2026-08-17 02:22:54 | 1초 |
로그 보기2026-08-16 17:22:55 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 17:22:55 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-16 17:22:55 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-16 17:22:55 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-16 17:22:55 [scrapy.core.engine] INFO: Spider opened
2026-08-16 17:22:55 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-16 17:22:55 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-16 17:22:55 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 17:22:55 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-16 17:22:55 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-16 17:22:55 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.014746418688446283,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 16, 17, 22, 55, 468002, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90550272,
'memusage/startup': 90550272,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 16, 17, 22, 55, 453255, tzinfo=datetime.timezone.utc)}
2026-08-16 17:22:55 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | 주식 (스케줄) | 성공 | +0 | 2026-08-17 02:22:52 | 1초 |
로그 보기2026-08-16 17:22:54 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 17:22:54 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-16 17:22:53 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-16 17:22:53 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-16 17:22:53 [scrapy.core.engine] INFO: Spider opened
2026-08-16 17:22:54 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-16 17:22:54 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-16 17:22:54 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 17:22:54 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-16 17:22:54 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-16 17:22:54 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.013964307960122824,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 16, 17, 22, 54, 18408, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90722304,
'memusage/startup': 90722304,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 16, 17, 22, 54, 4443, tzinfo=datetime.timezone.utc)}
2026-08-16 17:22:54 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | 경제QQ0fTJev' OR 803=(SELECT 803 FROM PG_SLEEP(15))-- (스케줄) | 성공 | +0 | 2026-08-17 02:22:51 | 1초 |
로그 보기2026-08-16 17:22:52 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 17:22:52 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-16 17:22:52 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-16 17:22:52 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-16 17:22:52 [scrapy.core.engine] INFO: Spider opened
2026-08-16 17:22:52 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-16 17:22:52 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-16 17:22:52 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 17:22:52 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-16 17:22:52 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-16 17:22:52 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.013282993342727423,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 16, 17, 22, 52, 586512, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90771456,
'memusage/startup': 90771456,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 16, 17, 22, 52, 573228, tzinfo=datetime.timezone.utc)}
2026-08-16 17:22:52 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | @@I0WIt (스케줄) | 성공 | +0 | 2026-08-17 02:22:49 | 1초 |
로그 보기2026-08-16 17:22:51 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 17:22:51 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-16 17:22:51 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-16 17:22:51 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-16 17:22:51 [scrapy.core.engine] INFO: Spider opened
2026-08-16 17:22:51 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-16 17:22:51 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-16 17:22:51 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 17:22:51 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-16 17:22:51 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-16 17:22:51 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.013131419662386179,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 16, 17, 22, 51, 164337, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 89944064,
'memusage/startup': 89944064,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 16, 17, 22, 51, 151205, tzinfo=datetime.timezone.utc)}
2026-08-16 17:22:51 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | 보안위협 (스케줄) | 성공 | +0 | 2026-08-17 02:22:48 | 1초 |
로그 보기2026-08-16 17:22:49 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 17:22:49 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-16 17:22:49 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-16 17:22:49 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-16 17:22:49 [scrapy.core.engine] INFO: Spider opened
2026-08-16 17:22:49 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-16 17:22:49 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-16 17:22:49 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 17:22:49 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-16 17:22:49 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-16 17:22:49 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.012491422239691019,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 16, 17, 22, 49, 748517, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90075136,
'memusage/startup': 90075136,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 16, 17, 22, 49, 736024, tzinfo=datetime.timezone.utc)}
2026-08-16 17:22:49 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | 주식(관심) (스케줄) | 성공 | +0 | 2026-08-17 02:22:47 | 1초 |
로그 보기2026-08-16 17:22:48 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 17:22:48 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-16 17:22:48 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-16 17:22:48 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-16 17:22:48 [scrapy.core.engine] INFO: Spider opened
2026-08-16 17:22:48 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-16 17:22:48 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-16 17:22:48 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 17:22:48 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-16 17:22:48 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-16 17:22:48 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.015071081928908825,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 16, 17, 22, 48, 331012, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90689536,
'memusage/startup': 90689536,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 16, 17, 22, 48, 315940, tzinfo=datetime.timezone.utc)}
2026-08-16 17:22:48 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | IT (스케줄) | 성공 | +0 | 2026-08-17 02:22:45 | 1초 |
로그 보기2026-08-16 17:22:46 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 17:22:46 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-16 17:22:46 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-16 17:22:46 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-16 17:22:46 [scrapy.core.engine] INFO: Spider opened
2026-08-16 17:22:46 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-16 17:22:46 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-16 17:22:46 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 17:22:46 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-16 17:22:46 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-16 17:22:46 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.014642883092164993,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 16, 17, 22, 46, 907858, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 89976832,
'memusage/startup': 89976832,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 16, 17, 22, 46, 893215, tzinfo=datetime.timezone.utc)}
2026-08-16 17:22:46 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||