수집현황
최근 실행한 크롤링 작업의 상태입니다. 실행 중인 작업이 있어 5초마다 자동 새로고침됩니다.
| 작업 | 대상 | 상태 | 수집 건수 | 시작 | 소요 |
|---|---|---|---|---|---|
| focused | -1 OR 2+202-202-1=0+0+0+1 -- (스케줄) | 성공 | +0 | 2026-08-17 08:12:24 | 1초 |
로그 보기2026-08-16 23:12:25 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 23:12:25 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-16 23:12:25 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-16 23:12:25 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-16 23:12:25 [scrapy.core.engine] INFO: Spider opened
2026-08-16 23:12:25 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-16 23:12:25 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-16 23:12:25 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 23:12:25 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-16 23:12:25 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-16 23:12:25 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.012140295002609491,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 16, 23, 12, 25, 891300, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90161152,
'memusage/startup': 90161152,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 16, 23, 12, 25, 879158, tzinfo=datetime.timezone.utc)}
2026-08-16 23:12:25 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | -1' OR 2+162-162-1=0+0+0+1 or 'noc5aZ54'=' (스케줄) | 성공 | +0 | 2026-08-17 08:12:23 | 1초 |
로그 보기2026-08-16 23:12:24 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 23:12:24 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-16 23:12:24 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-16 23:12:24 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-16 23:12:24 [scrapy.core.engine] INFO: Spider opened
2026-08-16 23:12:24 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-16 23:12:24 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-16 23:12:24 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 23:12:24 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-16 23:12:24 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-16 23:12:24 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.014431157149374485,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 16, 23, 12, 24, 470520, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90374144,
'memusage/startup': 90374144,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 16, 23, 12, 24, 456087, tzinfo=datetime.timezone.utc)}
2026-08-16 23:12:24 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | -1" OR 2+179-179-1=0+0+0+1 -- (스케줄) | 성공 | +0 | 2026-08-17 08:12:21 | 1초 |
로그 보기2026-08-16 23:12:23 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 23:12:23 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-16 23:12:22 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-16 23:12:22 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-16 23:12:22 [scrapy.core.engine] INFO: Spider opened
2026-08-16 23:12:23 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-16 23:12:23 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-16 23:12:23 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 23:12:23 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-16 23:12:23 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-16 23:12:23 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.014087283052504063,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 16, 23, 12, 23, 18480, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90697728,
'memusage/startup': 90697728,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 16, 23, 12, 23, 4391, tzinfo=datetime.timezone.utc)}
2026-08-16 23:12:23 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | -1' OR 2+626-626-1=0+0+0+1 -- (스케줄) | 성공 | +0 | 2026-08-17 08:12:20 | 1초 |
로그 보기2026-08-16 23:12:21 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 23:12:21 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-16 23:12:21 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-16 23:12:21 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-16 23:12:21 [scrapy.core.engine] INFO: Spider opened
2026-08-16 23:12:21 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-16 23:12:21 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-16 23:12:21 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 23:12:21 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-16 23:12:21 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-16 23:12:21 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.014131186064332724,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 16, 23, 12, 21, 597180, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90157056,
'memusage/startup': 90157056,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 16, 23, 12, 21, 583048, tzinfo=datetime.timezone.utc)}
2026-08-16 23:12:21 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | 주식(관심) (스케줄) | 성공 | +0 | 2026-08-17 08:12:18 | 1초 |
로그 보기2026-08-16 23:12:20 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 23:12:20 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-16 23:12:20 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-16 23:12:20 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-16 23:12:20 [scrapy.core.engine] INFO: Spider opened
2026-08-16 23:12:20 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-16 23:12:20 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-16 23:12:20 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 23:12:20 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-16 23:12:20 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-16 23:12:20 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.014255058951675892,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 16, 23, 12, 20, 177215, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90636288,
'memusage/startup': 90636288,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 16, 23, 12, 20, 162960, tzinfo=datetime.timezone.utc)}
2026-08-16 23:12:20 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | -1 OR 2+310-310-1=0+0+0+1 (스케줄) | 성공 | +0 | 2026-08-17 08:11:17 | 1초 |
로그 보기2026-08-16 23:11:18 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 23:11:18 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-16 23:11:18 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-16 23:11:18 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-16 23:11:18 [scrapy.core.engine] INFO: Spider opened
2026-08-16 23:11:18 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-16 23:11:18 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-16 23:11:18 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 23:11:18 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-16 23:11:18 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-16 23:11:18 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.014477379154413939,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 16, 23, 11, 18, 739228, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90415104,
'memusage/startup': 90415104,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 16, 23, 11, 18, 724749, tzinfo=datetime.timezone.utc)}
2026-08-16 23:11:18 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | -1" OR 2+357-357-1=0+0+0+1 -- (스케줄) | 성공 | +0 | 2026-08-17 08:10:15 | 1초 |
로그 보기2026-08-16 23:10:17 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 23:10:17 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-16 23:10:17 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-16 23:10:17 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-16 23:10:17 [scrapy.core.engine] INFO: Spider opened
2026-08-16 23:10:17 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-16 23:10:17 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-16 23:10:17 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 23:10:17 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-16 23:10:17 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-16 23:10:17 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.013917438220232725,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 16, 23, 10, 17, 298285, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90005504,
'memusage/startup': 90005504,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 16, 23, 10, 17, 284366, tzinfo=datetime.timezone.utc)}
2026-08-16 23:10:17 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | -1' OR 2+754-754-1=0+0+0+1 -- (스케줄) | 성공 | +0 | 2026-08-17 08:09:14 | 1초 |
로그 보기2026-08-16 23:09:15 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 23:09:15 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-16 23:09:15 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-16 23:09:15 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-16 23:09:15 [scrapy.core.engine] INFO: Spider opened
2026-08-16 23:09:15 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-16 23:09:15 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-16 23:09:15 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 23:09:15 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-16 23:09:15 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-16 23:09:15 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.012638722080737352,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 16, 23, 9, 15, 853261, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90472448,
'memusage/startup': 90472448,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 16, 23, 9, 15, 840621, tzinfo=datetime.timezone.utc)}
2026-08-16 23:09:15 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | -1' OR 2+402-402-1=0+0+0+1 or 'JhwqDpfs'=' (스케줄) | 성공 | +0 | 2026-08-17 08:08:13 | 1초 |
로그 보기2026-08-16 23:08:14 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 23:08:14 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-16 23:08:14 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-16 23:08:14 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-16 23:08:14 [scrapy.core.engine] INFO: Spider opened
2026-08-16 23:08:14 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-16 23:08:14 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-16 23:08:14 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 23:08:14 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-16 23:08:14 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-16 23:08:14 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.014545043930411339,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 16, 23, 8, 14, 422861, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90157056,
'memusage/startup': 90157056,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 16, 23, 8, 14, 408315, tzinfo=datetime.timezone.utc)}
2026-08-16 23:08:14 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | IT (스케줄) | 성공 | +0 | 2026-08-17 08:04:11 | 1초 |
로그 보기2026-08-16 23:04:12 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 23:04:12 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-16 23:04:12 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-16 23:04:12 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-16 23:04:12 [scrapy.core.engine] INFO: Spider opened
2026-08-16 23:04:12 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-16 23:04:12 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-16 23:04:12 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 23:04:12 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-16 23:04:12 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-16 23:04:12 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.012352397199720144,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 16, 23, 4, 12, 917027, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90664960,
'memusage/startup': 90664960,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 16, 23, 4, 12, 904673, tzinfo=datetime.timezone.utc)}
2026-08-16 23:04:12 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||