수집현황
최근 실행한 크롤링 작업의 상태입니다. 실행 중인 작업이 있어 5초마다 자동 새로고침됩니다.
| 작업 | 대상 | 상태 | 수집 건수 | 시작 | 소요 |
|---|---|---|---|---|---|
| focused | IT (스케줄) | 성공 | +0 | 2026-08-18 14:48:22 | 1초 |
로그 보기2026-08-18 05:48:24 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-18 05:48:24 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-18 05:48:24 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-18 05:48:24 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-18 05:48:24 [scrapy.core.engine] INFO: Spider opened
2026-08-18 05:48:24 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-18 05:48:24 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-18 05:48:24 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-18 05:48:24 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-18 05:48:24 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-18 05:48:24 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.014238701667636633,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 18, 5, 48, 24, 239870, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90279936,
'memusage/startup': 90279936,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 18, 5, 48, 24, 225630, tzinfo=datetime.timezone.utc)}
2026-08-18 05:48:24 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | 보안위협 (스케줄) | 성공 | +0 | 2026-08-18 14:48:21 | 1초 |
로그 보기2026-08-18 05:48:22 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-18 05:48:22 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-18 05:48:22 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-18 05:48:22 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-18 05:48:22 [scrapy.core.engine] INFO: Spider opened
2026-08-18 05:48:22 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-18 05:48:22 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-18 05:48:22 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-18 05:48:22 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-18 05:48:22 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-18 05:48:22 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.014082863926887512,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 18, 5, 48, 22, 819382, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90284032,
'memusage/startup': 90284032,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 18, 5, 48, 22, 805298, tzinfo=datetime.timezone.utc)}
2026-08-18 05:48:22 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | 경제soTt4YhT') OR 620=(SELECT 620 FROM PG_SLEEP(15))-- (스케줄) | 성공 | +0 | 2026-08-18 14:47:20 | 1초 |
로그 보기2026-08-18 05:47:21 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-18 05:47:21 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-18 05:47:21 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-18 05:47:21 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-18 05:47:21 [scrapy.core.engine] INFO: Spider opened
2026-08-18 05:47:21 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-18 05:47:21 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-18 05:47:21 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-18 05:47:21 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-18 05:47:21 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-18 05:47:21 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.0120140272192657,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 18, 5, 47, 21, 384966, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90374144,
'memusage/startup': 90374144,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 18, 5, 47, 21, 372951, tzinfo=datetime.timezone.utc)}
2026-08-18 05:47:21 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | -1' OR 2+557-557-1=0+0+0+1 -- (스케줄) | 성공 | +0 | 2026-08-18 14:47:18 | 1초 |
로그 보기2026-08-18 05:47:19 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-18 05:47:19 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-18 05:47:19 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-18 05:47:19 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-18 05:47:19 [scrapy.core.engine] INFO: Spider opened
2026-08-18 05:47:19 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-18 05:47:19 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-18 05:47:19 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-18 05:47:19 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-18 05:47:19 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-18 05:47:19 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.01427523698657751,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 18, 5, 47, 19, 965586, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90501120,
'memusage/startup': 90501120,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 18, 5, 47, 19, 951309, tzinfo=datetime.timezone.utc)}
2026-08-18 05:47:19 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | 부동산 (스케줄) | 성공 | +0 | 2026-08-18 14:47:17 | 1초 |
로그 보기2026-08-18 05:47:18 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-18 05:47:18 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-18 05:47:18 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-18 05:47:18 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-18 05:47:18 [scrapy.core.engine] INFO: Spider opened
2026-08-18 05:47:18 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-18 05:47:18 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-18 05:47:18 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-18 05:47:18 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-18 05:47:18 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-18 05:47:18 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.014023805968463421,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 18, 5, 47, 18, 525780, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90460160,
'memusage/startup': 90460160,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 18, 5, 47, 18, 511756, tzinfo=datetime.timezone.utc)}
2026-08-18 05:47:18 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | ê²½ì À§À¢%2527%2522\'\" (스케줄) | 성공 | +0 | 2026-08-18 14:47:15 | 1초 |
로그 보기2026-08-18 05:47:17 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-18 05:47:17 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-18 05:47:17 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-18 05:47:17 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-18 05:47:17 [scrapy.core.engine] INFO: Spider opened
2026-08-18 05:47:17 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-18 05:47:17 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-18 05:47:17 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-18 05:47:17 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-18 05:47:17 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-18 05:47:17 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.013993052765727043,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 18, 5, 47, 17, 107914, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90218496,
'memusage/startup': 90218496,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 18, 5, 47, 17, 93920, tzinfo=datetime.timezone.utc)}
2026-08-18 05:47:17 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | 경제lgvGOBoP')) OR 353=(SELECT 353 FROM PG_SLEEP(15))-- (스케줄) | 성공 | +0 | 2026-08-18 14:47:14 | 1초 |
로그 보기2026-08-18 05:47:15 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-18 05:47:15 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-18 05:47:15 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-18 05:47:15 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-18 05:47:15 [scrapy.core.engine] INFO: Spider opened
2026-08-18 05:47:15 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-18 05:47:15 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-18 05:47:15 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-18 05:47:15 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-18 05:47:15 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-18 05:47:15 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.01225341809913516,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 18, 5, 47, 15, 679611, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90341376,
'memusage/startup': 90341376,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 18, 5, 47, 15, 667356, tzinfo=datetime.timezone.utc)}
2026-08-18 05:47:15 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | 경제uk593NBp')) OR 311=(SELECT 311 FROM PG_SLEEP(15))-- (스케줄) | 성공 | +0 | 2026-08-18 14:47:12 | 1초 |
로그 보기2026-08-18 05:47:14 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-18 05:47:14 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-18 05:47:14 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-18 05:47:14 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-18 05:47:14 [scrapy.core.engine] INFO: Spider opened
2026-08-18 05:47:14 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-18 05:47:14 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-18 05:47:14 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-18 05:47:14 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-18 05:47:14 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-18 05:47:14 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.013909963425248861,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 18, 5, 47, 14, 234879, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 89993216,
'memusage/startup': 89993216,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 18, 5, 47, 14, 220968, tzinfo=datetime.timezone.utc)}
2026-08-18 05:47:14 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | 주식 (스케줄) | 성공 | +0 | 2026-08-18 14:47:11 | 1초 |
로그 보기2026-08-18 05:47:12 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-18 05:47:12 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-18 05:47:12 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-18 05:47:12 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-18 05:47:12 [scrapy.core.engine] INFO: Spider opened
2026-08-18 05:47:12 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-18 05:47:12 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-18 05:47:12 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-18 05:47:12 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-18 05:47:12 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-18 05:47:12 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.014085720293223858,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 18, 5, 47, 12, 782705, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 89956352,
'memusage/startup': 89956352,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 18, 5, 47, 12, 768618, tzinfo=datetime.timezone.utc)}
2026-08-18 05:47:12 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | -1' OR 2+754-754-1=0+0+0+1 -- (스케줄) | 성공 | +0 | 2026-08-18 14:46:10 | 1초 |
로그 보기2026-08-18 05:46:11 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-18 05:46:11 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-18 05:46:11 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-18 05:46:11 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-18 05:46:11 [scrapy.core.engine] INFO: Spider opened
2026-08-18 05:46:11 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-18 05:46:11 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-18 05:46:11 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-18 05:46:11 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-18 05:46:11 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-18 05:46:11 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.012359781190752983,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 18, 5, 46, 11, 319086, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90226688,
'memusage/startup': 90226688,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 18, 5, 46, 11, 306724, tzinfo=datetime.timezone.utc)}
2026-08-18 05:46:11 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||