수집현황
최근 실행한 크롤링 작업의 상태입니다. 실행 중인 작업이 있어 5초마다 자동 새로고침됩니다.
| 작업 | 대상 | 상태 | 수집 건수 | 시작 | 소요 |
|---|---|---|---|---|---|
| focused | 경제 (스케줄) | 성공 | +0 | 2026-08-17 06:28:28 | 1초 |
로그 보기2026-08-16 21:28:29 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 21:28:29 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-16 21:28:29 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-16 21:28:29 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-16 21:28:29 [scrapy.core.engine] INFO: Spider opened
2026-08-16 21:28:29 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-16 21:28:29 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-16 21:28:29 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 21:28:29 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-16 21:28:29 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-16 21:28:29 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.014044114854186773,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 16, 21, 28, 29, 821041, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90132480,
'memusage/startup': 90132480,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 16, 21, 28, 29, 806997, tzinfo=datetime.timezone.utc)}
2026-08-16 21:28:29 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | IT (스케줄) | 성공 | +0 | 2026-08-17 06:28:27 | 1초 |
로그 보기2026-08-16 21:28:28 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 21:28:28 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-16 21:28:28 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-16 21:28:28 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-16 21:28:28 [scrapy.core.engine] INFO: Spider opened
2026-08-16 21:28:28 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-16 21:28:28 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-16 21:28:28 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 21:28:28 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-16 21:28:28 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-16 21:28:28 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.014091836288571358,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 16, 21, 28, 28, 396042, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90533888,
'memusage/startup': 90533888,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 16, 21, 28, 28, 381949, tzinfo=datetime.timezone.utc)}
2026-08-16 21:28:28 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | 경제QQ0fTJev' OR 803=(SELECT 803 FROM PG_SLEEP(15))-- (스케줄) | 성공 | +0 | 2026-08-17 06:28:25 | 1초 |
로그 보기2026-08-16 21:28:26 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 21:28:26 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-16 21:28:26 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-16 21:28:26 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-16 21:28:26 [scrapy.core.engine] INFO: Spider opened
2026-08-16 21:28:26 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-16 21:28:26 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-16 21:28:26 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 21:28:26 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-16 21:28:26 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-16 21:28:26 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.014390052761882544,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 16, 21, 28, 26, 966687, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90648576,
'memusage/startup': 90648576,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 16, 21, 28, 26, 952296, tzinfo=datetime.timezone.utc)}
2026-08-16 21:28:26 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | 경제soTt4YhT') OR 620=(SELECT 620 FROM PG_SLEEP(15))-- (스케줄) | 성공 | +0 | 2026-08-17 06:27:24 | 1초 |
로그 보기2026-08-16 21:27:25 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 21:27:25 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-16 21:27:25 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-16 21:27:25 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-16 21:27:25 [scrapy.core.engine] INFO: Spider opened
2026-08-16 21:27:25 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-16 21:27:25 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-16 21:27:25 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 21:27:25 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-16 21:27:25 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-16 21:27:25 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.012050606776028872,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 16, 21, 27, 25, 531669, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90030080,
'memusage/startup': 90030080,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 16, 21, 27, 25, 519617, tzinfo=datetime.timezone.utc)}
2026-08-16 21:27:25 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | 경제lbH819S3'; waitfor delay '0:0:15' -- (스케줄) | 성공 | +0 | 2026-08-17 06:27:22 | 1초 |
로그 보기2026-08-16 21:27:24 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 21:27:24 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-16 21:27:24 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-16 21:27:24 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-16 21:27:24 [scrapy.core.engine] INFO: Spider opened
2026-08-16 21:27:24 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-16 21:27:24 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-16 21:27:24 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 21:27:24 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-16 21:27:24 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-16 21:27:24 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.013614238239824772,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 16, 21, 27, 24, 87346, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90103808,
'memusage/startup': 90103808,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 16, 21, 27, 24, 73731, tzinfo=datetime.timezone.utc)}
2026-08-16 21:27:24 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | 부동산 (스케줄) | 성공 | +0 | 2026-08-17 06:27:21 | 1초 |
로그 보기2026-08-16 21:27:22 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 21:27:22 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-16 21:27:22 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-16 21:27:22 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-16 21:27:22 [scrapy.core.engine] INFO: Spider opened
2026-08-16 21:27:22 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-16 21:27:22 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-16 21:27:22 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 21:27:22 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-16 21:27:22 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-16 21:27:22 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.01253760140389204,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 16, 21, 27, 22, 643292, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90058752,
'memusage/startup': 90058752,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 16, 21, 27, 22, 630754, tzinfo=datetime.timezone.utc)}
2026-08-16 21:27:22 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | 경제lgvGOBoP')) OR 353=(SELECT 353 FROM PG_SLEEP(15))-- (스케줄) | 성공 | +0 | 2026-08-17 06:27:19 | 1초 |
로그 보기2026-08-16 21:27:21 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 21:27:21 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-16 21:27:21 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-16 21:27:21 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-16 21:27:21 [scrapy.core.engine] INFO: Spider opened
2026-08-16 21:27:21 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-16 21:27:21 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-16 21:27:21 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 21:27:21 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-16 21:27:21 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-16 21:27:21 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.014204915147274733,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 16, 21, 27, 21, 212713, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90652672,
'memusage/startup': 90652672,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 16, 21, 27, 21, 198507, tzinfo=datetime.timezone.utc)}
2026-08-16 21:27:21 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | 주식 (스케줄) | 성공 | +0 | 2026-08-17 06:27:18 | 1초 |
로그 보기2026-08-16 21:27:19 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 21:27:19 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-16 21:27:19 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-16 21:27:19 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-16 21:27:19 [scrapy.core.engine] INFO: Spider opened
2026-08-16 21:27:19 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-16 21:27:19 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-16 21:27:19 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 21:27:19 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-16 21:27:19 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-16 21:27:19 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.014241797849535942,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 16, 21, 27, 19, 774620, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90681344,
'memusage/startup': 90681344,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 16, 21, 27, 19, 760377, tzinfo=datetime.timezone.utc)}
2026-08-16 21:27:19 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | -1' OR 2+162-162-1=0+0+0+1 or 'noc5aZ54'=' (스케줄) | 성공 | +0 | 2026-08-17 06:26:17 | 1초 |
로그 보기2026-08-16 21:26:18 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 21:26:18 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-16 21:26:18 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-16 21:26:18 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-16 21:26:18 [scrapy.core.engine] INFO: Spider opened
2026-08-16 21:26:18 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-16 21:26:18 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-16 21:26:18 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 21:26:18 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-16 21:26:18 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-16 21:26:18 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.013864600099623203,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 16, 21, 26, 18, 310423, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90120192,
'memusage/startup': 90120192,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 16, 21, 26, 18, 296556, tzinfo=datetime.timezone.utc)}
2026-08-16 21:26:18 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | 주식(관심) (스케줄) | 성공 | +0 | 2026-08-17 06:26:15 | 1초 |
로그 보기2026-08-16 21:26:16 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 21:26:16 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-16 21:26:16 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-16 21:26:16 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-16 21:26:16 [scrapy.core.engine] INFO: Spider opened
2026-08-16 21:26:16 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-16 21:26:16 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-16 21:26:16 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 21:26:16 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-16 21:26:16 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-16 21:26:16 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.013784187845885754,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 16, 21, 26, 16, 895649, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90296320,
'memusage/startup': 90296320,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 16, 21, 26, 16, 881863, tzinfo=datetime.timezone.utc)}
2026-08-16 21:26:16 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||