수집현황
최근 실행한 크롤링 작업의 상태입니다. 실행 중인 작업이 있어 5초마다 자동 새로고침됩니다.
| 작업 | 대상 | 상태 | 수집 건수 | 시작 | 소요 |
|---|---|---|---|---|---|
| focused | -1' OR 2+626-626-1=0+0+0+1 -- (스케줄) | 성공 | +0 | 2026-08-18 06:01:40 | 1초 |
로그 보기2026-08-17 21:01:41 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 21:01:41 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-17 21:01:41 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-17 21:01:41 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-17 21:01:41 [scrapy.core.engine] INFO: Spider opened
2026-08-17 21:01:41 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-17 21:01:41 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-17 21:01:41 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 21:01:41 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-17 21:01:41 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-17 21:01:41 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.014107812661677599,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 17, 21, 1, 41, 763014, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90357760,
'memusage/startup': 90357760,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 17, 21, 1, 41, 748905, tzinfo=datetime.timezone.utc)}
2026-08-17 21:01:41 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | 경제����%2527%2522\'\" (스케줄) | 성공 | +0 | 2026-08-18 05:55:38 | 1초 |
로그 보기2026-08-17 20:55:40 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 20:55:40 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-17 20:55:40 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-17 20:55:40 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-17 20:55:40 [scrapy.core.engine] INFO: Spider opened
2026-08-17 20:55:40 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-17 20:55:40 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-17 20:55:40 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 20:55:40 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-17 20:55:40 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-17 20:55:40 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.015260985121130943,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 17, 20, 55, 40, 237488, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90189824,
'memusage/startup': 90189824,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 17, 20, 55, 40, 222226, tzinfo=datetime.timezone.utc)}
2026-08-17 20:55:40 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | IT (스케줄) | 성공 | +0 | 2026-08-18 05:55:37 | 1초 |
로그 보기2026-08-17 20:55:38 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 20:55:38 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-17 20:55:38 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-17 20:55:38 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-17 20:55:38 [scrapy.core.engine] INFO: Spider opened
2026-08-17 20:55:38 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-17 20:55:38 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-17 20:55:38 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 20:55:38 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-17 20:55:38 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-17 20:55:38 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.015265642665326595,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 17, 20, 55, 38, 795145, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90374144,
'memusage/startup': 90374144,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 17, 20, 55, 38, 779878, tzinfo=datetime.timezone.utc)}
2026-08-17 20:55:38 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | 경제 (스케줄) | 성공 | +0 | 2026-08-18 05:55:36 | 1초 |
로그 보기2026-08-17 20:55:37 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 20:55:37 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-17 20:55:37 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-17 20:55:37 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-17 20:55:37 [scrapy.core.engine] INFO: Spider opened
2026-08-17 20:55:37 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-17 20:55:37 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-17 20:55:37 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 20:55:37 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-17 20:55:37 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-17 20:55:37 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.0139824696816504,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 17, 20, 55, 37, 381712, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 89980928,
'memusage/startup': 89980928,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 17, 20, 55, 37, 367728, tzinfo=datetime.timezone.utc)}
2026-08-17 20:55:37 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | @@I0WIt (스케줄) | 성공 | +0 | 2026-08-18 05:55:34 | 1초 |
로그 보기2026-08-17 20:55:35 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 20:55:35 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-17 20:55:35 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-17 20:55:35 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-17 20:55:35 [scrapy.core.engine] INFO: Spider opened
2026-08-17 20:55:35 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-17 20:55:35 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-17 20:55:35 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 20:55:35 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-17 20:55:35 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-17 20:55:35 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.014142601285129786,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 17, 20, 55, 35, 971137, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90140672,
'memusage/startup': 90140672,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 17, 20, 55, 35, 956993, tzinfo=datetime.timezone.utc)}
2026-08-17 20:55:35 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | 경제QQ0fTJev' OR 803=(SELECT 803 FROM PG_SLEEP(15))-- (스케줄) | 성공 | +0 | 2026-08-18 05:55:33 | 1초 |
로그 보기2026-08-17 20:55:34 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 20:55:34 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-17 20:55:34 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-17 20:55:34 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-17 20:55:34 [scrapy.core.engine] INFO: Spider opened
2026-08-17 20:55:34 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-17 20:55:34 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-17 20:55:34 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 20:55:34 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-17 20:55:34 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-17 20:55:34 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.012396379839628935,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 17, 20, 55, 34, 531906, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90673152,
'memusage/startup': 90673152,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 17, 20, 55, 34, 519508, tzinfo=datetime.timezone.utc)}
2026-08-17 20:55:34 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | 보안위협 (스케줄) | 성공 | +0 | 2026-08-18 05:55:31 | 1초 |
로그 보기2026-08-17 20:55:33 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 20:55:33 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-17 20:55:33 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-17 20:55:33 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-17 20:55:33 [scrapy.core.engine] INFO: Spider opened
2026-08-17 20:55:33 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-17 20:55:33 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-17 20:55:33 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 20:55:33 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-17 20:55:33 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-17 20:55:33 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.01202149922028184,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 17, 20, 55, 33, 116349, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90234880,
'memusage/startup': 90234880,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 17, 20, 55, 33, 104327, tzinfo=datetime.timezone.utc)}
2026-08-17 20:55:33 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | 경제lgvGOBoP')) OR 353=(SELECT 353 FROM PG_SLEEP(15))-- (스케줄) | 성공 | +0 | 2026-08-18 05:54:30 | 1초 |
로그 보기2026-08-17 20:54:31 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 20:54:31 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-17 20:54:31 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-17 20:54:31 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-17 20:54:31 [scrapy.core.engine] INFO: Spider opened
2026-08-17 20:54:31 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-17 20:54:31 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-17 20:54:31 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 20:54:31 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-17 20:54:31 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-17 20:54:31 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.01383763737976551,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 17, 20, 54, 31, 612630, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90710016,
'memusage/startup': 90710016,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 17, 20, 54, 31, 598791, tzinfo=datetime.timezone.utc)}
2026-08-17 20:54:31 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | 경제J7kMucZ2' OR 512=(SELECT 512 FROM PG_SLEEP(15))-- (스케줄) | 성공 | +0 | 2026-08-18 05:54:28 | 1초 |
로그 보기2026-08-17 20:54:30 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 20:54:30 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-17 20:54:30 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-17 20:54:30 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-17 20:54:30 [scrapy.core.engine] INFO: Spider opened
2026-08-17 20:54:30 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-17 20:54:30 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-17 20:54:30 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 20:54:30 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-17 20:54:30 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-17 20:54:30 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.013890334870666265,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 17, 20, 54, 30, 175703, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90329088,
'memusage/startup': 90329088,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 17, 20, 54, 30, 161812, tzinfo=datetime.timezone.utc)}
2026-08-17 20:54:30 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | 주식 (스케줄) | 성공 | +0 | 2026-08-18 05:54:27 | 1초 |
로그 보기2026-08-17 20:54:28 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 20:54:28 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-17 20:54:28 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-17 20:54:28 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-17 20:54:28 [scrapy.core.engine] INFO: Spider opened
2026-08-17 20:54:28 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-17 20:54:28 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-17 20:54:28 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 20:54:28 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-17 20:54:28 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-17 20:54:28 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.014402867294847965,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 17, 20, 54, 28, 766822, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90365952,
'memusage/startup': 90365952,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 17, 20, 54, 28, 752418, tzinfo=datetime.timezone.utc)}
2026-08-17 20:54:28 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||