수집현황
최근 실행한 크롤링 작업의 상태입니다. 실행 중인 작업이 있어 5초마다 자동 새로고침됩니다.
| 작업 | 대상 | 상태 | 수집 건수 | 시작 | 소요 |
|---|---|---|---|---|---|
| focused | 경제bTpPFdCa' OR 764=(SELECT 764 FROM PG_SLEEP(15))-- (스케줄) | 성공 | +0 | 2026-08-17 21:06:44 | 1초 |
로그 보기2026-08-17 12:06:45 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 12:06:45 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-17 12:06:45 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-17 12:06:45 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-17 12:06:45 [scrapy.core.engine] INFO: Spider opened
2026-08-17 12:06:45 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-17 12:06:45 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-17 12:06:45 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 12:06:45 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-17 12:06:45 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-17 12:06:45 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.012441929895430803,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 17, 12, 6, 45, 357307, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90087424,
'memusage/startup': 90087424,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 17, 12, 6, 45, 344864, tzinfo=datetime.timezone.utc)}
2026-08-17 12:06:45 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | -1' OR 2+491-491-1=0+0+0+1 -- (스케줄) | 성공 | +0 | 2026-08-17 21:05:42 | 1초 |
로그 보기2026-08-17 12:05:43 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 12:05:43 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-17 12:05:43 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-17 12:05:43 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-17 12:05:43 [scrapy.core.engine] INFO: Spider opened
2026-08-17 12:05:43 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-17 12:05:43 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-17 12:05:43 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 12:05:43 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-17 12:05:43 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-17 12:05:43 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.014109777752310038,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 17, 12, 5, 43, 913709, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90157056,
'memusage/startup': 90157056,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 17, 12, 5, 43, 899598, tzinfo=datetime.timezone.utc)}
2026-08-17 12:05:43 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | -1 OR 2+456-456-1=0+0+0+1 -- (스케줄) | 성공 | +0 | 2026-08-17 21:05:41 | 1초 |
로그 보기2026-08-17 12:05:42 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 12:05:42 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-17 12:05:42 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-17 12:05:42 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-17 12:05:42 [scrapy.core.engine] INFO: Spider opened
2026-08-17 12:05:42 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-17 12:05:42 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-17 12:05:42 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 12:05:42 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-17 12:05:42 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-17 12:05:42 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.014343934133648872,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 17, 12, 5, 42, 473421, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90644480,
'memusage/startup': 90644480,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 17, 12, 5, 42, 459077, tzinfo=datetime.timezone.utc)}
2026-08-17 12:05:42 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | 경제R10jUCN8'; waitfor delay '0:0:15' -- (스케줄) | 성공 | +0 | 2026-08-17 21:05:39 | 1초 |
로그 보기2026-08-17 12:05:41 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 12:05:41 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-17 12:05:41 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-17 12:05:41 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-17 12:05:41 [scrapy.core.engine] INFO: Spider opened
2026-08-17 12:05:41 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-17 12:05:41 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-17 12:05:41 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 12:05:41 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-17 12:05:41 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-17 12:05:41 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.01401090994477272,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 17, 12, 5, 41, 40647, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90263552,
'memusage/startup': 90263552,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 17, 12, 5, 41, 26635, tzinfo=datetime.timezone.utc)}
2026-08-17 12:05:41 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | 경제nwDZixIN') OR 161=(SELECT 161 FROM PG_SLEEP(15))-- (스케줄) | 성공 | +0 | 2026-08-17 21:05:38 | 1초 |
로그 보기2026-08-17 12:05:39 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 12:05:39 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-17 12:05:39 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-17 12:05:39 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-17 12:05:39 [scrapy.core.engine] INFO: Spider opened
2026-08-17 12:05:39 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-17 12:05:39 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-17 12:05:39 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 12:05:39 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-17 12:05:39 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-17 12:05:39 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.012485820800065994,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 17, 12, 5, 39, 618460, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90398720,
'memusage/startup': 90398720,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 17, 12, 5, 39, 605973, tzinfo=datetime.timezone.utc)}
2026-08-17 12:05:39 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | -1' OR 2+941-941-1=0+0+0+1 or 'RmWmBDjp'=' (스케줄) | 성공 | +0 | 2026-08-17 21:05:36 | 1초 |
로그 보기2026-08-17 12:05:38 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 12:05:38 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-17 12:05:38 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-17 12:05:38 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-17 12:05:38 [scrapy.core.engine] INFO: Spider opened
2026-08-17 12:05:38 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-17 12:05:38 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-17 12:05:38 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 12:05:38 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-17 12:05:38 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-17 12:05:38 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.013666808139532804,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 17, 12, 5, 38, 189103, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 89907200,
'memusage/startup': 89907200,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 17, 12, 5, 38, 175435, tzinfo=datetime.timezone.utc)}
2026-08-17 12:05:38 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | -1 OR 2+310-310-1=0+0+0+1 (스케줄) | 성공 | +0 | 2026-08-17 21:05:35 | 1초 |
로그 보기2026-08-17 12:05:36 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 12:05:36 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-17 12:05:36 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-17 12:05:36 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-17 12:05:36 [scrapy.core.engine] INFO: Spider opened
2026-08-17 12:05:36 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-17 12:05:36 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-17 12:05:36 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 12:05:36 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-17 12:05:36 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-17 12:05:36 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.014316755812615156,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 17, 12, 5, 36, 736239, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90349568,
'memusage/startup': 90349568,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 17, 12, 5, 36, 721922, tzinfo=datetime.timezone.utc)}
2026-08-17 12:05:36 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | -1" OR 2+357-357-1=0+0+0+1 -- (스케줄) | 성공 | +0 | 2026-08-17 21:04:33 | 1초 |
로그 보기2026-08-17 12:04:35 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 12:04:35 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-17 12:04:35 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-17 12:04:35 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-17 12:04:35 [scrapy.core.engine] INFO: Spider opened
2026-08-17 12:04:35 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-17 12:04:35 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-17 12:04:35 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 12:04:35 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-17 12:04:35 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-17 12:04:35 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.014092825818806887,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 17, 12, 4, 35, 286944, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90275840,
'memusage/startup': 90275840,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 17, 12, 4, 35, 272850, tzinfo=datetime.timezone.utc)}
2026-08-17 12:04:35 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | -1" OR 2+929-929-1=0+0+0+1 -- (스케줄) | 성공 | +0 | 2026-08-17 21:04:32 | 1초 |
로그 보기2026-08-17 12:04:33 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 12:04:33 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-17 12:04:33 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-17 12:04:33 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-17 12:04:33 [scrapy.core.engine] INFO: Spider opened
2026-08-17 12:04:33 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-17 12:04:33 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-17 12:04:33 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 12:04:33 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-17 12:04:33 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-17 12:04:33 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.0134000638499856,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 17, 12, 4, 33, 854527, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90075136,
'memusage/startup': 90075136,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 17, 12, 4, 33, 841125, tzinfo=datetime.timezone.utc)}
2026-08-17 12:04:33 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | -1 OR 2+733-733-1=0+0+0+1 -- (스케줄) | 성공 | +0 | 2026-08-17 21:04:31 | 1초 |
로그 보기2026-08-17 12:04:32 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 12:04:32 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-17 12:04:32 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-17 12:04:32 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-17 12:04:32 [scrapy.core.engine] INFO: Spider opened
2026-08-17 12:04:32 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-17 12:04:32 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-17 12:04:32 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 12:04:32 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-17 12:04:32 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-17 12:04:32 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.012702287174761295,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 17, 12, 4, 32, 439245, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90292224,
'memusage/startup': 90292224,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 17, 12, 4, 32, 426540, tzinfo=datetime.timezone.utc)}
2026-08-17 12:04:32 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||