수집현황
최근 실행한 크롤링 작업의 상태입니다. 실행 중인 작업이 있어 5초마다 자동 새로고침됩니다.
| 작업 | 대상 | 상태 | 수집 건수 | 시작 | 소요 |
|---|---|---|---|---|---|
| focused | -1 OR 2+202-202-1=0+0+0+1 -- (스케줄) | 성공 | +0 | 2026-08-17 12:17:44 | 1초 |
로그 보기2026-08-17 03:17:45 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 03:17:45 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-17 03:17:45 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-17 03:17:45 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-17 03:17:45 [scrapy.core.engine] INFO: Spider opened
2026-08-17 03:17:45 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-17 03:17:45 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-17 03:17:45 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 03:17:45 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-17 03:17:45 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-17 03:17:45 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.01588242780417204,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 17, 3, 17, 45, 687673, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90607616,
'memusage/startup': 90607616,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 17, 3, 17, 45, 671790, tzinfo=datetime.timezone.utc)}
2026-08-17 03:17:45 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | 경제J7kMucZ2' OR 512=(SELECT 512 FROM PG_SLEEP(15))-- (스케줄) | 성공 | +0 | 2026-08-17 12:13:42 | 1초 |
로그 보기2026-08-17 03:13:44 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 03:13:44 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-17 03:13:44 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-17 03:13:44 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-17 03:13:44 [scrapy.core.engine] INFO: Spider opened
2026-08-17 03:13:44 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-17 03:13:44 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-17 03:13:44 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 03:13:44 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-17 03:13:44 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-17 03:13:44 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.015294376760721207,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 17, 3, 13, 44, 165322, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90673152,
'memusage/startup': 90673152,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 17, 3, 13, 44, 150026, tzinfo=datetime.timezone.utc)}
2026-08-17 03:13:44 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | @@4R67u (스케줄) | 성공 | +0 | 2026-08-17 12:13:41 | 1초 |
로그 보기2026-08-17 03:13:42 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 03:13:42 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-17 03:13:42 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-17 03:13:42 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-17 03:13:42 [scrapy.core.engine] INFO: Spider opened
2026-08-17 03:13:42 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-17 03:13:42 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-17 03:13:42 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 03:13:42 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-17 03:13:42 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-17 03:13:42 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.012487811036407948,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 17, 3, 13, 42, 711336, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90718208,
'memusage/startup': 90718208,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 17, 3, 13, 42, 698847, tzinfo=datetime.timezone.utc)}
2026-08-17 03:13:42 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | 경제ivnF88pt') OR 75=(SELECT 75 FROM PG_SLEEP(15))-- (스케줄) | 성공 | +0 | 2026-08-17 12:13:39 | 1초 |
로그 보기2026-08-17 03:13:41 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 03:13:41 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-17 03:13:41 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-17 03:13:41 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-17 03:13:41 [scrapy.core.engine] INFO: Spider opened
2026-08-17 03:13:41 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-17 03:13:41 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-17 03:13:41 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 03:13:41 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-17 03:13:41 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-17 03:13:41 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.014411226380616426,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 17, 3, 13, 41, 242652, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90140672,
'memusage/startup': 90140672,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 17, 3, 13, 41, 228240, tzinfo=datetime.timezone.utc)}
2026-08-17 03:13:41 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | 경제d17yBTkf'; waitfor delay '0:0:15' -- (스케줄) | 성공 | +0 | 2026-08-17 12:13:38 | 1초 |
로그 보기2026-08-17 03:13:39 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 03:13:39 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-17 03:13:39 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-17 03:13:39 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-17 03:13:39 [scrapy.core.engine] INFO: Spider opened
2026-08-17 03:13:39 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-17 03:13:39 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-17 03:13:39 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 03:13:39 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-17 03:13:39 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-17 03:13:39 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.01421148469671607,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 17, 3, 13, 39, 829278, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90267648,
'memusage/startup': 90267648,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 17, 3, 13, 39, 815066, tzinfo=datetime.timezone.utc)}
2026-08-17 03:13:39 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | 경제MLVmfXgg')) OR 196=(SELECT 196 FROM PG_SLEEP(15))-- (스케줄) | 성공 | +0 | 2026-08-17 12:13:37 | 1초 |
로그 보기2026-08-17 03:13:38 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 03:13:38 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-17 03:13:38 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-17 03:13:38 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-17 03:13:38 [scrapy.core.engine] INFO: Spider opened
2026-08-17 03:13:38 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-17 03:13:38 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-17 03:13:38 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 03:13:38 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-17 03:13:38 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-17 03:13:38 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.014925393741577864,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 17, 3, 13, 38, 401818, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90333184,
'memusage/startup': 90333184,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 17, 3, 13, 38, 386892, tzinfo=datetime.timezone.utc)}
2026-08-17 03:13:38 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | @@I0WIt (스케줄) | 성공 | +0 | 2026-08-17 12:09:35 | 1초 |
로그 보기2026-08-17 03:09:36 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 03:09:36 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-17 03:09:36 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-17 03:09:36 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-17 03:09:36 [scrapy.core.engine] INFO: Spider opened
2026-08-17 03:09:36 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-17 03:09:36 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-17 03:09:36 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 03:09:36 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-17 03:09:36 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-17 03:09:36 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.017481970135122538,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 17, 3, 9, 36, 886859, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90157056,
'memusage/startup': 90157056,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 17, 3, 9, 36, 869376, tzinfo=datetime.timezone.utc)}
2026-08-17 03:09:36 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | 경제 (스케줄) | 성공 | +0 | 2026-08-17 12:09:34 | 1초 |
로그 보기2026-08-17 03:09:35 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 03:09:35 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-17 03:09:35 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-17 03:09:35 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-17 03:09:35 [scrapy.core.engine] INFO: Spider opened
2026-08-17 03:09:35 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-17 03:09:35 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-17 03:09:35 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 03:09:35 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-17 03:09:35 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-17 03:09:35 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.014643021859228611,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 17, 3, 9, 35, 436022, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90755072,
'memusage/startup': 90755072,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 17, 3, 9, 35, 421378, tzinfo=datetime.timezone.utc)}
2026-08-17 03:09:35 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | 보안위협 (스케줄) | 성공 | +0 | 2026-08-17 12:09:32 | 1초 |
로그 보기2026-08-17 03:09:33 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 03:09:33 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-17 03:09:33 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-17 03:09:33 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-17 03:09:33 [scrapy.core.engine] INFO: Spider opened
2026-08-17 03:09:33 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-17 03:09:33 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-17 03:09:33 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 03:09:33 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-17 03:09:33 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-17 03:09:33 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.014041719026863575,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 17, 3, 9, 33, 993938, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90722304,
'memusage/startup': 90722304,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 17, 3, 9, 33, 979896, tzinfo=datetime.timezone.utc)}
2026-08-17 03:09:33 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | IT (스케줄) | 성공 | +0 | 2026-08-17 12:09:31 | 1초 |
로그 보기2026-08-17 03:09:32 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 03:09:32 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-17 03:09:32 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-17 03:09:32 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-17 03:09:32 [scrapy.core.engine] INFO: Spider opened
2026-08-17 03:09:32 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-17 03:09:32 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-17 03:09:32 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 03:09:32 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-17 03:09:32 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-17 03:09:32 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.014311450999230146,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 17, 3, 9, 32, 567799, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90222592,
'memusage/startup': 90222592,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 17, 3, 9, 32, 553487, tzinfo=datetime.timezone.utc)}
2026-08-17 03:09:32 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||