수집현황
최근 실행한 크롤링 작업의 상태입니다. 실행 중인 작업이 있어 5초마다 자동 새로고침됩니다.
| 작업 | 대상 | 상태 | 수집 건수 | 시작 | 소요 |
|---|---|---|---|---|---|
| focused | 경제lgvGOBoP')) OR 353=(SELECT 353 FROM PG_SLEEP(15))-- (스케줄) | 성공 | +0 | 2026-08-16 23:33:12 | 1초 |
로그 보기2026-08-16 14:33:13 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 14:33:13 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-16 14:33:13 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-16 14:33:13 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-16 14:33:13 [scrapy.core.engine] INFO: Spider opened
2026-08-16 14:33:13 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-16 14:33:13 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6027
2026-08-16 14:33:13 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 14:33:13 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-16 14:33:13 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-16 14:33:13 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.013731109909713268,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 16, 14, 33, 13, 835291, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 93732864,
'memusage/startup': 93732864,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 16, 14, 33, 13, 821559, tzinfo=datetime.timezone.utc)}
2026-08-16 14:33:13 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | 보안위협 (스케줄) | 성공 | +0 | 2026-08-16 23:33:10 | 1초 |
로그 보기2026-08-16 14:33:12 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 14:33:12 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-16 14:33:12 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-16 14:33:12 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-16 14:33:12 [scrapy.core.engine] INFO: Spider opened
2026-08-16 14:33:12 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-16 14:33:12 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6027
2026-08-16 14:33:12 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 14:33:12 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-16 14:33:12 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-16 14:33:12 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.01175566716119647,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 16, 14, 33, 12, 320927, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 93507584,
'memusage/startup': 93507584,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 16, 14, 33, 12, 309170, tzinfo=datetime.timezone.utc)}
2026-08-16 14:33:12 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | 경제'||DBMS_PIPE.RECEIVE_MESSAGE(CHR(98)||CHR(98)||CHR(98),15)||' (스케줄) | 성공 | +0 | 2026-08-16 23:33:09 | 1초 |
로그 보기2026-08-16 14:33:10 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 14:33:10 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-16 14:33:10 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-16 14:33:10 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-16 14:33:10 [scrapy.core.engine] INFO: Spider opened
2026-08-16 14:33:10 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-16 14:33:10 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6027
2026-08-16 14:33:10 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 14:33:10 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-16 14:33:10 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-16 14:33:10 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.014134195167571306,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 16, 14, 33, 10, 796624, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 93773824,
'memusage/startup': 93773824,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 16, 14, 33, 10, 782489, tzinfo=datetime.timezone.utc)}
2026-08-16 14:33:10 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | 주식 (스케줄) | 성공 | +0 | 2026-08-16 23:33:07 | 1초 |
로그 보기2026-08-16 14:33:09 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 14:33:09 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-16 14:33:09 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-16 14:33:09 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-16 14:33:09 [scrapy.core.engine] INFO: Spider opened
2026-08-16 14:33:09 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-16 14:33:09 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6027
2026-08-16 14:33:09 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 14:33:09 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-16 14:33:09 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-16 14:33:09 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.014561125077307224,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 16, 14, 33, 9, 287555, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 93454336,
'memusage/startup': 93454336,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 16, 14, 33, 9, 272993, tzinfo=datetime.timezone.utc)}
2026-08-16 14:33:09 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | @@4R67u (스케줄) | 성공 | +0 | 2026-08-16 23:33:06 | 1초 |
로그 보기2026-08-16 14:33:07 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 14:33:07 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-16 14:33:07 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-16 14:33:07 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-16 14:33:07 [scrapy.core.engine] INFO: Spider opened
2026-08-16 14:33:07 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-16 14:33:07 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6027
2026-08-16 14:33:07 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 14:33:07 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-16 14:33:07 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-16 14:33:07 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.017034951131790876,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 16, 14, 33, 7, 809377, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 92880896,
'memusage/startup': 92880896,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 16, 14, 33, 7, 792340, tzinfo=datetime.timezone.utc)}
2026-08-16 14:33:07 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | 부동산 (스케줄) | 성공 | +0 | 2026-08-16 23:33:04 | 1초 |
로그 보기2026-08-16 14:33:06 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 14:33:06 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-16 14:33:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-16 14:33:06 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-16 14:33:06 [scrapy.core.engine] INFO: Spider opened
2026-08-16 14:33:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-16 14:33:06 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6027
2026-08-16 14:33:06 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 14:33:06 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-16 14:33:06 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-16 14:33:06 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.021960854064673185,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 16, 14, 33, 6, 303567, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 93118464,
'memusage/startup': 93118464,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 16, 14, 33, 6, 281605, tzinfo=datetime.timezone.utc)}
2026-08-16 14:33:06 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | 경제nwDZixIN') OR 161=(SELECT 161 FROM PG_SLEEP(15))-- (스케줄) | 성공 | +0 | 2026-08-16 23:33:03 | 1초 |
로그 보기2026-08-16 14:33:04 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 14:33:04 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-16 14:33:04 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-16 14:33:04 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-16 14:33:04 [scrapy.core.engine] INFO: Spider opened
2026-08-16 14:33:04 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-16 14:33:04 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6027
2026-08-16 14:33:04 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 14:33:04 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-16 14:33:04 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-16 14:33:04 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.013753620907664299,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 16, 14, 33, 4, 783424, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 93310976,
'memusage/startup': 93310976,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 16, 14, 33, 4, 769669, tzinfo=datetime.timezone.utc)}
2026-08-16 14:33:04 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | 경제ivnF88pt') OR 75=(SELECT 75 FROM PG_SLEEP(15))-- (스케줄) | 성공 | +0 | 2026-08-16 23:33:01 | 1초 |
로그 보기2026-08-16 14:33:03 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 14:33:03 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-16 14:33:03 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-16 14:33:03 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-16 14:33:03 [scrapy.core.engine] INFO: Spider opened
2026-08-16 14:33:03 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-16 14:33:03 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6027
2026-08-16 14:33:03 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 14:33:03 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-16 14:33:03 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-16 14:33:03 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.017437982372939587,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 16, 14, 33, 3, 314681, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 93622272,
'memusage/startup': 93622272,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 16, 14, 33, 3, 297242, tzinfo=datetime.timezone.utc)}
2026-08-16 14:33:03 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | 경제soTt4YhT') OR 620=(SELECT 620 FROM PG_SLEEP(15))-- (스케줄) | 성공 | +0 | 2026-08-16 23:33:00 | 1초 |
로그 보기2026-08-16 14:33:01 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 14:33:01 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-16 14:33:01 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-16 14:33:01 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-16 14:33:01 [scrapy.core.engine] INFO: Spider opened
2026-08-16 14:33:01 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-16 14:33:01 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6027
2026-08-16 14:33:01 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 14:33:01 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-16 14:33:01 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-16 14:33:01 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.021888447925448418,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 16, 14, 33, 1, 851544, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 93650944,
'memusage/startup': 93650944,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 16, 14, 33, 1, 829654, tzinfo=datetime.timezone.utc)}
2026-08-16 14:33:01 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | @@I0WIt (스케줄) | 성공 | +0 | 2026-08-16 23:32:58 | 1초 |
로그 보기2026-08-16 14:33:00 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 14:33:00 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-16 14:33:00 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-16 14:33:00 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-16 14:33:00 [scrapy.core.engine] INFO: Spider opened
2026-08-16 14:33:00 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-16 14:33:00 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6027
2026-08-16 14:33:00 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 14:33:00 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-16 14:33:00 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-16 14:33:00 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.01483266893774271,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 16, 14, 33, 0, 159540, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 93470720,
'memusage/startup': 93470720,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 16, 14, 33, 0, 144705, tzinfo=datetime.timezone.utc)}
2026-08-16 14:33:00 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||