수집현황
최근 실행한 크롤링 작업의 상태입니다. 실행 중인 작업이 있어 5초마다 자동 새로고침됩니다.
| 작업 | 대상 | 상태 | 수집 건수 | 시작 | 소요 |
|---|---|---|---|---|---|
| focused | 경제lgvGOBoP')) OR 353=(SELECT 353 FROM PG_SLEEP(15))-- (스케줄) | 성공 | +0 | 2026-08-17 18:00:02 | 1초 |
로그 보기2026-08-17 09:00:03 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 09:00:03 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-17 09:00:03 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-17 09:00:03 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-17 09:00:03 [scrapy.core.engine] INFO: Spider opened
2026-08-17 09:00:03 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-17 09:00:03 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-17 09:00:03 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 09:00:03 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-17 09:00:03 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-17 09:00:03 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.014111996162682772,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 17, 9, 0, 3, 763998, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90386432,
'memusage/startup': 90386432,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 17, 9, 0, 3, 749885, tzinfo=datetime.timezone.utc)}
2026-08-17 09:00:03 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | -1" OR 2+929-929-1=0+0+0+1 -- (스케줄) | 성공 | +0 | 2026-08-17 18:00:01 | 1초 |
로그 보기2026-08-17 09:00:02 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 09:00:02 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-17 09:00:02 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-17 09:00:02 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-17 09:00:02 [scrapy.core.engine] INFO: Spider opened
2026-08-17 09:00:02 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-17 09:00:02 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-17 09:00:02 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 09:00:02 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-17 09:00:02 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-17 09:00:02 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.014655349776148796,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 17, 9, 0, 2, 352919, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90206208,
'memusage/startup': 90206208,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 17, 9, 0, 2, 338262, tzinfo=datetime.timezone.utc)}
2026-08-17 09:00:02 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | 주식 (스케줄) | 성공 | +0 | 2026-08-17 17:59:59 | 1초 |
로그 보기2026-08-17 09:00:00 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 09:00:00 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-17 09:00:00 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-17 09:00:00 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-17 09:00:00 [scrapy.core.engine] INFO: Spider opened
2026-08-17 09:00:00 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-17 09:00:00 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-17 09:00:00 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 09:00:00 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-17 09:00:00 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-17 09:00:00 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.01303646108135581,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 17, 9, 0, 0, 919671, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90071040,
'memusage/startup': 90071040,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 17, 9, 0, 0, 906634, tzinfo=datetime.timezone.utc)}
2026-08-17 09:00:00 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | -1' OR 2+626-626-1=0+0+0+1 -- (스케줄) | 성공 | +0 | 2026-08-17 17:58:58 | 1초 |
로그 보기2026-08-17 08:58:59 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 08:58:59 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-17 08:58:59 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-17 08:58:59 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-17 08:58:59 [scrapy.core.engine] INFO: Spider opened
2026-08-17 08:58:59 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-17 08:58:59 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-17 08:58:59 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 08:58:59 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-17 08:58:59 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-17 08:58:59 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.014145581983029842,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 17, 8, 58, 59, 470834, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90578944,
'memusage/startup': 90578944,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 17, 8, 58, 59, 456687, tzinfo=datetime.timezone.utc)}
2026-08-17 08:58:59 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | -1 OR 2+202-202-1=0+0+0+1 -- (스케줄) | 성공 | +0 | 2026-08-17 17:58:56 | 1초 |
로그 보기2026-08-17 08:58:58 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 08:58:58 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-17 08:58:58 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-17 08:58:58 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-17 08:58:58 [scrapy.core.engine] INFO: Spider opened
2026-08-17 08:58:58 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-17 08:58:58 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-17 08:58:58 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 08:58:58 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-17 08:58:58 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-17 08:58:58 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.012094489298760891,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 17, 8, 58, 58, 36761, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90730496,
'memusage/startup': 90730496,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 17, 8, 58, 58, 24666, tzinfo=datetime.timezone.utc)}
2026-08-17 08:58:58 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | -1' OR 2+162-162-1=0+0+0+1 or 'noc5aZ54'=' (스케줄) | 성공 | +0 | 2026-08-17 17:58:55 | 1초 |
로그 보기2026-08-17 08:58:56 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 08:58:56 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-17 08:58:56 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-17 08:58:56 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-17 08:58:56 [scrapy.core.engine] INFO: Spider opened
2026-08-17 08:58:56 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-17 08:58:56 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-17 08:58:56 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 08:58:56 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-17 08:58:56 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-17 08:58:56 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.013676107861101627,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 17, 8, 58, 56, 619406, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90189824,
'memusage/startup': 90189824,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 17, 8, 58, 56, 605729, tzinfo=datetime.timezone.utc)}
2026-08-17 08:58:56 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | 주식(관심) (스케줄) | 성공 | +0 | 2026-08-17 17:58:53 | 1초 |
로그 보기2026-08-17 08:58:55 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 08:58:55 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-17 08:58:55 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-17 08:58:55 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-17 08:58:55 [scrapy.core.engine] INFO: Spider opened
2026-08-17 08:58:55 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-17 08:58:55 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-17 08:58:55 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 08:58:55 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-17 08:58:55 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-17 08:58:55 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.011915051378309727,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 17, 8, 58, 55, 178948, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90308608,
'memusage/startup': 90308608,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 17, 8, 58, 55, 167031, tzinfo=datetime.timezone.utc)}
2026-08-17 08:58:55 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | -1 OR 2+777-777-1=0+0+0+1 (스케줄) | 성공 | +0 | 2026-08-17 17:58:52 | 1초 |
로그 보기2026-08-17 08:58:53 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 08:58:53 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-17 08:58:53 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-17 08:58:53 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-17 08:58:53 [scrapy.core.engine] INFO: Spider opened
2026-08-17 08:58:53 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-17 08:58:53 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-17 08:58:53 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 08:58:53 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-17 08:58:53 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-17 08:58:53 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.013289399910718203,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 17, 8, 58, 53, 773494, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90103808,
'memusage/startup': 90103808,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 17, 8, 58, 53, 760203, tzinfo=datetime.timezone.utc)}
2026-08-17 08:58:53 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | -1" OR 2+179-179-1=0+0+0+1 -- (스케줄) | 성공 | +0 | 2026-08-17 17:58:51 | 1초 |
로그 보기2026-08-17 08:58:52 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 08:58:52 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-17 08:58:52 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-17 08:58:52 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-17 08:58:52 [scrapy.core.engine] INFO: Spider opened
2026-08-17 08:58:52 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-17 08:58:52 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-17 08:58:52 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 08:58:52 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-17 08:58:52 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-17 08:58:52 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.014575523789972067,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 17, 8, 58, 52, 332899, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90656768,
'memusage/startup': 90656768,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 17, 8, 58, 52, 318323, tzinfo=datetime.timezone.utc)}
2026-08-17 08:58:52 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | -1 OR 2+475-475-1=0+0+0+1 (스케줄) | 성공 | +0 | 2026-08-17 17:57:49 | 1초 |
로그 보기2026-08-17 08:57:50 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 08:57:50 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-17 08:57:50 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-17 08:57:50 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-17 08:57:50 [scrapy.core.engine] INFO: Spider opened
2026-08-17 08:57:50 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-17 08:57:50 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-17 08:57:50 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-17 08:57:50 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-17 08:57:50 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-17 08:57:50 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.014089295640587807,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 17, 8, 57, 50, 878227, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90349568,
'memusage/startup': 90349568,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 17, 8, 57, 50, 864137, tzinfo=datetime.timezone.utc)}
2026-08-17 08:57:50 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||