수집현황
최근 실행한 크롤링 작업의 상태입니다. 실행 중인 작업이 있어 5초마다 자동 새로고침됩니다.
| 작업 | 대상 | 상태 | 수집 건수 | 시작 | 소요 |
|---|---|---|---|---|---|
| focused | 주식(관심) (스케줄) | 성공 | +0 | 2026-08-18 18:06:33 | 1초 |
로그 보기2026-08-18 09:06:34 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-18 09:06:34 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-18 09:06:34 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-18 09:06:34 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-18 09:06:34 [scrapy.core.engine] INFO: Spider opened
2026-08-18 09:06:34 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-18 09:06:34 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-18 09:06:34 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-18 09:06:34 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-18 09:06:34 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-18 09:06:34 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.014361225999891758,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 18, 9, 6, 34, 362225, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90521600,
'memusage/startup': 90521600,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 18, 9, 6, 34, 347862, tzinfo=datetime.timezone.utc)}
2026-08-18 09:06:34 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | 경제nwDZixIN') OR 161=(SELECT 161 FROM PG_SLEEP(15))-- (스케줄) | 성공 | +0 | 2026-08-18 18:06:31 | 1초 |
로그 보기2026-08-18 09:06:32 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-18 09:06:32 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-18 09:06:32 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-18 09:06:32 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-18 09:06:32 [scrapy.core.engine] INFO: Spider opened
2026-08-18 09:06:32 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-18 09:06:32 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-18 09:06:32 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-18 09:06:32 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-18 09:06:32 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-18 09:06:32 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.014318945817649364,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 18, 9, 6, 32, 911895, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90738688,
'memusage/startup': 90738688,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 18, 9, 6, 32, 897575, tzinfo=datetime.timezone.utc)}
2026-08-18 09:06:32 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | 경제R10jUCN8'; waitfor delay '0:0:15' -- (스케줄) | 성공 | +0 | 2026-08-18 18:06:30 | 1초 |
로그 보기2026-08-18 09:06:31 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-18 09:06:31 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-18 09:06:31 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-18 09:06:31 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-18 09:06:31 [scrapy.core.engine] INFO: Spider opened
2026-08-18 09:06:31 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-18 09:06:31 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-18 09:06:31 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-18 09:06:31 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-18 09:06:31 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-18 09:06:31 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.01269778423011303,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 18, 9, 6, 31, 387142, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90206208,
'memusage/startup': 90206208,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 18, 9, 6, 31, 374442, tzinfo=datetime.timezone.utc)}
2026-08-18 09:06:31 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | -1 OR 2+733-733-1=0+0+0+1 -- (스케줄) | 성공 | +0 | 2026-08-18 18:05:28 | 1초 |
로그 보기2026-08-18 09:05:29 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-18 09:05:29 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-18 09:05:29 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-18 09:05:29 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-18 09:05:29 [scrapy.core.engine] INFO: Spider opened
2026-08-18 09:05:29 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-18 09:05:29 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-18 09:05:29 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-18 09:05:29 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-18 09:05:29 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-18 09:05:29 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.014045519288629293,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 18, 9, 5, 29, 935666, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90259456,
'memusage/startup': 90259456,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 18, 9, 5, 29, 921619, tzinfo=datetime.timezone.utc)}
2026-08-18 09:05:29 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | -1" OR 2+929-929-1=0+0+0+1 -- (스케줄) | 성공 | +0 | 2026-08-18 18:05:27 | 1초 |
로그 보기2026-08-18 09:05:28 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-18 09:05:28 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-18 09:05:28 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-18 09:05:28 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-18 09:05:28 [scrapy.core.engine] INFO: Spider opened
2026-08-18 09:05:28 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-18 09:05:28 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-18 09:05:28 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-18 09:05:28 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-18 09:05:28 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-18 09:05:28 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.014755734242498875,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 18, 9, 5, 28, 484840, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90451968,
'memusage/startup': 90451968,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 18, 9, 5, 28, 470084, tzinfo=datetime.timezone.utc)}
2026-08-18 09:05:28 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | @@4R67u (스케줄) | 성공 | +0 | 2026-08-18 18:03:25 | 1초 |
로그 보기2026-08-18 09:03:27 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-18 09:03:27 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-18 09:03:26 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-18 09:03:26 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-18 09:03:26 [scrapy.core.engine] INFO: Spider opened
2026-08-18 09:03:26 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-18 09:03:26 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-18 09:03:27 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-18 09:03:27 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-18 09:03:27 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-18 09:03:27 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.0143768391571939,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 18, 9, 3, 27, 7504, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90812416,
'memusage/startup': 90812416,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 18, 9, 3, 26, 993126, tzinfo=datetime.timezone.utc)}
2026-08-18 09:03:27 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | -1 OR 2+475-475-1=0+0+0+1 (스케줄) | 성공 | +0 | 2026-08-18 18:03:24 | 1초 |
로그 보기2026-08-18 09:03:25 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-18 09:03:25 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-18 09:03:25 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-18 09:03:25 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-18 09:03:25 [scrapy.core.engine] INFO: Spider opened
2026-08-18 09:03:25 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-18 09:03:25 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-18 09:03:25 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-18 09:03:25 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-18 09:03:25 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-18 09:03:25 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.01591916475445032,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 18, 9, 3, 25, 575352, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90255360,
'memusage/startup': 90255360,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 18, 9, 3, 25, 559431, tzinfo=datetime.timezone.utc)}
2026-08-18 09:03:25 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | 경제MLVmfXgg')) OR 196=(SELECT 196 FROM PG_SLEEP(15))-- (스케줄) | 성공 | +0 | 2026-08-18 18:02:22 | 1초 |
로그 보기2026-08-18 09:02:24 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-18 09:02:24 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-18 09:02:24 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-18 09:02:24 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-18 09:02:24 [scrapy.core.engine] INFO: Spider opened
2026-08-18 09:02:24 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-18 09:02:24 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-18 09:02:24 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-18 09:02:24 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-18 09:02:24 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-18 09:02:24 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.012347049079835415,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 18, 9, 2, 24, 89102, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90222592,
'memusage/startup': 90222592,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 18, 9, 2, 24, 76753, tzinfo=datetime.timezone.utc)}
2026-08-18 09:02:24 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | 경제J7kMucZ2' OR 512=(SELECT 512 FROM PG_SLEEP(15))-- (스케줄) | 성공 | +0 | 2026-08-18 18:01:21 | 1초 |
로그 보기2026-08-18 09:01:22 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-18 09:01:22 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-18 09:01:22 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-18 09:01:22 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-18 09:01:22 [scrapy.core.engine] INFO: Spider opened
2026-08-18 09:01:22 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-18 09:01:22 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-18 09:01:22 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-18 09:01:22 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-18 09:01:22 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-18 09:01:22 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.014191729947924614,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 18, 9, 1, 22, 651060, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90656768,
'memusage/startup': 90656768,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 18, 9, 1, 22, 636867, tzinfo=datetime.timezone.utc)}
2026-08-18 09:01:22 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | 경제d17yBTkf'; waitfor delay '0:0:15' -- (스케줄) | 성공 | +0 | 2026-08-18 18:01:19 | 1초 |
로그 보기2026-08-18 09:01:21 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-18 09:01:21 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-18 09:01:21 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-18 09:01:21 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-18 09:01:21 [scrapy.core.engine] INFO: Spider opened
2026-08-18 09:01:21 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-18 09:01:21 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-18 09:01:21 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-18 09:01:21 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-18 09:01:21 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-18 09:01:21 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.018662508111447096,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 18, 9, 1, 21, 207757, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90447872,
'memusage/startup': 90447872,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 18, 9, 1, 21, 189094, tzinfo=datetime.timezone.utc)}
2026-08-18 09:01:21 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||