수집현황
최근 실행한 크롤링 작업의 상태입니다. 실행 중인 작업이 있어 5초마다 자동 새로고침됩니다.
| 작업 | 대상 | 상태 | 수집 건수 | 시작 | 소요 |
|---|---|---|---|---|---|
| focused | -1' OR 2+626-626-1=0+0+0+1 -- (스케줄) | 성공 | +0 | 2026-08-17 00:14:03 | 1초 |
로그 보기2026-08-16 15:14:04 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 15:14:04 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-16 15:14:04 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-16 15:14:04 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-16 15:14:04 [scrapy.core.engine] INFO: Spider opened
2026-08-16 15:14:04 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-16 15:14:04 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-16 15:14:04 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 15:14:04 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-16 15:14:04 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-16 15:14:04 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.013693857938051224,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 16, 15, 14, 4, 717639, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 90361856,
'memusage/startup': 90361856,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 16, 15, 14, 4, 703943, tzinfo=datetime.timezone.utc)}
2026-08-16 15:14:04 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | @@m6WpX (스케줄) | 성공 | +0 | 2026-08-17 00:09:01 | 1초 |
로그 보기2026-08-16 15:09:03 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 15:09:03 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-16 15:09:03 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-16 15:09:03 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-16 15:09:03 [scrapy.core.engine] INFO: Spider opened
2026-08-16 15:09:03 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-16 15:09:03 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-16 15:09:03 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 15:09:03 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-16 15:09:03 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-16 15:09:03 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.012339503969997168,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 16, 15, 9, 3, 209232, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 89722880,
'memusage/startup': 89722880,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 16, 15, 9, 3, 196891, tzinfo=datetime.timezone.utc)}
2026-08-16 15:09:03 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| focused | 경제����%2527%2522\'\" (스케줄) | 성공 | +0 | 2026-08-17 00:09:00 | 1초 |
로그 보기2026-08-16 15:09:01 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 15:09:01 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
--- (최근 로그) ---
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-08-16 15:09:01 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.start.StartSpiderMiddleware',
'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-08-16 15:09:01 [scrapy.middleware] INFO: Enabled item pipelines:
['news_crawler.pipelines.DuplicatesPipeline',
'news_crawler.pipelines.PostgresPipeline']
2026-08-16 15:09:01 [scrapy.core.engine] INFO: Spider opened
2026-08-16 15:09:01 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-08-16 15:09:01 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-08-16 15:09:01 [focused] INFO: [진단] 수집할 카테고리: []
2026-08-16 15:09:01 [focused] WARNING: [진단] 최종적으로 크롤링할 카테고리가 없습니다. 요청한 카테고리 이름이 DB(category_keywords)에 등록된 이름과 정확히 일치하는지 확인하세요.
2026-08-16 15:09:01 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-16 15:09:01 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'elapsed_time_seconds': 0.012191249057650566,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 16, 15, 9, 1, 763352, tzinfo=datetime.timezone.utc),
'items_per_minute': None,
'log_count/INFO': 4,
'log_count/WARNING': 1,
'memusage/max': 88850432,
'memusage/startup': 88850432,
'responses_per_minute': None,
'start_time': datetime.datetime(2026, 8, 16, 15, 9, 1, 751160, tzinfo=datetime.timezone.utc)}
2026-08-16 15:09:01 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| generic | pHqghUme | 성공 | +0 | 2026-08-17 00:06:48 | 39초 |
로그 보기2026-08-16 15:07:26 [scrapy.core.scraper] ERROR: Spider error processing <GET http://www.example.com> (referer: None)
Traceback (most recent call last):
'log_count/ERROR': 1,
--- (최근 로그) ---
cssselect.parser.SelectorSyntaxError: Expected selector, got <NUMBER '1' at 0>
2026-08-16 15:07:26 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-16 15:07:26 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 472,
'downloader/request_count': 2,
'downloader/request_method_count/GET': 2,
'downloader/response_bytes': 200,
'downloader/response_count': 2,
'downloader/response_status_count/200': 2,
'elapsed_time_seconds': 3.5471421950496733,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 16, 15, 7, 26, 210332, tzinfo=datetime.timezone.utc),
'items_per_minute': 0.0,
'log_count/ERROR': 1,
'log_count/INFO': 3,
'memusage/max': 85966848,
'memusage/startup': 85966848,
'response_received_count': 2,
'responses_per_minute': 40.0,
'robotstxt/request_count': 1,
'robotstxt/response_count': 1,
'robotstxt/response_status_count/200': 1,
'scheduler/dequeued': 1,
'scheduler/dequeued/memory': 1,
'scheduler/enqueued': 1,
'scheduler/enqueued/memory': 1,
'spider_exceptions/SelectorSyntaxError': 1,
'spider_exceptions/count': 1,
'start_time': datetime.datetime(2026, 8, 16, 15, 7, 22, 663162, tzinfo=datetime.timezone.utc)}
2026-08-16 15:07:26 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| generic | pHqghUme | 성공 | +0 | 2026-08-17 00:06:47 | 39초 |
로그 보기2026-08-16 15:07:25 [scrapy.core.scraper] ERROR: Spider error processing <GET http://www.example.com> (referer: None)
Traceback (most recent call last):
'log_count/ERROR': 1,
--- (최근 로그) ---
cssselect.parser.SelectorSyntaxError: Expected selector, got <NUMBER '1' at 0>
2026-08-16 15:07:25 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-16 15:07:25 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 472,
'downloader/request_count': 2,
'downloader/request_method_count/GET': 2,
'downloader/response_bytes': 200,
'downloader/response_count': 2,
'downloader/response_status_count/200': 2,
'elapsed_time_seconds': 3.689829762093723,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 16, 15, 7, 25, 867436, tzinfo=datetime.timezone.utc),
'items_per_minute': 0.0,
'log_count/ERROR': 1,
'log_count/INFO': 3,
'memusage/max': 85966848,
'memusage/startup': 85966848,
'response_received_count': 2,
'responses_per_minute': 40.0,
'robotstxt/request_count': 1,
'robotstxt/response_count': 1,
'robotstxt/response_status_count/200': 1,
'scheduler/dequeued': 1,
'scheduler/dequeued/memory': 1,
'scheduler/enqueued': 1,
'scheduler/enqueued/memory': 1,
'spider_exceptions/SelectorSyntaxError': 1,
'spider_exceptions/count': 1,
'start_time': datetime.datetime(2026, 8, 16, 15, 7, 22, 177607, tzinfo=datetime.timezone.utc)}
2026-08-16 15:07:25 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| generic | pHqghUme | 성공 | +0 | 2026-08-17 00:06:47 | 38초 |
로그 보기2026-08-16 15:07:23 [scrapy.core.scraper] ERROR: Spider error processing <GET http://www.example.com> (referer: None)
Traceback (most recent call last):
'log_count/ERROR': 1,
--- (최근 로그) ---
cssselect.parser.SelectorSyntaxError: Expected selector, got <NUMBER '1' at 0>
2026-08-16 15:07:23 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-16 15:07:23 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 472,
'downloader/request_count': 2,
'downloader/request_method_count/GET': 2,
'downloader/response_bytes': 200,
'downloader/response_count': 2,
'downloader/response_status_count/200': 2,
'elapsed_time_seconds': 2.6967035587877035,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 16, 15, 7, 23, 429853, tzinfo=datetime.timezone.utc),
'items_per_minute': 0.0,
'log_count/ERROR': 1,
'log_count/INFO': 3,
'memusage/max': 85966848,
'memusage/startup': 85966848,
'response_received_count': 2,
'responses_per_minute': 60.0,
'robotstxt/request_count': 1,
'robotstxt/response_count': 1,
'robotstxt/response_status_count/200': 1,
'scheduler/dequeued': 1,
'scheduler/dequeued/memory': 1,
'scheduler/enqueued': 1,
'scheduler/enqueued/memory': 1,
'spider_exceptions/SelectorSyntaxError': 1,
'spider_exceptions/count': 1,
'start_time': datetime.datetime(2026, 8, 16, 15, 7, 20, 733105, tzinfo=datetime.timezone.utc)}
2026-08-16 15:07:23 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| generic | pHqghUme | 성공 | +0 | 2026-08-17 00:06:47 | 39초 |
로그 보기2026-08-16 15:07:24 [scrapy.core.scraper] ERROR: Spider error processing <GET http://www.example.com> (referer: None)
Traceback (most recent call last):
'log_count/ERROR': 1,
--- (최근 로그) ---
cssselect.parser.SelectorSyntaxError: Expected selector, got <NUMBER '1' at 0>
2026-08-16 15:07:24 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-16 15:07:24 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 472,
'downloader/request_count': 2,
'downloader/request_method_count/GET': 2,
'downloader/response_bytes': 200,
'downloader/response_count': 2,
'downloader/response_status_count/200': 2,
'elapsed_time_seconds': 3.1071252967230976,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 16, 15, 7, 24, 916007, tzinfo=datetime.timezone.utc),
'items_per_minute': 0.0,
'log_count/ERROR': 1,
'log_count/INFO': 3,
'memusage/max': 85966848,
'memusage/startup': 85966848,
'response_received_count': 2,
'responses_per_minute': 40.0,
'robotstxt/request_count': 1,
'robotstxt/response_count': 1,
'robotstxt/response_status_count/200': 1,
'scheduler/dequeued': 1,
'scheduler/dequeued/memory': 1,
'scheduler/enqueued': 1,
'scheduler/enqueued/memory': 1,
'spider_exceptions/SelectorSyntaxError': 1,
'spider_exceptions/count': 1,
'start_time': datetime.datetime(2026, 8, 16, 15, 7, 21, 808879, tzinfo=datetime.timezone.utc)}
2026-08-16 15:07:24 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| generic | (select(0)from(select(sleep(15)))v)/*'+(select(0)from(select(sleep(15)))v)+'"+(select(0)from(select(sleep(15)))v)+"*/ | 성공 | +0 | 2026-08-17 00:06:47 | 38초 |
로그 보기2026-08-16 15:07:25 [scrapy.core.scraper] ERROR: Spider error processing <GET http://www.example.com> (referer: None)
Traceback (most recent call last):
'log_count/ERROR': 1,
--- (최근 로그) ---
cssselect.parser.SelectorSyntaxError: Expected selector, got <NUMBER '1' at 0>
2026-08-16 15:07:25 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-16 15:07:25 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 472,
'downloader/request_count': 2,
'downloader/request_method_count/GET': 2,
'downloader/response_bytes': 200,
'downloader/response_count': 2,
'downloader/response_status_count/200': 2,
'elapsed_time_seconds': 3.3069184073247015,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 16, 15, 7, 25, 110595, tzinfo=datetime.timezone.utc),
'items_per_minute': 0.0,
'log_count/ERROR': 1,
'log_count/INFO': 3,
'memusage/max': 85966848,
'memusage/startup': 85966848,
'response_received_count': 2,
'responses_per_minute': 40.0,
'robotstxt/request_count': 1,
'robotstxt/response_count': 1,
'robotstxt/response_status_count/200': 1,
'scheduler/dequeued': 1,
'scheduler/dequeued/memory': 1,
'scheduler/enqueued': 1,
'scheduler/enqueued/memory': 1,
'spider_exceptions/SelectorSyntaxError': 1,
'spider_exceptions/count': 1,
'start_time': datetime.datetime(2026, 8, 16, 15, 7, 21, 803672, tzinfo=datetime.timezone.utc)}
2026-08-16 15:07:25 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| generic | pHqghUme | 성공 | +0 | 2026-08-17 00:06:47 | 39초 |
로그 보기2026-08-16 15:07:25 [scrapy.core.scraper] ERROR: Spider error processing <GET http://www.example.com> (referer: None)
Traceback (most recent call last):
'log_count/ERROR': 1,
--- (최근 로그) ---
cssselect.parser.SelectorSyntaxError: Expected selector, got <NUMBER '1' at 0>
2026-08-16 15:07:25 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-16 15:07:25 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 472,
'downloader/request_count': 2,
'downloader/request_method_count/GET': 2,
'downloader/response_bytes': 200,
'downloader/response_count': 2,
'downloader/response_status_count/200': 2,
'elapsed_time_seconds': 3.794054946862161,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 16, 15, 7, 25, 753489, tzinfo=datetime.timezone.utc),
'items_per_minute': 0.0,
'log_count/ERROR': 1,
'log_count/INFO': 3,
'memusage/max': 85966848,
'memusage/startup': 85966848,
'response_received_count': 2,
'responses_per_minute': 40.0,
'robotstxt/request_count': 1,
'robotstxt/response_count': 1,
'robotstxt/response_status_count/200': 1,
'scheduler/dequeued': 1,
'scheduler/dequeued/memory': 1,
'scheduler/enqueued': 1,
'scheduler/enqueued/memory': 1,
'spider_exceptions/SelectorSyntaxError': 1,
'spider_exceptions/count': 1,
'start_time': datetime.datetime(2026, 8, 16, 15, 7, 21, 959434, tzinfo=datetime.timezone.utc)}
2026-08-16 15:07:25 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||
| generic | pHqghUme | 성공 | +0 | 2026-08-17 00:06:47 | 39초 |
로그 보기2026-08-16 15:07:25 [scrapy.core.scraper] ERROR: Spider error processing <GET http://www.example.com> (referer: None)
Traceback (most recent call last):
'log_count/ERROR': 1,
--- (최근 로그) ---
cssselect.parser.SelectorSyntaxError: Expected selector, got <NUMBER '1' at 0>
2026-08-16 15:07:25 [scrapy.core.engine] INFO: Closing spider (finished)
2026-08-16 15:07:25 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 472,
'downloader/request_count': 2,
'downloader/request_method_count/GET': 2,
'downloader/response_bytes': 200,
'downloader/response_count': 2,
'downloader/response_status_count/200': 2,
'elapsed_time_seconds': 3.4995035869069397,
'finish_reason': 'finished',
'finish_time': datetime.datetime(2026, 8, 16, 15, 7, 25, 577986, tzinfo=datetime.timezone.utc),
'items_per_minute': 0.0,
'log_count/ERROR': 1,
'log_count/INFO': 3,
'memusage/max': 85966848,
'memusage/startup': 85966848,
'response_received_count': 2,
'responses_per_minute': 40.0,
'robotstxt/request_count': 1,
'robotstxt/response_count': 1,
'robotstxt/response_status_count/200': 1,
'scheduler/dequeued': 1,
'scheduler/dequeued/memory': 1,
'scheduler/enqueued': 1,
'scheduler/enqueued/memory': 1,
'spider_exceptions/SelectorSyntaxError': 1,
'spider_exceptions/count': 1,
'start_time': datetime.datetime(2026, 8, 16, 15, 7, 22, 78470, tzinfo=datetime.timezone.utc)}
2026-08-16 15:07:25 [scrapy.core.engine] INFO: Spider closed (finished)
|
|||||