zoukankan      html  css  js  c++  java
  • 一次scrapy成功停止的信息

    2017-11-05 18:52:42 [scrapy.core.engine] INFO: Closing spider (finished)
    2017-11-05 18:52:42 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
    {'downloader/exception_count': 1,
    'downloader/exception_type_count/twisted.internet.error.TCPTimedOutError': 1,
    'downloader/request_bytes': 13663857,
    'downloader/request_count': 41889,
    'downloader/request_method_count/GET': 41889,
    'downloader/response_bytes': 935922909,
    'downloader/response_count': 41888,
    'downloader/response_status_count/200': 41776,
    'downloader/response_status_count/301': 25,
    'downloader/response_status_count/404': 87,
    'dupefilter/filtered': 5335,
    'finish_reason': 'finished',
    'finish_time': datetime.datetime(2017, 11, 5, 10, 52, 42, 779396),
    'item_scraped_count': 41346,
    'log_count/DEBUG': 83237,
    'log_count/INFO': 49,
    'request_depth_max': 1,
    'response_received_count': 41533,
    'retry/count': 1,
    'retry/reason_count/twisted.internet.error.TCPTimedOutError': 1,
    'scheduler/dequeued': 41886,
    'scheduler/dequeued/disk': 41886,
    'scheduler/enqueued': 41886,
    'scheduler/enqueued/disk': 41886,
    'start_time': datetime.datetime(2017, 11, 5, 10, 10, 13, 465263)}
    2017-11-05 18:52:42 [scrapy.core.engine] INFO: Spider closed (finished)

  • 相关阅读:
    快速幂取模
    程序人生系列之新闻发布系统 0105
    JavaWeb之博客系统(四)
    [转]树状数组
    题目:免费午餐
    题目:删数问题
    题目:三元组
    题目:分子团
    题目:[汪老师结婚]婚礼上的袭击
    题目:[SBN号码]
  • 原文地址:https://www.cnblogs.com/anqiang1995/p/7788282.html
Copyright © 2011-2022 走看看