zoukankan      html  css  js  c++  java
  • Scrapy各项命令说明

    关于Scrapy这个爬虫框架,方块字的资料实在是少。这几天查资料的时候看到了些有用处的文字,记录在此,以作备忘。

    You have to execute it in your 'startproject' folder. You will have another commands if it finds your scrapy.cfg file. You can see the diference here:

    $ scrapy startproject bar
    $ cd bar
    /
    $ ls
    bar  scrapy
    .cfg
    $ scrapy
    Scrapy0.12.0.2536- project: bar

    Usage:
      scrapy
    <command>[options][args]

    Available commands:
      crawl        
    Start crawling from a spider or URL
      deploy        
    Deploy project inScrapyd target
      fetch        
    Fetch a URL using the Scrapy downloader
      genspider    
    Generatenew spider using pre-defined templates
      list          
    List available spiders
      parse        
    Parse URL (using its spider)andprint the results
      queue        
    Deprecated command.SeeScrapyd documentation.
      runserver    
    Deprecated command.Use'server' command instead
      runspider    
    Run a self-contained spider (without creating a project)
      server        
    StartScrapyd server forthis project
      settings      
    Get settings values
      shell        
    Interactive scraping console
      startproject  
    Createnew project
      version      
    PrintScrapy version
      view          
    Open URL in browser,as seen byScrapy

    Use"scrapy <command> -h" to see more info about a command


    $ cd
    ..
    $ scrapy
    Scrapy0.12.0.2536-no active project

    Usage:
      scrapy
    <command>[options][args]

    Available commands:
      fetch        
    Fetch a URL using the Scrapy downloader
      runspider    
    Run a self-contained spider (without creating a project)
      settings      
    Get settings values
      shell        
    Interactive scraping console
      startproject  
    Createnew project
      version      
    PrintScrapy version
      view          
    Open URL in browser,as seen byScrapy

    Use"scrapy <command> -h" to see more info about a command
  • 相关阅读:
    STM32---GPIO
    SQLITE笔记
    STM32 ---- PWM
    STM32--- IIC使用
    TP配置apache下Rewrite模式
    韩顺平老师SNS数据库表 http://blog.csdn.net/zxman660/article/details/7786994
    HashMap和HashTable的区别http://blog.csdn.net/shohokuf/article/details/3932967
    HashMap和HashSet的区别http://www.importnew.com/6931.html
    在mysql中存储生日,php中计算今天是否为用户生日
    文件的MIME类型
  • 原文地址:https://www.cnblogs.com/icycore/p/2441490.html
Copyright © 2011-2022 走看看