zoukankan      html  css  js  c++  java
  • Scrapy各项命令说明

    关于Scrapy这个爬虫框架,方块字的资料实在是少。这几天查资料的时候看到了些有用处的文字,记录在此,以作备忘。

    You have to execute it in your 'startproject' folder. You will have another commands if it finds your scrapy.cfg file. You can see the diference here:

    $ scrapy startproject bar
    $ cd bar
    /
    $ ls
    bar  scrapy
    .cfg
    $ scrapy
    Scrapy0.12.0.2536- project: bar

    Usage:
      scrapy
    <command>[options][args]

    Available commands:
      crawl        
    Start crawling from a spider or URL
      deploy        
    Deploy project inScrapyd target
      fetch        
    Fetch a URL using the Scrapy downloader
      genspider    
    Generatenew spider using pre-defined templates
      list          
    List available spiders
      parse        
    Parse URL (using its spider)andprint the results
      queue        
    Deprecated command.SeeScrapyd documentation.
      runserver    
    Deprecated command.Use'server' command instead
      runspider    
    Run a self-contained spider (without creating a project)
      server        
    StartScrapyd server forthis project
      settings      
    Get settings values
      shell        
    Interactive scraping console
      startproject  
    Createnew project
      version      
    PrintScrapy version
      view          
    Open URL in browser,as seen byScrapy

    Use"scrapy <command> -h" to see more info about a command


    $ cd
    ..
    $ scrapy
    Scrapy0.12.0.2536-no active project

    Usage:
      scrapy
    <command>[options][args]

    Available commands:
      fetch        
    Fetch a URL using the Scrapy downloader
      runspider    
    Run a self-contained spider (without creating a project)
      settings      
    Get settings values
      shell        
    Interactive scraping console
      startproject  
    Createnew project
      version      
    PrintScrapy version
      view          
    Open URL in browser,as seen byScrapy

    Use"scrapy <command> -h" to see more info about a command
  • 相关阅读:
    Linux网络与服务管理
    输入两个数据,如果输入数据之和为5的倍数,那么就算是输了,停止游戏;如果赢了,接着输入数据。
    switch语句
    计算一个三位数的个位,十位,百位之和
    单分支和双分支选择结构程序设计
    register变量
    static变量
    auto变量
    长双精度类型
    双精度类型变量
  • 原文地址:https://www.cnblogs.com/icycore/p/2441490.html
Copyright © 2011-2022 走看看