zoukankan      html  css  js  c++  java
  • Scrapy各项命令说明

    关于Scrapy这个爬虫框架,方块字的资料实在是少。这几天查资料的时候看到了些有用处的文字,记录在此,以作备忘。

    You have to execute it in your 'startproject' folder. You will have another commands if it finds your scrapy.cfg file. You can see the diference here:

    $ scrapy startproject bar
    $ cd bar
    /
    $ ls
    bar  scrapy
    .cfg
    $ scrapy
    Scrapy0.12.0.2536- project: bar

    Usage:
      scrapy
    <command>[options][args]

    Available commands:
      crawl        
    Start crawling from a spider or URL
      deploy        
    Deploy project inScrapyd target
      fetch        
    Fetch a URL using the Scrapy downloader
      genspider    
    Generatenew spider using pre-defined templates
      list          
    List available spiders
      parse        
    Parse URL (using its spider)andprint the results
      queue        
    Deprecated command.SeeScrapyd documentation.
      runserver    
    Deprecated command.Use'server' command instead
      runspider    
    Run a self-contained spider (without creating a project)
      server        
    StartScrapyd server forthis project
      settings      
    Get settings values
      shell        
    Interactive scraping console
      startproject  
    Createnew project
      version      
    PrintScrapy version
      view          
    Open URL in browser,as seen byScrapy

    Use"scrapy <command> -h" to see more info about a command


    $ cd
    ..
    $ scrapy
    Scrapy0.12.0.2536-no active project

    Usage:
      scrapy
    <command>[options][args]

    Available commands:
      fetch        
    Fetch a URL using the Scrapy downloader
      runspider    
    Run a self-contained spider (without creating a project)
      settings      
    Get settings values
      shell        
    Interactive scraping console
      startproject  
    Createnew project
      version      
    PrintScrapy version
      view          
    Open URL in browser,as seen byScrapy

    Use"scrapy <command> -h" to see more info about a command
  • 相关阅读:
    WYT的刷子
    小烈送菜
    猴腮雷
    基于Docker的Mysql主从复制搭建
    C#集合类型大揭秘
    ASP.NET三剑客 HttpApplication HttpModule HttpHandler 解析
    使用缓存的正确姿势
    【模块化那些事】 拆散的模块化
    分享一个开源的网盘下载工具BaiduPCS-Go
    【抽象那些事】不必要的抽象
  • 原文地址:https://www.cnblogs.com/icycore/p/2441490.html
Copyright © 2011-2022 走看看