zoukankan      html  css  js  c++  java
  • Scrapy各项命令说明

    关于Scrapy这个爬虫框架,方块字的资料实在是少。这几天查资料的时候看到了些有用处的文字,记录在此,以作备忘。

    You have to execute it in your 'startproject' folder. You will have another commands if it finds your scrapy.cfg file. You can see the diference here:

    $ scrapy startproject bar
    $ cd bar
    /
    $ ls
    bar  scrapy
    .cfg
    $ scrapy
    Scrapy0.12.0.2536- project: bar

    Usage:
      scrapy
    <command>[options][args]

    Available commands:
      crawl        
    Start crawling from a spider or URL
      deploy        
    Deploy project inScrapyd target
      fetch        
    Fetch a URL using the Scrapy downloader
      genspider    
    Generatenew spider using pre-defined templates
      list          
    List available spiders
      parse        
    Parse URL (using its spider)andprint the results
      queue        
    Deprecated command.SeeScrapyd documentation.
      runserver    
    Deprecated command.Use'server' command instead
      runspider    
    Run a self-contained spider (without creating a project)
      server        
    StartScrapyd server forthis project
      settings      
    Get settings values
      shell        
    Interactive scraping console
      startproject  
    Createnew project
      version      
    PrintScrapy version
      view          
    Open URL in browser,as seen byScrapy

    Use"scrapy <command> -h" to see more info about a command


    $ cd
    ..
    $ scrapy
    Scrapy0.12.0.2536-no active project

    Usage:
      scrapy
    <command>[options][args]

    Available commands:
      fetch        
    Fetch a URL using the Scrapy downloader
      runspider    
    Run a self-contained spider (without creating a project)
      settings      
    Get settings values
      shell        
    Interactive scraping console
      startproject  
    Createnew project
      version      
    PrintScrapy version
      view          
    Open URL in browser,as seen byScrapy

    Use"scrapy <command> -h" to see more info about a command
  • 相关阅读:
    在Ubuntu下依然爱SOGO
    CompositePattern(23种设计模式之一)
    Arduino String.h库函数详解
    cp命令详解
    PHP AJAX 返回JSON 数据
    PHP AJAX返回 "TEXT"
    PHP JSON数据 AJAX
    PHP JQurey
    PHP 封装POD 类
    PHP 分页+查询
  • 原文地址:https://www.cnblogs.com/icycore/p/2441490.html
Copyright © 2011-2022 走看看