zoukankan      html  css  js  c++  java
  • scrapy fram work 1/n

    OS, debian 9

    1. pip3 install Scrapy

    pip3 install Scrapy
    Collecting Scrapy
      Downloading https://files.pythonhosted.org/packages/e0/b7/06c19d7d7f5318ffd1d31d7cd7d944ed9dcf773981c731285350961d9b5c/Scrapy-2.0.1-py2.py3-none-any.whl (242kB)
        100% |████████████████████████████████| 245kB 651kB/s 
    Collecting w3lib>=1.17.0 (from Scrapy)
      Downloading https://files.pythonhosted.org/packages/6a/45/1ba17c50a0bb16bd950c9c2b92ec60d40c8ebda9f3371ae4230c437120b6/w3lib-1.21.0-py2.py3-none-any.whl
    Collecting cryptography>=2.0 (from Scrapy)
      Downloading https://files.pythonhosted.org/packages/45/73/d18a8884de8bffdcda475728008b5b13be7fbef40a2acc81a0d5d524175d/cryptography-2.8-cp34-abi3-manylinux1_x86_64.whl (2.3MB)
        100% |████████████████████████████████| 2.3MB 594kB/s 
    Collecting lxml>=3.5.0 (from Scrapy)
      Downloading https://files.pythonhosted.org/packages/f2/e5/304cfec4e0abebb4a4e16f56129df792c81f1bcdbb1432d1a63f749f8b74/lxml-4.5.0-cp35-cp35m-manylinux1_x86_64.whl (5.7MB)
        100% |████████████████████████████████| 5.7MB 148kB/s 
    Collecting pyOpenSSL>=16.2.0 (from Scrapy)
      Downloading https://files.pythonhosted.org/packages/9e/de/f8342b68fa9e981d348039954657bdf681b2ab93de27443be51865ffa310/pyOpenSSL-19.1.0-py2.py3-none-any.whl (53kB)
        100% |████████████████████████████████| 61kB 206kB/s 
    Collecting Twisted>=17.9.0 (from Scrapy)
      Downloading https://files.pythonhosted.org/packages/86/35/277208855efd887688b50dbeefd2b5a68f02867fcc197a57d294db6782b1/Twisted-20.3.0-cp35-cp35m-manylinux1_x86_64.whl (3.1MB)
        100% |████████████████████████████████| 3.1MB 241kB/s 
    Collecting protego>=0.1.15 (from Scrapy)
      Downloading https://files.pythonhosted.org/packages/db/6e/bf6d5e4d7cf233b785719aaec2c38f027b9c2ed980a0015ec1a1cced4893/Protego-0.1.16.tar.gz (3.2MB)
        100% |████████████████████████████████| 3.2MB 181kB/s 
    Collecting queuelib>=1.4.2 (from Scrapy)
      Downloading https://files.pythonhosted.org/packages/4c/85/ae64e9145f39dd6d14f8af3fa809a270ef3729f3b90b3c0cf5aa242ab0d4/queuelib-1.5.0-py2.py3-none-any.whl
    Collecting zope.interface>=4.1.3 (from Scrapy)
      Downloading https://files.pythonhosted.org/packages/55/9a/1013088df24d6275340cb70a9f56a8188068588a89486407e95601ecb190/zope.interface-5.0.1-cp35-cp35m-manylinux1_x86_64.whl (225kB)
        100% |████████████████████████████████| 235kB 354kB/s 
    Collecting parsel>=1.5.0 (from Scrapy)
      Downloading https://files.pythonhosted.org/packages/86/c8/fc5a2f9376066905dfcca334da2a25842aedfda142c0424722e7c497798b/parsel-1.5.2-py2.py3-none-any.whl
    Collecting PyDispatcher>=2.0.5 (from Scrapy)
      Downloading https://files.pythonhosted.org/packages/cd/37/39aca520918ce1935bea9c356bcbb7ed7e52ad4e31bff9b943dfc8e7115b/PyDispatcher-2.0.5.tar.gz
    Collecting service-identity>=16.0.0 (from Scrapy)
      Downloading https://files.pythonhosted.org/packages/e9/7c/2195b890023e098f9618d43ebc337d83c8b38d414326685339eb024db2f6/service_identity-18.1.0-py2.py3-none-any.whl
    Collecting cssselect>=0.9.1 (from Scrapy)
      Downloading https://files.pythonhosted.org/packages/3b/d4/3b5c17f00cce85b9a1e6f91096e1cc8e8ede2e1be8e96b87ce1ed09e92c5/cssselect-1.1.0-py2.py3-none-any.whl
    Collecting six>=1.4.1 (from w3lib>=1.17.0->Scrapy)
      Using cached https://files.pythonhosted.org/packages/65/eb/1f97cb97bfc2390a276969c6fae16075da282f5058082d4cb10c6c5c1dba/six-1.14.0-py2.py3-none-any.whl
    Collecting cffi!=1.11.3,>=1.8 (from cryptography>=2.0->Scrapy)
      Downloading https://files.pythonhosted.org/packages/d6/7f/7acc85c478f5056b98c9961a31697b1e53fbec158ee5f723097e1c355660/cffi-1.14.0-cp35-cp35m-manylinux1_x86_64.whl (399kB)
        100% |████████████████████████████████| 409kB 222kB/s 
    Collecting incremental>=16.10.1 (from Twisted>=17.9.0->Scrapy)
      Downloading https://files.pythonhosted.org/packages/f5/1d/c98a587dc06e107115cf4a58b49de20b19222c83d75335a192052af4c4b7/incremental-17.5.0-py2.py3-none-any.whl
    Collecting Automat>=0.3.0 (from Twisted>=17.9.0->Scrapy)
      Downloading https://files.pythonhosted.org/packages/dd/83/5f6f3c1a562674d65efc320257bdc0873ec53147835aeef7762fe7585273/Automat-20.2.0-py2.py3-none-any.whl
    Collecting hyperlink>=17.1.1 (from Twisted>=17.9.0->Scrapy)
      Downloading https://files.pythonhosted.org/packages/7f/91/e916ca10a2de1cb7101a9b24da546fb90ee14629e23160086cf3361c4fb8/hyperlink-19.0.0-py2.py3-none-any.whl
    Collecting attrs>=19.2.0 (from Twisted>=17.9.0->Scrapy)
      Downloading https://files.pythonhosted.org/packages/a2/db/4313ab3be961f7a763066401fb77f7748373b6094076ae2bda2806988af6/attrs-19.3.0-py2.py3-none-any.whl
    Collecting constantly>=15.1 (from Twisted>=17.9.0->Scrapy)
      Downloading https://files.pythonhosted.org/packages/b9/65/48c1909d0c0aeae6c10213340ce682db01b48ea900a7d9fce7a7910ff318/constantly-15.1.0-py2.py3-none-any.whl
    Collecting PyHamcrest!=1.10.0,>=1.9.0 (from Twisted>=17.9.0->Scrapy)
      Downloading https://files.pythonhosted.org/packages/40/16/e54cc65891f01cb62893540f44ffd3e8dab0a22443e1b438f1a9f5574bee/PyHamcrest-2.0.2-py3-none-any.whl (52kB)
        100% |████████████████████████████████| 61kB 225kB/s 
    Collecting setuptools (from zope.interface>=4.1.3->Scrapy)
      Downloading https://files.pythonhosted.org/packages/1e/32/69e6ce8502a12af0cdcbb8de91f1cbafd4533f84d8fe17bf712f6200f21b/setuptools-46.1.1-py3-none-any.whl (582kB)
        100% |████████████████████████████████| 583kB 263kB/s 
    Collecting pyasn1-modules (from service-identity>=16.0.0->Scrapy)
      Downloading https://files.pythonhosted.org/packages/95/de/214830a981892a3e286c3794f41ae67a4495df1108c3da8a9f62159b9a9d/pyasn1_modules-0.2.8-py2.py3-none-any.whl (155kB)
        100% |████████████████████████████████| 163kB 228kB/s 
    Collecting pyasn1 (from service-identity>=16.0.0->Scrapy)
      Downloading https://files.pythonhosted.org/packages/62/1e/a94a8d635fa3ce4cfc7f506003548d0a2447ae76fd5ca53932970fe3053f/pyasn1-0.4.8-py2.py3-none-any.whl (77kB)
        100% |████████████████████████████████| 81kB 463kB/s 
    Collecting pycparser (from cffi!=1.11.3,>=1.8->cryptography>=2.0->Scrapy)
      Downloading https://files.pythonhosted.org/packages/ae/e7/d9c3a176ca4b02024debf82342dab36efadfc5776f9c8db077e8f6e71821/pycparser-2.20-py2.py3-none-any.whl (112kB)
        100% |████████████████████████████████| 112kB 340kB/s 
    Collecting idna>=2.5 (from hyperlink>=17.1.1->Twisted>=17.9.0->Scrapy)
      Using cached https://files.pythonhosted.org/packages/89/e3/afebe61c546d18fb1709a61bee788254b40e736cff7271c7de5de2dc4128/idna-2.9-py2.py3-none-any.whl
    Building wheels for collected packages: protego, PyDispatcher
      Running setup.py bdist_wheel for protego ... done
      Stored in directory: /home/cor/.cache/pip/wheels/51/01/d1/4a2286a976dccd025ba679acacfe37320540df0f2283ecab12
      Running setup.py bdist_wheel for PyDispatcher ... done
      Stored in directory: /home/cor/.cache/pip/wheels/88/99/96/cfef6665f9cb1522ee6757ae5955feedf2fe25f1737f91fa7f
    Successfully built protego PyDispatcher
    Installing collected packages: six, w3lib, pycparser, cffi, cryptography, lxml, pyOpenSSL, incremental, attrs, Automat, idna, hyperlink, setuptools, zope.interface, constantly, PyHamcrest, Twisted, protego, queuelib, cssselect, parsel, PyDispatcher, pyasn1, pyasn1-modules, service-identity, Scrapy
    Successfully installed Automat-20.2.0 PyDispatcher-2.0.5 PyHamcrest-2.0.2 Scrapy-2.0.1 Twisted-20.3.0 attrs-19.3.0 cffi-1.14.0 constantly-15.1.0 cryptography-2.8 cssselect-1.1.0 hyperlink-19.0.0 idna-2.9 incremental-17.5.0 lxml-4.5.0 parsel-1.5.2 protego-0.1.16 pyOpenSSL-19.1.0 pyasn1-0.4.8 pyasn1-modules-0.2.8 pycparser-2.20 queuelib-1.5.0 service-identity-18.1.0 setuptools-46.1.1 six-1.14.0 w3lib-1.21.0 zope.interface-5.0.1
    
  • 相关阅读:
    钱多多软件制作04
    团队项目01应用场景
    HDU 4411 arrest
    HDU 4406 GPA
    HDU 3315 My Brute
    HDU 3667 Transportation
    HDU 2676 Matrix
    欧拉回路三水题 POJ 1041 POJ 2230 POJ 1386
    SPOJ 371 BOXES
    POJ 3422 Kaka's Matrix Travels
  • 原文地址:https://www.cnblogs.com/winditsway/p/12560390.html
Copyright © 2011-2022 走看看