windows
1.wheel
pip install wheel
2.lxml
http://www.lfd.uci.edu/~gohlke/pythonlibs/#lxml
3.PyOpenssl
https://pypi.python.org/pypi/pyOpenSSL#downloads
4.Wwisted
http://www.lfd.uci.edu/~gohlke/pythonlibs/#twisted
5.Pywin32
https://sourceforge.net/projects/pywin32/files/pywin32/Bu
6.Scrapy
pip install scrapy
centos7
默认python 2.7,支持twisted
首先准备环境
yum install gcc libffi-devel openssl-devel libxml2 libxslt-devel libxml2-devel python-devel -y
安装easy_install
yum install python-setuptools
安装pip
easy_install pip
安装 lxml
easy_install lxml
如果以上都顺利,就开始安装scrapy吧
pip install scrapy