1.使用环境为AWS ubuntu 14.04 LTS
2.默认的python版本为2.7.6
3.根据安装指南开始安装环境:
安装LXML: apt-get install libxslt-dev sudo apt-get install python-dev apt-get install zlib1g-dev pip install lxml
安装LXML:
apt-get install libxslt-dev
sudo apt-get install python-dev
apt-get install zlib1g-dev
pip install lxml
4.安装爬虫框架:
pip install Scrapy
安装完毕