1,了解到两个爬虫项目SeimiCrawler 和webmagic:https://www.jianshu.com/p/8147bb0cc026
2,两个项目的gitbub地址:https://github.com/zhegexiaohuozi/SeimiCrawler
https://github.com/code4craft/webmagic
3,又从该网站上https://blog.csdn.net/cpongo3/article/details/89327620了解到gecco,其github地址:
https://github.com/xtuhcy/gecco
详细说明看github说明