爬虫大佬的网站:https://github.com/01ly
hashlib.md5
重定向:
import requests res = requests.get(url="", headers={}, allow_redirects=False) # 禁止重定向 next_url = res.headers['Location'] # 找到打算重定向的url
============= 自定义 window document
var window = global; window.location = { host: "www.toutiao.com", hostname: "www.toutiao.com", href: "https://www.toutiao.com/", origin: "https://www.toutiao.com", pathname: "", port: "", protocol: "https:", }; window.navigator = { userAgent:'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/83.0.4103.97 Safari/537.36' };
=========== execjs
=========== post请求提交数据
==========js中获取参数
============调用js