机器学习——小白学习Linux（二）爬取并保存图片

代码参考链接：https://www.cnblogs.com/chenyuan404/p/10192758.html

首先进入环境并cd 到指定文件夹下 输入命令【vi food_pic.py】新建food_pic.py文件，进入编辑模式输入代码。输入命令【python food_pic.py】运行代码

分析网站

查看网页源代码

 

 通过正则表达式获取图片链接 re

import requests
import re
from urllib import request


#模拟浏览器获取图片链接
def Get_PIC_list(keyword,max_page):
    all_picture_list = []
    for page in range(max_page):
        page = page *30
        url = 'https://image.baidu.com/search/flip?tn=baiduimage&ie=utf-8&word={}&pn={}'.format(keyword, page)
        html = requests.get(url).content.decode('utf-8')
        picture_list = re.findall('{"thumbURL":"(.*?)",',html)
        all_picture_list.extend(picture_list)

    all_picture_list = set(all_picture_list)
    download_picture(all_picture_list)

#下载图片
def download_picture(all_picture_list):
    for i,pic_url in enumerate(all_picture_list):
        print(i)
        string = 'picture/{}.jpg'.format(str(i + 1))
        request.urlretrieve(pic_url, string)

#开始函数
def start():
    keyword = '美食照片'
    max_page = 2
    Get_PIC_list(keyword,max_page)


if __name__ == '__main__':
    start()