zoukankan      html  css  js  c++  java
  • 爬取汽车之家新闻图片的python爬虫代码

    import requests
    from bs4 import BeautifulSoup
    respone=requests.get('https://www.autohome.com.cn/news/')
    respone.encoding='gbk'
    # print(respone.text)

    soup=BeautifulSoup(respone.text,'html.parser')
    div=soup.find(name='div',attrs={'id':'auto-channel-lazyload-article'})
    li_list=div.find_all(name='li')

    i=1
    for li in li_list:
    print('pro:',i)
    title=li.find(name='h3')
    if not title:
    continue
    p=li.find(name='p')
    a=li.find(name='a')
    img=li.find(name='img')

    print(title.text)
    print(p.text)
    print('https:'+a.attrs.get('href'))
    print('https:'+img.get('src')) #img.get==img.attrs.get


    #请求下载图片
    src='https:'+img.get('src')
    file_name=src.rsplit('/',maxsplit=1)[1]
    with open(file_name,'wb') as f:
    ret=requests.get(src)
    f.write(ret.content)
  • 相关阅读:
    10.28
    10.25
    10.21
    移动第七次作业
    移动第六次作业
    移动第五次作业
    移动第四次作业
    移动第3次作业
    移动第二次作业
    移动第一次作业
  • 原文地址:https://www.cnblogs.com/xpptt/p/11772628.html
Copyright © 2011-2022 走看看