zoukankan      html  css  js  c++  java
  • 团队项目冲刺第四天

    今天做了一些其他的事,爬取了世界疫情情况。之后就可以用echarts图表显示出世界地图疫情显示。

    import json
    import pymysql
    import requests
    from bs4 import BeautifulSoup
    import datetime
    url = 'https://ncov.dxy.cn/ncovh5/view/pneumonia?from=timeline&isappinstalled=0' # 请求地址
    headers = {
    'user-agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/74.0.3729.131 Safari/537.36'} # 创建头部信息
    response = requests.get(url, headers=headers) # 发送网络请求
    content = response.content.decode('utf-8')
    soup = BeautifulSoup(content, 'html.parser')
    # 世界确诊getAreaStat
    listB = soup.find_all(name='script', attrs={"id": "getListByCountryTypeService2true"})
    world_messages = str(listB)[95:-21]
    print(world_messages)
    world_messages_json = json.loads(world_messages)
    worldList = []
    now_time = datetime.datetime.now().strftime('%Y-%m-%d')
    for k in range(len(world_messages_json)):
    worldvalue = (now_time,
    world_messages_json[k].get('countryType'), world_messages_json[k].get('continents'),
    world_messages_json[k].get('provinceId'), world_messages_json[k].get('provinceName'),
    world_messages_json[k].get('provinceShortName'), world_messages_json[k].get('cityName'),
    world_messages_json[k].get('currentConfirmedCount'), world_messages_json[k].get('confirmedCount'),
    world_messages_json[k].get('suspectedCount'), world_messages_json[k].get('curedCount'),
    world_messages_json[k].get('deadCount'), world_messages_json[k].get('locationId'),
    world_messages_json[k].get('countryShortCode'),)
    worldList.append(worldvalue)
    db = pymysql.connect("localhost", "root", "163216", "yiqing", charset='utf8')
    cursor = db.cursor()
    sql_world = "INSERT INTO world_map values (%s,%s,%s,%s,%s,%s,%s,%s,%s,%s,%s,%s,%s,%s)"
    worldTuple = tuple(worldList)
    print(worldTuple)
    try:
    cursor.executemany(sql_world, worldTuple)
    db.commit()
    except:
    print('执行失败,进入回调2')
    db.rollback()

    db.close()
  • 相关阅读:
    Sublime Text 3 绝对神器
    spring 笔记3: Spring 多环境配置文件切换
    elk-logstash: window下指定jdk目录
    通过slf4j/log4j的MDC/NDC 实现日志追踪
    spring 笔记2:Spring MVC : Did not find handler method for 问题的解决
    mysql一机多实例安装记录
    Java:通过反射复制父类字段到子类。
    mybatis研究:select性能对比
    spring " expected single matching bean but found 2" 问题一例。
    数组去重复
  • 原文地址:https://www.cnblogs.com/aiyyue/p/12734701.html
Copyright © 2011-2022 走看看