zoukankan      html  css  js  c++  java
  • 3.21第5周学习内容总结

    主要是疫情的爬取跟云服务器的配置和学习;

    https://blog.csdn.net/qq_34317125/article/details/80533685  学习别人的博客;

    主要是python的学习,学习怎么爬取数据

    代码的编写量在300行左右;

    import requests
    import time, json
    import sys;
    import pymysql
    
    def get_wangyi_request():
        url = 'https://c.m.163.com/ug/api/wuhan/app/data/list-total'
    
        headers = {
            'accept': '*/*',
            'accept-encoding': 'gzip,deflate,br',
            'accept-language': 'en-US,en;q=0.9,zh-CN;q = 0.8,zh;q = 0.7',
            'origin': 'https://wp.m.163.com',
            'referer': 'https://wp.m.163.com/',
            'sec-fetch-dest': 'empty',
            'sec-fetch-mode': 'cors',
            'sec-fetch-site': 'same-ite',
            'user-agent': 'Mozilla/5.0(WindowsNT10.0;Win64;x64) AppleWebKit/37.36 (KHTML, likeGecko) Chrome/82.0.4056.0 Safari/537.36 Edg/82.0.432.3'
        }
    
        result = requests.get(url, headers=headers)
        return result
    
    
    def print_mess1(string: str, dict1total: dict):
        sys.stdout.write(string + '确诊: ' + str(dict1total['confirm'] if dict1total['confirm'] != None else 0))
        sys.stdout.write(' ')
        sys.stdout.write(string + '疑似: ' + str(dict1total['suspect'] if dict1total['suspect'] != None else 0))
        sys.stdout.write(' ')
        sys.stdout.write(string + '治愈: ' + str(dict1total['heal'] if dict1total['heal'] != None else 0))
        sys.stdout.write(' ')
        sys.stdout.write(string + '死亡: ' + str(dict1total['dead'] if dict1total['dead'] != None else 0))
    
    
    if __name__ == '__main__':
        result = get_wangyi_request()
    
        json_str = json.loads(result.text)['data']
        # print(json_str.keys())
        # dict_keys(['chinaTotal', 'chinaDayList', 'lastUpdateTime', 'areaTree'])
    
        print(json_str['lastUpdateTime'])
        provinae_list = json_str['areaTree'][0]['children']
        # 每个省份包含如下的键
        # dict_keys(['today', 'total', 'extData', 'name', 'id', 'lastUpdateTime', 'children'])
    
        conn = pymysql.connect(
            host='localhost',  # 我的IP地址
            port=3306,  # 不是字符串不需要加引号。
            user='root',
            password='123456',
            db='python',
            charset='utf8'
        )
    
        cursor = conn.cursor()  # 获取一个光标
        id = 1;
        for dict in provinae_list:
            sql = 'insert into yiqing (pronvice,total_confirm,total_suspect,total_heal,total_dead,today_confirm,today_suspect,today_heal,today_dead,id) values (%s,%s,%s,%s,%s,%s,%s,%s,%s,%s);'
            pronvice=dict['name']
            total_confirm=dict['total']['confirm']
            total_suspect=dict['total']['suspect']
            total_heal=dict['total']['heal']
            total_dead=dict['total']['dead']
            today_confirm=dict['today']['confirm']
            today_suspect=dict['today']['suspect']
            today_heal=dict['today']['heal']
            today_dead=dict['today']['dead']
            id=id+1
            sys.stdout.write( dict['name'] + '  ')
            cursor.execute(sql, [pronvice, total_confirm, total_suspect,total_heal,total_dead,today_confirm,today_suspect,today_heal,today_dead,id])
        print()
    
        conn.commit()
    
    
        cursor.close()
        conn.close()
  • 相关阅读:
    windows64系统下安装 redis服务 (详细)
    周期信号的傅里叶级数表示
    LeetCode 36——有效的数独
    LeetCode 3——无重复字符的最长子串
    线性时不变系统的卷积
    信号与系统
    C++ 学习笔记之——输入和输出
    LeetCode 74——搜索二维矩阵
    LeetCode 389——找不同
    LeetCode 2——两数相加
  • 原文地址:https://www.cnblogs.com/1234yyf/p/13032573.html
Copyright © 2011-2022 走看看