zoukankan      html  css  js  c++  java
  • 综合练习:英文词频统计

    词频统计预处理
    下载一首英文的歌词或文章
    将所有,.?!’:等分隔符全部替换为空格
    将所有大写转换为小写
    生成单词列表
    生成词频统计
    排序
    排除语法型词汇,代词、冠词、连词
    输出词频最大TOP10

    article = '''The capital has opened 33 roads of a total length of 105 kilometers for autonomous1 car testing outside the Fifth Ring Road and away from densely-populated areas on the outskirts2.
    
    According to regulations for managing road testing for self-driving vehicles,autonomous vehicles are eligible3 for public road testing only after they have completed 5,000 kilometers of daily driving in designated closed test fields and passed assessments4.
    
    The test vehicles must be equipped with monitoring devices that can monitor driving behavior,collect vehicle location information and monitor whether a vehicle is in self-driving mode.
    
    Test drivers must have received no less than 50 hours of self-driving training.
    
    Beijing has built its first closed test fields in Haidian District, covering about 13 hectares.
    
    The licenses6 for road testing are valid7 for 30 days and license5 holders8 can apply for renewal9 after self-driving cars pass assessments.
    
    Baidu is developing high-resolution maps for self-driving cars. The first will be based on the 33 roads.'''
    
    
    
    
    sign = ['.',',']
    for i in sign:
        article = article.replace(i, '')
    
    article = article.lower()
    
    article = article.split()
    
    dic = dict(zip())
    
    for i in article:
        dic[i] = article.count(i)
    
    delwords = ["the", "has", "of", "a", "for", "and","away","from","on","to","are","only","have","in","after"]
    
    for i in delwords:
        del dic[i]
    
    newarticle = sorted(dic.items(),key=lambda s:s[1],reverse=True)
    
    for i in range(10):
        print(newarticle[i])

    运行结果截图:

  • 相关阅读:
    MySQL 一般模糊查询的几种用法
    MySQL插入中文数据报错
    BeanUtils.populate 的作用
    分分钟搞定 JSP 技术
    margin-top相对谁的问题
    常用汉字的Unicode码表
    从InputStream到String_写成函数
    Http请求和响应应用
    发布mvc报错:403.14-Forbidden Web 服务器被配置为不列出此目录的内容
    导出到excel
  • 原文地址:https://www.cnblogs.com/xuyizhu/p/8618512.html
Copyright © 2011-2022 走看看