文件方式实现完整的英文词频统计实例

1.读入待分析的字符串

2.分解提取单词 

3.计数字典

4.排除语法型词汇

5.排序

6.输出TOP(20)

crity.txt文件中的内容

Donald Trump was the subject of startlingly strong abuse from major sports stars on Saturday, after he criticised NFL players protesting against racial injustice and withdrew an invitation for the NBA-champion Golden State Warriors to visit the White House, breaking a tradition dating back to the Reagan years.

The Cleveland Cavaliers star forward LeBron James called the president a “bum” while the Buffalo Bills running back LeSean McCoy went further, calling Trump an “asshole”. Even NFL commissioner Roger Goodell saying in a statement: “Divisive comments like Trump’s demonstrate an unfortunate lack of respect for the NFL.”

In their own statement, the Warriors accepted they would not be going to the White House. But they said they would use their trip to Washington in February – they play the Washington Wizards on the 28th of that month – to “celebrate equality, diversity and inclusion”.

On Friday, point guard Steph Curry, the NBA champions’ star player, told reporters he planned to vote no when the players came together to decide whether to visit Trump. The Warriors could “inspire some change” and “send a statement” by snubbing the president, Curry said.

On Saturday morning, Trump tweeted: “Going to the White House is considered a great honor for a championship team, Stephen Curry is hesitating, therefore invitation is withdrawn!”

In a statement issued later, the Warriors said: “While we intended to meet as a team at the first opportunity we had this morning to collaboratively discuss a potential visit to the White House, we accept that President Trump has made it clear that we are not invited.

“We believe there is nothing more American than our citizens having the right to express themselves freely on matters important to them. We’re disappointed that we did not have an opportunity during this process to share our views or have open dialogue on issues we felt would be important to raise.

“In lieu of a visit to the White House, we have decided that we’ll constructively use our trip to the nation’s capital in February to celebrate equality, diversity and inclusion – the values that we embrace as an organization.

# _*_coding:utf-8_*_
# 实例：词频统计
# 打开文件
fr = open('crity.txt','r',encoding= 'utf-8')
str = fr.read()
fr.close()

# 排除元数的集合
exc = {'','a','an','the','in','on','that','and','to','is','of','for','have','not','nfl','said','would'}
# 将，？.！变成空格
x = {',','.','
','  ','?',':','!','，','。','–'}
for i in x:
    str = str.replace(i, ' ')
# 将所有大写转换为小写
str = str.lower()
# 把歌词切片
words = str.split(' ')
# 定义一个空字典
di = {}
# 单词排序
words.sort()
# 用循环，写入字典
disc = set(words)
disc = disc - exc
for i in disc:
    di[i] = words.count(i)
wc = list(di.items())
# print(wc)
wc.sort(key = lambda x:x[1],reverse=True)
# print(wc)
print('{0:-^50}'.format('词频统计结果前20'))
for i in range(20):
    print('{0} = {1}'.format(wc[i][0],wc[i][1]))

运行结果：