统计web服务器类型

现在做web开发肯定离不开web服务器。知道各大网站用的都是什么服务器吗？

今天我就怀着这样一个好奇心写了个搜索web服务器类型的工具，具体代码就不贴了。
程序和代码在这里

主要思路是：

　　向一个网站发送HTTP请求，收到HTTP回复后检测其头部Server的值。

为了实现批量获取，还需要指定一系列网站的URL。

为了偷懒，我就从一个网页开始遍历其中所有的网址，然后获取其服务器类型。

光有数据还不行，还要对数据进行分析。我的策略是只分析服务器大的种类，具体版本就忽略了，这样就可以使用linq进行按服务器类型分组、排序等待

运行结果：

从www.hao123.com开始搜索，前三个用的最多的服务器是Apache(38.64%),nginx(21.36%),Microsoft IIS(17.27%).

然后还可以发现：Apache真的还有很多人用；尽管微软的IIS都有7.5的了，但6.0的IIS依旧还有很多在用。

下面是搜索到的服务器：

  

chexian.pingan.com:
wenku.baidu.com:lighttpd
www.hao123.com:lighttpd
hi.baidu.com:apache 1.1.26.0
www.baidu.com:BWS/1.0
top.baidu.com:Apache
dict.baidu.com:Apache
www.ifeng.com:DnionOS/1.0
www.sohu.com:Apache
www.cntv.cn:Apache
www.hunantv.com:nginx/0.6.35
www.gov.cn:Apache
www.people.com.cn:nginx
www.kaixin001.com:Apache
baike.baidu.com:Apache
www.google.com.hk:gws
utility.hao123.com:Apache
www.zhcw.com:Apache/2.0.63 (Unix) DAV/2
www.sina.com.cn:Apache/2.0.63 (Unix)
www.163.com:nginx
www.youku.com:bjwww
www.autohome.com.cn:Microsoft-IIS/6.0
www.renren.com:nginx/0.7.64
www.xinhuanet.com:Apache
www.eastmoney.com:nginx/0.8.36
www.51seer.com:WS CDN Server
www.ctrip.com:Microsoft-IIS/6.0
youa.baidu.com:Apache
www.58.com:Microsoft-IIS/6.0
www.rayli.com.cn:Apache
www.ganji.com:nginx/0.7.62
www.zhaopin.com:Apache/1.3.29 (Unix) mod_webapp/1.2.0-dev
www.anjuke.com:nginx
www.icbc.com.cn:Microsoft-IIS/6.0
10086.cn:Apache
house.sina.com.cn:Apache/2.0.63 (Unix)
www.pconline.com.cn:DnionOS/1.0
www.zol.com.cn:Apache
www.qq.com:nginx/0.6.39
www.chinahr.com:Microsoft-IIS/6.0
tl.changyou.com:Apache
www.bitauto.com:Microsoft-IIS/6.0
www.qunar.com:nginx/0.7.64
www.lafaso.com:nginx/0.7.61
www.justonline.cn:Apache/2.2.15 (Win32) PHP/5.2.8
www.moonbasa.com:DnionOS/1.0
union.360buy.com:jdws
www.baihe.com:Apache/2.0.59 (Unix)
huangguan.yijia.com:nginx/0.8.34
www.taobao.com:Apache
www.s.cn:nginx/51086858
video.sina.com.cn:nginx/0.5.35
www.lashou.com:Apache/2.2.15 (Unix) mod_ssl/2.2.15 OpenSSL/0.9.8e-fips-rhel5 PHP/5.3.2 DAV/2
www.qiyi.com:nginx
www.letv.com:nginx/0.7.65
jipiao.kuxun.cn:lighttpd
www.letao.com:Microsoft-IIS/6.0
www.m1905.com:nginx/0.7.61
www.elong.com:Microsoft-IIS/6.0
www.mbaobao.com:
www.funshion.com:lighttpd/1.4.22
www.17173.com:Apache
tv.sohu.com:Apache
www.4399.com:Microsoft-IIS/6.0
www.7k7k.com:Microsoft-IIS/6.0
my.91.com:Apache/2.2.6 (Unix)
zt.ztgame.com:DnionOS/1.0
news.sina.com.cn:Apache/2.0.63 (Unix)
dhsh.changyou.com:Apache
news.qq.com:nginx/0.6.39
military.china.com:nginx/0.7.63
mil.news.sina.com.cn:Apache/2.0.63 (Unix)
www.shumenol.com:
war.news.163.com:nginx
news.ifeng.com:DnionOS/1.0
news.sohu.com:Apache/1.3.37 (Unix) mod_gzip/1.3.26.1a
www.china.com.cn:Sun-ONE-Web-Server/6.1
www.warcraftchina.com:Apache
www.tiexue.net:Microsoft-IIS/6.0
www.mod.gov.cn:Apache
han.70yx.com:Microsoft-IIS/6.0
pv.7fgame.com:Microsoft-IIS/6.0
www.amazon.cn:Server
www.qq163.com:Microsoft-IIS/6.0
www.5173.com:Microsoft-IIS/6.0
www.1ting.com:
kok3.ztgame.com:DnionOS/1.0
mail.cn.yahoo.com:
www.aiting.com:Microsoft-IIS/6.0
www.kuwo.cn:nginx/0.6.34
mail.qq.com:TWS
www.qidian.com:Microsoft-IIS/6.0
mp3.baidu.com:apache 1.6.14.0
www.xxsy.net:Microsoft-IIS/6.0
mail.sina.com.cn:Apache/2.2.9 (FreeBSD) mod_ssl/2.2.9 OpenSSL/0.9.7e-p1 PHP/5.2.6 with Suhosin-Patch
home.woool.sdo.com:SNDA CDN Cache Server
act.dn.sdo.com:SNDA CDN Cache Server
www.readnovel.com:
www.jiayuan.com:nginx
email.163.com:Apache
www.126.com:Apache
www.xs8.cn:
www.51mole.com:nginx/CHINACACHE
hua.61.com:nginx/CHINACACHE
www.91wan.com:lighttpd/1.4.26
www.265g.com:Microsoft-IIS/6.0
www.jjwxc.net:Apache
www.3366.com:lighttpd/1.4.20
xiaoyou.qq.com:Apache
www.mop.com:dx136
finance.sina.com.cn:Apache
17roco.com:Apache
r.dangdang.com:nginx/0.6.37
finance.qq.com:nginx/0.6.39
www.hotmail.com:Microsoft-IIS/6.0
www.jrj.com.cn:
www.zhenai.com:Apache
business.sohu.com:SWS
www.pcpop.com:Microsoft-IIS/6.0
www.stockstar.com:nginx/0.7.59
www.tianya.cn:Microsoft-IIS/6.0
www.marry5.com:Apache
tieba.baidu.com:apache 2.7.18.0
www.onlinedown.net:Microsoft-IIS/6.0
www.skycn.com:Apache
www.cmbchina.com:
blog.sina.com.cn:nginx/0.7.62
www.51.com:Apache
blog.163.com:nginx
blog.sohu.com:nginx
www.abchina.com:Microsoft-IIS/7.5,M2
www.ccb.com:Apache
sports.sina.com.cn:Apache
t.sina.com.cn:Apache
sports.sohu.com:SWS
qzone.qq.com:Apache
sports.qq.com:nginx/0.6.39
nba.tom.com:nginx/0.6.32
sports.tom.com:Apache
tech.sina.com.cn:Apache
www.hoopchina.com:[SA: xifan hcw/web-12-10-53

 

chexian.pingan.com
wenku.baidu.com lighttpd
www.hao123.com lighttpd
hi.baidu.com apache 1.1.26.0
www.baidu.com BWS/1.0
top.baidu.com Apache
dict.baidu.com Apache
www.ifeng.com DnionOS/1.0
www.sohu.com Apache
www.cntv.cn Apache
www.hunantv.com nginx/0.6.35
www.gov.cn Apache
www.people.com.cn nginx
www.kaixin001.com Apache
baike.baidu.com Apache
www.google.com.hk gws
utility.hao123.com Apache
www.zhcw.com Apache/2.0.63 (Unix) DAV/2
www.sina.com.cn Apache/2.0.63 (Unix)
www.163.com nginx
www.youku.com bjwww
www.autohome.com.cn Microsoft-IIS/6.0
www.renren.com nginx/0.7.64
www.xinhuanet.com Apache
www.eastmoney.com nginx/0.8.36
www.51seer.com WS CDN Server
www.ctrip.com Microsoft-IIS/6.0
youa.baidu.com Apache
www.58.com Microsoft-IIS/6.0
www.rayli.com.cn Apache
www.ganji.com nginx/0.7.62
www.zhaopin.com Apache/1.3.29 (Unix) mod_webapp/1.2.0-dev
www.anjuke.com nginx
www.icbc.com.cn Microsoft-IIS/6.0
10086.cn Apache
house.sina.com.cn Apache/2.0.63 (Unix)
www.pconline.com.cn DnionOS/1.0
www.zol.com.cn Apache
www.qq.com nginx/0.6.39
www.chinahr.com Microsoft-IIS/6.0
tl.changyou.com Apache
www.bitauto.com Microsoft-IIS/6.0
www.qunar.com nginx/0.7.64
www.lafaso.com nginx/0.7.61
www.justonline.cn Apache/2.2.15 (Win32) PHP/5.2.8
www.moonbasa.com DnionOS/1.0
union.360buy.com jdws
www.baihe.com Apache/2.0.59 (Unix)
huangguan.yijia.com nginx/0.8.34
www.taobao.com Apache
www.s.cn nginx/51086858
video.sina.com.cn nginx/0.5.35
www.lashou.com Apache/2.2.15 (Unix) mod_ssl/2.2.15 OpenSSL/0.9.8e-fips-rhel5 PHP/5.3.2 DAV/2
www.qiyi.com nginx
www.letv.com nginx/0.7.65
jipiao.kuxun.cn lighttpd
www.letao.com Microsoft-IIS/6.0
www.m1905.com nginx/0.7.61
www.elong.com Microsoft-IIS/6.0
www.mbaobao.com
www.funshion.com lighttpd/1.4.22
www.17173.com Apache
tv.sohu.com Apache
www.4399.com Microsoft-IIS/6.0
www.7k7k.com Microsoft-IIS/6.0
my.91.com Apache/2.2.6 (Unix)
zt.ztgame.com DnionOS/1.0
news.sina.com.cn Apache/2.0.63 (Unix)
dhsh.changyou.com Apache
news.qq.com nginx/0.6.39
military.china.com nginx/0.7.63
mil.news.sina.com.cn Apache/2.0.63 (Unix)
www.shumenol.com
war.news.163.com nginx
news.ifeng.com DnionOS/1.0
news.sohu.com Apache/1.3.37 (Unix) mod_gzip/1.3.26.1a
www.china.com.cn Sun-ONE-Web-Server/6.1
www.warcraftchina.com Apache
www.tiexue.net Microsoft-IIS/6.0
www.mod.gov.cn Apache
han.70yx.com Microsoft-IIS/6.0
pv.7fgame.com Microsoft-IIS/6.0
www.amazon.cn Server
www.qq163.com Microsoft-IIS/6.0
www.5173.com Microsoft-IIS/6.0
www.1ting.com
kok3.ztgame.com DnionOS/1.0
mail.cn.yahoo.com
www.aiting.com Microsoft-IIS/6.0
www.kuwo.cn nginx/0.6.34
mail.qq.com TWS
www.qidian.com Microsoft-IIS/6.0
mp3.baidu.com apache 1.6.14.0
www.xxsy.net Microsoft-IIS/6.0
mail.sina.com.cn Apache/2.2.9 (FreeBSD) mod_ssl/2.2.9 OpenSSL/0.9.7e-p1 PHP/5.2.6 with Suhosin-Patch
home.woool.sdo.com SNDA CDN Cache Server
act.dn.sdo.com SNDA CDN Cache Server
www.readnovel.com
www.jiayuan.com nginx
email.163.com Apache
www.126.com Apache
www.xs8.cn
www.51mole.com nginx/CHINACACHE
hua.61.com nginx/CHINACACHE
www.91wan.com lighttpd/1.4.26
www.265g.com Microsoft-IIS/6.0
www.jjwxc.net Apache
www.3366.com lighttpd/1.4.20
xiaoyou.qq.com Apache
www.mop.com dx136
finance.sina.com.cn Apache
17roco.com Apache
r.dangdang.com nginx/0.6.37
finance.qq.com nginx/0.6.39
www.hotmail.com Microsoft-IIS/6.0
www.jrj.com.cn
www.zhenai.com Apache
business.sohu.com SWS
www.pcpop.com Microsoft-IIS/6.0
www.stockstar.com nginx/0.7.59
www.tianya.cn Microsoft-IIS/6.0
www.marry5.com Apache
tieba.baidu.com apache 2.7.18.0
www.onlinedown.net Microsoft-IIS/6.0
www.skycn.com Apache
www.cmbchina.com
blog.sina.com.cn nginx/0.7.62
www.51.com Apache
blog.163.com nginx
blog.sohu.com nginx
www.abchina.com Microsoft-IIS/7.5,M2
www.ccb.com Apache
sports.sina.com.cn Apache
t.sina.com.cn Apache
sports.sohu.com SWS
qzone.qq.com Apache
sports.qq.com nginx/0.6.39
nba.tom.com nginx/0.6.32
sports.tom.com Apache
tech.sina.com.cn Apache
www.hoopchina.com [SA: xifan hcw/web-12-10-53

程序和代码在这里