一：说明
1.项目的整体框架
2.Topology的设计
3.记录
0. 89.201.10.122 - - [1528033390201] "GET /edit.php HTTP/1.1" 200 0 "-" "Mozilla/5.0 (compatible; MSIE 10.0; Windows NT 6.2;Tident/6.0)" "-"
1. 168.214.132.53 - - [1528033393241] "GET /list.php HTTP/1.1" 200 0 "http://www.google.cn/search?q=spark mllib" "Mozilla/5.0 (compatible; MSIE 10.0; Windows NT 6.2;Tident/6.0)" "-"
2. 30.215.30.190 - - [1528033408262] "GET /IBEIfeng.gif?order_id=1&orderTime=1528033408262&memberId=1238569670989878&productInfos=10004-1889.43-A-1|10003-901.07-A-1|10002-2159.20-A-1&orderAmt=4949.70 HTTP/1.1" 200 0 "-" "Mozilla/4.0 (compatible; MSIE 7.0; Windows NT 5.1;Tident/4.0; .NETCLR 2.0.50727)" "-"
4.字段
ip serverTime requestUrl httpRefer userAgent orderInfo
5.分析需求
统计每天，每小时，每分钟 各个IP的访问量
统计每天，每小时，每分钟 被访问的url的次数
统计外链数
解析userAgent获取浏览器操作系统的信息
订单信息