Elastic Stack之Logstash
作者：尹正杰
版权声明：原创作品，谢绝转载！否则将追究法律责任。
一.安装web服务器
1>.在一台服务器上单独部署httpd服务
[root@node105 ~]# [root@node105 ~]# yum -y install httpd Loaded plugins: fastestmirror Repodata is over 2 weeks old. Install yum-cron? Or run: yum makecache fast base | 3.6 kB 00:00:00 extras | 3.4 kB 00:00:00 updates | 3.4 kB 00:00:00 (1/2): extras/7/x86_64/primary_db | 180 kB 00:00:00 (2/2): updates/7/x86_64/primary_db | 2.5 MB 00:00:01 Determining fastest mirrors * base: mirrors.cn99.com * extras: mirror.lzu.edu.cn * updates: mirror.lzu.edu.cn Resolving Dependencies --> Running transaction check ---> Package httpd.x86_64 0:2.4.6-88.el7.centos will be installed --> Processing Dependency: httpd-tools = 2.4.6-88.el7.centos for package: httpd-2.4.6-88.el7.centos.x86_64 --> Processing Dependency: /etc/mime.types for package: httpd-2.4.6-88.el7.centos.x86_64 --> Processing Dependency: libaprutil-1.so.0()(64bit) for package: httpd-2.4.6-88.el7.centos.x86_64 --> Processing Dependency: libapr-1.so.0()(64bit) for package: httpd-2.4.6-88.el7.centos.x86_64 --> Running transaction check ---> Package apr.x86_64 0:1.4.8-3.el7_4.1 will be installed ---> Package apr-util.x86_64 0:1.5.2-6.el7 will be installed ---> Package httpd-tools.x86_64 0:2.4.6-88.el7.centos will be installed ---> Package mailcap.noarch 0:2.1.41-2.el7 will be installed --> Finished Dependency Resolution Dependencies Resolved =================================================================================================================================================================================== Package Arch Version Repository Size =================================================================================================================================================================================== Installing: httpd x86_64 2.4.6-88.el7.centos base 2.7 M Installing for dependencies: apr x86_64 1.4.8-3.el7_4.1 base 103 k apr-util x86_64 1.5.2-6.el7 base 92 k httpd-tools x86_64 2.4.6-88.el7.centos base 90 k mailcap noarch 2.1.41-2.el7 base 31 k Transaction Summary =================================================================================================================================================================================== Install 1 Package (+4 Dependent packages) Total download size: 3.0 M Installed size: 10 M Downloading packages: (1/5): apr-util-1.5.2-6.el7.x86_64.rpm | 92 kB 00:00:00 (2/5): apr-1.4.8-3.el7_4.1.x86_64.rpm | 103 kB 00:00:00 (3/5): mailcap-2.1.41-2.el7.noarch.rpm | 31 kB 00:00:00 (4/5): httpd-2.4.6-88.el7.centos.x86_64.rpm | 2.7 MB 00:00:02 (5/5): httpd-tools-2.4.6-88.el7.centos.x86_64.rpm | 90 kB 00:00:02 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Total 1.2 MB/s | 3.0 MB 00:00:02 Running transaction check Running transaction test Transaction test succeeded Running transaction Installing : apr-1.4.8-3.el7_4.1.x86_64 1/5 Installing : apr-util-1.5.2-6.el7.x86_64 2/5 Installing : httpd-tools-2.4.6-88.el7.centos.x86_64 3/5 Installing : mailcap-2.1.41-2.el7.noarch 4/5 Installing : httpd-2.4.6-88.el7.centos.x86_64 5/5 Verifying : httpd-tools-2.4.6-88.el7.centos.x86_64 1/5 Verifying : apr-1.4.8-3.el7_4.1.x86_64 2/5 Verifying : mailcap-2.1.41-2.el7.noarch 3/5 Verifying : httpd-2.4.6-88.el7.centos.x86_64 4/5 Verifying : apr-util-1.5.2-6.el7.x86_64 5/5 Installed: httpd.x86_64 0:2.4.6-88.el7.centos Dependency Installed: apr.x86_64 0:1.4.8-3.el7_4.1 apr-util.x86_64 0:1.5.2-6.el7 httpd-tools.x86_64 0:2.4.6-88.el7.centos mailcap.noarch 0:2.1.41-2.el7 Complete! [root@node105 ~]#
2>.创建测试网页
[root@node105 ~]# [root@node105 ~]# cd /var/www/html/ [root@node105 html]# [root@node105 html]# ls [root@node105 html]# [root@node105 html]# for i in {1..50};do echo "Page $i" > ./test$i.html;done [root@node105 html]# [root@node105 html]# ls test10.html test14.html test18.html test21.html test25.html test29.html test32.html test36.html test3.html test43.html test47.html test50.html test8.html test11.html test15.html test19.html test22.html test26.html test2.html test33.html test37.html test40.html test44.html test48.html test5.html test9.html test12.html test16.html test1.html test23.html test27.html test30.html test34.html test38.html test41.html test45.html test49.html test6.html test13.html test17.html test20.html test24.html test28.html test31.html test35.html test39.html test42.html test46.html test4.html test7.html [root@node105 html]# [root@node105 html]#
3>.修改httpd的配置文件
[root@node105 ~]# cp /etc/httpd/conf/httpd.conf /etc/httpd/conf/httpd.conf-`date +%F` [root@node105 ~]# [root@node105 ~]# [root@node105 ~]# grep LogFormat /etc/httpd/conf/httpd.conf | head -2 #LogFormat "%h %l %u %t "%r" %>s %b "%{Referer}i" "%{User-Agent}i"" combined LogFormat "%{X-Forwarded-For}i %l %u %t "%r" %>s %b "%{Referer}i" "%{User-Agent}i"" combined [root@node105 ~]# [root@node105 ~]#
4>.启动httpd服务
root@node105 ~]# [root@node105 ~]# [root@node105 ~]# systemctl start httpd [root@node105 ~]# [root@node105 ~]# systemctl enable httpd Created symlink from /etc/systemd/system/multi-user.target.wants/httpd.service to /usr/lib/systemd/system/httpd.service. [root@node105 ~]# [root@node105 ~]# [root@node105 ~]# systemctl status httpd ● httpd.service - The Apache HTTP Server Loaded: loaded (/usr/lib/systemd/system/httpd.service; enabled; vendor preset: disabled) Active: active (running) since Sun 2019-03-10 23:28:10 CST; 9s ago Docs: man:httpd(8) man:apachectl(8) Main PID: 2653 (httpd) Status: "Total requests: 0; Current requests/sec: 0; Current traffic: 0 B/sec" CGroup: /system.slice/httpd.service ├─2653 /usr/sbin/httpd -DFOREGROUND ├─2654 /usr/sbin/httpd -DFOREGROUND ├─2655 /usr/sbin/httpd -DFOREGROUND ├─2656 /usr/sbin/httpd -DFOREGROUND ├─2657 /usr/sbin/httpd -DFOREGROUND └─2658 /usr/sbin/httpd -DFOREGROUND Mar 10 23:28:10 node105.yinzhengjie.org.cn systemd[1]: Starting The Apache HTTP Server... Mar 10 23:28:10 node105.yinzhengjie.org.cn httpd[2653]: AH00557: httpd: apr_sockaddr_info_get() failed for node105.yinzhengjie.org.cn Mar 10 23:28:10 node105.yinzhengjie.org.cn httpd[2653]: AH00558: httpd: Could not reliably determine the server's fully qualified domain name, using 127.0.0.1. Set th...is message Mar 10 23:28:10 node105.yinzhengjie.org.cn systemd[1]: Started The Apache HTTP Server. Hint: Some lines were ellipsized, use -l to show in full. [root@node105 ~]# [root@node105 ~]# [root@node105 ~]# [root@node105 ~]# [root@node105 ~]# systemctl stop firewalld [root@node105 ~]# [root@node105 ~]# systemctl disable firewalld Removed symlink /etc/systemd/system/dbus-org.fedoraproject.FirewallD1.service. Removed symlink /etc/systemd/system/basic.target.wants/firewalld.service. [root@node105 ~]# [root@node105 ~]# [root@node105 ~]# setenforce 0 [root@node105 ~]# [root@node105 ~]# sed -i s'#SELINUX=enforcing#SELINUX=disabled#' /etc/sysconfig/selinux [root@node105 ~]# [root@node105 ~]#
5>.模拟不同的客户端访问httpd服务器
[root@node103 ~]# [root@node103 ~]# while true; do curl -H "X-Forwarded-For:$[$RANDOM%223+1].$[$RANDOM%255].1.1" http://node105.yinzhengjie.org.cn/test$[$RANDOM%50+1].html;sleep 1;done Page 32 Page 28 Page 18 Page 46 Page 27 Page 18 Page 41 Page 37 Page 12 Page 12 Page 26 Page 15 Page 6 Page 25 Page 13 Page 35 Page 15 Page 36 Page 1 Page 28 Page 13 Page 48 Page 30 Page 26 Page 31 Page 30 Page 12 Page 34 Page 50 Page 35 Page 19 Page 32 Page 41 Page 36 Page 8 Page 29 Page 42 ^C [root@node103 ~]#
[root@node105 ~]# tail -10f /var/log/httpd/access_log 24.243.1.1 - - [10/Mar/2019:23:37:07 +0800] "GET /test17.html HTTP/1.1" 200 8 "-" "curl/7.29.0" 8.56.1.1 - - [10/Mar/2019:23:38:54 +0800] "GET /test32.html HTTP/1.1" 200 8 "-" "curl/7.29.0" 160.210.1.1 - - [10/Mar/2019:23:38:55 +0800] "GET /test28.html HTTP/1.1" 200 8 "-" "curl/7.29.0" 140.113.1.1 - - [10/Mar/2019:23:38:56 +0800] "GET /test18.html HTTP/1.1" 200 8 "-" "curl/7.29.0" 176.163.1.1 - - [10/Mar/2019:23:38:57 +0800] "GET /test46.html HTTP/1.1" 200 8 "-" "curl/7.29.0" 104.174.1.1 - - [10/Mar/2019:23:38:58 +0800] "GET /test27.html HTTP/1.1" 200 8 "-" "curl/7.29.0" 137.0.1.1 - - [10/Mar/2019:23:38:59 +0800] "GET /test18.html HTTP/1.1" 200 8 "-" "curl/7.29.0" 114.55.1.1 - - [10/Mar/2019:23:39:00 +0800] "GET /test41.html HTTP/1.1" 200 8 "-" "curl/7.29.0" 103.106.1.1 - - [10/Mar/2019:23:39:01 +0800] "GET /test37.html HTTP/1.1" 200 8 "-" "curl/7.29.0" 80.42.1.1 - - [10/Mar/2019:23:39:02 +0800] "GET /test12.html HTTP/1.1" 200 8 "-" "curl/7.29.0" 184.43.1.1 - - [10/Mar/2019:23:39:03 +0800] "GET /test12.html HTTP/1.1" 200 8 "-" "curl/7.29.0" 92.169.1.1 - - [10/Mar/2019:23:39:04 +0800] "GET /test26.html HTTP/1.1" 200 8 "-" "curl/7.29.0" 165.68.1.1 - - [10/Mar/2019:23:39:05 +0800] "GET /test15.html HTTP/1.1" 200 8 "-" "curl/7.29.0" 150.171.1.1 - - [10/Mar/2019:23:39:06 +0800] "GET /test6.html HTTP/1.1" 200 7 "-" "curl/7.29.0" 161.124.1.1 - - [10/Mar/2019:23:39:07 +0800] "GET /test25.html HTTP/1.1" 200 8 "-" "curl/7.29.0" 208.131.1.1 - - [10/Mar/2019:23:39:08 +0800] "GET /test13.html HTTP/1.1" 200 8 "-" "curl/7.29.0" 217.250.1.1 - - [10/Mar/2019:23:39:09 +0800] "GET /test35.html HTTP/1.1" 200 8 "-" "curl/7.29.0" 28.228.1.1 - - [10/Mar/2019:23:39:10 +0800] "GET /test15.html HTTP/1.1" 200 8 "-" "curl/7.29.0" 5.106.1.1 - - [10/Mar/2019:23:39:11 +0800] "GET /test36.html HTTP/1.1" 200 8 "-" "curl/7.29.0" 88.40.1.1 - - [10/Mar/2019:23:39:12 +0800] "GET /test1.html HTTP/1.1" 200 7 "-" "curl/7.29.0" 178.123.1.1 - - [10/Mar/2019:23:39:13 +0800] "GET /test28.html HTTP/1.1" 200 8 "-" "curl/7.29.0" 71.162.1.1 - - [10/Mar/2019:23:39:14 +0800] "GET /test13.html HTTP/1.1" 200 8 "-" "curl/7.29.0" 124.37.1.1 - - [10/Mar/2019:23:39:15 +0800] "GET /test48.html HTTP/1.1" 200 8 "-" "curl/7.29.0" 79.129.1.1 - - [10/Mar/2019:23:39:16 +0800] "GET /test30.html HTTP/1.1" 200 8 "-" "curl/7.29.0" 20.197.1.1 - - [10/Mar/2019:23:39:17 +0800] "GET /test26.html HTTP/1.1" 200 8 "-" "curl/7.29.0" 144.246.1.1 - - [10/Mar/2019:23:39:18 +0800] "GET /test31.html HTTP/1.1" 200 8 "-" "curl/7.29.0" 144.62.1.1 - - [10/Mar/2019:23:39:19 +0800] "GET /test30.html HTTP/1.1" 200 8 "-" "curl/7.29.0" 56.115.1.1 - - [10/Mar/2019:23:39:20 +0800] "GET /test12.html HTTP/1.1" 200 8 "-" "curl/7.29.0" 220.121.1.1 - - [10/Mar/2019:23:39:21 +0800] "GET /test34.html HTTP/1.1" 200 8 "-" "curl/7.29.0" 51.20.1.1 - - [10/Mar/2019:23:39:22 +0800] "GET /test50.html HTTP/1.1" 200 8 "-" "curl/7.29.0" 136.100.1.1 - - [10/Mar/2019:23:39:23 +0800] "GET /test35.html HTTP/1.1" 200 8 "-" "curl/7.29.0" 133.173.1.1 - - [10/Mar/2019:23:39:24 +0800] "GET /test19.html HTTP/1.1" 200 8 "-" "curl/7.29.0" 88.221.1.1 - - [10/Mar/2019:23:39:25 +0800] "GET /test32.html HTTP/1.1" 200 8 "-" "curl/7.29.0" 142.38.1.1 - - [10/Mar/2019:23:39:26 +0800] "GET /test41.html HTTP/1.1" 200 8 "-" "curl/7.29.0" 156.208.1.1 - - [10/Mar/2019:23:39:27 +0800] "GET /test36.html HTTP/1.1" 200 8 "-" "curl/7.29.0" 48.138.1.1 - - [10/Mar/2019:23:39:28 +0800] "GET /test8.html HTTP/1.1" 200 7 "-" "curl/7.29.0" ^C [root@node105 ~]#
二.安装Logstash客户端
1>.访问logstash官方网址（https://www.elastic.co/cn/downloads/logstash）
2>.下载和elasticsearch版本一致的logstash（https://www.elastic.co/downloads/past-releases）
root@node105 ~]# [root@node105 ~]# wget https://artifacts.elastic.co/downloads/logstash/logstash-5.6.12.rpm --2019-03-10 23:45:42-- https://artifacts.elastic.co/downloads/logstash/logstash-5.6.12.rpm Resolving artifacts.elastic.co (artifacts.elastic.co)... 151.101.230.222, 2a04:4e42:1a::734 Connecting to artifacts.elastic.co (artifacts.elastic.co)|151.101.230.222|:443... connected. HTTP request sent, awaiting response... 200 OK Length: 105333923 (100M) [application/octet-stream] Saving to: ‘logstash-5.6.12.rpm’ 100%[====================================================================================================================================================================================================================================>] 105,333,923 473KB/s in 4m 50s 2019-03-10 23:50:37 (355 KB/s) - ‘logstash-5.6.12.rpm’ saved [105333923/105333923] [root@node105 ~]#
3>.安装jdk环境
[root@node105 ~]# yum -y install java-1.8.0-openjdk Loaded plugins: fastestmirror Loading mirror speeds from cached hostfile * base: mirrors.cn99.com * extras: mirror.lzu.edu.cn * updates: mirror.lzu.edu.cn Resolving Dependencies --> Running transaction check ---> Package java-1.8.0-openjdk.x86_64 1:1.8.0.201.b09-2.el7_6 will be installed --> Processing Dependency: java-1.8.0-openjdk-headless(x86-64) = 1:1.8.0.201.b09-2.el7_6 for package: 1:java-1.8.0-openjdk-1.8.0.201.b09-2.el7_6.x86_64 --> Processing Dependency: xorg-x11-fonts-Type1 for package: 1:java-1.8.0-openjdk-1.8.0.201.b09-2.el7_6.x86_64 --> Processing Dependency: libpng15.so.15(PNG15_0)(64bit) for package: 1:java-1.8.0-openjdk-1.8.0.201.b09-2.el7_6.x86_64 --> Processing Dependency: libjvm.so(SUNWprivate_1.1)(64bit) for package: 1:java-1.8.0-openjdk-1.8.0.201.b09-2.el7_6.x86_64 --> Processing Dependency: libjpeg.so.62(LIBJPEG_6.2)(64bit) for package: 1:java-1.8.0-openjdk-1.8.0.201.b09-2.el7_6.x86_64 --> Processing Dependency: libjava.so(SUNWprivate_1.1)(64bit) for package: 1:java-1.8.0-openjdk-1.8.0.201.b09-2.el7_6.x86_64 --> Processing Dependency: libXcomposite(x86-64) for package: 1:java-1.8.0-openjdk-1.8.0.201.b09-2.el7_6.x86_64 --> Processing Dependency: gtk2(x86-64) for package: 1:java-1.8.0-openjdk-1.8.0.201.b09-2.el7_6.x86_64 --> Processing Dependency: fontconfig(x86-64) for package: 1:java-1.8.0-openjdk-1.8.0.201.b09-2.el7_6.x86_64 --> Processing Dependency: libpng15.so.15()(64bit) for package: 1:java-1.8.0-openjdk-1.8.0.201.b09-2.el7_6.x86_64 --> Processing Dependency: libjvm.so()(64bit) for package: 1:java-1.8.0-openjdk-1.8.0.201.b09-2.el7_6.x86_64 --> Processing Dependency: libjpeg.so.62()(64bit) for package: 1:java-1.8.0-openjdk-1.8.0.201.b09-2.el7_6.x86_64 --> Processing Dependency: libjava.so()(64bit) for package: 1:java-1.8.0-openjdk-1.8.0.201.b09-2.el7_6.x86_64 --> Processing Dependency: libgif.so.4()(64bit) for package: 1:java-1.8.0-openjdk-1.8.0.201.b09-2.el7_6.x86_64 --> Processing Dependency: libXtst.so.6()(64bit) for package: 1:java-1.8.0-openjdk-1.8.0.201.b09-2.el7_6.x86_64 --> Processing Dependency: libXrender.so.1()(64bit) for package: 1:java-1.8.0-openjdk-1.8.0.201.b09-2.el7_6.x86_64 --> Processing Dependency: libXi.so.6()(64bit) for package: 1:java-1.8.0-openjdk-1.8.0.201.b09-2.el7_6.x86_64 --> Processing Dependency: libXext.so.6()(64bit) for package: 1:java-1.8.0-openjdk-1.8.0.201.b09-2.el7_6.x86_64 --> Processing Dependency: libX11.so.6()(64bit) for package: 1:java-1.8.0-openjdk-1.8.0.201.b09-2.el7_6.x86_64 --> Running transaction check ---> Package fontconfig.x86_64 0:2.13.0-4.3.el7 will be installed --> Processing Dependency: freetype >= 2.8-7 for package: fontconfig-2.13.0-4.3.el7.x86_64 --> Processing Dependency: fontpackages-filesystem for package: fontconfig-2.13.0-4.3.el7.x86_64 --> Processing Dependency: dejavu-sans-fonts for package: fontconfig-2.13.0-4.3.el7.x86_64 ---> Package giflib.x86_64 0:4.1.6-9.el7 will be installed --> Processing Dependency: libSM.so.6()(64bit) for package: giflib-4.1.6-9.el7.x86_64 --> Processing Dependency: libICE.so.6()(64bit) for package: giflib-4.1.6-9.el7.x86_64 ---> Package gtk2.x86_64 0:2.24.31-1.el7 will be installed --> Processing Dependency: pango >= 1.20.0-1 for package: gtk2-2.24.31-1.el7.x86_64 --> Processing Dependency: libtiff >= 3.6.1 for package: gtk2-2.24.31-1.el7.x86_64 --> Processing Dependency: libXrandr >= 1.2.99.4-2 for package: gtk2-2.24.31-1.el7.x86_64 --> Processing Dependency: atk >= 1.29.4-2 for package: gtk2-2.24.31-1.el7.x86_64 --> Processing Dependency: hicolor-icon-theme for package: gtk2-2.24.31-1.el7.x86_64 --> Processing Dependency: gtk-update-icon-cache for package: gtk2-2.24.31-1.el7.x86_64 --> Processing Dependency: libpangoft2-1.0.so.0()(64bit) for package: gtk2-2.24.31-1.el7.x86_64 --> Processing Dependency: libpangocairo-1.0.so.0()(64bit) for package: gtk2-2.24.31-1.el7.x86_64 --> Processing Dependency: libpango-1.0.so.0()(64bit) for package: gtk2-2.24.31-1.el7.x86_64 --> Processing Dependency: libgdk_pixbuf-2.0.so.0()(64bit) for package: gtk2-2.24.31-1.el7.x86_64 --> Processing Dependency: libcups.so.2()(64bit) for package: gtk2-2.24.31-1.el7.x86_64 --> Processing Dependency: libcairo.so.2()(64bit) for package: gtk2-2.24.31-1.el7.x86_64 --> Processing Dependency: libatk-1.0.so.0()(64bit) for package: gtk2-2.24.31-1.el7.x86_64 --> Processing Dependency: libXrandr.so.2()(64bit) for package: gtk2-2.24.31-1.el7.x86_64 --> Processing Dependency: libXinerama.so.1()(64bit) for package: gtk2-2.24.31-1.el7.x86_64 --> Processing Dependency: libXfixes.so.3()(64bit) for package: gtk2-2.24.31-1.el7.x86_64 --> Processing Dependency: libXdamage.so.1()(64bit) for package: gtk2-2.24.31-1.el7.x86_64 --> Processing Dependency: libXcursor.so.1()(64bit) for package: gtk2-2.24.31-1.el7.x86_64 ---> Package java-1.8.0-openjdk-headless.x86_64 1:1.8.0.201.b09-2.el7_6 will be installed --> Processing Dependency: tzdata-java >= 2015d for package: 1:java-1.8.0-openjdk-headless-1.8.0.201.b09-2.el7_6.x86_64 --> Processing Dependency: nss-softokn(x86-64) >= 3.36.0 for package: 1:java-1.8.0-openjdk-headless-1.8.0.201.b09-2.el7_6.x86_64 --> Processing Dependency: nss(x86-64) >= 3.36.0 for package: 1:java-1.8.0-openjdk-headless-1.8.0.201.b09-2.el7_6.x86_64 --> Processing Dependency: copy-jdk-configs >= 3.3 for package: 1:java-1.8.0-openjdk-headless-1.8.0.201.b09-2.el7_6.x86_64 --> Processing Dependency: chkconfig >= 1.7 for package: 1:java-1.8.0-openjdk-headless-1.8.0.201.b09-2.el7_6.x86_64 --> Processing Dependency: chkconfig >= 1.7 for package: 1:java-1.8.0-openjdk-headless-1.8.0.201.b09-2.el7_6.x86_64 --> Processing Dependency: pcsc-lite-libs(x86-64) for package: 1:java-1.8.0-openjdk-headless-1.8.0.201.b09-2.el7_6.x86_64 --> Processing Dependency: lksctp-tools(x86-64) for package: 1:java-1.8.0-openjdk-headless-1.8.0.201.b09-2.el7_6.x86_64 --> Processing Dependency: jpackage-utils for package: 1:java-1.8.0-openjdk-headless-1.8.0.201.b09-2.el7_6.x86_64 ---> Package libX11.x86_64 0:1.6.5-2.el7 will be installed --> Processing Dependency: libX11-common >= 1.6.5-2.el7 for package: libX11-1.6.5-2.el7.x86_64 --> Processing Dependency: libxcb.so.1()(64bit) for package: libX11-1.6.5-2.el7.x86_64 ---> Package libXcomposite.x86_64 0:0.4.4-4.1.el7 will be installed ---> Package libXext.x86_64 0:1.3.3-3.el7 will be installed ---> Package libXi.x86_64 0:1.7.9-1.el7 will be installed ---> Package libXrender.x86_64 0:0.9.10-1.el7 will be installed ---> Package libXtst.x86_64 0:1.2.3-1.el7 will be installed ---> Package libjpeg-turbo.x86_64 0:1.2.90-6.el7 will be installed ---> Package libpng.x86_64 2:1.5.13-7.el7_2 will be installed ---> Package xorg-x11-fonts-Type1.noarch 0:7.5-9.el7 will be installed --> Processing Dependency: ttmkfdir for package: xorg-x11-fonts-Type1-7.5-9.el7.noarch --> Processing Dependency: ttmkfdir for package: xorg-x11-fonts-Type1-7.5-9.el7.noarch --> Processing Dependency: mkfontdir for package: xorg-x11-fonts-Type1-7.5-9.el7.noarch --> Processing Dependency: mkfontdir for package: xorg-x11-fonts-Type1-7.5-9.el7.noarch --> Running transaction check ---> Package atk.x86_64 0:2.28.1-1.el7 will be installed ---> Package cairo.x86_64 0:1.15.12-3.el7 will be installed --> Processing Dependency: libpixman-1.so.0()(64bit) for package: cairo-1.15.12-3.el7.x86_64 --> Processing Dependency: libGL.so.1()(64bit) for package: cairo-1.15.12-3.el7.x86_64 --> Processing Dependency: libEGL.so.1()(64bit) for package: cairo-1.15.12-3.el7.x86_64 ---> Package chkconfig.x86_64 0:1.3.61-5.el7 will be updated ---> Package chkconfig.x86_64 0:1.7.4-1.el7 will be an update ---> Package copy-jdk-configs.noarch 0:3.3-10.el7_5 will be installed ---> Package cups-libs.x86_64 1:1.6.3-35.el7 will be installed ---> Package dejavu-sans-fonts.noarch 0:2.33-6.el7 will be installed --> Processing Dependency: dejavu-fonts-common = 2.33-6.el7 for package: dejavu-sans-fonts-2.33-6.el7.noarch ---> Package fontpackages-filesystem.noarch 0:1.44-8.el7 will be installed ---> Package freetype.x86_64 0:2.4.11-11.el7 will be updated ---> Package freetype.x86_64 0:2.8-12.el7_6.1 will be an update ---> Package gdk-pixbuf2.x86_64 0:2.36.12-3.el7 will be installed --> Processing Dependency: glib2(x86-64) >= 2.48.0 for package: gdk-pixbuf2-2.36.12-3.el7.x86_64 --> Processing Dependency: libjasper.so.1()(64bit) for package: gdk-pixbuf2-2.36.12-3.el7.x86_64 ---> Package gtk-update-icon-cache.x86_64 0:3.22.30-3.el7 will be installed ---> Package hicolor-icon-theme.noarch 0:0.12-7.el7 will be installed ---> Package javapackages-tools.noarch 0:3.4.1-11.el7 will be installed --> Processing Dependency: python-javapackages = 3.4.1-11.el7 for package: javapackages-tools-3.4.1-11.el7.noarch --> Processing Dependency: libxslt for package: javapackages-tools-3.4.1-11.el7.noarch ---> Package libICE.x86_64 0:1.0.9-9.el7 will be installed ---> Package libSM.x86_64 0:1.2.2-2.el7 will be installed ---> Package libX11-common.noarch 0:1.6.5-2.el7 will be installed ---> Package libXcursor.x86_64 0:1.1.15-1.el7 will be installed ---> Package libXdamage.x86_64 0:1.1.4-4.1.el7 will be installed ---> Package libXfixes.x86_64 0:5.0.3-1.el7 will be installed ---> Package libXinerama.x86_64 0:1.1.3-2.1.el7 will be installed ---> Package libXrandr.x86_64 0:1.5.1-2.el7 will be installed ---> Package libtiff.x86_64 0:4.0.3-27.el7_3 will be installed --> Processing Dependency: libjbig.so.2.0()(64bit) for package: libtiff-4.0.3-27.el7_3.x86_64 ---> Package libxcb.x86_64 0:1.13-1.el7 will be installed --> Processing Dependency: libXau.so.6()(64bit) for package: libxcb-1.13-1.el7.x86_64 ---> Package lksctp-tools.x86_64 0:1.0.17-2.el7 will be installed ---> Package nss.x86_64 0:3.19.1-18.el7 will be updated --> Processing Dependency: nss = 3.19.1-18.el7 for package: nss-sysinit-3.19.1-18.el7.x86_64 --> Processing Dependency: nss(x86-64) = 3.19.1-18.el7 for package: nss-tools-3.19.1-18.el7.x86_64 ---> Package nss.x86_64 0:3.36.0-7.1.el7_6 will be an update --> Processing Dependency: nss-util >= 3.36.0-1.1 for package: nss-3.36.0-7.1.el7_6.x86_64 --> Processing Dependency: nspr >= 4.19.0 for package: nss-3.36.0-7.1.el7_6.x86_64 --> Processing Dependency: nss-pem(x86-64) for package: nss-3.36.0-7.1.el7_6.x86_64 --> Processing Dependency: libnssutil3.so(NSSUTIL_3.31)(64bit) for package: nss-3.36.0-7.1.el7_6.x86_64 --> Processing Dependency: libnssutil3.so(NSSUTIL_3.24)(64bit) for package: nss-3.36.0-7.1.el7_6.x86_64 --> Processing Dependency: libnssutil3.so(NSSUTIL_3.21)(64bit) for package: nss-3.36.0-7.1.el7_6.x86_64 ---> Package nss-softokn.x86_64 0:3.16.2.3-13.el7_1 will be updated ---> Package nss-softokn.x86_64 0:3.36.0-5.el7_5 will be an update --> Processing Dependency: nss-softokn-freebl(x86-64) >= 3.36.0-5.el7_5 for package: nss-softokn-3.36.0-5.el7_5.x86_64 ---> Package pango.x86_64 0:1.42.4-1.el7 will be installed --> Processing Dependency: libthai(x86-64) >= 0.1.9 for package: pango-1.42.4-1.el7.x86_64 --> Processing Dependency: libXft(x86-64) >= 2.0.0 for package: pango-1.42.4-1.el7.x86_64 --> Processing Dependency: harfbuzz(x86-64) >= 1.4.2 for package: pango-1.42.4-1.el7.x86_64 --> Processing Dependency: fribidi(x86-64) >= 1.0 for package: pango-1.42.4-1.el7.x86_64 --> Processing Dependency: libthai.so.0(LIBTHAI_0.1)(64bit) for package: pango-1.42.4-1.el7.x86_64 --> Processing Dependency: libthai.so.0()(64bit) for package: pango-1.42.4-1.el7.x86_64 --> Processing Dependency: libharfbuzz.so.0()(64bit) for package: pango-1.42.4-1.el7.x86_64 --> Processing Dependency: libfribidi.so.0()(64bit) for package: pango-1.42.4-1.el7.x86_64 --> Processing Dependency: libXft.so.2()(64bit) for package: pango-1.42.4-1.el7.x86_64 ---> Package pcsc-lite-libs.x86_64 0:1.8.8-8.el7 will be installed ---> Package ttmkfdir.x86_64 0:3.0.9-42.el7 will be installed ---> Package tzdata-java.noarch 0:2018i-1.el7 will be installed ---> Package xorg-x11-font-utils.x86_64 1:7.5-21.el7 will be installed --> Processing Dependency: libfontenc.so.1()(64bit) for package: 1:xorg-x11-font-utils-7.5-21.el7.x86_64 --> Running transaction check ---> Package dejavu-fonts-common.noarch 0:2.33-6.el7 will be installed ---> Package fribidi.x86_64 0:1.0.2-1.el7 will be installed ---> Package glib2.x86_64 0:2.42.2-5.el7 will be updated ---> Package glib2.x86_64 0:2.56.1-2.el7 will be an update ---> Package harfbuzz.x86_64 0:1.7.5-2.el7 will be installed --> Processing Dependency: libgraphite2.so.3()(64bit) for package: harfbuzz-1.7.5-2.el7.x86_64 ---> Package jasper-libs.x86_64 0:1.900.1-33.el7 will be installed ---> Package jbigkit-libs.x86_64 0:2.0-11.el7 will be installed ---> Package libXau.x86_64 0:1.0.8-2.1.el7 will be installed ---> Package libXft.x86_64 0:2.3.2-2.el7 will be installed ---> Package libfontenc.x86_64 0:1.1.3-3.el7 will be installed ---> Package libglvnd-egl.x86_64 1:1.0.1-0.8.git5baa1e5.el7 will be installed --> Processing Dependency: libglvnd(x86-64) = 1:1.0.1-0.8.git5baa1e5.el7 for package: 1:libglvnd-egl-1.0.1-0.8.git5baa1e5.el7.x86_64 --> Processing Dependency: mesa-libEGL(x86-64) >= 13.0.4-1 for package: 1:libglvnd-egl-1.0.1-0.8.git5baa1e5.el7.x86_64 --> Processing Dependency: libGLdispatch.so.0()(64bit) for package: 1:libglvnd-egl-1.0.1-0.8.git5baa1e5.el7.x86_64 ---> Package libglvnd-glx.x86_64 1:1.0.1-0.8.git5baa1e5.el7 will be installed --> Processing Dependency: mesa-libGL(x86-64) >= 13.0.4-1 for package: 1:libglvnd-glx-1.0.1-0.8.git5baa1e5.el7.x86_64 ---> Package libthai.x86_64 0:0.1.14-9.el7 will be installed ---> Package libxslt.x86_64 0:1.1.28-5.el7 will be installed ---> Package nspr.x86_64 0:4.10.8-2.el7_1 will be updated ---> Package nspr.x86_64 0:4.19.0-1.el7_5 will be an update ---> Package nss-pem.x86_64 0:1.0.3-5.el7 will be installed ---> Package nss-softokn-freebl.x86_64 0:3.16.2.3-13.el7_1 will be updated ---> Package nss-softokn-freebl.x86_64 0:3.36.0-5.el7_5 will be an update ---> Package nss-sysinit.x86_64 0:3.19.1-18.el7 will be updated ---> Package nss-sysinit.x86_64 0:3.36.0-7.1.el7_6 will be an update ---> Package nss-tools.x86_64 0:3.19.1-18.el7 will be updated ---> Package nss-tools.x86_64 0:3.36.0-7.1.el7_6 will be an update ---> Package nss-util.x86_64 0:3.19.1-4.el7_1 will be updated ---> Package nss-util.x86_64 0:3.36.0-1.1.el7_6 will be an update ---> Package pixman.x86_64 0:0.34.0-1.el7 will be installed ---> Package python-javapackages.noarch 0:3.4.1-11.el7 will be installed --> Processing Dependency: python-lxml for package: python-javapackages-3.4.1-11.el7.noarch --> Running transaction check ---> Package graphite2.x86_64 0:1.3.10-1.el7_3 will be installed ---> Package libglvnd.x86_64 1:1.0.1-0.8.git5baa1e5.el7 will be installed ---> Package mesa-libEGL.x86_64 0:18.0.5-4.el7_6 will be installed --> Processing Dependency: mesa-libgbm = 18.0.5-4.el7_6 for package: mesa-libEGL-18.0.5-4.el7_6.x86_64 --> Processing Dependency: libxshmfence.so.1()(64bit) for package: mesa-libEGL-18.0.5-4.el7_6.x86_64 --> Processing Dependency: libwayland-server.so.0()(64bit) for package: mesa-libEGL-18.0.5-4.el7_6.x86_64 --> Processing Dependency: libwayland-client.so.0()(64bit) for package: mesa-libEGL-18.0.5-4.el7_6.x86_64 --> Processing Dependency: libglapi.so.0()(64bit) for package: mesa-libEGL-18.0.5-4.el7_6.x86_64 --> Processing Dependency: libgbm.so.1()(64bit) for package: mesa-libEGL-18.0.5-4.el7_6.x86_64 ---> Package mesa-libGL.x86_64 0:18.0.5-4.el7_6 will be installed --> Processing Dependency: libdrm >= 2.4.83 for package: mesa-libGL-18.0.5-4.el7_6.x86_64 --> Processing Dependency: libXxf86vm.so.1()(64bit) for package: mesa-libGL-18.0.5-4.el7_6.x86_64 ---> Package python-lxml.x86_64 0:3.2.1-4.el7 will be installed --> Running transaction check ---> Package libXxf86vm.x86_64 0:1.1.4-1.el7 will be installed ---> Package libdrm.x86_64 0:2.4.60-3.el7 will be updated ---> Package libdrm.x86_64 0:2.4.91-3.el7 will be an update ---> Package libwayland-client.x86_64 0:1.15.0-1.el7 will be installed ---> Package libwayland-server.x86_64 0:1.15.0-1.el7 will be installed ---> Package libxshmfence.x86_64 0:1.2-1.el7 will be installed ---> Package mesa-libgbm.x86_64 0:18.0.5-4.el7_6 will be installed ---> Package mesa-libglapi.x86_64 0:18.0.5-4.el7_6 will be installed --> Finished Dependency Resolution Dependencies Resolved =================================================================================================================================================================================== Package Arch Version Repository Size =================================================================================================================================================================================== Installing: java-1.8.0-openjdk x86_64 1:1.8.0.201.b09-2.el7_6 updates 260 k Installing for dependencies: atk x86_64 2.28.1-1.el7 base 263 k cairo x86_64 1.15.12-3.el7 base 741 k copy-jdk-configs noarch 3.3-10.el7_5 base 21 k cups-libs x86_64 1:1.6.3-35.el7 base 357 k dejavu-fonts-common noarch 2.33-6.el7 base 64 k dejavu-sans-fonts noarch 2.33-6.el7 base 1.4 M fontconfig x86_64 2.13.0-4.3.el7 base 254 k fontpackages-filesystem noarch 1.44-8.el7 base 9.9 k fribidi x86_64 1.0.2-1.el7 base 79 k gdk-pixbuf2 x86_64 2.36.12-3.el7 base 570 k giflib x86_64 4.1.6-9.el7 base 40 k graphite2 x86_64 1.3.10-1.el7_3 base 115 k gtk-update-icon-cache x86_64 3.22.30-3.el7 base 28 k gtk2 x86_64 2.24.31-1.el7 base 3.4 M harfbuzz x86_64 1.7.5-2.el7 base 267 k hicolor-icon-theme noarch 0.12-7.el7 base 42 k jasper-libs x86_64 1.900.1-33.el7 base 150 k java-1.8.0-openjdk-headless x86_64 1:1.8.0.201.b09-2.el7_6 updates 32 M javapackages-tools noarch 3.4.1-11.el7 base 73 k jbigkit-libs x86_64 2.0-11.el7 base 46 k libICE x86_64 1.0.9-9.el7 base 66 k libSM x86_64 1.2.2-2.el7 base 39 k libX11 x86_64 1.6.5-2.el7 base 606 k libX11-common noarch 1.6.5-2.el7 base 164 k libXau x86_64 1.0.8-2.1.el7 base 29 k libXcomposite x86_64 0.4.4-4.1.el7 base 22 k libXcursor x86_64 1.1.15-1.el7 base 30 k libXdamage x86_64 1.1.4-4.1.el7 base 20 k libXext x86_64 1.3.3-3.el7 base 39 k libXfixes x86_64 5.0.3-1.el7 base 18 k libXft x86_64 2.3.2-2.el7 base 58 k libXi x86_64 1.7.9-1.el7 base 40 k libXinerama x86_64 1.1.3-2.1.el7 base 14 k libXrandr x86_64 1.5.1-2.el7 base 27 k libXrender x86_64 0.9.10-1.el7 base 26 k libXtst x86_64 1.2.3-1.el7 base 20 k libXxf86vm x86_64 1.1.4-1.el7 base 18 k libfontenc x86_64 1.1.3-3.el7 base 31 k libglvnd x86_64 1:1.0.1-0.8.git5baa1e5.el7 base 89 k libglvnd-egl x86_64 1:1.0.1-0.8.git5baa1e5.el7 base 44 k libglvnd-glx x86_64 1:1.0.1-0.8.git5baa1e5.el7 base 125 k libjpeg-turbo x86_64 1.2.90-6.el7 base 134 k libpng x86_64 2:1.5.13-7.el7_2 base 213 k libthai x86_64 0.1.14-9.el7 base 187 k libtiff x86_64 4.0.3-27.el7_3 base 170 k libwayland-client x86_64 1.15.0-1.el7 base 33 k libwayland-server x86_64 1.15.0-1.el7 base 39 k libxcb x86_64 1.13-1.el7 base 214 k libxshmfence x86_64 1.2-1.el7 base 7.2 k libxslt x86_64 1.1.28-5.el7 base 242 k lksctp-tools x86_64 1.0.17-2.el7 base 88 k mesa-libEGL x86_64 18.0.5-4.el7_6 updates 102 k mesa-libGL x86_64 18.0.5-4.el7_6 updates 162 k mesa-libgbm x86_64 18.0.5-4.el7_6 updates 38 k mesa-libglapi x86_64 18.0.5-4.el7_6 updates 44 k nss-pem x86_64 1.0.3-5.el7 base 74 k pango x86_64 1.42.4-1.el7 base 280 k pcsc-lite-libs x86_64 1.8.8-8.el7 base 34 k pixman x86_64 0.34.0-1.el7 base 248 k python-javapackages noarch 3.4.1-11.el7 base 31 k python-lxml x86_64 3.2.1-4.el7 base 758 k ttmkfdir x86_64 3.0.9-42.el7 base 48 k tzdata-java noarch 2018i-1.el7 updates 187 k xorg-x11-font-utils x86_64 1:7.5-21.el7 base 104 k xorg-x11-fonts-Type1 noarch 7.5-9.el7 base 521 k Updating for dependencies: chkconfig x86_64 1.7.4-1.el7 base 181 k freetype x86_64 2.8-12.el7_6.1 updates 380 k glib2 x86_64 2.56.1-2.el7 base 2.5 M libdrm x86_64 2.4.91-3.el7 base 153 k nspr x86_64 4.19.0-1.el7_5 base 127 k nss x86_64 3.36.0-7.1.el7_6 updates 835 k nss-softokn x86_64 3.36.0-5.el7_5 base 315 k nss-softokn-freebl x86_64 3.36.0-5.el7_5 base 222 k nss-sysinit x86_64 3.36.0-7.1.el7_6 updates 62 k nss-tools x86_64 3.36.0-7.1.el7_6 updates 515 k nss-util x86_64 3.36.0-1.1.el7_6 updates 78 k Transaction Summary =================================================================================================================================================================================== Install 1 Package (+65 Dependent packages) Upgrade ( 11 Dependent packages) Total download size: 50 M Downloading packages: Delta RPMs disabled because /usr/bin/applydeltarpm not installed. (1/77): atk-2.28.1-1.el7.x86_64.rpm | 263 kB 00:00:00 (2/77): dejavu-fonts-common-2.33-6.el7.noarch.rpm | 64 kB 00:00:00 (3/77): copy-jdk-configs-3.3-10.el7_5.noarch.rpm | 21 kB 00:00:00 (4/77): cups-libs-1.6.3-35.el7.x86_64.rpm | 357 kB 00:00:00 (5/77): fontpackages-filesystem-1.44-8.el7.noarch.rpm | 9.9 kB 00:00:00 (6/77): dejavu-sans-fonts-2.33-6.el7.noarch.rpm | 1.4 MB 00:00:00 (7/77): freetype-2.8-12.el7_6.1.x86_64.rpm | 380 kB 00:00:00 (8/77): fribidi-1.0.2-1.el7.x86_64.rpm | 79 kB 00:00:00 (9/77): giflib-4.1.6-9.el7.x86_64.rpm | 40 kB 00:00:00 (10/77): gdk-pixbuf2-2.36.12-3.el7.x86_64.rpm | 570 kB 00:00:00 (11/77): graphite2-1.3.10-1.el7_3.x86_64.rpm | 115 kB 00:00:00 (12/77): gtk-update-icon-cache-3.22.30-3.el7.x86_64.rpm | 28 kB 00:00:00 (13/77): cairo-1.15.12-3.el7.x86_64.rpm | 741 kB 00:00:02 (14/77): harfbuzz-1.7.5-2.el7.x86_64.rpm | 267 kB 00:00:00 (15/77): hicolor-icon-theme-0.12-7.el7.noarch.rpm | 42 kB 00:00:00 (16/77): glib2-2.56.1-2.el7.x86_64.rpm | 2.5 MB 00:00:01 (17/77): java-1.8.0-openjdk-1.8.0.201.b09-2.el7_6.x86_64.rpm | 260 kB 00:00:00 (18/77): gtk2-2.24.31-1.el7.x86_64.rpm | 3.4 MB 00:00:01 (19/77): jasper-libs-1.900.1-33.el7.x86_64.rpm | 150 kB 00:00:01 (20/77): jbigkit-libs-2.0-11.el7.x86_64.rpm | 46 kB 00:00:00 (21/77): javapackages-tools-3.4.1-11.el7.noarch.rpm | 73 kB 00:00:00 (22/77): libICE-1.0.9-9.el7.x86_64.rpm | 66 kB 00:00:00 (23/77): libSM-1.2.2-2.el7.x86_64.rpm | 39 kB 00:00:00 (24/77): libX11-common-1.6.5-2.el7.noarch.rpm | 164 kB 00:00:00 (25/77): libXau-1.0.8-2.1.el7.x86_64.rpm | 29 kB 00:00:00 (26/77): libXcomposite-0.4.4-4.1.el7.x86_64.rpm | 22 kB 00:00:00 (27/77): libX11-1.6.5-2.el7.x86_64.rpm | 606 kB 00:00:00 (28/77): libXdamage-1.1.4-4.1.el7.x86_64.rpm | 20 kB 00:00:00 (29/77): libXcursor-1.1.15-1.el7.x86_64.rpm | 30 kB 00:00:00 (30/77): libXext-1.3.3-3.el7.x86_64.rpm | 39 kB 00:00:00 (31/77): libXft-2.3.2-2.el7.x86_64.rpm | 58 kB 00:00:00 (32/77): libXi-1.7.9-1.el7.x86_64.rpm | 40 kB 00:00:00 (33/77): libXfixes-5.0.3-1.el7.x86_64.rpm | 18 kB 00:00:00 (34/77): libXinerama-1.1.3-2.1.el7.x86_64.rpm | 14 kB 00:00:00 (35/77): libXrender-0.9.10-1.el7.x86_64.rpm | 26 kB 00:00:00 (36/77): libXrandr-1.5.1-2.el7.x86_64.rpm | 27 kB 00:00:00 (37/77): libXtst-1.2.3-1.el7.x86_64.rpm | 20 kB 00:00:00 (38/77): libXxf86vm-1.1.4-1.el7.x86_64.rpm | 18 kB 00:00:00 (39/77): libdrm-2.4.91-3.el7.x86_64.rpm | 153 kB 00:00:00 (40/77): libglvnd-1.0.1-0.8.git5baa1e5.el7.x86_64.rpm | 89 kB 00:00:00 (41/77): libfontenc-1.1.3-3.el7.x86_64.rpm | 31 kB 00:00:00 (42/77): libglvnd-egl-1.0.1-0.8.git5baa1e5.el7.x86_64.rpm | 44 kB 00:00:00 (43/77): libjpeg-turbo-1.2.90-6.el7.x86_64.rpm | 134 kB 00:00:00 (44/77): libglvnd-glx-1.0.1-0.8.git5baa1e5.el7.x86_64.rpm | 125 kB 00:00:00 (45/77): libpng-1.5.13-7.el7_2.x86_64.rpm | 213 kB 00:00:00 (46/77): libthai-0.1.14-9.el7.x86_64.rpm | 187 kB 00:00:00 (47/77): libtiff-4.0.3-27.el7_3.x86_64.rpm | 170 kB 00:00:00 (48/77): libwayland-client-1.15.0-1.el7.x86_64.rpm | 33 kB 00:00:00 (49/77): libxcb-1.13-1.el7.x86_64.rpm | 214 kB 00:00:00 (50/77): libwayland-server-1.15.0-1.el7.x86_64.rpm | 39 kB 00:00:00 (51/77): libxshmfence-1.2-1.el7.x86_64.rpm | 7.2 kB 00:00:00 (52/77): lksctp-tools-1.0.17-2.el7.x86_64.rpm | 88 kB 00:00:00 (53/77): libxslt-1.1.28-5.el7.x86_64.rpm | 242 kB 00:00:00 (54/77): mesa-libGL-18.0.5-4.el7_6.x86_64.rpm | 162 kB 00:00:00 (55/77): mesa-libgbm-18.0.5-4.el7_6.x86_64.rpm | 38 kB 00:00:00 (56/77): mesa-libglapi-18.0.5-4.el7_6.x86_64.rpm | 44 kB 00:00:00 (57/77): mesa-libEGL-18.0.5-4.el7_6.x86_64.rpm | 102 kB 00:00:00 (58/77): nspr-4.19.0-1.el7_5.x86_64.rpm | 127 kB 00:00:00 (59/77): nss-pem-1.0.3-5.el7.x86_64.rpm | 74 kB 00:00:00 (60/77): nss-3.36.0-7.1.el7_6.x86_64.rpm | 835 kB 00:00:00 (61/77): fontconfig-2.13.0-4.3.el7.x86_64.rpm | 254 kB 00:00:06 (62/77): nss-softokn-freebl-3.36.0-5.el7_5.x86_64.rpm | 222 kB 00:00:00 (63/77): nss-sysinit-3.36.0-7.1.el7_6.x86_64.rpm | 62 kB 00:00:00 (64/77): nss-softokn-3.36.0-5.el7_5.x86_64.rpm | 315 kB 00:00:00 (65/77): nss-util-3.36.0-1.1.el7_6.x86_64.rpm | 78 kB 00:00:00 (66/77): pcsc-lite-libs-1.8.8-8.el7.x86_64.rpm | 34 kB 00:00:00 (67/77): pango-1.42.4-1.el7.x86_64.rpm | 280 kB 00:00:00 (68/77): python-javapackages-3.4.1-11.el7.noarch.rpm | 31 kB 00:00:00 (69/77): pixman-0.34.0-1.el7.x86_64.rpm | 248 kB 00:00:00 (70/77): nss-tools-3.36.0-7.1.el7_6.x86_64.rpm | 515 kB 00:00:00 (71/77): ttmkfdir-3.0.9-42.el7.x86_64.rpm | 48 kB 00:00:00 (72/77): xorg-x11-font-utils-7.5-21.el7.x86_64.rpm | 104 kB 00:00:00 (73/77): tzdata-java-2018i-1.el7.noarch.rpm | 187 kB 00:00:00 (74/77): python-lxml-3.2.1-4.el7.x86_64.rpm | 758 kB 00:00:00 (75/77): xorg-x11-fonts-Type1-7.5-9.el7.noarch.rpm | 521 kB 00:00:00 (76/77): java-1.8.0-openjdk-headless-1.8.0.201.b09-2.el7_6.x86_64.rpm | 32 MB 00:00:17 chkconfig-1.7.4-1.el7.x86_64.r FAILED http://mirrors.shu.edu.cn/centos/7.6.1810/os/x86_64/Packages/chkconfig-1.7.4-1.el7.x86_64.rpm: [Errno 14] curl#7 - "Failed connect to mirrors.shu.edu.cn:80; Connection refused"TA Trying other mirror. (77/77): chkconfig-1.7.4-1.el7.x86_64.rpm | 181 kB 00:00:00 ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- Total 2.3 MB/s | 50 MB 00:00:21 Running transaction check Running transaction test Transaction test succeeded Running transaction Updating : nspr-4.19.0-1.el7_5.x86_64 1/88 Updating : nss-util-3.36.0-1.1.el7_6.x86_64 2/88 Updating : glib2-2.56.1-2.el7.x86_64 3/88 Installing : libjpeg-turbo-1.2.90-6.el7.x86_64 4/88 Installing : 2:libpng-1.5.13-7.el7_2.x86_64 5/88 Updating : freetype-2.8-12.el7_6.1.x86_64 6/88 Updating : libdrm-2.4.91-3.el7.x86_64 7/88 Installing : mesa-libglapi-18.0.5-4.el7_6.x86_64 8/88 Installing : 1:cups-libs-1.6.3-35.el7.x86_64 9/88 Installing : 1:libglvnd-1.0.1-0.8.git5baa1e5.el7.x86_64 10/88 Installing : libxshmfence-1.2-1.el7.x86_64 11/88 Installing : libxslt-1.1.28-5.el7.x86_64 12/88 Installing : fontpackages-filesystem-1.44-8.el7.noarch 13/88 Installing : libICE-1.0.9-9.el7.x86_64 14/88 Updating : chkconfig-1.7.4-1.el7.x86_64 15/88 Installing : libwayland-server-1.15.0-1.el7.x86_64 16/88 Installing : mesa-libgbm-18.0.5-4.el7_6.x86_64 17/88 Installing : libSM-1.2.2-2.el7.x86_64 18/88 Installing : dejavu-fonts-common-2.33-6.el7.noarch 19/88 Installing : dejavu-sans-fonts-2.33-6.el7.noarch 20/88 Installing : fontconfig-2.13.0-4.3.el7.x86_64 21/88 Installing : python-lxml-3.2.1-4.el7.x86_64 22/88 Installing : python-javapackages-3.4.1-11.el7.noarch 23/88 Installing : javapackages-tools-3.4.1-11.el7.noarch 24/88 Installing : ttmkfdir-3.0.9-42.el7.x86_64 25/88 Installing : jasper-libs-1.900.1-33.el7.x86_64 26/88 Installing : atk-2.28.1-1.el7.x86_64 27/88 Updating : nss-softokn-freebl-3.36.0-5.el7_5.x86_64 28/88 Updating : nss-softokn-3.36.0-5.el7_5.x86_64 29/88 Updating : nss-sysinit-3.36.0-7.1.el7_6.x86_64 30/88 Installing : nss-pem-1.0.3-5.el7.x86_64 31/88 Updating : nss-3.36.0-7.1.el7_6.x86_64 32/88 Installing : libfontenc-1.1.3-3.el7.x86_64 33/88 Installing : 1:xorg-x11-font-utils-7.5-21.el7.x86_64 34/88 Installing : xorg-x11-fonts-Type1-7.5-9.el7.noarch 35/88 Installing : jbigkit-libs-2.0-11.el7.x86_64 36/88 Installing : libtiff-4.0.3-27.el7_3.x86_64 37/88 Installing : libthai-0.1.14-9.el7.x86_64 38/88 Installing : copy-jdk-configs-3.3-10.el7_5.noarch 39/88 Installing : hicolor-icon-theme-0.12-7.el7.noarch 40/88 Installing : libX11-common-1.6.5-2.el7.noarch 41/88 Installing : graphite2-1.3.10-1.el7_3.x86_64 42/88 Installing : harfbuzz-1.7.5-2.el7.x86_64 43/88 Installing : pixman-0.34.0-1.el7.x86_64 44/88 Installing : tzdata-java-2018i-1.el7.noarch 45/88 Installing : libXau-1.0.8-2.1.el7.x86_64 46/88 Installing : libxcb-1.13-1.el7.x86_64 47/88 Installing : libX11-1.6.5-2.el7.x86_64 48/88 Installing : libXext-1.3.3-3.el7.x86_64 49/88 Installing : libXrender-0.9.10-1.el7.x86_64 50/88 Installing : libXfixes-5.0.3-1.el7.x86_64 51/88 Installing : libXi-1.7.9-1.el7.x86_64 52/88 Installing : libXdamage-1.1.4-4.1.el7.x86_64 53/88 Installing : libXcomposite-0.4.4-4.1.el7.x86_64 54/88 Installing : gdk-pixbuf2-2.36.12-3.el7.x86_64 55/88 Installing : gtk-update-icon-cache-3.22.30-3.el7.x86_64 56/88 Installing : libXtst-1.2.3-1.el7.x86_64 57/88 Installing : libXcursor-1.1.15-1.el7.x86_64 58/88 Installing : libXrandr-1.5.1-2.el7.x86_64 59/88 Installing : libXft-2.3.2-2.el7.x86_64 60/88 Installing : libXinerama-1.1.3-2.1.el7.x86_64 61/88 Installing : libXxf86vm-1.1.4-1.el7.x86_64 62/88 Installing : 1:libglvnd-glx-1.0.1-0.8.git5baa1e5.el7.x86_64 63/88 Installing : mesa-libGL-18.0.5-4.el7_6.x86_64 64/88 Installing : giflib-4.1.6-9.el7.x86_64 65/88 Installing : pcsc-lite-libs-1.8.8-8.el7.x86_64 66/88 Installing : lksctp-tools-1.0.17-2.el7.x86_64 67/88 Installing : 1:java-1.8.0-openjdk-headless-1.8.0.201.b09-2.el7_6.x86_64 68/88 Installing : fribidi-1.0.2-1.el7.x86_64 69/88 Installing : libwayland-client-1.15.0-1.el7.x86_64 70/88 Installing : 1:libglvnd-egl-1.0.1-0.8.git5baa1e5.el7.x86_64 71/88 Installing : mesa-libEGL-18.0.5-4.el7_6.x86_64 72/88 Installing : cairo-1.15.12-3.el7.x86_64 73/88 Installing : pango-1.42.4-1.el7.x86_64 74/88 Installing : gtk2-2.24.31-1.el7.x86_64 75/88 Installing : 1:java-1.8.0-openjdk-1.8.0.201.b09-2.el7_6.x86_64 76/88 Updating : nss-tools-3.36.0-7.1.el7_6.x86_64 77/88 Cleanup : nss-tools-3.19.1-18.el7.x86_64 78/88 Cleanup : nss-sysinit-3.19.1-18.el7.x86_64 79/88 Cleanup : nss-3.19.1-18.el7.x86_64 80/88 Cleanup : nss-softokn-3.16.2.3-13.el7_1.x86_64 81/88 Cleanup : nss-util-3.19.1-4.el7_1.x86_64 82/88 Cleanup : nspr-4.10.8-2.el7_1.x86_64 83/88 Cleanup : nss-softokn-freebl-3.16.2.3-13.el7_1.x86_64 84/88 Cleanup : chkconfig-1.3.61-5.el7.x86_64 85/88 Cleanup : libdrm-2.4.60-3.el7.x86_64 86/88 Cleanup : freetype-2.4.11-11.el7.x86_64 87/88 Cleanup : glib2-2.42.2-5.el7.x86_64 88/88 Verifying : libXext-1.3.3-3.el7.x86_64 1/88 Verifying : libXi-1.7.9-1.el7.x86_64 2/88 Verifying : libXrender-0.9.10-1.el7.x86_64 3/88 Verifying : 1:xorg-x11-font-utils-7.5-21.el7.x86_64 4/88 Verifying : libwayland-server-1.15.0-1.el7.x86_64 5/88 Verifying : python-lxml-3.2.1-4.el7.x86_64 6/88 Verifying : mesa-libgbm-18.0.5-4.el7_6.x86_64 7/88 Verifying : 2:libpng-1.5.13-7.el7_2.x86_64 8/88 Verifying : pango-1.42.4-1.el7.x86_64 9/88 Verifying : libwayland-client-1.15.0-1.el7.x86_64 10/88 Verifying : python-javapackages-3.4.1-11.el7.noarch 11/88 Verifying : libXcomposite-0.4.4-4.1.el7.x86_64 12/88 Verifying : fribidi-1.0.2-1.el7.x86_64 13/88 Verifying : lksctp-tools-1.0.17-2.el7.x86_64 14/88 Verifying : mesa-libGL-18.0.5-4.el7_6.x86_64 15/88 Verifying : dejavu-sans-fonts-2.33-6.el7.noarch 16/88 Verifying : pcsc-lite-libs-1.8.8-8.el7.x86_64 17/88 Verifying : cairo-1.15.12-3.el7.x86_64 18/88 Verifying : libXau-1.0.8-2.1.el7.x86_64 19/88 Verifying : chkconfig-1.7.4-1.el7.x86_64 20/88 Verifying : libICE-1.0.9-9.el7.x86_64 21/88 Verifying : giflib-4.1.6-9.el7.x86_64 22/88 Verifying : nss-tools-3.36.0-7.1.el7_6.x86_64 23/88 Verifying : tzdata-java-2018i-1.el7.noarch 24/88 Verifying : nss-sysinit-3.36.0-7.1.el7_6.x86_64 25/88 Verifying : libXtst-1.2.3-1.el7.x86_64 26/88 Verifying : nss-3.36.0-7.1.el7_6.x86_64 27/88 Verifying : pixman-0.34.0-1.el7.x86_64 28/88 Verifying : javapackages-tools-3.4.1-11.el7.noarch 29/88 Verifying : nss-softokn-3.36.0-5.el7_5.x86_64 30/88 Verifying : 1:libglvnd-egl-1.0.1-0.8.git5baa1e5.el7.x86_64 31/88 Verifying : jasper-libs-1.900.1-33.el7.x86_64 32/88 Verifying : graphite2-1.3.10-1.el7_3.x86_64 33/88 Verifying : libX11-common-1.6.5-2.el7.noarch 34/88 Verifying : libXfixes-5.0.3-1.el7.x86_64 35/88 Verifying : libtiff-4.0.3-27.el7_3.x86_64 36/88 Verifying : fontconfig-2.13.0-4.3.el7.x86_64 37/88 Verifying : gdk-pixbuf2-2.36.12-3.el7.x86_64 38/88 Verifying : 1:libglvnd-glx-1.0.1-0.8.git5baa1e5.el7.x86_64 39/88 Verifying : libXcursor-1.1.15-1.el7.x86_64 40/88 Verifying : 1:java-1.8.0-openjdk-headless-1.8.0.201.b09-2.el7_6.x86_64 41/88 Verifying : fontpackages-filesystem-1.44-8.el7.noarch 42/88 Verifying : ttmkfdir-3.0.9-42.el7.x86_64 43/88 Verifying : libjpeg-turbo-1.2.90-6.el7.x86_64 44/88 Verifying : hicolor-icon-theme-0.12-7.el7.noarch 45/88 Verifying : glib2-2.56.1-2.el7.x86_64 46/88 Verifying : copy-jdk-configs-3.3-10.el7_5.noarch 47/88 Verifying : harfbuzz-1.7.5-2.el7.x86_64 48/88 Verifying : libxslt-1.1.28-5.el7.x86_64 49/88 Verifying : libXrandr-1.5.1-2.el7.x86_64 50/88 Verifying : atk-2.28.1-1.el7.x86_64 51/88 Verifying : 1:java-1.8.0-openjdk-1.8.0.201.b09-2.el7_6.x86_64 52/88 Verifying : libxshmfence-1.2-1.el7.x86_64 53/88 Verifying : nss-softokn-freebl-3.36.0-5.el7_5.x86_64 54/88 Verifying : libSM-1.2.2-2.el7.x86_64 55/88 Verifying : nspr-4.19.0-1.el7_5.x86_64 56/88 Verifying : freetype-2.8-12.el7_6.1.x86_64 57/88 Verifying : libXdamage-1.1.4-4.1.el7.x86_64 58/88 Verifying : mesa-libglapi-18.0.5-4.el7_6.x86_64 59/88 Verifying : libXinerama-1.1.3-2.1.el7.x86_64 60/88 Verifying : libXxf86vm-1.1.4-1.el7.x86_64 61/88 Verifying : gtk2-2.24.31-1.el7.x86_64 62/88 Verifying : nss-util-3.36.0-1.1.el7_6.x86_64 63/88 Verifying : gtk-update-icon-cache-3.22.30-3.el7.x86_64 64/88 Verifying : nss-pem-1.0.3-5.el7.x86_64 65/88 Verifying : dejavu-fonts-common-2.33-6.el7.noarch 66/88 Verifying : libthai-0.1.14-9.el7.x86_64 67/88 Verifying : 1:libglvnd-1.0.1-0.8.git5baa1e5.el7.x86_64 68/88 Verifying : libxcb-1.13-1.el7.x86_64 69/88 Verifying : libXft-2.3.2-2.el7.x86_64 70/88 Verifying : mesa-libEGL-18.0.5-4.el7_6.x86_64 71/88 Verifying : xorg-x11-fonts-Type1-7.5-9.el7.noarch 72/88 Verifying : libX11-1.6.5-2.el7.x86_64 73/88 Verifying : libdrm-2.4.91-3.el7.x86_64 74/88 Verifying : jbigkit-libs-2.0-11.el7.x86_64 75/88 Verifying : 1:cups-libs-1.6.3-35.el7.x86_64 76/88 Verifying : libfontenc-1.1.3-3.el7.x86_64 77/88 Verifying : libdrm-2.4.60-3.el7.x86_64 78/88 Verifying : nss-util-3.19.1-4.el7_1.x86_64 79/88 Verifying : nss-tools-3.19.1-18.el7.x86_64 80/88 Verifying : nss-softokn-3.16.2.3-13.el7_1.x86_64 81/88 Verifying : nss-sysinit-3.19.1-18.el7.x86_64 82/88 Verifying : glib2-2.42.2-5.el7.x86_64 83/88 Verifying : chkconfig-1.3.61-5.el7.x86_64 84/88 Verifying : freetype-2.4.11-11.el7.x86_64 85/88 Verifying : nss-3.19.1-18.el7.x86_64 86/88 Verifying : nss-softokn-freebl-3.16.2.3-13.el7_1.x86_64 87/88 Verifying : nspr-4.10.8-2.el7_1.x86_64 88/88 Installed: java-1.8.0-openjdk.x86_64 1:1.8.0.201.b09-2.el7_6 Dependency Installed: atk.x86_64 0:2.28.1-1.el7 cairo.x86_64 0:1.15.12-3.el7 copy-jdk-configs.noarch 0:3.3-10.el7_5 cups-libs.x86_64 1:1.6.3-35.el7 dejavu-fonts-common.noarch 0:2.33-6.el7 dejavu-sans-fonts.noarch 0:2.33-6.el7 fontconfig.x86_64 0:2.13.0-4.3.el7 fontpackages-filesystem.noarch 0:1.44-8.el7 fribidi.x86_64 0:1.0.2-1.el7 gdk-pixbuf2.x86_64 0:2.36.12-3.el7 giflib.x86_64 0:4.1.6-9.el7 graphite2.x86_64 0:1.3.10-1.el7_3 gtk-update-icon-cache.x86_64 0:3.22.30-3.el7 gtk2.x86_64 0:2.24.31-1.el7 harfbuzz.x86_64 0:1.7.5-2.el7 hicolor-icon-theme.noarch 0:0.12-7.el7 jasper-libs.x86_64 0:1.900.1-33.el7 java-1.8.0-openjdk-headless.x86_64 1:1.8.0.201.b09-2.el7_6 javapackages-tools.noarch 0:3.4.1-11.el7 jbigkit-libs.x86_64 0:2.0-11.el7 libICE.x86_64 0:1.0.9-9.el7 libSM.x86_64 0:1.2.2-2.el7 libX11.x86_64 0:1.6.5-2.el7 libX11-common.noarch 0:1.6.5-2.el7 libXau.x86_64 0:1.0.8-2.1.el7 libXcomposite.x86_64 0:0.4.4-4.1.el7 libXcursor.x86_64 0:1.1.15-1.el7 libXdamage.x86_64 0:1.1.4-4.1.el7 libXext.x86_64 0:1.3.3-3.el7 libXfixes.x86_64 0:5.0.3-1.el7 libXft.x86_64 0:2.3.2-2.el7 libXi.x86_64 0:1.7.9-1.el7 libXinerama.x86_64 0:1.1.3-2.1.el7 libXrandr.x86_64 0:1.5.1-2.el7 libXrender.x86_64 0:0.9.10-1.el7 libXtst.x86_64 0:1.2.3-1.el7 libXxf86vm.x86_64 0:1.1.4-1.el7 libfontenc.x86_64 0:1.1.3-3.el7 libglvnd.x86_64 1:1.0.1-0.8.git5baa1e5.el7 libglvnd-egl.x86_64 1:1.0.1-0.8.git5baa1e5.el7 libglvnd-glx.x86_64 1:1.0.1-0.8.git5baa1e5.el7 libjpeg-turbo.x86_64 0:1.2.90-6.el7 libpng.x86_64 2:1.5.13-7.el7_2 libthai.x86_64 0:0.1.14-9.el7 libtiff.x86_64 0:4.0.3-27.el7_3 libwayland-client.x86_64 0:1.15.0-1.el7 libwayland-server.x86_64 0:1.15.0-1.el7 libxcb.x86_64 0:1.13-1.el7 libxshmfence.x86_64 0:1.2-1.el7 libxslt.x86_64 0:1.1.28-5.el7 lksctp-tools.x86_64 0:1.0.17-2.el7 mesa-libEGL.x86_64 0:18.0.5-4.el7_6 mesa-libGL.x86_64 0:18.0.5-4.el7_6 mesa-libgbm.x86_64 0:18.0.5-4.el7_6 mesa-libglapi.x86_64 0:18.0.5-4.el7_6 nss-pem.x86_64 0:1.0.3-5.el7 pango.x86_64 0:1.42.4-1.el7 pcsc-lite-libs.x86_64 0:1.8.8-8.el7 pixman.x86_64 0:0.34.0-1.el7 python-javapackages.noarch 0:3.4.1-11.el7 python-lxml.x86_64 0:3.2.1-4.el7 ttmkfdir.x86_64 0:3.0.9-42.el7 tzdata-java.noarch 0:2018i-1.el7 xorg-x11-font-utils.x86_64 1:7.5-21.el7 xorg-x11-fonts-Type1.noarch 0:7.5-9.el7 Dependency Updated: chkconfig.x86_64 0:1.7.4-1.el7 freetype.x86_64 0:2.8-12.el7_6.1 glib2.x86_64 0:2.56.1-2.el7 libdrm.x86_64 0:2.4.91-3.el7 nspr.x86_64 0:4.19.0-1.el7_5 nss.x86_64 0:3.36.0-7.1.el7_6 nss-softokn.x86_64 0:3.36.0-5.el7_5 nss-softokn-freebl.x86_64 0:3.36.0-5.el7_5 nss-sysinit.x86_64 0:3.36.0-7.1.el7_6 nss-tools.x86_64 0:3.36.0-7.1.el7_6 nss-util.x86_64 0:3.36.0-1.1.el7_6 Complete! [root@node105 ~]#
4>.安装logstash
[root@node105 ~]# [root@node105 ~]# ll -h total 101M -rw-r--r--. 1 root root 101M Sep 19 03:12 logstash-5.6.12.rpm [root@node105 ~]# [root@node105 ~]# [root@node105 ~]# rpm -ivh logstash-5.6.12.rpm warning: logstash-5.6.12.rpm: Header V4 RSA/SHA512 Signature, key ID d88e42b4: NOKEY Preparing... ################################# [100%] Updating / installing... 1:logstash-1:5.6.12-1 ################################# [100%] Using provided startup.options file: /etc/logstash/startup.options Successfully created system startup script for Logstash [root@node105 ~]# [root@node105 ~]# [root@node105 ~]# [root@node105 ~]# rpm -ql logstash | wc -l 11615 [root@node105 ~]# [root@node105 ~]#
5>.添加logstash的环境变量
[root@node105 ~]# [root@node105 ~]# rpm -ql logstash | grep logstash$ /usr/share/logstash/bin/logstash /var/lib/logstash /var/log/logstash [root@node105 ~]# [root@node105 ~]# [root@node105 ~]# echo "export PATH=$PATH:/usr/share/logstash/bin/ " > /etc/profile.d/logstash.sh [root@node105 ~]# [root@node105 ~]# exec bash #重新执行一下当前bash [root@node105 ~]# [root@node105 ~]# [root@node105 ~]# which logstash /usr/share/logstash/bin/logstash [root@node105 ~]# [root@node105 ~]#
[root@node105 ~]# [root@node105 ~]# logstash --help WARNING: Could not find logstash.yml which is typically located in $LS_HOME/config or /etc/logstash. You can specify the path using --path.settings. Continuing using the defaults Usage: bin/logstash [OPTIONS] Options: -n, --node.name NAME Specify the name of this logstash instance, if no value is given it will default to the current hostname. (default: "0.0.0.0") -f, --path.config CONFIG_PATH Load the logstash config from a specific file or directory. If a directory is given, all files in that directory will be concatenated in lexicographical order and then parsed as a single config file. You can also specify wildcards (globs) and any matched files will be loaded in the order described above. -e, --config.string CONFIG_STRING Use the given string as the configuration data. Same syntax as the config file. If no input is specified, then the following is used as the default input: "input { stdin { type => stdin } }" and if no output is specified, then the following is used as the default output: "output { stdout { codec => rubydebug } }" If you wish to use both defaults, please use the empty string for the '-e' flag. (default: nil) --modules MODULES Load Logstash modules. Modules can be defined using multiple instances '--modules module1 --modules module2', or comma-separated syntax '--modules=module1,module2' Cannot be used in conjunction with '-e' or '-f' Use of '--modules' will override modules declared in the 'logstash.yml' file. -M, --modules.variable MODULES_VARIABLE Load variables for module template. Multiple instances of '-M' or '--modules.variable' are supported. Ignored if '--modules' flag is not used. Should be in the format of '-M "MODULE_NAME.var.PLUGIN_TYPE.PLUGIN_NAME.VARIABLE_NAME=VALUE"' as in '-M "example.var.filter.mutate.fieldname=fieldvalue"' --setup Load index template into Elasticsearch, and saved searches, index-pattern, visualizations, and dashboards into Kibana when running modules. (default: false) -w, --pipeline.workers COUNT Sets the number of pipeline workers to run. (default: 2) -b, --pipeline.batch.size SIZE Size of batches the pipeline is to work in. (default: 125) -u, --pipeline.batch.delay DELAY_IN_MS When creating pipeline batches, how long to wait while polling for the next event. (default: 5) --pipeline.unsafe_shutdown Force logstash to exit during shutdown even if there are still inflight events in memory. By default, logstash will refuse to quit until all received events have been pushed to the outputs. (default: false) --path.data PATH This should point to a writable directory. Logstash will use this directory whenever it needs to store data. Plugins will also have access to this path. (default: "/usr/share/logstash/data") -p, --path.plugins PATH A path of where to find plugins. This flag can be given multiple times to include multiple paths. Plugins are expected to be in a specific directory hierarchy: 'PATH/logstash/TYPE/NAME.rb' where TYPE is 'inputs' 'filters', 'outputs' or 'codecs' and NAME is the name of the plugin. (default: []) -l, --path.logs PATH Write logstash internal logs to the given file. Without this flag, logstash will emit logs to standard output. (default: "/usr/share/logstash/logs") --log.level LEVEL Set the log level for logstash. Possible values are: - fatal - error - warn - info - debug - trace (default: "info") --config.debug Print the compiled config ruby code out as a debug log (you must also have --log.level=debug enabled). WARNING: This will include any 'password' options passed to plugin configs as plaintext, and may result in plaintext passwords appearing in your logs! (default: false) -i, --interactive SHELL Drop to shell instead of running as normal. Valid shells are "irb" and "pry" -V, --version Emit the version of logstash and its friends, then exit. -t, --config.test_and_exit Check configuration for valid syntax and then exit. (default: false) -r, --config.reload.automatic Monitor configuration changes and reload whenever it is changed. NOTE: use SIGHUP to manually reload the config (default: false) --config.reload.interval RELOAD_INTERVAL How frequently to poll the configuration location for changes, in seconds. (default: 3) --http.host HTTP_HOST Web API binding host (default: "127.0.0.1") --http.port HTTP_PORT Web API http port (default: 9600..9700) --log.format FORMAT Specify if Logstash should write its own logs in JSON form (one event per line) or in plain text (using Ruby's Object#inspect) (default: "plain") --path.settings SETTINGS_DIR Directory containing logstash.yml file. This can also be set through the LS_SETTINGS_DIR environment variable. (default: "/usr/share/logstash/config") --verbose Set the log level to info. DEPRECATED: use --log.level=info instead. --debug Set the log level to debug. DEPRECATED: use --log.level=debug instead. --quiet Set the log level to info. DEPRECATED: use --log.level=quiet instead. -h, --help print help [root@node105 ~]#
6>.编写logstash的测试文件
[root@node105 ~]# [root@node105 ~]# cat /etc/logstash/conf.d/stdin-stdout.conf input { stdin {} } output { stdout {} } [root@node105 ~]#
[root@node105 ~]# [root@node105 ~]# logstash -f /etc/logstash/conf.d/stdin-stdout.conf -t WARNING: Could not find logstash.yml which is typically located in $LS_HOME/config or /etc/logstash. You can specify the path using --path.settings. Continuing using the defaults Could not find log4j2 configuration at path /usr/share/logstash/config/log4j2.properties. Using default config which logs errors to the console Configuration OK [root@node105 ~]#
[root@node105 ~]# [root@node105 ~]# logstash -f /etc/logstash/conf.d/stdin-stdout.conf WARNING: Could not find logstash.yml which is typically located in $LS_HOME/config or /etc/logstash. You can specify the path using --path.settings. Continuing using the defaults Could not find log4j2 configuration at path /usr/share/logstash/config/log4j2.properties. Using default config which logs errors to the console The stdin plugin is now waiting for input: 尹正杰到此一游！ { "@version" => "1", "host" => "0.0.0.0", "@timestamp" => 2019-03-10T16:32:17.415Z, "message" => "尹正杰到此一游！" }
[root@node105 ~]# [root@node105 ~]# cat /etc/logstash/conf.d/stdin-stdout.conf input { stdin {} } output { stdout { codec => rubydebug } } [root@node105 ~]# [root@node105 ~]# [root@node105 ~]# logstash -f /etc/logstash/conf.d/stdin-stdout.conf -t WARNING: Could not find logstash.yml which is typically located in $LS_HOME/config or /etc/logstash. You can specify the path using --path.settings. Continuing using the defaults Could not find log4j2 configuration at path /usr/share/logstash/config/log4j2.properties. Using default config which logs errors to the console Configuration OK [root@node105 ~]# [root@node105 ~]# [root@node105 ~]# [root@node105 ~]# [root@node105 ~]# logstash -f /etc/logstash/conf.d/stdin-stdout.conf WARNING: Could not find logstash.yml which is typically located in $LS_HOME/config or /etc/logstash. You can specify the path using --path.settings. Continuing using the defaults Could not find log4j2 configuration at path /usr/share/logstash/config/log4j2.properties. Using default config which logs errors to the console The stdin plugin is now waiting for input: Hello,Logstash { "@version" => "1", "host" => "0.0.0.0", "@timestamp" => 2019-03-10T16:35:52.467Z, "message" => "Hello,Logstash" } ^C[root@node105 ~]# [root@node105 ~]#
三. 编写Logstash的配置文件（官方文档：https://www.elastic.co/guide/en/logstash/5.6/logstash-5-6-12.html）
1>.从文件中读取数据并输出到屏幕终端（参考文档：https://www.elastic.co/guide/en/logstash/5.6/plugins-inputs-file.html）
[root@node105 ~]# [root@node105 ~]# cp /etc/logstash/conf.d/stdin-stdout.conf /etc/logstash/conf.d/file-stdout.conf [root@node105 ~]# [root@node105 ~]# [root@node105 ~]# cat /etc/logstash/conf.d/file-stdout.conf input { file { path => ["/var/log/httpd/access_log"] start_position => "beginning" } } output { stdout { codec => rubydebug } } [root@node105 ~]# [root@node105 ~]#
[root@node105 ~]# [root@node105 ~]# logstash -f /etc/logstash/conf.d/file-stdout.conf -t WARNING: Could not find logstash.yml which is typically located in $LS_HOME/config or /etc/logstash. You can specify the path using --path.settings. Continuing using the defaults Could not find log4j2 configuration at path /usr/share/logstash/config/log4j2.properties. Using default config which logs errors to the console Configuration OK [root@node105 ~]#
[root@node105 ~]# [root@node105 ~]# logstash -f /etc/logstash/conf.d/file-stdout.conf WARNING: Could not find logstash.yml which is typically located in $LS_HOME/config or /etc/logstash. You can specify the path using --path.settings. Continuing using the defaults Could not find log4j2 configuration at path /usr/share/logstash/config/log4j2.properties. Using default config which logs errors to the console { "@version" => "1", "host" => "0.0.0.0", "path" => "/var/log/httpd/access_log", "@timestamp" => 2019-03-10T16:44:54.695Z, "message" => "24.243.1.1 - - [10/Mar/2019:23:37:07 +0800] "GET /test17.html HTTP/1.1" 200 8 "-" "curl/7.29.0"" } { "@version" => "1", "host" => "0.0.0.0", "path" => "/var/log/httpd/access_log", "@timestamp" => 2019-03-10T16:44:54.696Z, "message" => "8.56.1.1 - - [10/Mar/2019:23:38:54 +0800] "GET /test32.html HTTP/1.1" 200 8 "-" "curl/7.29.0"" } { "@version" => "1", "host" => "0.0.0.0", "path" => "/var/log/httpd/access_log", "@timestamp" => 2019-03-10T16:44:54.719Z, "message" => "160.210.1.1 - - [10/Mar/2019:23:38:55 +0800] "GET /test28.html HTTP/1.1" 200 8 "-" "curl/7.29.0"" } { "@version" => "1", "host" => "0.0.0.0", "path" => "/var/log/httpd/access_log", "@timestamp" => 2019-03-10T16:44:54.723Z, "message" => "140.113.1.1 - - [10/Mar/2019:23:38:56 +0800] "GET /test18.html HTTP/1.1" 200 8 "-" "curl/7.29.0"" } { "@version" => "1", "host" => "0.0.0.0", "path" => "/var/log/httpd/access_log", "@timestamp" => 2019-03-10T16:44:54.724Z, "message" => "176.163.1.1 - - [10/Mar/2019:23:38:57 +0800] "GET /test46.html HTTP/1.1" 200 8 "-" "curl/7.29.0"" } { "@version" => "1", "host" => "0.0.0.0", "path" => "/var/log/httpd/access_log", "@timestamp" => 2019-03-10T16:44:54.725Z, "message" => "104.174.1.1 - - [10/Mar/2019:23:38:58 +0800] "GET /test27.html HTTP/1.1" 200 8 "-" "curl/7.29.0"" } { "@version" => "1", "host" => "0.0.0.0", "path" => "/var/log/httpd/access_log", "@timestamp" => 2019-03-10T16:44:54.726Z, "message" => "137.0.1.1 - - [10/Mar/2019:23:38:59 +0800] "GET /test18.html HTTP/1.1" 200 8 "-" "curl/7.29.0"" } { "@version" => "1", "host" => "0.0.0.0", "path" => "/var/log/httpd/access_log", "@timestamp" => 2019-03-10T16:44:54.726Z, "message" => "114.55.1.1 - - [10/Mar/2019:23:39:00 +0800] "GET /test41.html HTTP/1.1" 200 8 "-" "curl/7.29.0"" } { "@version" => "1", "host" => "0.0.0.0", "path" => "/var/log/httpd/access_log", "@timestamp" => 2019-03-10T16:44:54.727Z, "message" => "103.106.1.1 - - [10/Mar/2019:23:39:01 +0800] "GET /test37.html HTTP/1.1" 200 8 "-" "curl/7.29.0"" } { "@version" => "1", "host" => "0.0.0.0", "path" => "/var/log/httpd/access_log", "@timestamp" => 2019-03-10T16:44:54.727Z, "message" => "80.42.1.1 - - [10/Mar/2019:23:39:02 +0800] "GET /test12.html HTTP/1.1" 200 8 "-" "curl/7.29.0"" } { "@version" => "1", "host" => "0.0.0.0", "path" => "/var/log/httpd/access_log", "@timestamp" => 2019-03-10T16:44:54.731Z, "message" => "184.43.1.1 - - [10/Mar/2019:23:39:03 +0800] "GET /test12.html HTTP/1.1" 200 8 "-" "curl/7.29.0"" } { "@version" => "1", "host" => "0.0.0.0", "path" => "/var/log/httpd/access_log", "@timestamp" => 2019-03-10T16:44:54.731Z, "message" => "92.169.1.1 - - [10/Mar/2019:23:39:04 +0800] "GET /test26.html HTTP/1.1" 200 8 "-" "curl/7.29.0"" } { "@version" => "1", "host" => "0.0.0.0", "path" => "/var/log/httpd/access_log", "@timestamp" => 2019-03-10T16:44:54.733Z, "message" => "165.68.1.1 - - [10/Mar/2019:23:39:05 +0800] "GET /test15.html HTTP/1.1" 200 8 "-" "curl/7.29.0"" } { "@version" => "1", "host" => "0.0.0.0", "path" => "/var/log/httpd/access_log", "@timestamp" => 2019-03-10T16:44:54.733Z, "message" => "150.171.1.1 - - [10/Mar/2019:23:39:06 +0800] "GET /test6.html HTTP/1.1" 200 7 "-" "curl/7.29.0"" } { "@version" => "1", "host" => "0.0.0.0", "path" => "/var/log/httpd/access_log", "@timestamp" => 2019-03-10T16:44:54.734Z, "message" => "161.124.1.1 - - [10/Mar/2019:23:39:07 +0800] "GET /test25.html HTTP/1.1" 200 8 "-" "curl/7.29.0"" } { "@version" => "1", "host" => "0.0.0.0", "path" => "/var/log/httpd/access_log", "@timestamp" => 2019-03-10T16:44:54.734Z, "message" => "208.131.1.1 - - [10/Mar/2019:23:39:08 +0800] "GET /test13.html HTTP/1.1" 200 8 "-" "curl/7.29.0"" } { "@version" => "1", "host" => "0.0.0.0", "path" => "/var/log/httpd/access_log", "@timestamp" => 2019-03-10T16:44:54.736Z, "message" => "217.250.1.1 - - [10/Mar/2019:23:39:09 +0800] "GET /test35.html HTTP/1.1" 200 8 "-" "curl/7.29.0"" } { "@version" => "1", "host" => "0.0.0.0", "path" => "/var/log/httpd/access_log", "@timestamp" => 2019-03-10T16:44:54.736Z, "message" => "28.228.1.1 - - [10/Mar/2019:23:39:10 +0800] "GET /test15.html HTTP/1.1" 200 8 "-" "curl/7.29.0"" } { "@version" => "1", "host" => "0.0.0.0", "path" => "/var/log/httpd/access_log", "@timestamp" => 2019-03-10T16:44:54.737Z, "message" => "5.106.1.1 - - [10/Mar/2019:23:39:11 +0800] "GET /test36.html HTTP/1.1" 200 8 "-" "curl/7.29.0"" } { "@version" => "1", "host" => "0.0.0.0", "path" => "/var/log/httpd/access_log", "@timestamp" => 2019-03-10T16:44:54.737Z, "message" => "88.40.1.1 - - [10/Mar/2019:23:39:12 +0800] "GET /test1.html HTTP/1.1" 200 7 "-" "curl/7.29.0"" } { "@version" => "1", "host" => "0.0.0.0", "path" => "/var/log/httpd/access_log", "@timestamp" => 2019-03-10T16:44:54.739Z, "message" => "178.123.1.1 - - [10/Mar/2019:23:39:13 +0800] "GET /test28.html HTTP/1.1" 200 8 "-" "curl/7.29.0"" } { "@version" => "1", "host" => "0.0.0.0", "path" => "/var/log/httpd/access_log", "@timestamp" => 2019-03-10T16:44:54.739Z, "message" => "71.162.1.1 - - [10/Mar/2019:23:39:14 +0800] "GET /test13.html HTTP/1.1" 200 8 "-" "curl/7.29.0"" } { "@version" => "1", "host" => "0.0.0.0", "path" => "/var/log/httpd/access_log", "@timestamp" => 2019-03-10T16:44:54.744Z, "message" => "124.37.1.1 - - [10/Mar/2019:23:39:15 +0800] "GET /test48.html HTTP/1.1" 200 8 "-" "curl/7.29.0"" } { "@version" => "1", "host" => "0.0.0.0", "path" => "/var/log/httpd/access_log", "@timestamp" => 2019-03-10T16:44:54.744Z, "message" => "79.129.1.1 - - [10/Mar/2019:23:39:16 +0800] "GET /test30.html HTTP/1.1" 200 8 "-" "curl/7.29.0"" } { "@version" => "1", "host" => "0.0.0.0", "path" => "/var/log/httpd/access_log", "@timestamp" => 2019-03-10T16:44:54.745Z, "message" => "20.197.1.1 - - [10/Mar/2019:23:39:17 +0800] "GET /test26.html HTTP/1.1" 200 8 "-" "curl/7.29.0"" } { "@version" => "1", "host" => "0.0.0.0", "path" => "/var/log/httpd/access_log", "@timestamp" => 2019-03-10T16:44:54.745Z, "message" => "144.246.1.1 - - [10/Mar/2019:23:39:18 +0800] "GET /test31.html HTTP/1.1" 200 8 "-" "curl/7.29.0"" } { "@version" => "1", "host" => "0.0.0.0", "path" => "/var/log/httpd/access_log", "@timestamp" => 2019-03-10T16:44:54.749Z, "message" => "144.62.1.1 - - [10/Mar/2019:23:39:19 +0800] "GET /test30.html HTTP/1.1" 200 8 "-" "curl/7.29.0"" } { "@version" => "1", "host" => "0.0.0.0", "path" => "/var/log/httpd/access_log", "@timestamp" => 2019-03-10T16:44:54.750Z, "message" => "56.115.1.1 - - [10/Mar/2019:23:39:20 +0800] "GET /test12.html HTTP/1.1" 200 8 "-" "curl/7.29.0"" } { "@version" => "1", "host" => "0.0.0.0", "path" => "/var/log/httpd/access_log", "@timestamp" => 2019-03-10T16:44:54.752Z, "message" => "220.121.1.1 - - [10/Mar/2019:23:39:21 +0800] "GET /test34.html HTTP/1.1" 200 8 "-" "curl/7.29.0"" } { "@version" => "1", "host" => "0.0.0.0", "path" => "/var/log/httpd/access_log", "@timestamp" => 2019-03-10T16:44:54.752Z, "message" => "51.20.1.1 - - [10/Mar/2019:23:39:22 +0800] "GET /test50.html HTTP/1.1" 200 8 "-" "curl/7.29.0"" } { "@version" => "1", "host" => "0.0.0.0", "path" => "/var/log/httpd/access_log", "@timestamp" => 2019-03-10T16:44:54.756Z, "message" => "136.100.1.1 - - [10/Mar/2019:23:39:23 +0800] "GET /test35.html HTTP/1.1" 200 8 "-" "curl/7.29.0"" } { "@version" => "1", "host" => "0.0.0.0", "path" => "/var/log/httpd/access_log", "@timestamp" => 2019-03-10T16:44:54.756Z, "message" => "133.173.1.1 - - [10/Mar/2019:23:39:24 +0800] "GET /test19.html HTTP/1.1" 200 8 "-" "curl/7.29.0"" } { "@version" => "1", "host" => "0.0.0.0", "path" => "/var/log/httpd/access_log", "@timestamp" => 2019-03-10T16:44:54.757Z, "message" => "88.221.1.1 - - [10/Mar/2019:23:39:25 +0800] "GET /test32.html HTTP/1.1" 200 8 "-" "curl/7.29.0"" } { "@version" => "1", "host" => "0.0.0.0", "path" => "/var/log/httpd/access_log", "@timestamp" => 2019-03-10T16:44:54.757Z, "message" => "142.38.1.1 - - [10/Mar/2019:23:39:26 +0800] "GET /test41.html HTTP/1.1" 200 8 "-" "curl/7.29.0"" } { "@version" => "1", "host" => "0.0.0.0", "path" => "/var/log/httpd/access_log", "@timestamp" => 2019-03-10T16:44:54.758Z, "message" => "156.208.1.1 - - [10/Mar/2019:23:39:27 +0800] "GET /test36.html HTTP/1.1" 200 8 "-" "curl/7.29.0"" } { "@version" => "1", "host" => "0.0.0.0", "path" => "/var/log/httpd/access_log", "@timestamp" => 2019-03-10T16:44:54.758Z, "message" => "48.138.1.1 - - [10/Mar/2019:23:39:28 +0800] "GET /test8.html HTTP/1.1" 200 7 "-" "curl/7.29.0"" } { "@version" => "1", "host" => "0.0.0.0", "path" => "/var/log/httpd/access_log", "@timestamp" => 2019-03-10T16:44:54.759Z, "message" => "15.248.1.1 - - [10/Mar/2019:23:39:29 +0800] "GET /test29.html HTTP/1.1" 200 8 "-" "curl/7.29.0"" } { "@version" => "1", "host" => "0.0.0.0", "path" => "/var/log/httpd/access_log", "@timestamp" => 2019-03-10T16:44:54.759Z, "message" => "138.64.1.1 - - [10/Mar/2019:23:39:30 +0800] "GET /test42.html HTTP/1.1" 200 8 "-" "curl/7.29.0"" }
2>.使用logstash的过滤器（参考文档：https://www.elastic.co/guide/en/logstash/5.6/plugins-filters-grok.html）
[root@node105 ~]# [root@node105 ~]# rpm -ql logstash | grep pattern /usr/share/logstash/modules/fb_apache/configuration/kibana/index-pattern/fb_apache.json /usr/share/logstash/modules/netflow/configuration/kibana/index-pattern/netflow.json /usr/share/logstash/vendor/bundle/jruby/1.9/gems/cinch-2.3.4/lib/cinch/pattern.rb /usr/share/logstash/vendor/bundle/jruby/1.9/gems/coderay-1.1.2/lib/coderay/scanners/ruby/patterns.rb /usr/share/logstash/vendor/bundle/jruby/1.9/gems/logstash-patterns-core-4.1.2/CHANGELOG.md /usr/share/logstash/vendor/bundle/jruby/1.9/gems/logstash-patterns-core-4.1.2/CONTRIBUTORS /usr/share/logstash/vendor/bundle/jruby/1.9/gems/logstash-patterns-core-4.1.2/Gemfile /usr/share/logstash/vendor/bundle/jruby/1.9/gems/logstash-patterns-core-4.1.2/LICENSE /usr/share/logstash/vendor/bundle/jruby/1.9/gems/logstash-patterns-core-4.1.2/NOTICE.TXT /usr/share/logstash/vendor/bundle/jruby/1.9/gems/logstash-patterns-core-4.1.2/README.md /usr/share/logstash/vendor/bundle/jruby/1.9/gems/logstash-patterns-core-4.1.2/lib/logstash/patterns/core.rb /usr/share/logstash/vendor/bundle/jruby/1.9/gems/logstash-patterns-core-4.1.2/logstash-patterns-core.gemspec /usr/share/logstash/vendor/bundle/jruby/1.9/gems/logstash-patterns-core-4.1.2/patterns/aws /usr/share/logstash/vendor/bundle/jruby/1.9/gems/logstash-patterns-core-4.1.2/patterns/bacula /usr/share/logstash/vendor/bundle/jruby/1.9/gems/logstash-patterns-core-4.1.2/patterns/bind /usr/share/logstash/vendor/bundle/jruby/1.9/gems/logstash-patterns-core-4.1.2/patterns/bro /usr/share/logstash/vendor/bundle/jruby/1.9/gems/logstash-patterns-core-4.1.2/patterns/exim /usr/share/logstash/vendor/bundle/jruby/1.9/gems/logstash-patterns-core-4.1.2/patterns/firewalls /usr/share/logstash/vendor/bundle/jruby/1.9/gems/logstash-patterns-core-4.1.2/patterns/grok-patterns /usr/share/logstash/vendor/bundle/jruby/1.9/gems/logstash-patterns-core-4.1.2/patterns/haproxy /usr/share/logstash/vendor/bundle/jruby/1.9/gems/logstash-patterns-core-4.1.2/patterns/httpd /usr/share/logstash/vendor/bundle/jruby/1.9/gems/logstash-patterns-core-4.1.2/patterns/java /usr/share/logstash/vendor/bundle/jruby/1.9/gems/logstash-patterns-core-4.1.2/patterns/junos /usr/share/logstash/vendor/bundle/jruby/1.9/gems/logstash-patterns-core-4.1.2/patterns/linux-syslog /usr/share/logstash/vendor/bundle/jruby/1.9/gems/logstash-patterns-core-4.1.2/patterns/maven /usr/share/logstash/vendor/bundle/jruby/1.9/gems/logstash-patterns-core-4.1.2/patterns/mcollective /usr/share/logstash/vendor/bundle/jruby/1.9/gems/logstash-patterns-core-4.1.2/patterns/mcollective-patterns /usr/share/logstash/vendor/bundle/jruby/1.9/gems/logstash-patterns-core-4.1.2/patterns/mongodb /usr/share/logstash/vendor/bundle/jruby/1.9/gems/logstash-patterns-core-4.1.2/patterns/nagios /usr/share/logstash/vendor/bundle/jruby/1.9/gems/logstash-patterns-core-4.1.2/patterns/postgresql /usr/share/logstash/vendor/bundle/jruby/1.9/gems/logstash-patterns-core-4.1.2/patterns/rails /usr/share/logstash/vendor/bundle/jruby/1.9/gems/logstash-patterns-core-4.1.2/patterns/redis /usr/share/logstash/vendor/bundle/jruby/1.9/gems/logstash-patterns-core-4.1.2/patterns/ruby /usr/share/logstash/vendor/bundle/jruby/1.9/gems/logstash-patterns-core-4.1.2/patterns/squid /usr/share/logstash/vendor/bundle/jruby/1.9/specifications/logstash-patterns-core-4.1.2.gemspec [root@node105 ~]#
[root@node105 ~]# [root@node105 ~]# [root@node105 ~]# vi /etc/logstash/conf.d/file-stdout.conf [root@node105 ~]# [root@node105 ~]# [root@node105 ~]# cp /etc/logstash/conf.d/file-stdout.conf /etc/logstash/conf.d/file-grok-stdout.conf [root@node105 ~]# [root@node105 ~]# [root@node105 ~]# cat /etc/logstash/conf.d/file-grok-stdout.conf input { file { path => ["/var/log/httpd/access_log"] start_position => "beginning" } } filter { grok { match => { "message" => "%{HTTPD_COMBINEDLOG}" } } } output { stdout { codec => rubydebug } } [root@node105 ~]# [root@node105 ~]#
[root@node105 ~]# [root@node105 ~]# logstash -f /etc/logstash/conf.d/file-grok-stdout.conf -t WARNING: Could not find logstash.yml which is typically located in $LS_HOME/config or /etc/logstash. You can specify the path using --path.settings. Continuing using the defaults Could not find log4j2 configuration at path /usr/share/logstash/config/log4j2.properties. Using default config which logs errors to the console Configuration OK [root@node105 ~]#
[root@node105 ~]# [root@node105 ~]# logstash -f /etc/logstash/conf.d/file-grok-stdout.conf WARNING: Could not find logstash.yml which is typically located in $LS_HOME/config or /etc/logstash. You can specify the path using --path.settings. Continuing using the defaults Could not find log4j2 configuration at path /usr/share/logstash/config/log4j2.properties. Using default config which logs errors to the console { "request" => "/test5.html", "agent" => ""curl/7.29.0"", "auth" => "-", "ident" => "-", "verb" => "GET", "message" => "96.200.1.1 - - [11/Mar/2019:01:05:20 +0800] "GET /test5.html HTTP/1.1" 200 7 "-" "curl/7.29.0"", "path" => "/var/log/httpd/access_log", "referrer" => ""-"", "@timestamp" => 2019-03-10T17:05:22.981Z, "response" => "200", "bytes" => "7", "clientip" => "96.200.1.1", "@version" => "1", "host" => "0.0.0.0", "httpversion" => "1.1", "timestamp" => "11/Mar/2019:01:05:20 +0800" } { "request" => "/test22.html", "agent" => ""curl/7.29.0"", "auth" => "-", "ident" => "-", "verb" => "GET", "message" => "12.63.1.1 - - [11/Mar/2019:01:05:21 +0800] "GET /test22.html HTTP/1.1" 200 8 "-" "curl/7.29.0"", "path" => "/var/log/httpd/access_log", "referrer" => ""-"", "@timestamp" => 2019-03-10T17:05:22.983Z, "response" => "200", "bytes" => "8", "clientip" => "12.63.1.1", "@version" => "1", "host" => "0.0.0.0", "httpversion" => "1.1", "timestamp" => "11/Mar/2019:01:05:21 +0800" } { "request" => "/test13.html", "agent" => ""curl/7.29.0"", "auth" => "-", "ident" => "-", "verb" => "GET", "message" => "159.250.1.1 - - [11/Mar/2019:01:05:22 +0800] "GET /test13.html HTTP/1.1" 200 8 "-" "curl/7.29.0"", "path" => "/var/log/httpd/access_log", "referrer" => ""-"", "@timestamp" => 2019-03-10T17:05:22.988Z, "response" => "200", "bytes" => "8", "clientip" => "159.250.1.1", "@version" => "1", "host" => "0.0.0.0", "httpversion" => "1.1", "timestamp" => "11/Mar/2019:01:05:22 +0800" } { "request" => "/test7.html", "agent" => ""curl/7.29.0"", "auth" => "-", "ident" => "-", "verb" => "GET", "message" => "2.153.1.1 - - [11/Mar/2019:01:05:23 +0800] "GET /test7.html HTTP/1.1" 200 7 "-" "curl/7.29.0"", "path" => "/var/log/httpd/access_log", "referrer" => ""-"", "@timestamp" => 2019-03-10T17:05:24.012Z, "response" => "200", "bytes" => "7", "clientip" => "2.153.1.1", "@version" => "1", "host" => "0.0.0.0", "httpversion" => "1.1", "timestamp" => "11/Mar/2019:01:05:23 +0800" } { "request" => "/test4.html", "agent" => ""curl/7.29.0"", "auth" => "-", "ident" => "-", "verb" => "GET", "message" => "101.210.1.1 - - [11/Mar/2019:01:05:24 +0800] "GET /test4.html HTTP/1.1" 200 7 "-" "curl/7.29.0"", "path" => "/var/log/httpd/access_log", "referrer" => ""-"", "@timestamp" => 2019-03-10T17:05:25.014Z, "response" => "200", "bytes" => "7", "clientip" => "101.210.1.1", "@version" => "1", "host" => "0.0.0.0", "httpversion" => "1.1", "timestamp" => "11/Mar/2019:01:05:24 +0800" } { "request" => "/test33.html", "agent" => ""curl/7.29.0"", "auth" => "-", "ident" => "-", "verb" => "GET", "message" => "26.127.1.1 - - [11/Mar/2019:01:05:25 +0800] "GET /test33.html HTTP/1.1" 200 8 "-" "curl/7.29.0"", "path" => "/var/log/httpd/access_log", "referrer" => ""-"", "@timestamp" => 2019-03-10T17:05:26.016Z, "response" => "200", "bytes" => "8", "clientip" => "26.127.1.1", "@version" => "1", "host" => "0.0.0.0", "httpversion" => "1.1", "timestamp" => "11/Mar/2019:01:05:25 +0800" }
[root@node105 ~]# [root@node105 ~]# cat /etc/logstash/conf.d/file-grok-stdout.conf input { file { path => ["/var/log/httpd/access_log"] start_position => "beginning" } } filter { grok { match => { "message" => "%{HTTPD_COMBINEDLOG}" } remove_field => "message" } } output { stdout { codec => rubydebug } } [root@node105 ~]# [root@node105 ~]# [root@node105 ~]# [root@node105 ~]# logstash -f /etc/logstash/conf.d/file-grok-stdout.conf -t WARNING: Could not find logstash.yml which is typically located in $LS_HOME/config or /etc/logstash. You can specify the path using --path.settings. Continuing using the defaults Could not find log4j2 configuration at path /usr/share/logstash/config/log4j2.properties. Using default config which logs errors to the console Configuration OK [root@node105 ~]#
3>.logstash的date插件使用（参考链接：https://www.elastic.co/guide/en/logstash/5.6/plugins-filters-date.html）
[root@node105 ~]# [root@node105 ~]# cp /etc/logstash/conf.d/file-grok-stdout.conf /etc/logstash/conf.d/file-date-stdout.conf [root@node105 ~]# [root@node105 ~]# [root@node105 ~]# vi /etc/logstash/conf.d/file-date-stdout.conf [root@node105 ~]# [root@node105 ~]# cat /etc/logstash/conf.d/file-date-stdout.conf input { file { path => ["/var/log/httpd/access_log"] start_position => "beginning" } } filter { grok { match => { "message" => "%{HTTPD_COMBINEDLOG}" } remove_field => "message" } date { match => ["timestamp","dd/MMM/YYYY:H:m:s Z"] remove_field => "timestamp" } } output { stdout { codec => rubydebug } } [root@node105 ~]#
[root@node105 ~]# [root@node105 ~]# logstash -f /etc/logstash/conf.d/file-date-stdout.conf -t WARNING: Could not find logstash.yml which is typically located in $LS_HOME/config or /etc/logstash. You can specify the path using --path.settings. Continuing using the defaults Could not find log4j2 configuration at path /usr/share/logstash/config/log4j2.properties. Using default config which logs errors to the console Configuration OK [root@node105 ~]# [root@node105 ~]#
[root@node105 ~]# [root@node105 ~]# [root@node105 ~]# logstash -f /etc/logstash/conf.d/file-date-stdout.conf WARNING: Could not find logstash.yml which is typically located in $LS_HOME/config or /etc/logstash. You can specify the path using --path.settings. Continuing using the defaults Could not find log4j2 configuration at path /usr/share/logstash/config/log4j2.properties. Using default config which logs errors to the console { "request" => "/test3.html", "agent" => ""curl/7.29.0"", "auth" => "-", "ident" => "-", "verb" => "GET", "path" => "/var/log/httpd/access_log", "referrer" => ""-"", "@timestamp" => 2019-03-10T17:18:07.000Z, "response" => "200", "bytes" => "7", "clientip" => "11.221.1.1", "@version" => "1", "host" => "0.0.0.0", "httpversion" => "1.1" } { "request" => "/test40.html", "agent" => ""curl/7.29.0"", "auth" => "-", "ident" => "-", "verb" => "GET", "path" => "/var/log/httpd/access_log", "referrer" => ""-"", "@timestamp" => 2019-03-10T17:18:08.000Z, "response" => "200", "bytes" => "8", "clientip" => "209.47.1.1", "@version" => "1", "host" => "0.0.0.0", "httpversion" => "1.1" } { "request" => "/test13.html", "agent" => ""curl/7.29.0"", "auth" => "-", "ident" => "-", "verb" => "GET", "path" => "/var/log/httpd/access_log", "referrer" => ""-"", "@timestamp" => 2019-03-10T17:18:09.000Z, "response" => "200", "bytes" => "8", "clientip" => "45.74.1.1", "@version" => "1", "host" => "0.0.0.0", "httpversion" => "1.1" } { "request" => "/test10.html", "agent" => ""curl/7.29.0"", "auth" => "-", "ident" => "-", "verb" => "GET", "path" => "/var/log/httpd/access_log", "referrer" => ""-"", "@timestamp" => 2019-03-10T17:18:10.000Z, "response" => "200", "bytes" => "8", "clientip" => "220.234.1.1", "@version" => "1", "host" => "0.0.0.0", "httpversion" => "1.1" } { "request" => "/test20.html", "agent" => ""curl/7.29.0"", "auth" => "-", "ident" => "-", "verb" => "GET", "path" => "/var/log/httpd/access_log", "referrer" => ""-"", "@timestamp" => 2019-03-10T17:18:11.000Z, "response" => "200", "bytes" => "8", "clientip" => "175.86.1.1", "@version" => "1", "host" => "0.0.0.0", "httpversion" => "1.1" } { "request" => "/test14.html", "agent" => ""curl/7.29.0"", "auth" => "-", "ident" => "-", "verb" => "GET", "path" => "/var/log/httpd/access_log", "referrer" => ""-"", "@timestamp" => 2019-03-10T17:18:12.000Z, "response" => "200", "bytes" => "8", "clientip" => "47.57.1.1", "@version" => "1", "host" => "0.0.0.0", "httpversion" => "1.1" } { "request" => "/test25.html", "agent" => ""curl/7.29.0"", "auth" => "-", "ident" => "-", "verb" => "GET", "path" => "/var/log/httpd/access_log", "referrer" => ""-"", "@timestamp" => 2019-03-10T17:18:13.000Z, "response" => "200", "bytes" => "8", "clientip" => "193.90.1.1", "@version" => "1", "host" => "0.0.0.0", "httpversion" => "1.1" } { "request" => "/test29.html", "agent" => ""curl/7.29.0"", "auth" => "-", "ident" => "-", "verb" => "GET", "path" => "/var/log/httpd/access_log", "referrer" => ""-"", "@timestamp" => 2019-03-10T17:18:14.000Z, "response" => "200", "bytes" => "8", "clientip" => "201.232.1.1", "@version" => "1", "host" => "0.0.0.0", "httpversion" => "1.1" } { "request" => "/test13.html", "agent" => ""curl/7.29.0"", "auth" => "-", "ident" => "-", "verb" => "GET", "path" => "/var/log/httpd/access_log", "referrer" => ""-"", "@timestamp" => 2019-03-10T17:18:15.000Z, "response" => "200", "bytes" => "8", "clientip" => "90.55.1.1", "@version" => "1", "host" => "0.0.0.0", "httpversion" => "1.1" } { "request" => "/test32.html", "agent" => ""curl/7.29.0"", "auth" => "-", "ident" => "-", "verb" => "GET", "path" => "/var/log/httpd/access_log", "referrer" => ""-"", "@timestamp" => 2019-03-10T17:18:17.000Z, "response" => "200", "bytes" => "8", "clientip" => "14.200.1.1", "@version" => "1", "host" => "0.0.0.0", "httpversion" => "1.1" } { "request" => "/test29.html", "agent" => ""curl/7.29.0"", "auth" => "-", "ident" => "-", "verb" => "GET", "path" => "/var/log/httpd/access_log", "referrer" => ""-"", "@timestamp" => 2019-03-10T17:18:18.000Z, "response" => "200", "bytes" => "8", "clientip" => "70.10.1.1", "@version" => "1", "host" => "0.0.0.0", "httpversion" => "1.1" }
更多关于logstash的案例请参考：Elastic Stack之Logstash进阶。