zoukankan      html  css  js  c++  java
  • Flume1.6.0搭建

    下载地址:http://archive.apache.org/dist/flume/

    解压完毕

    切换到安装目录下/usr/local/flume/apache-flume-1.6.0-bin/conf

    1.简单示例

    1.1 netcat模式

    创建demoagent.conf

    # example.conf: A single-node Flume configuration
    
    # Name the components on this agent
    a1.sources = r1
    a1.sinks = k1
    a1.channels = c1
    
    # Describe/configure the source
    a1.sources.r1.type = netcat
    a1.sources.r1.bind = CentOS7One
    a1.sources.r1.port = 44444
    
    # Describe the sink
    a1.sinks.k1.type = logger
    
    # Use a channel which buffers events in memory
    a1.channels.c1.type = memory
    a1.channels.c1.capacity = 1000
    a1.channels.c1.transactionCapacity = 100
    
    # Bind the source and sink to the channel
    a1.sources.r1.channels = c1
    a1.sinks.k1.channel = c1

    测试:Windows用telnet命令测试

    telnet centos7one 44444

    在cmd终端随便输入几个字符

    在Flume端可以看到返回的消息

     1.2 exec模式

    创建demoagent-exec.conf

    # example.conf: A single-node Flume configuration
    
    # Name the components on this agent
    a1.sources = r1
    a1.sinks = k1
    a1.channels = c1
    
    # Describe/configure the source
    a1.sources.r1.type = exec
    a1.sources.r1.command = tail -f /usr/local/flume/test.log
    a1.sources.r1.port = 44444
    a1.sources.r1.channels = c1
    
    # Describe the sink
    a1.sinks.k1.type = logger
    
    # Use a channel which buffers events in memory
    a1.channels.c1.type = memory
    a1.channels.c1.capacity = 1000
    a1.channels.c1.transactionCapacity = 100
    
    # Bind the source and sink to the channel
    a1.sources.r1.channels = c1
    a1.sinks.k1.channel = c1

     克隆一个窗口在命令行输入如下信息

    对test.log持续添加信息

    [root@centos7one flume]# while true
    > do
    > echo message >> test.log 
    > done

     可以看到Flume端,接收到了实时的消息

  • 相关阅读:
    Integer to Roman leetcode java
    Reverse Integer leetcode java
    Binary Tree Maximum Path Sum leetcode java
    公司来了一个奇葩需求pppoe client+server+EOIP+vlan
    魔兽数据库-自然
    windows默认dns解析走ipv4而不走ipv6
    ROS支持BCP桥接(基于PPP隧道)
    几款比较好用的电动理发器推荐
    centos 拨号pptp在拨号成功和拨号失败的时候脚本处理!!!非常重要
    ros routeros 脚本命令script
  • 原文地址:https://www.cnblogs.com/Java-Starter/p/10794734.html
Copyright © 2011-2022 走看看