zoukankan      html  css  js  c++  java
  • [Spark][Flume]Flume 启动例子

    Flume 启动例子:

    flume-ng agent --conf /etc/flume-ng/conf --conf-file /etc/flume-ng/conf/flume.conf --name agent1
    -Dflume.root.logger=INFO,console

    [root@localhost conf]# flume-ng agent --conf /etc/flume-ng/conf --conf-file /etc/flume-ng/conf/flume.conf --name agent1 
    > -Dflume.root.logger=INFO,console
    Info: Sourcing environment configuration script /etc/flume-ng/conf/flume-env.sh
    Info: Including Hadoop libraries found via (/usr/bin/hadoop) for HDFS access
    Info: Excluding /usr/lib/hadoop/lib/slf4j-api-1.7.5.jar from classpath
    Info: Excluding /usr/lib/hadoop/lib/slf4j-log4j12.jar from classpath
    Info: Including HBASE libraries found via (/usr/bin/hbase) for HBASE access
    Info: Excluding /usr/lib/hbase/bin/../lib/slf4j-api-1.7.5.jar from classpath
    Info: Excluding /usr/lib/hbase/bin/../lib/slf4j-log4j12.jar from classpath
    Info: Excluding /usr/lib/hadoop/lib/slf4j-api-1.7.5.jar from classpath
    Info: Excluding /usr/lib/hadoop/lib/slf4j-log4j12.jar from classpath
    Info: Excluding /usr/lib/hadoop/lib/slf4j-api-1.7.5.jar from classpath
    Info: Excluding /usr/lib/hadoop/lib/slf4j-log4j12.jar from classpath
    Info: Excluding /usr/lib/zookeeper/lib/slf4j-api-1.7.5.jar from classpath
    Info: Excluding /usr/lib/zookeeper/lib/slf4j-log4j12-1.7.5.jar from classpath
    Info: Excluding /usr/lib/zookeeper/lib/slf4j-log4j12.jar from classpath
    Info: Including Hive libraries found via () for Hive access
    
    ...
    
    
    2017-10-18 04:23:01,667 (lifecycleSupervisor-1-0) [INFO - org.apache.flume.node.PollingPropertiesFileConfigurationProvider.start(PollingPropertiesFileConfigurationProvider.java:61)] Configuration provider starting
    2017-10-18 04:23:01,740 (conf-file-poller-0) [INFO - org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:133)] Reloading configuration file:/etc/flume-ng/conf/flume.conf
    2017-10-18 04:23:01,817 (conf-file-poller-0) [INFO - org.apache.flume.conf.FlumeConfiguration.validateConfiguration(FlumeConfiguration.java:141)] Post-validation flume configuration contains configuration for agents: []
    2017-10-18 04:23:01,825 (conf-file-poller-0) [WARN - org.apache.flume.node.AbstractConfigurationProvider.getConfiguration(AbstractConfigurationProvider.java:133)] No configuration found for this host:agent1
    2017-10-18 04:23:01,972 (conf-file-poller-0) [INFO - org.apache.flume.node.Application.startAllComponents(Application.java:138)] Starting new configuration:{ sourceRunners:{} sinkRunners:{} channels:{} }
  • 相关阅读:
    56. Merge Intervals
    Reorder List
    Merge Two Sorted Lists
    彻底删除kafka topic数据
    什么时候类加载
    checkpoint的作用
    case when
    SQL:将查询结果插入到另一个表的三种情况
    IFNULL函数
    kafka主要配置
  • 原文地址:https://www.cnblogs.com/gaojian/p/7688993.html
Copyright © 2011-2022 走看看