zoukankan      html  css  js  c++  java
  • [Spark][Flume]Flume 启动例子

    Flume 启动例子:

    flume-ng agent --conf /etc/flume-ng/conf --conf-file /etc/flume-ng/conf/flume.conf --name agent1
    -Dflume.root.logger=INFO,console

    [root@localhost conf]# flume-ng agent --conf /etc/flume-ng/conf --conf-file /etc/flume-ng/conf/flume.conf --name agent1 
    > -Dflume.root.logger=INFO,console
    Info: Sourcing environment configuration script /etc/flume-ng/conf/flume-env.sh
    Info: Including Hadoop libraries found via (/usr/bin/hadoop) for HDFS access
    Info: Excluding /usr/lib/hadoop/lib/slf4j-api-1.7.5.jar from classpath
    Info: Excluding /usr/lib/hadoop/lib/slf4j-log4j12.jar from classpath
    Info: Including HBASE libraries found via (/usr/bin/hbase) for HBASE access
    Info: Excluding /usr/lib/hbase/bin/../lib/slf4j-api-1.7.5.jar from classpath
    Info: Excluding /usr/lib/hbase/bin/../lib/slf4j-log4j12.jar from classpath
    Info: Excluding /usr/lib/hadoop/lib/slf4j-api-1.7.5.jar from classpath
    Info: Excluding /usr/lib/hadoop/lib/slf4j-log4j12.jar from classpath
    Info: Excluding /usr/lib/hadoop/lib/slf4j-api-1.7.5.jar from classpath
    Info: Excluding /usr/lib/hadoop/lib/slf4j-log4j12.jar from classpath
    Info: Excluding /usr/lib/zookeeper/lib/slf4j-api-1.7.5.jar from classpath
    Info: Excluding /usr/lib/zookeeper/lib/slf4j-log4j12-1.7.5.jar from classpath
    Info: Excluding /usr/lib/zookeeper/lib/slf4j-log4j12.jar from classpath
    Info: Including Hive libraries found via () for Hive access
    
    ...
    
    
    2017-10-18 04:23:01,667 (lifecycleSupervisor-1-0) [INFO - org.apache.flume.node.PollingPropertiesFileConfigurationProvider.start(PollingPropertiesFileConfigurationProvider.java:61)] Configuration provider starting
    2017-10-18 04:23:01,740 (conf-file-poller-0) [INFO - org.apache.flume.node.PollingPropertiesFileConfigurationProvider$FileWatcherRunnable.run(PollingPropertiesFileConfigurationProvider.java:133)] Reloading configuration file:/etc/flume-ng/conf/flume.conf
    2017-10-18 04:23:01,817 (conf-file-poller-0) [INFO - org.apache.flume.conf.FlumeConfiguration.validateConfiguration(FlumeConfiguration.java:141)] Post-validation flume configuration contains configuration for agents: []
    2017-10-18 04:23:01,825 (conf-file-poller-0) [WARN - org.apache.flume.node.AbstractConfigurationProvider.getConfiguration(AbstractConfigurationProvider.java:133)] No configuration found for this host:agent1
    2017-10-18 04:23:01,972 (conf-file-poller-0) [INFO - org.apache.flume.node.Application.startAllComponents(Application.java:138)] Starting new configuration:{ sourceRunners:{} sinkRunners:{} channels:{} }
  • 相关阅读:
    Learning Experience of Big Data:The First Day-Try to set up a network connection on my virtural machine
    Learning Experience of Big Data: Learn to install CentOs 6.5 on my laptop
    事物总线模式实例——EventBus实例详解
    软件架构——事件总线模式
    阅读《大型网站技术架构》,并结合"重大需求征集系统"有感
    淘宝网的六个质量属性
    读架构漫谈博文有感
    06软件需求读书笔记(六)
    .NET应用程序性能优化
    【转】消息队列设计精要
  • 原文地址:https://www.cnblogs.com/gaojian/p/7688993.html
Copyright © 2011-2022 走看看