zoukankan      html  css  js  c++  java
  • Flume -- Transfer one type of source to another type

     Source within Flume is a kind of Server for outside client.

     Sink within Flume is a kind of client for ourside server such as HDFS, MongoDB, Kafka.

     

    Component InterfaceType AliasImplementation Class
    org.apache.flume.Channel memory org.apache.flume.channel.MemoryChannel
    org.apache.flume.Channel jdbc org.apache.flume.channel.jdbc.JdbcChannel
    org.apache.flume.Channel file org.apache.flume.channel.file.FileChannel
    org.apache.flume.Channel org.apache.flume.channel.PseudoTxnMemoryChannel
    org.apache.flume.Channel org.example.MyChannel
    org.apache.flume.Source avro org.apache.flume.source.AvroSource
    org.apache.flume.Source netcat org.apache.flume.source.NetcatSource
    org.apache.flume.Source seq org.apache.flume.source.SequenceGeneratorSource
    org.apache.flume.Source exec org.apache.flume.source.ExecSource
    org.apache.flume.Source syslogtcp org.apache.flume.source.SyslogTcpSource
    org.apache.flume.Source multiport_syslogtcp org.apache.flume.source.MultiportSyslogTCPSource
    org.apache.flume.Source syslogudp org.apache.flume.source.SyslogUDPSource
    org.apache.flume.Source spooldir org.apache.flume.source.SpoolDirectorySource
    org.apache.flume.Source http org.apache.flume.source.http.HTTPSource
    org.apache.flume.Source thrift org.apache.flume.source.ThriftSource
    org.apache.flume.Source jms org.apache.flume.source.jms.JMSSource
    org.apache.flume.Source org.apache.flume.source.avroLegacy.AvroLegacySource
    org.apache.flume.Source org.apache.flume.source.thriftLegacy.ThriftLegacySource
    org.apache.flume.Source org.example.MySource
    org.apache.flume.Sink null org.apache.flume.sink.NullSink
    org.apache.flume.Sink logger org.apache.flume.sink.LoggerSink
    org.apache.flume.Sink avro org.apache.flume.sink.AvroSink
    org.apache.flume.Sink hdfs org.apache.flume.sink.hdfs.HDFSEventSink
    org.apache.flume.Sink hbase org.apache.flume.sink.hbase.HBaseSink
    org.apache.flume.Sink asynchbase org.apache.flume.sink.hbase.AsyncHBaseSink
    org.apache.flume.Sink elasticsearch org.apache.flume.sink.elasticsearch.ElasticSearchSink
    org.apache.flume.Sink file_roll org.apache.flume.sink.RollingFileSink
    org.apache.flume.Sink irc org.apache.flume.sink.irc.IRCSink
    org.apache.flume.Sink thrift org.apache.flume.sink.ThriftSink
    org.apache.flume.Sink org.example.MySink
    org.apache.flume.ChannelSelector replicating org.apache.flume.channel.ReplicatingChannelSelector
    org.apache.flume.ChannelSelector multiplexing org.apache.flume.channel.MultiplexingChannelSelector
    org.apache.flume.ChannelSelector org.example.MyChannelSelector
    org.apache.flume.SinkProcessor default org.apache.flume.sink.DefaultSinkProcessor
    org.apache.flume.SinkProcessor failover org.apache.flume.sink.FailoverSinkProcessor
    org.apache.flume.SinkProcessor load_balance org.apache.flume.sink.LoadBalancingSinkProcessor
    org.apache.flume.SinkProcessor  
    org.apache.flume.interceptor.Interceptor timestamp org.apache.flume.interceptor.TimestampInterceptor$Builder
    org.apache.flume.interceptor.Interceptor host org.apache.flume.interceptor.HostInterceptor$Builder
    org.apache.flume.interceptor.Interceptor static org.apache.flume.interceptor.StaticInterceptor$Builder
    org.apache.flume.interceptor.Interceptor regex_filter org.apache.flume.interceptor.RegexFilteringInterceptor$Builder
    org.apache.flume.interceptor.Interceptor regex_extractor org.apache.flume.interceptor.RegexFilteringInterceptor$Builder
    org.apache.flume.channel.file.encryption.KeyProvider$Builder jceksfile org.apache.flume.channel.file.encryption.JCEFileKeyProvider
    org.apache.flume.channel.file.encryption.KeyProvider$Builder org.example.MyKeyProvider
    org.apache.flume.channel.file.encryption.CipherProvider aesctrnopadding org.apache.flume.channel.file.encryption.AESCTRNoPaddingProvider
    org.apache.flume.channel.file.encryption.CipherProvider org.example.MyCipherProvider
    org.apache.flume.serialization.EventSerializer$Builder text org.apache.flume.serialization.BodyTextEventSerializer$Builder
    org.apache.flume.serialization.EventSerializer$Builder avro_event org.apache.flume.serialization.FlumeEventAvroEventSerializer$Builder
    org.apache.flume.serialization.EventSerializer$Builder org.example.MyEventSerializer$Builder
  • 相关阅读:
    Mybatis查询select操作
    插入排序和它的进化希尔排序
    关于c头文件的使用的小记录
    Mybatis介绍
    spring tool suite开发环境搭建
    一个简单的jsp+servlet登录界面的总结
    纠正关于线程的错误理解
    表达式语言EL简单学习
    [BZOJ 1804] Flood
    [POJ 1739] Tony's Tour
  • 原文地址:https://www.cnblogs.com/iiiDragon/p/9405451.html
Copyright © 2011-2022 走看看