zoukankan      html  css  js  c++  java
  • Flume

    http://www.iteblog.com/archives/1043

    http://www.iteblog.com/archives/908

    http://www.iteblog.com/archives/1034

    In flume-ng's HBase sink, HbaseEventSerializer implementation is responsible for generating row keys. The default implementation org.apache.flume.sink.hbase.SimpleHbaseEventSerializer already supports generating timestamp row keys in the format prefix + current timestamp, to use it just modify your flume configuration accordinly.

    hbase-agent.sinks.sink1.type = org.apache.flume.sink.hbase.HBaseSink
    hbase-agent.sinks.sink1.channel = ch1
    hbase-agent.sinks.sink1.table = demo
    hbase-agent.sinks.sink1.columnFamily = cf
    hbase-agent.sinks.sink1.serializer = org.apache.flume.sink.hbase.SimpleHbaseEventSerializer
    hbase-agent.sinks.sink1.serializer.payloadColumn = col1
    hbase-agent.sinks.sink1.serializer.keyType = timestamp
    

    If the provided timestamp based key generation method is not what you are after then you'll need to provide a custom HbaseEventSerializer implementation to flume, which will require you to:

    1. Create your own row key generator class (the default one is org.apache.flume.sink.hbase.SimpleRowKeyGenerator)
    2. Create your own implementation of the HbaseEventSerializer interface (default implementation is org.apache.flume.sink.hbase.SimpleHbaseEventSerializer) which will use the custom row key generator you created in first step
    3. Modify your flume hbase sink configuration to use the custom HbaseEventSerializer implementation.

    http://www.kankanews.com/ICkengine/archives/67816.shtml

    http://search-hadoop.com/?q=prefix+salt+key+hotspot&fc_project=HBase

  • 相关阅读:
    Linux常用命令-学习笔记
    Linux 输入输出重定向
    Linux 网卡配置参数
    JS Promise对象学习
    Linux用户身份与文件权限学习笔记
    4、点击事件
    3、自定义按压效果
    2、自定义背景形状
    1、文字大小,颜色
    5、跑马灯
  • 原文地址:https://www.cnblogs.com/diyunpeng/p/3920325.html
Copyright © 2011-2022 走看看