zoukankan      html  css  js  c++  java
  • Mapreduce读取Hbase表,写数据到多个Hbase表中

    Job端的变化:

    通过设置conf,配置输出表,在reduce中获取输出表名字

    Configuration conf = job.getConfiguration();
    //输出表1
    conf.set("usertag_output", "usertag");
    //输出表2
    conf.set("prodtag_output", "prodtag");
         job.setReducerClass(LabelReducer.class);
            job.setOutputValueClass(Put.class);
            job.setOutputFormatClass(MultiTableOutputFormat.class);
    

     

    LabelReducer:

    @Override
    public void reduce(Text key, Iterable<Text> values, Context context)
    throws IOException, InterruptedException
    {

    .......
    Put put = new Put(userid.getBytes());
    put.add("usertags".getBytes(), "usertags".getBytes(), outputlabel.toString().getBytes());
    

      

     ............

    ImmutableBytesWritable ib = new ImmutableBytesWritable();
    ib.set(Bytes.toBytes(usertag_output)); // 将结果存入hbase表 
    context.write(ib, put);
    

      

    }

  • 相关阅读:
    JSP&JavaBean
    Cookie&&Session
    多个请求使用同一个 Servlet
    C3P0--数据库连接池
    navicat设置唯一键——unique
    J2EE常用组件简介
    JSP基础知识_3
    JSP基础知识_2
    JSP基础知识_1
    Android
  • 原文地址:https://www.cnblogs.com/tmeily/p/4514004.html
Copyright © 2011-2022 走看看