zoukankan      html  css  js  c++  java
  • hive多分区写入

    hive多分区写入

    -- 多分区写入
    set mapred.max.split.size=256000000;
    set hive.exec.dynamic.partition.mode=nonstrict;
    set hive.exec.max.dynamic.partitions=800;
    set hive.exec.max.dynamic.partitions.pernode=800;
    
    INSERT overwrite table ods.im_session_content_record partition(`date`)
    select
    -999 as source_type,
    a.cid,
    a.sid,
    a.vccid,
    a.userid,
    current_timestamp as bi_update_datetime,
    to_date(from_unixtime(cast(cont.createTime as int))) as `date`
    from ods.im_session_content a LATERAL VIEW explode(content) bb AS cont
    where from_unixtime(cast(cont.createTime as int)) < '2018-11-25'
    ;
    
    INSERT overwrite table ods.im_session_content_record partition(`date`)
    select
    -999 as source_type,
    a.cid,
    a.sid,
    a.vccid,
    a.userid,
    current_timestamp as bi_update_datetime,
    to_date(from_unixtime(cast(cont.createTime as int))) as `date`
    from ods.im_session_content a LATERAL VIEW explode(content) bb AS cont
    where from_unixtime(cast(cont.createTime as int)) >= '2018-11-25'
    and from_unixtime(cast(cont.createTime as int)) < '2018-12-02'
    ;
    
  • 相关阅读:
    Makefile编写
    C++静态库与动态库
    C语言编译过程详解
    Fiddler抓HTTPS
    web测试的一些关注点
    Appium使用过程中的一些坑
    Jmeter+Maven+Jenkins的搭建笔记
    华为DHCP+VLANDHCP RELAY配置重点
    华为GVRP配置重点
    802.11协议总结
  • 原文地址:https://www.cnblogs.com/myblog1900/p/11539989.html
Copyright © 2011-2022 走看看