zoukankan      html  css  js  c++  java
  • hive中分析函数window子句

    hive中有些分析函数功能确实很强大,在和sum,max等聚合函数结合起来能实现不少功能。

    直接上代码演示吧

    原始数据

    channel1	2016-11-10	1
    channel1	2016-11-11	3
    channel1	2016-11-12	5
    channel1	2016-11-13	6
    channel1	2016-11-14	2
    channel1	2016-11-15	4
    channel2	2016-11-10	5
    channel2	2016-11-11	3
    channel2	2016-11-12	5
    channel2	2016-11-13	2
    

    创建表

    CREATE TABLE test (
    channel string,
    createtime string,   --day 
    pv INT
    ) ROW FORMAT DELIMITED 
    FIELDS TERMINATED BY '	' 
    

    语句以及结果

    SELECT 
    channel,
    createtime,
    pv,
    SUM(pv) OVER(PARTITION BY channel ORDER BY createtime) AS pv1, 
    SUM(pv) OVER(PARTITION BY channel ORDER BY createtime ROWS BETWEEN UNBOUNDED PRECEDING AND CURRENT ROW) AS pv2, 
    SUM(pv) OVER(PARTITION BY channel) AS pv3,
    SUM(pv) OVER(PARTITION BY channel ORDER BY createtime ROWS BETWEEN 3 PRECEDING AND CURRENT ROW) AS pv4,  
    SUM(pv) OVER(PARTITION BY channel ORDER BY createtime ROWS BETWEEN 3 PRECEDING AND 1 FOLLOWING) AS pv5,  
    SUM(pv) OVER(PARTITION BY channel ORDER BY createtime ROWS BETWEEN CURRENT ROW AND UNBOUNDED FOLLOWING) AS pv6  
    FROM test;
                                    pv     pv1     pv2     pv3     pv4      pv5    pv6
    channel1	2016-11-15	4	21	21	21	17	17	4
    channel1	2016-11-14	2	17	17	21	16	20	6
    channel1	2016-11-13	6	15	15	21	15	17	12
    channel1	2016-11-12	5	9	9	21	9	15	17
    channel1	2016-11-11	3	4	4	21	4	9	20
    channel1	2016-11-10	1	1	1	21	1	4	21
    channel2	2016-11-13	2	15	15	15	15	15	2
    channel2	2016-11-12	5	13	13	15	13	15	7
    channel2	2016-11-11	3	8	8	15	8	13	10
    channel2	2016-11-10	5	5	5	15	5	8	15
    

    分析结果,以channel1 列

    pv1 结果是取起点到当前行的积累,比如:10号=10号  11号=10号+11号  12号=10号+11号+12号 以此类推

    pv2 和pv1的结果是一样的。

    pv3 就是分组channel的pv的聚合

    pv4 就是分组内当前行向前+3 行  15号=15+14+13+12  14号=14+13+12+11  13号=13号+12号+11号 以此类推

    pv5 就是分组内当前行往前+3行 往后加+1行   15号=14+13+12+11  14号=14号+13号+12号+11号+15号 以此类推

    pv6 就是当前行+往后所有行

    如果不指定rows between 默认为从起点到当前行  如果不指定order by 默认则将分组内累加

    PRECEDING:往前
    FOLLOWING:往后
    CURRENT ROW:当前行
    UNBOUNDED:起点,UNBOUNDED PRECEDING 表示从前面的起点, UNBOUNDED FOLLOWING:表示到后面的终点

  • 相关阅读:
    java中this关键字
    java继承
    java super关键字
    java String类型存储详解
    java四种访问权限修饰符
    C/C++语言void及void指针深层探索【转】
    Linux Epoll介绍和程序实例【转】http://blog.csdn.net/sparkliang/article/details/4770655
    服务器与wp7的socket通信【转】 http://www.cnblogs.com/linzheng/archive/2011/06/21/2086456.html
    android关于socket编程,以聊天为例【转】http://hi.baidu.com/yaoyuanhuajx/item/9b93d7565f315ba9acc857d7
    Tesseract 3 语言数据的训练方法【转】http://blog.csdn.net/dragoo1/article/details/8439373
  • 原文地址:https://www.cnblogs.com/wujin/p/6126276.html
Copyright © 2011-2022 走看看