zoukankan      html  css  js  c++  java
  • hadoop+spark+kudu

    1.spark 和kudu 的兼容版本

    Spark Integration Known Issues and Limitations
    Spark 2.2+ requires Java 8 at runtime even though Kudu Spark 2.x integration is Java 7 compatible. Spark 2.2 is the default dependency version as of Kudu 1.5.0.
    
    Kudu tables with a name containing upper case or non-ascii characters must be assigned an alternate name when registered as a temporary table.
    
    Kudu tables with a column name containing upper case or non-ascii characters may not be used with SparkSQL. Columns may be renamed in Kudu to work around this issue.
    
    <> and OR predicates are not pushed to Kudu, and instead will be evaluated by the Spark task. Only LIKE predicates with a suffix wildcard are pushed to Kudu, meaning that LIKE "FOO%" is pushed down but LIKE "FOO%BAR" isn’t.
    
    Kudu does not support every type supported by Spark SQL. For example, Date and complex types are not supported.
    
    Kudu tables may only be registered as temporary tables in SparkSQL. Kudu tables may not be queried using HiveContext.

    spark 2.2 需要 kudu 1.5.0

  • 相关阅读:
    System.DateUtils 1. DateOf、TimeOf 简单修饰功能
    Servlet高级
    Servlet基础
    AOP的基本概念
    Bean的定义及作用域的注解实现
    Bean
    centos7系统下,配置学校客户端网络记录
    CUDA并行编程思维过程
    CUDA(GPU)OPENCV
    3-决策树
  • 原文地址:https://www.cnblogs.com/chengjunhao/p/8718036.html
Copyright © 2011-2022 走看看