zoukankan      html  css  js  c++  java
  • apache-kylin-2.5.2-bin-cdh57与cdh-5.13.0集群整合运用

    1.下载kylin最新版apache-kylin-2.5.2-bin-cdh57;

    2.解压配置环境变量;

    export BASE_PATH="/opt/cloudera/parcels/CDH/lib"
    
    #added by hbase
    export HBASE_HOME="$BASE_PATH/hbase"
    export PATH="$HBASE_HOME/bin:$PATH"
    
    #added by HCat
    export HCAT_HOME="$BASE_PATH/hive-hcatalog"
    
    #added by kylin
    export KYLIN_HOME="/opt/kylin"
    
    export JAVA_HOME="/usr/java/jdk1.8.0_152"
    export PATH="$JAVA_HOME/bin:$PATH"

    3.修改kylin中配置文件kylin.properties

    ## List of web servers in use, this enables one web server instance to sync up with other servers.
    kylin.server.cluster-servers=hadoopnode3:7070

    添加:

    #add by yourself
    kylin.job.jar=/opt/kylin/lib/kylin-job-2.5.2.jar
    
    kylin.coprocessor.local.jar=/opt/kylin/lib/kylin-coprocessor-2.5.2.jar
    
    kylin.job.yarn.app.rest.check.status.url=http://hadoopnode3:8088/ws/v1/cluster/apps/${job_id}?anonymous=true

    4.kafka streaming cude 构建:

    bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic kylin_streaming_topic
    ##发送kafka消息
    ./kylin.sh org.apache.kylin.source.kafka.util.KafkaSampleProducer --topic kylin_streaming_topic --broker hadoopnode2:9092
  • 相关阅读:
    P1169 [ZJOI2007]棋盘制作
    P4147 玉蟾宫
    P1387 最大正方形
    动态规划之悬线法
    P2330 [SCOI2005]繁忙的都市
    最小生成树
    P2936 [USACO09JAN]全流Total Flow
    Python开发之规范化目录
    python模块知识四 包和logging日志
    python模块知识三 hashlib 加密模块、collections、re模块
  • 原文地址:https://www.cnblogs.com/gxc2015/p/10209365.html
Copyright © 2011-2022 走看看