zoukankan      html  css  js  c++  java
  • apache-kylin-2.5.2-bin-cdh57与cdh-5.13.0集群整合运用

    1.下载kylin最新版apache-kylin-2.5.2-bin-cdh57;

    2.解压配置环境变量;

    export BASE_PATH="/opt/cloudera/parcels/CDH/lib"
    
    #added by hbase
    export HBASE_HOME="$BASE_PATH/hbase"
    export PATH="$HBASE_HOME/bin:$PATH"
    
    #added by HCat
    export HCAT_HOME="$BASE_PATH/hive-hcatalog"
    
    #added by kylin
    export KYLIN_HOME="/opt/kylin"
    
    export JAVA_HOME="/usr/java/jdk1.8.0_152"
    export PATH="$JAVA_HOME/bin:$PATH"

    3.修改kylin中配置文件kylin.properties

    ## List of web servers in use, this enables one web server instance to sync up with other servers.
    kylin.server.cluster-servers=hadoopnode3:7070

    添加:

    #add by yourself
    kylin.job.jar=/opt/kylin/lib/kylin-job-2.5.2.jar
    
    kylin.coprocessor.local.jar=/opt/kylin/lib/kylin-coprocessor-2.5.2.jar
    
    kylin.job.yarn.app.rest.check.status.url=http://hadoopnode3:8088/ws/v1/cluster/apps/${job_id}?anonymous=true

    4.kafka streaming cude 构建:

    bin/kafka-topics.sh --create --zookeeper localhost:2181 --replication-factor 1 --partitions 1 --topic kylin_streaming_topic
    ##发送kafka消息
    ./kylin.sh org.apache.kylin.source.kafka.util.KafkaSampleProducer --topic kylin_streaming_topic --broker hadoopnode2:9092
  • 相关阅读:
    7大python 深度学习框架的描述及优缺点绍
    nodejs 和 js
    python操redis
    python ConfigParser 的小技巧
    RHEL 7.3修改网卡命名规则为ethX
    redhat7.3配置163 yum源
    分区脚本(fdisk)
    linux之sed用法
    linux awk命令详解
    Python 装饰器学习
  • 原文地址:https://www.cnblogs.com/gxc2015/p/10209365.html
Copyright © 2011-2022 走看看