zoukankan      html  css  js  c++  java
  • 01-编译azkaban

    01-基本环境

    1.操作系统

    CentOS7

    2.azkaban版本

    azkaban 3.81.0

    02-azkaban下载

    1.azkaban下载地址

    https://azkaban.github.io/downloads.html

    2.azkaban官方文档地址

    https://azkaban.readthedocs.io/en/latest/

    03-编译azkaban

    1.将azkaban源码zip包解压

     

    2.提前准备gradle对应版本的zip

    为了方便编译,查看gradle配置文件,提前下载“gradle-4.6-all”

    1)修改gradle配置文件azkaban-master/gradle/wrapper/gradle-wrapper.properties

    2)将gradle-4.6-all压缩包放在azkaban-master/gradle/wrapper/目录下

    #
    # Copyright 2018 LinkedIn Corp.
    #
    # Licensed under the Apache License, Version 2.0 (the "License"); you may not
    # use this file except in compliance with the License. You may obtain a copy of
    # the License at
    #
    # http://www.apache.org/licenses/LICENSE-2.0
    #
    # Unless required by applicable law or agreed to in writing, software
    # distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
    # WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
    # License for the specific language governing permissions and limitations under
    # the License.
    #
    
    distributionBase=GRADLE_USER_HOME
    distributionPath=wrapper/dists
    zipStoreBase=GRADLE_USER_HOME
    zipStorePath=wrapper/dists
    #修改为本地gradle压缩包
    #distributionUrl=https://services.gradle.org/distributions/gradle-4.6-all.zip
    distributionUrl=gradle-4.6-all.zip

    3.按顺序执行构建命令

     1 # Build Azkaban
     2 ./gradlew build
     3 
     4 # Clean the build
     5 ./gradlew clean
     6 
     7 # Build and install distributions
     8 ./gradlew installDist
     9 
    10 # Run tests
    11 ./gradlew test
    12 
    13 # Build without running tests
    14 ./gradlew build -x test

     4.获取tar包

    编译好的tar包在如下目录

    1)solo模式azkaban

    azkaban-master/azkaban-solo-server/build/distributions

    2) Multi Executor Server模式azkaban

    azkaban-master/azkaban-web-server/build/distributions2

    azkaban-master/azkaban-exec-server/build/distributions

    3) Multi Executor Server模式MySQL元数据初始化脚本

    azkaban-master/azkaban-db/build/distributions
    4)hadoop相关的插件
    azkaban-master/azkaban-hadoop-security-plugin/build/distributions
    5)还有一些其他的插件

    04-可能遇到的问题

    1.执行“./gradlew build” 出现time out 错误

    解决方案:重新执行“./gradlew build” 命令即可

    原因:网络链接不稳定

    备注:这个问题会频繁遇到

  • 相关阅读:
    saltstack编写自定义模块
    saltstack数据系统Pliiar
    saltstack数据系统Grains
    saltstack正则匹配主机
    docker安装httpd+php为zabbix提供web服务
    saltstack安装部署
    zabbix报警(向消息中心发送报警信息)
    selenium用css、xpath表达式进行元素定位
    pytest+allure基础知识
    pythonGUI-PySide2的使用笔记
  • 原文地址:https://www.cnblogs.com/zhaoxj127/p/12060764.html
Copyright © 2011-2022 走看看