zoukankan      html  css  js  c++  java
  • 01-编译azkaban

    01-基本环境

    1.操作系统

    CentOS7

    2.azkaban版本

    azkaban 3.81.0

    02-azkaban下载

    1.azkaban下载地址

    https://azkaban.github.io/downloads.html

    2.azkaban官方文档地址

    https://azkaban.readthedocs.io/en/latest/

    03-编译azkaban

    1.将azkaban源码zip包解压

     

    2.提前准备gradle对应版本的zip

    为了方便编译,查看gradle配置文件,提前下载“gradle-4.6-all”

    1)修改gradle配置文件azkaban-master/gradle/wrapper/gradle-wrapper.properties

    2)将gradle-4.6-all压缩包放在azkaban-master/gradle/wrapper/目录下

    #
    # Copyright 2018 LinkedIn Corp.
    #
    # Licensed under the Apache License, Version 2.0 (the "License"); you may not
    # use this file except in compliance with the License. You may obtain a copy of
    # the License at
    #
    # http://www.apache.org/licenses/LICENSE-2.0
    #
    # Unless required by applicable law or agreed to in writing, software
    # distributed under the License is distributed on an "AS IS" BASIS, WITHOUT
    # WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the
    # License for the specific language governing permissions and limitations under
    # the License.
    #
    
    distributionBase=GRADLE_USER_HOME
    distributionPath=wrapper/dists
    zipStoreBase=GRADLE_USER_HOME
    zipStorePath=wrapper/dists
    #修改为本地gradle压缩包
    #distributionUrl=https://services.gradle.org/distributions/gradle-4.6-all.zip
    distributionUrl=gradle-4.6-all.zip

    3.按顺序执行构建命令

     1 # Build Azkaban
     2 ./gradlew build
     3 
     4 # Clean the build
     5 ./gradlew clean
     6 
     7 # Build and install distributions
     8 ./gradlew installDist
     9 
    10 # Run tests
    11 ./gradlew test
    12 
    13 # Build without running tests
    14 ./gradlew build -x test

     4.获取tar包

    编译好的tar包在如下目录

    1)solo模式azkaban

    azkaban-master/azkaban-solo-server/build/distributions

    2) Multi Executor Server模式azkaban

    azkaban-master/azkaban-web-server/build/distributions2

    azkaban-master/azkaban-exec-server/build/distributions

    3) Multi Executor Server模式MySQL元数据初始化脚本

    azkaban-master/azkaban-db/build/distributions
    4)hadoop相关的插件
    azkaban-master/azkaban-hadoop-security-plugin/build/distributions
    5)还有一些其他的插件

    04-可能遇到的问题

    1.执行“./gradlew build” 出现time out 错误

    解决方案:重新执行“./gradlew build” 命令即可

    原因:网络链接不稳定

    备注:这个问题会频繁遇到

  • 相关阅读:
    SpringFlex框架搭建
    SqlDataReader的用法 转自https://www.cnblogs.com/sunxi/p/3924954.html
    C#学习笔记:ListBox控件的用法
    C#栈Stack的使用
    C# 队列Queue
    xshell传送文件
    Java基础中字符串与字符的注意点!
    大数据的基础学习:
    Python的空行
    Python基本语法
  • 原文地址:https://www.cnblogs.com/zhaoxj127/p/12060764.html
Copyright © 2011-2022 走看看