Oozie 实战之 Hive

1.编辑job.propertiers

nameNode=hdfs://cen-ubuntu.cenzhongman.com:8020
jobTracker=localhost:8032
queueName=default
oozieAppsRoot=oozie-apps

oozie.use.system.libpath=true

oozie.wf.application.path=({nameNode}/user/cen/){oozieAppsRoot}/hive-select/
outputDir=hive-select/output

2.添加lib文件夹

3.复制MySQL的API到lib下

4.复制hive-site.xml文件到目录下

5.编辑workflow

  <action name="hive-node">
      <hive xmlns="uri:oozie:hive-action:0.5">
          <job-tracker>${jobTracker}</job-tracker>
          <name-node>${nameNode}</name-node>
          <prepare>
              <delete path="${nameNode}/user/cen/${oozieAppsRoot}/${outputDir}"/>
          </prepare>
          <job-xml>${nameNode}/user/cen/${oozieAppsRoot}/hive-select/hive-site</job-xml>
          <configuration>
              <property>
                  <name>mapred.job.queue.name</name>
                  <value>${queueName}</value>
              </property>
          </configuration>
          <script>select.sql</script>
          <param>OUTPUT=/user/cen/${oozieAppsRoot}/${outputDir}</param>
      </hive>
      <ok to="end"/>
      <error to="fail"/>
  </action>

  <kill name="fail">
      <message>Hive failed, error message[${wf:errorMessage(wf:lastErrorNode())}]</message>
  </kill>
  <end name="end"/>

注意事项(对比example文件)

• 更新版本两个
• 无需使用新api
• 添加({nameNode}/user/cen/){oozieAppsRoot}/hive-select/hive-site用以说明配置文件位置
• 添加指明SQL文件
• 添加OUTPUT=/user/cen/({oozieAppsRoot}/){outputDir}说明输出目录[可选]

6.上传文件

7.执行文件

export OOZIE_URL=http://cen-ubuntu:11000/oozie/
bin/oozie job -config oozie-apps/hive-select/job.properties -run