zoukankan      html  css  js  c++  java
  • oozie 常用命令

    1.验证wokflow.xml
    oozie validate /appcom/apps/hduser0401/mbl_webtrends/workflow.xml 

    2.提交作业,作业进入PREP状态 
    oozie job -oozie http://localhost:11000/oozie -config job.properties -submit 
    job: 14-20090525161321-oozie-joe


    3.执行已提交的作业

    oozie job -oozie

    http://localhost:11000/oozie -start 14-20090525161321-oozie-joe 

     查看oozie服务状态:

    oozie  admin -oozie http://localhost:11000/oozie -status

    4.直接运行作业 
    oozie job -oozie http://localhost:11000/oozie -config job.properties -run 

     #-D job_start=2016-11-10T02:00+0800 -- 起始日期(当天)
    #-D job_end=2016-11-11T02:00+0800 -- 结束日期(当天+1)

    5.挂起作业,挂起前状态(RUNNING , RUNNIINGWITHERROR or PREP状态) 
    workflow job will be in SUSPENDED status. 

    6.杀死作业 
    oozie job -oozie http://localhost:11000/oozie -kill 14-20090525161321-oozie-joe 

    7.改变作业参数,不能修改killed状态的作业 
    oozie job -oozie http://localhost:11000/oozie -change 14-20090525161321-oozie-joe -value endtime=2011-12-01T05:00Z;concurrency=100;2011-10-01T05:00Z 

    8.重新运行作业 
    oozie job -oozie http://localhost:11000/oozie -config job.properties -rerun 14-20090525161321-oozie-joe 
    000000-130817230824019-oozie-ceny-W 
    Rerunning a Coordinator Action or Multiple Actions 
    $oozie job -rerun <coord_Job_id> [-nocleanup] [-refresh] 
    [-action 1, 3-4, 7-40] (-action or -date is required to rerun.) 
    [-date 2009-01-01T01:00Z::2009-05-31T23:59Z, 2009-11-10T01:00Z, 2009-12-31T22:00Z] 
    Rerunning a Bundle Job 
    oozie job -rerun <bundle_Job_id> [-nocleanup] [-refresh] 
    [-coordinator c1, c3, c4] (-coordinator or -date is required to rerun.) 
    [-date 2009-01-01T01:00Z::2009-05-31T23:59Z, 2009-11-10T01:00Z, 2009-12-31T22:00Z] 
    (if neither -coordinator nor -date is given, the exception will be thrown.)

    9.检查作业状态 
    oozie job -oozie http://localhost:11000/oozie -info 14-20090525161321-oozie-joe

    oozie job -oozie http://localhost:11000/oozie -info 0000001-111219170928042-oozie-para-W@mr-node -verbose 

    10.查看日志 
    oozie job -oozie http://localhost:11000/oozie -log 14-20090525161321-oozie-joe 
    oozie job -log <coord_job_id> [-action 1, 3-4, 7-40] (-action is optional.)

    11.提交pig作业 
    oozie pig -oozie http://localhost:11000/oozie -file pigScriptFile -config job.properties -X -param_file params

    12.提交MR作业 
    oozie mapreduce -oozie http://localhost:11000/oozie -config job.properties

    usage: 
          the env variable 'OOZIE_URL' is used as default value for the '-oozie' option 
          the env variable 'OOZIE_TIMEZONE' is used as default value for the '-timezone' option 
          custom headers for Oozie web services can be specified using '-Dheader:NAME=VALUE'      oozie help : display usage 

          oozie version : show client version 

          oozie job <OPTIONS> : job operations 
                    -action <arg>         coordinator rerun on action ids (requires -rerun); coordinator log retrieval on action ids (requires -log) 
                    -auth <arg>           select authentication type [SIMPLE|KERBEROS] 
                    -change <arg>         change a coordinator/bundle job 
                    -config <arg>         job configuration file '.xml' or '.properties' 
                    -D <property=value>   set/override value for given property 
                    -date <arg>           coordinator/bundle rerun on action dates (requires -rerun) 
                    -definition <arg>     job definition 
                    -doas <arg>           doAs user, impersonates as the specified user 
                    -dryrun               Dryrun a workflow (since 3.3.2) or coordinator (since 2.0) job without actually executing it 
                    -info <arg>           info of a job 
                    -kill <arg>           kill a job 
                    -len <arg>            number of actions (default TOTAL ACTIONS, requires -info) 
                    -localtime            use local time (same as passing your time zone to -timezone). 
                                          Overrides -timezone option 
                    -log <arg>            job log 
                    -nocleanup            do not clean up output-events of the coordinator rerun actions 
                                          (requires -rerun) 
                    -offset <arg>         job info offset of actions (default '1', requires -info) 
                    -oozie <arg>          Oozie URL 
                    -refresh              re-materialize the coordinator rerun actions (requires -rerun) 
                    -rerun <arg>          rerun a job  (coordinator requires -action or -date; bundle requires -coordinator or -date) 
                    -resume <arg>         resume a job 
                    -run                  run a job 
                    -start <arg>          start a job 
                    -submit               submit a job 
                    -suspend <arg>        suspend a job 
                    -timezone <arg>       use time zone with the specified ID (default GMT). 
                                          See 'oozie info -timezones' for a list 
                    -value <arg>          new endtime/concurrency/pausetime value for changing a 
                                          coordinator job; new pausetime value for changing a bundle job 
                    -verbose              verbose mode 

          oozie jobs <OPTIONS> : jobs status 
                     -auth <arg>          select authentication type [SIMPLE|KERBEROS] 
                     -doas <arg>          doAs user, impersonates as the specified user.
                     -filter <arg>        user=<U>;name=<N>;group=<G>;status=<S>;... 
                     -jobtype <arg>       job type ('Supported in Oozie-2.0 or later versions ONLY - coordinator' or 'wf' (default)) 
                     -len <arg>           number of jobs (default '100') 
                     -localtime           use local time (same as passing your time zone to -timezone). Overrides -timezone option 
                     -offset <arg>        jobs offset (default '1') 
                     -oozie <arg>         Oozie URL 
                     -timezone <arg>      use time zone with the specified ID (default GMT). See 'oozie info -timezones' for a list 
                     -verbose             verbose mode 

          oozie admin <OPTIONS> : admin operations 
                      -auth <arg>         select authentication type [SIMPLE|KERBEROS] 
                      -doas <arg>         doAs user, impersonates as the specified user.
                      -oozie <arg>        Oozie URL 
                      -queuedump          show Oozie server queue elements 
                      -status             show the current system status 
                      -systemmode <arg>   Supported in Oozie-2.0 or later versions ONLY. Change oozie 
                                          system mode [NORMAL|NOWEBSERVICE|SAFEMODE] 
                      -version            show Oozie server build version 

          oozie validate <ARGS> : validate a workflow XML file 

          oozie sla <OPTIONS> : sla operations (Supported in Oozie-2.0 or later) 
                    -auth <arg>           select authentication type [SIMPLE|KERBEROS] 
                    -len <arg>            number of results (default '100', max limited by oozie server setting which defaults to '1000') 
                    -offset <arg>         start offset (default '0') 
                    -oozie <arg>          Oozie URL 
                    -filter <arg>         jobid=<JobID/ActionID>;appname=<Application Name> 

          oozie pig <OPTIONS> -X <ARGS> : submit a pig job, everything after '-X' are pass-through parameters to pig 
                    -auth <arg>           select authentication type [SIMPLE|KERBEROS] 
                    -doas <arg>           doAs user, impersonates as the specified user.
                    -config <arg>         job configuration file '.properties' 
                    -D <property=value>   set/override value for given property 
                    -file <arg>           Pig script 
                    -oozie <arg>          Oozie URL 

          oozie info <OPTIONS> : get more detailed info about specific topics 
                    -timezones   display a list of available time zones

  • 相关阅读:
    Linux添加系统环境变量
    keras 或 tensorflow 调用GPU报错:Blas GEMM launch failed
    python 安装虚拟环境
    Seq2Seq 到 Attention的演变
    聊天内容处理笔记
    LSTM 详解
    keras 打印模型图
    zip 的对象是不能用索引去取的
    c# 反射获取属性值 TypeUtils
    .iml文件恢复
  • 原文地址:https://www.cnblogs.com/ilinuxer/p/6804515.html
Copyright © 2011-2022 走看看