zoukankan      html  css  js  c++  java
  • oozie执行报错日志

    Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.ShellMain], main() threw exception, Cannot run program "p1.sh" (in directory "/opt/module/cdh/hadoop-2.5.0-cdh5.3.6/data/tmp/nm-local-dir/usercache/lxl/appcache/application_1560704889158_0005/container_1560704889158_0005_01_000002"): error=2, 没有那个文件或目录
    java.io.IOException: Cannot run program "p1.sh" (in directory "/opt/module/cdh/hadoop-2.5.0-cdh5.3.6/data/tmp/nm-local-dir/usercache/lxl/appcache/application_1560704889158_0005/container_1560704889158_0005_01_000002"): error=2, 没有那个文件或目录
        at java.lang.ProcessBuilder.start(ProcessBuilder.java:1048)
        at org.apache.oozie.action.hadoop.ShellMain.execute(ShellMain.java:93)
        at org.apache.oozie.action.hadoop.ShellMain.run(ShellMain.java:55)
        at org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:39)
        at org.apache.oozie.action.hadoop.ShellMain.main(ShellMain.java:47)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:227)
        at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
        at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:450)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1642)
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:163)
    Caused by: java.io.IOException: error=2, 没有那个文件或目录
        at java.lang.UNIXProcess.forkAndExec(Native Method)
        at java.lang.UNIXProcess.<init>(UNIXProcess.java:247)
        at java.lang.ProcessImpl.start(ProcessImpl.java:134)
        at java.lang.ProcessBuilder.start(ProcessBuilder.java:1029)
        ... 17 more
    
    Log Type: stdout
    
    Log Length: 81310
    
    Showing 4096 bytes of 81310 total. Click here for the full log.
    
    odule/cdh/hadoop-2.5.0-cdh5.3.6/share/hadoop/common/*:/opt/module/cdh/hadoop-2.5.0-cdh5.3.6/share/hadoop/common/lib/*:/opt/module/cdh/hadoop-2.5.0-cdh5.3.6/share/hadoop/hdfs/*:/opt/module/cdh/hadoop-2.5.0-cdh5.3.6/share/hadoop/hdfs/lib/*:/opt/module/cdh/hadoop-2.5.0-cdh5.3.6/share/hadoop/yarn/*:/opt/module/cdh/hadoop-2.5.0-cdh5.3.6/share/hadoop/yarn/lib/*:/opt/module/cdh/hadoop-2.5.0-cdh5.3.6/share/hadoop/mapreduce/*:/opt/module/cdh/hadoop-2.5.0-cdh5.3.6/share/hadoop/mapreduce/lib/*:job.jar/job.jar:job.jar/classes/:job.jar/lib/*:/opt/module/cdh/hadoop-2.5.0-cdh5.3.6/data/tmp/nm-local-dir/usercache/lxl/appcache/application_1560704889158_0005/container_1560704889158_0005_01_000002/*:
    SSH_CONNECTION=192.168.192.103 40453 192.168.192.102 22:
    HADOOP_TOKEN_FILE_LOCATION=/opt/module/cdh/hadoop-2.5.0-cdh5.3.6/data/tmp/nm-local-dir/usercache/lxl/appcache/application_1560704889158_0005/container_1560704889158_0005_01_000002/container_tokens:
    HADOOP_NFS3_OPTS=:
    HADOOP_NAMENODE_OPTS=-Dhadoop.security.logger=INFO,RFAS -Dhdfs.audit.logger=INFO,NullAppender -Dhadoop.security.logger=INFO,RFAS -Dhdfs.audit.logger=INFO,NullAppender :
    QTDIR=/usr/lib64/qt-3.3:
    NLSPATH=/usr/dt/lib/nls/msg/%L/%N.cat:
    OOZIE_ACTION_CONF_XML=/opt/module/cdh/hadoop-2.5.0-cdh5.3.6/data/tmp/nm-local-dir/usercache/lxl/appcache/application_1560704889158_0005/container_1560704889158_0005_01_000002/action.xml:
    YARN_NICENESS=0:
    QTLIB=/usr/lib64/qt-3.3/lib:
    HOME=/home/:
    CONTAINER_ID=container_1560704889158_0005_01_000002:
    HADOOP_PORTMAP_OPTS=-Xmx512m -Xmx512m :
    MALLOC_ARENA_MAX=4:
    =================================================================
    
    >>> Invoking Shell command line now >>
    
    
    <<< Invocation of Main class completed <<<
    
    Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.ShellMain], main() threw exception, Cannot run program "p1.sh" (in directory "/opt/module/cdh/hadoop-2.5.0-cdh5.3.6/data/tmp/nm-local-dir/usercache/lxl/appcache/application_1560704889158_0005/container_1560704889158_0005_01_000002"): error=2, 没有那个文件或目录
    java.io.IOException: Cannot run program "p1.sh" (in directory "/opt/module/cdh/hadoop-2.5.0-cdh5.3.6/data/tmp/nm-local-dir/usercache/lxl/appcache/application_1560704889158_0005/container_1560704889158_0005_01_000002"): error=2, 没有那个文件或目录
        at java.lang.ProcessBuilder.start(ProcessBuilder.java:1048)
        at org.apache.oozie.action.hadoop.ShellMain.execute(ShellMain.java:93)
        at org.apache.oozie.action.hadoop.ShellMain.run(ShellMain.java:55)
        at org.apache.oozie.action.hadoop.LauncherMain.run(LauncherMain.java:39)
        at org.apache.oozie.action.hadoop.ShellMain.main(ShellMain.java:47)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.apache.oozie.action.hadoop.LauncherMapper.map(LauncherMapper.java:227)
        at org.apache.hadoop.mapred.MapRunner.run(MapRunner.java:54)
        at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:450)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:343)
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1642)
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:163)
    Caused by: java.io.IOException: error=2, 没有那个文件或目录
        at java.lang.UNIXProcess.forkAndExec(Native Method)
        at java.lang.UNIXProcess.<init>(UNIXProcess.java:247)
        at java.lang.ProcessImpl.start(ProcessImpl.java:134)
        at java.lang.ProcessBuilder.start(ProcessBuilder.java:1029)
        ... 17 more
    
    Oozie Launcher failed, finishing Hadoop job gracefully
    
    Oozie Launcher, uploading action data to HDFS sequence file: hdfs://hadoop102:8020/user/lxl/oozie-lxl/0000000-190617051500311-oozie-lxl-W/shell-node--shell/action-data.seq
    
    Oozie Launcher ends
  • 相关阅读:
    python简单接口的测试(随机数等)
    关于数据库的去重+导入导出参数
    找到并杀死一个软件开启的进程
    blinker库
    HTTP状态码
    一致性哈希算法
    celery
    项目部署
    redis更多
    functools模块
  • 原文地址:https://www.cnblogs.com/LXL616/p/11037255.html
Copyright © 2011-2022 走看看