zoukankan      html  css  js  c++  java
  • Oozie java.io.IOException: output.properties data exceeds its limit [2048]

    在使用oozie调用sqoop时,报了下边这个错

    Launcher AM execution failed
    java.io.IOException: output.properties data exceeds its limit [2048]
        at org.apache.oozie.action.hadoop.LocalFsOperations.getLocalFileContentAsString(LocalFsOperations.java:86)
        at org.apache.oozie.action.hadoop.LauncherAM.processActionData(LauncherAM.java:521)
        at org.apache.oozie.action.hadoop.LauncherAM.handleActionData(LauncherAM.java:501)
        at org.apache.oozie.action.hadoop.LauncherAM.run(LauncherAM.java:229)
        at org.apache.oozie.action.hadoop.LauncherAM$1.run(LauncherAM.java:153)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1685)
        at org.apache.oozie.action.hadoop.LauncherAM.main(LauncherAM.java:141)
    Exception in thread "main" java.io.IOException: output.properties data exceeds its limit [2048]
        at org.apache.oozie.action.hadoop.LocalFsOperations.getLocalFileContentAsString(LocalFsOperations.java:86)
        at org.apache.oozie.action.hadoop.LauncherAM.processActionData(LauncherAM.java:521)
        at org.apache.oozie.action.hadoop.LauncherAM.handleActionData(LauncherAM.java:501)
        at org.apache.oozie.action.hadoop.LauncherAM.run(LauncherAM.java:229)
        at org.apache.oozie.action.hadoop.LauncherAM$1.run(LauncherAM.java:153)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:422)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1685)
        at org.apache.oozie.action.hadoop.LauncherAM.main(LauncherAM.java:141)

    解决

    输出大小默认是2048,在oozie-site.xml修改配置,重启
    <property>
        <name>oozie.action.max.output.data</name>
        <value>204800</value>
    </property>
  • 相关阅读:
    latch与DFF
    数字逻辑综合DC脚本示例及解释
    当DiscuzNT遇上了Loadrunner(下)
    [C#学习]在多线程中如何调用Winform
    并发性测试工具
    当DiscuzNT遇上了Loadrunner(上)
    大型网站(高访问、海量数据)技术架构
    Load Runner下载
    Invoke 和 BeginInvoke 的真正涵义
    当DiscuzNT遇上了Loadrunner(中)
  • 原文地址:https://www.cnblogs.com/EnzoDin/p/10548405.html
Copyright © 2011-2022 走看看