zoukankan      html  css  js  c++  java
  • 报错:Sqoop Failing this attempt. Failing the application.

    报错背景

    sqoop将HBase的数据导入到HDFS

    报错现象

    20/10/29 17:17:48 INFO mapreduce.Job: Running job: job_1603962187772_0001
    20/10/29 17:17:53 INFO mapreduce.Job: Job job_1603962187772_0001 running in uber mode : false
    20/10/29 17:17:53 INFO mapreduce.Job:  map 0% reduce 0%
    20/10/29 17:17:53 INFO mapreduce.Job: Job job_1603962187772_0001 failed with state FAILED due to: Application application_1603962187772_0001 failed 2 times due to AM Container for appattempt_1603962187772_0001_000002 exited with  exitCode: 1
    For more detailed output, check application tracking page:http://basecoalmine:8088/cluster/app/application_1603962187772_0001Then, click on links to logs of each attempt.
    Diagnostics: Exception from container-launch.
    Container id: container_e08_1603962187772_0001_02_000001
    Exit code: 1
    Stack trace: ExitCodeException exitCode=1: 
        at org.apache.hadoop.util.Shell.runCommand(Shell.java:585)
        at org.apache.hadoop.util.Shell.run(Shell.java:482)
        at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:776)
        at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:212)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
        at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
        at java.util.concurrent.FutureTask.run(FutureTask.java:266)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)
    
    
    Container exited with a non-zero exit code 1
    Failing this attempt. Failing the application.
    20/10/29 17:17:53 INFO mapreduce.Job: Counters: 0
    20/10/29 17:17:53 WARN mapreduce.Counters: Group FileSystemCounters is deprecated. Use org.apache.hadoop.mapreduce.FileSystemCounter instead
    20/10/29 17:17:53 INFO mapreduce.ImportJobBase: Transferred 0 bytes in 19.4517 seconds (0 bytes/sec)
    20/10/29 17:17:53 WARN mapreduce.Counters: Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead
    20/10/29 17:17:53 INFO mapreduce.ImportJobBase: Retrieved 0 records.
    20/10/29 17:17:53 ERROR tool.ImportTool: Error during import: Import job failed!

    报错原因

    不知

    报错解决

    修改 mapred-site.xml

      <property>
        <name>vix.mapreduce.framework.name</name>
        <value>yarn</value>
      </property>

    修改 yarn-site.xml

        <property>
            <name>vix.yarn.resourcemanager.address</name>
            <value>basecoalmine:18040</value>
        </property>
        <property>
            <name>vix.yarn.resourcemanager.scheduler.address</name>
            <value>basecoalmine:1800</value>
        </property>
  • 相关阅读:
    readystatechange事件
    DOMContentLoaded事件
    beforeunload事件
    jieba
    模型评估
    机器学习术语
    决策树
    kafka
    即时通讯好文
    HTTP头的Expires与Cache-control
  • 原文地址:https://www.cnblogs.com/chuijingjing/p/13897986.html
Copyright © 2011-2022 走看看