zoukankan      html  css  js  c++  java
  • hadoop jar wc.jar com.map.red.job.WordCountJob

    [root@bigdataspark ~]# hadoop jar wc.jar com.map.red.job.WordCountJob
    16/05/22 19:20:24 WARN mapreduce.JobSubmitter: Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
    16/05/22 19:20:24 WARN mapreduce.JobSubmitter: No job jar file set.  User classes may not be found. See Job or Job#setJar(String).
    16/05/22 19:20:24 INFO input.FileInputFormat: Total input paths to process : 1
    16/05/22 19:20:25 INFO mapreduce.JobSubmitter: number of splits:1
    16/05/22 19:20:25 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1464397668280_0004
    16/05/22 19:20:26 INFO mapred.YARNRunner: Job jar is not present. Not adding any jar to the list of resources.
    16/05/22 19:20:26 INFO impl.YarnClientImpl: Submitted application application_1464397668280_0004
    16/05/22 19:20:26 INFO mapreduce.Job: The url to track the job: http://bigdatastorm:8088/proxy/application_1464397668280_0004/
    16/05/22 19:20:26 INFO mapreduce.Job: Running job: job_1464397668280_0004
    16/05/22 19:20:49 INFO mapreduce.Job: Job job_1464397668280_0004 running in uber mode : false
    16/05/22 19:20:49 INFO mapreduce.Job:  map 0% reduce 0%
    16/05/22 19:21:12 INFO mapreduce.Job:  map 100% reduce 0%
    16/05/22 19:21:12 INFO mapreduce.Job: Task Id : attempt_1464397668280_0004_m_000000_0, Status : FAILED
    Error: java.lang.RuntimeException: java.lang.ClassNotFoundException: Class com.map.red.job.WordCountMapper not found
        at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1905)
        at org.apache.hadoop.mapreduce.task.JobContextImpl.getMapperClass(JobContextImpl.java:186)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:722)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:340)
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:415)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614)
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:163)
    Caused by: java.lang.ClassNotFoundException: Class com.map.red.job.WordCountMapper not found
        at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:1811)
        at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1903)
        ... 8 more

    16/05/22 19:21:13 INFO mapreduce.Job:  map 0% reduce 0%
    16/05/22 19:21:23 INFO mapreduce.Job: Task Id : attempt_1464397668280_0004_m_000000_1, Status : FAILED
    Error: java.lang.RuntimeException: java.lang.ClassNotFoundException: Class com.map.red.job.WordCountMapper not found
        at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1905)
        at org.apache.hadoop.mapreduce.task.JobContextImpl.getMapperClass(JobContextImpl.java:186)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:722)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:340)
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:415)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614)
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:163)
    Caused by: java.lang.ClassNotFoundException: Class com.map.red.job.WordCountMapper not found
        at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:1811)
        at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1903)
        ... 8 more

    16/05/22 19:21:34 INFO mapreduce.Job: Task Id : attempt_1464397668280_0004_m_000000_2, Status : FAILED
    Error: java.lang.RuntimeException: java.lang.ClassNotFoundException: Class com.map.red.job.WordCountMapper not found
        at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1905)
        at org.apache.hadoop.mapreduce.task.JobContextImpl.getMapperClass(JobContextImpl.java:186)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:722)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:340)
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:415)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614)
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:163)
    Caused by: java.lang.ClassNotFoundException: Class com.map.red.job.WordCountMapper not found
        at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:1811)
        at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1903)
        ... 8 more

    16/05/22 19:21:45 INFO mapreduce.Job:  map 100% reduce 0%
    16/05/22 19:21:46 INFO mapreduce.Job:  map 100% reduce 100%
    16/05/22 19:21:48 INFO mapreduce.Job: Job job_1464397668280_0004 failed with state FAILED due to: Task failed task_1464397668280_0004_m_000000
    Job failed as tasks failed. failedMaps:1 failedReduces:0


  • 相关阅读:
    jQuery火箭图标返回顶部代码
    jQuery火箭图标返回顶部代码
    jQuery火箭图标返回顶部代码
    jQuery火箭图标返回顶部代码
    jQuery火箭图标返回顶部代码
    jQuery火箭图标返回顶部代码
    jQuery火箭图标返回顶部代码
    jQuery火箭图标返回顶部代码
    jQuery火箭图标返回顶部代码
    jQuery火箭图标返回顶部代码
  • 原文地址:https://www.cnblogs.com/TendToBigData/p/10501449.html
Copyright © 2011-2022 走看看