zoukankan      html  css  js  c++  java
  • hadoop jar wc.jar com.map.red.job.WordCountJob

    [root@bigdataspark ~]# hadoop jar wc.jar com.map.red.job.WordCountJob
    16/05/22 19:20:24 WARN mapreduce.JobSubmitter: Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
    16/05/22 19:20:24 WARN mapreduce.JobSubmitter: No job jar file set.  User classes may not be found. See Job or Job#setJar(String).
    16/05/22 19:20:24 INFO input.FileInputFormat: Total input paths to process : 1
    16/05/22 19:20:25 INFO mapreduce.JobSubmitter: number of splits:1
    16/05/22 19:20:25 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1464397668280_0004
    16/05/22 19:20:26 INFO mapred.YARNRunner: Job jar is not present. Not adding any jar to the list of resources.
    16/05/22 19:20:26 INFO impl.YarnClientImpl: Submitted application application_1464397668280_0004
    16/05/22 19:20:26 INFO mapreduce.Job: The url to track the job: http://bigdatastorm:8088/proxy/application_1464397668280_0004/
    16/05/22 19:20:26 INFO mapreduce.Job: Running job: job_1464397668280_0004
    16/05/22 19:20:49 INFO mapreduce.Job: Job job_1464397668280_0004 running in uber mode : false
    16/05/22 19:20:49 INFO mapreduce.Job:  map 0% reduce 0%
    16/05/22 19:21:12 INFO mapreduce.Job:  map 100% reduce 0%
    16/05/22 19:21:12 INFO mapreduce.Job: Task Id : attempt_1464397668280_0004_m_000000_0, Status : FAILED
    Error: java.lang.RuntimeException: java.lang.ClassNotFoundException: Class com.map.red.job.WordCountMapper not found
        at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1905)
        at org.apache.hadoop.mapreduce.task.JobContextImpl.getMapperClass(JobContextImpl.java:186)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:722)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:340)
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:415)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614)
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:163)
    Caused by: java.lang.ClassNotFoundException: Class com.map.red.job.WordCountMapper not found
        at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:1811)
        at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1903)
        ... 8 more

    16/05/22 19:21:13 INFO mapreduce.Job:  map 0% reduce 0%
    16/05/22 19:21:23 INFO mapreduce.Job: Task Id : attempt_1464397668280_0004_m_000000_1, Status : FAILED
    Error: java.lang.RuntimeException: java.lang.ClassNotFoundException: Class com.map.red.job.WordCountMapper not found
        at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1905)
        at org.apache.hadoop.mapreduce.task.JobContextImpl.getMapperClass(JobContextImpl.java:186)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:722)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:340)
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:415)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614)
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:163)
    Caused by: java.lang.ClassNotFoundException: Class com.map.red.job.WordCountMapper not found
        at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:1811)
        at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1903)
        ... 8 more

    16/05/22 19:21:34 INFO mapreduce.Job: Task Id : attempt_1464397668280_0004_m_000000_2, Status : FAILED
    Error: java.lang.RuntimeException: java.lang.ClassNotFoundException: Class com.map.red.job.WordCountMapper not found
        at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1905)
        at org.apache.hadoop.mapreduce.task.JobContextImpl.getMapperClass(JobContextImpl.java:186)
        at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:722)
        at org.apache.hadoop.mapred.MapTask.run(MapTask.java:340)
        at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:415)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614)
        at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:163)
    Caused by: java.lang.ClassNotFoundException: Class com.map.red.job.WordCountMapper not found
        at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:1811)
        at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1903)
        ... 8 more

    16/05/22 19:21:45 INFO mapreduce.Job:  map 100% reduce 0%
    16/05/22 19:21:46 INFO mapreduce.Job:  map 100% reduce 100%
    16/05/22 19:21:48 INFO mapreduce.Job: Job job_1464397668280_0004 failed with state FAILED due to: Task failed task_1464397668280_0004_m_000000
    Job failed as tasks failed. failedMaps:1 failedReduces:0


  • 相关阅读:
    ISAG协议中彩信支持的几种附件格式(河南电信)
    河南电信ISAG短信下行数据格式
    SQL中varchar和nvarchar有什么区别?
    通过一个很实用的例子让你学会TSQL编程的基本语法和思想
    在读取或者保存word时,程序捕获到word异常“word无法启动转换器mswrd632 wpc”
    工作基本搞定等待周五入职
    ClickOnce发布时,资源文件添加问题
    访问IIS元数据库失败
    一个随机产生中文简体字的一个类
    QQ抢车位外挂(续)
  • 原文地址:https://www.cnblogs.com/TendToBigData/p/10501449.html
Copyright © 2011-2022 走看看