zoukankan      html  css  js  c++  java
  • 运行wordcount的时候显示INFO mapreduce.Job: map 0% reduce 0%

    错误提示:

    [xiaoqiu@s150 /home/xiaoqiu]$ hadoop jar wordcounter.jar com.cr.wordcount.WordcountApp hdfs://s150/user/xiaoqiu/data/wc.txt hdfs://s150/user/xiaoqiu/data/out
    18/01/05 09:12:52 INFO client.RMProxy: Connecting to ResourceManager at s150/192.168.109.150:8032
    18/01/05 09:12:55 WARN mapreduce.JobResourceUploader: Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
    18/01/05 09:13:13 INFO input.FileInputFormat: Total input paths to process : 1
    18/01/05 09:13:18 INFO mapreduce.JobSubmitter: number of splits:1
    18/01/05 09:13:21 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1515157734609_0002
    18/01/05 09:14:14 INFO impl.YarnClientImpl: Submitted application application_1515157734609_0002
    18/01/05 09:14:16 INFO mapreduce.Job: The url to track the job: http://s150:8088/proxy/application_1515157734609_0002/
    18/01/05 09:14:16 INFO mapreduce.Job: Running job: job_1515157734609_0002
    18/01/05 09:20:09 INFO mapreduce.Job: Job job_1515157734609_0002 running in uber mode : false
    18/01/05 09:20:16 INFO mapreduce.Job:  map 0% reduce 0%
    解决:

    修改了虚拟机的内存大小,我之前是每个虚拟机配置的512M,后来改成了1个G,解决了问题

    欢迎关注我的公众号:小秋的博客 CSDN博客:https://blog.csdn.net/xiaoqiu_cr github:https://github.com/crr121 联系邮箱:rongchen633@gmail.com 有什么问题可以给我留言噢~
  • 相关阅读:
    httpd-2.2 配置及用法完全攻略
    在 Ubuntu 16.04 上安装 LEMP 环境之图文向导
    Zookeeper集群搭建
    smem – Linux 内存监视软件
    X.Org可能将失去它的域名x.org
    Docker 容器测试全探索
    Unix操作系统中UUCP知识详细讲解
    常用的Git Tips
    Unix操作系统中UUCP知识详细讲解
    将博客搬至CSDN
  • 原文地址:https://www.cnblogs.com/flyingcr/p/10326964.html
Copyright © 2011-2022 走看看