zoukankan      html  css  js  c++  java
  • 运行wordcount的时候显示INFO mapreduce.Job: map 0% reduce 0%

    错误提示:

    [xiaoqiu@s150 /home/xiaoqiu]$ hadoop jar wordcounter.jar com.cr.wordcount.WordcountApp hdfs://s150/user/xiaoqiu/data/wc.txt hdfs://s150/user/xiaoqiu/data/out
    18/01/05 09:12:52 INFO client.RMProxy: Connecting to ResourceManager at s150/192.168.109.150:8032
    18/01/05 09:12:55 WARN mapreduce.JobResourceUploader: Hadoop command-line option parsing not performed. Implement the Tool interface and execute your application with ToolRunner to remedy this.
    18/01/05 09:13:13 INFO input.FileInputFormat: Total input paths to process : 1
    18/01/05 09:13:18 INFO mapreduce.JobSubmitter: number of splits:1
    18/01/05 09:13:21 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1515157734609_0002
    18/01/05 09:14:14 INFO impl.YarnClientImpl: Submitted application application_1515157734609_0002
    18/01/05 09:14:16 INFO mapreduce.Job: The url to track the job: http://s150:8088/proxy/application_1515157734609_0002/
    18/01/05 09:14:16 INFO mapreduce.Job: Running job: job_1515157734609_0002
    18/01/05 09:20:09 INFO mapreduce.Job: Job job_1515157734609_0002 running in uber mode : false
    18/01/05 09:20:16 INFO mapreduce.Job:  map 0% reduce 0%
    解决:

    修改了虚拟机的内存大小,我之前是每个虚拟机配置的512M,后来改成了1个G,解决了问题

    欢迎关注我的公众号:小秋的博客 CSDN博客:https://blog.csdn.net/xiaoqiu_cr github:https://github.com/crr121 联系邮箱:rongchen633@gmail.com 有什么问题可以给我留言噢~
  • 相关阅读:
    pymongo 学习
    Mongodb 学习
    2个list取交集
    2个list取差集
    yaml 基础
    is 和 ==的区别
    软件测试人员需要掌握的linux命令(二)
    免费翻译API破解(简易翻译工具)
    测试面试解析
    Python之Time模块
  • 原文地址:https://www.cnblogs.com/flyingcr/p/10326965.html
Copyright © 2011-2022 走看看