zoukankan      html  css  js  c++  java
  • hadoop执行wordcount例子

    1:下载hadoop。http://mirror.esocc.com/apache/hadoop/common/hadoop-1.2.1/hadoop-1.2.1.tar.gz

    2:解压. tar -zxvf 

    3:修改hadoop-env.sh中的JAVA_HOME配置

    4:用hadoop编译wordcount

    A:代码位置/soft/hadoop/src/examples/org/apache/hadoop/examples

    mkdir wordcount_classes 
    javac -classpath /soft/hadoop/hadoop-core-1.2.1.jar:/soft/hadoop/lib/commons-cli-1.2.jar -d wordcount_classes WordCount.java
    jar -cvf /soft/hadoop/wordcount.jar -C wordcount_classes/ .
    

    输入

    vi /soft/hadoop/input/file01
    vi /soft/hadoop/input/file02

    Hello World Bye World

    Hello Hadoop Goodbye Hadoop

    计算

    ./bin/hadoop jar /soft/hadoop/wordcount.jar org.apache.hadoop.examples.WordCount /soft/hadoop/input /soft/hadoop/output
    

    结果在/soft/hadoop/output文件夹内。

    {下次执行要删除output的内容,要不就执行错了}

  • 相关阅读:
    pycharm运行html文件报404错误
    css3 鼠标悬浮动画效果
    子代选择器和后代选择器的区别
    前端入门
    爬虫Scrapy框架
    BeautifulSoup
    爬虫之selenium使用
    爬虫之BeautifulSoup
    urllib模块
    爬虫基础
  • 原文地址:https://www.cnblogs.com/tommyli/p/3282968.html
Copyright © 2011-2022 走看看