zoukankan      html  css  js  c++  java
  • tachyon with hadoop


    hadoop2.2.0 jdk1.7 tachyon0.5.0 无zookeeper

    tachyon和hadoop都是伪分布式模式


    1.修改core-site.xml文件

    <property>
     <name>fs.tachyon.impl</name>
     <value>tachyon.hadoop.TFS</value>
    </property>

    2.配置hadoop-env.sh

    hadoop-env.sh文件中添加Tachyon客户端jar包路径的环境变量

    export HADOOP_CLASSPATH=/home/hadoop/tachyon-0.5.0-bin/client/target/tachyon-client-0.5.0-jar-with-dependencies.jar

    3.启动hadoop集群

    sbin/start-dfs.sh
    sbin/start-yarn.sh

    4.启动tachyon

    tachyon-start.sh local

    5.执行MR作业

    hadoop jar share/hadoop/mapreduce/hadoop-mapreduce-examples-2.2.0.jar wordcount -libjars /home/hadoop/tachyon-0.5.0-bin/client/target/tachyon-client-0.5.0-jar-with-dependencies.jar tachyon://hadoop:19998/test/passwd tachyon://hadoop:19998/out

    6.查看结果

    tachyon tfs cat /out/part-r-00000


    欲为大树,何与草争;心若不动,风又奈何。
  • 相关阅读:
    iOS进阶二-KVC
    iOS进阶一OC对象的本质
    2019-01-19
    2019-01-12
    2019
    2018-12-23 随笔
    2018-12-18 随笔
    2018-12-10
    2018-12-01
    2018.11.23 随笔
  • 原文地址:https://www.cnblogs.com/admln/p/tachyon-with-hadoop.html
Copyright © 2011-2022 走看看