zoukankan      html  css  js  c++  java
  • tachyon with hadoop


    hadoop2.2.0 jdk1.7 tachyon0.5.0 无zookeeper

    tachyon和hadoop都是伪分布式模式


    1.修改core-site.xml文件

    <property>
     <name>fs.tachyon.impl</name>
     <value>tachyon.hadoop.TFS</value>
    </property>

    2.配置hadoop-env.sh

    hadoop-env.sh文件中添加Tachyon客户端jar包路径的环境变量

    export HADOOP_CLASSPATH=/home/hadoop/tachyon-0.5.0-bin/client/target/tachyon-client-0.5.0-jar-with-dependencies.jar

    3.启动hadoop集群

    sbin/start-dfs.sh
    sbin/start-yarn.sh

    4.启动tachyon

    tachyon-start.sh local

    5.执行MR作业

    hadoop jar share/hadoop/mapreduce/hadoop-mapreduce-examples-2.2.0.jar wordcount -libjars /home/hadoop/tachyon-0.5.0-bin/client/target/tachyon-client-0.5.0-jar-with-dependencies.jar tachyon://hadoop:19998/test/passwd tachyon://hadoop:19998/out

    6.查看结果

    tachyon tfs cat /out/part-r-00000


    欲为大树,何与草争;心若不动,风又奈何。
  • 相关阅读:
    NET网络配置
    NTP时间同步器
    NFS配置linux
    DNS配置域名解析
    ftp配置windows
    samba配置与windows
    NTP服务和DNS服务
    NFS服务和DHCP服务scp
    SAMBA服务和FTP服务
    find用法
  • 原文地址:https://www.cnblogs.com/admln/p/tachyon-with-hadoop.html
Copyright © 2011-2022 走看看