zoukankan      html  css  js  c++  java
  • hadoop2.5的伪分布式安装配置

    一.windows环境下安装

    根据博主写的一次性安装成功了:

    http://blog.csdn.net/antgan/article/details/52067441

    二.linux环境下(centos6.5,JDK1.7)

    1.主机名与IP的映射

    2.关闭防火墙

    3.vi hadoop2.5/etc/hadoop/hadoop-env.sh

        配置JDK路径

    4.core-site.xml

     <configuration>

       <property>
        <name>fs.defaultFS</name>
        <value>hdfs://master-qian:8020</value>
       </property>

       <property>
        <name>hadoop.tmp.dir</name>
        <value>/opt/modules/hadoop-2.5/data/tmp</value>
       </property>

     </configuration>

    5.hdfs-site.xml

      <configuration>

        <property>
          <name>dfs.replication</name>
          <value>1</value>
        </property>
        <property>
          <name>dfs.namenode.secondary.http-address</name>
          <value>master-qian:50090</value>
        </property>
        <property>
          <name>dfs.permissions.enabled</name>
          <value>false</value>
        </property>

      </configuration>

    6.mapred-site.xml

    <configuration>

    <property>
    <name>mapreduce.framework.name</name>
    <value>yarn</value>
    </property>
    <property>
    <name>mapreduce.jobhistory.address</name>
    <value>master-qian:10020</value>
    </property>
    <property>
    <name>mapreduce.jobhistory.webapp.address</name>
    <value>master-qian:19888</value>
    </property>
    </configuration>

    7.yarn-site.xml

    <configuration>

    <property>
    <name>yarn.resourcemanager.hostname</name>
    <value>master-qian</value>
    </property>
    <property>
    <name>yarn.nodemanager.aux-services</name>
    <value>mapreduce_shuffle</value>
    </property>

    </configuration>

      

  • 相关阅读:
    kubernetes架构部署
    GitLab+Jenkins+Ansible
    python之字典方法
    Python之列表方法
    python之字符串方法
    Python编写从ZabbixAPI获取信息
    Django基础
    扫描某个包下所有的类,输出所有使用了特定注解的类的注解值
    日志切面和统一异常处理
    Mybatis动态排序问题
  • 原文地址:https://www.cnblogs.com/feiyumo/p/7340137.html
Copyright © 2011-2022 走看看