zoukankan      html  css  js  c++  java
  • hadoop2.0安装和配置

    hadoop2与hadoop1的配置有些许不同,最主要的是hadoop1里的master变成了yarn

    这篇文直接从hadoop的配置开始,因为系统环境和jdk和hadoop1都是一样的。

    hadoop1的配置链接,从第六步开始

    六、设置hadoop2参数

    进入 usr/local/hadoop/etc/hadoop 文件夹,即可看到以下文件

    6.1配置hadoop-env.sh
     
    找到export JAVA_HOME这一行,去除前面的#号注释符。
    修改 export JAVA_HOME=/usr/local/jdk1.6.0_30
     
    6.2配置core-site.xml
    <configuration>
    <property>
    <name>fs.default.name</name>
    <value>hdfs://hadoop100:8020</value>
     <final>true</final>
     </property>
    <property>
     <name>hadoop.tmp.dir</name>
    <value>/home/hadoop/tmphadoop2.0</value>
    </property>
    </configuration>

    6.3配置hdfs-site.xml

    <configuration>
    <property>
    <name>dfs.namenode.name.dir</name>
    <value>/home/hadoop/tmphadoop2.0/dfs/name</value>
     <final>true</final>
    </property>
     <property>
     <name>dfs.datanode.data.dir</name>
    <value>/home/hadoop/tmphadoop2.0/dfs/data</value>
    <description>Determines where on the local filesystem an DFS data node
    should store its blocks. If this is a comma-delimited list of
    directories, then data will be stored in all named directories,
    typically on different devices. Directories that do not exist are
    ignored. </description> 
    <final>true</final> 
    </property>
     <property>
    <name>dfs.replication</name> <value>1</value>
     </property>
     <property>
    <name>dfs.permissions</name> <value>false</value>
     </property>
    
    </configuration>

    6.4:配置mapred-site.xml

    <configuration>
    <property>
    <name>mapreduce.framework.name</name> 
    <value>yarn</value>
     </property>
    </configuration>

    6.5配置yarn-site.xml

    <?xml version="1.0"?>
    <configuration>
    
    <!-- Site specific YARN configuration properties -->
    <property>
      <name>yarn.resourcemanager.address</name>
      <value>hadoop100:8032</value>
    </property>
    
    <property>
      <name>yarn.resourcemanager.scheduler.address</name>
      <value>hadoop100:8030</value>
    </property>
    
    <property>
      <name>yarn.resourcemanager.resource-tracker.address</name>
      <value>hadoop100:8031</value>
    </property>
    
    <property>
      <name>yarn.resourcemanager.admin.address</name>
      <value>hadoop100:8033</value>
    </property>
    
    <property>
      <name>yarn.resourcemanager.webapp.address</name>
      <value>hadoop100:8088</value>
    </property>
    
    <property> 
        <name>yarn.nodemanager.aux-services</name> 
            <value>mapreduce.shuffle</value> 
            </property> 
             
    <property> 
        <name>yarn.nodemanager.aux-services.mapreduce.shuffle.class</name> 
            <value>org.apache.hadoop.mapred.ShuffleHandler</value> 
            </property> 
    
    </configuration>

    6.6配置slaves

    hadoop101
    hadoop102

    其他的和hadoop1都是一样的,这里就不在详述

  • 相关阅读:
    华为交换机配置命令总结
    Linux 系统启动项修复
    Linux菜鸟成长日记 ( Linux 下的 ftp 文件传输协议 )
    Linux 查看用户命令
    linux 查看过滤命令命令
    Linux篇---ftp服务器的搭建
    linux挂载详解
    园区IP地址规划(非常详细)
    Linux创建、删除文件和文件夹命令
    CentOs 7 安装 Xampp
  • 原文地址:https://www.cnblogs.com/arbitrary/p/4823699.html
Copyright © 2011-2022 走看看