zoukankan      html  css  js  c++  java
  • hadoop集群安装好之后的启动操作

    hadoop状态的手动切换:不推荐,但是可用

    hdfs haadmin -transitionToActive/standby nn2 -forcemanaual

    hdfs haadmin -getservicestate nn1/nn2  查看状态

    1,启动456的zookeeper
    cd /root/soft/zookeeper-3.4.6/bin
    ./zkServer.sh start

    2,查看状态./zkServer.sh status
    保证一个leader两个 follower

    3,启动journalnode(在hadoop01上启动所有journalnode)
    cd /root/soft/hadoop-2.7.1
    sbin/hadoop-daemons.sh start journalnode

    4,启动HDFS(在hadoop01上执行)
    cd /root/soft/hadoop-2.7.1
    sbin/start-dfs.sh

    5,启动YARN(在hadoop01上执行)
    sbin/start-yarn.sh

    6,可以统计浏览器访问:
    http://hadoop01:50070
    NameNode Overview 'hadoop01:9000' (standby)
    http://hadoop02:50070
    NameNode 'hadoop02:9000' (active)

    jps查看进程
    kill -9 <pid of NN>杀死进程查看状态

    手动启动那个挂掉的NameNode
    sbin/hadoop-daemon.sh start namenode

    7,管理界面8088,hadoopyear的管理界面(hadoop03)
    http://hadoop01:50070 hadoop01的datanode,

    8,上传文件,cd /root/
    hadoop fs -put words /words
    put时候出现这个错误
    Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
    put: `/words': File exists
    无法为你的平台的原生Hadoop加载库…使用内置的Java类,如适用
    放:' /字':文件存在

    #export HADOOP_OPTS="$HADOOP_OPTS -Djava.net.preferIPv4Stack=true"
    export HADOOP_OPTS="-Djava.library.path=$HADOOP_PREFIX/lib:$HADOOP_PREFIX/lib/native"


    hadoop checknative -a
    全部是失败

    字典:
    cd /root/soft/hadoop-2.7.1/share/hadoop/mapreduce
    hadoop jar hadoop-mapreduce-examples-2.7.1.jar wordcount /words /resultout




    在hadoop03启动year,03免登陆到456

    hadoop fs -ls /resultout

    hadoop fs -cat /resultout/part-r-00000 查看,

    hadoop fs -ls /


    hadoop调试信息开启关闭:
    开启:export HADOOP_ROOT_LOGGER=DEBUG,console
    关闭:export HADOOP_ROOT_LOGGER=INFO,console


  • 相关阅读:
    csuoj 1355: 地雷清除计划
    Task 6.4 冲刺Two之站立会议3
    Task 10 统计从1到某个整数之间出现的1的次数
    Task 6.3 冲刺Two之站立会议2
    Task 9 从用户界面和体验分析“360极速浏览器”
    Task 6.3 冲刺Two之站立会议1
    《程序员开发心理学》阅读笔记一
    Task 6.2冲刺会议十 /2015-5-23
    Task 6.2冲刺会议九 /2015-5-22
    Task 6.2冲刺会议八 /2015-5-21
  • 原文地址:https://www.cnblogs.com/xiaoxiao5ya/p/4976200.html
Copyright © 2011-2022 走看看