zoukankan      html  css  js  c++  java
  • [已决解]关于Hadoop start-all.sh启动问题

    问题一:出现Attempting to operate on hdfs namenode as root

    写在最前注意:
    1、master,slave都需要修改start-dfs.sh,stop-dfs.sh,start-yarn.sh,stop-yarn.sh四个文件
    2、如果你的Hadoop是另外启用其它用户来启动,记得将root改为对应用户

    HDFS格式化后启动dfs出现以下错误:

    [root@master sbin]# ./start-dfs.sh
    Starting namenodes on [master]
    ERROR: Attempting to operate on hdfs namenode as root
    ERROR: but there is no HDFS_NAMENODE_USER defined. Aborting operation.
    Starting datanodes
    ERROR: Attempting to operate on hdfs datanode as root
    ERROR: but there is no HDFS_DATANODE_USER defined. Aborting operation.
    Starting secondary namenodes [slave1]
    ERROR: Attempting to operate on hdfs secondarynamenode as root
    ERROR: but there is no HDFS_SECONDARYNAMENODE_USER defined. Aborting operation.

    查度娘,见一仁兄的博客有次FAQ,故参考处理顺便再做一记录
    参考地址:https://blog.csdn.net/u013725455/article/details/70147331

    在/hadoop/sbin路径下:
    将start-dfs.sh,stop-dfs.sh两个文件顶部添加以下参数

    HDFS_DATANODE_USER=root
    HDFS_DATANODE_SECURE_USER=hdfs
    HDFS_NAMENODE_USER=root
    HDFS_SECONDARYNAMENODE_USER=root

    还有,start-yarn.sh,stop-yarn.sh顶部也需添加以下:

    #!/usr/bin/env bash
    YARN_RESOURCEMANAGER_USER=root
    HADOOP_SECURE_DN_USER=yarn
    YARN_NODEMANAGER_USER=root
    
    
    # Licensed to the Apache Software Foundation (ASF) under one or more

    修改后重启 ./start-dfs.sh,成功!

    [root@master sbin]# ./start-dfs.sh
    WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER.
    Starting namenodes on [master]
    上一次登录:日 6月  3 03:01:37 CST 2018从 slave1pts/2 上
    master: Warning: Permanently added 'master,192.168.43.161' (ECDSA) to the list of known hosts.
    Starting datanodes
    上一次登录:日 6月  3 04:09:05 CST 2018pts/1 上
    Starting secondary namenodes [slave1]
    上一次登录:日 6月  3 04:09:08 CST 2018pts/1

    from: https://blog.csdn.net/lglglgl/article/details/80553828

    问题二:正常启动后jps查看无namenode,datanode

    解决方法:

    1.先查看是不是的防火墙开启,将防火墙关闭:service iptbales stop
    2.查看端口状态:telnet 192.168.86.10 9000(192.168.86.10是我自己的静态ip)
         如果出现不能连接,那么我们需要修改我们的hosts
    3.修改hosts:vi /etc/hosts 
         将127:0:0:1   localhost localhost.localdomain localhost4 localhost4.localdomain4
         改为 ::1      localhost localhost.localdomain localhost4 localhost4.localdomain4
         或者将127:0:0:1   localhost localhost.localdomain localhost4 localhost4.localdomain4 删除
       在下方写入     192.168.86.10     mini1 localhost (192.168.86.10是我自己的静态ip      mini1是我的主机名)
    4.重新启动network:service network restart或sudo /etc/init.d/networking restart

    from: https://blog.csdn.net/u010599953/article/details/75635058

  • 相关阅读:
    Python Revisited Day 13 (正则表达式)
    Python Revisited Day 06 (面向对象程序设计)
    Python Revisited (变量)
    Python Revisited Day 05(模块)
    Python Revisited Day 04 (控制结构与函数)
    Python Revisited Day 03 (组合数据类型)
    Numpy
    Python Revisited Day 01
    Python3使用openpyxl读写Excel文件
    Python3操作YAML文件
  • 原文地址:https://www.cnblogs.com/hankleo/p/10704031.html
Copyright © 2011-2022 走看看