zoukankan      html  css  js  c++  java
  • [已决解]关于Hadoop start-all.sh启动问题

    问题一:出现Attempting to operate on hdfs namenode as root

    写在最前注意:
    1、master,slave都需要修改start-dfs.sh,stop-dfs.sh,start-yarn.sh,stop-yarn.sh四个文件
    2、如果你的Hadoop是另外启用其它用户来启动,记得将root改为对应用户

    HDFS格式化后启动dfs出现以下错误:

    [root@master sbin]# ./start-dfs.sh
    Starting namenodes on [master]
    ERROR: Attempting to operate on hdfs namenode as root
    ERROR: but there is no HDFS_NAMENODE_USER defined. Aborting operation.
    Starting datanodes
    ERROR: Attempting to operate on hdfs datanode as root
    ERROR: but there is no HDFS_DATANODE_USER defined. Aborting operation.
    Starting secondary namenodes [slave1]
    ERROR: Attempting to operate on hdfs secondarynamenode as root
    ERROR: but there is no HDFS_SECONDARYNAMENODE_USER defined. Aborting operation.

    查度娘,见一仁兄的博客有次FAQ,故参考处理顺便再做一记录
    参考地址:https://blog.csdn.net/u013725455/article/details/70147331

    在/hadoop/sbin路径下:
    将start-dfs.sh,stop-dfs.sh两个文件顶部添加以下参数

    HDFS_DATANODE_USER=root
    HDFS_DATANODE_SECURE_USER=hdfs
    HDFS_NAMENODE_USER=root
    HDFS_SECONDARYNAMENODE_USER=root

    还有,start-yarn.sh,stop-yarn.sh顶部也需添加以下:

    #!/usr/bin/env bash
    YARN_RESOURCEMANAGER_USER=root
    HADOOP_SECURE_DN_USER=yarn
    YARN_NODEMANAGER_USER=root
    
    
    # Licensed to the Apache Software Foundation (ASF) under one or more

    修改后重启 ./start-dfs.sh,成功!

    [root@master sbin]# ./start-dfs.sh
    WARNING: HADOOP_SECURE_DN_USER has been replaced by HDFS_DATANODE_SECURE_USER. Using value of HADOOP_SECURE_DN_USER.
    Starting namenodes on [master]
    上一次登录:日 6月  3 03:01:37 CST 2018从 slave1pts/2 上
    master: Warning: Permanently added 'master,192.168.43.161' (ECDSA) to the list of known hosts.
    Starting datanodes
    上一次登录:日 6月  3 04:09:05 CST 2018pts/1 上
    Starting secondary namenodes [slave1]
    上一次登录:日 6月  3 04:09:08 CST 2018pts/1

    from: https://blog.csdn.net/lglglgl/article/details/80553828

    问题二:正常启动后jps查看无namenode,datanode

    解决方法:

    1.先查看是不是的防火墙开启,将防火墙关闭:service iptbales stop
    2.查看端口状态:telnet 192.168.86.10 9000(192.168.86.10是我自己的静态ip)
         如果出现不能连接,那么我们需要修改我们的hosts
    3.修改hosts:vi /etc/hosts 
         将127:0:0:1   localhost localhost.localdomain localhost4 localhost4.localdomain4
         改为 ::1      localhost localhost.localdomain localhost4 localhost4.localdomain4
         或者将127:0:0:1   localhost localhost.localdomain localhost4 localhost4.localdomain4 删除
       在下方写入     192.168.86.10     mini1 localhost (192.168.86.10是我自己的静态ip      mini1是我的主机名)
    4.重新启动network:service network restart或sudo /etc/init.d/networking restart

    from: https://blog.csdn.net/u010599953/article/details/75635058

  • 相关阅读:
    VS2010出现FileTracker : error FTK1011编译错误的解决办法
    win7笔记本 开启wifi共享 非常好用
    VS2010连接Mysql数据库图解详细教程
    vs2010打包winform程序详解
    九个让人难以置信的HTML5和JavaScript实验
    C#获取当前应用程序所在路径及环境变量
    winform加载时,为什么画图不执行了
    Asp_net与SQLserver一起打包部署安装图文教程
    CUDA编译问题
    llvm
  • 原文地址:https://www.cnblogs.com/hankleo/p/10704031.html
Copyright © 2011-2022 走看看