zoukankan      html  css  js  c++  java
  • 17/11/24 05:08:44 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

    2017-11-24 21:20:25

    1:什么叫失望,什么叫绝望。总之是一脸懵逼的继续......

    之前部署的hadoop都是hadoop-2.4.1.tar.gz,这几天换成了hadoop-2.6.4.tar.gz,部署老生常谈,启动就不一样了,本来吧,也就是warn,不是error,启动hdfs和yarn,节点都可以正常启动,但是对于我这种强迫症,能容忍下面这一大推错误吗?当你看到这篇的时候,显然是不能,虽然网上已经有很多了,但是貌似好多还是不好使。我呢,也算脑补。记录一下。

    [root@master hadoop]# start-dfs.sh 
    17/11/24 04:24:39 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
    Starting namenodes on [Java HotSpot(TM) Client VM warning: You have loaded library /home/hadoop/soft/hadoop-2.6.4/lib/native/libhadoop.so.1.0.0 which might have disabled stack guard. The VM will try to fix the stack guard now.
    It's highly recommended that you fix the library with 'execstack -c <libfile>', or link it with '-z noexecstack'.
    master]
    sed: -e expression #1, char 6: unknown option to `s'
    -c: Unknown cipher type 'cd'
    master: starting namenode, logging to /home/hadoop/soft/hadoop-2.6.4/logs/hadoop-root-namenode-master.out
    stack: ssh: connect to host stack port 22: Connection refused
    highly: ssh: connect to host highly port 22: Connection refused
    disabled: ssh: connect to host disabled port 22: Connection refused
    Client: ssh: connect to host Client port 22: Connection refused
    Java: ssh: Could not resolve hostname Java: Temporary failure in name resolution
    '-z: ssh: Could not resolve hostname '-z: Temporary failure in name resolution
    might: ssh: Could not resolve hostname might: Temporary failure in name resolution
    now.: ssh: Could not resolve hostname now.: Temporary failure in name resolution
    It's: ssh: Could not resolve hostname It's: Temporary failure in name resolution
    HotSpot(TM): ssh: Could not resolve hostname HotSpot(TM): Temporary failure in name resolution
    it: ssh: Could not resolve hostname it: Temporary failure in name resolution
    or: ssh: Could not resolve hostname or: Temporary failure in name resolution
    to: ssh: Could not resolve hostname to: Temporary failure in name resolution
    fix: ssh: Could not resolve hostname fix: Temporary failure in name resolution
    warning:: ssh: Could not resolve hostname warning:: Temporary failure in name resolution
    You: ssh: Could not resolve hostname You: Temporary failure in name resolution
    <libfile>',: ssh: Could not resolve hostname <libfile>',: Temporary failure in name resolution
    fix: ssh: Could not resolve hostname fix: Temporary failure in name resolution
    'execstack: ssh: Could not resolve hostname 'execstack: Temporary failure in name resolution
    loaded: ssh: Could not resolve hostname loaded: Temporary failure in name resolution
    VM: ssh: Could not resolve hostname VM: Temporary failure in name resolution
    try: ssh: Could not resolve hostname try: Temporary failure in name resolution
    you: ssh: Could not resolve hostname you: Temporary failure in name resolution
    link: ssh: Could not resolve hostname link: Temporary failure in name resolution
    noexecstack'.: ssh: Could not resolve hostname noexecstack'.: Temporary failure in name resolution
    with: ssh: connect to host with port 22: Connection refused
    The: ssh: connect to host The port 22: Connection refused
    that: ssh: Could not resolve hostname that: Temporary failure in name resolution
    recommended: ssh: Could not resolve hostname recommended: Temporary failure in name resolution
    have: ssh: Could not resolve hostname have: Temporary failure in name resolution
    will: ssh: Could not resolve hostname will: Temporary failure in name resolution
    VM: ssh: Could not resolve hostname VM: Temporary failure in name resolution
    library: ssh: Could not resolve hostname library: Temporary failure in name resolution
    with: ssh: Could not resolve hostname with: Temporary failure in name resolution
    guard: ssh: Could not resolve hostname guard: Temporary failure in name resolution
    the: ssh: connect to host the port 22: Connection refused
    have: ssh: connect to host have port 22: Connection refused
    stack: ssh: connect to host stack port 22: Connection refused
    library: ssh: connect to host library port 22: Connection refused
    the: ssh: connect to host the port 22: Connection refused
    guard.: ssh: connect to host guard. port 22: Connection refused
    which: ssh: connect to host which port 22: Connection refused
    master: starting datanode, logging to /home/hadoop/soft/hadoop-2.6.4/logs/hadoop-root-datanode-master.out
    slaver1: starting datanode, logging to /home/hadoop/soft/hadoop-2.6.4/logs/hadoop-root-datanode-slaver1.out
    slaver2: starting datanode, logging to /home/hadoop/soft/hadoop-2.6.4/logs/hadoop-root-datanode-slaver2.out
    Starting secondary namenodes [Java HotSpot(TM) Client VM warning: You have loaded library /home/hadoop/soft/hadoop-2.6.4/lib/native/libhadoop.so.1.0.0 which might have disabled stack guard. The VM will try to fix the stack guard now.
    It's highly recommended that you fix the library with 'execstack -c <libfile>', or link it with '-z noexecstack'.
    master]
    sed: -e expression #1, char 6: unknown option to `s'
    -c: Unknown cipher type 'cd'
    master: starting secondarynamenode, logging to /home/hadoop/soft/hadoop-2.6.4/logs/hadoop-root-secondarynamenode-master.out
    Client: ssh: connect to host Client port 22: Connection refused
    recommended: ssh: connect to host recommended port 22: Connection refused
    VM: ssh: connect to host VM port 22: Connection refused
    VM: ssh: connect to host VM port 22: Connection refused
    stack: ssh: connect to host stack port 22: Connection refused
    disabled: ssh: connect to host disabled port 22: Connection refused
    guard.: ssh: connect to host guard. port 22: Connection refused
    library: ssh: connect to host library port 22: Connection refused
    stack: ssh: connect to host stack port 22: Connection refused
    you: ssh: Could not resolve hostname you: Temporary failure in name resolution
    HotSpot(TM): ssh: Could not resolve hostname HotSpot(TM): Temporary failure in name resolution
    warning:: ssh: Could not resolve hostname warning:: Temporary failure in name resolution
    to: ssh: Could not resolve hostname to: Temporary failure in name resolution
    You: ssh: Could not resolve hostname You: Temporary failure in name resolution
    'execstack: ssh: Could not resolve hostname 'execstack: Temporary failure in name resolution
    <libfile>',: ssh: Could not resolve hostname <libfile>',: Temporary failure in name resolution
    Java: ssh: Could not resolve hostname Java: Temporary failure in name resolution
    link: ssh: Could not resolve hostname link: Temporary failure in name resolution
    It's: ssh: Could not resolve hostname It's: Temporary failure in name resolution
    noexecstack'.: ssh: Could not resolve hostname noexecstack'.: Temporary failure in name resolution
    it: ssh: Could not resolve hostname it: Temporary failure in name resolution
    '-z: ssh: Could not resolve hostname '-z: Temporary failure in name resolution
    with: ssh: connect to host with port 22: Connection refused
    loaded: ssh: connect to host loaded port 22: Connection refused
    that: ssh: connect to host that port 22: Connection refused
    have: ssh: connect to host have port 22: Connection refused
    try: ssh: Could not resolve hostname try: Temporary failure in name resolution
    which: ssh: connect to host which port 22: Connection refused
    have: ssh: connect to host have port 22: Connection refused
    fix: ssh: connect to host fix port 22: Connection refused
    the: ssh: connect to host the port 22: Connection refused
    guard: ssh: connect to host guard port 22: Connection refused
    highly: ssh: connect to host highly port 22: Connection refused
    library: ssh: connect to host library port 22: Connection refused
    fix: ssh: connect to host fix port 22: Connection refused
    now.: ssh: Could not resolve hostname now.: Temporary failure in name resolution
    The: ssh: connect to host The port 22: Connection refused
    the: ssh: connect to host the port 22: Connection refused
    will: ssh: connect to host will port 22: Connection refused
    with: ssh: connect to host with port 22: Connection refused
    or: ssh: connect to host or port 22: Connection refused
    might: ssh: connect to host might port 22: Connection refused
    17/11/24 04:25:55 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
    [root@master hadoop]# jps
    17223 DataNode
    17879 Jps
    17502 SecondaryNameNode
    16885 NameNode
    [root@master hadoop]# 

    上面是启动dfs的时候报的,下面是关闭dfs的时候报的:

    [root@master hadoop]# stop-dfs.sh 
    17/11/24 05:00:36 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
    Stopping namenodes on [Java HotSpot(TM) Client VM warning: You have loaded library /home/hadoop/soft/hadoop-2.6.4/lib/native/libhadoop.so.1.0.0 which might have disabled stack guard. The VM will try to fix the stack guard now.
    It's highly recommended that you fix the library with 'execstack -c <libfile>', or link it with '-z noexecstack'.
    master]
    sed: -e expression #1, char 6: unknown option to `s'
    -c: Unknown cipher type 'cd'
    master: stopping namenode
    loaded: ssh: connect to host loaded port 22: Connection refused
    library: ssh: connect to host library port 22: Connection refused
    recommended: ssh: connect to host recommended port 22: Connection refused
    might: ssh: connect to host might port 22: Connection refused
    HotSpot(TM): ssh: Could not resolve hostname HotSpot(TM): Temporary failure in name resolution
    noexecstack'.: ssh: Could not resolve hostname noexecstack'.: Temporary failure in name resolution
    it: ssh: Could not resolve hostname it: Temporary failure in name resolution
    You: ssh: Could not resolve hostname You: Temporary failure in name resolution
    <libfile>',: ssh: Could not resolve hostname <libfile>',: Temporary failure in name resolution
    warning:: ssh: Could not resolve hostname warning:: Temporary failure in name resolution
    link: ssh: Could not resolve hostname link: Temporary failure in name resolution
    now.: ssh: Could not resolve hostname now.: Temporary failure in name resolution
    you: ssh: Could not resolve hostname you: Temporary failure in name resolution
    '-z: ssh: Could not resolve hostname '-z: Temporary failure in name resolution
    It's: ssh: Could not resolve hostname It's: Temporary failure in name resolution
    'execstack: ssh: Could not resolve hostname 'execstack: Temporary failure in name resolution
    fix: ssh: connect to host fix port 22: Connection refused
    the: ssh: connect to host the port 22: Connection refused
    with: ssh: connect to host with port 22: Connection refused
    to: ssh: Could not resolve hostname to: Temporary failure in name resolution
    Java: ssh: Could not resolve hostname Java: Temporary failure in name resolution
    with: ssh: connect to host with port 22: Connection refused
    have: ssh: connect to host have port 22: Connection refused
    library: ssh: connect to host library port 22: Connection refused
    disabled: ssh: connect to host disabled port 22: Connection refused
    stack: ssh: connect to host stack port 22: Connection refused
    VM: ssh: connect to host VM port 22: Connection refused
    The: ssh: connect to host The port 22: Connection refused
    which: ssh: connect to host which port 22: Connection refused
    Client: ssh: connect to host Client port 22: Connection refused
    will: ssh: connect to host will port 22: Connection refused
    try: ssh: connect to host try port 22: Connection refused
    guard.: ssh: connect to host guard. port 22: Connection refused
    stack: ssh: connect to host stack port 22: Connection refused
    highly: ssh: connect to host highly port 22: Connection refused
    have: ssh: connect to host have port 22: Connection refused
    VM: ssh: connect to host VM port 22: Connection refused
    the: ssh: connect to host the port 22: Connection refused
    guard: ssh: connect to host guard port 22: Connection refused
    that: ssh: connect to host that port 22: Connection refused
    or: ssh: connect to host or port 22: Connection refused
    fix: ssh: connect to host fix port 22: Connection refused
    slaver2: stopping datanode
    slaver1: stopping datanode
    master: stopping datanode
    Stopping secondary namenodes [Java HotSpot(TM) Client VM warning: You have loaded library /home/hadoop/soft/hadoop-2.6.4/lib/native/libhadoop.so.1.0.0 which might have disabled stack guard. The VM will try to fix the stack guard now.
    It's highly recommended that you fix the library with 'execstack -c <libfile>', or link it with '-z noexecstack'.
    master]
    sed: -e expression #1, char 6: unknown option to `s'
    -c: Unknown cipher type 'cd'
    master: stopping secondarynamenode
    Client: ssh: Could not resolve hostname Client: Temporary failure in name resolution
    You: ssh: Could not resolve hostname You: Temporary failure in name resolution
    Java: ssh: Could not resolve hostname Java: Temporary failure in name resolution
    have: ssh: Could not resolve hostname have: Temporary failure in name resolution
    loaded: ssh: Could not resolve hostname loaded: Temporary failure in name resolution
    library: ssh: Could not resolve hostname library: Temporary failure in name resolution
    have: ssh: Could not resolve hostname have: Temporary failure in name resolution
    disabled: ssh: Could not resolve hostname disabled: Temporary failure in name resolution
    The: ssh: Could not resolve hostname The: Temporary failure in name resolution
    highly: ssh: Could not resolve hostname highly: Temporary failure in name resolution
    try: ssh: Could not resolve hostname try: Temporary failure in name resolution
    warning:: ssh: Could not resolve hostname warning:: Temporary failure in name resolution
    guard: ssh: Could not resolve hostname guard: Temporary failure in name resolution
    which: ssh: Could not resolve hostname which: Temporary failure in name resolution
    stack: ssh: Could not resolve hostname stack: Temporary failure in name resolution
    recommended: ssh: Could not resolve hostname recommended: Temporary failure in name resolution
    the: ssh: Could not resolve hostname the: Temporary failure in name resolution
    will: ssh: Could not resolve hostname will: Temporary failure in name resolution
    It's: ssh: Could not resolve hostname It's: Temporary failure in name resolution
    stack: ssh: Could not resolve hostname stack: Temporary failure in name resolution
    now.: ssh: Could not resolve hostname now.: Temporary failure in name resolution
    library: ssh: Could not resolve hostname library: Temporary failure in name resolution
    fix: ssh: Could not resolve hostname fix: Temporary failure in name resolution
    that: ssh: Could not resolve hostname that: Temporary failure in name resolution
    with: ssh: Could not resolve hostname with: Temporary failure in name resolution
    to: ssh: Could not resolve hostname to: Temporary failure in name resolution
    '-z: ssh: Could not resolve hostname '-z: Temporary failure in name resolution
    <libfile>',: ssh: Could not resolve hostname <libfile>',: Temporary failure in name resolution
    it: ssh: Could not resolve hostname it: Temporary failure in name resolution
    VM: ssh: Could not resolve hostname VM: Temporary failure in name resolution
    the: ssh: Could not resolve hostname the: Temporary failure in name resolution
    'execstack: ssh: Could not resolve hostname 'execstack: Temporary failure in name resolution
    or: ssh: Could not resolve hostname or: Temporary failure in name resolution
    link: ssh: Could not resolve hostname link: Temporary failure in name resolution
    you: ssh: Could not resolve hostname you: Temporary failure in name resolution
    noexecstack'.: ssh: Could not resolve hostname noexecstack'.: Temporary failure in name resolution
    HotSpot(TM): ssh: Could not resolve hostname HotSpot(TM): Temporary failure in name resolution
    fix: ssh: Could not resolve hostname fix: Temporary failure in name resolution
    VM: ssh: Could not resolve hostname VM: Temporary failure in name resolution
    might: ssh: Could not resolve hostname might: Temporary failure in name resolution
    with: ssh: Could not resolve hostname with: Temporary failure in name resolution
    guard.: ssh: connect to host guard. port 22: Connection refused
    17/11/24 05:02:06 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
    [root@master hadoop]# 

    待续.......

    2:出错,解决不了,百度呗,这里贴出来,我准备百度参考的文章,不知道能不能成功呢,先记录一下,因为那是2015年,距今2年了。

    http://blog.csdn.net/young_kim1/article/details/50324345

    http://blog.csdn.net/young_kim1/article/details/50269501

     此两篇是上下篇,希望可以帮到以后遇到这个问题的人。

    3:为什么出现这个问题呢:

    提示hadoop不能加载本地库。

    以前官网会提供32位的安装包,但目前提供的下载包为64位的,在linux 32位系统下安装后会一直提示错误“WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform… using builtin-java classes where applicable ”,但官网又不提供32位系统下的安装包,所以我们只能自己编译打包源码。

    首先看下自己的虚拟机是多少位的吧:

    # uname -i

    通过以上命令获取系统版本,

    然后呢到

    大家可以到cd /home/hadoop/soft/hadoop-2.6.4/lib/native下,查看文件libhadoop.so.1.0.0,里面会显示Hadoop的位数,官网下载好的显示是64位的,截图如下:

     4:有耐心的可以根据上面的网址操作,已经写的很详细了,这里不作多叙述,直接将lib下面的native贴出来,如果你的linux是32位的,直接替换你的/lib/native即可。替换过后再查看,如下所示:

    替换的32位的lib/native包:http://download.csdn.net/download/biexiansheng/10132053

     

     启动和关闭的时候也不warn了:

     停更......

    2017-11-24 22:02:20

  • 相关阅读:
    Fortran学习记录1(Fortran数据类型)
    ABAQUS学习记录1——用户子程序综述
    Abaqus用户子程序umat的学习
    信号基础知识---线阵
    信号基础知识--FFT DFT
    信号基础知识
    服务器文件打压缩包下载(java)
    网页鼠标特效-点击漂浮文字
    jQuery父子页面之间元素、方法获取、调用
    常用数字与字母的正则表达式
  • 原文地址:https://www.cnblogs.com/biehongli/p/7892406.html
Copyright © 2011-2022 走看看