zoukankan      html  css  js  c++  java
  • hadoop碰到的 一个问题

    在里面添加/usr/local/hadoop/etc/hadoop/log4j.properties

    log4j.logger.org.apache.hadoop.util.NativeCodeLoader=DEBUG

    可以查看debug信息:

    [root@elk03 hadoop]# hdfs dfs -ls /
    19/02/26 01:19:37 DEBUG util.NativeCodeLoader: Trying to load the custom-built native-hadoop library...
    19/02/26 01:19:37 DEBUG util.NativeCodeLoader: Failed to load native-hadoop with error: java.lang.UnsatisfiedLinkError: /usr/local/hadoop/lib/native/libhadoop.so.1.0.0: /lib64/libc.so.6: version `GLIBC_2.14' not found (required by /usr/local/hadoop/lib/native/libhadoop.so.1.0.0)
    19/02/26 01:19:37 DEBUG util.NativeCodeLoader: java.library.path=/usr/local/hadoop/lib/native
    19/02/26 01:19:37 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

    #############问题#########

    [root@elk03 sbin]# hadoop dfs -ls /
    DEPRECATED: Use of this script to execute hdfs command is deprecated.
    Instead use the hdfs command for it.

    19/02/26 01:17:11 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

    ##################解决#################

    [root@elk03 hadoop]# hdfs dfs -ls /
    19/02/26 01:19:37 DEBUG util.NativeCodeLoader: Trying to load the custom-built native-hadoop library...
    19/02/26 01:19:37 DEBUG util.NativeCodeLoader: Failed to load native-hadoop with error: java.lang.UnsatisfiedLinkError: /usr/local/hadoop/lib/native/libhadoop.so.1.0.0: /lib64/libc.so.6: version `GLIBC_2.14' not found (required by /usr/local/hadoop/lib/native/libhadoop.so.1.0.0)
    19/02/26 01:19:37 DEBUG util.NativeCodeLoader: java.library.path=/usr/local/hadoop/lib/native
    19/02/26 01:19:37 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
    [root@elk03 hadoop]# cd /usr/local/hadoop/lib/native
    [root@elk03 native]# ll
    total 5360
    -rw-rw-r-- 1 eshadoop hadoop 1370614 Oct 3 2016 libhadoop.a
    -rw-rw-r-- 1 eshadoop hadoop 1934326 Oct 3 2016 libhadooppipes.a
    lrwxrwxrwx 1 eshadoop hadoop 18 Feb 16 18:58 libhadoop.so -> libhadoop.so.1.0.0
    -rwxrwxr-x 1 eshadoop hadoop 798496 Oct 3 2016 libhadoop.so.1.0.0
    -rw-rw-r-- 1 eshadoop hadoop 650580 Oct 3 2016 libhadooputils.a
    -rw-rw-r-- 1 eshadoop hadoop 443766 Oct 3 2016 libhdfs.a
    lrwxrwxrwx 1 eshadoop hadoop 16 Feb 16 18:58 libhdfs.so -> libhdfs.so.0.0.0
    -rwxrwxr-x 1 eshadoop hadoop 280368 Oct 3 2016 libhdfs.so.0.0.0
    [root@elk03 native]# ldd libhadoop.so
    ./libhadoop.so: /lib64/libc.so.6: version `GLIBC_2.14' not found (required by ./libhadoop.so)
    linux-vdso.so.1 => (0x00007fff23ba8000)
    libdl.so.2 => /lib64/libdl.so.2 (0x00007f1b9bb6e000)
    libc.so.6 => /lib64/libc.so.6 (0x00007f1b9b7d9000)
    /lib64/ld-linux-x86-64.so.2 (0x00007f1b9bf9b000)
    [root@elk03 native]# ldd --version
    ldd (GNU libc) 2.12
    Copyright (C) 2010 Free Software Foundation, Inc.
    This is free software; see the source for copying conditions. There is NO
    warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.
    Written by Roland McGrath and Ulrich Drepper.

  • 相关阅读:
    Linux-1-用户管理
    接口相关资料整理
    JPype1使用总结
    1.django项目的创建(在CMD中)
    公有云、私有云和混合云的区别
    接口测试1.测试用例要点与模板
    PostMan Test 的脚本scripts编写方法
    Tensorflow RNN中的坑
    2019年终总结
    tensorflow中一种融合多个模型的方法
  • 原文地址:https://www.cnblogs.com/shanhua-fu/p/10436937.html
Copyright © 2011-2022 走看看