zoukankan      html  css  js  c++  java
  • hadoop碰到的 一个问题

    在里面添加/usr/local/hadoop/etc/hadoop/log4j.properties

    log4j.logger.org.apache.hadoop.util.NativeCodeLoader=DEBUG

    可以查看debug信息:

    [root@elk03 hadoop]# hdfs dfs -ls /
    19/02/26 01:19:37 DEBUG util.NativeCodeLoader: Trying to load the custom-built native-hadoop library...
    19/02/26 01:19:37 DEBUG util.NativeCodeLoader: Failed to load native-hadoop with error: java.lang.UnsatisfiedLinkError: /usr/local/hadoop/lib/native/libhadoop.so.1.0.0: /lib64/libc.so.6: version `GLIBC_2.14' not found (required by /usr/local/hadoop/lib/native/libhadoop.so.1.0.0)
    19/02/26 01:19:37 DEBUG util.NativeCodeLoader: java.library.path=/usr/local/hadoop/lib/native
    19/02/26 01:19:37 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

    #############问题#########

    [root@elk03 sbin]# hadoop dfs -ls /
    DEPRECATED: Use of this script to execute hdfs command is deprecated.
    Instead use the hdfs command for it.

    19/02/26 01:17:11 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

    ##################解决#################

    [root@elk03 hadoop]# hdfs dfs -ls /
    19/02/26 01:19:37 DEBUG util.NativeCodeLoader: Trying to load the custom-built native-hadoop library...
    19/02/26 01:19:37 DEBUG util.NativeCodeLoader: Failed to load native-hadoop with error: java.lang.UnsatisfiedLinkError: /usr/local/hadoop/lib/native/libhadoop.so.1.0.0: /lib64/libc.so.6: version `GLIBC_2.14' not found (required by /usr/local/hadoop/lib/native/libhadoop.so.1.0.0)
    19/02/26 01:19:37 DEBUG util.NativeCodeLoader: java.library.path=/usr/local/hadoop/lib/native
    19/02/26 01:19:37 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
    [root@elk03 hadoop]# cd /usr/local/hadoop/lib/native
    [root@elk03 native]# ll
    total 5360
    -rw-rw-r-- 1 eshadoop hadoop 1370614 Oct 3 2016 libhadoop.a
    -rw-rw-r-- 1 eshadoop hadoop 1934326 Oct 3 2016 libhadooppipes.a
    lrwxrwxrwx 1 eshadoop hadoop 18 Feb 16 18:58 libhadoop.so -> libhadoop.so.1.0.0
    -rwxrwxr-x 1 eshadoop hadoop 798496 Oct 3 2016 libhadoop.so.1.0.0
    -rw-rw-r-- 1 eshadoop hadoop 650580 Oct 3 2016 libhadooputils.a
    -rw-rw-r-- 1 eshadoop hadoop 443766 Oct 3 2016 libhdfs.a
    lrwxrwxrwx 1 eshadoop hadoop 16 Feb 16 18:58 libhdfs.so -> libhdfs.so.0.0.0
    -rwxrwxr-x 1 eshadoop hadoop 280368 Oct 3 2016 libhdfs.so.0.0.0
    [root@elk03 native]# ldd libhadoop.so
    ./libhadoop.so: /lib64/libc.so.6: version `GLIBC_2.14' not found (required by ./libhadoop.so)
    linux-vdso.so.1 => (0x00007fff23ba8000)
    libdl.so.2 => /lib64/libdl.so.2 (0x00007f1b9bb6e000)
    libc.so.6 => /lib64/libc.so.6 (0x00007f1b9b7d9000)
    /lib64/ld-linux-x86-64.so.2 (0x00007f1b9bf9b000)
    [root@elk03 native]# ldd --version
    ldd (GNU libc) 2.12
    Copyright (C) 2010 Free Software Foundation, Inc.
    This is free software; see the source for copying conditions. There is NO
    warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.
    Written by Roland McGrath and Ulrich Drepper.

  • 相关阅读:
    详解EBS接口开发之采购申请导入
    EBS HRMS数据表
    会计期间
    帐套和会计科目的理解
    oracle中动态SQL详解
    不同币种汇率转换
    API创建/更新员工联系电话
    API创建/更新员工薪水
    Android 圆形、圆角图片ImageView
    Knowledge Generation Model for Visual Analytics
  • 原文地址:https://www.cnblogs.com/shanhua-fu/p/10436937.html
Copyright © 2011-2022 走看看