欢迎访问 生活随笔!

生活随笔

当前位置: 首页 > 编程资源 > 编程问答 >内容正文

编程问答

hadoop碰到的 一个问题

发布时间:2024/7/5 编程问答 20 豆豆
生活随笔 收集整理的这篇文章主要介绍了 hadoop碰到的 一个问题 小编觉得挺不错的,现在分享给大家,帮大家做个参考.

在里面添加/usr/local/hadoop/etc/hadoop/log4j.properties

log4j.logger.org.apache.hadoop.util.NativeCodeLoader=DEBUG

 

可以查看debug信息:

[root@elk03 hadoop]# hdfs dfs -ls /
19/02/26 01:19:37 DEBUG util.NativeCodeLoader: Trying to load the custom-built native-hadoop library...
19/02/26 01:19:37 DEBUG util.NativeCodeLoader: Failed to load native-hadoop with error: java.lang.UnsatisfiedLinkError: /usr/local/hadoop/lib/native/libhadoop.so.1.0.0: /lib64/libc.so.6: version `GLIBC_2.14' not found (required by /usr/local/hadoop/lib/native/libhadoop.so.1.0.0)
19/02/26 01:19:37 DEBUG util.NativeCodeLoader: java.library.path=/usr/local/hadoop/lib/native
19/02/26 01:19:37 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

 

 

#############问题#########

[root@elk03 sbin]# hadoop dfs -ls /
DEPRECATED: Use of this script to execute hdfs command is deprecated.
Instead use the hdfs command for it.

19/02/26 01:17:11 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable

 

##################解决#################

[root@elk03 hadoop]# hdfs dfs -ls /
19/02/26 01:19:37 DEBUG util.NativeCodeLoader: Trying to load the custom-built native-hadoop library...
19/02/26 01:19:37 DEBUG util.NativeCodeLoader: Failed to load native-hadoop with error: java.lang.UnsatisfiedLinkError: /usr/local/hadoop/lib/native/libhadoop.so.1.0.0: /lib64/libc.so.6: version `GLIBC_2.14' not found (required by /usr/local/hadoop/lib/native/libhadoop.so.1.0.0)
19/02/26 01:19:37 DEBUG util.NativeCodeLoader: java.library.path=/usr/local/hadoop/lib/native
19/02/26 01:19:37 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
[root@elk03 hadoop]# cd /usr/local/hadoop/lib/native
[root@elk03 native]# ll
total 5360
-rw-rw-r-- 1 eshadoop hadoop 1370614 Oct 3 2016 libhadoop.a
-rw-rw-r-- 1 eshadoop hadoop 1934326 Oct 3 2016 libhadooppipes.a
lrwxrwxrwx 1 eshadoop hadoop 18 Feb 16 18:58 libhadoop.so -> libhadoop.so.1.0.0
-rwxrwxr-x 1 eshadoop hadoop 798496 Oct 3 2016 libhadoop.so.1.0.0
-rw-rw-r-- 1 eshadoop hadoop 650580 Oct 3 2016 libhadooputils.a
-rw-rw-r-- 1 eshadoop hadoop 443766 Oct 3 2016 libhdfs.a
lrwxrwxrwx 1 eshadoop hadoop 16 Feb 16 18:58 libhdfs.so -> libhdfs.so.0.0.0
-rwxrwxr-x 1 eshadoop hadoop 280368 Oct 3 2016 libhdfs.so.0.0.0
[root@elk03 native]# ldd libhadoop.so
./libhadoop.so: /lib64/libc.so.6: version `GLIBC_2.14' not found (required by ./libhadoop.so)
linux-vdso.so.1 => (0x00007fff23ba8000)
libdl.so.2 => /lib64/libdl.so.2 (0x00007f1b9bb6e000)
libc.so.6 => /lib64/libc.so.6 (0x00007f1b9b7d9000)
/lib64/ld-linux-x86-64.so.2 (0x00007f1b9bf9b000)
[root@elk03 native]# ldd --version
ldd (GNU libc) 2.12
Copyright (C) 2010 Free Software Foundation, Inc.
This is free software; see the source for copying conditions. There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.
Written by Roland McGrath and Ulrich Drepper.

转载于:https://www.cnblogs.com/shanhua-fu/p/10436937.html

总结

以上是生活随笔为你收集整理的hadoop碰到的 一个问题的全部内容,希望文章能够帮你解决所遇到的问题。

如果觉得生活随笔网站内容还不错,欢迎将生活随笔推荐给好友。