native snappy library not available: this version

2019-08-22 10:11发布

java.lang.RuntimeException: native snappy library not available: this version of libhadoop was built without snappy support. at org.apache.hadoop.io.compress.SnappyCodec.checkNativeCodeLoaded(SnappyCodec.java:65) at org.apache.hadoop.io.compress.SnappyCodec.getCompressorType(SnappyCodec.java:134) at org.apache.hadoop.io.compress.CodecPool.getCompressor(CodecPool.java:150)

enter image description here

i am using hadoop 2.7.3 version and hive 2.1.1 version

标签: hadoop hive
1条回答
劳资没心,怎么记你
2楼-- · 2019-08-22 10:34

I have the same problem with you and I solved it.

As the error hint, the problem is libhadoop.so library that is not support snappy when building. When hadoop invoke libhadoop.so's public static native boolean buildSupportsSnappy(), it will return false. So, we get the error.

The solution is following BUILDING.txt to build libhadoop.so supporting snappy.

Good luck.

查看更多
登录 后发表回答