Cloudera Hive on Spark 2.x?

2019-02-26 03:08发布

问题:

Looking at this:

https://www.cloudera.com/documentation/spark2/latest/topics/spark2_known_issues.html#hive_on_spark

To summarize, it says Hive doesn't work on Spark 2.x in Cloudera.

However, I assume Hive does run on Spark 2.x in other distributions. Has anyone configured CDH 5.10.x or higher to run Hive on Spark 2.x?

Is Spark 2.x a big leap forward from Spark 1.6?

回答1:

The latest released version of Hive as of now is 2.1.x and it does not support Spark 2.x (see https://issues.apache.org/jira/browse/HIVE-14029). When Hive version 2.2.0 is released it will support Spark 2.x.