Distribution of spark 3.0.1 with Hive1.2

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

Distribution of spark 3.0.1 with Hive1.2

Dmitry
Hi all, I am trying to make distribution 3.0.1 with spark 3 using
./dev/make-distribution.sh --name spark3-hive12 --pip  --tgz  -Phive-1.2 -Phadoop-2.7 -Pyarn
The problem is maven can't found right profile for hive and build ends without hive jars
++ /Users/reireirei/spark/spark/build/mvn help:evaluate -Dexpression=project.activeProfiles -pl sql/hive -Phive-1.2 -Phadoop-2.7 -Pyarn
++ grep -v INFO
++ grep -v WARNING
++ fgrep --count '<id>hive</id>'
++ echo -n
+ SPARK_HIVE=0
+ '[' spark3-hive12 == none ']'
+ echo 'Spark version is 3.0.1'
Spark version is 3.0.1

What is the correct way to build in hive 1.2  jars in spark distribution?