Spark stable release for Hadoop 3

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

Spark stable release for Hadoop 3

Piper Spark
Hello,

We are considering whether to use Hadoop or Kubernetes as the cluster manager for Spark. We would prefer to have Hadoop 3 because of its native support for scheduling GPUs.

Although there is a Spark 3.0.0 pre-view2 version available that is pre-built for Hadoop 3, I would like to know when is the estimated date for a Spark stable release for Hadoop 3.

Thank you,

Piper