Spark with Hadoop 3.3 distribution release in Download page

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

Spark with Hadoop 3.3 distribution release in Download page

Gabriel Magno
Are there any plans to provide a distribution release of Spark with Hadoop3.3 (spark-3.0.1-bin-hadoop3.2.tgz) directly in the Spark Download page (https://spark.apache.org/downloads.html)?

--
Gabriel Magno
Reply | Threaded
Open this post in threaded view
|

Re: Spark with Hadoop 3.3 distribution release in Download page

Gabriel Magno
Correction: spark-3.0.1-bin-hadoop3.3.tgz

--
Gabriel Magno


Em qua., 20 de jan. de 2021 às 00:34, Gabriel Magno <[hidden email]> escreveu:
Are there any plans to provide a distribution release of Spark with Hadoop3.3 (spark-3.0.1-bin-hadoop3.2.tgz) directly in the Spark Download page (https://spark.apache.org/downloads.html)?

--
Gabriel Magno
Reply | Threaded
Open this post in threaded view
|

Re: Spark with Hadoop 3.3 distribution release in Download page

Chao Sun
Hi Gabriel,

The distribution won’t be available for download until Spark supports Hadoop 3.3.x. At the moment, Spark cannot use Hadoop 3.3.0 because of various issues. Our best bet is to wait until Hadoop 3.3.1 comes out.

Best,
Chao

On Tue, Jan 19, 2021 at 8:00 PM Gabriel Magno <[hidden email]> wrote:
Correction: spark-3.0.1-bin-hadoop3.3.tgz

--
Gabriel Magno


Em qua., 20 de jan. de 2021 às 00:34, Gabriel Magno <[hidden email]> escreveu:
Are there any plans to provide a distribution release of Spark with Hadoop3.3 (spark-3.0.1-bin-hadoop3.2.tgz) directly in the Spark Download page (https://spark.apache.org/downloads.html)?

--
Gabriel Magno