Possible upgrade path from Spark 3.1.1-RC2 to Spark 3.1.1 GA

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

Possible upgrade path from Spark 3.1.1-RC2 to Spark 3.1.1 GA

Mich Talebzadeh
Hi,

Is there any direct upgrade path from 3.1.1 RC-2 to 3.1.1 GA.

If there is, will that involve replacing the Spark binaries?

thanks,

Mich 



LinkedIn  https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw

 



Disclaimer: Use it at your own risk. Any and all responsibility for any loss, damage or destruction of data or any other property which may arise from relying on this email's technical content is explicitly disclaimed. The author will in no case be liable for any monetary damages arising from such loss, damage or destruction.

 

Reply | Threaded
Open this post in threaded view
|

Re: Possible upgrade path from Spark 3.1.1-RC2 to Spark 3.1.1 GA

srowen
I think you're still asking about GCP and Dataproc, and that's really nothing to do with Spark itself.
Whatever issues you are having concern Dataproc and how it's run and possibly customizations in Dataproc.
3.1.1-RC2 is not a release, but, also nothing meaningfully changed between it and the final 3.1.1 release. There is no need for any change to work with 3.1.1.


On Thu, Mar 4, 2021 at 8:16 AM Mich Talebzadeh <[hidden email]> wrote:
Hi,

Is there any direct upgrade path from 3.1.1 RC-2 to 3.1.1 GA.

If there is, will that involve replacing the Spark binaries?

thanks,

Mich 



LinkedIn  https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw

 



Disclaimer: Use it at your own risk. Any and all responsibility for any loss, damage or destruction of data or any other property which may arise from relying on this email's technical content is explicitly disclaimed. The author will in no case be liable for any monetary damages arising from such loss, damage or destruction.

 

Reply | Threaded
Open this post in threaded view
|

Re: Possible upgrade path from Spark 3.1.1-RC2 to Spark 3.1.1 GA

Mich Talebzadeh
Ok, thanks. 



LinkedIn  https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw

 



Disclaimer: Use it at your own risk. Any and all responsibility for any loss, damage or destruction of data or any other property which may arise from relying on this email's technical content is explicitly disclaimed. The author will in no case be liable for any monetary damages arising from such loss, damage or destruction.

 



On Thu, 4 Mar 2021 at 14:39, Sean Owen <[hidden email]> wrote:
I think you're still asking about GCP and Dataproc, and that's really nothing to do with Spark itself.
Whatever issues you are having concern Dataproc and how it's run and possibly customizations in Dataproc.
3.1.1-RC2 is not a release, but, also nothing meaningfully changed between it and the final 3.1.1 release. There is no need for any change to work with 3.1.1.


On Thu, Mar 4, 2021 at 8:16 AM Mich Talebzadeh <[hidden email]> wrote:
Hi,

Is there any direct upgrade path from 3.1.1 RC-2 to 3.1.1 GA.

If there is, will that involve replacing the Spark binaries?

thanks,

Mich 



LinkedIn  https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw

 



Disclaimer: Use it at your own risk. Any and all responsibility for any loss, damage or destruction of data or any other property which may arise from relying on this email's technical content is explicitly disclaimed. The author will in no case be liable for any monetary damages arising from such loss, damage or destruction.