Avoid re-creating __spark_conf__5678XXXX.zip in /tmp for each application submit and copy under application specific .staging directory

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

Avoid re-creating __spark_conf__5678XXXX.zip in /tmp for each application submit and copy under application specific .staging directory

Bhatta, Ramesha

Hello,

 

I have created an enhancement request describing details in the https://issues.apache.org/jira/browse/SPARK-33864.

 

Kindly check and vote for this enhancement and/or provide your insight/suggestions.

 

Regards,

-Ramesh