How to avoid copying hadoop conf to submit on yarn

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

How to avoid copying hadoop conf to submit on yarn

Yann Moisan
Hello,

I'm using Spark on YARN in cluster mode.

Is there a way to avoid copying the directory /etc/hadoop/conf to the machine where I run spark-submit ?

Regards,
Yann.