Dependency management using https in spark on kubernetes

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

Dependency management using https in spark on kubernetes

Pradeepta Choudhury
Hey guys , 
I have an external api from which i can download the main jar from . when i do a spark-submit ...all confs...https:api.call.com/somefile.jar . it gives an error file already exist in the tmp directory and file content doesn't match error . how can i fix this? Do i need to use an kubernetes init container ? 


Thanks