Executor unable to pick postgres driver in Spark standalone cluster
This post has NOT been accepted by the mailing list yet.
I was submitting the play application to spark 2.1 standalone cluster . In play application postgres dependency is also added and application works on local spark libraries. But at run time on standalone cluster it gives me error :
o.a.s.s.TaskSetManager - Lost task 0.0 in stage 0.0 (TID 1, 172.31.21.3, executor 1): java.lang.ClassNotFoundException: org.postgresql
I have placed following in spark-defaults.conf directory