how sequence of chained jars in spark.(driver/executor).extraClassPath matters

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

how sequence of chained jars in spark.(driver/executor).extraClassPath matters

Richard Xin-2
so let's say I have chained path in spark.driver.extraClassPath/spark.executor.extraClassPath such as /path1/*:/path2/*, and I have different versions of the same jar under those 2 directories, how spark pick the version of jar to use, from /path1/*?

Thanks.