Dose --py-files place the files on the PYTHONPATH of executor?

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

Dose --py-files place the files on the PYTHONPATH of executor?

thinkdoom2
I use spark-submint --help, and find:
--jars: driver,executor classpath
--files --archives: working directory of each executor.

But for --py-files:
--py-files: place on the PYTHONPATH for Python apps.
It hasn't describe whether it is placed on executor(it is sure whill be
placed on driver).

So dose --py-files place the files on the PYTHONPATH of executor?
dose --files and --archives can't be read in driver?




--
Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/

---------------------------------------------------------------------
To unsubscribe e-mail: [hidden email]