Apache spark on windows without shortnames enabled

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view

Apache spark on windows without shortnames enabled


We use Apache Spark 2.2.0 in our stack. Our software by default like other
softwares gets installed under "C:\Program Files\....". We have a
restriction that we cannot ask our customers to enable short names on their
machines. From our experience, spark does not handle the absolute paths well
if there is a whitespace in the path neither while calling spark-class2.cmd
from commandline nor the paths inside spark-env.cmd.

We have tried the following:
1. Using double quotes around the path.
2. Escaping the whitespaces.
3. Using relative paths.

None of them have been successful in bringing up spark. How do you recommend
handling this?

Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/

To unsubscribe e-mail: [hidden email]