Spark sample submitted with cluster deploy-mode does not work in Standalone

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Spark sample submitted with cluster deploy-mode does not work in Standalone

ctang
This post has NOT been accepted by the mailing list yet.
Spark sample submitted with cluster deploy-mode (./bin/run-example --master spark://localhost:6066 --deploy-mode=cluster SparkPi 10) throw out following error, any one knows what the problem is?
==
17/08/07 16:27:39 ERROR RestSubmissionClient: Exception from the cluster:
java.nio.file.NoSuchFileException: spark-internal
        sun.nio.fs.UnixException.translateToIOException(UnixException.java:86)
        sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:102)
        sun.nio.fs.UnixException.rethrowAsIOException(UnixException.java:107)
        sun.nio.fs.UnixCopyFile.copy(UnixCopyFile.java:526)
        sun.nio.fs.UnixFileSystemProvider.copy(UnixFileSystemProvider.java:253)
        java.nio.file.Files.copy(Files.java:1274)
        org.apache.spark.util.Utils$.org$apache$spark$util$Utils$$copyRecursive(Utils.scala:604)
        org.apache.spark.util.Utils$.copyFile(Utils.scala:575)
        org.apache.spark.util.Utils$.doFetchFile(Utils.scala:660)
        org.apache.spark.util.Utils$.fetchFile(Utils.scala:459)
        org.apache.spark.deploy.worker.DriverRunner.org$apache$spark$deploy$worker$DriverRunner$$downloadUserJar(DriverRunner.scala:154)
        org.apache.spark.deploy.worker.DriverRunner$$anon$1.run(DriverRunner.scala:83)
Loading...