yarn.application.classpath in yarn-site.xml

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view

yarn.application.classpath in yarn-site.xml


I've just tested spark in yarn mode, but something made me confused.

When I delete the "yarn.application.classpath" configuration in yarn-site.xml, the following command works well.
bin/spark-class org.apache.spark.deploy.yarn.Client --jar examples/target/scala-2.10/spark-examples_2.10-assembly-0.9.0-incubating.jar --class org.apache.spark.examples.SparkPi --args yarn-standalone --num-worker 3

However, when I configures it as follows, yarnAppState has always kept in the ACCEPTED state. The application has no tend to stop.

Hadoop version is 2.2.0 and the cluster has one master and three workers.

Does anyone have ideas about this problem?