Launching spark job using Sparklauncher

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

Launching spark job using Sparklauncher

balpatkar.itengg@gmail.com
This post has NOT been accepted by the mailing list yet.
SparkAppHandle handler = new SparkLauncher()
                 .setAppResource("/home/cloudera/workspace/spark/target/spark-0.0.1-SNAPSHOT.jar")
                 .setSparkHome("/usr/lib/spark")
                 .setMainClass("spark.WordCount")
                 .setMaster("local").setConf(SparkLauncher.DRIVER_MEMORY, "2g")
                 .startApplication(); // <-- and start spark job app

I am providing setAppResource() argument as jar file location but i want provide directly class how i can launch this application?