Shark runtime error

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

Shark runtime error

Kishore kumar
Installed the spark and scala to run the shark with the help of this document https://github.com/amplab/shark/wiki/Running-Shark-on-a-Cluster
when i run shark the error which iam getting is



-- [root@localhost bin]# shark

Starting the Shark Command Line Client
WARNING: org.apache.hadoop.metrics.jvm.EventCounter is deprecated. Please use org.apache.hadoop.log.metrics.EventCounter in all the log4j.properties files.
Logging initialized using configuration in jar:file:/root/shark-0.8.0-bin-cdh4/hive-0.9.0-shark-0.8.0-bin/lib/hive-common-0.9.0-shark-0.8.0.jar!/hive-log4j.properties
Hive history file=/tmp/root/hive_job_log_root_201401140937_1343032668.txt
56.095: [GC 262656K->21306K(1005568K), 1.5447170 secs]
shark> Exception in thread "Thread-2" org.apache.spark.SparkException: Error stopping standalone scheduler's driver actor
    at org.apache.spark.scheduler.cluster.StandaloneSchedulerBackend.stop(StandaloneSchedulerBackend.scala:174)
    at org.apache.spark.scheduler.cluster.SparkDeploySchedulerBackend.stop(SparkDeploySchedulerBackend.scala:61)
    at org.apache.spark.scheduler.cluster.ClusterScheduler.stop(ClusterScheduler.scala:309)
    at org.apache.spark.scheduler.DAGScheduler.stop(DAGScheduler.scala:856)
    at org.apache.spark.SparkContext.stop(SparkContext.scala:676)
    at shark.SharkEnv$.stop(SharkEnv.scala:134)
    at shark.SharkCliDriver$$anon$1.run(SharkCliDriver.scala:109)
Caused by: java.util.concurrent.TimeoutException: Futures timed out after [10000] milliseconds
    at akka.dispatch.DefaultPromise.ready(Future.scala:870)
    at akka.dispatch.DefaultPromise.result(Future.scala:874)
    at akka.dispatch.Await$.result(Future.scala:74)
    at org.apache.spark.scheduler.cluster.StandaloneSchedulerBackend.stop(StandaloneSchedulerBackend.scala:170)
    ... 6 more
any help..

Please check the attachment for shark-withinfo output


--

Kishore Kumar
ITIM


console.output (21K) Download Attachment