spark job getting hang

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

spark job getting hang

Amit Sharma
I am running spark job and if i run it sometimes it ran successfully but most of the time getting 

 ERROR Dropping event from queue appStatus. This likely means one of the listeners is too slow and cannot keep up with the rate at which tasks are being started by the scheduler. (org.apache.spark.scheduler.AsyncEventQueue).


Please suggest what  how to debug this issue.


Thanks
Amit