spark web ui kill application but still exists background

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

spark web ui kill application but still exists background

xiaoming w
When I kill an application on the Web UI (which I submit with
standalone-client mode), it seems to be killed already; But when I use 'jps'
command I can still see the application running background. This is my demo
code to reappear this problem.

And, 
If I kill the application on web ui when section 1 rdd.map process, it can
be stopped clearly;
If I kill the application on web ui when section 2 do something in the
driver, and then it stll running background.
So, what's the reason and how to solve it?



--
Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/

---------------------------------------------------------------------
To unsubscribe e-mail: [hidden email]