executors in single local mode

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view

executors in single local mode


I'm trying to execute a stream application using local[4], however I just see one executor in the web UI, shouldn't be more? one executor per worker thread?

I'm trying to open connections in all the worker nodes to a mysql database and keep them open until the end of the stream.

Do you guys know any better way to do this? right now I'm just trying to create static connections in each worker but I just get one (from the driver program apparently)