Driver Information

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

Driver Information

Amit Sharma
Hi, I have 20 node clusters. I run multiple batch jobs. in spark submit file ,driver memory=2g and executor memory=4g and I have 8 GB worker. I have below questions

1. Is there any way I know in each batch job which worker is the driver node?
2. Will the driver node be part of one of the executors or it is independent ?



Thanks
Amit