Apache Spark User List
only in this topic
Open this post in threaded view
Hi, I have 20 node clusters. I run multiple batch jobs. in spark submit file ,driver memory=2g and executor memory=4g and I have 8 GB worker. I have below questions
1. Is there any way I know in each batch job which worker is the driver node?
2. Will the driver node be part of one of the executors or it is independent ?
Return to Apache Spark User List
1 view|%1 views
Free forum by Nabble
Edit this page