I'm using spark for my program in local system. The current cofiguration is 32 cores and 64 GB memory. My datasize is 15 MB. I'm setting the following env parameters:
But I'm getting GC overhead issue, which is making my computation slow. I read [this] article and tried to tune my GC accordingly. But still it's throwing this problem.
Can anyone please guide me how to fix it?
If you reply to this email, your message will be added to the discussion below:
To start a new topic under Apache Spark User List, email [hidden email]
To unsubscribe from Apache Spark User List, click here.