Setting spark.akka.frameSize

classic Classic list List threaded Threaded
2 messages Options
Setting spark.akka.frameSize – Hi all, Configuration: Standalone 0.9.1-cdh4 cluster, 7 workers per node, 32gb per worker I'm running a job on a spark cluster, and running ...
Hi Matt, First of all, in Spark 1.0 there's logging when the message exceeds the frame size, so you won't have silent hangs in this scenario a...