Kryoserializer with pyspark

Previous Topic Next Topic
classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view

Kryoserializer with pyspark

Hichame El Khalfi

Hello there !!!

Is there any benefit from tuning `spark.kryoserializer.buffer` and `spark.kryoserializer.buffer.max` if we just use pyspark wth no Java or Scala classes ?

Thanks for your help,