Kryoserializer with pyspark

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

Kryoserializer with pyspark

Hichame El Khalfi

Hello there !!!

Is there any benefit from tuning `spark.kryoserializer.buffer` and `spark.kryoserializer.buffer.max` if we just use pyspark wth no Java or Scala classes ?

Thanks for your help,

Hichame