Which Storage format to use

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|  
Report Content as Inappropriate

Which Storage format to use

hitansu
This post has NOT been accepted by the mailing list yet.
I am confused with which storage format to use with spark.Between Avro vs Parquet vs ORC, I have eliminated Avro as I want a columnar storage for faster read. But between Parquet & ORC, I am not able to decide which one to use. From initial investigation ORC seems to be better than Parquet.Is ORC fully supported in Spark & does it support schema evolution ?
Loading...