Best alternative for Category Type in Spark Dataframe
This post has NOT been accepted by the mailing list yet.
I'm trying to convert a Pandas -> Spark dataframe. One of the columns I have is of the Category type in Pandas. But there does not seem to be support for this same type in Spark. What is the best alternative?