Moving from java.util.HashMap to org.apache.spark.util.AppendOnlyMap.scala

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

Moving from java.util.HashMap to org.apache.spark.util.AppendOnlyMap.scala

Archit Thakur
Hi,

In spark-0.8.1, in org.apache.spark.Aggregator.scala where actual aggregation is done, logic has been moved from hashMap to AppendOnlyMap. Was there any specific reason for that.
Any issues found in java.util.HashMap?

I am asking this, because I am facing a problem, which could be related to HashMap/ AppendOnlyMap.

Thanks and Regards,
Archit Thakur.