RDD values and defensive copying

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view

RDD values and defensive copying

Allen Chang
Hi all,

I had a question: if I have an RDD containing mutable values, and I run a function over the RDD which mucks with the mutable values, what happens? What happens in the case of a cogroup? e.g.:


Will this result in undefined behavior? Is it a best practice then to make sure functionThatModifiesValues() performs a defensive copy if necessary?