task not serializable on simple operations

Previous Topic Next Topic
classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view

task not serializable on simple operations

Imran Rajjad
Is there a way around to implement a separate Java class that implements serializable interface for even small petty arithmetic operations?

below is code from simple decision tree example

Double testMSE =  predictionAndLabel.map(new Function<Tuple2<Double, Double>, Double>() {
      public Double call(Tuple2<Double, Double> pl) {
        Double diff = pl._1() - pl._2();
        return diff * diff;
    }).reduce(new Function2<Double, Double, Double>() {

      public Double call(Double a, Double b) {
        return a + b;
    }) / testDataCount;

there are no complex java objects involved here and simple arithmetic operations.