Spark RDD ouput path for data lineage

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

Spark RDD ouput path for data lineage

ard3nte
Hi, i am trying to do data lineage, so i need to extract output path from RDD
job (for example someRDD.saveAsTextFile("/path/")) using SparListener. How
can i do that?




--
Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/

---------------------------------------------------------------------
To unsubscribe e-mail: [hidden email]