Structured streaming checkpointing

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

Structured streaming checkpointing

puneetloya
Hi,

Is s3 a good storage candidate for structured streaming checkpointing?
According to the structured streaming guide, it must be HDFS compliant.
https://spark.apache.org/docs/latest/structured-streaming-programming-guide.html

I see people using s3 for checkpointing but is it suitable for the
structured streaming?





--
Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/

---------------------------------------------------------------------
To unsubscribe e-mail: [hidden email]