Exactly-Once delivery with Structured Streaming and Kafka

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

Exactly-Once delivery with Structured Streaming and Kafka

William Briggs-2
I noticed that Spark 2.4.0 implemented support for reading only committed messages in Kafka, and was excited. Are there currently any plans to update the Kafka output sink to support exactly-once delivery? 

Thanks,
Will