[Structured Streaming] Continuous Processing Mode plan?

Previous Topic Next Topic
classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view

[Structured Streaming] Continuous Processing Mode plan?

Marchant, Hayden
I was really excited by the demo in Summer 2017 on Continuous Processing Mode for Structured Streaming, and have been regularly checking the JIRA item (https://issues.apache.org/jira/browse/SPARK-20928) for activity.

We have a project with very low latency requirements that can only be fulfilled with this type of abilities. We'd very much like to be able to use Spark, and not use other streaming frameworks which already offer very low latency.

Can someone clarify whether this will be included in an upcoming release, and at what scope will all scenarios be covered?


To unsubscribe e-mail: [hidden email]