How does Spark Streaming handle late data?

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

How does Spark Streaming handle late data?

lafeier
Hi, All
I am using Spark Streaming for real-time data, but the data is delayed.
My batch time is set to 15 minutes and then Spark steaming trigger calculation at 15 minutes,30 minutes,45 minutes and 60 minutes, but my data delay is 5 minutes, what should I do?
Can spark be calculated at 20,35,50,05 minutes?
If not, how do these issues be handled in Spark steaming?

--------------------------------------------------------------------- To unsubscribe e-mail: [hidden email]