Question on streaming job wait and re-run

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

Question on streaming job wait and re-run

David Zhou
Hi,
My streaming job consumes data from kafka and writes them into Cassandra. 

Current status: 
Cassandra is not stable. Streaming job crashed when it can't write data into Cassandra. Streaming job has check point. Usually, the Cassandra cluster will come back in 4 hours. Finally, I start the streaming job again, and it will start from check point and run.

Expectation:
Streaming job can enter a status like thread wait, not crash, and it will be notified automatically when Cassandra comes back. 

Does Streaming job support this feature? I searched by Google, can't find related solutions.

Thanks.
David