joining streams from multiple kafka clusters

Previous Topic Next Topic
classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view

joining streams from multiple kafka clusters

My question is about ability to integrate spark streaming with multiple
clusters.Is it a supported use case. An example of that is that two topics
owned by different group and they have their own kakka infra .
Can i have two dataframes as a result of spark.readstream listening to
different kafka clueters in the same spark screaming job?
Any one has solved this usecase before?


Sent from:

To unsubscribe e-mail: [hidden email]