I cannot use spark 2.3.0 and kafka 0.9?

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

I cannot use spark 2.3.0 and kafka 0.9?

kant kodali
Hi All,

This link seems to suggest I cant use Spark 2.3.0 and Kafka 0.9 broker. is that correct?

https://spark.apache.org/docs/latest/streaming-kafka-integration.html

Thanks!
Reply | Threaded
Open this post in threaded view
|

Re: I cannot use spark 2.3.0 and kafka 0.9?

Shixiong(Ryan) Zhu
"note that the 0.8 integration is compatible with later 0.9 and 0.10 brokers, but the 0.10 integration is not compatible with earlier brokers."

This is pretty clear. You can use 0.8 integration to talk to 0.9 broker.

Best Regards,

Shixiong Zhu
Databricks Inc.


On Fri, May 4, 2018 at 2:02 AM, kant kodali <[hidden email]> wrote:
Hi All,

This link seems to suggest I cant use Spark 2.3.0 and Kafka 0.9 broker. is that correct?

https://spark.apache.org/docs/latest/streaming-kafka-integration.html

Thanks!