Re: Does Kafka dependency jars changed for Spark Structured Streaming 2.2.0?
I can actually compile the following code with any one of these jars. But none of them seem to print the messages to console however when I use Kafka-console-consumer with the same hello topic I can see messages. When I run my spark code it just hangs here forever even when I continue producing messages.
17/09/11 21:59:12 INFO AppInfoParser: Kafka version : 0.10.0.1
17/09/11 21:59:12 INFO AppInfoParser: Kafka commitId : a7a17cdec9eaa6c5
17/09/11 21:59:12 INFO CodeGenerator: Code generated in 153.741942 ms
17/09/11 21:59:12 INFO CodeGenerator: Code generated in 9.219524 ms
17/09/11 21:59:12 INFO AbstractCoordinator: Discovered coordinator localhost:9092 (id: 2147483647 rack: null) for group spark-kafka-source-ea00925f-353e-49e7-8719-f812bde4c25a--849182030-executor.