Structured Streaming using Kafka Avro Record in 2.3.0

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

Structured Streaming using Kafka Avro Record in 2.3.0

Harsh
Hi 

How can we deserialise avro record read from kafka in spark 2.3.0 in optimised manner. I could see that native support for avro was added in 2.4.x.
  
Currently i am using following library which is very slow.
<dependency>
<groupId>com.twitter</groupId>
<artifactId>bijection-avro_2.11</artifactId>
</dependency>

Kind Regards
Harsh Takkar