How to add spark structured streaming kafka source receiver

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

How to add spark structured streaming kafka source receiver

zenglong chen
I have set the " maxOffsetsPerTrigger",but it still receive one partition per trigger on micro-batch mode.So where to set receiving on 10  partitions parallel like what is Spark Streaming doing?