PySpark Streaming and Secured Kafka.

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

PySpark Streaming and Secured Kafka.

Ramaswamy, Muthuraman

Hi All,

 

I would like to use PySpark Streaming with secured Kafka as the source stream.

 

What options or arguments that I should pass in spark-submit command?

 

A sample spark-submit command with all the required options/arguments to access a remote-secured Kafka will help.

 

Thank you,

 

~Muthu R