Need help on Calling Pyspark code using Wheel

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

Need help on Calling Pyspark code using Wheel

Sachit Murarka
Hi Users,

I have created a wheel file using Poetry. I tried running the following commands to run spark job using wheel , but it is not working. Can anyone please let me know about the invocation step for the wheel file?

spark-submit --py-files /path/to/wheel
spark-submit --files /path/to/wheel

Thanks
Sachit

Kind Regards,
Sachit Murarka