Launch a pyspark Job From UI

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
4 messages Options
Reply | Threaded
Open this post in threaded view
|

Launch a pyspark Job From UI

srungarapu vamsi
Hi,

I am looking for applications where we can trigger spark jobs from UI.
Are there any such applications available?

I have checked Spark-jobserver using which we can expose an api to submit a spark application.

Are there any other alternatives using which i can submit pyspark jobs from UI ?

Thanks,
Vamsi
Reply | Threaded
Open this post in threaded view
|

Re: Launch a pyspark Job From UI

hemant singh

On Mon, Jun 11, 2018 at 3:35 PM, srungarapu vamsi <[hidden email]> wrote:
Hi,

I am looking for applications where we can trigger spark jobs from UI.
Are there any such applications available?

I have checked Spark-jobserver using which we can expose an api to submit a spark application.

Are there any other alternatives using which i can submit pyspark jobs from UI ?

Thanks,
Vamsi

Reply | Threaded
Open this post in threaded view
|

Re: Launch a pyspark Job From UI

Sathishkumar Manimoorthy
You can use Zeppelin as well


Thanks,
Sathish

On Mon, Jun 11, 2018 at 4:25 PM, hemant singh <[hidden email]> wrote:

On Mon, Jun 11, 2018 at 3:35 PM, srungarapu vamsi <[hidden email]> wrote:
Hi,

I am looking for applications where we can trigger spark jobs from UI.
Are there any such applications available?

I have checked Spark-jobserver using which we can expose an api to submit a spark application.

Are there any other alternatives using which i can submit pyspark jobs from UI ?

Thanks,
Vamsi


Reply | Threaded
Open this post in threaded view
|

Re: Launch a pyspark Job From UI

Uğur Sopaoğlu
In reply to this post by hemant singh
Dear Hemant,

I have built spark cluster by using docker container. Can I use apache livy to submit a job to master node?

hemant singh <[hidden email]> şunları yazdı (11 Haz 2018 13:55):


On Mon, Jun 11, 2018 at 3:35 PM, srungarapu vamsi <[hidden email]> wrote:
Hi,

I am looking for applications where we can trigger spark jobs from UI.
Are there any such applications available?

I have checked Spark-jobserver using which we can expose an api to submit a spark application.

Are there any other alternatives using which i can submit pyspark jobs from UI ?

Thanks,
Vamsi