Custom SparkListener

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

Custom SparkListener

Chitturi Padma
Hello All,

I am trying to extend SparkListener and post job ends trying to retrieve job name to check the status of either success/failure and write to log file.

I couldn't find a way where I could fetch job name in the onJobEnd method.

Thanks,
Padma CH
Reply | Threaded
Open this post in threaded view
|

Re: Custom SparkListener

Mark Hamstra
What do you mean? Spark Jobs don't have names.

On Thu, Sep 20, 2018 at 9:40 PM Priya Ch <[hidden email]> wrote:
Hello All,

I am trying to extend SparkListener and post job ends trying to retrieve job name to check the status of either success/failure and write to log file.

I couldn't find a way where I could fetch job name in the onJobEnd method.

Thanks,
Padma CH