Increase time for Spark Job to be in Accept mode in Yarn

classic Classic list List threaded Threaded
3 messages Options
Reply | Threaded
Open this post in threaded view
|

Increase time for Spark Job to be in Accept mode in Yarn

Chetan Khatri
Hello Spark Users,

Can you please tell me how to increase the time for Spark job to be in Accept mode in Yarn.

Thank you. Regards,
Chetan
Reply | Threaded
Open this post in threaded view
|

Re:Increase time for Spark Job to be in Accept mode in Yarn

Jiaan Geng
Hi , please tell me why you need to increase the time?





At 2019-01-22 18:38:29, "Chetan Khatri" <[hidden email]> wrote:
Hello Spark Users,

Can you please tell me how to increase the time for Spark job to be in Accept mode in Yarn.

Thank you. Regards,
Chetan


 

Reply | Threaded
Open this post in threaded view
|

Re: Increase time for Spark Job to be in Accept mode in Yarn

Chetan Khatri
Hello Beliefer,
I am orchestrating many spark jobs using Airflow and when some of the spark jobs get started and running and many other would be in accepted mode and sometimes 1-2 jobs go to failure state if yarn cannot create container application.

Thanks

On Wed, Jan 23, 2019 at 9:15 AM 大啊 <[hidden email]> wrote:
Hi , please tell me why you need to increase the time?





At 2019-01-22 18:38:29, "Chetan Khatri" <[hidden email]> wrote:
Hello Spark Users,

Can you please tell me how to increase the time for Spark job to be in Accept mode in Yarn.

Thank you. Regards,
Chetan