Spark Streaming Job is stucked

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

Spark Streaming Job is stucked

kumar.rajat20del
Hello Everyone,

My spark streaming job is running too slow, it is having batch time of 15 seconds and the batch gets completed in 20-22 secs. It was fine till 1st week October, but it is behaving this way suddenly. I know changing the batch time can help , but other than that any idea what can be done?

Please note I am using Direct Stream Approach

Thanks
Rajat Sharma
Reply | Threaded
Open this post in threaded view
|

Re: Spark Streaming Job is stucked

Artemis User
If it was running fine before and stops working now, one thing I could
think of may be your disk was full.  Check your disk space and clean up
your old log files might help...

On 10/18/20 12:06 PM, rajat kumar wrote:

> Hello Everyone,
>
> My spark streaming job is running too slow, it is having batch time of
> 15 seconds and the batch gets completed in 20-22 secs. It was fine
> till 1st week October, but it is behaving this way suddenly. I know
> changing the batch time can help , but other than that any idea what
> can be done?
>
> Please note I am using Direct Stream Approach
>
> Thanks
> Rajat Sharma

---------------------------------------------------------------------
To unsubscribe e-mail: [hidden email]