"failed to get records for spark-executor after polling for ***" error

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

"failed to get records for spark-executor after polling for ***" error

JF Chen
Some kafka consumer tasks throw "failed to get records for spark-executor after polling for ***" error some times. In detail, some tasks take very long time, and throw this error.  However while the task restarts, it recovers very soon. 
My spark version is 2.2.0 


Regard,
Junfeng Chen
Reply | Threaded
Open this post in threaded view
|

Re: "failed to get records for spark-executor after polling for ***" error

Gabor Somogyi
Hi,

There are not much details in the mail so hard to tell exactly. Maybe you're facing

BR,
G


On Mon, Dec 3, 2018 at 10:32 AM JF Chen <[hidden email]> wrote:
Some kafka consumer tasks throw "failed to get records for spark-executor after polling for ***" error some times. In detail, some tasks take very long time, and throw this error.  However while the task restarts, it recovers very soon. 
My spark version is 2.2.0 


Regard,
Junfeng Chen