Apache Spark User List

Stopping StreamingContext does not kill receiver

_‹ Previous Topic Next Topic _›

Classic

List

Threaded

9 messages Options

Nick Chammas Stopping StreamingContext does not kill receiver – From the interactive shell I’ve created a StreamingContext. I call ssc.start() and take a look at http://master_url:4040/streaming/ and see th...

Nick Chammas To add a potentially relevant piece of information, around when I stop the StreamingContext, I get the following warning: 14/07/12 22:16:18 WA...

Tathagata Das Yes, thats a bug i just discovered. Race condition in the Twitter Receiver, will fix asap. Here is the JIRA https://issues.apache.org/jira/brows...

Nick Chammas Okie doke. Thanks for filing the JIRA. On Sat, Jul 12, 2014 at 6:45 PM, Tathagata Das <tathagata.das1565@...> wrote: > Yes, that...

lbustelo I'm running on spark 1.0.0 and I see a similar problem when using the socketTextStream receiver. The ReceiverTracker task sticks around after a ss...

Tathagata Das Can you give the stack trace? This was the fix for the twitter stream. https://github.com/apache/spark/pull/1577/files You could try doin...

lbustelo Sorry about the screenshot… but that is what I have handy right now. You can see that we get a WARN and it ultimately say that it stopped successf...

Tathagata Das Okay let me give it a shot. On Wed, Aug 6, 2014 at 3:57 PM, lbustelo <gino@...> wrote: > Sorry about the screenshot… but that is ...

Tathagata Das I narrowed down the error. Unfortunately this is not quick fix. I have opened a JIRA for this. https://issues.apache.org/jira/browse/SPARK-2892 ...