Spark Streaming using Flume body size limitation

classic Classic list List threaded Threaded
4 messages Options
Spark Streaming using Flume body size limitation – Hi, I am trying to send events to spark streaming via flume. It's working fine up to a certain point. I have problems when the size of the bo...
Hi, I think I found the problem. In SparkFlumeEvent the readExternal method use in.read(bodyBuff) which read the first 1020 bytes, but no more...
For some reason the patch did not make it. Trying via email: /D On May 23, 2014, at 9:52 AM, lemieud <david.lemieux@...> wrote:...
Created https://issues.apache.org/jira/browse/SPARK-1916 I'll submit a pull request soon. /D On May 23, 2014, at 9:56 AM, David Lemieux <d...