SRK
SRK
Registered:
Groups: Anyone, Registered
Posts in Apache Spark User List
1234 ... 6
Show   Total: 111 items
Date Subject Count Location
Automatic Json Schema inference using Structured Streaming 1 reply Apache Spark User List
Re: Lag and queued up batches info in Structured Streaming UI 1 reply Apache Spark User List
Lag and queued up batches info in Structured Streaming UI 4 replies Apache Spark User List
How do I implement forEachWriter in structured streaming so that the connection is created once per partition? 0 replies Apache Spark User List
Does structured streaming support Spark Kafka Direct? 1 reply Apache Spark User List
How to get time slice or the batch time for which the current micro batch is running in Spark Streaming 0 replies Apache Spark User List
Slower performance while running Spark Kafka Direct Streaming with Kafka 10 cluster 0 replies Apache Spark User List
ReduceByKeyAndWindow checkpoint recovery issues in Spark Streaming 0 replies Apache Spark User List
How to force Spark Kafka Direct to start from the latest offset when the lag is huge in kafka 10? 0 replies Apache Spark User List
Issues when trying to recover a textFileStream from checkpoint in Spark streaming 0 replies Apache Spark User List
Memory consumption and checkpointed data seems to increase incrementally when reduceByKeyAndWIndow with inverse function is used with mapWithState in Stateful streaming 0 replies Apache Spark User List
Does mapWithState need checkpointing to be specified in Spark Streaming? 2 replies Apache Spark User List
Spark streaming does not seem to clear MapPartitionsRDD and ShuffledRDD that are persisted after the use of updateStateByKey and reduceByKeyAndWindow with inverse functions even after checkpointing the data 0 replies Apache Spark User List
Partitions cached by updatStateByKey does not seem to be getting evicted forever 0 replies Apache Spark User List
How to make sure that Spark Kafka Direct Streaming job maintains the state upon code deployment? 0 replies Apache Spark User List
How to reduce the amount of data that is getting written to the checkpoint from Spark Streaming 4 replies Apache Spark User List
How do I find the time taken by each step in a stage in a Spark Job 0 replies Apache Spark User List
Spark Streaming reduceByKeyAndWindow with inverse function seems to iterate over all the keys in the window even though they are not present in the current batch 0 replies Apache Spark User List
How to bootstrap Spark Kafka direct with the previous state in case of a code upgrade 0 replies Apache Spark User List
Is Structured streaming ready for production usage 0 replies Apache Spark User List
1234 ... 6