SRK
SRK
Registered:
Groups: Anyone, Registered
Posts in Apache Spark User List
1234 ... 6
Show   Total: 106 items
Date Subject Count Location
How to get time slice or the batch time for which the current micro batch is running in Spark Streaming 0 replies Apache Spark User List
Slower performance while running Spark Kafka Direct Streaming with Kafka 10 cluster 0 replies Apache Spark User List
ReduceByKeyAndWindow checkpoint recovery issues in Spark Streaming 0 replies Apache Spark User List
How to force Spark Kafka Direct to start from the latest offset when the lag is huge in kafka 10? 0 replies Apache Spark User List
Issues when trying to recover a textFileStream from checkpoint in Spark streaming 0 replies Apache Spark User List
Memory consumption and checkpointed data seems to increase incrementally when reduceByKeyAndWIndow with inverse function is used with mapWithState in Stateful streaming 0 replies Apache Spark User List
Does mapWithState need checkpointing to be specified in Spark Streaming? 2 replies Apache Spark User List
Spark streaming does not seem to clear MapPartitionsRDD and ShuffledRDD that are persisted after the use of updateStateByKey and reduceByKeyAndWindow with inverse functions even after checkpointing the data 0 replies Apache Spark User List
Partitions cached by updatStateByKey does not seem to be getting evicted forever 0 replies Apache Spark User List
How to make sure that Spark Kafka Direct Streaming job maintains the state upon code deployment? 0 replies Apache Spark User List
How to reduce the amount of data that is getting written to the checkpoint from Spark Streaming 4 replies Apache Spark User List
How do I find the time taken by each step in a stage in a Spark Job 0 replies Apache Spark User List
Spark Streaming reduceByKeyAndWindow with inverse function seems to iterate over all the keys in the window even though they are not present in the current batch 0 replies Apache Spark User List
How to bootstrap Spark Kafka direct with the previous state in case of a code upgrade 0 replies Apache Spark User List
Is Structured streaming ready for production usage 0 replies Apache Spark User List
Exception which using ReduceByKeyAndWindow in Spark Streaming. 0 replies Apache Spark User List
Checkpointing fro reduceByKeyAndWindow with a window size of 1 hour and 24 hours 0 replies Apache Spark User List
HyperLogLogMonoid for unique visitor count in Spark Streaming 0 replies Apache Spark User List
How does Spark provide Hive style bucketing support? 0 replies Apache Spark User List
How to tune groupBy operations in Spark 2.x? 0 replies Apache Spark User List
1234 ... 6