Apache Spark User List

This forum is an archive for the mailing list user@spark.apache.org (more options) Messages posted here will be sent to this mailing list.
1 ... 45678910 ... 318
Topics (11128)
Replies Last Post Views
Spark streaming does not seem to clear MapPartitionsRDD and ShuffledRDD that are persisted after the use of updateStateByKey and reduceByKeyAndWindow with inverse functions even after checkpointing the data by SRK
0
by SRK
REST Api for a running Spark Streaming job is not updating by SM290
0
by SM290
Testing another Dataset after ML training by mckunkel
1
by mckunkel
Hive on S3 EMR moving temp files really slow by tafranky
0
by tafranky
Spark in Docker container? by lola
2
by lola
Contact MSN Customer Service For Signup & Signin Errors by jacobsmithwts
0
by jacobsmithwts
Which Storage format to use by hitansu
0
by hitansu
Storage format by hitansu
0
by hitansu
Spark stalling during shuffle (maybe a memory issue) by jonathan.keebler
11
by Toshiba_r
Regarding UUID data type in spark sql by srinu.gajjala321@gma...
0
by srinu.gajjala321@gma...
Integrating Kafka 0.10 or higher with Spark 2.1.1 -- required jars by mahendra
0
by mahendra
How does Dataframe determines the number and size of the output files? by kchew
0
by kchew
Structured Streaming: consumerGroupId by aravias
0
by aravias
Partitions cached by updatStateByKey does not seem to be getting evicted forever by SRK
0
by SRK
Do we anything for Deep Learning in Spark? by Gaurav1809
4
by Gaurav1809
Not able to query on partitioned table in hive which is created using Spark dataframe by Sunil Kumar
1
by rajeshspark
Mean/Averaging list of lists in an RDD by FK
0
by FK
MongoDB and Spark integration Query by hemanta
0
by hemanta
How to reduce the amount of data that is getting written to the checkpoint from Spark Streaming by SRK
4
by yncxcw
spark-jdbc impala with kerberos using yarn-client by twisterius
1
by morfious902002
Structured Streaming UI similar to Spark Streaming by Yuval.Itzchakov
0
by Yuval.Itzchakov
saveAsTextFile by DaveHysom
2
by mrunfeldt
spark streaming socket read issue by pradeepbill
0
by pradeepbill
[Spark Structured Streaming] Exception while using watermark with type of timestamp by Biplob Biswas
1
by abaghel
PySpark working with Generators by saatvikshah1994
0
by saatvikshah1994
spark.pyspark.python is ignored? by Jason White
0
by Jason White
Time taken by multiple executors has huge difference for the same input size by Megha Upadhyay
0
by Megha Upadhyay
Understanding how spark share db connections created on driver by salvador
0
by salvador
Optusmail support phone number 1800-057-707 | Optusmail support by Alisiamoore
0
by Alisiamoore
Resource Wastage because of caching and way to tune it by SM290
0
by SM290
How to propagate Non-Empty Value in SPARQL Dataset by carloallocca
0
by carloallocca
How to propagate Non-Empty Value in SPARQL Dataset by carloallocca
0
by carloallocca
How to write dataset object to excel in spark java? by BhanuMathi
0
by BhanuMathi
How can Contact Mozilla Firefox Browser by atlasnumberdir
0
by atlasnumberdir
How to make sure that Spark Kafka Direct Streaming job maintains the state upon code deployment? by SRK
0
by SRK
1 ... 45678910 ... 318