Apache Spark User List

This forum is an archive for the mailing list user@spark.apache.org (more options) Messages posted here will be sent to this mailing list.
1 ... 3456789 ... 359
Topics (12553)
Replies Last Post Views
How to make Yarn dynamically allocate resources for Spark by Anton Puzanov
0
by Anton Puzanov
Executor lost for unknown reasons error Spark 2.3 on kubernetes by Mamillapalli, Purna ...
3
by purna pradeep
Use Arrow instead of Pickle without pandas_udf by Hichame El Khalfi
4
by Hichame El Khalfi
How to do PCA with Spark Streaming Dataframe? by Aakash Basu-2
1
by Aakash Basu-2
Query on Profiling Spark Code by Aakash Basu-2
2
by Aakash Basu-2
How to Create one DB connection per executor and close it after the job is done? by kant kodali
3
by Vadim Semenov-2
sorting on dataframe causes out of memory (java heap space) by msbreuer
0
by msbreuer
Kafka backlog - spark structured streaming by Kailash Kalahasti
2
by Arun Mahadevan
How to reduceByKeyAndWindow in Structured Streaming? by oripwk
3
by oripwk
Using Spark Streaming for analyzing changing data by oripwk
0
by oripwk
How to read csv in dataframe by Lehak Dharmani
0
by Lehak Dharmani
Big Burst of Streaming Changes by ayan guha
0
by ayan guha
[SparkContext] will application immediately stop after sc.stop()? by bsikander
0
by bsikander
modeling timestamp in Avro messages (read using Spark Structured Streaming) by karan alang
0
by karan alang
How to read json data from kafka and store to hdfs with spark structued streaming? by dddaaa
5
by Arbab Khalil
Iterative rdd union + reduceByKey operations on small dataset leads to "No space left on device" error on account of lot of shuffle spill. by dineshdharme
2
by dineshdharme
Question of spark streaming by uutkarshsingh
1
by Arun Mahadevan
Exceptions with simplest Structured Streaming example by Jonathan Apple
2
by Jonathan Apple
Backpressure initial rate not working by Biplob Biswas
5
by Biplob Biswas
Optimizing a join with bucketing by Vitaliy Pisarev
0
by Vitaliy Pisarev
[Spark Structured Streaming on K8S]: Debug - File handles/descriptor (unix pipe) leaking by abhisheyke
2
by Yuval.Itzchakov
Bug in Window Function by Elior Malul
1
by Jacek Laskowski
***UNCHECKED*** UNSUBSCRIBE by sridhararao mutluri
0
by sridhararao mutluri
***UNCHECKED*** How dose spark streaming program (written with scala)call python file by 康逸之
1
by 康逸之
Live Code Reviews, Coding, and Dev Tools by Holden Karau
0
by Holden Karau
[Structured Streaming] Avoiding multiple streaming queries by Priyank Shrivastava
13
by Karthik Reddy Vadde
Arrow type issue with Pandas UDF by Patrick McCarthy-2
3
by Gourav Sengupta
Where can I read the Kafka offsets in SparkSQL application by John, Vishal (Agoda)...
1
by Gourav Sengupta
Query on Spark Hive with kerberos Enabled on Kubernetes by Garlapati, Suryanara...
2
by Garlapati, Suryanara...
Spark on Mesos - Weird behavior by Zois Theodoros
7
by Zois Theodoros
Spark on Mesos: Spark issuing hundreds of SUBSCRIBE requests / second and crashing Mesos by Nimi W
2
by Nimi W
Interest in adding ability to request GPU's to the spark client? by Daniel Galvez
3
by Susan X. Huynh
spark sql data skew by 崔苗
5
by Gourav Sengupta
Apache Spark Cluster by Uğur Sopaoğlu
0
by Uğur Sopaoğlu
How to register custom structured streaming source by Farshid Zavareh
1
by Hien Luu
1 ... 3456789 ... 359