Apache Spark User List

This forum is an archive for the mailing list user@spark.apache.org (more options) Messages posted here will be sent to this mailing list.
123456 ... 392
Topics (13708)
Replies Last Post Views
Can anyone suggest what is wrong with my spark job here? by Shyam P
0
by Shyam P
Unable to verify in-transit encryption by G R
0
by G R
Classloading issues when using connectors with Uber jars with improper Shading in single Spark job by Sharma, Praneet
1
by Sharma, Praneet
Monitor Spark Applications by raman gugnani
3
by Alex Landa
[Spark SQL]: Does Union operation followed by drop duplicate follows "keep first" by Abhinesh Hada
4
by Dhaval Patel
Partitioning query by ☼ R Nair (रविशंकर ना...
0
by ☼ R Nair (रविशंकर ना...
Cluster sizing by Riccardo Ferrari
0
by Riccardo Ferrari
Exception when reading multiline JSON file by Kumaresh AK
1
by kevin.r.mellott
Inconsistent dataset behavior between file and in-memory versions by Dean Arnold
0
by Dean Arnold
Spark Kafka Streaming making progress but there is no data to be consumed by Charles vinodh
7
by Charles vinodh
script running in jupyter 6-7x faster than spark submit by Dhrubajyoti Hati
14
by AbdealiJK
Access all of the custom streaming query listeners that were registered to spark session by Natalie Ruiz
1
by Gabor Somogyi
question about pyarrow.Table to pyspark.DataFrame conversion by Artem Kozhevnikov
1
by Bryan Cutler
Deadlock using Barrier Execution by csmith
0
by csmith
Custom encoders and udf's by jelmer
0
by jelmer
[ANNOUNCE] Announcing Apache Spark 2.3.4 by Kazuaki Ishizaki
0
by Kazuaki Ishizaki
Problem upgrading from 2.3.1 to 2.4.3 with gradle by Nathan Kronenfeld-2
0
by Nathan Kronenfeld-2
Re: read image or binary files / spark 2.3 by Peter Liu
1
by Peter Liu
OOM Error by Ankit Khettry
9
by Ankit Khettry
how to refresh the loaded non-streaming dataframe for each steaming batch ? by Shyam P
4
by Shyam P
Question on streaming job wait and re-run by David Zhou
0
by David Zhou
[Spark Streaming Kafka 0-10] - What was the reason for adding "spark-executor-" prefix to group id in executor configurations by Sethupathi T
5
by Sethupathi T
DataSourceV2: pushFilters() is not invoked for each read call - spark 2.3.2 by Shubham Chaurasia
1
by Hyukjin Kwon
Anonymous functions cannot be found by Yuta Morisawa
0
by Yuta Morisawa
org.apache.spark.sql.AnalysisException: Detected implicit cartesian product by kyunam
0
by kyunam
Start point to read source codes by David Zhou
2
by David Zhou
Collecting large dataset by Rishikesh Gawade
1
by Marcin Tustin
Tune hive query launched thru spark-yarn job. by Himali Patel
2
by Himali Patel
Test mail by Himali Patel
0
by Himali Patel
How to query StructField's metadata in spark sql? by kyunam
0
by kyunam
Issue with structured streaming custom data source V2 by stevech.hu
0
by stevech.hu
Re: Even after VO fields are mapped using @Table and @Column annotations get error NoSuchElementException by Shyam P
0
by Shyam P
Structured Streaming: How to add a listener for when a batch is complete by Natalie Ruiz
2
by Gourav Sengupta
EMR Spark 2.4.3 executor hang by Daniel Zhang
1
by Vadim Semenov-3
Unit testing PySpark Code and doing assertion by Rahul Nandi
0
by Rahul Nandi
123456 ... 392