Apache Spark User List

This forum is an archive for the mailing list user@spark.apache.org (more options) Messages posted here will be sent to this mailing list.
12345678 ... 370
Topics (12933)
Replies Last Post Views
Using spark and mesos container with host_path volume by Antoine DUBOIS
0
by Antoine DUBOIS
Parallel read parquet file, write to postgresql by James Starks
1
by Shahab Yunus
Executor launched but no tasks is submitted by wuchang1989
0
by wuchang1989
"failed to get records for spark-executor after polling for ***" error by JF Chen
1
by Gabor Somogyi
PicklingError - Can't pickle py4j.protocol.Py4JJavaError - it's not the same object by AbdealiJK
0
by AbdealiJK
Java: pass parameters in spark sql query by Mann Du
2
by 965
Do we need to kill a spark job every time we change and deploy it? by Mina Aslani
2
by 965
Caused by: java.io.NotSerializableException: com.softwaremill.sttp.FollowRedirectsBackend by James Starks
3
by James Starks
Spark and Zookeeper HA failures by Mark Bidewell
0
by Mark Bidewell
Spark 2.4.0 worker can't find work/app/folderNo directory for logs by flyingmeatball
0
by flyingmeatball
Spark 2.4.0 worker can't find work/app/folderNo directory for logs by flyingmeatball
0
by flyingmeatball
Spark streaming join on yarn by Abhijeet Kumar
1
by Tathagata Das
PySpark Direct Streaming : SASL Security Compatibility Issue by Ramaswamy, Muthurama...
1
by Gabor Somogyi
spark unsupported conversion to Stringtype error by JF Chen
0
by JF Chen
Upgrading spark history server, no logs showing. by bbarks
1
by bbarks
Spark Streaming join taking long to process by Abhijeet Kumar
3
by Shixiong(Ryan) Zhu
Spark Streaming by Siva Samraj
2
by Siva Samraj
Spark column combinations and combining multiple dataframes (pyspark) by Christopher Petrino
0
by Christopher Petrino
Re: [Spark SQL]: Does Spark SQL 2.3+ suppor UDT? by Suny Tyagi
0
by Suny Tyagi
Encoding not working when using a map / mapPartitions call by ccaspanello
0
by ccaspanello
Zookeeper and Spark deployment for standby master by akila.wajirasena
1
by Jörn Franke
Casting nested columns and updated nested struct fields. by Colin Williams-2
2
by Colin Williams-2
[Spark ORC | SQL | Hive] Buffer size too small when using filterPushdown predicate=True (ref.: SPARK-25145) by Bjørnar Jensen
0
by Bjørnar Jensen
Show function name in Logs for PythonUDFRunner by AbdealiJK
2
by AbdealiJK
spark2.3.2 "load data inpath /hrds/tablename-* " can't use * for A class of files by yutaochina
1
by yutaochina
How to Keep Null values in Parquet by Chetan Khatri
2
by Chetan Khatri
Spark 2.3.0 with HDP Got completely successfully but status FAILED with error by Chetan Khatri
0
by Chetan Khatri
Structured Streaming restart results in illegal state exception by Magnus Nilsson-2
0
by Magnus Nilsson-2
spark-sql force parallel union by onmstester onmsteste...
3
by Alessandro Solimando
Structured Streaming to file sink results in illegal state exception by Magnus Nilsson
0
by Magnus Nilsson
Monthly Apache Spark Newsletter by Ankur Gupta
0
by Ankur Gupta
Is there any window operation for RDDs in Pyspark? like for DStreams by zakhavan
0
by zakhavan
Spark DataSets and multiple write(.) calls by Rico B.
6
by Gourav Sengupta
streaming pdf by Nicolas Paris-2
4
by Jörn Franke
[Spark SQL] [Spark 2.4.0] v1 -> struct(v1.e) fails by François Sarradin
1
by kathleen li
12345678 ... 370