Apache Spark User List

This forum is an archive for the mailing list user@spark.apache.org (more options) Messages posted here will be sent to this mailing list.
12345 ... 375
Topics (13120)
Replies Last Post Views
Mutating broadcast variable from executors, any risks even if done in a thread-safe manner? by Jan Brabec (janbrabe...
0
by Jan Brabec (janbrabe...
read json and write into parquet in executors by Lian Jiang
0
by Lian Jiang
unsubscribe by Byron Lee
0
by Byron Lee
returning type of function that needs to be passed to method 'mapWithState' by shicheng31604@gmail....
0
by shicheng31604@gmail....
use rocksdb for spark structured streaming (SSS) by Lian Jiang
4
by Lian Jiang
How to know if a machine in a Spark cluster 'participate's a job by zjzzjz
0
by zjzzjz
Optimize tables used more than once: make dataframe persistent or save as parquet by zjzzjz
0
by zjzzjz
A spark streaming problem about shuffle operation by linrick
0
by linrick
Difference between 'cores' config params: spark submit on k8s by Battini Lakshman
0
by Battini Lakshman
spark structured streaming crash due to decompressing gzip file failure by Lian Jiang
2
by Lian Jiang
mapreduce.input.fileinputformat.split.maxsize not working for spark 2.4.0 by Akshay Mendole
2
by Akshay Mendole
[SparkSQL, user-defined Hadoop, K8s] Hadoop free spark on kubernetes => NoClassDefFound by Sommer Tobias
0
by Sommer Tobias
Hadoop free spark on kubernetes => NoClassDefFound by Sommer Tobias
0
by Sommer Tobias
Structured Streaming to Kafka Topic by Pankaj Wahane
1
by Akshay Bhardwaj
PysPark date_add function suggestion by William Creger
0
by William Creger
Why does Apache Spark Master shutdown when Zookeeper expires the session by lokeshkumar
1
by Jungtaek Lim
"java.lang.AssertionError: assertion failed: Failed to get records for **** after polling for 180000" error by JF Chen
4
by JF Chen
(no subject) by Shyam P
1
by Shyam P
[SQL] 64-bit hash function, and seeding by Huon.Wilson
2
by Huon.Wilson
Is there a way to validate the syntax of raw spark sql query? by kant kodali
2
by kant kodali
[Kubernets] [SPARK-27061] Need to expose 4040 port on driver service by Chandu Kavar
3
by Chandu Kavar
[PySpark] TypeError: expected string or bytes-like object by Thomas Ryck
0
by Thomas Ryck
How to add more imports at the start of REPL by Nuthan Reddy
2
by Nuthan Reddy
C++ script on Spark Cluster throws exit status 132 by Mkal
0
by Mkal
Join selection by Akhilanand
0
by Akhilanand
error in sprark sql by yuvraj singh
1
by Shyam P
subscribe by Qian He
0
by Qian He
Difference between One map vs multiple maps by Yeikel
0
by Yeikel
Spark SQL doesn't produce output while hive does by mayangyang02
2
by Patrik Medvedev
Connect to hive 3 from spark by Nicolas Paris-2
0
by Nicolas Paris-2
Timeout between driver and application master (Thrift Server) by Jürgen Thomann
0
by Jürgen Thomann
Shuffle service with more than one executor by Bruno Faria
0
by Bruno Faria
disable spark disk cache by Andrey Dudin
1
by Hien Luu
Milliseconds in timestamp by swastik mittal
0
by swastik mittal
updateBytesRead() by swastik mittal
0
by swastik mittal
12345 ... 375