Apache Spark User List

This forum is an archive for the mailing list user@spark.apache.org (more options) Messages posted here will be sent to this mailing list.
12345678 ... 365
Topics (12757)
Replies Last Post Views
[K8S] Option to keep the executor pods after job finishes by Li Gao-2
1
by Yinan Li
Exception: It appears that you are attempting to reference SparkContext from a broadcast variable, action, or transformation. SparkContext can only be used on the driver, not in code that it run on workers. For more information, see SPARK-5063. by zakhavan
0
by zakhavan
Does spark.streaming.concurrentJobs still exist? by kant kodali
0
by kant kodali
Any way to see the size of the broadcast variable? by V0lleyBallJunki3
2
by V0lleyBallJunki3
Internal Spark class is not registered by Kryo by 曹礼俊-2
0
by 曹礼俊-2
Internal Spark class is not registered by Kryo by 曹礼俊
0
by 曹礼俊
Internal Spark class is not registered by Kryo by 曹礼俊
0
by 曹礼俊
Internal Spark class is not registered by Kryo by 曹礼俊
0
by 曹礼俊
Internal Spark class is not registered by Kryo by 曹礼俊
0
by 曹礼俊
Spark internal class is not registered by Kryo by 曹礼俊
0
by 曹礼俊
Internal Spark class is not registered by Kryo by 曹礼俊
0
by 曹礼俊
Executor hang by 阎志涛
4
by 阎志涛
td by 冯 远森
0
by 冯 远森
Error while upserting ElasticSearch from Spark 2.2 by Deepak Sharma
0
by Deepak Sharma
Target java version not set when building spark with tags/v2.4.0-rc2 by Shubham Chaurasia
0
by Shubham Chaurasia
Where is the DAG stored before catalyst gets it? by jgp
1
by Jacek Laskowski
Recreate Dataset<Row> from list of Row in spark streaming application. by Robin Kuttaiah
2
by Robin Kuttaiah
error in job by yuvraj singh
1
by muthu
[PySpark join] Resolved attribute(s) missing from... Attribute(s) with the same name appear in the operation by Buckler, Christine
0
by Buckler, Christine
Specifying different version of pyspark.zip and py4j files on worker nodes with Spark pre-installed by Jianshi Huang
9
by Marcelo Vanzin-2
Unsubscribe by Donni Khan-2
0
by Donni Khan-2
PySpark structured streaming job throws socket exception by mmuru
2
by mmuru
Pyspark Partitioning by dimitris plakas
1
by Vitaliy Pisarev
Spark 2.3.1 leaves _temporary dir back on s3 even after write to s3 is done. by sushil.chaudhary
0
by sushil.chaudhary
How to do sliding window operation on RDDs in Pyspark? by zakhavan
4
by zakhavan
java.lang.IllegalArgumentException: requirement failed: BLAS.dot(x: Vector, y:Vector) was given Vectors with non-matching sizes by Mina Aslani
1
by hager
Use SparkContext in Web Application by Girish Vasmatkar
5
by Girish Vasmatkar
How to do a broadcast join using raw Spark SQL 2.3.1 or 2.3.2? by kant kodali
1
by kathleen li
Restarting a failed Spark streaming job running on top of a yarn cluster by jcgarciam
0
by jcgarciam
How to read remote HDFS from Spark using username? by Aakash Basu-2
3
by Aakash Basu-2
CSV parser - how to parse column containing json data by Nirav Patel
3
by Brandon Geise
Re: BroadcastJoin failed on partitioned parquet table by Wenchen Fan
0
by Wenchen Fan
Pyspark Partitioning by dimitris plakas
3
by Gourav Sengupta
Time-Series Forecasting by Mina Aslani
10
by Mina Aslani
[Structured Streaming SPARK-23966] Why non-atomic rename is problem in State Store ? by chandan prakash
1
by chandan prakash
12345678 ... 365