Apache Spark User List

This forum is an archive for the mailing list user@spark.apache.org (more options) Messages posted here will be sent to this mailing list.

New Topic

People

123456 ... 414

Topics (14463)

Replies

Last Post

Views

Is there any possibility to avoid double computation in case of RDD checkpointing by Ivan Petrov

by Ivan Petrov

Spark - Scala-Java interoperablity by Ramesh Mathikumar

by srowen

Fwd: Time stamp in Kafka by khajaasmath786

by khajaasmath786

Appropriate checkpoint interval in a spark streaming application by sheelstera

by sheelstera

ThriftServer LDAP doesn't work by ravi6c2

by ravi6c2

Where do the executors get my app jar from? by James Yu

by James Yu

Kafka spark structure streaming out of memory issue by km.santanu

by Srinivas V

help on use case - spark parquet processing by manjay

by Amit Sharma

How can I use pyspark to upsert one row without replacing entire table by Siavash Namvar

by Siavash Namvar

Spark ShutdownHook through python jobs. by Shriraj Bhardwaj

by Shriraj Bhardwaj

[SPARK-STRUCTURED-STREAMING] IllegalStateException: Race while writing batch 4 by Amit Joshi

by Jungtaek Lim-2

[Spark SQL]: Rationale for access modifiers and qualifiers in Spark by 김민우

by 김민우

Spark Streaming with Kafka and Python by Hamish Whittal

by srowen

S3 read/write from PySpark by Daniel Stojanov

by Stephen Coy

Support for group aggregate pandas UDF in streaming aggregation for SPARK 3.0 python by Aesha Dhar Roy

by Aesha Dhar Roy

Spark Structured streaming 2.4 - Kill and deploy in yarn by khajaasmath786

by khajaasmath786

regexp_extract regex for extracting the columns from string by anbutech

by Enrico Minack

Spark streaming receivers by Dark Crusader

by Russell Spitzer

Streaming AVRO data in console: java.lang.ArrayIndexOutOfBoundsException by dwgw

by dwgw

[Spark-Kafka-Streaming] Verifying the approach for multiple queries by Amit Joshi

by tianlangstudio

Spark batch job chaining by Amit Sharma

by Jun Zhu-2

[SPARK-SQL] How to return GenericInternalRow from spark udf by Amit Joshi

by srowen

join doesn't work by nt

by nt

Understanding Spark execution plans by Daniel Stojanov

by Daniel Stojanov

Multi insert with join in Spark SQL by moqi

by moqi

Tab delimited csv import and empty columns by Stephen Coy

by Stephen Coy

Comments conventions in Spark distribution official examples by Fuad Efendi

by srowen

Async API to save RDDs? by Antonin Delpeuch (li...

by Antonin Delpeuch (li...

file importing / hibernate by nt

by nt

Renaming a DataFrame column makes Spark lose partitioning information by Antoine Wendlinger

by Antoine Wendlinger

Pyspark: Issue using sql in foreachBatch sink by mmuru

by mmuru

What is an "analytics engine"? by Boris Gershfield

by tianlangstudio

DataSource API v2 & Spark-SQL by Lavelle, Shawn

by Lavelle, Shawn

CVE-2020-9480: Apache Spark RCE vulnerability in auth-enabled standalone master by Sean Owen

by Sean Owen

[Spark SQL]: Can't write DataFrame after using explode function on multiple columns. by hesouol

by hesouol

123456 ... 414