Apache Spark User List

This forum is an archive for the mailing list user@spark.apache.org (more options) Messages posted here will be sent to this mailing list.

New Topic

People

1234 ... 357

Topics (12464)

Replies

Last Post

Views

No space left on device by lordjoe

by Gourav Sengupta

CBO not predicting cardinality on partition columns for Parquet tables by rajat mishra

by rajat mishra

Insert a pyspark dataframe in postgresql by dimitris plakas

by dimitris plakas

Structured Streaming on Kubernetes by Krishna Kalyan

by puneetloya

Spark with Scala : understanding closures or best way to take udf registrations' code out of main and put in utils by aastha

by aastha

Unsubscribe by Happy每一天

by Happy每一天

Why repartitionAndSortWithinPartitions slower than MapReducer by 周浥尘

by Koert Kuipers

Two different Hive instances running by Fabio Wada

by Vaibhav Kulkarni

Refresh broadcast variable when it isn't the value. by Guillermo Ortiz Fern...

by Guillermo Ortiz Fern...

java.nio.file.FileSystemException: /tmp/spark- .._cache : No space left on device by Polisetti, Venkata S...

by naresh Goud

csv reader performance with multiline option by Nirav Patel

by Nicolas Paris-2

Use Spark extension points to implement row-level security by Richard Siebeling

by Richard Siebeling

spark driver pod stuck in Waiting: PodInitializing state in Kubernetes by purna pradeep

by purna pradeep

Pyspark error when converting string to timestamp in map function by Keith Chapman

by Keith Chapman

[Spark Streaming] [ML]: Exception handling for the transform method of Spark ML pipeline model by sudododo

by sudododo

Pass config file through spark-submit by James Starks

by James Starks

Unable to see completed application in Spark 2 history web UI by Fawze Abujaber

by Fawze Abujaber

java.lang.UnsupportedOperationException: No Encoder found for Set[String] by V0lleyBallJunki3

by Manu Zhang

something happened to MemoryStream after spark 2.3 by Koert Kuipers

by Koert Kuipers

[K8S] Spark initContainer custom bootstrap support for Spark master by Li Gao-2

by Li Gao-2

java.lang.IndexOutOfBoundsException: len is negative - when data size increases by Deepak Sharma

by Vadim Semenov-2

Structured streaming: Tried to fetch $offset but the returned record offset was ${record.offset}" by ARAVIND SETHURATHNAM

by weand

from_json function by dbolshak

by dbolshak

[ANNOUNCE] Apache Toree 0.2.0-incubating Released by Luciano Resende

by Luciano Resende

JdbcRDD - schema always resolved as nullable=true by Subhash Sriram

by Subhash Sriram

from_json schema order by Brandon Geise

by Brandon Geise

Dynamic Allocation not removing executors by Maximiliano Patricio...

by Maximiliano Patricio...

Shuffle uses Direct Memory Buffer even after setting "spark.shuffle.io.preferDirectBufs = false" by Vaibhav Kulkarni

by Vaibhav Kulkarni

Java API for statistics of spark job running on yarn by Serkan TAS

by Serkan TAS

Spark CEP by Esa Heikkinen-2

by Esa Heikkinen-2

Custom state store provider based on RocksDB by Alexander Chermenin

by Alexander Chermenin

How to convert Spark Streaming to Static Dataframe on the fly and pass it to a ML Model as batch by Aakash Basu-2

by Gourav Sengupta

Sending data from ZeroMQ to Spark Streaming API with Python by oreogundipe

by oreogundipe

How to parallelize zip file processing? by mytramesh

by mytramesh

Accessing a dataframe from another Singleton class (Python) by Aakash Basu-2

by Aakash Basu-2

1234 ... 357