Apache Spark User List

This forum is an archive for the mailing list user@spark.apache.org (more options) Messages posted here will be sent to this mailing list.

New Topic

People

1234 ... 417

Topics (14578)

Replies

Last Post

Views

How to apply ranger policies on Spark by joyan sil

by joyan sil

spark cassandra questiom by adfel70

by Sonal Goyal

Cache not getting cleaned. by Amit Sharma-2

by Kevin Pis

Spark SQL check timestamp with other table and update a column. by anbutech

by Khalid Mammadov

Blacklisting in Spark Stateful Structured Streaming by Eric Beabes

by Eric Beabes

Spark Exception by Amit Sharma-2

by Russell Spitzer

Cannot perform operation after producer has been closed by Eric Beabes

by Gabor Somogyi

Out of memory issue by Amit Sharma-2

by Russell Spitzer

Kafka Topic to Parquet HDFS with Structured Streaming by Chetan Khatri

by AlbertoMarq

Spark 3.0.1 new Proleptic Gregorian calendar by Saurabh Gulati

by Maxim Gekk

Need Unit test complete reference for Pyspark by Sachit Murarka

by Marco Mistroni

Disable parquet metadata for count by Gary Li

by Gary Li

Can all the parameters of hive be used on spark sql? by Gang Li

by Gang Li

Announcing Hyperspace v0.3.0 - an indexing subsystem for Apache Spark™ by imback82

by Rahul Potharaju

Single spark streaming job to read incoming events with dynamic schema by act_coder

by act_coder

spark-sql on windows throws Exception in thread "main" java.lang.UnsatisfiedLinkError: by Mich Talebzadeh

by Mich Talebzadeh

DStreams stop consuming from Kafka by Razvan-Daniel Mihai

by liyuanjian

Re:Re: Flink 1.11 not showing logs by 马阳阳

by 马阳阳

PyCharm IDE throws spark error by Mich Talebzadeh

by Mich Talebzadeh

Submitting extra jars on spark applications on yarn with cluster mode by Pedro Cardoso

by Artemis User

Refreshing Data in Spark Memory (DataFrames) by Arti Pande

by Lalwani, Jayesh

Spark on Kubernetes by Arti Pande

by Arti Pande

Purpose of type in pandas_udf by Daniel Stojanov

by srowen

Path of jars added to a Spark Job - spark-submit // // Override jars in spark submit by Dominique De Vito

by Dominique De Vito

Spark Dataset withColumn issue by Vikas Garg

by Lalwani, Jayesh

Spark[SqL] performance tuning by Lakshmi Nivedita

by Lakshmi Nivedita

spark UI storage tab by Amit Sharma-2

by Amit Sharma-2

Slow insert into overwrite in spark in object store backed hive tables by joyan sil

by joyan sil

Spark 2.4 lifetime by netanel246

by srowen

Pyspark application hangs (no error messages) on Python RDD .map by Daniel Stojanov

by Daniel Stojanov

Spark Parquet file size by Tzahi File

by Tzahi File

Creating hive table through df.write.mode("overwrite").saveAsTable("DB.TABLE") by Mich Talebzadeh

by Mich Talebzadeh

Distribution of spark 3.0.1 with Hive1.2 by Dmitry

by Dmitry

repartition in Spark by Ashok Kumar-2

by Mich Talebzadeh

Ask about Pyspark ML interaction by Du, Yi

by Du, Yi

1234 ... 417