Apache Spark User List

This forum is an archive for the mailing list user@spark.apache.org (more options) Messages posted here will be sent to this mailing list.

New Topic

People

1234567 ... 354

Topics (12362)

Replies

Last Post

Views

Spark Streaming PID rate controller minRate default value by Faxian Zhao

by Faxian Zhao

[Spark Structured Streaming] Measure metrics from CsvSink for Rate source by Dhruv Kumar

by Dhruv Kumar

Lag and queued up batches info in Structured Streaming UI by SRK

by Tathagata Das

How to reduceByKeyAndWindow in Structured Streaming? by oripwk

by Tathagata Das

Caching when you perfom one action and have a dataframe used more than once. by mxmn

by mxmn

How to handle java.sql.Date inside Maps with to_json / from_json by patrickmcgloin

by patrickmcgloin

[Spark Streaming] Spark Streaming with S3 vs Kinesis by Farshid Zavareh

by Farshid Zavareh

Not able to overwrite cassandra table using Spark by Abhijeet Kumar

by Siva Samraj

Semi-Supervised self-training (e.g. partial fitting) by Mina Aslani

by Mina Aslani

submitting dependencies by amin mohebbi

by jgp

[PYSPARK Word2Vec] Error when loading Word2Vec before calling SparkSession by tgiordan

by tgiordan

[ANNOUNCE] Apache Bahir 2.2.1 Released by Luciano Resende

by Luciano Resende

RepartitionByKey Behavior by Chawla,Sumit

by Chawla,Sumit

the best tool to interact with Spark by Donni Khan-2

by ayan guha

Increase no of tasks by pratik4891

by JayeshLalwani

[Spark Streaming] Measure latency by Daniele Foroni

by maasg

Recommendation of using StreamSinkProvider for a custom KairosDB Sink by subramgr

by subramgr

Can we get the partition Index in an UDF by JayeshLalwani

by Vadim Semenov-2

Pyspark is not picking up correct python version on azure hdinsight by amit kumar singh

by amit kumar singh

Error when joining on two bucketed tables by Vitaliy Pisarev

by Vitaliy Pisarev

[Spark SQL] was it correct that only one executor was used to shuffle the data for reduce task? by deszuc@163.com

by deszuc@163.com

Broadcast Variables by Puneet Lakhina

by mrsanketh

restarting ranger kms causes spark thrift server to stop by quentinlam

by rahvin

Driver doesn't respect the request to abort itself by Mesos by igor.berman

by igor.berman

Internal table stored NULL as \N. How to remove it by Mahender Sarangam

by Mahender Sarangam

Spark sql creating managed table with location converts it to external table by Nirav Patel

by Nirav Patel

Dataframe to automatically create Impala table when writing to Impala by spicoflorin

by spicoflorin

Kafka streaming maxOffsetsPerTrigger by subramgr

by subramgr

Spark 2.3.1 not working on Java 10 by rahulagrawal

by vaquar khan

Spark 2.3.0 and Custom Sink by subramgr

by Yogesh

Does Spark Structured Streaming have a JDBC sink or Do I need to use ForEachWriter? by kant kodali

by kant kodali

createorreplacetempview cause memory leak by onmstester onmsteste...

by onmstester onmsteste...

[Spark SQL]: How to read Hive tables with Sub directories - is this supported? by mattl156

by Daniel Pires

Blockmgr directories intermittently not being cleaned up by Jeff F

by tBoyle

[Help] Codegen Stage grows beyond 64 KB by Aakash Basu-2

by Kazuaki Ishizaki

1234567 ... 354