Apache Spark User List

This forum is an archive for the mailing list user@spark.apache.org (more options) Messages posted here will be sent to this mailing list.

New Topic

People

1234567 ... 315

Topics (11019)

Replies

Last Post

Views

build spark current master can not use hive metadatamysql by zhangxin0112

by zhangxin0112

Roadrunner emails send/receive problems. by rihanajonsen123

by rihanajonsen123

issue in add row functionality by Dhaval

by abhimadav

PySpark LDA logLikelihood / logPerplexity functions not found by ajaythampi

by ajaythampi

Invocation of StreamingContext.stop() hangs in 1.5 by jiten

by vasanths

Spark Streaming watermark is a time interval by yogeshg

by yogeshg

The streamingContext stops before waiting for the processing of all received data to be completed by dali

by dali

how to set spark driver memory and executor memory by Dhaval

by Dhaval

Spark jobs profiling by matus.cimerman

by matus.cimerman

After setting HADOOP_CONF_DIR getting file not found exceptions when running spark-submit by cbredlow

by cbredlow

How to force Spark Kafka Direct to start from the latest offset when the lag is huge in kafka 10? by SRK

by SRK

ClassNotFoundException for parquet on CentOS 7.3 by jeevithaS

by jeevithaS

Structured Streaming + Kafka Integration unable to read new messages after sometimes by NikhilP

by NikhilP

[SPARK-CORE] Why RPC message are transferred with header and body separately in TCP frame by neoremind

by neoremind

XML Parsing with Spark and SCala by ej21

by ej21

Issues when trying to recover a textFileStream from checkpoint in Spark streaming by SRK

by SRK

org.apache.spark.sql.AnalysisException: resolved attribute(s) code#906 missing from code#1992, by grjohnson35

by NaveenRamaraju

GC Time Error in Client Mode by betaSpark

by yncxcw

Spark-kafka Streaming using Spring boot (non web app) by HD

by HD

Refreshing/Updating Reference Data by Vikash Pareek

by Vikash Pareek

Error when executing Spark application on YARN by alvarobrandon

by smishra

StructuredStreaming: java.util.concurrent.TimeoutException: Cannot fetch record for offset by aravias

by aravias

Spark streaming: java.lang.ClassCastException: org.apache.spark.util.SerializableConfiguration ... on restart from checkpoint by alberskib

by dcam

IndexOutOfBoundException in catalyst when doing multiple approxDistinctCount by AssafMendelson

by AssafMendelson

Spark sample submitted with cluster deploy-mode does not work in Standalone by ctang

by ctang

External table partitioned by date using Spark SQL by ehalpern

by santhavathi

About spark.num.executors by ijung5399

by yncxcw

Spark streaming + Kafka pending batches by jithinpt

by jithinpt

How To Recover The Hacked Comcast Email Account ? by jullietwillor

by jullietwillor

word2vec outputs Infinity,-Infinity vectors with increasing iterations by danielS

by danielS

Performance issue to handle too many aggregations with group by by KannanSpark

by KannanSpark

How to print content of each RDD in topics? and How to convert data in topics into data frames? by prudhviteddu

by prudhviteddu

ALSModel.load not working on pyspark 2.1.0 by cgarciae

by cgarciae

Logging in RDD mapToPair of Java Spark application by johnzengspark

by johnzengspark

Persisting RDD: Low Percentage with a lot of memory available by pedroT

by pedroT

1234567 ... 315