Apache Spark User List

This forum is an archive for the mailing list user@spark.apache.org (more options) Messages posted here will be sent to this mailing list.
1234 ... 353
Topics (12352)
Replies Last Post Views
Spark (Scala) Streaming [Convert rdd [org.bson.document] - > dataframe] by Chethan
1
by vincent gromakowski
Pyspark access to scala/java libraries by Mohit Jaggi
4
by Harsh
Dataset - withColumn and withColumnRenamed that accept Column type by Nirav Patel
4
by Tathagata Das
Dataframe from partitioned parquet table missing partition columns from schema by Nirav Patel
1
by Nirav Patel
Heap Memory in Spark 2.3.0 by Bryan Jeffrey
1
by Imran Rashid-2
joining streams from multiple kafka clusters by sathich
0
by sathich
Running Production ML Pipelines by Gautam Singaraju
1
by Shmuel Blitz
spark sql data skew by 崔苗
2
by 崔苗
Query on Profiling Spark Code by Aakash Basu-2
0
by Aakash Basu-2
Performance considerations, Using microservices for ZooKeeper & Kafka in Spark Streaming by Mich Talebzadeh
0
by Mich Talebzadeh
Run Python User Defined Functions / code in Spark with Scala Codebase by Chetan Khatri
8
by Gourav Sengupta
Security in pyspark using extensions by Maximiliano Patricio...
0
by Maximiliano Patricio...
Stopping a Spark Streaming Context gracefully by Bryan Jeffrey
1
by Dhaval Modi
Properly stop applications or jobs within the application by Behroz Sikander
7
by Dhaval Modi
Stopping StreamingContext by Sidney Feiner
1
by Dhaval Modi
How to stop streaming jobs by Dhaval Modi
0
by Dhaval Modi
Do GraphFrames support streaming? by kant kodali
6
by kant kodali
Can I specify watermark using raw sql alone? by kant kodali
1
by kant kodali
how to decide broadcast join data size by Selvam Raman
0
by Selvam Raman
Spark Shortcut by Deepu Raj
0
by Deepu Raj
Spark on Mesos: Spark issuing hundreds of SUBSCRIBE requests / second and crashing Mesos by Nimi W
0
by Nimi W
Live Streamed Code Review today at 11am Pacific by Holden Karau
5
by Holden Karau
[ML] Linear regression with SGD by sandy
0
by sandy
spark rename or access columns which has special chars " ?: by Great Info
0
by Great Info
Pyspark Structured Streaming Error by umargeek
1
by Arbab Khalil
How to avoid duplicate column names after join with multiple conditions by Nirav Patel
6
by Prem Sure
[Structured Streaming] Custom StateStoreProvider by subramgr
4
by Jungtaek Lim
Reading multiple files in Spark / which pattern to use by Marco Mistroni
0
by Marco Mistroni
How to validate orc vectorization is working within spark application? by umargeek
3
by umargeek
Upgrading spark history server, no logs showing. by bbarks
0
by bbarks
Spark ML online serving by Holden Karau
1
by Maximiliano Felice
Interest in adding ability to request GPU's to the spark client? by Daniel Galvez
2
by Mich Talebzadeh
[Structured Streaming] Avoiding multiple streaming queries by Priyank Shrivastava
7
by Arun Mahadevan
Running Spark on Kubernetes behind a HTTP proxy by JayeshLalwani
0
by JayeshLalwani
how to specify external jars in program with SparkConf by mytramesh
1
by Prem Sure
1234 ... 353