PySpark: batch_df in ForeachBatch - aggregation

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

PySpark: batch_df in ForeachBatch - aggregation

mmuru
Hi,

Using the master branch, I tried to perform SQL aggregation on batch_df in
foreachBatch and only SQL API methods work but not spark sql queries on the
temp table (register as a table or view createOrReplaceTempView).

Is it supported? I really appreciate your help.



--
Sent from: http://apache-spark-user-list.1001560.n3.nabble.com/

---------------------------------------------------------------------
To unsubscribe e-mail: [hidden email]