Spark structured streaming time series forecasting

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

Spark structured streaming time series forecasting

Bogdan Cojocar
Hello,

Is there a method to do time series forecasting in spark structured streaming? Is there any integration going on with spark-ts or a similar library?

Many thanks,
Bogdan Cojocar
Reply | Threaded
Open this post in threaded view
|

Re: Spark structured streaming time series forecasting

Tathagata Das
Spark-ts has been under development for a while. So I doubt there is any integration with Structured Streaming. That said, Structured Streaming uses DataFrames and Datasets, and a lot of existing libraries build on Datasets/DataFrames should work directly, especially if they are map-like functions.

On Mon, Jan 8, 2018 at 7:04 AM, Bogdan Cojocar <[hidden email]> wrote:
Hello,

Is there a method to do time series forecasting in spark structured streaming? Is there any integration going on with spark-ts or a similar library?

Many thanks,
Bogdan Cojocar