Spark and neural networks

Previous Topic Next Topic
 
classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

Spark and neural networks

Esa Heikkinen-2

Hi


What would be the best way to use Spark and neutral networks (especially RNN LSTM) ?


I think it would be possible by "tool"-combination:

Pyspark + anaconda + pandas + numpy + keras + tensorflow + scikit


But what about scalability and usability by Spark (pyspark) ?


How compatible are data structures (for example dataframe) between Spark and other "tools" ?

And it is possible convert them between different "tools" ?


---

Eras