Mllib in pyspark for 0.8.1

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

Mllib in pyspark for 0.8.1

Ian Ferreira

Hi there,

For some reason the distribution and build for 0.8.1 does not include
the MLLib libraries for pyspark i.e. import from mllib fails.

Seems to be addressed in 0.9.0, but that has other issue running on
mesos in standalone mode :)

Any pointers?

Cheers
- Ian

Reply | Threaded
Open this post in threaded view
|

Re: Mllib in pyspark for 0.8.1

Matei Zaharia
Administrator
You could probably port it back, but it required some changes on the Java side as well (a new PythonMLUtils class). It might be easier to fix the Mesos issues with 0.9.

Matei

On Apr 1, 2014, at 8:53 AM, Ian Ferreira <[hidden email]> wrote:

>
> Hi there,
>
> For some reason the distribution and build for 0.8.1 does not include
> the MLLib libraries for pyspark i.e. import from mllib fails.
>
> Seems to be addressed in 0.9.0, but that has other issue running on
> mesos in standalone mode :)
>
> Any pointers?
>
> Cheers
> - Ian
>