unable to deploy spark cluster with docker script

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

unable to deploy spark cluster with docker script

Jaonary Rabarisoa
Dear all,

I'm trying to use amplab docker script to deploy a development cluster on my laptop. The script hangs on waiting for master and the output of 'docker ps -a' shows 

CONTAINER ID        IMAGE                           COMMAND                CREATED             STATUS              PORTS               NAMES
27a38342b9f4        amplab/spark-master:0.9.0       /root/spark_master_f   9 minutes ago       Exit 1                                  furious_poincare  


It seems that the master container failed to start the spark master script.

When I start the master manually with 'docker run -i amplab/spark-master:0.9.0 /usr/bin/bash' it runs without error.


I use docker 0.8.0 on debian unstable.

Jaonary