Zookeeper and Spark deployment for standby master

classic Classic list List threaded Threaded
2 messages Options
Reply | Threaded
Open this post in threaded view
|

Zookeeper and Spark deployment for standby master

akila.wajirasena
Hi,

Is it necessary to deploy Apache Zookeeper and Spark in separate set of hosts when using standby masters? What will be the consequences of running Zookeeper quorum in the same physical machines that runs the Spark cluster.


Reply | Threaded
Open this post in threaded view
|

Re: Zookeeper and Spark deployment for standby master

Jörn Franke
I guess it is the usual things - if the non zookeeper processes take too much memory , disk space etc it will negatively affect zookeeper and thus your whole running cluster. You will have to make for your specific architectural setting a risk assessment if this is acceptable.

> Am 26.11.2018 um 07:25 schrieb Akila Wajirasena <[hidden email]>:
>
> Hi,
>
> Is it necessary to deploy Apache Zookeeper and Spark in separate set of hosts when using standby masters? What will be the consequences of running Zookeeper quorum in the same physical machines that runs the Spark cluster.
>
>

---------------------------------------------------------------------
To unsubscribe e-mail: [hidden email]