Mesos HA Getting Rid of Zookeeper
Channel: The Linux Foundation
Date: 08/12/2016

Mesos requires a distributed key-value storage for master election and detection, as well as for replicated log when running in HA mode. Currently, it relies on ZooKeeper which is a mature tool but has its own complexities. It's painful for operators to maintain all the ZooKeeper dependencies and runtime, especially in cases where they already have an existing KV system such as Etcd or Consul, in their production environment. Having the ability to replace Zookeeper with an already existing instance would give a lot of flexibility to the operators.


In this talk, we present Etcd integration for Mesos. This is achieved by modularizing the master contender and detector as well as the replicated log interfaces. We then discuss the issues and lessons learned with module development. Finally, we present a roadmap for simplifying module development from a Mesos community viewpoint.