Add multi-master support to Jenkins

Reviewers: ar

Subscribers: vishal, cf

Differential Revision: https://tails.corp.dropbox.com/D76338