Ensure only one config happens at a time

Change-Id: Ie0426d7a4d75f313f849b2ddf203290becb765c4
Reviewed-on: http://review.couchbase.org/42228
Tested-by: Jeffry Morris <jeffrymorris@gmail.com>
Reviewed-by: Mark Nunberg <mnunberg@haskalah.org>