Fix race condition when stopping component server

Signed-off-by: Max Brunsfeld <mbrunsfeld@pivotallabs.com>