Generalize stopping after supervisor finishes

This will allow other services to be stopped after supervisor stops
Merge pull request #554 from rackerlabs/after_supervisor

Generalize stopping after supervisor finishes