Generalize stopping after supervisor finishes

This will allow other services to be stopped after supervisor stops. This is prefix of stopping kazoo after supervisor finishes.