Only shutdown the server if we started one...