Handle case where shutdown() might be called before start()