Add an internal way to stop the CLI