Remove STARTING status check in CLIMainTest

This makes `CLIMainTest` less flaky.