edit: allow test to be started, but not using the --start all option