Only teardown once set up has finished successfully.