On bootstrap failure, also cleanup.