Don't remove stuff if destroy fails