Don't remove stuff that doesn't exist.