Allow `git rm` to fail
Do not remove wheels: they will be removed later after listing