Don't delete things twice