Don't delete the package dir itself