Delete on publish to prevent orphans

@brianhw