Fix invalid deletion of old provider files and provider listings