Correctly validate deleted config files