Remove old config remnants