Only check the config when we install. On removal we don't care.