Remove assert in obey_config_changes