Deal with ref_budget when excuting remove_fields an add_fields