Remove unnecessary check for to_field_ness