Removes contacts_fields

Removes contacts_fields, because contact name is required, so at least
that should be present if contacts are present.