Omit the address object if there are no address fields