Do not try to convert to Avro empty unions