maybe we can write this field as "raw", see XContentHelper#rawField, so no need to convert it to a map?