Use field charset insted of flags to decide whether to parse into Buffer