Eliminate some unnecessary conversions between char and byte arrays