Reduce allocations of byte buffers