Construct a single Uint8Array, instead of a new one for each getByteAt call