Drop .ord call

We call .each_byte.to_a anyway, which returns the bytes, no need to call
ord again.