We may want to use little endian as an optimization