Require native byte order when casting ByteBuffer to struct