Fix bigendian pointer dereference

Not ideal but consistent with asm_mips