Fix `x86` arch tests on non-x86

The usefulness of this is rather limited, but simplifies build system and
makes it easier to detect regressions.

This is however not fully endian-neutral.