ARM64: override all the things.

Actually, mostly only those in the top-level directory that already
had a "virtual" attached. But it's the thought that counts and it's
been a long day.
ARM64: remove -m32/-m64 mapping with ARM.

This is causing the ARM build-bots to fail since they only include
the ARM backend and can't create an ARM64 target.