RF: try to get whole test run to work

Refactor testing to be more explicit about archs, and drop i386 test for
base numpy if we're going to test up-to-date numpy as well.