Remove paranoid x-test

It turns out Bash doesn't interpret test flags to the test
builtins like that.