Correctly determine OS to xfail in cross build