Don't shell out we need to catch the error
Don't shell out for JSON either
xfail correctly on JSON