RF: extend wheel tests to scipy stack

But only test sympy partially - tests are too slow to do the whole thing.