Fix "wheel-ised" build on travis-ci

The wheel-based builds on travis have been failing. This is mostly my fault for merging into master too hastily. Whereas some wheel packages are very useful for speeding builds (notably numpy), some are broken (notably pytools). The .travis.yml resulting from these changes is a bit mucky but should work for the foreseeable future.