tests: don't build test/libfixmath on Travis CI

Very often the build unexplainably hangs.