Improvements to .travis.yml

Add fast_finish to the build matrix and use -j $(nproc) for make.

Just a reminder to the devs: do **not** merge this on github (mirror script will overwrite it) instead download a git patch from github by appending `.patch` to the pull request URL or use rebase.