Fix issue with fast-finish build matrix not passing.

Related to travis-ci/travis-ci#1688. This change also cleans up
the tests, which had the wrong expectations before and are now
actively testing for the fast_finish feature and the correct
return values.