Fix build matrix exclusion

See http://about.travis-ci.org/docs/user/build-configuration/#The-Build-Matrix for the full deets on the syntax.