Removes redundant builds in travis-ci config

Further speed up day to day travis-ci builds