[Travis-CI] Don't build nokogiri libraries