Change build matrix to use a different Gemfile for pure-ruby, not depending on Nokogiri and equivalent-xml