You also need to exclude the REE + ActiveSupport 4 from the Matrix Build since it will never work (or remove REE completely, since Ruby 1.8 is retired).