exclude debugger from CI builds

The compilation of the debugger gem's native extensions fails with Ruby 1.9.3 on Travis. As we don't need it there, this excludes it for Travis builds.