Remove debugger from gemspec

[#82948310]

It's causing some build problems when ruby 2.0.0 is used (Travis).