Remove debugger dependency

That doesn't build on ruby 2.0.0 yet.