Add specs for negative values and rb_num2uint
Pass specs for rb_num2uint

This looks like weird behavior but apparently things like the FFI gem
depend on it.

Fixes #2749