Add spec for RBIGNUM_LEN and rounding up

See #2742
Ensure we ceil RBIGNUM_LEN for correct rounding

Fixes #2742