Ditch reliance on ActiveSupport / Numeric monkey patching

Fix #489, Fix #490
Whenever 0.9.3