Address some PR comments in `NumericSerializer`

* Use the histogram serializer
* Remove stray comment
* Mark unsafe method