Remove all glyph_info rounding

Closes #2201 

Possible followup to #2276, removes all rounding in `glyph_info.hpp`

/cc @springmeyer