Clean up number parsing a bit
--Dependency on lexical_cast
Performance seems(?) unaffected
Getting tests working again.
Something is wrong with unsigned char, int8_t, uint8_t still.
I have no idea what.