test floating point formatting
avoid tests that would potentially have rounding issues