BUG: fix minor floating-point precision detail