more stable numerical tolerances