fix calibration compensation (was truncating)