binary point handling for calibration values