Fix maximum precision calculation, account for sign bit.