fix subpixel rounding errors equals off digits