Only subtract bilinear offset in SMOOTH case