Change shift argument to be relative to upsampled image, as per Avisynth resizer src_left and src_top arguments.