(HEVC/Research) Perform the interpolation directly on the FIFOs when possible.