Don't re-calculate x and y filter offset per iteration