Fix up the convolution matrix and offset for blur