Don't modify data pointers in im2col loop