Performance improvement - don't fill all pixels in block with MVs