Keep track of pointer_ucs2 also and use that to potentially raise the ValueError.

Otherwise, the protection in d9d03dd13a1d778782f84c2f9cd83c964815af9a can sidestep that exception, potentially leading to us applying corrupt deltas.