Is this behavior expected from all UAs or is it specific to IE?
The spec currently says that the pointercancel event is dispatched if "After having fired the pointerdown event, the pointer is subsequently used to manipulate the page viewport (e.g. panning or zooming)."
It further states that "Methods for changing the device's screen orientation, recognizing accidental input, or using a pointer to manipulate the viewport (e.g. panning or zooming) are out of scope for this specification."