Fix pan with select interaction in mousemove mode.

Fixes #2666