Multiple changed events fired when dragging handles past each other

Mentioned by @fmal in #58