Don't handle key down in SimpleDragHandler, see #333