Fix modifier key keeps selected item selected

Issue #1781, not using modifier key on modifierKeysToMultiSelect=true
correctly keep the selected item selected if multiple items were
previously selected