Handle ctrl/meta click in non-selection mode