Prevent deselection when clicking on the little arrows