Deselect the select piece when adding or removing a piece.