Don't set selection of the drawer if it's open.