Do not select group if no user selected.

Handle the case when user is in one group only.