Do not add groups if user has no groups