Don't memoize user.list_groups, Fix #5154