The thing is the userInfo is meant to be configured. You can see the ldap example in the doc.

The same provider is user for userInfo and avatar. I'll call them UserInfoProvider and AvatarProvider