Can't search on user fields portably

We don't know what fields a custom user model will have, so we can't
search using them.