I think it should be easy. `limit_fields_by_user` should return an empty `QuerySet` for `AnonymousUser` when we are dealing with authorizable models, and the view will return an error when there qs is empty.