Allow prefetching through a SingleRelatedObjectDescriptor or
ReverseSingleRelatedObjectDescriptor with a custom queryset.

Allowing it enables calling performance oriented queryset methods
like select_related when prefetching through single related objects.

Refs #17001.