Why is this case happening?  If this is the case for "stub" objects, and we're filtering before we have the full object, then we'll get incorrect results.  Instead, we should try to allow `CustomFilter.filter_fn` to return a deferred, and use `RefreshQueue` to ensure full reified objects are available for the filter.  (I'm not sure I fully understand the reasons for `related_mapped_objects` though).