I don't think the finalizing query runner should decide how things get filtered.
Since this is an optimization at the query toolchest level, we should try to contain all the logic there.