Or maybe wait for the aggregatorFactory to get a second call to create (meaning >1 agg spawned from the same factory) before upgrading a plain TermsEnum to a wrapped frequency caching one?