Something to think about: Maybe in certain case users don't want to use field data, but just iterate over the terms/postings (TermsEnum/DocsEnum) this will reduce the memory usage. Also this might event be faster in cases where there are only a few terms to lookup, In general if the users know up front the fields to do a lookup for then they should use docvalues, for the fastest and least heap consuming way of joining.