Disk based fielddata!  Just kidding, I agree.  I will think of a way to expose using a regular `TermsFilter`