Core: Do not cache term filters by default.

These filters are directly based on postings lists and can already
iterate/advance quickly. It is still possible to opt-in for caching.