serve a mix of tokenized prefix and pure prefix results.  NOTE: this breaks the offset option