twitter/typeahead.js — pull request #859 by linfrank (2014-06-01 20:56:25+00:00)
Title: Add option to specify dataset query tokenizer to fix broken highlighting

Related: https://github.com/twitter/typeahead.js/issues/821

Highlighting doesn't work correctly because typeahead doesn't know how query is tokenized. This adds a dataset-specific option that mirrors the Bloodhound queryTokenizer option to split the input query before turning them to regex patterns. Fixes the "John Smith Boston" problem in issue 821.