When a tokenizer receives a stream of characters (text), it tokenizes it (usually by splitting it up into individual words or tokens) and outputs the stream of words/tokens. Elasticsearch includes a number of tokenizers that you can use to create custom analyzers. When it encounters whitespace, a whitespace tokenizer, for example, splits the text into individual tokens.