Add tokenize function.

With a test.