clarify use of tokenise, closes #8