Move is_token function to its own file
Handle '\s' correctly in regexps
Unify ubiquitous tokens and lexical separators in API