simplify test demo function
fix: make tokenize return correct token index + update tokenize call
fix missing final token in tokenize if no non-alpha at end
ignore vim swap
working test of slightly smarter application of anchor