simplify tokenization by using a diff regex and re-seq instead of \W.