Add tokenizeConsecutive(), a version of tokenize() that treats consecutive delimiters as denoting empty tokens, rather than one delimiter