Need to though about the tokenize method more deeply.