tokenize can now handle dotted lists.