implemented tokenize test