working tokenizer with strings cemicolumns qnd pipes
tokeniser forget to add 3 new files