made tokenizer the only fct we deal with