add tokenizer and preprocessing to paper