updated tokenizer
fixed error in documentation