Concurrency in tokenizer.py added