allocate a big enough buffer for tokenizer