model max length is 2048?

#7
by yuchenlin - opened

Hi , this line in tokenizer_config.json suggests that the model's max length is 2048, but shouldn't it be 8192?

https://huggingface.co/HuggingFaceH4/zephyr-7b-gemma-v0.1/blob/main/tokenizer_config.json#L63

Thanks!

Sign up or log in to comment