为什么最大输入长度是2048？

#13

by yuyijiong - opened Aug 19, 2023

Aug 19, 2023

llama2原始版本最大输入长度是4096，为什么中文版变成2048了？

北京零速科技 org Aug 19, 2023

是4096

Aug 23, 2023

•

是4096

我看config文件里写的2048
"max_position_embeddings": 2048,

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment