Max sequence length config

#14
by alexhsu - opened

Hi authors,

I cross-examined the configuration files across Qwen-72B, Qwen-14B, and Qwen-7B. I figured out that the sequence length for Qwen-14B is much shorter than the other two. Is this intentional, or it's an error on the config file?

Yes! It is intentional.

Sign up or log in to comment