what is the difference between this model and 01-ai/Yi-1.5-34B?

#2
by muziyongshixin - opened

what is the difference between this model and 01-ai/Yi-1.5-34B?

01-ai org

This is a base model with 32K context length, good for community finetunes
Our previously released 01-ai/Yi-1.5-34B has a native context length of 4k.

lorinma changed discussion status to closed

This is a base model with 32K context length, good for community finetunes
Our previously released 01-ai/Yi-1.5-34B has a native context length of 4k.

Thank you very much for the longer context model.
Is there any plan to show more information related to the difference between 4k, 16k, 32k and also chat/base different?
Maybe it is somewhere posted?

01-ai org

This is a base model with 32K context length, good for community finetunes
Our previously released 01-ai/Yi-1.5-34B has a native context length of 4k.

Thank you very much for the longer context model.
Is there any plan to show more information related to the difference between 4k, 16k, 32k and also chat/base different?
Maybe it is somewhere posted?

I'll try my best to explain these in a tech blog.
If you are uncertain which version to use, your first choice might probably be 4k chat version.

Sign up or log in to comment