Recent weight update

#6
by adamo1139 - opened

Hi,

Yi-6B-200k weights and config.json were updated a few days ago, similarly to Yi-34B-200k.

In the discussion page for Yi-34B-200K, 01.ai representative confirmed that long context performance of the model has been increased. discussion link. Yi-6B-200k repo was updated to inform about updates to Yi-34B-200k model but updates to Yi-6B-200k were not mentioned.

Has the same long context performance extension happened to Yi-6B-200k? Do you have any numbers for the increase in "Needle-In-A-Haystack" test?

@adamo1139 We are yet to make any announcements specifically on Yi-6B-200k, please stay tuned :)

adamo1139 changed discussion status to closed

Sign up or log in to comment