Cutoff March, 2023? Shouldn't it be 2024?

#7
by kil3r - opened

The llama 8b has cutoff declared as March, 2023?
Shouldn't it be 2024? The bigger model has December 2023.

I think LLMs sometimes hallucinate the wrong cutoff date. They've slurped up declarations from other models posted on the internet during training. Eg. Sometimes Mistral quotes the cutoff date in 2021 from the original ChatGPT release and sometimes it says it's created by OpenAI.

I think LLMs sometimes hallucinate the wrong cutoff date. They've slurped up declarations from other models posted on the internet during training. Eg. Sometimes Mistral quotes the cutoff date in 2021 from the original ChatGPT release and sometimes it says it's created by OpenAI.

I'm not talking about what Llama says. I'm talking what's in this repo's model card.

Sign up or log in to comment