This is not a 7B. It's a ~9B. Please label appropriately.
#1
by
georgewalker
- opened
Like 4/5 top '7B' models on the leaderboard, this is actually a ~9B, downstream of https://huggingface.co/zyh3826/GML-Mistral-merged-v1, a merge that combined the first 32 layers (ie all of them) of Mistral-7B with the last 8 layers of another Mistral finetune, creating a model that is about 9B parameters.
done