No gemmoe branch in github
#7
by
rabimba
- opened
In both colab and howto.md I see this instruction
git clone -b gemmoe https://github.com/Crystalcareai/mergekit.git
But the github repo does not seem to have that branch at all.
Am I missing something?
Interesting. I’ll take a look when I get the chance, but stock mergekit now has native support for Gemma. You may need to go in and change the mistral.json to Gemma.json in the architecture.py file, though.
You need to do: git clone -b fix-moe https://github.com/Crystalcareai/mergekit.git