Curious about model design
#2
by
surya-narayanan
- opened
Hi,
How do you merge two models? It says on your model card that your model is the merge of llama and gpt. I'm curious how you do that?
Surya
I am very curious, too. @lilloukas , did you merge the alpaca-lora-30b adapter into the Platypus-30B model?
We merge the alpaca lora adapter onto the Platypus-30B model using PEFTs merge_and_unload function. There's a file for this in the GitHub repo!
arielnlee
changed discussion status to
closed