Merged version?

#1
by foldericon - opened

Can you merge the weights back in to the main model so we can run the model in projects like llama.cpp?

Unfortunately I think it's not that easy. From my understanding I either would have to fine-tune the original model (with the German dataset) or adjust the llama.cpp project to the Alpaca-LoRA repository.

I was referring to what the readme of the alpaca-lora project says under the headline "Checkpoint export". Wouldn't that be sufficient? Unfortunately I can't get alpaca-lora to run on my mac, otherwise I would try myself.

Oh sorry, I didn't know that was possible. Yes, I will definitely do that and get back to you!

that would really be awesome! Thanks for your efforts.

Sign up or log in to comment