Merged version?
#1
by
foldericon
- opened
Can you merge the weights back in to the main model so we can run the model in projects like llama.cpp?
Unfortunately I think it's not that easy. From my understanding I either would have to fine-tune the original model (with the German dataset) or adjust the llama.cpp project to the Alpaca-LoRA repository.
I was referring to what the readme of the alpaca-lora project says under the headline "Checkpoint export". Wouldn't that be sufficient? Unfortunately I can't get alpaca-lora to run on my mac, otherwise I would try myself.
Oh sorry, I didn't know that was possible. Yes, I will definitely do that and get back to you!
that would really be awesome! Thanks for your efforts.