How to convert my adapters to ggml model for alpacacpp?
#3
by
ShinokuS
- opened
Hi.
I have a fine tune model trained with PEFT. I would like to know how to turn a model with an adapter into a ggml model. can you suggest a detailed action guide so that I can run my trained model using alpacacpp on the CPU?
hm, you can convert model to ggml by exe file in llama cpp repo, but afaik youll need only cell model(merged), without loras or delta weights