will it work with llama.cpp?
#4
by
stormchaser
- opened
maybe a noob question but will it work with llama.cpp? will download this tomorrow and try.
I don't think so, you'll have to integrate this model with llama.cpp. But this model is compatible with GGML which is an alternative to this.
reshinthadith
changed discussion status to
closed
yes I tried and it does, i do run models with llama.cpp like the llama 2 7B chat ggml, but I what I dont get is if this is compatible with ggml then why wont it run. And I would really appreciate if someone can guide on how to convert this to llama.cpp compatible format on my laptop.