TheBloke

/

CodeLlama-7B-GGUF

like 108

Hey,
First thanks for all the hard work providing these quantized models in such a timely fashion, that's super helpful!
I noticed that you have some mention in the model card on "clients and libraries that are known to support GGUF" so just wanted to mention that our rust library candle now also supports using GGUF files. We even have in our examples an equivalent of llama.cpp that actually uses your weight files :) So would be great if it can be added to your list. No worries if you want to keep the list small and/or for libraries that you know well, feel free to close this issue if that's the case.