Release GGUF models?

#5
by CosmicSound - opened

Hi,

Any plans to release .GGUF models so users can try the models on their mobiles, tablets, easier?

IBM Granite org

@CosmicSound I think someone from the community is working on this: https://github.com/ggerganov/llama.cpp/issues/7116

IBM Granite org

the 20 and 34b have been released, work is still happening on 3 and 8

mayank-mishra changed discussion status to closed
IBM Granite org

all models have been released now

Sign up or log in to comment