GGUF file request

#14
by MicFizzy - opened

Hello Dear OpenGVLab

I tested the model and I think this is a wonderful product, thank you so so much for publishing it!! Since I am a beginner and what to use it locally via lmstudio, is it possible that we can have a gguf version of the model? that would be ssssoooo great!

thank you so much again for sharing your product with the public~~
Liz

I also need GGUF, thanks to team

LLamaCPP dosent' suppor this yet so there is no use using GGUF.

OpenGVLab org

We will consider supporting llama.cpp in the future.

czczup changed discussion status to closed

Sign up or log in to comment