Transformers
mpt
Composer
MosaicML
llm-foundry
text-generation-inference

GGUF?

#8
by mrfakename - opened

@TheBloke would you mind adding GGUF support? Thx!

@TheBloke Please we need a GGUF version

Sign up or log in to comment