Hugging Face's logo

LoneStriker
/
Xwin-LM-70B-V0.1-3.0bpw-h6-exl2

Text Generation
Transformers
PyTorch
llama
text-generation-inference
Inference Endpoints
Model card Files Community
2

Ggul version?

#2
by iHaag - opened
Discussion
iHaag

Can this be converted to work with lmstudio and llama.cpp please? @TheBloke

LoneStriker
 Owner

There are some GGUF quants already posted:
https://huggingface.co/models?search=Xwin-LM-70B-V0.1%20gguf

Hopefully they are compatible with your version of LMStudio.

Sign up or log in to comment