Hugging Face's logo

DisOOM
/
Faro-Yi-9B-200k-GGUF

Text Generation
Transformers
GGUF
PyTorch
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
fp16
GGUF
yi
conversational
Inference Endpoints
text-generation-inference
Model card Files Community
Edit model card

The gguf quantization of Fi-9B

Downloads last month
204
GGUF
Model size
8.83B params
Architecture
llama
Inference API
Text Generation
Examples
Input a message to start chatting with DisOOM/Faro-Yi-9B-200k-GGUF.
Inference API (serverless) has been turned off for this model.