Edit model card

Quantizations of https://huggingface.co/NousResearch/Nous-Capybara-3B-V1.9

From original readme

Prompt Format

The model follows ChatML prompt format

<|im_start|>system
You are a helpful AI assistant.<|im_end|>
<|im_start|>user
How are you<|im_end|>
<|im_start|>assistant
I am doing well!<|im_end|>
Downloads last month
127
GGUF
Model size
2.8B params
Architecture
stablelm

1-bit

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Inference API
Inference API (serverless) has been turned off for this model.