Hugging Face's logo

knifeayumu
/
Rocinante-12B-v1-nemo-sunfall-v0.6.1-SLERP-GGUF

Transformers
GGUF
English
Inference Endpoints
conversational
Model card Files Community
knifeayumu commited on
Commit
2212894
•
1 Parent(s): 1553702

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -20,7 +20,7 @@ Original model: [knifeayumu/Rocinante-12B-v1-nemo-sunfall-v0.6.1-SLERP](https://
20
  | Filename | Quant type | File Size |
21
  | -------- | ---------- | --------- |
22
  | [Rocinante-12B-v1-nemo-sunfall-v0.6.1-SLERP-F16.gguf](https://huggingface.co/knifeayumu/Rocinante-12B-v1-nemo-sunfall-v0.6.1-SLERP-GGUF/blob/main/Rocinante-12B-v1-nemo-sunfall-v0.6.1-SLERP-F16.gguf) | F16 | 24.5GB |
23
- | [Rocinante-12B-v1-nemo-sunfall-v0.6.1-SLERP-Q8_0.gguf](https://huggingface.co/knifeayumu/Rocinante-12B-v1-nemo-sunfall-v0.6.1-SLERP-GGUF/blob/main/Rocinante-12B-v1-nemo-sunfall-v0.6.1-SLERP-Q8_0.gguf) | Q8_0 | 10.1GB |
24
  | [Rocinante-12B-v1-nemo-sunfall-v0.6.1-SLERP-Q6_K.gguf](https://huggingface.co/knifeayumu/Rocinante-12B-v1-nemo-sunfall-v0.6.1-SLERP-GGUF/blob/main/Rocinante-12B-v1-nemo-sunfall-v0.6.1-SLERP-Q6_K.gguf) | Q6_K | 10.1GB |
25
  | [Rocinante-12B-v1-nemo-sunfall-v0.6.1-SLERP-Q5_K_M.gguf](https://huggingface.co/knifeayumu/Rocinante-12B-v1-nemo-sunfall-v0.6.1-SLERP-GGUF/blob/main/Rocinante-12B-v1-nemo-sunfall-v0.6.1-SLERP-Q5_K_M.gguf) | Q5_K_M | 8.73GB |
26
  | [Rocinante-12B-v1-nemo-sunfall-v0.6.1-SLERP-Q5_K_S.gguf](https://huggingface.co/knifeayumu/Rocinante-12B-v1-nemo-sunfall-v0.6.1-SLERP-GGUF/blob/main/Rocinante-12B-v1-nemo-sunfall-v0.6.1-SLERP-Q5_K_S.gguf) | Q5_K_S | 8.52GB |
 
20
  | Filename | Quant type | File Size |
21
  | -------- | ---------- | --------- |
22
  | [Rocinante-12B-v1-nemo-sunfall-v0.6.1-SLERP-F16.gguf](https://huggingface.co/knifeayumu/Rocinante-12B-v1-nemo-sunfall-v0.6.1-SLERP-GGUF/blob/main/Rocinante-12B-v1-nemo-sunfall-v0.6.1-SLERP-F16.gguf) | F16 | 24.5GB |
23
+ | [Rocinante-12B-v1-nemo-sunfall-v0.6.1-SLERP-Q8_0.gguf](https://huggingface.co/knifeayumu/Rocinante-12B-v1-nemo-sunfall-v0.6.1-SLERP-GGUF/blob/main/Rocinante-12B-v1-nemo-sunfall-v0.6.1-SLERP-Q8_0.gguf) | Q8_0 | 13GB |
24
  | [Rocinante-12B-v1-nemo-sunfall-v0.6.1-SLERP-Q6_K.gguf](https://huggingface.co/knifeayumu/Rocinante-12B-v1-nemo-sunfall-v0.6.1-SLERP-GGUF/blob/main/Rocinante-12B-v1-nemo-sunfall-v0.6.1-SLERP-Q6_K.gguf) | Q6_K | 10.1GB |
25
  | [Rocinante-12B-v1-nemo-sunfall-v0.6.1-SLERP-Q5_K_M.gguf](https://huggingface.co/knifeayumu/Rocinante-12B-v1-nemo-sunfall-v0.6.1-SLERP-GGUF/blob/main/Rocinante-12B-v1-nemo-sunfall-v0.6.1-SLERP-Q5_K_M.gguf) | Q5_K_M | 8.73GB |
26
  | [Rocinante-12B-v1-nemo-sunfall-v0.6.1-SLERP-Q5_K_S.gguf](https://huggingface.co/knifeayumu/Rocinante-12B-v1-nemo-sunfall-v0.6.1-SLERP-GGUF/blob/main/Rocinante-12B-v1-nemo-sunfall-v0.6.1-SLERP-Q5_K_S.gguf) | Q5_K_S | 8.52GB |