Hugging Face's logo

afrideva
/
TinyMistral-248M-GGUF

Text Generation
GGUF
English
ggml
quantized
q2_k
q3_k_m
q4_k_m
q5_k_m
q6_k
q8_0
Model card Files Community
afrideva commited on
Commit
c7474c0
•
1 Parent(s): 491ec27

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +0 -1
README.md CHANGED
@@ -28,7 +28,6 @@ Quantized GGUF model files for [TinyMistral-248M](https://huggingface.co/Locutus
28
 
29
  | Name | Quant method | Size |
30
  | ---- | ---- | ---- |
31
- | [tinymistral-248m.fp16.gguf](https://huggingface.co/afrideva/TinyMistral-248M-GGUF/resolve/main/tinymistral-248m.fp16.gguf) | fp16 | 497.75 MB |
32
  | [tinymistral-248m.q2_k.gguf](https://huggingface.co/afrideva/TinyMistral-248M-GGUF/resolve/main/tinymistral-248m.q2_k.gguf) | q2_k | 116.20 MB |
33
  | [tinymistral-248m.q3_k_m.gguf](https://huggingface.co/afrideva/TinyMistral-248M-GGUF/resolve/main/tinymistral-248m.q3_k_m.gguf) | q3_k_m | 131.01 MB |
34
  | [tinymistral-248m.q4_k_m.gguf](https://huggingface.co/afrideva/TinyMistral-248M-GGUF/resolve/main/tinymistral-248m.q4_k_m.gguf) | q4_k_m | 156.60 MB |
 
28
 
29
  | Name | Quant method | Size |
30
  | ---- | ---- | ---- |
 
31
  | [tinymistral-248m.q2_k.gguf](https://huggingface.co/afrideva/TinyMistral-248M-GGUF/resolve/main/tinymistral-248m.q2_k.gguf) | q2_k | 116.20 MB |
32
  | [tinymistral-248m.q3_k_m.gguf](https://huggingface.co/afrideva/TinyMistral-248M-GGUF/resolve/main/tinymistral-248m.q3_k_m.gguf) | q3_k_m | 131.01 MB |
33
  | [tinymistral-248m.q4_k_m.gguf](https://huggingface.co/afrideva/TinyMistral-248M-GGUF/resolve/main/tinymistral-248m.q4_k_m.gguf) | q4_k_m | 156.60 MB |