Hugging Face's logo

afrideva
/
TinyMistral-248M-Alpaca-GGUF

Text Generation
GGUF
Trained with AutoTrain
ggml
quantized
q2_k
q3_k_m
q4_k_m
q5_k_m
q6_k
q8_0
Model card Files Community
afrideva commited on
Commit
06188cc
•
1 Parent(s): c5c58c3

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +6 -6
README.md CHANGED
@@ -39,12 +39,12 @@ Quantized GGUF model files for [TinyMistral-248M-Alpaca](https://huggingface.co/
39
 
40
  | Name | Quant method | Size |
41
  | ---- | ---- | ---- |
42
- | [tinymistral-248m-alpaca.q2_k.gguf](https://huggingface.co/afrideva/TinyMistral-248M-Alpaca-GGUF/resolve/main/tinymistral-248m-alpaca.q2_k.gguf) | q2_k | None |
43
- | [tinymistral-248m-alpaca.q3_k_m.gguf](https://huggingface.co/afrideva/TinyMistral-248M-Alpaca-GGUF/resolve/main/tinymistral-248m-alpaca.q3_k_m.gguf) | q3_k_m | None |
44
- | [tinymistral-248m-alpaca.q4_k_m.gguf](https://huggingface.co/afrideva/TinyMistral-248M-Alpaca-GGUF/resolve/main/tinymistral-248m-alpaca.q4_k_m.gguf) | q4_k_m | None |
45
- | [tinymistral-248m-alpaca.q5_k_m.gguf](https://huggingface.co/afrideva/TinyMistral-248M-Alpaca-GGUF/resolve/main/tinymistral-248m-alpaca.q5_k_m.gguf) | q5_k_m | None |
46
- | [tinymistral-248m-alpaca.q6_k.gguf](https://huggingface.co/afrideva/TinyMistral-248M-Alpaca-GGUF/resolve/main/tinymistral-248m-alpaca.q6_k.gguf) | q6_k | None |
47
- | [tinymistral-248m-alpaca.q8_0.gguf](https://huggingface.co/afrideva/TinyMistral-248M-Alpaca-GGUF/resolve/main/tinymistral-248m-alpaca.q8_0.gguf) | q8_0 | None |
48
 
49
 
50
 
 
39
 
40
  | Name | Quant method | Size |
41
  | ---- | ---- | ---- |
42
+ | [tinymistral-248m-alpaca.q2_k.gguf](https://huggingface.co/afrideva/TinyMistral-248M-Alpaca-GGUF/resolve/main/tinymistral-248m-alpaca.q2_k.gguf) | q2_k | 115.26 MB |
43
+ | [tinymistral-248m-alpaca.q3_k_m.gguf](https://huggingface.co/afrideva/TinyMistral-248M-Alpaca-GGUF/resolve/main/tinymistral-248m-alpaca.q3_k_m.gguf) | q3_k_m | 130.08 MB |
44
+ | [tinymistral-248m-alpaca.q4_k_m.gguf](https://huggingface.co/afrideva/TinyMistral-248M-Alpaca-GGUF/resolve/main/tinymistral-248m-alpaca.q4_k_m.gguf) | q4_k_m | 155.67 MB |
45
+ | [tinymistral-248m-alpaca.q5_k_m.gguf](https://huggingface.co/afrideva/TinyMistral-248M-Alpaca-GGUF/resolve/main/tinymistral-248m-alpaca.q5_k_m.gguf) | q5_k_m | 179.23 MB |
46
+ | [tinymistral-248m-alpaca.q6_k.gguf](https://huggingface.co/afrideva/TinyMistral-248M-Alpaca-GGUF/resolve/main/tinymistral-248m-alpaca.q6_k.gguf) | q6_k | 204.26 MB |
47
+ | [tinymistral-248m-alpaca.q8_0.gguf](https://huggingface.co/afrideva/TinyMistral-248M-Alpaca-GGUF/resolve/main/tinymistral-248m-alpaca.q8_0.gguf) | q8_0 | 264.32 MB |
48
 
49
 
50