|
--- |
|
inference: false |
|
language: |
|
- vi |
|
pipeline_tag: text-generation |
|
quantized_by: Tamnemtf |
|
tags: |
|
- gguf |
|
- ggml |
|
- quantized |
|
- f16 |
|
- q8_0 |
|
--- |
|
|
|
| Name | Quant method | Size | |
|
| ---- | ---- | ---- | |
|
| [Ae-calem-mistral-7b-v0.2_f16.gguf](https://huggingface.co/Tamnemtf/Ae-calem-mistral-7b-v0.2-gguf/resolve/main/Ae-calem-mistral-7b-v0.2_f16.gguf) | fp16 | 14.6 GB | |
|
| [Ae-calem-mistral-7b-v0.2_8bit.gguf](https://huggingface.co/Tamnemtf/Ae-calem-mistral-7b-v0.2-gguf/resolve/main/Ae-calem-mistral-7b-v0.2_8bit.gguf) | q8_0 | 7.75 GB | |
|
|
|
|
