Latxa 7b Instruct GGUF
Provided files
| Name | Quant method | Bits | Size | Max RAM required | Use case |
|---|---|---|---|---|---|
| latxa-7b-v1-instruct-q8_0.gguf | 8 bits | 7 GB | 8,2 GB | Fits in a RTX 3060 12Gb |
- Downloads last month
- 23
Model size
6.74B params
Architecture
llama
| Name | Quant method | Bits | Size | Max RAM required | Use case |
|---|---|---|---|---|---|
| latxa-7b-v1-instruct-q8_0.gguf | 8 bits | 7 GB | 8,2 GB | Fits in a RTX 3060 12Gb |