File size: 845 Bytes
a880011 f22d09f |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 |
---
license: apache-2.0
language:
- es
---
Llama 2 (7B) fine-tuned on a [own Spanish instructions dataset](https://huggingface.co/datasets/dariolopez/Llama-2-databricks-dolly-oasst1-es).
On this repo you can find 4-bit and 5-bit quantized versions of the [Llama 2 (7B) Spanish fine-tuned](https://huggingface.co/dariolopez/Llama-2-databricks-dolly-oasst1-es-axolotl).
# How to use
```sh
git clone https://github.com/ggerganov/llama.cpp
cd llama.cpp && git pull && make clean && make
git clone https://huggingface.co/dariolopez/Llama-2-databricks-dolly-oasst1-es-axolotl-GGUF
./main -m ./llama-2-databricks-dolly-oasst1-es-axolotl.gguf.q4_k_m.bin -n 2048 --color --temp 0 -ngl 35 -p "<s>[INST] Describe 5 lugares para visitar en España: [/INST]"
```
# Based on
https://mlabonne.github.io/blog/posts/Quantize_Llama_2_models_using_ggml.html |