README.md

---
license: apache-2.0
base_model: Felladrin/TinyMistral-248M-Chat-v2
---

GGUF version of [Felladrin/TinyMistral-248M-Chat-v2](https://huggingface.co/Felladrin/TinyMistral-248M-Chat-v2).

## Try it with [llama.cpp](https://github.com/ggerganov/llama.cpp)

```bash
brew install ggerganov/ggerganov/llama.cpp
```
```bash
llama-cli \
  --hf-repo Felladrin/gguf-TinyMistral-248M-Chat-v2 \
  --model TinyMistral-248M-Chat-v2.Q8_0.gguf \
  --random-prompt \
  --temp 1.3 \
  --dynatemp-range 1.2 \
  --top-k 0 \
  --top-p 1 \
  --min-p 0.1 \
  --typical 0.85 \
  --mirostat 2 \
  --mirostat-ent 3.5 \
  --repeat-penalty 1.1 \
  --repeat-last-n -1 \
  -n 256
```