Felladrin's picture
Update README.md
cca8638 verified
---
license: apache-2.0
base_model: Felladrin/Minueza-32M-Chat
---
GGUF version of [Felladrin/Minueza-32M-Chat](https://huggingface.co/Felladrin/Minueza-32M-Chat).
It was not possible to quantize the model after converting it to F16/F32 GGUF, so only those versions are available, being F32 the recommended one for having better precision.
## Recommended Inference Parameters
```
temp 0.4
min-p 0.1
top_p 1
top_k 0
repeat_penalty 1.0
```