File size: 403 Bytes
bd12719 |
1 2 3 4 |
This contains GGML quants for [PygmalionAI/pygmalion-6b](https://huggingface.co/PygmalionAI/pygmalion-6b), made for use in KoboldCPP.
It contains multiple versions, please download the [ggjtv3](https://huggingface.co/concedo/pygmalion-6bv3-ggml-ggjt/blob/main/pygmalion-6b-v3-ggjtv3-q4_0.bin) version for best results
[You can get KoboldCPP here](https://github.com/LostRuins/koboldcpp/releases/latest) |