This contains GGML quants for [PygmalionAI/pygmalion-6b](https://huggingface.co/PygmalionAI/pygmalion-6b), made for use in KoboldCPP. | |
It contains multiple versions, please download the [ggjtv3](https://huggingface.co/concedo/pygmalion-6bv3-ggml-ggjt/blob/main/pygmalion-6b-v3-ggjtv3-q4_0.bin) version for best results | |
[You can get KoboldCPP here](https://github.com/LostRuins/koboldcpp/releases/latest) |