File size: 577 Bytes
2a62b3b d997d73 2a62b3b d997d73 4e9480a |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 |
---
license: mit
language:
- en
library_name: adapter-transformers
---
xriminact/TarsChattyBasev0.1 GGUF models converted using llama.cpp
| Name | Quant Method | Bits | Max RAM Required | Usecase |
| ----------- |:----------------------:|:-----:|:-----------------:|:--------:|
| TarsChattyBasev0.1-Q4_K_M.gguf | Q4_K_M | 4 | ~6.5 GB | balanced quality
| TarsChattyBasev0.1-Q5_K_M.gguf | Q5_K_M | 5 | ~7.5 GB | large, very low quality loss
| TarsChattyBasev0.1-Q8_0.gguf | Q8_0 | 8 | ~10.5 GB | very large, extremely low quality loss |