--- license: mit language: - en library_name: adapter-transformers --- xriminact/TarsChattyBasev0.1 GGUF models converted using llama.cpp | Name | Quant Method | Bits | Max RAM Required | Usecase | | ----------- |:----------------------:|:-----:|:-----------------:|:--------:| | TarsChattyBasev0.1-Q4_K_M.gguf | Q4_K_M | 4 | ~6.5 GB | balanced quality | TarsChattyBasev0.1-Q5_K_M.gguf | Q5_K_M | 5 | ~7.5 GB | large, very low quality loss | TarsChattyBasev0.1-Q8_0.gguf | Q8_0 | 8 | ~10.5 GB | very large, extremely low quality loss