tags: | |
- merge | |
license: apache-2.0 | |
GGUF quants of [TeeZee/Kyllene-34B-v1.1](https://huggingface.co/TeeZee/Kyllene-34B-v1.1), | |
remeber to set your max context length to proper length for your hardware, 4096 is fine. | |
Default context length is 200k so it will eat RAM or VRAM like crazy if left unchecked. |