This repository includes some of our favorite bonchon ('side dishes' in Korean).
We currently include in this repository several of our favorite GGUF files from TheBloke, including four of our favorite 7B chat models, in Q4_K_M GGUF files.
This repository is Public, but intended primarily for use in conjunction with other llmware models, datasets and libraries.
Please note specific licensing information and reference for files included in the repository:
- HuggingFaceH4/Zephyr-7B-GGUF - MIT License - original repository link
- Teknium/OpenHermes-2.5-Mistral-7B-GGUF - Apache 2.0 License - original repository link
- Llama2-Chat-7B-GGUF - Llama2 License - original repository link
- Starling-7B-GGUF - CC-BY-NC-4.0 License - Non-Commercial - original repository link
- EleutherAI/Llema-7B-GGUF - Apache 2.0 License - original repository link
Please also see TheBloke for more information on GGUF.
- Downloads last month
- 195
4-bit