GGUF
Inference Endpoints
conversational
Crunchy-onion-GGUF / README.md
LoneStriker's picture
Upload folder using huggingface_hub
534b944 verified
metadata
license: agpl-3.0
datasets:
  - lemonilia/LimaRP
  - grimulkan/theory-of-mind
  - Epiculous/Gnosis

Crunchy-onion

This model is created by training Mixtral base model on LimaRP (ShareGPT format provided by SAO), theory of mind, and gnosis(provided by jeiku).

The 4-bit qlora was then merged into Mixtral Instruct resulting in what you see here.

Works best with ChatML Instruct