kroonen/dolphin-2.6-mistral-7b-GGUF

This is a quantized GGUF version of dolphin-2.6-mistral-7b to 4_0, 8_0 bits and the converted 16 FP model.

(link to the original model : https://huggingface.co/cognitivecomputations/dolphin-2.6-mistral-7b)