QuantFactory
/

dolphin-2.8-mistral-7b-v02-GGUF

Text Generation

text-generation-inference

Model card Files Files and versions Community

dolphin-2.8-mistral-7b-v02-GGUF

1 contributor

History: 13 commits

munish0838's picture

Upload dolphin-2.8-mistral-7b-v02.Q4_K_M.gguf with huggingface_hub

ebec5ae verified 5 months ago

.gitattributes

2.26 kB

Upload dolphin-2.8-mistral-7b-v02.Q4_K_M.gguf with huggingface_hub 5 months ago
dolphin-2.8-mistral-7b-v02.Q3_K_S.gguf
3.16 GB
LFS

Upload dolphin-2.8-mistral-7b-v02.Q3_K_S.gguf with huggingface_hub 5 months ago
dolphin-2.8-mistral-7b-v02.Q4_0.gguf
4.11 GB
LFS

Upload dolphin-2.8-mistral-7b-v02.Q4_0.gguf with huggingface_hub 5 months ago
dolphin-2.8-mistral-7b-v02.Q4_1.gguf
4.55 GB
LFS

Upload dolphin-2.8-mistral-7b-v02.Q4_1.gguf with huggingface_hub 5 months ago
dolphin-2.8-mistral-7b-v02.Q4_K_M.gguf
4.37 GB
LFS

Upload dolphin-2.8-mistral-7b-v02.Q4_K_M.gguf with huggingface_hub 5 months ago
dolphin-2.8-mistral-7b-v02.Q4_K_S.gguf
4.14 GB
LFS

Upload dolphin-2.8-mistral-7b-v02.Q4_K_S.gguf with huggingface_hub 5 months ago
dolphin-2.8-mistral-7b-v02.Q5_0.gguf
5 GB
LFS

Upload dolphin-2.8-mistral-7b-v02.Q5_0.gguf with huggingface_hub 5 months ago
dolphin-2.8-mistral-7b-v02.Q5_1.gguf
5.44 GB
LFS

Upload dolphin-2.8-mistral-7b-v02.Q5_1.gguf with huggingface_hub 5 months ago
dolphin-2.8-mistral-7b-v02.Q5_K_S.gguf
5 GB
LFS

Upload dolphin-2.8-mistral-7b-v02.Q5_K_S.gguf with huggingface_hub 5 months ago
dolphin-2.8-mistral-7b-v02.Q6_K.gguf
5.94 GB
LFS

Upload dolphin-2.8-mistral-7b-v02.Q6_K.gguf with huggingface_hub 5 months ago
dolphin-2.8-mistral-7b-v02.Q8_0.gguf
7.7 GB
LFS

Upload dolphin-2.8-mistral-7b-v02.Q8_0.gguf with huggingface_hub 5 months ago