Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
dolphin-mistral-instruct-7b-GGUF
like
0
Text Generation
Transformers
GGUF
Safetensors
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
mergekit
Merge
conversational
Inference Endpoints
text-generation-inference
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
6066244
dolphin-mistral-instruct-7b-GGUF
1 contributor
History:
11 commits
MaziyarPanahi
ac4068cfec0937dc2ef3dd2c05d0f37eb9be1381ac86903d67be4e876c3fa9ea
6066244
verified
8 months ago
.gitattributes
Safe
2.27 kB
ac4068cfec0937dc2ef3dd2c05d0f37eb9be1381ac86903d67be4e876c3fa9ea
8 months ago
dolphin-mistral-instruct-7b.Q2_K.gguf
Safe
2.72 GB
LFS
7971671c93713f21ce24e9e92100a96b3d561854ed7b539b15c4e2643905d913
8 months ago
dolphin-mistral-instruct-7b.Q3_K_L.gguf
Safe
3.82 GB
LFS
e578825e126bd38e519ac293c368f92ccbe2dc6ee9227f960798bca549fcdecd
8 months ago
dolphin-mistral-instruct-7b.Q3_K_M.gguf
Safe
3.52 GB
LFS
5eeb98dc395dbf95d39d6e3eaf84d6ac486c0a2403802b19ce0b8811cec9f140
8 months ago
dolphin-mistral-instruct-7b.Q3_K_S.gguf
Safe
3.16 GB
LFS
93a0f733e80508b7e04cf7ea0fdcf9948ec18218049bcce208e38eb8c55aa194
8 months ago
dolphin-mistral-instruct-7b.Q4_K_M.gguf
4.37 GB
LFS
d0d17af90ac654262d6daa27fe09326c4a78ba3c04a782bede4ada491618a7f7
8 months ago
dolphin-mistral-instruct-7b.Q4_K_S.gguf
Safe
4.14 GB
LFS
c3a1df7b5fbba6a8f2058cf21fbdc34dfdc804a79c862315aedf371c0f9fe3a2
8 months ago
dolphin-mistral-instruct-7b.Q5_K_M.gguf
5.13 GB
LFS
add4a213fd74d6397bdb705f7e70e7dd167c7488a66169759793208a8b87009e
8 months ago
dolphin-mistral-instruct-7b.Q5_K_S.gguf
5 GB
LFS
2fa58bf313a441c150fd659d4b626bcbd076d29753c1fc8d0d79b796f317054f
8 months ago
dolphin-mistral-instruct-7b.Q6_K.gguf
5.94 GB
LFS
d847ccf637732c6f0ac768180797e9e8139493562d85d252b75055f21e3e3981
8 months ago
dolphin-mistral-instruct-7b.Q8_0.gguf
7.7 GB
LFS
ac4068cfec0937dc2ef3dd2c05d0f37eb9be1381ac86903d67be4e876c3fa9ea
8 months ago
