Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
Mistral-NeMo-Minitron-8B-Instruct-GGUF
like
0
Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card
Files
Files and versions
Community
1
Train
Use this model
3fc1bcb
Mistral-NeMo-Minitron-8B-Instruct-GGUF
1 contributor
History:
6 commits
MaziyarPanahi
caba3378f4a66843b7e27c48cd9dee91c121752e4c48e7c54c9e78d53dc475cb
3fc1bcb
verified
2 months ago
.gitattributes
1.92 kB
caba3378f4a66843b7e27c48cd9dee91c121752e4c48e7c54c9e78d53dc475cb
2 months ago
Mistral-NeMo-Minitron-8B-Instruct.Q5_K_M.gguf
6 GB
LFS
849ab006c1ea3adfd33a8c36f15215a3b4b128d98cf4ed8ee3ad1d2abfff5bde
2 months ago
Mistral-NeMo-Minitron-8B-Instruct.Q5_K_S.gguf
5.86 GB
LFS
5157a8b4ffdae7a7c61cb6fa83b672146adc05887538b53d1f35e7ebfacd7e60
2 months ago
Mistral-NeMo-Minitron-8B-Instruct.Q6_K.gguf
6.91 GB
LFS
537569048ef565b3d1fb161305888ea12f5440b446fd8daad782cd2eb7ba4a01
2 months ago
Mistral-NeMo-Minitron-8B-Instruct.Q8_0.gguf
8.95 GB
LFS
58efd2c1b75a3247665afd0a3614265678d0f20d284678713c9a44a1aecf4ae4
2 months ago
Mistral-NeMo-Minitron-8B-Instruct.fp16.gguf
16.8 GB
LFS
caba3378f4a66843b7e27c48cd9dee91c121752e4c48e7c54c9e78d53dc475cb
2 months ago
