Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
bartowski
/
Codestral-RAG-19B-Pruned-GGUF
like
0
Text Generation
GGUF
Inference Endpoints
imatrix
Model card
Files
Files and versions
Community
Deploy
Use this model
main
Codestral-RAG-19B-Pruned-GGUF
1 contributor
History:
2 commits
bartowski
Llamacpp quants
f68fdd7
verified
6 months ago
Codestral-RAG-19B-Pruned-f32.gguf
Llamacpp quants
6 months ago
.gitattributes
Safe
3.06 kB
Llamacpp quants
6 months ago
Codestral-RAG-19B-Pruned-IQ2_M.gguf
Safe
6.56 GB
LFS
Llamacpp quants
6 months ago
Codestral-RAG-19B-Pruned-IQ2_S.gguf
Safe
6.06 GB
LFS
Llamacpp quants
6 months ago
Codestral-RAG-19B-Pruned-IQ2_XS.gguf
Safe
5.73 GB
LFS
Llamacpp quants
6 months ago
Codestral-RAG-19B-Pruned-IQ3_M.gguf
Safe
8.66 GB
LFS
Llamacpp quants
6 months ago
Codestral-RAG-19B-Pruned-IQ3_XS.gguf
Safe
7.9 GB
LFS
Llamacpp quants
6 months ago
Codestral-RAG-19B-Pruned-IQ3_XXS.gguf
Safe
7.4 GB
LFS
Llamacpp quants
6 months ago
Codestral-RAG-19B-Pruned-IQ4_XS.gguf
Safe
10.3 GB
LFS
Llamacpp quants
6 months ago
Codestral-RAG-19B-Pruned-Q2_K.gguf
Safe
7.12 GB
LFS
Llamacpp quants
6 months ago
Codestral-RAG-19B-Pruned-Q3_K_L.gguf
Safe
10.1 GB
LFS
Llamacpp quants
6 months ago
Codestral-RAG-19B-Pruned-Q3_K_M.gguf
Safe
9.26 GB
LFS
Llamacpp quants
6 months ago
Codestral-RAG-19B-Pruned-Q3_K_S.gguf
Safe
8.3 GB
LFS
Llamacpp quants
6 months ago
Codestral-RAG-19B-Pruned-Q4_K_M.gguf
Safe
11.5 GB
LFS
Llamacpp quants
6 months ago
Codestral-RAG-19B-Pruned-Q4_K_S.gguf
Safe
10.9 GB
LFS
Llamacpp quants
6 months ago
Codestral-RAG-19B-Pruned-Q5_K_M.gguf
Safe
13.5 GB
LFS
Llamacpp quants
6 months ago
Codestral-RAG-19B-Pruned-Q5_K_S.gguf
Safe
13.2 GB
LFS
Llamacpp quants
6 months ago
Codestral-RAG-19B-Pruned-Q6_K.gguf
Safe
15.7 GB
LFS
Llamacpp quants
6 months ago
Codestral-RAG-19B-Pruned-Q8_0.gguf
Safe
20.3 GB
LFS
Llamacpp quants
6 months ago
Codestral-RAG-19B-Pruned.imatrix
Safe
10.2 MB
LFS
Llamacpp quants
6 months ago
README.md
Safe
7.32 kB
Llamacpp quants
6 months ago