PrunaAI
/

starcoder2-7b-GGUF-smashed

Inference Endpoints

Model card Files Files and versions Community

starcoder2-7b-GGUF-smashed

2 contributors

History: 10 commits

johnrachwanpruna's picture

johnrachwanpruna

Upload starcoder2-7b.Q5_K_M.gguf with huggingface_hub

dc12778 7 months ago

.gitattributes

2.07 kB

Upload starcoder2-7b.Q5_K_M.gguf with huggingface_hub 7 months ago
starcoder2-7b.IQ3_M.gguf

3.32 GB
LFS

Upload starcoder2-7b.IQ3_M.gguf with huggingface_hub 7 months ago
starcoder2-7b.IQ4_NL.gguf

4.15 GB
LFS

Upload starcoder2-7b.IQ4_NL.gguf with huggingface_hub 7 months ago
starcoder2-7b.IQ4_XS.gguf

3.95 GB
LFS

Upload starcoder2-7b.IQ4_XS.gguf with huggingface_hub 7 months ago
starcoder2-7b.Q3_K_L.gguf

4.07 GB
LFS

Upload starcoder2-7b.Q3_K_L.gguf with huggingface_hub 7 months ago
starcoder2-7b.Q4_0.gguf

4.1 GB
LFS

Upload starcoder2-7b.Q4_0.gguf with huggingface_hub 7 months ago
starcoder2-7b.Q5_1.gguf

5.4 GB
LFS

Upload starcoder2-7b.Q5_1.gguf with huggingface_hub 7 months ago
starcoder2-7b.Q5_K_M.gguf

5.15 GB
LFS

Upload starcoder2-7b.Q5_K_M.gguf with huggingface_hub 7 months ago
starcoder2-7b.Q5_K_S.gguf

4.97 GB
LFS

Upload starcoder2-7b.Q5_K_S.gguf with huggingface_hub 7 months ago
starcoder2-7b.Q6_K.gguf

5.89 GB
LFS

Upload starcoder2-7b.Q6_K.gguf with huggingface_hub 7 months ago