PrunaAI
/

stablelm-2-12b-GGUF-smashed

Inference Endpoints

Model card Files Files and versions Community

stablelm-2-12b-GGUF-smashed

2 contributors

History: 13 commits

johnrachwanpruna's picture

johnrachwanpruna

Upload stablelm-2-12b.Q5_0.gguf with huggingface_hub

2c3efae verified 7 months ago

.gitattributes

2.2 kB

Upload stablelm-2-12b.Q5_0.gguf with huggingface_hub 7 months ago
stablelm-2-12b.IQ3_M.gguf

5.65 GB
LFS

Upload stablelm-2-12b.IQ3_M.gguf with huggingface_hub 7 months ago
stablelm-2-12b.IQ3_XS.gguf

5.2 GB
LFS

Upload stablelm-2-12b.IQ3_XS.gguf with huggingface_hub 7 months ago
stablelm-2-12b.Q2_K.gguf

4.7 GB
LFS

Upload stablelm-2-12b.Q2_K.gguf with huggingface_hub 7 months ago
stablelm-2-12b.Q3_K_L.gguf

6.49 GB
LFS

Upload stablelm-2-12b.Q3_K_L.gguf with huggingface_hub 7 months ago
stablelm-2-12b.Q3_K_M.gguf

5.99 GB
LFS

Upload stablelm-2-12b.Q3_K_M.gguf with huggingface_hub 7 months ago
stablelm-2-12b.Q4_1.gguf

7.7 GB
LFS

Upload stablelm-2-12b.Q4_1.gguf with huggingface_hub 7 months ago
stablelm-2-12b.Q4_K_S.gguf

7.02 GB
LFS

Upload stablelm-2-12b.Q4_K_S.gguf with huggingface_hub 7 months ago
stablelm-2-12b.Q5_0.gguf

8.42 GB
LFS

Upload stablelm-2-12b.Q5_0.gguf with huggingface_hub 7 months ago
stablelm-2-12b.Q5_1.gguf

9.15 GB
LFS

Upload stablelm-2-12b.Q5_1.gguf with huggingface_hub 7 months ago
stablelm-2-12b.Q5_K_M.gguf

8.63 GB
LFS

Upload stablelm-2-12b.Q5_K_M.gguf with huggingface_hub 7 months ago
stablelm-2-12b.Q6_K.gguf

9.97 GB
LFS

Upload stablelm-2-12b.Q6_K.gguf with huggingface_hub 7 months ago
stablelm-2-12b.fp16.bin

24.3 GB
LFS

Upload stablelm-2-12b.fp16.bin with huggingface_hub 7 months ago