Hugging Face's logo

MaziyarPanahi
/
SmolLM2-1.7B-Instruct-GGUF

Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card Files Community
2

Upload folder using huggingface_hub

#2
by MaziyarPanahi - opened
base: refs/heads/main
←
from: refs/pr/2
Discussion Files changed
+20
-0
Files changed (6) hide show
  1. .gitattributes +5 -0
  2. SmolLM2-1.7B-Instruct.Q2_K.gguf +3 -0
  3. SmolLM2-1.7B-Instruct.Q3_K_L.gguf +3 -0
  4. SmolLM2-1.7B-Instruct.Q3_K_M.gguf +3 -0
  5. SmolLM2-1.7B-Instruct.Q4_K_M.gguf +3 -0
  6. SmolLM2-1.7B-Instruct.Q4_K_S.gguf +3 -0
.gitattributes CHANGED
@@ -39,3 +39,8 @@ SmolLM2-1.7B-Instruct.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
39
  SmolLM2-1.7B-Instruct.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
40
  SmolLM2-1.7B-Instruct.fp16.gguf filter=lfs diff=lfs merge=lfs -text
41
  SmolLM2-1.7B-Instruct.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
39
  SmolLM2-1.7B-Instruct.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
40
  SmolLM2-1.7B-Instruct.fp16.gguf filter=lfs diff=lfs merge=lfs -text
41
  SmolLM2-1.7B-Instruct.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
42
+ SmolLM2-1.7B-Instruct.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
43
+ SmolLM2-1.7B-Instruct.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
44
+ SmolLM2-1.7B-Instruct.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
45
+ SmolLM2-1.7B-Instruct.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
46
+ SmolLM2-1.7B-Instruct.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
SmolLM2-1.7B-Instruct.Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4f8540bd01d96bfae7635d35e4fb443ec202d2da1104cbb13aeb5edfd5275c3d
3
+ size 674583456
SmolLM2-1.7B-Instruct.Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f96c2fa02ce15ff8013567ec5e44756df89f922c2840872f2034a4df516b584a
3
+ size 932533152
SmolLM2-1.7B-Instruct.Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:288a6a081791fd3a5fa5c4402e3cdf7239d5d4515d69726555701d7628740cd7
3
+ size 860181408
SmolLM2-1.7B-Instruct.Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0eed15c92fa16bbf543050ceee2a0b9c62107dadaee1bb44c8d6076584604caa
3
+ size 1055609760
SmolLM2-1.7B-Instruct.Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1b59b1fa60253e53b848b18ab215e2a69df5c7ea3b13a6aabf77bec3ead405ad
3
+ size 999117728