Hugging Face's logo

larenspear
/
Yi-1.5-6B-Chat-GGUF

Transformers
GGUF
English
Inference Endpoints
Model card Files Community
larenspear commited on
Commit
fbcb2ad
•
1 Parent(s): 95df77d

GGUF Quantizations

Browse files
Files changed (12) hide show
  1. yi-1.5-6b-chat-q2_k.gguf +3 -0
  2. yi-1.5-6b-chat-q3_k_l.gguf +3 -0
  3. yi-1.5-6b-chat-q3_k_m.gguf +3 -0
  4. yi-1.5-6b-chat-q3_k_s.gguf +3 -0
  5. yi-1.5-6b-chat-q4_0.gguf +3 -0
  6. yi-1.5-6b-chat-q4_k_m.gguf +3 -0
  7. yi-1.5-6b-chat-q4_k_s.gguf +3 -0
  8. yi-1.5-6b-chat-q5_0.gguf +3 -0
  9. yi-1.5-6b-chat-q5_k_m.gguf +3 -0
  10. yi-1.5-6b-chat-q5_k_s.gguf +3 -0
  11. yi-1.5-6b-chat-q6_k.gguf +3 -0
  12. yi-1.5-6b-chat-q8_0.gguf +3 -0
yi-1.5-6b-chat-q2_k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:59c11aaf0573d9c21c1aa672bf7cca3e571427912d96fd914e164eec73761528
3
+ size 2337066944
yi-1.5-6b-chat-q3_k_l.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:32c7c62a1be7227a4774cca285b04e703fffa8e2f87d214f4b9c4592eb2c862d
3
+ size 3236892608
yi-1.5-6b-chat-q3_k_m.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ac8b7addc4524b06910997f92e71b0fbe4240fdbd8ce95bbc920ece7743ad951
3
+ size 2992836544
yi-1.5-6b-chat-q3_k_s.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2a530a3dd0d845c02c22622657c3c9ed4265a91fe904c6c95f793cf4e5427e1d
3
+ size 2709196736
yi-1.5-6b-chat-q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:132f5389ef9d8ae443d25d4eed8647fa687a3b19a09528ddce3bb34d444564cd
3
+ size 3479326656
yi-1.5-6b-chat-q4_k_m.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ec97424075767eead880320562871da631ab35895e383c159c9566df2229cf23
3
+ size 3673968576
yi-1.5-6b-chat-q4_k_s.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6869baf3841984d60196e98ab283f5ad4e80e4cecb5c92df0f064b34f32d306d
3
+ size 3502919616
yi-1.5-6b-chat-q5_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d27a72ef0c6f5af9a93e01619f26ac2e3be5e4f994aa42ae680d49d7cb48735e
3
+ size 4204154816
yi-1.5-6b-chat-q5_k_m.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5013d1f635dc863d84f17f122d1b85a4a51e561364dbc7ad0244a0389a6870e0
3
+ size 4304424896
yi-1.5-6b-chat-q5_k_s.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:efdece9756c78484f326f6d71b1c8587b144d714b658834f51f5646c415939af
3
+ size 4204154816
yi-1.5-6b-chat-q6_k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1d701b8be56065f648aa5a931dc5724350b7d577f91f0dbf6b8819b30bc0f3ac
3
+ size 4974284736
yi-1.5-6b-chat-q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:70f89e631caf8dd43f3eb4e020de047798547022bbaf941b97f161a162c10ae0
3
+ size 6442127296