Hugging Face's logo

second-state
/
MistralLite-7B-GGUF

Text Generation
Transformers
GGUF
mistral
text-generation-inference
Model card Files Community
Xin Liu commited on
Commit
e37442c
•
1 Parent(s): 4886e58

Add models

Browse files

Signed-off-by: Xin Liu <sam@secondstate.io>

Files changed (12) hide show
  1. MistralLite-Q2_K.gguf +3 -0
  2. MistralLite-Q3_K_L.gguf +3 -0
  3. MistralLite-Q3_K_M.gguf +3 -0
  4. MistralLite-Q3_K_S.gguf +3 -0
  5. MistralLite-Q4_0.gguf +3 -0
  6. MistralLite-Q4_K_M.gguf +3 -0
  7. MistralLite-Q4_K_S.gguf +3 -0
  8. MistralLite-Q5_0.gguf +3 -0
  9. MistralLite-Q5_K_M.gguf +3 -0
  10. MistralLite-Q5_K_S.gguf +3 -0
  11. MistralLite-Q6_K.gguf +3 -0
  12. MistralLite-Q8_0.gguf +3 -0
MistralLite-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b9f46fbc58f966476d2a906005da7a42d0d2085fc217c5a670487d8a715032d5
3
+ size 2701430240
MistralLite-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:02186137e07badb7707e80a8865016c79809d750e2d22bce710ab66b3a4d4329
3
+ size 3822039744
MistralLite-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6ead22c59a5c66ef54a875522075dac3686f34214b344bb7586a72b00a36c21c
3
+ size 3519001280
MistralLite-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:df03e3fa1924af92e55b3149c5ba3f586c9901faa063fface1488563413f4165
3
+ size 3164582592
MistralLite-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:259579cb037ea997b02450e37d676693849429a144ea1b1ce7e40e5ec3f58962
3
+ size 4108933408
MistralLite-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ff0fb6c536e9807fdcd6082c0e760ca582ef93a973e0a6f1e4f9cc19c676ee43
3
+ size 4368455968
MistralLite-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c9eb4e6603a8715deca11969523db2f1e66ee40c1f2d6305db87a3c5c7e014da
3
+ size 4140390688
MistralLite-Q5_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:91397b0810fd6f057807855007ec1a1f6e43c178c285f292f442d4a1d150a585
3
+ size 4997734176
MistralLite-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c8f5d6117cc9ec8dceb2e28e1268770c0c32f39949fceceb105d1e0837e07361
3
+ size 5131427616
MistralLite-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:264516b471a342d9f3c8cbbdcc164645af43463fdd5ceafb034025ce96d452cf
3
+ size 4997734176
MistralLite-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fc6cc0771f0f963c56b3b50f7edf011fe30e671ba0834de0c081e5570bbd1f59
3
+ size 5942084992
MistralLite-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:321944233d26681cf52905193ba5cc4104d57f3340caf1265c09c4173b54a75f
3
+ size 7695883456