Hugging Face's logo

second-state
/
Zephyr-7B-Alpha-GGUF

Text Generation
Transformers
GGUF
English
mistral
text-generation-inference
Model card Files Community
Xin Liu commited on
Commit
4f5c3b5
•
1 Parent(s): e6ee286

Add models

Browse files

Signed-off-by: Xin Liu <sam@secondstate.io>

Files changed (12) hide show
  1. zephyr-7b-alpha-Q2_K.gguf +3 -0
  2. zephyr-7b-alpha-Q3_K_L.gguf +3 -0
  3. zephyr-7b-alpha-Q3_K_M.gguf +3 -0
  4. zephyr-7b-alpha-Q3_K_S.gguf +3 -0
  5. zephyr-7b-alpha-Q4_0.gguf +3 -0
  6. zephyr-7b-alpha-Q4_K_M.gguf +3 -0
  7. zephyr-7b-alpha-Q4_K_S.gguf +3 -0
  8. zephyr-7b-alpha-Q5_0.gguf +3 -0
  9. zephyr-7b-alpha-Q5_K_M.gguf +3 -0
  10. zephyr-7b-alpha-Q5_K_S.gguf +3 -0
  11. zephyr-7b-alpha-Q6_K.gguf +3 -0
  12. zephyr-7b-alpha-Q8_0.gguf +3 -0
zephyr-7b-alpha-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:23cb1aa3edf2997af1fda518e1348dffc048d307a1ca060dadaba01ccfd1ba52
3
+ size 2701416544
zephyr-7b-alpha-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:27907713cc210878b9b4e4887520c7f3fa860bd52a7b2add6b24027d7826977a
3
+ size 3822024800
zephyr-7b-alpha-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f4101fb76a49b0df23fe3e32d2ef6c314d272d61b883c6149db54c89c55aa368
3
+ size 3518986336
zephyr-7b-alpha-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:141acd410a36fe305f01975dde46ebf507e69b69a704f311c24c33f9fef949de
3
+ size 3164567648
zephyr-7b-alpha-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1b3db978dacb3ba2d0ac8651ec046b6d507c16090abbadf991fe013537b08d8d
3
+ size 4108916832
zephyr-7b-alpha-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3f2da80630ae4bb5cbc56561bf830b92d6e2d629e6b4783801f06a6bf9423efb
3
+ size 4368439392
zephyr-7b-alpha-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9c3f815825c405ada3f1ffe1f8f524d91a6631eb53789b1874b84f942de48158
3
+ size 4140374112
zephyr-7b-alpha-Q5_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:75d356cdbd474fcb14f562545f5d3875e50682e161cfeb6dd638db8ceb30ea8f
3
+ size 4997716064
zephyr-7b-alpha-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cd035904c4b16904049c2ba7e45f1b34ad2868af3ecbe51d8c77daa371b96245
3
+ size 5131409504
zephyr-7b-alpha-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e97b801e611b194a9ecdbae5727cb0b7d082ba84575d421343e07a0c645f1427
3
+ size 4997716064
zephyr-7b-alpha-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:708fe0ba2fe5e63f5d08e932332b0c854ed33065b407f88bdbdb0533d5a66f1c
3
+ size 5942065248
zephyr-7b-alpha-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6f11eb54abbd2413d6c3d257a6ebd71e2db8109911fbb8ad7fc9b55f8c965f8d
3
+ size 7695857760