Hugging Face's logo

second-state
/
Zephyr-7B-Beta-GGUF

Text Generation
Transformers
GGUF
English
mistral
Generated from Trainer
text-generation-inference
Model card Files Community
Xin Liu commited on
Commit
7900dfe
•
1 Parent(s): 8955fdb

Add models

Browse files

Signed-off-by: Xin Liu <sam@secondstate.io>

Files changed (13) hide show
  1. .gitattributes +1 -0
  2. zephyr-7b-beta-Q2_K.gguf +3 -0
  3. zephyr-7b-beta-Q3_K_L.gguf +3 -0
  4. zephyr-7b-beta-Q3_K_M.gguf +3 -0
  5. zephyr-7b-beta-Q3_K_S.gguf +3 -0
  6. zephyr-7b-beta-Q4_0.gguf +3 -0
  7. zephyr-7b-beta-Q4_K_M.gguf +3 -0
  8. zephyr-7b-beta-Q4_K_S.gguf +3 -0
  9. zephyr-7b-beta-Q5_0.gguf +3 -0
  10. zephyr-7b-beta-Q5_K_M.gguf +3 -0
  11. zephyr-7b-beta-Q5_K_S.gguf +3 -0
  12. zephyr-7b-beta-Q6_K.gguf +3 -0
  13. zephyr-7b-beta-Q8_0.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ *.gguf filter=lfs diff=lfs merge=lfs -text
zephyr-7b-beta-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c020e52cabc84af032a1e1ac842d27c5c1362a2add77dbb65b05f269d0c90a42
3
+ size 3083098208
zephyr-7b-beta-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:579523641e01b9473675e5c372ed01f11967298fa982b1a179a1f909a4591504
3
+ size 3822024800
zephyr-7b-beta-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:244731b1010e59ebd57aee4f0a0991ab6d817b9a2957e393b5a3821baa33bd80
3
+ size 3518986336
zephyr-7b-beta-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c7ba70672ed7cdcf3ce53e93f891a292c210633563f2b7df3b0e78d4cd6d08c7
3
+ size 3164567648
zephyr-7b-beta-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:72f01f378c85edb7832fbbbc9933594df503e34c1b0ca086cc184a633929fae3
3
+ size 4108916832
zephyr-7b-beta-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b6ae8f4312acfa39fa6a47e07c65fd2c73d213b6ae95c36f37ed4415ca3dfb13
3
+ size 4368439392
zephyr-7b-beta-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f3869b5216ce604ea60ca3e4f61c3a7844ea525c0196fc78bcfaf15fee082f4e
3
+ size 4140374112
zephyr-7b-beta-Q5_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ca8c67b59585024e1302502e3414c90cd052aeffb3b18b89c98dac3aa59a4e92
3
+ size 4997716064
zephyr-7b-beta-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9ef317faf382c2eb6a34a50f5e95300f108dd188264df00767cf555df7d05c74
3
+ size 5131409504
zephyr-7b-beta-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:79bebf283f88a20195532426e710ed97ba0b7c2f8e45e83d1e6bcfbafe2a77ca
3
+ size 4997716064
zephyr-7b-beta-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ab1bf526440b1e3582ce3bf702c2ec7039620f7ca2c78ce1a4c98ea7159dc2c2
3
+ size 5942065248
zephyr-7b-beta-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d6e2d6d76b1b0ec96c5c30c223cb4eeb0ebf98517fea4a38238c504369135a8f
3
+ size 7695857760