Text Generation
Transformers
GGUF
Safetensors
PyTorch
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
Safetensors
text-generation-inference
Merge
7b
mistralai/Mistral-7B-Instruct-v0.2
HuggingFaceH4/zephyr-7b-beta
Generated from Trainer
en
dataset:HuggingFaceH4/ultrachat_200k
dataset:HuggingFaceH4/ultrafeedback_binarized
arxiv:2305.18290
arxiv:2310.16944
Eval Results
Inference Endpoints
conversational
MaziyarPanahi
commited on
Commit
•
c7d11d8
1
Parent(s):
17e1490
Upload folder using huggingface_hub
Browse files- .gitattributes +1 -0
- README.md +0 -1
- zephyr-7b-beta-Mistral-7B-Instruct-v0.2.Q2_K.gguf +2 -2
- zephyr-7b-beta-Mistral-7B-Instruct-v0.2.Q3_K_L.gguf +2 -2
- zephyr-7b-beta-Mistral-7B-Instruct-v0.2.Q3_K_M.gguf +2 -2
- zephyr-7b-beta-Mistral-7B-Instruct-v0.2.Q3_K_S.gguf +2 -2
- zephyr-7b-beta-Mistral-7B-Instruct-v0.2.Q4_K_M.gguf +2 -2
- zephyr-7b-beta-Mistral-7B-Instruct-v0.2.Q4_K_S.gguf +2 -2
- zephyr-7b-beta-Mistral-7B-Instruct-v0.2.Q5_K_M.gguf +2 -2
- zephyr-7b-beta-Mistral-7B-Instruct-v0.2.Q5_K_S.gguf +2 -2
- zephyr-7b-beta-Mistral-7B-Instruct-v0.2.Q6_K.gguf +2 -2
- zephyr-7b-beta-Mistral-7B-Instruct-v0.2.Q8_0.gguf +2 -2
- zephyr-7b-beta-Mistral-7B-Instruct-v0.2.fp16.gguf +3 -0
.gitattributes
CHANGED
@@ -43,3 +43,4 @@ zephyr-7b-beta-Mistral-7B-Instruct-v0.2.Q5_K_M.gguf filter=lfs diff=lfs merge=lf
|
|
43 |
zephyr-7b-beta-Mistral-7B-Instruct-v0.2.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
44 |
zephyr-7b-beta-Mistral-7B-Instruct-v0.2.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
45 |
zephyr-7b-beta-Mistral-7B-Instruct-v0.2.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
|
|
|
43 |
zephyr-7b-beta-Mistral-7B-Instruct-v0.2.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
44 |
zephyr-7b-beta-Mistral-7B-Instruct-v0.2.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
45 |
zephyr-7b-beta-Mistral-7B-Instruct-v0.2.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
46 |
+
zephyr-7b-beta-Mistral-7B-Instruct-v0.2.fp16.gguf filter=lfs diff=lfs merge=lfs -text
|
README.md
CHANGED
@@ -136,7 +136,6 @@ HF_HUB_ENABLE_HF_TRANSFER=1 huggingface-cli download MaziyarPanahi/zephyr-7b-bet
|
|
136 |
Windows Command Line users: You can set the environment variable by running `set HF_HUB_ENABLE_HF_TRANSFER=1` before the download command.
|
137 |
</details>
|
138 |
|
139 |
-
|
140 |
## Example `llama.cpp` command
|
141 |
|
142 |
Make sure you are using `llama.cpp` from commit [d0cee0d](https://github.com/ggerganov/llama.cpp/commit/d0cee0d36d5be95a0d9088b674dbb27354107221) or later.
|
|
|
136 |
Windows Command Line users: You can set the environment variable by running `set HF_HUB_ENABLE_HF_TRANSFER=1` before the download command.
|
137 |
</details>
|
138 |
|
|
|
139 |
## Example `llama.cpp` command
|
140 |
|
141 |
Make sure you are using `llama.cpp` from commit [d0cee0d](https://github.com/ggerganov/llama.cpp/commit/d0cee0d36d5be95a0d9088b674dbb27354107221) or later.
|
zephyr-7b-beta-Mistral-7B-Instruct-v0.2.Q2_K.gguf
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
-
size
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:883696cb7c8c08d86b2c0d8195a70a5b6757400c40d44856fffe7dd0bdd1c858
|
3 |
+
size 2719242432
|
zephyr-7b-beta-Mistral-7B-Instruct-v0.2.Q3_K_L.gguf
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
-
size
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:55964160c7839fcfdd31ccbf0ffe41bd21db91d456fbad6f3c8d2d394a04cd53
|
3 |
+
size 3822024896
|
zephyr-7b-beta-Mistral-7B-Instruct-v0.2.Q3_K_M.gguf
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
-
size
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:917c9629cb03940f229e3e64ed9acc1c15465a5d018a5754608a00dadfc8bd4c
|
3 |
+
size 3518986432
|
zephyr-7b-beta-Mistral-7B-Instruct-v0.2.Q3_K_S.gguf
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
-
size
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:a693a575b9f55f3a57173a8d687beec2cc1152cff54bb124142ec8b979cd33d2
|
3 |
+
size 3164567744
|
zephyr-7b-beta-Mistral-7B-Instruct-v0.2.Q4_K_M.gguf
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
-
size
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:2eecae1027fd71bd5f9e1a9b589d95dad65a5112c29475b7e651f85951f1ff50
|
3 |
+
size 4368439488
|
zephyr-7b-beta-Mistral-7B-Instruct-v0.2.Q4_K_S.gguf
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
-
size
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:bb42eab3b46243795d3ffaf53f2e26655235f07572e5204f89e9066018473be0
|
3 |
+
size 4140374208
|
zephyr-7b-beta-Mistral-7B-Instruct-v0.2.Q5_K_M.gguf
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
-
size
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:58ae2e123b9d91118e25b2ef71bbca2c495bd50f211cbe9789b7bcb476531dca
|
3 |
+
size 5131409600
|
zephyr-7b-beta-Mistral-7B-Instruct-v0.2.Q5_K_S.gguf
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
-
size
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:58bfe24e12773ed36063daea4d4021b07ecb945d3e1b9e083e32913131c8b227
|
3 |
+
size 4997716160
|
zephyr-7b-beta-Mistral-7B-Instruct-v0.2.Q6_K.gguf
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
-
size
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:3fac2cf8db004ed71617d5605d1ea6b221eba249c0935761b837cacfad99b1d5
|
3 |
+
size 5942065344
|
zephyr-7b-beta-Mistral-7B-Instruct-v0.2.Q8_0.gguf
CHANGED
@@ -1,3 +1,3 @@
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
-
oid sha256:
|
3 |
-
size
|
|
|
1 |
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:99a8be73fcbe9f04067a130da74adcdb55cf2fab5e4894cd0d273ae84c0163af
|
3 |
+
size 7695857856
|
zephyr-7b-beta-Mistral-7B-Instruct-v0.2.fp16.gguf
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:be06095d82f75f3adc2bec377bafff18dd4f2b13c510f87306b3338858be8d31
|
3 |
+
size 14484732064
|