Hugging Face's logo

second-state
/
Mistral-7B-Instruct-v0.1-GGUF

Text Generation
Transformers
GGUF
mistral
finetuned
text-generation-inference
Model card Files Community
Xin Liu commited on
Commit
082b72a
•
1 Parent(s): 9bcd354

Add models

Browse files

Signed-off-by: Xin Liu <sam@secondstate.io>

Files changed (12) hide show
  1. Mistral-7B-Instruct-v0.1-Q2_K.gguf +3 -0
  2. Mistral-7B-Instruct-v0.1-Q3_K_L.gguf +3 -0
  3. Mistral-7B-Instruct-v0.1-Q3_K_M.gguf +3 -0
  4. Mistral-7B-Instruct-v0.1-Q3_K_S.gguf +3 -0
  5. Mistral-7B-Instruct-v0.1-Q4_0.gguf +3 -0
  6. Mistral-7B-Instruct-v0.1-Q4_K_M.gguf +3 -0
  7. Mistral-7B-Instruct-v0.1-Q4_K_S.gguf +3 -0
  8. Mistral-7B-Instruct-v0.1-Q5_0.gguf +3 -0
  9. Mistral-7B-Instruct-v0.1-Q5_K_M.gguf +3 -0
  10. Mistral-7B-Instruct-v0.1-Q5_K_S.gguf +3 -0
  11. Mistral-7B-Instruct-v0.1-Q6_K.gguf +3 -0
  12. Mistral-7B-Instruct-v0.1-Q8_0.gguf +3 -0
Mistral-7B-Instruct-v0.1-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:558da6444cf2113c71ab03b75f5bebe261f5bf5ecefa9118df1eef2bf84cfbd9
3
+ size 2701416672
Mistral-7B-Instruct-v0.1-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1be10c4426a7366a3ecd92dea0e30d2e1650aac8773976550ffc7fbaba3a2721
3
+ size 3822024928
Mistral-7B-Instruct-v0.1-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1234750a52edd6f461f3d16030c4cd48d8766d73e05737f0e3a0ada8feee62a6
3
+ size 3518986464
Mistral-7B-Instruct-v0.1-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dfa28f5fffbb98372f06b34e56ef39b5d1c115d1b927d3c4beda0ba5740f6f40
3
+ size 3164567776
Mistral-7B-Instruct-v0.1-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:54d0252b30aa4b4dbbb0c596e07c60c4a83b7068071a6c7c3c2163f1c46e9a61
3
+ size 4108916960
Mistral-7B-Instruct-v0.1-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3952bb238caf9137ae87a6a0b5591211f25b7753c9ad55267b92c4ae2ea27682
3
+ size 4368439520
Mistral-7B-Instruct-v0.1-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6db6cb5c7d4f4f0639fa43bb327ce001fe4696bd5e9327c0f7dcdfdf1e86a0a9
3
+ size 4140374240
Mistral-7B-Instruct-v0.1-Q5_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0afee75ec1573c222bb36280c99754fb564063a490a3bd3162cd009c3410ad59
3
+ size 4997716192
Mistral-7B-Instruct-v0.1-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:287a6520a937fcdb9d1d21b1f9145ba3c8624a4c8ce5411dae5e74991a911a94
3
+ size 5131409632
Mistral-7B-Instruct-v0.1-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2fe65581a8e41635b1c651856d6cbcb54d9ca434b61245ec2c6670478a793484
3
+ size 4997716192
Mistral-7B-Instruct-v0.1-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d9c7c6584a89cc8deee9f70ffa13429665b19f49fa5efff4269b6ba158162124
3
+ size 5942065376
Mistral-7B-Instruct-v0.1-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4e87deac3a32c3b0a127da5dde0540364888be0d0892303d0e600a10b8ab2ad3
3
+ size 7695857888