Hugging Face's logo

second-state
/
Samantha-1.2-Mistral-7B-GGUF

Text Generation
Transformers
GGUF
mistral
text-generation-inference
conversational
Model card Files Community
Xin Liu commited on
Commit
d7ada25
•
1 Parent(s): f0e5734

Add models

Browse files

Signed-off-by: Xin Liu <sam@secondstate.io>

Files changed (12) hide show
  1. samantha-1.2-mistral-7b-Q2_K.gguf +3 -0
  2. samantha-1.2-mistral-7b-Q3_K_L.gguf +3 -0
  3. samantha-1.2-mistral-7b-Q3_K_M.gguf +3 -0
  4. samantha-1.2-mistral-7b-Q3_K_S.gguf +3 -0
  5. samantha-1.2-mistral-7b-Q4_0.gguf +3 -0
  6. samantha-1.2-mistral-7b-Q4_K_M.gguf +3 -0
  7. samantha-1.2-mistral-7b-Q4_K_S.gguf +3 -0
  8. samantha-1.2-mistral-7b-Q5_0.gguf +3 -0
  9. samantha-1.2-mistral-7b-Q5_K_M.gguf +3 -0
  10. samantha-1.2-mistral-7b-Q5_K_S.gguf +3 -0
  11. samantha-1.2-mistral-7b-Q6_K.gguf +3 -0
  12. samantha-1.2-mistral-7b-Q8_0.gguf +3 -0
samantha-1.2-mistral-7b-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d8191d494afa15a99672d0d14cb3b53c5d2727e4e7eaf7621e20f2dc2c58baaa
3
+ size 2719251680
samantha-1.2-mistral-7b-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cef4e477dfdc261aed82932f709db302e944bb3be6ecc9ae3ca21130cccddcdd
3
+ size 3822034976
samantha-1.2-mistral-7b-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:322d875bcf238d8ff5f80699ae5f3e7a4e938e975c0c990d4d145b7e18fe27e1
3
+ size 3518996512
samantha-1.2-mistral-7b-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7ca13f0277fac19b876c91fc5e9b743b3013e1c286f8d2825d1ff289327e329e
3
+ size 3164577824
samantha-1.2-mistral-7b-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9c2051bc234609755cd277cd153aa600effe40fb5cc3453c0408d0a4d6353009
3
+ size 4108928096
samantha-1.2-mistral-7b-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6bcf859610d78da9a95901d5a488e576679a64f29ba06326ebc43ead027430a4
3
+ size 4368450656
samantha-1.2-mistral-7b-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d7413e77d40fda64c10a369cf50b3054c416ac1da23c4725d2fab4c4d9c5078b
3
+ size 4140385376
samantha-1.2-mistral-7b-Q5_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5f7a2a2290b8bf1879408c2c94027f899e71f9e4848d38d5c4c217464c989a64
3
+ size 4997728352
samantha-1.2-mistral-7b-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1051ff70a76561776427c22fe022f8984166bdeca82a1c0c2edcd6fa6d2c5dee
3
+ size 5131421792
samantha-1.2-mistral-7b-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:444e1e8e9b2bb37460dd4148b1db1666d8fe562da07877d697b12d98bda9554f
3
+ size 4997728352
samantha-1.2-mistral-7b-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:864c0ce6e0a6cf525025d265b804a37b2b33474c944528894339ece9441122dc
3
+ size 5942078624
samantha-1.2-mistral-7b-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d219f7f729a4d2812793e1c81c5afec03384033d894ecbe62fff616195de5622
3
+ size 7695875104