Text Generation
Transformers
GGUF
English
mixtral
text-generation-inference
Xin Liu commited on
Commit
3670b9d
1 Parent(s): ebab9b8

Add Q6 and Q8 models

Browse files

Signed-off-by: Xin Liu <sam@secondstate.io>

dolphin-2.7-mixtral-8x7b-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4d4b8e458565a4ab100edc6b0e250f34676628ec2e864ed559a15f7ef52d5cf1
3
+ size 38378773312
dolphin-2.7-mixtral-8x7b-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6416ca13fdaf2ecdbec983d6a20b5dad4bd80638733e2fb2071d67cca2d037a7
3
+ size 49624279744