Hugging Face's logo

l3utterfly
/
mistral-7b-v0.1-layla-v4-chatml-gguf

GGUF
Inference Endpoints
conversational
Model card Files Community
l3utterfly commited on
Commit
709dcb8
•
1 Parent(s): 07c7928

Add quantised GGUF files

Browse files
Files changed (8) hide show
  1. mistral-7b-v0.1-layla-v4-chatml-Q2_K.gguf +2 -2
  2. mistral-7b-v0.1-layla-v4-chatml-Q4_0_4_4.gguf +3 -0
  3. mistral-7b-v0.1-layla-v4-chatml-Q4_0_4_8.gguf +3 -0
  4. mistral-7b-v0.1-layla-v4-chatml-Q4_0_8_8.gguf +3 -0
  5. mistral-7b-v0.1-layla-v4-chatml-Q4_K_M.gguf +3 -0
  6. mistral-7b-v0.1-layla-v4-chatml-Q6_K.gguf +2 -2
  7. mistral-7b-v0.1-layla-v4-chatml-Q8_0.gguf +2 -2
  8. mistral-7b-v0.1-layla-v4-chatml-f16.gguf +2 -2
mistral-7b-v0.1-layla-v4-chatml-Q2_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ea115cdb3f2a195535f0126eaf2ae17e57ca4b2b0b5da734b3c6585ac95fc011
3
- size 2719252064
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:14cf40403e64230fd63162ee3a77d8caf81d5258b3548696493f05cceb55b57e
3
+ size 2719252736
mistral-7b-v0.1-layla-v4-chatml-Q4_0_4_4.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b4ce053e8b83567c1491118d83b2ee2ce60a5fda6d1b3b1359bfc5af0600df86
3
+ size 4108929152
mistral-7b-v0.1-layla-v4-chatml-Q4_0_4_8.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:55350908d2300744456d317e2fcab222b18bedc6ec06cfde629db1496e5c2ee7
3
+ size 4108929152
mistral-7b-v0.1-layla-v4-chatml-Q4_0_8_8.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:da6b5af1317a0a5eb6c4ee2faebd5de05deddae3245c0b62634e6a3205fffd94
3
+ size 4108929152
mistral-7b-v0.1-layla-v4-chatml-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4b179f50a512c491885c11ab88bcb424620bfc0fd5a1a6aa1a00d6022e90a331
3
+ size 4368451712
mistral-7b-v0.1-layla-v4-chatml-Q6_K.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:91ec57a6964b90a94e3dd8d8f56342444ff8373596be15dae81b39aaa3c11ad0
3
- size 5942079008
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0bafe169c218c7e2afb1b8df2eb0e107a05092af7b71aa6340e76ad1e312d6d1
3
+ size 5942079680
mistral-7b-v0.1-layla-v4-chatml-Q8_0.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:a25b45791a4da50e5b3f7553aa47d3934208d70b070f94be69ea6704e9e96ad4
3
- size 7695875488
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f6d5923012fe6c3bb4e4227abeaccb2cd36c6be91ed203222a98324646642c75
3
+ size 7695876160
mistral-7b-v0.1-layla-v4-chatml-f16.gguf CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:13ded28c54bcf3f04be75f89bffc5bef518da3dc454f7167ed17aa956605d8c1
3
- size 14484765024
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a66eba67a39de97fc0e48b566c5969c2447cce171a7f73b94029117f236e33df
3
+ size 14484765760