Hugging Face's logo

Clevyby
/
Moistral-11B-v3-Q5_K_S-GGUF-iMatrix

Text Generation
Transformers
GGUF
llama
Not-For-All-Audiences
Model card Files Community
Clevyby MarsupialAI commited on
Commit
fc22d41
·
verified ·
0 Parent(s):

Duplicate from MarsupialAI/Moistral-11B-v3_iMatrix_GGUF

Browse files

Co-authored-by: Nonya Biznez <MarsupialAI@users.noreply.huggingface.co>

Files changed (17) hide show
  1. .gitattributes +49 -0
  2. Moistral-11B-v3_Q3km.gguf +3 -0
  3. Moistral-11B-v3_Q4km.gguf +3 -0
  4. Moistral-11B-v3_Q4ks.gguf +3 -0
  5. Moistral-11B-v3_Q5km.gguf +3 -0
  6. Moistral-11B-v3_Q5ks.gguf +3 -0
  7. Moistral-11B-v3_Q6k.gguf +3 -0
  8. Moistral-11B-v3_Q8.gguf +3 -0
  9. Moistral-11B-v3_fp16.gguf +3 -0
  10. Moistral-11B-v3_iQ2m.gguf +3 -0
  11. Moistral-11B-v3_iQ2xxs.gguf +3 -0
  12. Moistral-11B-v3_iQ3m.gguf +3 -0
  13. Moistral-11B-v3_iQ3xxs.gguf +3 -0
  14. Moistral-11B-v3_iQ4nl.gguf +3 -0
  15. Moistral-11B-v3_iQ4xs.gguf +3 -0
  16. README.md +11 -0
  17. groups_merged.txt +0 -0
.gitattributes ADDED
@@ -0,0 +1,49 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ *.7z filter=lfs diff=lfs merge=lfs -text
2
+ *.arrow filter=lfs diff=lfs merge=lfs -text
3
+ *.bin filter=lfs diff=lfs merge=lfs -text
4
+ *.bz2 filter=lfs diff=lfs merge=lfs -text
5
+ *.ckpt filter=lfs diff=lfs merge=lfs -text
6
+ *.ftz filter=lfs diff=lfs merge=lfs -text
7
+ *.gz filter=lfs diff=lfs merge=lfs -text
8
+ *.h5 filter=lfs diff=lfs merge=lfs -text
9
+ *.joblib filter=lfs diff=lfs merge=lfs -text
10
+ *.lfs.* filter=lfs diff=lfs merge=lfs -text
11
+ *.mlmodel filter=lfs diff=lfs merge=lfs -text
12
+ *.model filter=lfs diff=lfs merge=lfs -text
13
+ *.msgpack filter=lfs diff=lfs merge=lfs -text
14
+ *.npy filter=lfs diff=lfs merge=lfs -text
15
+ *.npz filter=lfs diff=lfs merge=lfs -text
16
+ *.onnx filter=lfs diff=lfs merge=lfs -text
17
+ *.ot filter=lfs diff=lfs merge=lfs -text
18
+ *.parquet filter=lfs diff=lfs merge=lfs -text
19
+ *.pb filter=lfs diff=lfs merge=lfs -text
20
+ *.pickle filter=lfs diff=lfs merge=lfs -text
21
+ *.pkl filter=lfs diff=lfs merge=lfs -text
22
+ *.pt filter=lfs diff=lfs merge=lfs -text
23
+ *.pth filter=lfs diff=lfs merge=lfs -text
24
+ *.rar filter=lfs diff=lfs merge=lfs -text
25
+ *.safetensors filter=lfs diff=lfs merge=lfs -text
26
+ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
27
+ *.tar.* filter=lfs diff=lfs merge=lfs -text
28
+ *.tar filter=lfs diff=lfs merge=lfs -text
29
+ *.tflite filter=lfs diff=lfs merge=lfs -text
30
+ *.tgz filter=lfs diff=lfs merge=lfs -text
31
+ *.wasm filter=lfs diff=lfs merge=lfs -text
32
+ *.xz filter=lfs diff=lfs merge=lfs -text
33
+ *.zip filter=lfs diff=lfs merge=lfs -text
34
+ *.zst filter=lfs diff=lfs merge=lfs -text
35
+ *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ Moistral-11B-v3_fp16.gguf filter=lfs diff=lfs merge=lfs -text
37
+ Moistral-11B-v3_Q3km.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Moistral-11B-v3_Q4km.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Moistral-11B-v3_Q4ks.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Moistral-11B-v3_Q5km.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Moistral-11B-v3_Q5ks.gguf filter=lfs diff=lfs merge=lfs -text
42
+ Moistral-11B-v3_Q6k.gguf filter=lfs diff=lfs merge=lfs -text
43
+ Moistral-11B-v3_Q8.gguf filter=lfs diff=lfs merge=lfs -text
44
+ Moistral-11B-v3_iQ2xxs.gguf filter=lfs diff=lfs merge=lfs -text
45
+ Moistral-11B-v3_iQ2m.gguf filter=lfs diff=lfs merge=lfs -text
46
+ Moistral-11B-v3_iQ3xxs.gguf filter=lfs diff=lfs merge=lfs -text
47
+ Moistral-11B-v3_iQ3m.gguf filter=lfs diff=lfs merge=lfs -text
48
+ Moistral-11B-v3_iQ4xs.gguf filter=lfs diff=lfs merge=lfs -text
49
+ Moistral-11B-v3_iQ4nl.gguf filter=lfs diff=lfs merge=lfs -text
Moistral-11B-v3_Q3km.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6fde3bcf73fc9257f5cddf88e1a92096214bf2df11ed42804d3dd806ca6038e6
3
+ size 5195667648
Moistral-11B-v3_Q4km.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:73749dd5b0ec9463a83554416dce5fbfbd80f233e85cfb28a4e900894089a28b
3
+ size 6461667520
Moistral-11B-v3_Q4ks.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:10ab53e55390e69827ae2c9f1ac33739316bb4930585609e661f9b617460b075
3
+ size 6118521024
Moistral-11B-v3_Q5km.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cb7df3a9d8669c40eaaed7ed75ba2d62dc49d91717cef4023bf8e284cf9e2006
3
+ size 7597930688
Moistral-11B-v3_Q5ks.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d1cbe77cfd09e3a36d558c69b0f57e38f3e671c96336dda12d44d180ff2af731
3
+ size 7397390528
Moistral-11B-v3_Q6k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:904f62bb5f0845cfc17a3156a65914b2199f9d64163eddeec9436e0b232076ad
3
+ size 8805210304
Moistral-11B-v3_Q8.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a48158bd12b63b1f53827c4f82adb21c26e58ebd95674252c837ad3394c02558
3
+ size 11404155072
Moistral-11B-v3_fp16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e050a86405c8a99b7d8c38862d55b2611d5f533efa9db0d017e78dd5a3d01ffe
3
+ size 21464586368
Moistral-11B-v3_iQ2m.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:13f9382c701c83d87aa5040db3b48bb60916d5f9a3c7bfb0ffcfd2f014a51aa2
3
+ size 3677485248
Moistral-11B-v3_iQ2xxs.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a9524ea1dc338a3fbc0f2ec81578d0cf6b88b1def442b3a3729ed510a62da059
3
+ size 2920601792
Moistral-11B-v3_iQ3m.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2a6c3045d64f3737034b48d67253dc9e5608f36e1839946c5ceb522ce3741d9e
3
+ size 4845050048
Moistral-11B-v3_iQ3xxs.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b599cea9e85cdc95b6e3a36bc1a04a4197458a71f55ab83acb2c4484928f0d4f
3
+ size 4167432384
Moistral-11B-v3_iQ4nl.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2382295b9d914eee3c9a462eb51863226f0b7f7bf425785c41888ef5b856ffb0
3
+ size 6097549504
Moistral-11B-v3_iQ4xs.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:91b2eaa69cc69489429a5f97e76a9f07a588fbbe3451d237b9762f35c047516a
3
+ size 5772589248
README.md ADDED
@@ -0,0 +1,11 @@
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: other
3
+ license_name: freeuse
4
+ license_link: LICENSE
5
+ tags:
6
+ - not-for-all-audiences
7
+ ---
8
+
9
+ GGUFs for Moistral v3 - https://huggingface.co/TheDrummer/Moistral-11B-v3
10
+
11
+ iMatrix generated using Kalomaze's groups_merged.txt
groups_merged.txt ADDED
The diff for this file is too large to render. See raw diff