Hugging Face's logo

DavidAU
/
L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B-GGUF

Text Generation
Transformers
GGUF
English
mergekit
Mixture of Experts
mixture of experts
Merge
8x8B
Llama3 MOE
creative
creative writing
fiction writing
plot generation
sub-plot generation
story generation
scene continue
storytelling
fiction story
science fiction
romance
all genres
story
writing
vivid prosing
vivid writing
fiction
roleplaying
bfloat16
swearing
rp
horror
Inference Endpoints
conversational
Model card Files Community
2
DavidAU mradermacher commited on
Commit
27afb9d
•
0 Parent(s):

Duplicate from mradermacher/L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B-GGUF

Browse files

Co-authored-by: team mradermacher <mradermacher@users.noreply.huggingface.co>

Files changed (14) hide show
  1. .gitattributes +47 -0
  2. L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B.IQ4_XS.gguf +3 -0
  3. L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B.Q2_K.gguf +3 -0
  4. L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B.Q3_K_L.gguf +3 -0
  5. L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B.Q3_K_M.gguf +3 -0
  6. L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B.Q3_K_S.gguf +3 -0
  7. L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B.Q4_K_M.gguf +3 -0
  8. L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B.Q4_K_S.gguf +3 -0
  9. L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B.Q5_K_M.gguf +3 -0
  10. L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B.Q5_K_S.gguf +3 -0
  11. L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B.Q6_K.gguf +3 -0
  12. L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B.Q8_0.gguf.part1of2 +3 -0
  13. L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B.Q8_0.gguf.part2of2 +3 -0
  14. README.md +67 -0
.gitattributes ADDED
@@ -0,0 +1,47 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ *.7z filter=lfs diff=lfs merge=lfs -text
2
+ *.arrow filter=lfs diff=lfs merge=lfs -text
3
+ *.bin filter=lfs diff=lfs merge=lfs -text
4
+ *.bz2 filter=lfs diff=lfs merge=lfs -text
5
+ *.ckpt filter=lfs diff=lfs merge=lfs -text
6
+ *.ftz filter=lfs diff=lfs merge=lfs -text
7
+ *.gz filter=lfs diff=lfs merge=lfs -text
8
+ *.h5 filter=lfs diff=lfs merge=lfs -text
9
+ *.joblib filter=lfs diff=lfs merge=lfs -text
10
+ *.lfs.* filter=lfs diff=lfs merge=lfs -text
11
+ *.mlmodel filter=lfs diff=lfs merge=lfs -text
12
+ *.model filter=lfs diff=lfs merge=lfs -text
13
+ *.msgpack filter=lfs diff=lfs merge=lfs -text
14
+ *.npy filter=lfs diff=lfs merge=lfs -text
15
+ *.npz filter=lfs diff=lfs merge=lfs -text
16
+ *.onnx filter=lfs diff=lfs merge=lfs -text
17
+ *.ot filter=lfs diff=lfs merge=lfs -text
18
+ *.parquet filter=lfs diff=lfs merge=lfs -text
19
+ *.pb filter=lfs diff=lfs merge=lfs -text
20
+ *.pickle filter=lfs diff=lfs merge=lfs -text
21
+ *.pkl filter=lfs diff=lfs merge=lfs -text
22
+ *.pt filter=lfs diff=lfs merge=lfs -text
23
+ *.pth filter=lfs diff=lfs merge=lfs -text
24
+ *.rar filter=lfs diff=lfs merge=lfs -text
25
+ *.safetensors filter=lfs diff=lfs merge=lfs -text
26
+ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
27
+ *.tar.* filter=lfs diff=lfs merge=lfs -text
28
+ *.tar filter=lfs diff=lfs merge=lfs -text
29
+ *.tflite filter=lfs diff=lfs merge=lfs -text
30
+ *.tgz filter=lfs diff=lfs merge=lfs -text
31
+ *.wasm filter=lfs diff=lfs merge=lfs -text
32
+ *.xz filter=lfs diff=lfs merge=lfs -text
33
+ *.zip filter=lfs diff=lfs merge=lfs -text
34
+ *.zst filter=lfs diff=lfs merge=lfs -text
35
+ *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
37
+ L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
38
+ L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B.Q8_0.gguf.part1of2 filter=lfs diff=lfs merge=lfs -text
39
+ L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B.Q8_0.gguf.part2of2 filter=lfs diff=lfs merge=lfs -text
40
+ L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
41
+ L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
42
+ L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
43
+ L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
44
+ L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
45
+ L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
46
+ L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
47
+ L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B.IQ4_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a40ea6e390b8a5fac3f9f3620b16073e70a28e9b4e5e3ccade040d000372326e
3
+ size 25914114656
L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B.Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5168c3e723dac19a2b2096b3001cb4b024fbc217f804b7968e20fbdd8a2819cc
3
+ size 17771119200
L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B.Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4d0e63ff1df275d2c6e67ed51fc3afc64ec38880e435479f08fe8f403ff06909
3
+ size 24669577824
L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B.Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:910d9bf79bb85bbd4112f515ac7b7fafa44c71ad731b530fe46f9dcce53ba88d
3
+ size 23046382176
L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B.Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d927f93d03f8fd312c3379c3e08af8f4510ade2263991f764c3710a110d30c23
3
+ size 20932452960
L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B.Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:14d304f1a1f0c10ed85941c680fc155979b73b9c5477c6d6dc16d9ebeabe2e02
3
+ size 29000761952
L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B.Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d002e42fc7573fe1e88ebc717e6b53426ff06d00a22dd0d28d5f14219bd43ce9
3
+ size 27297874528
L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B.Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2f46deda3023f7e7d69d1c3700c1b036d38f10e2767638c1585d8ff01a97e5ba
3
+ size 33831158368
L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B.Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5b79af87f3b22747cbf0220f0ea53b75bff39095f78ba7194c965d3185d79ad5
3
+ size 32832914016
L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B.Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:492cc949db22f0ad063717f4e2167b97c6125e26884a89a4cfbef6a03fd51ef6
3
+ size 39034757728
L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B.Q8_0.gguf.part1of2 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0c93e819e9154b082fb6c9078df6051cb4323571844dd95ce211fbaff5a24dc7
3
+ size 25769803776
L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B.Q8_0.gguf.part2of2 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b5044c48b097b79f2e12a236c772b992a2b2ad5bd48d9b34814454e09a1d97df
3
+ size 24701428320
README.md ADDED
@@ -0,0 +1,67 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: DavidAU/L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B
3
+ language:
4
+ - en
5
+ library_name: transformers
6
+ quantized_by: mradermacher
7
+ tags:
8
+ - mergekit
9
+ - moe
10
+ - mixture of experts
11
+ - merge
12
+ ---
13
+ ## About
14
+
15
+ <!-- ### quantize_version: 2 -->
16
+ <!-- ### output_tensor_quantised: 1 -->
17
+ <!-- ### convert_type: hf -->
18
+ <!-- ### vocab_type: -->
19
+ <!-- ### tags: -->
20
+ static quants of https://huggingface.co/DavidAU/L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B
21
+
22
+ <!-- provided-files -->
23
+ weighted/imatrix quants are available at https://huggingface.co/mradermacher/L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B-i1-GGUF
24
+ ## Usage
25
+
26
+ If you are unsure how to use GGUF files, refer to one of [TheBloke's
27
+ READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
28
+ more details, including on how to concatenate multi-part files.
29
+
30
+ ## Provided Quants
31
+
32
+ (sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
33
+
34
+ | Link | Type | Size/GB | Notes |
35
+ |:-----|:-----|--------:|:------|
36
+ | [GGUF](https://huggingface.co/mradermacher/L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B-GGUF/resolve/main/L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B.Q2_K.gguf) | Q2_K | 17.9 | |
37
+ | [GGUF](https://huggingface.co/mradermacher/L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B-GGUF/resolve/main/L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B.Q3_K_S.gguf) | Q3_K_S | 21.0 | |
38
+ | [GGUF](https://huggingface.co/mradermacher/L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B-GGUF/resolve/main/L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B.Q3_K_M.gguf) | Q3_K_M | 23.1 | lower quality |
39
+ | [GGUF](https://huggingface.co/mradermacher/L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B-GGUF/resolve/main/L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B.Q3_K_L.gguf) | Q3_K_L | 24.8 | |
40
+ | [GGUF](https://huggingface.co/mradermacher/L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B-GGUF/resolve/main/L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B.IQ4_XS.gguf) | IQ4_XS | 26.0 | |
41
+ | [GGUF](https://huggingface.co/mradermacher/L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B-GGUF/resolve/main/L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B.Q4_K_S.gguf) | Q4_K_S | 27.4 | fast, recommended |
42
+ | [GGUF](https://huggingface.co/mradermacher/L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B-GGUF/resolve/main/L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B.Q4_K_M.gguf) | Q4_K_M | 29.1 | fast, recommended |
43
+ | [GGUF](https://huggingface.co/mradermacher/L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B-GGUF/resolve/main/L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B.Q5_K_S.gguf) | Q5_K_S | 32.9 | |
44
+ | [GGUF](https://huggingface.co/mradermacher/L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B-GGUF/resolve/main/L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B.Q5_K_M.gguf) | Q5_K_M | 33.9 | |
45
+ | [GGUF](https://huggingface.co/mradermacher/L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B-GGUF/resolve/main/L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B.Q6_K.gguf) | Q6_K | 39.1 | very good quality |
46
+ | [PART 1](https://huggingface.co/mradermacher/L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B-GGUF/resolve/main/L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B.Q8_0.gguf.part1of2) [PART 2](https://huggingface.co/mradermacher/L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B-GGUF/resolve/main/L3-MOE-8X8B-Dark-Planet-8D-Mirrored-Chaos-47B.Q8_0.gguf.part2of2) | Q8_0 | 50.6 | fast, best quality |
47
+
48
+ Here is a handy graph by ikawrakow comparing some lower-quality quant
49
+ types (lower is better):
50
+
51
+ ![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
52
+
53
+ And here are Artefact2's thoughts on the matter:
54
+ https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
55
+
56
+ ## FAQ / Model Request
57
+
58
+ See https://huggingface.co/mradermacher/model_requests for some answers to
59
+ questions you might have and/or if you want some other model quantized.
60
+
61
+ ## Thanks
62
+
63
+ I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
64
+ me use its servers and providing upgrades to my workstation to enable
65
+ this work in my free time.
66
+
67
+ <!-- end -->