Text Generation
Transformers
GGUF
English
mergekit
Mixture of Experts
mixture of experts
Merge
4x8B
Llama3 MOE
creative
creative writing
fiction writing
plot generation
sub-plot generation
story generation
scene continue
storytelling
fiction story
science fiction
romance
all genres
story
writing
vivid prosing
vivid writing
fiction
roleplaying
bfloat16
swearing
rp
horror
Inference Endpoints
conversational
Commit
•
3a2b269
0
Parent(s):
Duplicate from mradermacher/L3-MOE-4x8B-Dark-Planet-Rebel-FURY-25B-GGUF
Browse filesCo-authored-by: team mradermacher <mradermacher@users.noreply.huggingface.co>
- .gitattributes +46 -0
- L3-MOE-4x8B-Dark-Planet-Rebel-FURY-25B.IQ4_XS.gguf +3 -0
- L3-MOE-4x8B-Dark-Planet-Rebel-FURY-25B.Q2_K.gguf +3 -0
- L3-MOE-4x8B-Dark-Planet-Rebel-FURY-25B.Q3_K_L.gguf +3 -0
- L3-MOE-4x8B-Dark-Planet-Rebel-FURY-25B.Q3_K_M.gguf +3 -0
- L3-MOE-4x8B-Dark-Planet-Rebel-FURY-25B.Q3_K_S.gguf +3 -0
- L3-MOE-4x8B-Dark-Planet-Rebel-FURY-25B.Q4_K_M.gguf +3 -0
- L3-MOE-4x8B-Dark-Planet-Rebel-FURY-25B.Q4_K_S.gguf +3 -0
- L3-MOE-4x8B-Dark-Planet-Rebel-FURY-25B.Q5_K_M.gguf +3 -0
- L3-MOE-4x8B-Dark-Planet-Rebel-FURY-25B.Q5_K_S.gguf +3 -0
- L3-MOE-4x8B-Dark-Planet-Rebel-FURY-25B.Q6_K.gguf +3 -0
- L3-MOE-4x8B-Dark-Planet-Rebel-FURY-25B.Q8_0.gguf +3 -0
- README.md +66 -0
.gitattributes
ADDED
@@ -0,0 +1,46 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
*.7z filter=lfs diff=lfs merge=lfs -text
|
2 |
+
*.arrow filter=lfs diff=lfs merge=lfs -text
|
3 |
+
*.bin filter=lfs diff=lfs merge=lfs -text
|
4 |
+
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
5 |
+
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
6 |
+
*.ftz filter=lfs diff=lfs merge=lfs -text
|
7 |
+
*.gz filter=lfs diff=lfs merge=lfs -text
|
8 |
+
*.h5 filter=lfs diff=lfs merge=lfs -text
|
9 |
+
*.joblib filter=lfs diff=lfs merge=lfs -text
|
10 |
+
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
11 |
+
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
12 |
+
*.model filter=lfs diff=lfs merge=lfs -text
|
13 |
+
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
14 |
+
*.npy filter=lfs diff=lfs merge=lfs -text
|
15 |
+
*.npz filter=lfs diff=lfs merge=lfs -text
|
16 |
+
*.onnx filter=lfs diff=lfs merge=lfs -text
|
17 |
+
*.ot filter=lfs diff=lfs merge=lfs -text
|
18 |
+
*.parquet filter=lfs diff=lfs merge=lfs -text
|
19 |
+
*.pb filter=lfs diff=lfs merge=lfs -text
|
20 |
+
*.pickle filter=lfs diff=lfs merge=lfs -text
|
21 |
+
*.pkl filter=lfs diff=lfs merge=lfs -text
|
22 |
+
*.pt filter=lfs diff=lfs merge=lfs -text
|
23 |
+
*.pth filter=lfs diff=lfs merge=lfs -text
|
24 |
+
*.rar filter=lfs diff=lfs merge=lfs -text
|
25 |
+
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
26 |
+
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
27 |
+
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
28 |
+
*.tar filter=lfs diff=lfs merge=lfs -text
|
29 |
+
*.tflite filter=lfs diff=lfs merge=lfs -text
|
30 |
+
*.tgz filter=lfs diff=lfs merge=lfs -text
|
31 |
+
*.wasm filter=lfs diff=lfs merge=lfs -text
|
32 |
+
*.xz filter=lfs diff=lfs merge=lfs -text
|
33 |
+
*.zip filter=lfs diff=lfs merge=lfs -text
|
34 |
+
*.zst filter=lfs diff=lfs merge=lfs -text
|
35 |
+
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
36 |
+
L3-MOE-4x8B-Dark-Planet-Rebel-FURY-25B.Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
37 |
+
L3-MOE-4x8B-Dark-Planet-Rebel-FURY-25B.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
|
38 |
+
L3-MOE-4x8B-Dark-Planet-Rebel-FURY-25B.Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
39 |
+
L3-MOE-4x8B-Dark-Planet-Rebel-FURY-25B.Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
40 |
+
L3-MOE-4x8B-Dark-Planet-Rebel-FURY-25B.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
41 |
+
L3-MOE-4x8B-Dark-Planet-Rebel-FURY-25B.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
42 |
+
L3-MOE-4x8B-Dark-Planet-Rebel-FURY-25B.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
|
43 |
+
L3-MOE-4x8B-Dark-Planet-Rebel-FURY-25B.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
44 |
+
L3-MOE-4x8B-Dark-Planet-Rebel-FURY-25B.Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
|
45 |
+
L3-MOE-4x8B-Dark-Planet-Rebel-FURY-25B.Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
46 |
+
L3-MOE-4x8B-Dark-Planet-Rebel-FURY-25B.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
|
L3-MOE-4x8B-Dark-Planet-Rebel-FURY-25B.IQ4_XS.gguf
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:964f626ceb9a4ee6f778bdea4b5404861aa37238f8b437e3897cbfc6911ca19a
|
3 |
+
size 13580763744
|
L3-MOE-4x8B-Dark-Planet-Rebel-FURY-25B.Q2_K.gguf
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:d0eadc9093f2c5d9e28a6db312dcb2930717b701f22a47aa7c2661348d840b3f
|
3 |
+
size 9302819424
|
L3-MOE-4x8B-Dark-Planet-Rebel-FURY-25B.Q3_K_L.gguf
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:62413a5c9e20120cee6752ac0af0371d9e443f333b5db51e85c0e0ff04537a7f
|
3 |
+
size 13044015712
|
L3-MOE-4x8B-Dark-Planet-Rebel-FURY-25B.Q3_K_M.gguf
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:2e67906f8fe0868e63ae705e2b0b0628f267260f958dab8710509928c6d682fe
|
3 |
+
size 12080374368
|
L3-MOE-4x8B-Dark-Planet-Rebel-FURY-25B.Q3_K_S.gguf
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:f1f22179b0e3bcff49dad7b064e1fdeaba4f0eed06b444030503280a808d568b
|
3 |
+
size 10933232224
|
L3-MOE-4x8B-Dark-Planet-Rebel-FURY-25B.Q4_K_M.gguf
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:f6a509fb352799ea33bcf70116a28694f8bc9eae904769ae07a75e51157a7394
|
3 |
+
size 15162180192
|
L3-MOE-4x8B-Dark-Planet-Rebel-FURY-25B.Q4_K_S.gguf
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:6ce8c403a861c0e6991c0ed0b89cd950f12252c372d82328893b5d7ecc2d9726
|
3 |
+
size 14295532128
|
L3-MOE-4x8B-Dark-Planet-Rebel-FURY-25B.Q5_K_M.gguf
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:a1c7852394ab89c87ffd57e886e721b82086ad38080182c2a156bff5b207870b
|
3 |
+
size 17736041056
|
L3-MOE-4x8B-Dark-Planet-Rebel-FURY-25B.Q5_K_S.gguf
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:2eab3d41b989f0f73504111000b374bf66b57241392842073cd5b605a8187719
|
3 |
+
size 17228005984
|
L3-MOE-4x8B-Dark-Planet-Rebel-FURY-25B.Q6_K.gguf
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:aad41a459c8d9861c50ea25134fdc9add3e0a10eeef52814a808722823b302a9
|
3 |
+
size 20470768224
|
L3-MOE-4x8B-Dark-Planet-Rebel-FURY-25B.Q8_0.gguf
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:93a6002032c137592ecff200fea7494afa301840c6ebe52ae43f559d196fd1f2
|
3 |
+
size 26511270496
|
README.md
ADDED
@@ -0,0 +1,66 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
base_model: DavidAU/L3-MOE-4x8B-Dark-Planet-Rebel-FURY-25B
|
3 |
+
language:
|
4 |
+
- en
|
5 |
+
library_name: transformers
|
6 |
+
quantized_by: mradermacher
|
7 |
+
tags:
|
8 |
+
- mergekit
|
9 |
+
- moe
|
10 |
+
- mixture of experts
|
11 |
+
- merge
|
12 |
+
---
|
13 |
+
## About
|
14 |
+
|
15 |
+
<!-- ### quantize_version: 2 -->
|
16 |
+
<!-- ### output_tensor_quantised: 1 -->
|
17 |
+
<!-- ### convert_type: hf -->
|
18 |
+
<!-- ### vocab_type: -->
|
19 |
+
<!-- ### tags: -->
|
20 |
+
static quants of https://huggingface.co/DavidAU/L3-MOE-4x8B-Dark-Planet-Rebel-FURY-25B
|
21 |
+
|
22 |
+
<!-- provided-files -->
|
23 |
+
weighted/imatrix quants seem not to be available (by me) at this time. If they do not show up a week or so after the static ones, I have probably not planned for them. Feel free to request them by opening a Community Discussion.
|
24 |
+
## Usage
|
25 |
+
|
26 |
+
If you are unsure how to use GGUF files, refer to one of [TheBloke's
|
27 |
+
READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
|
28 |
+
more details, including on how to concatenate multi-part files.
|
29 |
+
|
30 |
+
## Provided Quants
|
31 |
+
|
32 |
+
(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
|
33 |
+
|
34 |
+
| Link | Type | Size/GB | Notes |
|
35 |
+
|:-----|:-----|--------:|:------|
|
36 |
+
| [GGUF](https://huggingface.co/mradermacher/L3-MOE-4x8B-Dark-Planet-Rebel-FURY-25B-GGUF/resolve/main/L3-MOE-4x8B-Dark-Planet-Rebel-FURY-25B.Q2_K.gguf) | Q2_K | 9.4 | |
|
37 |
+
| [GGUF](https://huggingface.co/mradermacher/L3-MOE-4x8B-Dark-Planet-Rebel-FURY-25B-GGUF/resolve/main/L3-MOE-4x8B-Dark-Planet-Rebel-FURY-25B.Q3_K_S.gguf) | Q3_K_S | 11.0 | |
|
38 |
+
| [GGUF](https://huggingface.co/mradermacher/L3-MOE-4x8B-Dark-Planet-Rebel-FURY-25B-GGUF/resolve/main/L3-MOE-4x8B-Dark-Planet-Rebel-FURY-25B.Q3_K_M.gguf) | Q3_K_M | 12.2 | lower quality |
|
39 |
+
| [GGUF](https://huggingface.co/mradermacher/L3-MOE-4x8B-Dark-Planet-Rebel-FURY-25B-GGUF/resolve/main/L3-MOE-4x8B-Dark-Planet-Rebel-FURY-25B.Q3_K_L.gguf) | Q3_K_L | 13.1 | |
|
40 |
+
| [GGUF](https://huggingface.co/mradermacher/L3-MOE-4x8B-Dark-Planet-Rebel-FURY-25B-GGUF/resolve/main/L3-MOE-4x8B-Dark-Planet-Rebel-FURY-25B.Q4_K_S.gguf) | Q4_K_S | 14.4 | fast, recommended |
|
41 |
+
| [GGUF](https://huggingface.co/mradermacher/L3-MOE-4x8B-Dark-Planet-Rebel-FURY-25B-GGUF/resolve/main/L3-MOE-4x8B-Dark-Planet-Rebel-FURY-25B.Q4_K_M.gguf) | Q4_K_M | 15.3 | fast, recommended |
|
42 |
+
| [GGUF](https://huggingface.co/mradermacher/L3-MOE-4x8B-Dark-Planet-Rebel-FURY-25B-GGUF/resolve/main/L3-MOE-4x8B-Dark-Planet-Rebel-FURY-25B.Q5_K_S.gguf) | Q5_K_S | 17.3 | |
|
43 |
+
| [GGUF](https://huggingface.co/mradermacher/L3-MOE-4x8B-Dark-Planet-Rebel-FURY-25B-GGUF/resolve/main/L3-MOE-4x8B-Dark-Planet-Rebel-FURY-25B.Q5_K_M.gguf) | Q5_K_M | 17.8 | |
|
44 |
+
| [GGUF](https://huggingface.co/mradermacher/L3-MOE-4x8B-Dark-Planet-Rebel-FURY-25B-GGUF/resolve/main/L3-MOE-4x8B-Dark-Planet-Rebel-FURY-25B.Q6_K.gguf) | Q6_K | 20.6 | very good quality |
|
45 |
+
| [GGUF](https://huggingface.co/mradermacher/L3-MOE-4x8B-Dark-Planet-Rebel-FURY-25B-GGUF/resolve/main/L3-MOE-4x8B-Dark-Planet-Rebel-FURY-25B.Q8_0.gguf) | Q8_0 | 26.6 | fast, best quality |
|
46 |
+
|
47 |
+
Here is a handy graph by ikawrakow comparing some lower-quality quant
|
48 |
+
types (lower is better):
|
49 |
+
|
50 |
+
![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
|
51 |
+
|
52 |
+
And here are Artefact2's thoughts on the matter:
|
53 |
+
https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
|
54 |
+
|
55 |
+
## FAQ / Model Request
|
56 |
+
|
57 |
+
See https://huggingface.co/mradermacher/model_requests for some answers to
|
58 |
+
questions you might have and/or if you want some other model quantized.
|
59 |
+
|
60 |
+
## Thanks
|
61 |
+
|
62 |
+
I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
|
63 |
+
me use its servers and providing upgrades to my workstation to enable
|
64 |
+
this work in my free time.
|
65 |
+
|
66 |
+
<!-- end -->
|