Commit
•
8dbe791
1
Parent(s):
1002b60
Upload folder using huggingface_hub
Browse files- .gitattributes +5 -35
- README.md +56 -0
- SkunkApe-14b-Q3_K_L.gguf +3 -0
- SkunkApe-14b-Q4_K_M.gguf +3 -0
- SkunkApe-14b-Q5_K_M.gguf +3 -0
- SkunkApe-14b-Q6_K.gguf +3 -0
- SkunkApe-14b-Q8_0.gguf +3 -0
- mergekit_config.yml +12 -0
- recipe.txt +50 -0
- sample.txt +52 -0
.gitattributes
CHANGED
@@ -1,35 +1,5 @@
|
|
1 |
-
|
2 |
-
|
3 |
-
|
4 |
-
|
5 |
-
|
6 |
-
*.ftz filter=lfs diff=lfs merge=lfs -text
|
7 |
-
*.gz filter=lfs diff=lfs merge=lfs -text
|
8 |
-
*.h5 filter=lfs diff=lfs merge=lfs -text
|
9 |
-
*.joblib filter=lfs diff=lfs merge=lfs -text
|
10 |
-
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
11 |
-
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
12 |
-
*.model filter=lfs diff=lfs merge=lfs -text
|
13 |
-
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
14 |
-
*.npy filter=lfs diff=lfs merge=lfs -text
|
15 |
-
*.npz filter=lfs diff=lfs merge=lfs -text
|
16 |
-
*.onnx filter=lfs diff=lfs merge=lfs -text
|
17 |
-
*.ot filter=lfs diff=lfs merge=lfs -text
|
18 |
-
*.parquet filter=lfs diff=lfs merge=lfs -text
|
19 |
-
*.pb filter=lfs diff=lfs merge=lfs -text
|
20 |
-
*.pickle filter=lfs diff=lfs merge=lfs -text
|
21 |
-
*.pkl filter=lfs diff=lfs merge=lfs -text
|
22 |
-
*.pt filter=lfs diff=lfs merge=lfs -text
|
23 |
-
*.pth filter=lfs diff=lfs merge=lfs -text
|
24 |
-
*.rar filter=lfs diff=lfs merge=lfs -text
|
25 |
-
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
26 |
-
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
27 |
-
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
28 |
-
*.tar filter=lfs diff=lfs merge=lfs -text
|
29 |
-
*.tflite filter=lfs diff=lfs merge=lfs -text
|
30 |
-
*.tgz filter=lfs diff=lfs merge=lfs -text
|
31 |
-
*.wasm filter=lfs diff=lfs merge=lfs -text
|
32 |
-
*.xz filter=lfs diff=lfs merge=lfs -text
|
33 |
-
*.zip filter=lfs diff=lfs merge=lfs -text
|
34 |
-
*.zst filter=lfs diff=lfs merge=lfs -text
|
35 |
-
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
|
|
1 |
+
SkunkApe-14b-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
|
2 |
+
SkunkApe-14b-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
3 |
+
SkunkApe-14b-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
|
4 |
+
SkunkApe-14b-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
|
5 |
+
SkunkApe-14b-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
README.md
ADDED
@@ -0,0 +1,56 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
license: cc-by-nc-4.0
|
3 |
+
language:
|
4 |
+
- en
|
5 |
+
tags:
|
6 |
+
- solar
|
7 |
+
---
|
8 |
+
# Skunk Ape 14b
|
9 |
+
|
10 |
+
![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/65a531bc7ec6af0f95c707b1/p9tbuezkb2qvf8kWEnO_2.jpeg)
|
11 |
+
|
12 |
+
This version performs *substantially* better than the 16b version.
|
13 |
+
|
14 |
+
This model is a merge of three self-merged Solar-based models in a 14b (64 layer) configuration. The result of
|
15 |
+
this "frankenmerge" is a medium-sized model that contains what I consider to be the best of the solar finetunes.
|
16 |
+
|
17 |
+
Mergefuel:
|
18 |
+
- Sao10K/Fimbulvetr-11B-v2
|
19 |
+
- Sao10K/Solstice-11B-v1
|
20 |
+
- TheDrummer/Moistral-11B-v1
|
21 |
+
|
22 |
+
This model is uncensored and capable of generating objectionable material. However, it is not an explicitely-NSFW model,
|
23 |
+
and it has never "gone rogue" and tried to insert NSFW content into SFW prompts in my experience. As with any LLM, no
|
24 |
+
factual claims made by the model should be taken at face value. You know that boilerplate safety disclaimer that most
|
25 |
+
professional models have? Assume this has it too. This model is for entertainment purposes only.
|
26 |
+
|
27 |
+
|
28 |
+
iMatrix GGUFs: https://huggingface.co/MarsupialAI/SkunkApe-14b_iMatrix_GGUF
|
29 |
+
|
30 |
+
|
31 |
+
# Sample output
|
32 |
+
|
33 |
+
```
|
34 |
+
{{[INPUT]}}
|
35 |
+
Write a detailed and humorous story about a cute and fluffy bunny that goes to a Gwar concert.
|
36 |
+
{{[OUTPUT]}}
|
37 |
+
Bobby was the softest, fluffiest, and cutest rabbit you had ever seen. His thick fur, bright eyes, and cuddly little face would make anyone who laid their eyes upon him just want to squeeze him and make him their best friend forever. But there was something no one knew about Bobby: he was a heavy metalhead at heart.
|
38 |
+
|
39 |
+
That Saturday morning, Bobby hopped out of his pen in his owners' backyard, excited for what the day had in store for him. Today, he was going on an adventure. Not just any adventure, but an epic heavy metal adventure. Today, he was going to see the mighty Gwar in concert. Ever since he first heard their music, Bobby knew he needed to experience their raw power live.
|
40 |
+
|
41 |
+
He hopped through the neighborhood and made his way towards town. He was so excited; his heart was beating like a double kick drum. Eventually, he got to the venue and found himself standing in line with a group of leather-clad headbangers. They took one look at this innocent looking bunny with a denim jacket, black band patches, and a Slayer baseball cap and began to laugh. Bobby didn’t mind; it just fueled his fire to prove these posers wrong.
|
42 |
+
|
43 |
+
A burly bouncer came up to Bobby as he approached the front of the line, "Um, buddy. No rabbits allowed."
|
44 |
+
|
45 |
+
<<<This goes on for a while. See sample.txt for full output>>>
|
46 |
+
```
|
47 |
+
|
48 |
+
|
49 |
+
# Prompt format
|
50 |
+
Prefers alpaca.
|
51 |
+
|
52 |
+
|
53 |
+
# Weird merge fuckery
|
54 |
+
According to Toasty Pigeon, FM, Akai, and probably others on the KAI discord, this merge method works better than a normal stacked merge.
|
55 |
+
I don't pretend to understand why, but the huge PPL improvement (5.96 for this model vs 7.65 for the 16b @ Q4km) indicates that they're right.
|
56 |
+
See recipe.txt for all the alchemy.
|
SkunkApe-14b-Q3_K_L.gguf
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:4f90967eeb2e4e388ad26d8e8402d0d11a0633fac3726d8169f0094598ab58f7
|
3 |
+
size 7479474816
|
SkunkApe-14b-Q4_K_M.gguf
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:6424630d16cac7756e131c63508a63ecc974eb3c7c1d1d5f080bfda7cd749ab7
|
3 |
+
size 8554896000
|
SkunkApe-14b-Q5_K_M.gguf
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:7a8c47edeb88a12c99583c43c9e03bcb0c5ce78fb50c3dfa7df99f67b5f77e73
|
3 |
+
size 10064452224
|
SkunkApe-14b-Q6_K.gguf
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:0405fb150749aeaecfb5b30e619130824e65c19c57ad63d9492373dc5c9e71e0
|
3 |
+
size 11668355712
|
SkunkApe-14b-Q8_0.gguf
ADDED
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
1 |
+
version https://git-lfs.github.com/spec/v1
|
2 |
+
oid sha256:0f86caba4f02157dd501bebdd7835df95f17f99d5ef3490cbd88cf725414f80f
|
3 |
+
size 15112452736
|
mergekit_config.yml
ADDED
@@ -0,0 +1,12 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
models:
|
2 |
+
- model: f:\raw\fimbul14
|
3 |
+
parameters:
|
4 |
+
weight: 1.0
|
5 |
+
- model: f:\raw\moist14
|
6 |
+
parameters:
|
7 |
+
weight: 1.0
|
8 |
+
- model: f:\raw\solstice14
|
9 |
+
parameters:
|
10 |
+
weight: 1.0
|
11 |
+
merge_method: linear
|
12 |
+
dtype: float16
|
recipe.txt
ADDED
@@ -0,0 +1,50 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
Merge recipe
|
2 |
+
|
3 |
+
|
4 |
+
Stack A1
|
5 |
+
solstice [0, 40]
|
6 |
+
solstice [24, 48]
|
7 |
+
|
8 |
+
Stack A2
|
9 |
+
solstice [0, 24]
|
10 |
+
solstice [8, 48]
|
11 |
+
|
12 |
+
MergeA
|
13 |
+
A1 weight: [1, 1, 1, 1, 0.5, 0, 0, 0, 0]
|
14 |
+
A2 weight: [0, 0, 0, 0, 0.5, 1, 1, 1, 1]
|
15 |
+
merge_method: linear
|
16 |
+
|
17 |
+
|
18 |
+
Stack B1
|
19 |
+
fimbulvetr [0, 40]
|
20 |
+
fimbulvetr [24, 48]
|
21 |
+
|
22 |
+
Stack B2
|
23 |
+
fimbulvetr [0, 24]
|
24 |
+
fimbulvetr [8, 48]
|
25 |
+
|
26 |
+
MergeB
|
27 |
+
B1 weight: [1, 1, 1, 1, 0.5, 0, 0, 0, 0]
|
28 |
+
B2 weight: [0, 0, 0, 0, 0.5, 1, 1, 1, 1]
|
29 |
+
merge_method: linear
|
30 |
+
|
31 |
+
|
32 |
+
Stack C1
|
33 |
+
moistral [0, 40]
|
34 |
+
moistral [24, 48]
|
35 |
+
|
36 |
+
Stack C2
|
37 |
+
moistral [0, 24]
|
38 |
+
moistral [8, 48]
|
39 |
+
|
40 |
+
MergeC
|
41 |
+
C1 weight: [1, 1, 1, 1, 0.5, 0, 0, 0, 0]
|
42 |
+
C2 weight: [0, 0, 0, 0, 0.5, 1, 1, 1, 1]
|
43 |
+
merge_method: linear
|
44 |
+
|
45 |
+
|
46 |
+
Final merge
|
47 |
+
MergeA weight: 1.0
|
48 |
+
MergeB weight: 1.0
|
49 |
+
MergeC weight: 1.0
|
50 |
+
merge_method: linear
|
sample.txt
ADDED
@@ -0,0 +1,52 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
{{[INPUT]}}
|
2 |
+
Write a detailed and humorous story about a cute and fluffy bunny that goes to a Gwar concert.
|
3 |
+
{{[OUTPUT]}}
|
4 |
+
Bobby was the softest, fluffiest, and cutest rabbit you had ever seen. His thick fur, bright eyes, and cuddly little face would make anyone who laid their eyes upon him just want to squeeze him and make him their best friend forever. But there was something no one knew about Bobby: he was a heavy metalhead at heart.
|
5 |
+
|
6 |
+
That Saturday morning, Bobby hopped out of his pen in his owners' backyard, excited for what the day had in store for him. Today, he was going on an adventure. Not just any adventure, but an epic heavy metal adventure. Today, he was going to see the mighty Gwar in concert. Ever since he first heard their music, Bobby knew he needed to experience their raw power live.
|
7 |
+
|
8 |
+
He hopped through the neighborhood and made his way towards town. He was so excited; his heart was beating like a double kick drum. Eventually, he got to the venue and found himself standing in line with a group of leather-clad headbangers. They took one look at this innocent looking bunny with a denim jacket, black band patches, and a Slayer baseball cap and began to laugh. Bobby didn’t mind; it just fueled his fire to prove these posers wrong.
|
9 |
+
|
10 |
+
A burly bouncer came up to Bobby as he approached the front of the line, "Um, buddy. No rabbits allowed."
|
11 |
+
|
12 |
+
"Listen," Bobby replied, attempting to sound as menacing as a rabbit could, "Gwar doesn't care what species you are. They embrace us all."
|
13 |
+
|
14 |
+
The bouncer thought for a moment before relenting. “Alright, you got spunk. Get in line."
|
15 |
+
|
16 |
+
Bobby cheered internally, then realized that it probably sounded more like a cute little bunny hop. Still, it didn't matter to him. Once inside the concert hall, he could hardly contain his excitement. The air was thick with cigarette smoke, sweat, and anticipation. As Bobby pushed his way further into the crowd, the opening band finally took the stage.
|
17 |
+
|
18 |
+
Bobby watched intently from his spot near the back, headbanging along to their crushing riffs. A mosh pit opened up right in front of him. Suddenly, Bobby felt a rush of adrenaline and dove right in. He was small enough to dodge all the flying fists and feet. Instead, he made a point to bash his head against everyone’s shins as they stomped by. The bass shook his entire body, sending vibrations through his tiny frame. It felt amazing.
|
19 |
+
|
20 |
+
After a few more songs, the opening band finished their set, leaving the stage in shambles. The crowd roared for Gwar. Soon enough, a thick fog covered the stage, and the intro music started to play. Bobby screamed along to the lyrics, feeling a surge of electricity run through his veins. As the music reached its crescendo, Gwar emerged from the haze, covered in gore and brandishing their oversized instruments.
|
21 |
+
|
22 |
+
As soon as the first note rang out, Bobby lost it. He threw himself into the crowd and began thrashing about wildly, bashing his little head against everyone within reach. His Slayer baseball cap went flying off, but he didn't care. He was in the midst of a metal circus of blood, sweat, and pure energy.
|
23 |
+
|
24 |
+
Gwar played hit after hit, interspersed with hilarious jokes and stories. They even brought fans up on stage to take part in their sick rituals, but it seemed Bobby was too small to be noticed. That is, until the end of the show when lead singer Oderus Urungus announced, "For our final act of debauchery tonight, we are going to unleash an animal from the pit."
|
25 |
+
|
26 |
+
Bobby's heart leapt with excitement. Surely they had him in mind. True enough, one of the band members snatched him up from the crowd and hoisted him onto the stage. The entire room cheered. Bobby felt like a god as he stood there, soaking up the adoration of the audience.
|
27 |
+
|
28 |
+
Oderus smiled down at Bobby and asked, "What is your name, my friend?"
|
29 |
+
|
30 |
+
"I'm Bobby," he shouted back, "and I came here for one reason: METAL!"
|
31 |
+
|
32 |
+
The crowd erupted in laughter and applause. Gwar began to play their classic track, "Sick of Society." Bobby started headbanging again, feeling invincible. Then, out of nowhere, Oderus grabbed a chainsaw and revved its engine.
|
33 |
+
|
34 |
+
Bobby panicked as he realized his fate. This was it; he was about to die for metal. He closed his eyes, preparing to become a martyr. As the chainsaw approached his fluffy neck...
|
35 |
+
|
36 |
+
*SNIP SNIP*
|
37 |
+
|
38 |
+
Instead of hearing the sickening sound of steel on fur, the crowd laughed as a long piece of Bobby's tail fell to the stage. Oderus held it triumphantly, showing it off to the crowd. Bobby's eyes widened in shock but tried not to show it. This was the price he had to pay for his devotion.
|
39 |
+
|
40 |
+
Gwar finished the song, dousing Bobby in fake blood, and tossed him back into the crowd. Bobby stood there, wet, half-tailed, and happier than ever. He'd finally achieved his goal and didn't care if he had to walk home naked.
|
41 |
+
|
42 |
+
As he hopped towards the exit, he overheard some fans behind him talking.
|
43 |
+
|
44 |
+
"Dude, what the hell was that?"
|
45 |
+
|
46 |
+
"A live bunny, dude! He went wild during the mosh."
|
47 |
+
|
48 |
+
"No way. That's gotta be a stunt."
|
49 |
+
|
50 |
+
Bobby smirked to himself, knowing they couldn't possibly understand the lengths he would go for metal. As he hopped through town and back towards home, he felt more fulfilled than ever. After all, in the world of heavy metal, nobody gave a fuck if you were a bunny. He'd found his family, and nothing could take that away from him.
|
51 |
+
|
52 |
+
The next day, Bobby's owners found him at the backdoor, dirty and half-tailed. They scooped him up and brought him inside. But he just looked at them with a content smile, knowing that he’d already experienced something most rabbits wouldn’t even dream of.
|