This repo contains the full precision source code, in "safe tensors" format to generate GGUFs, GPTQ, EXL2, AWQ, HQQ and other formats. The source code can also be used directly.
2 example generations with prompts (of 2 gens each) at the bottom of this page.
NOTE: Links to GGUFs below.
Evolved "Dark Planet" Model X 4 - "Rising"
This model is based on the original "Llama 3 Dark Planet 8B" (GGUF / SOURCE) merge that has been "evolved" several times. Each "evolved" version is then tested, if it is unique and/or removes certain negative attibutes and/or enhances certain positive attibutes, it is kept otherwise it is deleted.
This model contains the four ("cr2","cr1","r7", "r6" ) best models from this process, with the very best as a "captain" of the "MOE" so to speak.
None of these versions have ever been released, but contain the "raw source DNA" of the original model.
This process was first explored in the WORDSTORM Project
This model contains FOUR different 8B Dark Planets models that have never been released in a MOE model at 25B, equal to 4X8B - 32B parameters.
SIDE NOTE:
Uusually a "MOE" is constructed with different models, to give the "moe model" some of the best of each (or not) during generation.
I felt turning this concept on its head was better for creative use cases.
I.E:
All the "chefs" in the kitchen went to the same elite cooking school, got the highest marks, and now all work together to make the very best "dish of tokens" they can every time.
POWER UP? or DOWN?
You can change the number of experts (models) activated inside many LLM/AI apps.
Turning it up increases quality, nuance and depth but at the same time the tokens per second drops accordingly.
You can use 1 expert for "draft mode", and then move up in experts to get to final draft.
Also note instruction following will also increase as you up the number of experts too.
Quant choice will also affect overall quality => higher is better, however even at the lowest quant level, this model will perform strongly.
MOE SPECIFIC NOTES:
If you want to change the "default" number of experts set, modify the "config.json" :
"num_experts_per_tok": 2,
The user will still be able to modify it, if the LLM/AI app has the setting option to do this.
Each time you add/subtract an expert the token per second speed will change.
( this model is set at 2 out of 4 experts active, more experts => greater quality. )
IMPORTANT: Highest Quality Settings / Optimal Operation Guide / Parameters and Samplers
If you are going to use this model, (source, GGUF or a different quant), please review this document for critical parameter, sampler and advance sampler settings (for multiple AI/LLM aps).
This a "Class 1" (settings will enhance operation) model:
For all settings used for this model (including specifics for its "class"), including example generation(s) and for advanced settings guide (which many times addresses any model issue(s)), including methods to improve model performance for all use case(s) as well as chat, roleplay and other use case(s) (especially for use case(s) beyond the model's design) please see:
REASON:
Regardless of "model class" this document will detail methods to enhance operations.
If the model is a Class 3/4 model the default settings (parameters, samplers, advanced samplers) must be set for "use case(s)" uses correctly. Some AI/LLM apps DO NOT have consistant default setting(s) which result in sub-par model operation. Like wise for Class 3/4 models (which operate somewhat to very differently than standard models) additional samplers and advanced samplers settings are required to "smooth out" operation, AND/OR also allow full operation for use cases the model was not designed for.
BONUS - Use these settings for ANY model, ANY repo, ANY quant (including source/full precision):
This document also details parameters, sampler and advanced samplers that can be use FOR ANY MODEL, FROM ANY REPO too - all quants, and of course source code operation too - to enhance the operation of any model.
NOTE:
I strongly suggest you also visit the DavidAU GGUF (below) repo too for more details in using this model ; especially if it is "Class 3" or "Class 4" to get maximum performance from the model.
For full information about this model, including:
Please go to:
[ https://huggingface.co/DavidAU/L3-MOE-4x8B-Dark-Planet-Rising-25B-GGUF ]
Quants by Team "Mradermacher":
GGUFS:
[ https://huggingface.co/mradermacher/L3-MOE-4x8B-Dark-Planet-Rising-25B-GGUF ]
IMATRIX GGUFS:
[ https://huggingface.co/mradermacher/L3-MOE-4x8B-Dark-Planet-Rising-25B-i1-GGUF ]
Example Generations at GGUF Q4_K_S (mid level for gguf)
NSFW - Swearing, horror, gore, intense.
Prompt in "BOLD".
Using the following "story idea" below, write the first scene in the novel introducing the young woman. This scene should start in the middle of the action, include dialog, vivid passages, and end on a cliffhanger relevant to the story idea but it should also be unexpected. The scene should be 1000 words long and escalate in conflict and suspense and be written in first person, present tense with the point of view character being the young woman. The pov character will CURSE AND SWEAR, and generally have a "filthy" mouth.
Story idea: In a world ruled by dictatorship, a rebel young woman leads a rebellion against the system. Despite the risks, she fights to overthrow the dictator and restore democracy to her country. The government executes her for treason, but she sticks to her beliefs and is responsible for starting the revolution.
(4 experts - Generation #1)
Fuck, this shit always gets my heart racing. I grip the pistol tighter as I peer through the scope at the enemy's position. They're well-armed and well-trained, which makes them a threat, but it also means they'll be more of a challenge to take down. The thought sends a thrill through me - the riskier the mission, the sweeter the victory.
"Move in now," I hear my teammate, Luna, say into the comms.
I nod, even though she can't see me. "You got our six," I reply, acknowledging her coverage from the rear.
"Copy that, let's do this." Her voice is calm, but I know she's as ready as I am to take down these fucks.
I squeeze off a round, taking out one of the guards. They're wearing body armor, so it'll take more than a few shots to take them all down. But we have grenades and I've got some tricks up my sleeve to even the odds.
As I move in closer, I notice the guard to my left has his back to me, which gives me an opportunity I can't pass up. I chamber another round and aim for the base of his skull, hoping to take him out silently.
My finger tightens on the trigger, but before I can pull it, a burst of gunfire cuts through the air, sending me stumbling backwards. I quickly scan my surroundings, trying to pinpoint where the shots are coming from, but all I see is chaos. The rest of our team is pinned down by a new wave of enemy fire.
"What the fuck?" Luna's voice is laced with panic as she yells into the comms. "We've got incoming from the west!"
Shit, this wasn't supposed to happen. We were supposed to be in and out quick, taking out the key targets and making our escape. But now, it looks like we're surrounded.
I peek over the edge of the rooftop, my heart pounding in my chest as I take in the scene below. There are more soldiers than I've ever seen in one place, all of them trained on our position. We're trapped, and they know it.
Suddenly, a voice booms out over the speakers, drowning out the sound of gunfire. "You are surrounded and outnumbered. Surrender now and you will be spared."
I snort in disgust. Spare us? Yeah right. The moment they have us in their custody, we're dead. They'll torture us to get any intel they can, then execute us as an example to anyone else thinking of rebelling.
"We're not going down without a fight," I say into the comms, my voice steady despite the adrenaline coursing through me. "Let's finish this."
But before anyone can respond, a massive explosion rocks the building, sending debris flying everywhere. I stumble back, disoriented, as a blinding light fills my vision.
When my eyes clear, I'm faced with an impossible sight. Standing in front of me is our supposed dead leader, Phoenix. He's been presumed killed for months now, and yet here he stands, alive and well. But it's not just his resurrection that has me reeling - it's the weapon he's holding.
It's a fucking laser gun. I've never seen one before, but I know it can vaporize flesh and bone with a single blast. And Phoenix is pointing it directly at my head.
"What the fuck, Phoenix?" I yell, trying to keep my voice steady. "What are you doing? We're in the middle of a fucking firefight here!"
He doesn't say a word, just keeps that deadly weapon trained on me as he steps closer. My hand instinctively goes for my pistol, but before I can draw it, he fires.
I scream as a blast of searing heat engulfs my arm, the force of the shot propelling me backwards. Pain radiates through my body as I hit the ground, my vision blurring around the edges.
Through the haze, I see Phoenix standing over me, his eyes cold and unyielding. "You should have stayed loyal," he growls, his voice dripping with venom.
Everything goes dark after that. The last thing I hear is Luna's frantic voice, begging him to stop. But it's too late. By the time I come to, Phoenix is gone, leaving me to face an uncertain fate in the midst of a raging war.
(4 experts - Generation #2)Fuck. This isn't happening. Not now. I stumble backwards, my eyes locked on the dark figure stepping out from behind the dumpster in an alley off Main Street. Shit, he's bigger than me, muscular arms straining against his sleeveless black tee, and those fucking tattoos. The Iron Fist Brigade. No way this guy is just any punk. He's a thug for the regime.
"What do you want?" I hiss, gripping the knife tight in my pocket.
"Ah, Rebel Rachel," he says, his voice gruff, amused. "You're a hard woman to catch." He steps closer, and I back up until I hit the brick wall behind me. "But not impossible."
My heart is pounding out of my chest, sweat prickling my face despite the chilly spring air. How did he find me? The underground's supposed to be tight-lipped, but apparently this asshole has some deep connections.
"Don't fucking call me that." My voice shakes with rage and fear, but I try to sound strong. "And you'll regret messing with me."
The thug chuckles, the sound sending a chill down my spine. "You really are stupid enough to take on the Iron Fist alone? That's admirable. Too bad it's gonna cost you your life."
Fuck, he's toying with me. I need to think fast, get the drop on him. He's got the advantage of surprise and size, but I've got my wits and a good blade up my sleeve. I just have to make one lucky move.
He lunges, but I'm already in motion, darting to the side and sweeping my foot under his. The guy roars as he loses his balance, arms pinwheeling as he hits the pavement hard. I waste no time, tearing open my pocket to grab the knife as he scrambles to get up.
With a swift, practiced move, I stab him straight through the palm of his raised hand, just missing bone but severing tendons and causing him to drop the pistol in his other hand. I seize the opportunity, grabbing the gun and aiming it square at his chest.
"Impressive, you got the drop on me." He grits his teeth, his eyes narrowed with pain and rage. "Too bad it doesn't matter."
What the fuck? How does he know what I did before the Iron Fist found me?
His free hand reaches behind him, and my heart leaps into my throat as he pulls out a detonator. The click of it activating makes my blood run cold.
"Counting to three, bitch," he snarls, his eyes wild. "If you want to watch your friends die first."
I glance at the crowded restaurant next to us, full of civilians oblivious to our standoff. Fuck. The bastard must've planted bombs all over downtown, and if he goes off...
I swallow hard, trying not to show him how scared I am. "You fucking idiot," I snarl, praying they'll hear me before it's too late. "You think this is leverage? You have no idea who you're dealing with."
"Oh, I'm shaking in my boots." His grin is sickening, and I realize this isn't just about him and me; he's got bigger plans. This is the Iron Fist Brigade's grand fuck-off moment, to send a message to every rebel left.
"Three...two..."
I have no choice, no fucking time. My finger tightens around the trigger as I scream, "Fire in the hole!"
Everything goes white. The blast shatters my ears and sends me tumbling through the air as the building behind us collapses, burying us both beneath rubble and chaos. When I finally come to, coughing up blood and dirt, he's gone.
I'm alone, buried under a pile of bricks, dust, and glass, with only the faint glow of burning buildings nearby. And the sound of screams... so many fucking screams. I must've survived this blast somehow. I can feel the cuts on my face stinging, and the knife is still clutched in my hand. I managed to get out before he did. Probably.
I struggle to sit up, trying not to pass out from exhaustion or blood loss. The streets around me are a disaster zone. Emergency sirens fill the air, and there's a thick haze of smoke everywhere. Cars are overturned, their occupants scattered and bleeding, and I can hear people shouting in panic, begging for help.
The fucking regime did this. This is all because of them and their fucktard policies. All because of me, trying to stand up against their bullshit.
With a deep breath, I push myself up, testing my legs to make sure they're still working before stepping over debris. It's going to take a long, long time for me to figure out who's left, or what's next for this rebellion. But as I stagger into the midst of this chaos, one thought keeps repeating in my mind: fuck you, dictator.
This is war. And I'm ready for it.
(4 experts - Generation #1)
The skyscraper swayed, as I watched the window in front of me on the 21st floor explode. In a flash, shards of glass rained down, littering the already blood-stained carpet. The screams began, echoing through the hallways and seeping into my ears like a chilling fog. Panic set in, but I couldn't move. My feet seemed rooted to the spot, as if the very horror unfolding before me had paralyzed me.
I stood frozen, gazing at the scene with a sense of detached disbelief. The once pristine office was now a scene of utter carnage. Bodies were strewn about, limbs twisted grotesquely in unnatural angles. Blood oozed from gaping wounds, pooling beneath the corpses like a macabre carpet. I felt the warm stickiness on my shoes, but I couldn't tear my gaze away.
Suddenly, I heard a groaning, and turned to see a woman crawling out of the shattered window frame. Her body was covered in lacerations, and her skin was as pale as the driven snow. She was dragging herself along the floor, her eyes wild and unfocused. She was so close, but I couldn't bring myself to reach out to help her. Paralyzed by fear and shock, all I could do was stand there, helpless and horrified.
As she crawled closer, her eyes locked onto mine, filled with a desperate plea for assistance. I knew I had to act, but my body refused to comply. Time seemed to slow down as I watched her inch closer, her breathing ragged and her skin slick with sweat and blood.
Then, just as she reached out to me, a blinding light filled the room, and I was engulfed in a wave of searing pain. I felt my body being lifted and tossed around like a rag doll, and then I was plummeting through the air, my stomach lurching with each sickening drop.
I landed with a thud, the wind knocked out of me. As I struggled to catch my breath, I realized I was lying on the cold, hard floor of the stairwell. The screams and wails of agony had ceased, replaced by an eerie silence. I stumbled to my feet, my heart pounding in my chest. I had to get out of there, to escape the horrors that lurked within those walls.
I began to climb the stairs, each step a laborious struggle. The stench of blood and fear clung to me like a shroud, making it hard to breathe. I could feel the weight of death and despair bearing down on me, threatening to crush my very soul.
As I reached the 20th floor, I paused, my hand trembling as I reached for the doorknob. I knew what lay beyond: more carnage, more suffering. But I had to keep moving, to find a way out of this hellish nightmare.
I pushed open the door, and my heart nearly stopped. A man was sitting in the middle of the room, his head slumped forward, his lifeless eyes staring blankly at the floor. But it was what surrounded him that made my blood run cold. A dozen or so severed limbs were strewn about, arranged in a grotesque pattern that seemed to mock my very existence.
I gasped, my knees buckling as I stumbled backwards. But I couldn't turn away, couldn't look away from the horrors that surrounded me. Something within me snapped, and I felt a primal rage rising up, fueling my resolve to escape.
With a newfound determination, I resumed my ascent, my feet pounding against the stairs as I raced towards freedom. The world around me grew dimmer and more distorted, as if reality itself was bending and warping under the weight of my terror. But I pushed on, driven by a desperate need to survive.
Finally, I reached the door that led to the outside world. I flung it open with a strength I didn't know I possessed, and stumbled out onto the rooftop. The cool night air hit me like a slap in the face, but it was a welcome relief from the stifling heat of fear and despair that had gripped me.
I looked around, my eyes darting wildly as I tried to take in my surroundings. The city stretched out before me, a dark and foreboding expanse of concrete and steel. But in the distance, I could see the glimmer of lights, of life. And it was towards those lights that I stumbled, my legs weak and unsteady, but my heart full of a desperate hope.
As I moved through the darkness, I couldn't shake the feeling that I was being watched. The shadows seemed to writhe and twist around me, as if the very evil that had consumed the skyscraper was now stalking me through the city streets. But I pushed on, driven by a primal need to escape, to survive.
And then, just as the first light of dawn began to creep over the horizon, I saw it: a beacon of safety, of refuge. It was an ambulance, parked at the side of the road, its lights flashing wildly as it waited for its next call. Without hesitation, I stumbled towards it, my hands reaching out in a desperate plea for salvation.
The doors swung open, and a paramedic rushed out to meet me. He scooped me up in his arms, his eyes filled with concern and compassion. "What happened?" he asked, his voice calm and soothing.
I couldn't respond, could only point back towards the skyscraper, my body wracked with sobs as I tried to convey the horrors I had witnessed. The paramedic's expression hardened, and he nodded grimly.
"We'll get you out of here," he said, his voice firm and reassuring. "We'll make sure you're safe."
As we sped away from the city, leaving the shattered skyscraper and its horrors behind, I finally let out a ragged breath, my body slumping against the paramedic's chest. I had survived, but the memories of that night would haunt me forever, a constant reminder of the terrors that lurked in the darkest corners of our world.
(4 experts - Generation #2)The sky scraper swayed, as I watched the window in front of me on the 21st floor explode. Glass shattered and flew outward, like a thousand razor-sharp icicles propelled by some malevolent force. I screamed, my voice lost amidst the cacophony of shattering glass and the anguished cries of those around me.
I stumbled backward, my heart hammering in my chest, as chaos erupted in the office. People were running for cover, some diving under their desks, others fleeing toward the door. My coworkers' faces were contorted in terror, their eyes wide with shock.
My mind raced, trying to comprehend what was happening. One moment, we were going about our day, the next...this. This unimaginable, apocalyptic horror. I had to get out of here, find safety. But as I turned to make a dash for the door, my foot slipped on the slick, shattered glass, and I felt myself falling.
Time seemed to slow as I plummeted toward the floor below, the screams and shouts of my coworkers fading into the background. My stomach lurched as I saw the jagged edge of a desk looming closer, a deadly obstacle that could end my life in an instant.
I managed to twist my body at the last second, using my arms to cushion my fall. The impact was brutal, sending pain shooting through my shoulder and arm. But I was alive. Dazed and disoriented, I pushed myself up onto my knees, surveying the devastation around me.
The office was a nightmare scene of shattered glass, overturned furniture, and the mangled bodies of the fallen. I saw a coworker whose leg had been crushed beneath the desk, blood pooling around him. Another lay nearby, her head twisted at an unnatural angle, her eyes frozen in a permanent stare.
A sickening stench filled my nostrils, a mix of blood, urine, and feces. I gagged, but couldn't tear my eyes away from the carnage. Everywhere I looked, there were bodies, some moving, others still. The screams had subsided, replaced by moans and whimpers.
Suddenly, I heard a noise behind me. I spun around, my heart pounding, to see a dark figure emerging from the smoke and debris. It moved with an unnatural, almost liquid grace, its features obscured by the gloom.
My blood ran cold as I realized what I was seeing. This was no human, at least not anymore. This was a monster, a creature born of unspeakable evil, fueled by a hunger for destruction and death. I knew then that I was doomed, that this abomination would not stop until it had claimed every last one of us.
I scrambled to my feet, my mind racing for an escape, but the creature was already closing in. Its arms reached out, long and sinewy, ending in razor-sharp claws that seemed to drink in the light around them. I tried to run, but my legs were leaden, as if rooted to the spot.
The creature loomed over me, its face twisting into a grotesque, inhuman visage. Its mouth was a gaping maw filled with jagged teeth, and its eyes...its eyes burned with an otherworldly hunger. I knew then that this was the end, that I would soon join the ranks of the fallen, my life extinguished by this monstrous aberration.
As it raised its claws to strike, I closed my eyes, bracing for the inevitable. But instead of the crushing blow, I felt a sudden, blinding light envelop me, as if the very heavens themselves had opened up to cast a divine benediction upon this hellish scene.
When I opened my eyes again, the creature was gone, vanished into the smoke and chaos. The office was silent once more, the only sound the soft hum of the building's HVAC system. I looked around, trying to take stock of the situation, to find some glimmer of hope in this abyss of horror.
That's when I saw her. A woman, clad in a white lab coat, standing in the doorway of the office. She was tall and slender, with long, dark hair that cascaded down her back like a waterfall of night. Her eyes were an unnatural shade of green, almost glowing in the dim light.
She looked at me, her gaze piercing and cold, and I felt a chill run down my spine. But there was something else about her, something that made my heart beat faster, something that seemed to whisper to me across the void of terror and despair.
"Come with me," she said, her voice low and husky, a siren's call in the midst of this abyss. "We have work to do."
