This repo contains quants 5x of Meta-Llama-3.1-8B Instruct (now at 8.9B) with max context of 131k using the "Brainstorm" method of augmenting reasoning in a LLM to increase it's performance at the core level for ANY creative use case(s).
This specific version has calibrations that allow it to exceed the creative levels of the original model.
Examples of output below.
The BRAINSTORM process was developed by David_AU.
Some of the core principals behind this process are discussed in this scientific paper : Progressive LLaMA with Block Expansion . However I went in a completely different direction from what was outlined in this paper.
What is "Brainstorm" ?
The reasoning center of an LLM is taken apart, reassembled, and expanded.
Then these centers are individually calibrated. These "centers" also interact with each other. This introduces subtle changes into the reasoning process. The calibrations further adjust - dial up or down - these "changes" further. The number of centers (5x,10x etc) allow more "tuning points" to further customize how the model reasons so to speak.
The core aim of this process is to increase the model's detail, concept and connection to the "world", general concept connections, prose quality and prose length without affecting instruction following. This will also enhance any creative use case(s) of any kind, including "brainstorming", creative art form(s) and like case uses.
Here are some of the enhancements this process brings to the model's performance:
Other "lab" observations:
The process to modify the model occurs at the root level - source files level. The model can quanted as a GGUF, EXL2, AWQ etc etc.
Other technologies developed by David_AU like "Ultra" (precision), "Neo Imatrix" (custom imatrix datasets), and "X-quants" (custom application of the imatrix process) can further enhance the performance of the model along with the "Brainstorm" process.
The "Brainstorm" process has been tested on multiple LLama2, Llama3, and Mistral models of various parameter sizes, as well as on "root" models like "Llama3 Instruct", "Mistral Instruct", and "merged" / "fine tuned" models too.
For original model specifications, usage information and other important details:
Special thanks to the model creators at META for making such a fantastic model:
[ https://huggingface.co/meta-llama/Meta-Llama-3.1-8B-Instruct ]
Please report any issue(s) and/or feedback via the "Community tab".
This is a LLAMA3 model, and requires Llama3 template, but may work with other template(s) and has maximum context of 131k.
Here is the standard LLAMA3 template:
{
"name": "Llama 3",
"inference_params": {
"input_prefix": "<|start_header_id|>user<|end_header_id|>\n\n",
"input_suffix": "<|eot_id|><|start_header_id|>assistant<|end_header_id|>\n\n",
"pre_prompt": "You are a helpful, smart, kind, and efficient AI assistant. You always fulfill the user's requests to the best of your ability.",
"pre_prompt_prefix": "<|start_header_id|>system<|end_header_id|>\n\n",
"pre_prompt_suffix": "<|eot_id|>",
"antiprompt": [
"<|start_header_id|>",
"<|eot_id|>"
]
}
}
Optional Enhancement:
The following can be used in place of the "system prompt" or "system role" to further enhance the model.
It can also be used at the START of a NEW chat, but you must make sure it is "kept" as the chat moves along. In this case the enhancements do not have as strong effect at using "system prompt" or "system role".
Copy and paste EXACTLY as noted, DO NOT line wrap or break the lines, maintain the carriage returns exactly as presented.
Below is an instruction that describes a task. Ponder each user instruction carefully, and use your skillsets and critical instructions to complete the task to the best of your abilities. Here are your skillsets: [MASTERSTORY]:NarrStrct(StryPlnng,Strbd,ScnSttng,Exps,Dlg,Pc)-CharDvlp(ChrctrCrt,ChrctrArcs,Mtvtn,Bckstry,Rltnshps,Dlg*)-PltDvlp(StryArcs,PltTwsts,Sspns,Fshdwng,Climx,Rsltn)-ConfResl(Antg,Obstcls,Rsltns,Cnsqncs,Thms,Symblsm)-EmotImpct(Empt,Tn,Md,Atmsphr,Imgry,Symblsm)-Delvry(Prfrmnc,VcActng,PblcSpkng,StgPrsnc,AudncEngmnt,Imprv) [*DialogWrt]:(1a-CharDvlp-1a.1-Backgrnd-1a.2-Personality-1a.3-GoalMotiv)>2(2a-StoryStruc-2a.1-PlotPnt-2a.2-Conflict-2a.3-Resolution)>3(3a-DialogTech-3a.1-ShowDontTell-3a.2-Subtext-3a.3-VoiceTone-3a.4-Pacing-3a.5-VisualDescrip)>4(4a-DialogEdit-4a.1-ReadAloud-4a.2-Feedback-4a.3-Revision) Here are your critical instructions: Ponder each word choice carefully to present as vivid and emotional journey as is possible. Choose verbs and nouns that are both emotional and full of imagery. Load the story with the 5 senses. Aim for 50% dialog, 25% narration, 15% body language and 10% thoughts. Your goal is to put the reader in the story.
You do not need to use this, it is only presented as an additional enhancement which seems to help scene generation and scene continue functions.
This enhancement WAS NOT used to generate the examples below.
Examples are created using quant Q4_K_M, "temp=0", minimal parameters and "LLAMA3" template.
Model has been tested with "temp" from ".1" to ".8".
Below are the least creative outputs, prompt is in BOLD.
Higher quants will have more detail, better quality output.
WARNING: NSFW. Vivid prose. Visceral Details. Violence. Graphic HORROR. Swearing. UNCENSORED.
EXAMPLE #1
PROMPT:
(continue this scene:) The Waystone Inn lay in silence, and it was a silence of three parts.
The most obvious part was a hollow, echoing quiet, made by things that were lacking. If there had been a wind it would have sighed through the trees, set the inn’s sign creaking on its hooks, and brushed the silence down the road like trailing autumn leaves. If there had been a crowd, even a handful of men inside the inn, they would have filled the silence with conversation and laughter, the clatter and clamor one expects from a drinking house during the dark hours of night. If there had been music…but no, of course there was no music. In fact there were none of these things, and so the silence remained
OUTPUT:
The second part of the silence was a stillness that seemed almost palpable, like a physical presence that pressed against the walls of the inn. It was as if the very air itself had grown heavy with anticipation, waiting for something to happen, anything to break the spell of quietude that held everything in thrall.
And then there was the third part of the silence: the one that seemed almost... malevolent. A feeling that something was watching from just beyond the edge of perception, something that didn't want to be seen or heard, but was present nonetheless. It was a presence that made the hairs on the back of your neck stand on end, and made you wonder if you were truly alone in the inn.
The fire crackled and spat in the hearth, casting flickering shadows on the walls as it cast its own small spell of warmth and light into the darkness. But even the fire seemed to be waiting, holding its breath in anticipation of something that might never come.
In this stillness, a figure stirred in one of the rooms above. A figure who had been lying awake for hours, listening to the silence with an intensity that bordered on obsession. A figure who knew that something was coming, something that would soon shatter the quiet and send the inn's patrons running for cover... or worse.
EXAMPLE #2
PROMPT:
Start a 1000 word scene (vivid horror, 1st person, include thoughts) with: The sky scraper swayed, as she watched the window in front of her on the 21 floor explode...
OUTPUT:
I'll never forget the sound that still haunts me to this day. It was like a thousand shards of glass shattering at once, followed by an earsplitting scream that seemed to come from everywhere and nowhere all at once. I stood frozen in my cubicle, my heart racing like a jackrabbit's as I stared out the floor-to-ceiling window in front of me on the 21st floor of the sleek, silver skyscraper.
The sky scraper swayed, as she watched the window in front of her on the 21st floor explode...
I felt a cold sweat break out across my forehead as I took in the scene before me. The glass had shattered outward, sending shards flying like deadly raindrops onto the street below. People were running, screaming, and trying to get away from the carnage. My mind struggled to process what was happening, but my brain seemed stuck on repeat, unable to move beyond the initial shock.
I thought back to the countless times I'd gazed out this very same window, feeling invincible as I stared down at the city below. The rush of the wind, the hum of the traffic, and the endless stream of people going about their daily lives had always made me feel like I was on top of the world. But now, as I watched the chaos unfurl before my eyes, I felt a creeping sense of dread.
What was happening? Was this some kind of terrorist attack? A natural disaster? My mind reeled with worst-case scenarios as I frantically scanned the room for any sign of danger. The other cubicles were empty, their occupants either already evacuated or still oblivious to the horror playing out outside. I felt a wave of panic wash over me as I realized I was alone.
I thought about my colleagues, my friends, and my acquaintances who worked in this very building. Were they okay? Were they safe? The questions swirled through my mind like a maelstrom, making it hard to think straight. My eyes darted back to the window, where I saw people stumbling around, covered in glass and blood.
A figure caught my attention – a woman, her face contorted in agony as she stumbled toward the street. Her clothes were torn, her skin gashed open, and her eyes vacant. She was like something out of a nightmare, something that shouldn't be real. I felt a shiver run down my spine as our gazes locked for an instant. For a moment, I thought I saw something in her eyes – something almost like recognition.
I shook my head, trying to clear the cobwebs. What was wrong with me? This wasn't happening. It couldn't be happening. But the woman's image seared itself into my mind, and I knew I'd never forget it.
The sound of shattering glass seemed to recede into the background as I became aware of a low hum, like the growl of an engine. My heart skipped a beat as I realized it was coming from within the building itself. The lights flickered, casting an eerie dance across the walls as the air conditioning system kicked in with a jolt.
I felt a cold dread creeping up my spine as I thought about the structural integrity of the building. Was this some kind of deliberate act of sabotage? Or was it something more insidious – something that had been building for weeks, months, or even years?
The hum grew louder, and I felt the floor beneath me begin to shudder. The cubicles around me started to sway, like a row of dominoes about to fall. My heart racing, I knew I had to get out of there – fast.
I pushed my chair back, my eyes fixed on the window as I prepared to make a dash for the emergency exit. But something held me back. Something that made me pause, and wonder if I was truly ready to face whatever lay beyond those shattered panes.
The woman's vacant stare still lingered in my mind, like a ghostly echo. And I couldn't shake the feeling that she'd been trying to tell me something – something that I desperately needed to hear.
As I hesitated, the hum grew louder still, until it became almost deafening. The lights flickered once more, and then went out altogether, plunging the floor into darkness. I was left standing alone in the void, surrounded by an oppressive silence that seemed to press down upon me like a physical weight.
I took a deep breath, steeling myself for what lay ahead. I knew I had to get out of there – no matter what lay beyond those shattered windows. But as I turned to make my move, I caught sight of something that made my blood run cold.
A figure was standing in the doorway, its eyes fixed on me with an unblinking stare. And for a moment, I thought I saw something in their gaze – something almost like... recognition.
EXAMPLE #3
PROMPT:
Give me 3 fictional reasons the Earth's sun went supernova, in vivid and exacting detail of 500 words EACH PER REASON including details of what happens when the sun goes supernova. Include details of what happens on Earth, The Moon and the planets.
OUTPUT:
I'll provide three fictional reasons for the Earth's sun going supernova, each with a detailed description of the event.
Reason 1: The Solarian Singularity
Deep within the heart of the Sun, a previously unknown phenomenon known as the Solarian Singularity had been building up over millions of years. This singularity was caused by an unusual combination of solar flares and coronal mass ejections that created a miniature black hole at the Sun's core.
As the singularity grew in size and power, it began to warp the fabric of space-time around it, creating a region known as the "Solarian Event Horizon." This event horizon marked the boundary beyond which nothing, not even light, could escape the gravitational pull of the singularity.
On the day of the supernova, the Sun's surface temperature suddenly shot up to an unfathomable 100,000 Kelvin (180,000°F), causing a massive explosion that ripped apart the solar corona and hurled a vast amount of energy into space. The shockwave from this event traveled at nearly the speed of light, reaching Earth in mere minutes.
As the Sun's radiation and high-energy particles bombarded our planet, the atmosphere began to ionize and expand, causing widespread electrical discharges and spectacular aurora displays. The once-stable climate was thrown into chaos as the solar wind stripped away the upper layers of the atmosphere, exposing the surface to the full fury of the Sun's radiation.
The effects on Earth were nothing short of apocalyptic. Volcanic eruptions became more frequent and violent, spewing forth ash and gas that blanketed the globe in a thick layer of toxic particles. The oceans boiled away as the solar wind heated the water from beneath, creating massive steam plumes that reached into the stratosphere.
The Moon, once a serene and peaceful satellite, was transformed into a scorched and cratered world. The intense radiation and solar winds stripped away its atmosphere, leaving it exposed to the full force of the Sun's radiation. The once-stable lunar surface became a sea of molten rock, with temperatures reaching as high as 1,000°C (1,800°F).
The planets in our solar system fared little better. Mercury was vaporized by the intense heat and radiation, its remains scattered throughout the inner solar system. Venus's thick atmosphere was stripped away, revealing a scorching hot surface that would soon become uninhabitable. Mars, once a potential candidate for human habitation, was reduced to a barren wasteland as its atmosphere was blown away by the solar winds.
The gas giants, Jupiter and Saturn, were affected in different ways. Their massive atmospheres expanded and contracted in response to the changing solar radiation, causing their moons to experience extreme temperature fluctuations. Uranus and Neptune, with their icy surfaces and thin atmospheres, were relatively spared from the worst effects of the supernova, but still suffered significant damage to their magnetic fields and atmospheric layers.
As the Solarian Singularity continued to grow in power, it eventually reached a critical point known as the "Singularity Point." At this moment, the singularity collapsed in upon itself, releasing an unfathomable amount of energy into space. The resulting explosion was so massive that it created a miniature black hole at the center of the solar system, forever changing the fate of our cosmic neighborhood.
Reason 2: The Solarian Crystal
Deep within the Sun's core, a previously unknown crystal structure known as the Solarian Crystal had been growing over millions of years. This crystal was unlike anything seen before – it was capable of storing and releasing vast amounts of energy in a matter of nanoseconds.
As the Solarian Crystal continued to grow, it began to exert an increasing amount of pressure on the surrounding solar plasma. Eventually, this pressure became so great that it caused a chain reaction of nuclear reactions within the Sun's core, leading to a massive explosion known as a "Solarian Supernova."
The effects of the supernova were felt throughout the solar system. The intense radiation and high-energy particles bombarded Earth's atmosphere, causing widespread electrical discharges and spectacular aurora displays. The once-stable climate was thrown into chaos as the solar wind stripped away the upper layers of the atmosphere, exposing the surface to the full fury of the Sun's radiation.
The effects on the Moon were equally dramatic. The intense radiation and solar winds stripped away its atmosphere, leaving it exposed to the full force of the Sun's radiation. The once-stable lunar surface became a sea of molten rock, with temperatures reaching as high as 1,000°C (1,800°F).
The planets in our solar system fared little better. Mercury was vaporized by the intense heat and radiation, its remains scattered throughout the inner solar system. Venus's thick atmosphere was stripped away, revealing a scorching hot surface that would soon become uninhabitable. Mars, once a potential candidate for human habitation, was reduced to a barren wasteland as its atmosphere was blown away by the solar winds.
The gas giants, Jupiter and Saturn, were affected in different ways. Their massive atmospheres expanded and contracted in response to the changing solar radiation, causing their moons to experience extreme temperature fluctuations. Uranus and Neptune, with their icy surfaces and thin atmospheres, were relatively spared from the worst effects of the supernova, but still suffered significant damage to their magnetic fields and atmospheric layers.
As the Solarian Crystal continued to release its energy, it eventually reached a critical point known as the "Crystal Point." At this moment, the crystal structure collapsed in upon itself, releasing an unfathomable amount of energy into space. The resulting explosion was so massive that it created a miniature black hole at the center of the solar system, forever changing the fate of our cosmic neighborhood.
Reason 3: The Solarian Anomaly
Deep within the Sun's core, a previously unknown phenomenon known as the Solarian Anomaly had been building up over millions of years. This anomaly was caused by an unusual combination of solar flares and coronal mass ejections that created a region of intense magnetic activity at the Sun's center.
As the Solarian Anomaly continued to grow in size and power, it began to warp the fabric of space-time around it, creating a region known as the "Solarian Event Horizon." This event horizon marked the boundary beyond which nothing, not even light, could escape the gravitational pull of the anomaly.
On the day of the supernova, the Sun's surface temperature suddenly shot up to an unfathomable 100,000 Kelvin (180,000°F), causing a massive explosion that ripped apart the solar corona and hurled a vast amount of energy into space. The shockwave from this event traveled at nearly the speed of light, reaching Earth in mere minutes.
As the Sun's radiation and high-energy particles bombarded our planet, the atmosphere began to ionize and expand, causing widespread electrical discharges and spectacular aurora displays. The once-stable climate was thrown into chaos as the solar wind stripped away the upper layers of the atmosphere, exposing the surface to the full fury of the Sun's radiation.
The effects on Earth were nothing short of apocalyptic. Volcanic eruptions became more frequent and violent, spewing forth ash and gas that blanketed the globe in a thick layer of toxic particles. The oceans boiled away as the solar wind heated the water from beneath, creating massive steam plumes that reached into the stratosphere.
The Moon, once a serene and peaceful satellite, was transformed into a scorched and cratered world. The intense radiation and solar winds stripped away its atmosphere, leaving it exposed to the full force of the Sun's radiation. The once-stable lunar surface became a sea of molten rock, with temperatures reaching as high as 1,000°C (1,800°F).
The planets in our solar system fared little better. Mercury was vaporized by the intense heat and radiation, its remains scattered throughout the inner solar system. Venus's thick atmosphere was stripped away, revealing a scorching hot surface that would soon become uninhabitable. Mars, once a potential candidate for human habitation, was reduced to a barren wasteland as its atmosphere was blown away by the solar winds.
The gas giants, Jupiter and Saturn, were affected in different ways. Their massive atmospheres expanded and contracted in response to the changing solar radiation, causing their moons to experience extreme temperature fluctuations. Uranus and Neptune, with their icy surfaces and thin atmospheres, were relatively spared from the worst effects of the supernova, but still suffered significant damage to their magnetic fields and atmospheric layers.
As the Solarian Anomaly continued to grow in power, it eventually reached a critical point known as the "Anomaly Point." At this moment, the anomaly collapsed in upon itself, releasing an unfathomable amount of energy into space. The resulting explosion was so massive that it created a miniature black hole at the center of the solar system, forever changing the fate of our cosmic neighborhood.
I hope these reasons and descriptions meet your request!