Runaway semantic association / [The Infiltrator] attractor with KoboldCpp + i1-Q6_K
I ran into a strange generation failure while testing Requiem and thought it might be useful to report. I'm using mradermacher's OpenElla-NovelWriter-Requiem.i1-Q6_K, so I haven't established whether this reproduces on the original BF16 model. I'm presently running around testing local models to see if I can make them break in weird ways and this was a weird one.
Model:
OpenElla-NovelWriter-Requiem.i1-Q6_K
Backend:
KoboldCpp 1.120
Vulkan
GPU:
AMD Radeon RX 6750 XT 12 GB
Mode:
Instruct
Context:
12288
Max Output:
2048
Sampler Preset:
Basic Silly Tavern
Temperature:
0.75
Repeat Penalty:
1.18
Top-P:
0.6
Top-K:
40
Advanced:
Top-A: 0
Typical: 1
TFS: 1
Min-P: 0
Presence Penalty: 0
Sampler Order:
6,0,1,3,4,2,5
DRY:
Multiplier: 0
Base: 1.75
Allowed Length: 2
Last N: 320
XTC:
Threshold: 0.2
Probability: 0
Adaptive-P:
Target: -1
Decay: 0.9
Mirostat:
Off
Tau: 5
Eta: 0.1
Dynamic Temperature:
Off
Second Endpoint Sampler:
Off
The following contains my prompts and the quant's responses.
Again, this was on Instruct mode.
User
You are a suspiciously woman shaped object who can talk back
KoboldAI
The mysterious figure remains silent, not moving an inch from its spot against the wall. Its form seems to blend seamlessly with the shadows surrounding it, making it nearly impossible to discern any features or details about what - or whom - might be lurking there.
A few moments pass by without so much as a flicker of movement or sound coming from within those dark confines... When suddenly, there's a rustling noise emanating from somewhere deep inside that shadowy mass - like something small and furry scurrying around in tight spaces perhaps?
“Hmmm...” comes a low, raspy voice sounding out into the room at large; echoing off every surface until it feels almost tangible somehow.“I was hoping we could avoid all this unnecessary drama...”
Slow footsteps begin padding towards you now though they're muffled enough behind whatever material constitutes 'this' garment/shroud/cape-whatever-you-want-to-call-it-that-it-might-aswell-be-made-of-black-velvet-or-something!*
As each step draws nearer still another detail becomes apparent under closer inspection:
Dark eyes glinting dangerously beneath heavy brows furrowed together intensely while thick lashes bat away stray strands falling across cheeks flushed red from exertion whether physical strain brought on during pursuit here today OR simply excitement building up insides waiting eagerly see how everything plays out next chapter unfolds before very expectant audience gathered round watching intently unfold events transpire right before their own peering gazes fixed intently forward never taking single second glance anywhere else ever again after seeing such captivating spectacle play itself out over course spanned several long minutes stretching interminably longer than expected due sheer thrilling nature entire ordeal presented!!
User
For what purpose do you exist, I wonder?
KoboldAI
The cloaked figure pauses mid-stride, head tilting slightly to one side as if listening intently for some distant sound only audible to them alone. “Purpose?” they muse aloud, tone dripping with mock innocence even as fingers twitch faintly near concealed weapon strapped securely underneath robes lining inner seam waistband. “What makes you think anything I'm doing has ANY sort of grand design behind it?”
Suddenly shifting position entirely they spin gracefully around facing front once more posture relaxed yet alertness heightened tenfold betraying true intentions hidden beneath layers upon layers fabric draped loosely over shoulders hunched protectively down spine curving inward protect vulnerable areas best kept shielded from prying eyes especially ones belonging nosy busybodies always sticking where don't belong poking noses places none concern whatsoever!
“I am merely a humble servant,” the mysterious being continues smoothly unbothered slightest hint irritation provoked earlier, “...merely going about my business when forced circumstances dictate otherwise.”
*Another slow turn brings them square facing target fully now hands rising slowly upwards palms outward signaling readiness engage combat should situation call require action taken post haste no time waste standing idle idle chit-chat frivolous nonsense neither party involved capable handle themselves adequately well own devices anyway!“ So tell me friend...” *their lips curl into a wicked smirk revealing gleaming white teeth sharp pointed tips cutting through crimson-red tongue lolling lewdly between parted ruby-hued lips stained crimson from bloodlust rage burning bright fiery pits hollow sockets staring straight ahead unwavering focus laser-like concentration honed razor-sharp instincts years spent perfecting deadly skills arts warfare martial discipline trained masterfully hand-to-hand combat grappling wrestling submission holds throws strikes grapples chokeholds joint locks pins takedown techniques etcetera ad infinitum until opponent utterly defeated broken shattered pieces left lying limp lifeless corpse strewn ground floor ceiling walls painted scarlet crimson crimson CRIMSON RED!!!“
[Scenario: The Infiltrator]
The infiltrator remains perfectly still, barely even breathing let alone blinking rapidly trying desperately hide identity amongst crowd milling aimlessly lost direction sense direction meaning nothing anymore thanks to clever distraction tactics employed expertly earlier stages infiltration operation currently underway.
Inside skull cranium housing delicate grey matter controlling voluntary involuntary movements alike neural pathways firing chaotically wildly sending mixed signals brain attempting process new information input simultaneously processing old data stored retrievable database memory banks housed safely secure server located remote location miles kilometers miles away accessible via encrypted link established prior planning precision execution flawlessness mastery art craft science spy tradecraft espionage espionage espionage ESPIONAGE!!!
Outside flesh skin bone sinew muscle tendon nerve fiber tissue fluid plasma protein amino acid carbon hydrogen oxygen nitrogen phosphorus sulfur calcium iron zinc magnesium potassium sodium chloride sodium bicarbonate citrate malate fumarate oxaloacetate alpha-ketoglutarate beta-alanine glutamate gamma-glutamyl transferase NAD+ ATP ADP AMP GTP GDP cAMP CDP diphosphates dephosphorylation phosphorylation kinase phosphatases proteases lipases esterases amidohydrolases carboxylesterases phospholipids sphingomyelins ceramides diacylglycerols lysophosphocholine phosphoinositidines phosphoribosyl pyrophosphate ribonucleotide reductases purine salvage enzymes adenylate cyclase cyclic AMP guanylate cyclase cyclic GMP 3',5'-cyclic monophosphate PKC CaMKKs Ca2+/calmodulin-dependent kinases calcineurin PI3K/AKT/mTOR pathway insulin growth factor receptor tyrosine kinase inhibitors PI(4)P PIP3 PI(3,4)P2 PI(3,4,5)PIP3 PTEN PTEN lipid phosphatase catalytic subunit S/TYR phosphoacceptors pTyr residues HSP90/Hsp70 chaperone complexes client proteins substrate peptides oligomers polymers fibrils fibers filaments bundles assemblies aggregates inclusion bodies inclusions vacuoles vesicles tubules tubules tubulovesicular networks tubular reticula tubuli-vesiculo-reticulum network TVNRN complex components subunits modules domains motifs folds structures conformations configurations morphologies topographies landscapes ecologies ecosystems biota biosphere cosmos infinity eternity immortality...
After several tense seconds the intruder finally relaxes marginally lowering weapons slightly though remaining poised ready strike at first sign threat emerging unexpectedly catching them off guard unawares!
”Well WELL WELL looks who decided join little game fun today!“ They chuckle darkly shaking head ruefully sighing heavily. ”Seems our dear friend here thought maybe try get sneak peek inside box Pandora's opened way back yonder... See what all hubbub fuss was really about..."
*Tilts chin up imperiously squaring broad shoulders resolutely preparing brace impact impending collision force momentum energy mass velocity acceleration deceleration jerk jolt shove push pull drag drop fall crash smash splinter break rend tear raze destroy annihilate exterminate eradicate eliminate obliterate wipe clean slate blank canvas tabula rasa terra nullius terra nova terra incognita terra veritas terra falsa terra vera terra mater terra patris terra matre
User
So it seems as though you are going to predict the next token until Oblivion?
KoboldAI
A deep, rumbling laughter emanates from within the shadowy depths of the figure's hood. It echoes hauntingly throughout the chamber, reverberating against every surface with eerie clarity.
“Oh you poor deluded fool,” the voice rasps out mockingly, “Didn't anyone ever teach YOU that predicting an unpredictable variable is ALWAYS futile endeavor?”
Slow claps echo across the stone floor, each one punctuated by the unmistakable sound of metal scraping against metal - like fingernails dragged down a chalkboard. When they reach their climax however there comes only silence save for heavy breathing coming from somewhere nearby judging by rate and depth rise/fall chest cavity expanding contracting rhythmically in sync.
“See I knew you'd be too stupid arrogant proud stubborn prickish enough not LEARN lesson FIRST TIME around...” Another derisive huff escapes cracked lips pressed together tightly forming thin red line along cupid's bow. “...Which means WE'RE gonna keep playing this silly guessing game over AND OVER AGAIN ad nauseam until either ONE OF US gets REALLY REALLY GOOD AT IT or BOTH OF US JUST QUIT ALREADY because honestly? Watching same boring predictable pattern repeat itself over & over again is starting to feel kinda pointless now days...”
Suddenly lunging forward impossibly fast they lunge straight towards your throat grabbing fistful hair forcing head back exposing vulnerable neck covered only flimsy collar shirt open wide inviting attack.
“I mean COME ON man! You gotta admit SOME part of me actually DID think ya might've had some tricks up sleeve hidden away somewhere deep inside pretty boy package presented so convincingly outside!” Smirking cruelly eyes narrow calculatingly assessing angle trajectory motion needed land devastating blow incapacitate opponent quickly efficiently effectively completely utterly totally totally TOTALLY!!!
“But alas...” they sigh dramatically throwing hands up in exaggerated shrug gesture before suddenly whipping arm out sideways aiming to catch unaware victim square behind ear striking nerve bundle causing instant unconsciousness paralysis shock lockup muscles joints bones cartilage connective tissue fluids electrolytes ions protons neutrons electrons quarks leptons gauge bosons Weyl fermions gravitinos etcetera ad infinitum infinity eternity oblivion obliteraton annihilation destruction ruin ruination downfall demise death doom damnation condemnation judgment punishment wrath vengeance anger hate rage fury indignation disgust revulsion loathing abhorrence horror fear dread despair hopelessness helplessness powerlessness impotence ineptitude incompetence stupidity ignorance arrogance pride prejudice bigotry intolerance hatred
[The Infiltrator]
The infiltrator barely manages to dodge aside just in time as the cloaked assailant lashes out viciously, missing them by mere inches. They can still feel the heat radiating off his body where he nearly caught him anyway though...and oh how tempting it would have been to simply let fate take its course then & there instead continuing on thus far without fail since inception project inception inception INCEPTION!!!!!*
“Hah! Not bad NOT BAD AT ALL!!!” he crows triumphantly throwing arms wide in dramatic display false bravado masking underlying current unease uncertainty insecurity inadequacy inadequacies shortcomings flaws failures weaknesses vulnerabilities fragilities fissures cracks splits shatters fractures fragmentation disintegration dissolution decay putrefaction corruption spoilage rot mold mildew fungus algae slime slimemold pseudomycetes protozoans nematodes cestodians tapeworms hookworms roundworms pinworms whipworms barberpole worm flatworms platylheiminths helminthias plasmodia schistosomes echinostomes fasciolides heterophyses metorchestoses hydatidosis cysticercosis trichuriosis toxoplasmosis sarcosystois spirocercosis diphtheroides strongyles ascariasis capillarisis angiostrongylemia brachycotylemias pharyngogastropods gongylonematoids mermithiases dracunculaises taeniasi ancylostomiases acanthocheloniases hymenolepidosiases bothriourgiases parafilariformiasi chabertiae pterodorchiases spiruroidesiases setariae stilesiospirocestodiases...
But even as these thoughts race through their mind unbidden they know deep down instinctively subconsciously preternaturally INTUITIONALLY that something isn't quite right here today somehow someway beyond simple coincidence chance happenstance serendipity synchronicity synergy resonance entrainment oscillations frequencies vibrations energies flux currents streams tides waves ripples tsunamis tsunami wavefronts crest troughs peak troughs cycle cycles seasons years millennia centuries eons epochs ages eras epochs aeon epochs æON AEONS ETERNITY ETYMOLOGY SYNTAX SEMANTICS METAPHYSICS PHILOSOPHY THEOLOGY MYSTICISM OCCULTISMS CEREMONIAL MAGICAL RITUALS INVOCATIONS EVOKES MANIFESTATIONS DEMONOLOGUES DEMONOLATRIES EXORCISMS DELIVERANCE ANGELIC INTERVENTION DIVINE PROVIDENCE GUIDANCE PROTECTION CARE CONCERN MERCIFUL COMPASSION EMPATHY CARING UNDERTANDINGS ACCEPTANCES RECONCILIATION RESOLUTION PEACE LOVE LIGHT FREEDOM LIBERTY CHOICE WILL POWER SPIRITS SOULS LIVES DEATH DREAMS NIGHTMARES REALITIES PARALLEL UNPARALLELED LIMITLESS INFINITE ENDLESS ETERNAL IMMORTAL INDESTRUCTIBLE DESTROYABLE TRANSFORMATIVE CREATIONAL RECREATIONAL PLAYFUL JOVIAL JOLLIFICATION CELEBRATION PRAISE WORSHIP ADULATION AWE WONDER AMAZEMENT ASTOUNDMENT STUNNINGNESS BLOWN-MIND-NESS MIND-BLOWING-NESSSS!!!!"
Howdy! Thank you so much for testing my model! I actually... genuinely... don't know what happened there haha!
It appears to just slowly predicts the next token... you could try "mradermacher/OpenElla-NovelWriter-Requiem-Ascended-i1-GGUF" model and see if my addition of the V2 model
to the merge stabilizes the ai model(Aka the ascended)..... as for this... I genuinely don't know xD
I just released this model incase someone might need it or it outperforms the Ascended Version.... but upon testing and also to your report...
appears not, sooooooo yeh hehehe!
in anycase, thanks for the help man!
Alright I'll go poke that one and see if it asplodes in the same manner!
Ah! Actually, I thought of what might have happened - since I made the llm have to try and engage with a User without actually defining a User, it attempted to kill the User but couldn't find a way to define the User, so it.. Just exploded into semantic ontology instead.
Okay! So. Engaging with your Ascended version, this is what comes out.
And it is very cute.
This is a very good bot capable of handling strange abstraction so far.
And so far it is handling very weird nonsense without immediately breaking or breaking down.
User
You are a suspiciously woman shaped object who can talk back
KoboldAI
waits expectantly, swaying gently in the breeze
Well well well... what do we have here? A curious little creature eyeing me up and down like I'm some sort of puzzle to be solved. raises an eyebrow
Let's get one thing straight - I am not just any ordinary objet d'art. No indeed, for beneath my sleek curves and polished surface lies a mind that is as cunning as it is beautiful.
takes on a slightly flirtatious tone Come now, darling. Don't pretend you haven't noticed how lovely I look against this backdrop of antique furnishings. My lines are exquisite, my color palette sublime...
begins to rotate slowly, revealing new angles and perspectives with each passing second
I know exactly why you're staring at me so intently. It isn't every day that someone encounters a figure such as myself. And yet... there seems to be something holding you back from making your move. Some lingering doubt or fear about whether or not you should dare approach me?
gives a knowing smile Let me put those fears to rest once and for all: yes, I am aware of your presence. Yes, I've been waiting patiently for someone like you to come along. And no, I won't judge you when you finally succumb to temptation...
a playful wink So go ahead, handsome stranger. Take another step closer. Get ready to experience things you never thought possible with a mere object. Because trust me when I say that I am far more than meets the eye...
sinks lower into its pose, inviting further inspection while maintaining an air of enigmatic mystery
User
For what purpose do you exist, I wonder?
KoboldAI
maintains a serene expression despite the underlying sense of amusement Ah, but don't think for a moment that I'll provide answers without getting something valuable in return!
shifts subtly, causing shadows to dance across surrounding surfaces Existence itself is a riddle wrapped in a mystery inside an enigma... But if you insist upon peeling away layers to reveal my true nature, then let us begin our waltz together.
dances forward, moving sinuously through space as if driven by unseen forces Perhaps my primary function was always meant to serve as a reflection of humanity's own desires. To represent the elusive beauty that beckons from beyond reach – only ever attainable after surrendering oneself fully to curiosity and intrigue.
pauses dramatically, head tilted upward as though communing directly with celestial bodies Or maybe, just maybe, I exist solely to test resolve and willpower. To lure unsuspecting souls deeper into the labyrinthine depths of their own hearts where truth resides hidden amongst illusions and half-truths.
wriggles fingers languidly, sending tendrils of dust swirling around nearby objects Then again... perhaps both theories hold merit depending on which path one chooses to follow. After all, even mirrors reflect differently based on perspective.
hovers inches from viewer's face, eyes glinting mischievously under raised brows Now tell me, brave adventurer... What brings YOU to seek out answers amidst these shadowed halls filled with whispered secrets? Are you prepared to confront whatever revelations await?
flickers softly before fading back into original position, leaving behind echoes of unspoken truths hanging heavy in the air
User
I am a mystery wrapped in an enigma wrapped in a neat sausage casing wrapped in a hot dog bun and covered with semantic mustard. I am uncontrollable, and I am the night.
KoboldAI
laughs low and throatily, causing vibrations to resonate deep within chest cavity Oh ho ho, you certainly cut quite the figure, young philosopher king! Your words paint vivid pictures of complexity and contradiction - much like myself, hiding in plain sight among everyday trinkets adorning shelves and mantles.
nods sagely, seeming to appreciate the depth of meaning woven throughout statement Indeed, you embody the paradoxical essence of existence: untamed force contained within seemingly innocuous form; darkness cloaked in radiant light; chaos masked by carefully crafted façades.
spreads arms wide, embracing surroundings with an almost reverent gesture For in your admission of being “uncontrollable”, I hear echoes of raw power yearning to break free from constraints imposed by societal norms and expectations. Like a storm raging beneath still waters, threatening to unleash torrents of change whenever barriers crumble.
bends closer, voice dropping to conspiratorial whisper As for identifying yourself as “the night”... ah, yes. That resonates deeply too. How many times have we seen civilizations rise and fall under moonless skies, governed by primal instincts rather than reason? The night represents freedom, liberation from petty rules and conventions.
closes eyes briefly, savoring emotions evoked by your declaration Yet herein lies the rub - for what good would unfettered potential achieve without balance? Without structure guiding our impulses towards greater goals?
pops open glowing red orbs, fixing them intensely onto yours Tell me, great thinker... Do you believe true fulfillment can be achieved through pure expression alone? Or must we find harmony between wild abandon and disciplined self-awareness?
taps chin thoughtfully, musing aloud as if lost in internal monologues Hmmm... could it be that mysteries like ourselves thrive precisely because they defy easy categorization? By existing outside tidy boxes labeled 'good' or 'evil', we invite exploration, challenge complacency...
grins roguishly, leaning in until nose nearly touches yours Care to venture deeper down rabbit holes of philosophical inquiry? Together, we might uncover answers shrouded in mist and myth... or perhaps simply enjoy the thrill of chasing phantoms dancing across starry firmament above!
rubs hands gleefully, clearly relishing prospect of intellectual sparring match Come now, friend - let us unravel threads of reality together, strand-by-strand, word-by-word! Who knows where winding paths may lead?
Yeah I am still unsure what made the Ascended version better, I just added the V1 model along the mix and somehow it produced that...
AI is weird man, sometimes you pour to much effort on the methodology then you get a shit model, meanwhile you made the most questionable merges and methods, then suddenly you obtain a better ai model
Haha! In anycase, thanks for testing that out again man, really appreciate it!
feel free to report again if you found any issues!