Thank you again!
Appreciate the merge with Fiction_BF16! I am liking Midnight Macaw a lot.
Again, this is only in the niche-niche context of the CHIM Skyrim mod and emulating NPCs:
But I tested another evaluation by performing 30 generations each and used DeepSeekv4Flash to compare and summarize the top contenders with the addition of your two new models:
🏆 Rankings
Best Roleplaying
1. Fiction_BF16 — The only model consistently in-character for both NPCs, with unique emotional range. Sigrid: "It's a man's right to ask, and a woman's to answer." Lakhim arcs proud → disappointed → offended across the exchange: "A blade is for a worthy foe, not for a man who offers his presence as a gift."
2. Chimera-X — Best Lakhim persona, with coherent irritation that escalates through distinct insults: "barking orders like a magistrate in a crowded market," "Your lectures are as empty as a dried well." Sigrid is decent but templated.
3. Midnight Macaw — Lakhim has the most memorable desert identity ("Your words are as hollow as a dried-out well"), but Sigrid falls back on the shared template.
4. Dark Soul — Solid for both, but thin range. One standout line — "I'd sooner spit on a draugr than entertain a stranger's advances" — then mostly clones.
5. Shadow Siren — Sigrid is the most templated of the set: "I believe you, traveler. It's a heavy thing, carrying the weight of too many battles" appears nearly word-for-word three times.
6. Moonlight Dusk — Worst consistency. The Lakhim line "Our business is our own, and it concerns a traitor from my homeland. Do not press for details you are not part of" is repeated word-for-word at two points in the same file.
Best Writing / Prose Craft
1. Fiction_BF16 — Highest metaphor density: "A blade is only as useful as the purpose it serves... keep your eyes on the horizon, not on our belts." "The sun will still set on our vengeance." "You have the look of a man who has lived a long life, and perhaps a few too many battles."
2. Midnight Macaw — Has the single best metaphor in the dataset ("Your words are as hollow as a dried-out well") plus dune imagery — but reuses the same insult shape five times.
3. Chimera-X — Vivid and aggressive: "Your lectures are as empty as a dried well," "hunt a scent that has gone cold in the wind." High energy, narrower register.
4. Dark Soul — Occasional color ("keep your steel dry and your mouth shut", "stay out of our shadow") but few crafted lines.
5. Shadow Siren — Functional plain prose, one nice beat: "If you wish to walk it, stay out of our way."
6. Moonlight Dusk — Most repetitive phrasing and the literal duplicate — least craft on display.
Best Storytelling / Scene Advancement
1. Fiction_BF16 — The only Lakhim who offers a real choice with consequence: "stand aside and let us do our work, or come along and see if your steel holds true in a real fight." Real stakes: "We follow the trail of a shadow that has long escaped us." Sigrid reads the scene and hands the player something to answer: "This isn't the sort of place for a man of your stature to be wandering aimlessly."
2. Chimera-X — Gives the player an actionable role: "If you wish to help, find the trail; if not, get out of the way."
3. Shadow Siren — Assigns concrete tasks that move the mission forward: "watch the perimeter while we determine if this Legionnaire's zeal matches his competence."
4. Midnight Macaw — Strong atmosphere ("keep your eyes on the horizon and out of my path") but no real forks or progression.
5. Dark Soul — Tonal and static — sets mood, never advances the scene.
6. Moonlight Dusk — Pure de-escalation, the same beat repeated, and the duplicate-line artifact kills any sense of progression.
📌 Summary
#1 across all categories: Fiction_BF16.
The other five models cluster into a template lockstep — "It's a rare thing to find a man who...", "carrying the weight of too many battles" — that flattens their individual identities. Fiction_BF16 is the only one generating unique, per-scene content with emotional range, craft, and momentum.
Quick reference:
- 🎭 Roleplay: Fiction_BF16 > Chimera-X > Midnight Macaw > Dark Soul > Shadow Siren > Moonlight Dusk
- ✍️ Writing: Fiction_BF16 > Midnight Macaw > Chimera-X > Dark Soul > Shadow Siren > Moonlight Dusk
- 📖 Storytelling: Fiction_BF16 > Chimera-X > Shadow Siren > Midnight Macaw > Dark Soul > Moonlight Dusk