← Back to blog Dramatica Blog

Why Evaluating and Fine-Tuning Dramatica Story Logic Can’t Be Generic

Generic LLM assumptions collapse key Dramatica distinctions, so our evaluation and fine-tuning process enforces structural alignment to expand storytelling possibilities.

February 12, 20263 minute read

Most AI narrative systems fail in a very specific way: they sound plausible while quietly breaking the Storyform. The prose is often polished, the emotions read as real, and the arc feels familiar. But familiar is exactly the problem, because Dramatica is not a mirror of common storytelling assumptions. It is a model of narrative structure, and structure does not care what most people expect.

We ran into this directly while evaluating a new Audience Experience Dynamic: Character Evolution, specifically Steadfast / Holding Out. Our first generation looked good at a glance, but it smuggled in the default cultural bias that “holding out” means “not yet changing.” In practice, it treated Steadfast as delayed Change. That is not a small wording issue; that is a different story argument.

“By the time the forest "regiment" starts acting like real defenders, the audience feels Orrin’s grip loosening by inches–less a breakthrough than a long, painful endurance test where he keeps holding out against uncertainty until he can’t pretend rules alone will keep anyone safe.”

— Initial generated output, Character Evolution - Steadfast - Holding Out

That ending beat sounds emotionally satisfying in a general writing-workshop sense. It also collapses two distinct Dramatica outcomes into one: the Main Character eventually giving up their old approach, versus maintaining it under pressure. If you collapse those terms, you misdiagnose the story. If you misdiagnose the story, every smart downstream suggestion gets dumber.

In Dramatica, Change Resolve and Steadfast Resolve are not value judgments, and they are not growth versus stagnation. They are structural positions in the argument. A Change Main Character adopts a different problem-solving approach by the end; a Steadfast Main Character does not. In complete stories, roughly half of Main Characters are Steadfast, which means resolution often comes from the world, relationships, or other players shifting around a constant center.

From the inside of the character, Steadfast can feel costly, lonely, even tragic. From the outside of the narrative, that same constancy can be exactly what forces everyone else to reveal themselves and move. That is why Holding Out in this dynamic must describe pressure on commitment, not a countdown to surrender. The audience experience is strain, consequence, and ripple effects, not an inevitable conversion arc.

After tuning the evaluation set and fine-tuning for this distinction, the generation stopped implying that Orrin would eventually switch approaches. It started preserving the actual Steadfast pattern: pressure increases, costs rise, and he still holds his line.

“What lands emotionally is that he doesn’t suddenly become a new man; instead, the story keeps pressing him until his steadfast discipline becomes the steady metronome everyone else has to react to.”

— Aligned generated output, Character Evolution — Aligned

That shift is the point of our evaluation and fine-tuning process. We are not narrowing creativity by enforcing Dramatica terms; we are preventing false convergence on one culturally preferred arc. When the model can reliably distinguish Steadfast from Change, authors get more story possibilities, not fewer. Character Evolution is only one appreciation among hundreds in a complete Dramatica Storyform, and every one of those distinctions protects creative range by protecting structural truth.

More stories

Keep reading

View all posts