DOC : Improving Long Story Coherence With Detailed Outline Control (2023)

Abstract: We propose the Detailed Outline Control (DOC) framework for improving long-range plot coherence when automatically generating several-thousand-word-long stories. DOC consists of two complementary components: a detailed outliner and a detailed controller. The detailed outliner creates a more detailed, hierarchically structured outline, shifting creative burden from the main drafting procedure to the planning stage. The detailed controller ensures the more detailed outline is still respected during generation by controlling story passages to align with outline details. In human evaluations of automatically generated stories, DOC substantially outperforms a strong Re3 baseline (Yang et al., 2022) on plot coherence (22.5% absolute gain), outline relevance (28.2%), and interestingness (20.7%). Humans also judged DOC to be much more controllable in an interactive generation setting.

## introduction recent advancements in natural language generation systems have fueled increased interest in long-form text generation, in which texts may span thousands of words or more. compared to tasks with shorter outputs, long-form generation involves meaningfully different challenges. it is nontrivial to maintain overarching coherence, or even basic relevance to an initial premise or plan. even the most advanced language models to date, such as gpt4 @xcite , still cite long context as a major direction for further improvement, and require structured planning to generate text longer than a few hundred words. in this work, we focus on long-form story generation, which is representative of the major difficulties in long text generation. only recently have prior efforts even attempted to generate stories of comparable length to human-authored "short stories" (re 3 , yang et al. (2022)). compared to humans, state-of-the-art story generation systems like our detailed controller then maintains faithfulness to the more detailed outline when drafting the main story. re 3 still fall short in numerous areas: common failure modes include insufficient high-level planning resulting in local fluency amid global incoherence, or deviating from said planning even when it exists. to bridge some of this gap, we propose the detailed outline control (doc) framework. while reusing the high-level planning-drafting-revision structure of re 3 , doc improves long-range plot coherence via two complementary approaches. first, our detailed outliner refines a brief initial outline into a more detailed, hierarchical one (figure 1 left). as motivation, a human author might also iteratively refine and expand a brief initial outline before drafting a long document, using the outline to guide a coherent plot rather than improvising plot points on the fly. accordingly, our detailed outliner employs a structured prompting procedure to create a detailed outline with length scalable according to the desired scope of generation. individual outline items are associated with a setting and characters, and are carefully filtered for relevance and coherence in context. second, our detailed controller maintains faithfulness to our detailed outline by controlling passage generation based on corresponding outline items (figure 1 right). because our detailed outline imposes many overlapping soft constraints, the detailed controller must exert sufficient control strength to enforce them. the detailed controller must also accommodate flexible natural language inputs and be computationally efficient when generating with state-of-the-art large language models. we implement the detailed controller as an opt-350m-based controller according to @xcite , designing a contrastive training procedure that aligns summaries to passage prefixes. in particular, we construct fluent hard negatives to encourage lengthy outputs to be not only initially on topic, but relevant throughout. compared to the original re 3 , the previous state of the art in long-form story generation, using doc achieves dramatically higher plot coherence (22.5% absolute gain), outline relevance (28.2%), and even interestingness (20.7%) in pairwise human evaluations (section 4). our ablations indicate that both the detailed outliner and detailed controller are critical (section 5.1). we also demonstrate that doc can generate stories in collaboration with humans, interacting at a high-level planning stage rather than passage-by-passage as in many prior works @xcite , and is overwhelmingly preferred over the original re 3 in this setting (section 4.1). 1 ## related work although we generate stories an order of magnitude longer compared to most prior works @xcite @xcite @xcite , we highlight below several works which employ related ideas. ## detailed outline control we introduce the detailed outline control (doc) framework, aiming to improve long-range plot coherence in automatically generated long stories. ## evaluation experiment setup. our setup is similar to @xcite . the input is just a brief (english) premise, typically 30-60 words, sampled from instructgpt3-175b. the output is a complete story. we do not impose further rule-based constraints, as it is unclear how to define a "story," let alone a "good" story. instead, quality will be judged via human-annotated metrics. ## discussion we have presented the doc framework for improving long-range coherence in long-form story generation. doc uses a detailed outliner to shift creative work from drafting to planning, and employs a detailed controller to maintain faithfulness to the detailed outline during drafting. compared to the prior state-of-the-art, re 3 , doc dramatically improves the plot-coherence, outline relevance, and even interestingness of generated stories according to human annotators. nevertheless, there remain many interesting future directions.