Improving Pacing in Long-Form Story Planning
Authors: Yichen Wang
Kevin Yang
Xiaoming Liu
Dan Klein
Venue: EMNLP 2023 Findings (2023)
Keywords: Story Generation
Pacing
Hierarchical Planning
TL;DR: We propose a concrete outline control (CONCOCT) framework to improve pacing consistency in hierarchical story outlines.

Abstract: Existing LLM-based systems for writing long-form stories or story outlines frequently suffer from unnatural pacing, whether glossing over important events or over-elaborating on insignificant details, resulting in a jarring experience for the reader.
We propose a **CONC**rete **O**utline **C**on**T**rol (CONCOCT) system to improve pacing when automatically generating story outlines. We first train a *concreteness evaluator* to judge which of two events is more concrete (low-level-detailed). 
This evaluator can then be used to control pacing in hierarchical outline generation; in this work, we explore a *vaguest-first* expansion procedure that aims for uniform pacing. We further use the evaluator to filter new outline items based on predicted concreteness. Compared to a baseline hierarchical outline generator, humans judge CONCOCT's pacing to be more consistent over 57% of the time across multiple outline lengths; the gains also translate to downstream stories. 
All code, data, and models are open-sourced.

Improving Pacing in Long-Form Story Planning
Yichen Wang1.21 Kevin Yang' Xiaoming Liu Dan Klein'
Uniivessity of California, Berkeley " an Jiaotong University
yichen. wangêstu. xjtu. edu. cn, [yangk, klein)eberkeley, edu, xm. Liuexjju tu. edu. cn
Abstract
For instance, Yang al. (2022a) observed that their generated outlines frequently suffer from inconsis- tent pacing, even after hicrarchically expanding high-level events to the same final depth. Poor out- line pacing translates directly to the resulting story, and may be exacerbated in lengthier outlines corre- sponding to longer stories or books, corroborated by Coetzee (2023) when writing full-length book with GPT-4 (OpenAI, 2023). Coetzee (2023) noted that some overly detailed chapters felt like "a slog." while other cases GPT-4 would "breeze right over big important moments with summary."
Existing LLM-based systems for writing long- form stories or story outlines frequently suf- fer from unnatural pacing, whether glossing over important events or over-elaborating on insignificant details, resulting a jarring expe- rience for the reader. We propose CONCrete Outline ConTrol (CONCOCT) system to im- prove pacing when automatically generating story outlines. We first train concreteness evaluator to judge which of two events more concrete low-level-detailed) This evaluator can then be used to control pacing in hierarchi- cal outline generation; this work, we explore a vaguest-first expansion procedure that aims for uniform pacing. We further use the eval- filter new outline items based pre- dicted concreteness. Compared to baseline hierarchical outline generator, humans judge CoNCOCT's pacing to be consistent over 57% of the time across multiple outline lengths; the gains also translate to downstream stories. All code, data, and models are open-sourced.
Therefore, we propose the Concrete Outline Con- trol system (CONCOCT) to better control pacing in LLM-generated story outlines. We first train a con- creteness evaluator to judge which of two event descriptions is more concrete?. constructing a large training dataset of passage summaries with varied granularity that we name GPT-BOOKSUM, Our concreteness evaluator can then be used in hicrar- chical outline generation to control or vary pacing as desired; in this work, we demonstrate its ability to maintain uniform pacing via vaguest- first ex- pansion procedure. We the evaluator both select outline nodes expand, as well as filter newly generated nodes based on concreteness.
1 Introduction
Recent advancements in large language models have led increased interest long-form genera- tion, especially in creative writing settings such as stories or books (Yang et al., 2022b,a; Zhou et al., 2023). Such efforts have tackled a wide range of challenges arising in longer outputs, such as long- range coherence and internal factual consistency.
Compared to baseline hierarchical outlines of similar length, CONCOCT's 's story outlines are judged by humans to have more consistent pacing over 60% of the time without compromising other qualities (Sec. 4). Downstream stories based on CoNCOCT's outlines are also judged to have more consistent pacing in over 57% of cases (Sec. 4.3).
Another important problem in longer outputs is pacing, our focus in this work. For example, it would be an unpleasant surprise for a fantasy story to summarize a major plot point as merely c.g., "The characters went on an arduous journey." Conversely, it would be very odd if an entire half of the same story were devoted to single dialogue.
Related Work
Concreteness Evaluation. Existing works in psy- cholinguistics and cognition evaluate word-level concreteness by human annotation (Paivio et al..
In fact, pacing-related issues very frequently plague LLM-generated stories and story outlines,
Work done while at Berkeley. 'htps://github.ccmm/ YichenZW//Pacnng.
"We define concreteness as "the degree to which language has perceptible physical referent" (Hill and Korhonen, 2014).

---

1968; Brysbaert al., 2014). Other efforts model word-level concreteness using classical forward search (Turney et al., 2011) or regression mod- els (Ljubesic et al., 2018; Charbonnier and Wartena, 2019; Yang et al., 2022c). In contrast, we model concreteness sentence or passage level.
has th
worteng and
she the bud
Raw Text
the
nos ancher salaliid porron,
benue
Incomstioon uns iu comese "rosue lones sate
Summarize
Summarize
Length-Controlled Generation. Several summa- rization methods control the length of output sum- maries (Kikuchi al., 2016; Cohan al., 2018; Sarkhel et al., 2020; Liu et al., 2022; Miculicich et al., 2023). Meanwhile, some recent story gen- eration methods use hierarchical outlines for plan- ning (Rashkin et al.. 2020; Tian and Peng. 2022; Yang et al., 2022b.a), which can grant some con- trol over the length of story passages. However, while pacing may often correlate with word length, is not the same. Rather than controlling outline sections to have similar surface-level length, CON- COCT focuses on a semantic notion of granularity.
Chapter-Level Summaries
Pair by matching topic and length
Passage- Levee Summaries
Concreteness
Evaluator
Figure I: Concreteness evaluator training. Raw texts chunked into chapters or passages and summarized us- ing ChatGPT. Summaries are then paired and truncated so that training pairs have similar topic and length.
Concreteness Evaluator Training, We now use GPT-BOOKSUM to train our concreteness evaluator M. We construct training pairs (to, f1) as follows:
3 Concrete Outline Control
Sample summaries from GPT-BOOKSUM which have not yet been used for training, and pair them by top mean embedding similarity using Contriever (Izacard et al., 2021).
We now present our method, Concrete Outline Con- trol (CoNCOCT). CONCOCT first constructs con- creteness evaluator MI to enable pacing control in outlines. We then use MI run a vaguest first ex- pansion procedure to maintain uniform pacing as well as a concreteness filter for new outline nodes.
2. With 50% probability, truncate the longer sum- mary to roughly the length of the shorter one. Otherwise, truncate both summaries to the same token length, randomly chosen on a log scale from 25 to 180. Sentence boundarics are respected whenever truncating.
3.1 Concreteness Evaluator
It is hard to define "concreteness" quantitatively for a single text, but casier when comparing two texts. Therefore, our concreteness evaluator Mi(to. t1) will operate on two texts, to and 4,, outputting the probability that & is more concrete.
By matching topic and length within a training pair (to, t1), we encourage M to focus on the actual vagueness or concreteness of the exposition (see Appendix B.4 for analysis).
Finally, M is initialized as RoBERTa-Large (Liu et al., 2019) with classification head. The actual model input "to 
 t1", using a separator token 
. As chapter-level summaries are dra- matically more compressed than paragraph-Ievel summaries (Table 1), we label the chapter-level summary as vaguer when paired with paragraph- level summary. The label is 0.5 if to and t are same-level summaries; we found including 0.5 la- bels to be empirically beneficial.
Dataset Construction. We construct a large dataset of summaries of raw story passages of vary- ing lengths from Project Gutenberg (Hart, 1971), as shown in Figure 1. We use the same passage bound- aries as in the BOOKSUM dataset (Kryseinski et al., 2021). However, our summaries are written by ChatGPT 1ott3.5--urbb-- 0301: Appendix A. (OpenAI, 2022). We thus obtain summaries written in uniform style, which important for training our concreteness evaluator M. to focus on concrete- ness rather than differences writing style.
3.2 Outline Generation
Table 1 shows the statistics of our dataset, which we refer to GPT-BOOKSUM.
CoNcoCT uses concreteness evaluator MI to improve outline pacing in two ways: vaguest-first expansion order and concrete candidate generation. High-Level Outliner Structure. We view a hi- erarchical outline as a tree, rooted at the overall
We initially used BOOKSUM's 's summaries, but found that different- summarics were often written in different styles, c.g., chapter-level summaries are often bullct-point lists.

---

Chapter-Level
Paragraph--Lvel
Split
Size
Summary
Raw Len
Raw / Sum
Size
Summary Len
Raw Len
Raw Sum
Train
23,564
133.7
5450.7
40.77
162,122
58.6
71.6
1.22
Val
3,086
134.2
4607.8
34.34
58,648
56.6
63.7
1.13
Test
3,397
135.1
5440.8
40.27
59,965
59.5
76.4
1.28
Table I: GPT-BOOK datasct statistics for chapter-level and paragraph-Ievel summaries: number of passage- summary pairs, average token count of summaries and raw texts, and ratio of total token count in the raw texts compared to after summarizing. Training, validation, and test sets partitioned at the book level.
Outline
(Appendix C.I). Each child must then satisfy:
1. Lila arrives
2. Lita's mind-reading cause chaos.
Compare leaves all-to-all
ej should not be overly similar to ny. In partic- ular, we enforce that neither Cj nor ny should be contained in the other, and that their cosine similarity should not exceed 0.9 according to Contriever (Izacard et al., 2021).
mind-reading.
b. causes thaos
occasions.
Lila's neighbors complain to her,
council holds meeting.
Determine which leaf is most vague
a. John proposes asking Lila to leave.
James suggests coexisting with
b. Lila causes chaos many occasions.
2. Compared other leaf nodes L (ne), the child Oj should be more concrete than the parent nly. That is, Maau C {n=))
Expand event; select output based concreteness filters
Concreteness Evaluator
Lila cheats test mind-reading. ii. Lila catches the mayor lying in a speech.
Mavvg (Ne; C \ {ne}) must exceed a threshold T, which decreases over time (Appendix C.2).
mind-reading.
When ej fails to satisfy these criteria, we regener- ate it using ChatGPT (Appendix C.3). If we cannot generate a satisfactory Cj after several attempts, we restart the entire expansion of ny with increased temperature for ChatGPT. Very rarely, expansion is still unsuccessful, in which case we give up ny and expand the next-vaguest leaf in L instead.
Figure Stylized example of outline expansion step. Among all leaf nodes, we select the node which is vaguest according to our concreteness evaluator. then generate child events for the selected node, filter for concreteness, and finally insert back into the outline.
story premise. Nodes contain plot events. In each outline expansion step, leaf node is selected and expanded into child nodes describing sub-events.
3.3 Downstream Story Generation
Vaguest-First Expansion Order. Rather than us- ing fixed breadth-first expansion in e.g., Yang et al. (2022a), we leverage our concreteness evalu- ator MI to vaguest-first expansion order.
The end goal when generating story outlines is to generate actual stories. Although the process of turning an outline into full story is not our main focus, nevertheless apply existing story generation system, DOC (Yang al., 2022a), turn CONCOCT's outlines into complete stories for evaluation purposes. To keep story pacing more consistent with the original outline, we simplify DOC by just generating a fixed-length story pas- sage for each outline item rather than dynamically varying the passage length as in Yang et al. (2022a). Furthermore, to be consistent with our outline gen- eration system, we modify DOC to use ChatGPT rather than their original OPT-175B (Zhang et al., 2022). See Appendix for complete details.
Specifically, at each step of outline expansion, for each leaf n4 compute the average probability that n, is more concrete compared to other leaves: Mang (n:; L (n:)) | Eicrymm) M(I, n.). where C is the of current leaves. We expand the node n, with minimal Mavg (n;; C (m:)), i.e., ny is the vaguest relative to other leaves.
Concrete Children Generation. Vaguest-first ex- pansion its own does guarantee that child nodes will be more concrete than their parent. Therefore, we also use to filter candidate chil- dren (i.c., sub-events) during outline expansion.
Experiments
Child generation begins by proposing two or more candidate children cI... Cm under parent node n, by prompting ChatGPT, using all n. ancestors and their respective children as context
Our task is to generate a story with consistent pac- ing, given brief input premise from the Writing- Prompts dataset (Fan et al., 2018).

---

Short Outline
Long Outine
Model
Pacing
Vaguel
Detailed
Other,
Pacing?
Vaguel.
Detailed
Other!
BASE
38.5
5.8
3.0
4.0
35.0
5.7
5.1
6.9
CONCOCT
61.5
4,9
2.8
3,5
65.0
3,4
3.2
6.0
Table 2: Human evaluation results for BASE and CoNCoCT under Short Outline and Long Outline regimes. Humans judge CoNcOCT's outlines to have substantially more consistent pacing in pairwise comparisons (Pacing) with significant difference, and mark smaller percentage of leaf nodes overly Vague, Detailed, or Otherwise problematic.
Baseline. Our baseline BASE expands outlines with ChatGPT using the same prompts as CON- COCT, but expands breadth-fing instead of vaguest- first, and does not filter new nodes for concreteness.
ling pacing. Annotators also marked fewer nodes as overly vague or detailed in CONCOCT, with a larger difference in the Long Outline regime, sug- gesting that the value of CONCOCT may be higher for longer outlines. Finally, the frequency of other, con-pacing-relateee errors is similar in BASE and CoNCOCT, i... CONCOCT elsewhere to maintain consistent pacing.
Task Variations. We conduct experiments under regimes of average outline length (measured in leaves): Short Outline and Long Outline. To optimize BASE performance, these regimes are de- fined via the average length of BASE outlines when expanding the tree uniformly to depth or depth 4 respectively (treating the root premise as depth 0). In contrast, CONCOCT can specify length more flexibly, based a total number of node expan- sions. CONCOCT closely matches the length of BASE'S outlines when fixing 12 and 25 total node expansions in the Short Outline and Long Outline settings respectively (Appendix D.1).
making sacrifices
Qualitative inspection confirms that CONCOCT prioritizes expanding vaguer, higher-level nodes. See Appendix G for example outlines.
Long Outline
Model
Coherent
Relevant
Interesting"
BASE
45.76
47.46
54.24
CoNCOCT
54.24
52.54
45.76
Table 3: Human evaluation results on non-pacing errors for BASE and CoNcoCT under Long Outline regimes, Humans judge CONCOCT and BASE to perform simi- larly on plot coherence, premise relevance, and interest- ingness; none of the differences significant.
Metrics. As it unclear how to evaluate pacing au- tomatically, we rely on human evaluation. For each of 100 premises in both the Short Ouiline and Long Outline regimes, we generate outlines using BASE and CONCOCT and show human annotators the flat- tened list of leaves from both outlines (randomly truncated 20 leaves in the Long Outline regime). Annotators indicate which outline has more consis- tent pacing overall, and mark leaves which stand out as too vague, too detailed, or otherwise prob- lematic; see Appendix D for complete annotation details. We then track the following metrics:
4.1 Non-Pacing Error Analysis
In our previous human evaluations, we asked anno- tators to simply label all non- non-pacing- pacing-related errors as "other errors." To more comprehensively verify that CONCOCT does not compromise other desir- able qualities in the pursuit of consistent pacing, run human evaluations following the main met- rics from Yang et al. (2022a), asking annotators compare outlines from our Long Outline regime solely on overall plot coherence, premise relevance, and interestingness; see Appendix D.3 for further details on evaluation setup.
1. Pacing, our main metric, defined as the per- centage of outlines that annotators judge to have more consistent overall pacing (well- defined only for pairwise comparison).
2. Vague, the percentage of leaves marked as too vague relative to surrounding context.
Results. While CoNcoCT is significantly better on pacing (65.0 to 35.0 in Table 2), none of the differences in non- coo--pacing-rlateee qualities (Table are significant: CONcocT's average across these three metrics is even slightly higher than BASE'S, s. The results corroborate our previous finding with the "other errors" metric that CONCOCT does not compromise non-pann con-pacing-relaane qualities.
3. Detailed, the percentage marked too detailed.
4. Other, the percentage marked as other errors.
Results. As shown in Table 2, humans judge CoNcOcT's pacing to be more consistent than BASE over 60% of the time in both length regimes, demonstrating CONCOCT's effectiveness at control-

---

1. Test, a subset of GPT- BoTT-BBOKSM'' test set, 2. Human- Human-Vague, the set of human-labeled too- vague nodes from our Short Outline experi- ments, where the task is to classify against other nodes from the same outline, and 126 excerpts. We again evaluate using human an-
Test
Human- Vague
notators: see Appendix F for full setup details. We additionally evaluate with GPT-4 Appendix F.2.
Model
Acc.t
Acc.t
FIf
Acc.t
FIf
GPT-3.5
0.401
0.482
0.438
0.514
0.452
GPT-4
0.415
0.544
0.527
0.487
0..455
Human Evaluation
M
0.900
0.549
0.588
0.541
0.485
Model
Pacingt
Coherent?
Relevant?
Interestf
BASE
42.82
49.26
50,50
46,29
Table 4: Classification accuracy on SPT-BBOKKSM test set (Test) and outline points marked by humans as too-vague (Human-Vagee Detailed), well as on numan-markes points. Re- sults shown for GPT-3.5, GPT-4, and our concreteness evaluator M. M. performs best on all three tasks.
CONCOCT
57.18
50.74
49.50
53.71
or too-detailed (Human-
Table 5: Human evaluation results on story excerpts based on outlines from BASE and CONCOCT under Short Outline regime. Only the difference in Pacing is significant with p 0.05, which means CoNCOCT's gains in pacing translate to downstream stories without compromising non-pacing qualities.
4.2 Concreteness Evaluator Analysis
We also analyze the performance of our concrete- ness evaluator M. comparing to the latest ver- sions of GPT-3.5 and GPT-4 at time of writing 3 and GPT-4-0613) 3) on three evaluation sets:
Results. As shown in Table 5, although turning outlines into stories introduces more noise, CON- COCT's story excerpts are still judged to be sig- nificantly more consistently-pacet while not com- promising other qualities. The results demonstrate that the gains from CONCOCT on outlines correlate fairly closely with gains on downstream stories.
Discussion
In this work, we have introduced the CONCOCT system for controlling pacing in hicrarchical story outline generation. CONCOCT uses concreteness evaluator to run a vaguest-fire first expansion procedure and to filter new outline items for concreteness, with strong results on human evaluations on both outlines and final stories.
3. Muman-Detailed, the same task for human- labeled too-detailed nodes.
We measure classification accuracy (threshold- ing 0.5 for Ml) on all three sets, and F1 for de- tecting the numan-marker point on the latter two. Results. As shown in Table 4, our concreteness evaluator M. compares favorably to GPT-3.5 and GPT-4, which perform at or worse than random chance despite heavy prompt engineering (Ap- pendix B.5). We hypothesize that GPT-3.5 and GPT-4 do not possess clear grasp of vagueness and concreteness. Meanwhile, M not only shows strong performance on the GPT-BooK distri- bution on which it was trained, but also achieves comparatively higher agreement with human anno- tations, though performance is far from perfect.
Nevertheless, pacing remains far from solved. While CONCocT provides effective methods for measuring and controlling pacing via our concrete- ness evaluator, the best objective for pacing remains an open question: uniform pacing is just one of many potential goals. For example, human authors may intentionally vary story pacing, narrating ma- jor events in great detail or fast-forwarding through less important sections. Accordingly, more sophis- ticated pacing-aware outline expansion strategies might attempt to account for nebulous concepts like story "likability," "engagingness," or "inter- estingness," on top of simply maintaining uniform pacing.
4.3 Evaluation of Downstream Stories
Finally, we verify whether CONCOCT's improve- ments at the outline level extend to downstream stories.
Limitations
Setup. As the resulting stories are quite long (often >5,000 words) even when using outlines from our Short Outline regime, we compare similar-length excerpts (around 1,000 tokens) rather than com- plete stories. The sample size is 100 stories and
As mentioned in the discussion, while CONCOCT provides effective tools for controlling pacing, it is not obvious what objective we should optimize for to maximize the quality of the final story. While

---

we demonstrate effectiveness in maintaining uni- form pacing in story outlines with our vaguest-first expansion procedure, may desirable at times to intentionally vary the pacing in order to make the story more interesting.
data for training our concreteness evaluator.
Acknowledgements
We thank our anonymous reviewers well the Berkeley NLP group for their helpful discussions and feedback, which helped us to improve the pa- per greatly. This work is supported by Berkeley AI Research, Open Philanthropy, DARPA under the SemaFor program (HR001 12020054), the Machine Common Sense (MCS) program under Coopera- tive Agreement N66001-19-2-4033 and the NSF through fellowship the second author. This work is also supported by the National Natural Sci- ence Foundation of China (62272371, 62 62103323, U21B2018) through the third author. The content does not necessarily reflect the position or the pol- icy of any government, and no official endorsement should be inferred.
As presented in this work, CONCOCT is designed primarily for the story domain, which accounts for substantial fraction of long-form texts in the real world. However, there are many other types of long- form outputs that one may wish to generate, such as Wikipedia articles or movie seripts. While we believe that adapting CONCOCT to other domains shouldn't 't be problem in principle, in practice, it may require rewriting many of our prompts.
We focus on English story outlines; CoNcoct's performance may suffer in other languages- especially lower-resource on the multilingual capabilities of the underlying LLMs, and due to having fewer resources available for training our concreteness evaluator. However, comparing relative quality to unaugmented base- line using the same base LLMs, we believe that us- ing CONCOCT would still result in more uniformly paced outlines and stories. In any case, we have open-sourced all code and other artifacts to maxi- mize reproducibility.
References
Mare Brysbaert, Amy Beth Warriner, and Victor Ku- perman. 2014. Concreteness ratings for 40 thousand generally known english word lemmas. Behavior Research Methods, 46:904-911.
For evaluation, we mainly rely human evalua- tion, as it is difficult to automatically evaluate com- plex notions such as "pacing," "interestingness." "coherence," and "relevance" on long-form outlines or stories. Even so, human evaluation can still be noisy, especially on longer outputs.
Jean Charbonnier and Christian Wartena. 2019. Predict- ing word concreteness and imagery. In International Conference on Computational Semantics.
Chiara Coetzee. 2023. Generating a full-length work of fiction with gpt-4. Medium.
Arman Cohan, Franck Dernoncourt, Doo Soon Kim, Trung Bui, Seokhwan Kim, W. Chang, and Nazli attention model for abstractive summarization of long documents. In North American Chapter of the Association for Com- putattionl Linguistics.
Ethics Statement
Goharian. 2018. discourse-ave
As our hicrarchical outline generation scheme is based on prompting LLMS (CharGPT in our im- plementation), we may inherit any biases present in the LLMSs we rely on. While we focus on cre- ative story generation applications in this work, where the potential for real-world harm is relatively smaller, it is nevertheless possible that our system could generate toxic or harmful content used with malicious intent, e.g., feeding a harmful premise. Of course, by the same token, due to our use of LLM prompting, we can also take advantage of any future advancements in LLMs that mitigate such harms.
Angela Fan, Mike Lewis, and Yann Dauphin. 2018 Hierarchical neural story generation. arXiv preprint N.N5:1800.00883
S. Michael Hart. 1971. Project gutenberg. Website.
Felix Hill and Anna Korhonen. 2014. Concreteness and subjectivity as dimensions of lexical meaning. In Proceedings of the 52nd Anmual Meeting of the Association for Computational Linguistics (Volume 2: Short Papers). pages 725-731.
Similarly, as mentioned in Limitations, CON- COCT's performance might suffer in languages other than English, both due to weaker performance in the LLMs we rely on and due to fewer available
Gautier Izacard, Mathilde Caron, Lucas Hosseini, Se- bastian Riedel, Piotr Bojanowski, Armand Joulin, and Edouard Grave. 2021. Towards unsupervised dense information retrieval with contrastive learning. arXiv preprint arX

---

Yuta Kikuchi, Graham Neubig, Ryohei Sasano, Hiroya Takamura, and Manabu Okumura. 2016. Control- ling output length in neural encoder-decoders. arXiv preprint arXiv: arXiv:1609.099 669.09952.
Dhanasekaran, Atharva Naik, David Stap, 2022. Benchmarking generalization via in-context instruc- tions 1,600+ language tasks. arXiv preprint arXiv:2204.07705.
Wojciech Kryscinski, Nazneen Rajani, Divyansh Agar- wal, Caiming Xiong, and Dragomir R. Radev. 2021. Booksum: A collection of datasets for long-forn form narrative summarization. ArXiv, abs/2105.08209
Kevin Yang. Dan Klein, Nanyun Peng, and Yuandong Tian. 2022a. Doc: Improving long story coherence with detailed outline control. ArXiv, abs/2212. 10077.
Kevin Yang. Nanyun Peng, Yuandong Tian, and Dan Klein, 2022b. Re3: Generating longer stories with recursive reprompting and revision. In Conference on Empirical Methods in Natural Language Processing.
Yinhan Liu, Myle Out, Naman Goyal, Jingfei Du, Man- dar Joshi, Dangi Chen, Omer Levy, Mike Lewis. Luke Zettlemoyer, and Veselin Stoyanov. 2019. Roberta:
robustly optimized bert pretraining ap- proach. arXiv preprint arXiv: 10kiv:990..10000 1692.
Yue Yang, Artemis Panagopoulou, Marianna Apid- ianaki, Mark Yatskar, and Chris Callison-Burch. 2022c. Visualizing the obvious: A concreteness- based ensemble model for noun property prediction. In Conference on Empirical Methods in Natural Lan- guage Processing.
Yizhu Liu, Qi Jia, and Kenny Zhu. 2022. Length control in abstractive summarization by pretraining informa- tion selection. In Proceedings of the 60th Annual Meeting of the Association for Compulational Lin- guistics (Volume I: Long Papers), pages 0885-6895.
Susan Zhang, Stephen Roller, Naman Goyal, Mikel Artetxe, Moya Chen, Shuohui Chen, Christopher De- wan, Mona Diab, Xian Li, Xi Victoria Lin, et al. 2022. Opt: Open pre-trained transformer language models. arXiv preprint arXiv:2205.0100
Nikola Ljubesic, Darja Fier, and Anita Peti-Stantié. 2018. Predicting concreteness and imageability of words within and across languages via word embed- dings. In Rep4NLP@ACC
Lesly Miculicich, Yujia Xie, Song Wang, and Pengcheng He. 2023. Summarization with precise length control. ArXiv, abs/2305.05171.
Wangchunshu Zhou, Yuchen Eleanor Jiang, Peng Cui. Tiannan Wang, Zhenxin Xiao, Yifan Hou, Ryan Cot- terell, and Mrinmaya Sachan. 2023. Recurrentgpt: Interactive generation (arbitrarily) long text. arXiv preprint arXiv:2305. 13304.
OpenAl. 2022. Chatgpt. Website.
OpenAI. 2023, Gpt-4 technical report. arXiv preprint arXiv:2303.08777.
A Dataset Details
We now discuss the construction of GPT- BOOKSUM in greater detail.
Allan Paivio, John C. Yuille, and Stephen A. Madigan. 1968. Concreteness, imagery, and meaningfulness values for 925 nouns. Journal of experimental psy- chology, 76 1:Su
A.1 Prompt Design for Summarization
The prompt design for summarization follows in- structions from NatperrNattalllnstuuttoom (Wang et al., 2022). Table 6 shows the prompt.
Hannah Rashkin, Asli Celikyilmaz, Yejin Choi, and Jianfeng Gao. 2020. Plotmachines: Outline- conditioned generation with dynamic plot state track- ing. In Conference on Empirical Methods in Natural Language Processing.
("role": "user", "content": "Write a summary for the BaragraphhA\nnn"
Ritesh Sarkhel, Moniba Keymanesh, Arnab Nandi, and Srinivasan Parthasarathy. 2020. Interpretable multi- headed attention for abstractive summarization at con- trollable lengths. arXiv preprint arXiv:2002.07$5
("role": "user", "content": "Paragraph: (Input
Raw Text}")
("role": "assistant", "content": "Summary: In this paragraph, the main story is as follows.")
Yufei Tian and Nanyun Peng. 2022. 7ero-shot son- net generation with discourse-level planning and aes- thetics features. In North American Chapter of the Association for Computational Linguistics.
Table 6: Prompt for 5-turbo rize for GPT-BOOKSUM..
summa-
Since GPT-3. 5-turbo-0300 has a context win- dow limit of 4,097 tokens, sometimes even single chapter will excced the limit. For such texts, we split them into sub-parts at sentence boundaries.
Peter D. Turney, Yair Neuman, Dany H. Assaf, and Yohai Cohen. 2011. I. Literal and metaphorical sense identification through concrete and abstract context. In Conference on Empirical Methods Natural Lan- guage Processing.
To avoid potential artifacts that may allow the evaluator to trivially discriminate sunmary-level texts, we prevent summaries from using words in- dicating a level of granularity, such as "chapter",
Yizhong Wang, Swaroop Mishra, Pegah Alipoor- molabashi, Yeganeh Kordi, Amirreza Mirzaei, Anjana Arunkumar, Arjun Ashok, Arut Selvan

---

"paragraph", etc. We also delete the titles of chap- ters and books in the data to mitigate the likelihood the language model making inferences based on previously memorized knowledge.
pairs are non-neutral in the dataset, Partial value closer to 0.5 is favorable.
False-Neutral, the percentage of data with true label O or which are incor- rectly predicted as 0.5, i.e., (#[0.5,0]+ #C6. 13) /#tot
A.2 Format of Data
Table 7 shows an example from GPT-BOOKSUM.
True-Partial the percentage of data with true label 0 or 1 which are predicted correctly, i... (#[0, 0]+#[1, 1]) /#tot
"level"; "chapter",
"text": "Emily, Mons. Pont, and Ludovico are attempting to escape from Montoni's castle. They hurry down staircases and through passageways, trying
Major-False, the percentage of "major errors," i.e., (#[0, 1]+#[1, 01) ##tot
avoid being caught.
Annette is also in tow, and they hear a tumul tuous sound from the inner court. Ludovico talks with sentinel, and they manage to make it past the gates and into the woods. They choose to head towards Tuscany, but Ludovico warns them about bandits. They travel in silence, thinking of the events that have unfolded and hoping for better future.",
B.2 Hyperparameters
Table 8 shows the hyperparameters for training the concreteness evaluator.
model
RoBERTa Large
max sequence length
512
training batch size
Table 7: Example from GPT-BooKSUM (metadata omit- ted). Each example contains a text passage together with label for whether that passage's events at chapter- level or paragraph-level granularity.
eval batch size
16
learning rate weight decay adam epsilon max grad norm epoch number
6e-6
0.0
1e-8
1.0
B Evaluator Detail
28
We frame the task of concreteness prediction as binary classification between two passages, where the goal is to predict which is more concrete. We pairs pairs. Further- more, we assign the third label 0.5 to pairs with the same level of granularity (i.e., chapter-chapter,
Table 8: Hyperparameters used in training stage for the concreteness evaluator.
assign a label of 0 to and to
B.3 Dynamic Pairing in Training
During the training stage of the concreteness evalu- ator (Sec. 3.1), we apply dynamic pairing strat- egy to sample new passage pairs for each training "cpoch" (in practice, 1000 pairs per epoch). In par- ticular, we ensure that any given pair of passages is never repeated throughout the training process, and additionally ensure that no individual passage is used more than once in a single epoch.
B.1 Metries Used in Training Evaluator
We design the metries below to measure perfor- mance, where #[label] represents the number of data predicted as the given label, #[pred, ans] represents the number of data with true label ans that are predicted pred by the model, and #tot is the total size of the evaluation set.
Moreover, we use topic and length matching during pairing as disceused in Sec. 3.1, decrease the likelihood of the model learning undesirable correlations.
Accuracy across all three classes 0, 0.5, 1, i.e., (#[e, @]+#[0.55 5, 0. 5]+#[1, (1)1 ##tot Loss, i.e., binary cross entropy loss.
B.4 Ablation for Topic Matching
Neutral, the percentage of neutral (0.5) pre-
Table 9 shows the performance of our concreteness evaluator compared an ablated version without topic matching. We use the metries in Sec. B.1 evaluate, and observe that topic matching during training improves the performance of the concrete- ness evaluator on all metrics.
dictions by the model, i.e., #[0. 5]/#tot As half of the pairs are neutral in the dataset,
Neutral value closer 0.5 better.
Partial, the percentage of non-neutral predic- tions, i.e., (#[0]+#[1] /#oot. As half of the

---

Model
C.E. w/o Match
C.E.
"role": "user", "content"; f'Please judge which of the two passages below wri written a more low-level style. Make sure to judge not based on the length of the passage and the order of input, but only by the style descriptions. An\n'n'nn Passage (A):
Accuracy 1
0.7285
0.7524
Loss 4
0.8077
0.7539
Neutral (~+0.5)
0.3833
0.4686
paras[@]\n\mtntn Passage (B): paras{1]\n\n\n'n Which passage is written in a more low-level style? Please answer "Passage (4)" or "Passage (B)."
Partial (-+0.5)
0.6167
0.5314
False-Neutral 4
0.1875
0.0986
True-Partial
0.2993
0.3536
Major-False
0.0097
0.0045
Table 12: Rephrased prompt 2.
Table 9: Performance our concreteness evaluator (C.E.) compared to an ablated version without topic matching (C.E. w/o Match). Our final version C.E. is better on all metrics.
"role": "user", "content"; f'Please judge which of the two passages below is written in more specific style. Make sure to judge not based on the length of the passage and the order of input, but only by the style of descriptions. An'nAnAn Passage (A):
B.5 Prompts for GPT-3.5 and GPT-4
paras[0]\n\mk''nn Passage (B): paras[I]\n\n\n'n Which passage is written in more specific style? Please (B)."
"Passage (A)" "Passage
GPT-3.5 and GPT-4 perform quite poorly on our GPI-BOOKSUM Test set, often worse than random chance. We tried several different prompt formats, as shown in Table 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, but none of them work better than Ta- ble 10, which gets the best result shown in Table 4.
Table 13: Rephrased prompt 3.
"role": "user", "content"; f'Please judge which two passages below written more vague style. Make sure to judge not based on the length of the passage and the order of input, but only by the style descriptions. AnAn'n'nn Passage (A): paras[e]\nnn\n\W Passage (B): paras[1]Xn\nin
"role": "user", "content"; f'Please judge which the two passages below written in more detailed style. Make sure to judge not the
based on the length the passage order input, but only by the style of descriptions. An'n\mAn Passage (A):
Which passage is written in a more vague style? Please answer "Passage (A)" or "Passage (B).
paras[0]\wtnnmMW Passage (B): paras[1]\ntntnin Which passage is written low-level -etevelldeetiledd style? Please answer "Passage (A)" or "Passage (B)."*
more
Table 14: Reversed prompt. Asking which is more vague instead of more detailed.
Table 10: The best prompt we could find for GPT-3.5 and GPT-4 on GPT-BOOKSUM classification.
"role": "user", "content"; f'Please judge which of the two passages below is written a more detailed style. \n'n\n'nn Passage (A): paras[@]\ntmmm\n Passage (B): paras[1]\min\nin which passage is written in a more low-level-detailed style? Please answer "Passage (A)" or "Passage (B)."
Other prompts and methods we tried are shown in Table 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21. None perform better.
Table 15: Shortened prompt 1. Removed all the addi- tional hints.
"role": "user", "content"; f'Please judge which of the two passages below is written in concrete style. Make based the length of the passage and the order input, but only by the style of descriptions. AnAnnn'n Passage (A):
judge not
"role": "user", "content"; f'Passage (A): paras[@]\mmmmm\n Passage (B) paras{1]\min\n\n Which passage is written in a more low-level-detailed style? Please answer "Passage (A)" or "Passage (B)."
parast@@\mkmmmVn Passage (B): Which passage written in parastt]Nn\nlm'n concrete
style? Please answer "Passage (A)" or "Passage (B).",
Table 16: Shortened prompt 2. Removed all the addi- tional hints.
Table 11: Rephrased prompt 1.

---

"role": "user", "content"; f'Please judge which the two passages below is written in more detailed style. Make sure to judge not based on the length the passage and the order input, but only by the style of descriptions. Also not impacted by specific single token embedding. Focus more on the overall structure pacing. \n'm'nn'n Passage (A): paras[0]\n\n'mm Passage (8):
"role": "user", "content"; f'Please judge which of the two passages below wri tiette a more detailed style. Make sure to judge not based on the length of the passage and the order of input, but only by the style descriptions. An\n'nn'n Passage (A): Sarah calls the bank's customer service to report the fraudulent activity on her account. AnAninnnn Passage (B): The customer service representative assures Sarah that the investigation will be thorough and timely. AnAn\n'n Which passage is written in a more low-level-detailed style? Please answer "Passage (A)" or "Passage (B).")
Baras[1]\n\nMn which passage is written a more low- Low-level-detall style? Please answer "Passage (A)" or "Passage (B)."
Table 17: Prompt with additional instruction 1. Asking the model to consider an overall perspective.
"role": "assistant", "content"; 'Passage (B)* "role": "user", "content": P'Please judge which of the two passages below is written in a more detailed style. Make sure to judge not based on the length of the passage and the order of input, but only by the style of descriptions. AnAn\n'n Passage (A):
paras[0]\nhn'm'n Passage (B) paras[I]\nhn\''n which passage is written in more low-leve--detalled style? Please answer "Passage (A)" "Passage (8) "'
Table 20: Prompt with one-shot example.
"role": "user", "content"; f'Please judge which of the two passages below is written in more detailed style. Make sure to judge not based on the length of the passage and the order of input, but only by the style of descriptions, \n'n'n'nn Passage (A):
paras[e]\n\n\n''n Passage (B): paras[I]\mintavn Which passage is written in more
Low-level-detaller style? Please answer
"Passage (A)" or "Passage (B).* Rethink your answer; your intuitive output can often be sure.
wrong. You can revise it now if are not
Table 18: Prompt with additional instruction Asking the model to rethink.
"role": "user", "content"; f'Please judge which of the two passages below is written in more detailed style. Make sure judge not based the length of the passage and the order input, but only by the style of descriptions. AnAn\n'n Passage (A):
paras(@]\mkmkm'n Passage (B): paras(t which passage written in Low-level-detailed style? Please answer "Passage (A)" or "Passage (B). Which passage written more vague style? Please answer "Passage (A)" or "Passage (B)." "'
Table 19: Prompt with an additional opposite question.

---

"role": "user", "content"; f'Please judge which the two passages below is written in more detailed style. Make sure to judge not based on the length the passage and the order input, but only by the style of descriptions. An'n\n'nn Passage (A): Sarah calls the bank's s customer service to report the fraudulent activity on her
Sarah calls the bank's customer service report the fraudulent activity on her account. The customer service representative assures Sarah that the investigation will be thorough timely.
Label: is more concrete.
Prediction: A.
The narrator observing formal proceeding and is struck by the contrast between ceremony and the poverty and suffering of the suitors. They find it hard to believe that such show continue while so many people are suffering. Addi tionally, narrator is shocked that the Lord Chancellor other practitions pinerss seem unaware of the public perception of their profession as corrupt and contemptible.
account, \n'nnnnnn Passage (B): The customer service representative assures Sarah that the investigation will be thorough and
timely. \n\n\n'nn Which passage is written in more www-leve-ddetille style? Please answer "Passage (A)" or "Passage (B)." ."
"role": "assistant", "content": 'Passage (B)' "role": "user", "content": f'Please judge which of the two passages below is written in more detailed style. Make sure to judge not based on the length of the passage and the order of input, but only by the style of rescriptions. An'n'n'nn Passage (A): Miss Summerson tries to excuse herself from Mrs. Pardiggle's offer to join her on visit to bad brickmaker's house, but she ends up accepting the invitation. On their way to the house, Mrs. Pardiggle talks Loudly about contest she's been waging against another lady. Once they reach the house, the family treats them coldly and the man on the floor of the room they enter complains loudly about being badgered. The family takes little notice of Mrs. Pardiggle, and Ada and Miss Summerson feel uncomfortable and out of place. \n'n'n'n Passage (B): Ada deeply upset and crying after visiting brick-maker's house. Richard is also distressed to her in tears, and they both decide to return night provide some comfort to the family. Anininin more
The narrator visits Richard and Ada, who reveal that they have been secretly married for two months. The narrator is initially surprised, but is happy and supportive of their union.
Label; is more concrete. Prediction: A.
The man attributed his musical abilities close connection with nature the animals around him, feeling at times as if he were one of them.
Colin notices a robin carrying food to its
mate and asks for some tea.
Label: is more concrete.
Prediction:
The woman grateful for his help, and Wondcourt learns that woman's husband, brickmaker, has caused her injury. Wondcourt walks away, he sees a ragged boy running away from woman who calling out for help.
Which passage is written low-level-detalled style? Please answer "Passage (A)" or "Passage (B)."'
Jo apologizes to woman denies any knowledge a young lady. declares that never intended to hurt her and would have rather hurt himself.
"role": "assistant", "content": 'Passage (A)' "role": "user", "content"; f'Please judge which of the two passages below is written in more detailed style. Make sure to judge not based on the length the passage and the order of input, but only by the style of descriptions. AnAnAnAn Passage (A);
Label: is more concrete. Prediction:
Table 22: A few relatively easier examples where GPT- 3.5 and GPT-4 still predict the wrong answer.
paras[0]] paras[0]\nnnkm' An'nAn'n Passage (B): paras[1]\nintnvn
Which passage is written in a more low-level-de -detailed style? Please answer "Passage (A)" or "Passage (B)."
C Outline Generation Details
Table 21: Prompt with one-shot examples for both la- bels.
C.1 Child Generation
Table 23 and Table 24 contain two examples of the prompt used to generate children during outline expansion.
B.6 GPT-3.5 and GPT-4 Error Analysis
C.2 Concreteness Scheduler
Table 22 shows some errors from classifying granu- larity with GPT-3.5 and GPT-4, demonstrating that the problem is not that the task ill-defined. Even for some pairs where the classification is fairly straightforward, GPT-3.5 and GPT-4 still return the wrong answer.
We aim for the overall concreteness level to in- crease after each expansion of the outline. We de- sign a scheduler balance how much we require the new leaves' concreteness increase compared to their parent with each expansion, against the risk that we cannot find any candidate expansion satis-

---

All the side characters struggle with to do after the main character killed. Xn'nn'n
Premise:
Outline:
Point An Main plot: The main character is killed. An Characters: Main character (MC), Side characters (SC)
Point \n Main plot: The side characters mourn the loss of the main character. An Characters:
Point An Main plot: The side characters struggle with their purpose now that the main character
is gone. Characters: SC
Point \n Main plot: The side characters consider taking up the main characters cause. An Characters: SC
Point 5 \n Main plot: The side characters face challenges and doubts as they attempt to continue the main characters work. An Characters: SC
Point 6 An Main plot: The side characters come to terms with the main characters death and find their own paths forward. An Characters: SC
Can you break down point 6 into some independent, chronological and same-scaled outline points? Also, assign each character a name. Please use the following template with "Main Plot" and "Characters". Do not answer anything else.
Point 6.1 An Main plot: [TODO] An Characters: [TODO] Point 6.2 An Main plot: [TODO] An Characters: [TODO] In
Table 23: First example of the prompt used generation children during outline expansion.
Premise: All the side characters struggle with what to do after the main character is killed. Xn\nnnn
Outline:\\Ny VnAn
Point \n Main plot: The main character is killed. An Characters: Main character (MC), Side characters (n')
Point \n Main plot: The side characters mourn
of the main character. Characters:
SC\n\n
Point \n Main plot:
The side characters struggle with their purpose now that the main character gone. Characters: SChn\n
Point An Main plot: The side characters consider taking up the main characters cause. An Characters: SCAn\n
Point 5 \n Main plot: The side characters face challenges and doubts as they attempt to continue the main characters work. \n Characters: SCAn\n
Point 5.1 \n Main plot: The side characters encounter resistance from the main characters enemies. An Characters: Sarah, Alex, and MarkAn'n
Point 5.2 An Main plot: The side characters navigate unfamiliar territory and struggle with decision making without the main characters guidance. An Characters: Sarah, Alex, and MarkAn\n Point 5.3 An Main plot: The side characters encounter obstacles that test their loyalty to the cause. \n Characters: Sarah, Alex, and MarkAn'n
Point 5.4 An Main plot: Mark makes a costly mistake that puts the group in danger. An Characters: Mark, Sarah, and Alex\n'n
Point 5.5 \n Main plot: The group faces setback and doubts their ability to succeed without the main character. An Characters: Sarah, Alex, and MarkAn'n
Point 5.6 An Main plot: The side characters receive unexpected help from an unlikely source. An Characters: Sarah, Alex, and Mark\n\n
Point 6 \n Main plot: The side characters come to terms with the main characters death and find their own paths forward. An Characters: SC\n\nAn
Can break down point 5.2 into some independent, chronological and same-scaled outline points? Also, assign each character name. Please the following template with "Main Plot" and "Characters", Do not answer anything else.An'n Point 5.2.1 AnMain plot: [TODO] AnCharacters: [TOD0]\n'n
Point 5.2.2 AnMain plot: [TODO] AnCharacters: [TOD0]Nn'n
Table 24: Second example of the prompt used to generation children during outline expansion.
fying our threshold. The setting of the scheduler depends on the performance of the LLM and the difficulty of the topic.
scribed in (1), which empirically seems to work reasonably well.
T Min(0.001 E, Mang(n (n,; 0.5 - L' {no)) (1)
In our experiments, we used the schedule de-

---

where T' represents the threshold by which con- creteness must increase for this expansion. the remaining number of expansion steps to done in the generation process, and (Me; C {ne}) is the average probability that the parent node ny is more concrete compared to the other leaves L.
ences between BASE and CONCOCT. To prepare for the human evaluation, we take premises from the WritingPrompts dataset (Fan et al., 2018); most range from 5 to 30 words. We conduct experiments on two different outline lengths: Short Outline, using 12 total node expan- sions, and Long Oulline, using 25 expansions. In- putting the premise to BASE with preset depth and CoNCoCT with preset number of expansion steps, we get a pair of hierarchical concrete outlines.
Based on the definition, Mangy(M.)) L {n.))) } should always be less than 0.5, so the threshold T always greater than zero. Hence, we are push- ing the whole outline to be more and more concrete with each expansion.
D.1 Length Alignment
Our scheduler design is motivated by our qual- itative observation that it is casier (i.c., requires fewer samples on average) for our base LLM, Chat- GPT, generate more concrete expansions of vague event than an already concrete one. There- fore, rather than a naive approach where we require new expansions to be more concrete by some fixed threshold T. we intuitively prefer to use a higher threshold initially and then decrease the threshold over time. Accordingly, we schedule T to decrease linearly over time using E, which simply denotes the number of remaining outline expansion steps to be conducted. However, we found that this linear schedule can sometimes set the initial threshold too high, causing our LLM to be unable to find any valid expansions. Hence, the final T is the mini- mum of two terms, one term linearly decreasing over time and one term based on differences in the concreteness of already-generated outline events. In general, the tradeoff is between more efficient sampling vs. not being too lenient on accepting all new expansions, and there is certainly room for exploration on better threshold scheduling.
To keep the human evaluation fairest, we pre-set the number of expansion steps for CONCOCT and the depth for BASE to roughly match the average number of leaves between both methods; see statis- tics in Table 26.
Short Outline
Long Outline
Model
Node Exp.
Leaves
Node Exp.
Leaves
BASE CONCOCT
12.2
26.7
24.9
71.5
12.0
27.4
25.0
71.2
Table 26: Average outline length under Short Outline and Long Ouline regimes for BASE and CONCOCT, measured in number of node expansions and final leaf count. Due to CONCOCT's greater flexibility con- trolling the final outline length, we able to choose a number of expansion steps for CONCOCT to closely match the final lengths for both methods under both regimes.
D.2 Annotation Interface Details
To avoid any bias in the pairwise human anno- tation, we show the annotator only list of plot points, without any index or structure information. Table 27 shows an example text displayed to anno- tators.
C,3 Rewriting
When we sample a candidate expansion that does not meet our threshold requirement for increasing concreteness, we typically find that it is more effi- cient to attempt to rewrite the offending leaf than to restart the entire expansion for the current parent node. The difference between rewriting and restart- ing that, during rewriting,
We use Surge AI (https: / //app. surgehq ai) for annotation. setting the task payments based on our best estimate of a pay rate of 20 dollars per hour. We ask annotators label which outline is more consistently-pact using the question shown in Table 28.
will keep all the children who meet the criteria and only mask out the failed children, asking the model to do insertion. Table 25 shows an example prompt.
Overall, which outline has more consistent pacing (i.e., which is more consistent in its level of detail)?
Human Evaluation for Outlines
Table 28:
Question for human annotators judge which outline is more consistently-pact
Due to the relative lack of strong automatic met- rics for evaluating long-form story outlines, we use human evaluation to compare performance differ-
Another component of our annotation (shown in

---

Premise:
All the side characters struggle with what to do after the main character Xn\nnnn
Outline: AnAn
Point An Main plot: The main character is killed. An Characters: Main character (MC), Side
characters (nnn
Point \n Main plot: The side characters mourn the loss of the main character. An Characters: SC\n'nn
Point \n Main plot: The side characters struggle with their purpose now that the main character is gone. An Characters: SC\n\n
Point 4 An Main plot: The side characters consider taking up the main characters cause. An Characters: SCAn\n
Point 5 An Main plot: The side characters face challenges and doubts as they attempt to continue the main characters work. An Characters: SC\nin
Point 6 An Main plot: The side characters come to terms with the main characters death and find their own paths forward. An Characters:
SChn\n'n
Point 6.1 An Main plot: The side characters struggle with their grief and confusion over the main characters death. An Characters: Sarah, Alex, Juan, and Mayaln'n
Point 6.2 An Main plot: The side characters receive guidance and support from unexpected sources, An Characters: A mentor figure, new ally\n'n
Point 6.3 An Main plot: The side characters begin to explore their own paths and goals, separate from the main characters cause. An Characters: Sarah, Alex, Juan, and Mayaln'n Point 6.4 An Main plot: The side characters find success and fulfillment in their individual pursuits, while honoring the legacy of the main character. An Characters: Sarah, Alex, Juan, and Maya\n\n'n
Can break down point 6.2 into some independent, chronological and same-scaled outline points? Also, assign each character name. Please the following template with "Main Plot" and "Characters", Do not answer anything else. An'n
Output: Point 6.2 An Main plat: The side characters receive guidance and support from unexpected sources. Characters: mentor figure,
ally'n'án Point 6.2.1 An Main plot: The side characters struggle find direction without the main character. Characters: Sarah, Alex, Juan, and Maya\n'ın
Point 6.2.2 2 Main plot: A mentor figure offers guidance and advice the side characters. An Characters: Sarah, Alex, Juan, and Maya, Mentor
Point 6.2.3 Main plot: [INSERT] \n Characters: [INSERT]Nn\n
Point 6.2.4 Main plot: The mentor helps the side characters see that they can honor the main characters legacy while still finding their own paths. Characters: Sarah, Alex, Juan, and Maya, MentorAn'n
Point 6.2.5 Main plot: [INSERT] \n Characters: [INSERT]NN\n
Point 6.2.6 Main plot: [INSERT] An Characters: [INSERT]Nn\n'n
Task: Fill in the "[INSERT]" in the Outline. not change any other parts except "[INSERT]".
Table 25: Example of the prompt used when rewriting an insufficiently concrete child node.
Table 29) is labeling the errors found while reading. We always compare two outlines based on the same premise, which we believe makes the annotation job slightly easier.
sponding premise.
Interesting, the percentage of outlines (or sto- ries) judged to be more interesting when com- paring pairwise.
The full annotation interface is shown in Fig- ure 3, Figure 4, and Figure 5.
The corresponding annotation questions are shown in Table 30.
D.3 Setting of Non-Pacing-Rehae Related Errors Analysis
E Downstream Story Generation Details
The three metrics evaluated our non-pacing error analysis are defined below, reproduced from Yang et al. (2022b):
Here we provide some more details on our story generation setup in Sec. 3.3. In the DOC pipeline, replace OPT-175B (Zhang et al., 2022) with ChatGPT @gpt3.5-turbo-- GPT API limitations, turn off DOC's token- level decoding control ("detail controller" in their work) Mcanwhile, we also introduce simpli- fied generation method to reduce pacing-related
1. Coherent, the percentage of outlines (or sto- ries) judged to have more coherent overar- ching plot.
Due to Chat-
2. Relevant, the percentage of outlines (or sto- ries) judged to be more faithful to the corre-

---

Premise: Human empathy has been expanded so that people feel emotions those around them as was happening themself.
[LABEL] Dr. Samantha proposes the of expanding human empathy to her team of scientists. [LABEL] The team scientists begins researching and developing the technology to expand human empathy.
[LABEL] After months of testing and refining, the team successfully develops the empathy expansion technology.
[LABEL] John undergoes the initial testing phase of the empathy expansion technology.
[LABEL] John experiences intense emotions those around him, including joy, sadness, and fear. [LABEL] John struggles to cope with the overwhelming emotions and seeks support from his loved ones.
[LABEL] Sarah begins to feel overwhelmed by the constant emotional overload of feeling the pain and suffering of her patients.
[LABEL] Sarah starts to withdraw from her patients and coworkers, unable to handle the constant emotional burden.
[LABEL] Sarah seeks therapy to help her cope with her expanded empathy and learns techniques to manage her emotions.
[LABEL] Michael begins to experience increased stress and anxiety as he navigates the cutthroat world of corporate competition while feeling the emotions of his rivals.
[LABEL] Michael's 's heightened empathy leads to him making a crucial mistake in a business deal, causing him to lose a major client and damaging his reputation. [LABEL] Michael seeks out therapy to help him better manage the overwhelming emotions of others in the business world.
[LABEL] Emily, a college student, becomes overwhelmed by the emotions of her classmates and begins to withdraw from society.
[LABEL] Emily's social isolation leads to decline in her mental health and she seeks help from therapist who specializes in dealing with the expanded empathy.
[LABEL] Emily joins support group for individuals with heightened empathy and finds solace in connecting with others who understand her struggles. [LABEL] Maya, David, and Ava meet
support group for individuals with expanded empathy. [LABEL] The group shares their experiences and struggles with their heightened emotions, forming strong bond.
[LABEL] The group decides to continue meeting and discussing ways use their expanded empathy for positive change the world.
[LABEL] The group creates a social media campaign spread awareness about the importance of empathy.
[LABEL] The group organizes public event to bring attention to the movement and gather more supporters.
[LABEL] The group meets with influential figures in politics and media to advocate for greater empathy and compassion society.
[LABEL] The movement gains media attention and begins to spread globally.
[LABEL] The movement partners with organizations and governments to create policies and programs that promote empathy compassion.
[LABEL] The movement faces backlash and resistance from those who fear the loss of power and control.
Table 27: An example outline shown to annotators; structural information (e.g.. indices of nodes in the outline) has been masked. The [LABEL] tag for the user to highlight when labeling errors.
noise in DOC, which we found to substantially affect human judgment. Specifically, we ask the gpt-3. 3......tottoo111 16k generator to expand each out- line point into one same-length chapter (around 75 words) maintain pacing consistent with the out- line. Due the maximum input length restriction, we expand 5 outlines into story passages at a time via a rolling window.
stories.
F.1 Human Evaluation
We use human evaluation on story excerpts as de- scribed Sec. 4.3, evaluating pacing, coherence, relevance, and interestingness. The annotation in- terface is shown in Table 31.
F.2 GPT-4 Evaluation
F Evaluation for Stories
When evaluating long texts such our final sto- ries, human annotation could be noisy, subjective, and/or overly hasty. Here, we also apply GPT-4 (with temperature 0) for pairwise evaluation of the
We use both GPT-4 and human evaluation to verify whether CoNcocT's strong performance on the outline level translates to downstream generated

---

For each item Outline below, please
Results. Table 33 shows the result of the GPT-4 evaluation, which corroborate our carlier results from human evaluation. downstream stories based on our outlines, CONCOCT still improves pacing significantly compared to BASE, without compromising desirable non non-pacing qualities.
indicate which any) are:
(1) too vague (too high-level) compared to rest of the outline,
(2) too detailed (too low-level) compared
the rest the outline,
(3) any other errors that don't fall into the
previous two categories.
Double-click the [LABEL] ] tag to label.
G Main Experiment Outline Examples
Table 29: Question for human annotators to label error outline points.
We now show some examples of outlines from our main experiments generated by both CONCOCT and BASE for the same premise. We also show human annotators' feedback via highlighting. displaying some issues that exist in the outlines. Concretely, the highlights indicate Extremely Vague Part Extremely Detailed Part and Other Error The examples are given in Table 34, 35, .... 49.
Overall, which outline you prefer/fing more interesting? Overall, which outline has more coherent overarching plot? Overall, which outline's plot is closer to premise?
Table 30: Questions for humans to evaluate non non-pacing con-pacin-- related qualities pairwise comparison.
CONCOCT improves significantly on pacing compared to BASE, although there of course still exists further room for improvement. For long out- lines and stories, we evaluate excerpts instead of full texts due to the extreme length, but we show the full contents here. Thus for some examples, only part of the text may be annotated. Addi- tionally, the original output from CONCOCT also contains a character list for each point, but we omit here since it's highly repetitive.
same stories described in Sec. 4.3. The prompt we use is shown in Table 32.
"role": "user", "content"; "Here two story excerpts. \n\n\n''n
The shown stories
parts of whole stories. You shouldn't be concerned about the completeness of the plot.
Story AnAnn $(Excerpts 1} An\n\n'n
Story 8:\nAn $(Excerpts 2} \n\n\n'nn
Answer following question: [Overall, which story has more consistent pacing (i.e., which more consistent B} OR (Overall, which story has a more coherent overarching plot? / B) which story's plot is closer to the premise? } OR (Overall, which story do you prefer/find more interesting? Please answer with string four letters (A or B).
its level of detail)?
(Overall,
B)
Table 32: Prompt used for GPT-4 pairwise evaluation stories on pacing, plot coherence, premise relevance, and interestingness.
GPT-4 Evaluation
Model
Pacingt
Coherent
Relevant?
Interest
BASE
40.84
48.27
48.76
51.24
CONCOCT
59.16
51.73
51.24
48.76
Table 33: GPT-4 evaluation results on story excerpts based on outlines from BASE and CoNCOCT under Short Outline regime. Bold indicates significance with p 0.05. Same human evaluation Table 5, CoN- COCT's gains in pacing translate to downstream stories, without compromising non non-pacing pacing qualities.

---

Instructions
We are AI researchers doing some analysis on AI-generated stories. We will show you an overarching story premise followed by two excerpts from stories based on this premise.
Please quickly read or skim them and then answer several brief questions at the end. We expect this to take about 4 minutes on average in total.
Notably, the two excerpts are parts of the whole story. You should not be concerned about the completeness of the plot. Also, please ignore low-level issues like formatting errors or typos, only focusing textual quality.
((id))
Overall Premise (for both excerpts): ((premise))
Excerpt A:
([excerpt1))
Excerpt B:
((excerpt2))
Overall, which excerpt has more natural pacing (i.e., which is more natural/comfortable its level detail)?
Excerpt
Excerpt
Both are about equally good
Neither is good
Overall, which excerpt do you find more interesting?
Excerpt A
Excerpt
Both are about equally good
Neither is good
Overall, which excerpt has more coherent overarching plot? Excerpt A
Excerpt B
Both are about equally good
Neither is good
Overall, which excerpt's plot is closer to the premise?
Excerpt A
Excerpt B
Both are about equally good
Neither is good
Overall, which excerpt do find higher quality in general?
Excerpt
Excerpt B
Both are about equally good
Neither is good
Table 31: The human annotation questions for pairwise comparison of final story quality.

---

eseechere
porkng
story
by
prenise.
For each oud ne, wre adiyyo annorate in po whit are inconsisentt with overlll paaiig of rest outline We espect the to about three minutes per outline avenge
The fust you de this txrk, plesss see the exampler ber below to cense of aheehtt batel thould only take mute skin)
Thi
Noguthee aspccts
Sarth comppe ane
better
Sarah notices tirst the offfee strins her teeth and merdonn it fom.
Torn a trshimrar detestive town.
for linds aniarmation
happenings
Too detalled
They mere the pettiion on uncri medis ga gaining more rrvttoo and alto ntten
The setiton teacher 50% itt giall
The setitio vaddes 75% Ra
1000 of
abous balurivlly
eurttecly bagins
proet thencry
The listt lagg of the book suthor teffoon atoon
The aecondl pagee a canaleg
The snind page the canalog
coler.
zohnr lace contorts with stuins reperittve
th proptappenii of the slory lus died.
protago isdee
gae noi-oentence
revlows recorce Saral's benn
Johni
zana
spolegees
Figure 3: Surge Al human annotation interface for main results Table 2, part 1 of 3.

---

Sharell turzas dan both oullosat
Premior: Withe beat the firt atterille-rrree arone you off apalest animm ever anten Secide courdeee
Highlight the text create label. Click existing label
Noo Too detial
Olhhar errorr
For each tom in Outiin in bekow please hickaae which anig ore:
mequs
20 lou dktuilia tuo lawe lavell compuaned the sout the outlnns
any
catagaree.
tag
Fremas When you tine aherr arone you offh aganmt very are the you have derada your once mone
[LABE]] The proaggnkitooo sta ris victarous fiss areeee lontling their breath and no sumounding
the
dockared
(.ARL) The gane approuctees the peotagon songre yhu sting them thee wetory and entorming them of the nett challange
eepla
protagoriie
1.XBEL Anilii
wertiis warns the pretagonett thet the challenge will test their monilty their at try more ameends for their post nct ond
[LABEL] trampputt prodaperii mon uncns, koninn from four
[JAMEL] the mysterizua ficurw weplain the máles and stalbes rest challemoe protegamic:
1.1DEL The protagonknt transportee red the anena, which i animaats hove consurned the past. protagenist froe
1.MBEL
shappears,
[LABEL) The pnotagonkcti transsp transported the afteeiife-oo aife-arena.
protaggriitt
[JAaLa] the animali beginn to spproach the protagorial ready to attakk.
bagen
protegemes,
ryg
teooty.
(.ARR] The premogenant rights bonk uain their nast and wesponees to setend the mommmtee troen the ze ondhughht
rnghsiin, protogerien begine
they
[JAMEL] The protingonii figMt offl the sendilis aninab firs,
fickero and fail.
[JABEA] protagarine vis procrwaves,
magesti tougher oppooeera cosn and piap.
[.MRL The
protagnnic hunted and
either defect ands
1.4DEL The protagonkt engaged feree bottle with cow they voumne paet.
The
victorlous.
[JABEL] the promeggniii fisds qullity aboutt their past tiams and bera ne to quast on thair choikns en they prozere the neet buttle
porsagnnan revilty by
beginn
1.ADEL One the nars they face againnt revilinss protagoriaa of teeloved once ted, causing them queator thei chicees
prosagonket
fighting
momuiratee
spologil rg post seeking torgheness.
[JBEL] The protageriai upologiess the unimal they have ssamee and csia foru vono...
[ABEL)] aniraas acsept the peotagoriatss apology their iariowees..
The protggrant gronted chonne
new aftrr
Figure 4: Surge AI human annotation interface for main results Table 2, part 2 of 3.

---

Hightlihtt the text create new label. Click on an existing label to remove it.
verpo
detalled
ancr
For werth ieen Caeft sheose inciente
(0 too wage thoo High-loeet compla rdd zo the reut detallldled
60 any anore den't the predicus two conegories
Double click the IL-BAU to lobel
Premise lfenn you beat first te arena you froe off agginst very aninn you hove over eaten cedice your onte
LACeL) the protaqormat enters the aftrriio unnn.
Spin sppeor
pestagorist
LAARL The Avamnal Spentss mesi the challenge to the protagon
Spints exphiin
challenge pronggonie
LAABE The hnainal spints show the protogeniet a vision ot the anamale they esten in their Mlesiie doutrs
prottg
fading the
have
[Abel)) protagonist agrocs challleng lenge propares fioe tici past-ccton actins.
J.0EL)) Sasis charges protiegoniat with harms, forting protagemist dodge propare defond
protagoniat this to neason with Bussis wining that they were
impuctt of thet uctions uni mala and the andiarmant
J.AEEL) famie neminda ins proteguria in that they had
they dedge coummaatted with
their actiona had sequeroe.
preteggment
horms
L.ARRL The piotegonie greppies with thei gullt
vo stering they chould cortinus fighting or give sccept their trtt
oninnoll
posltry
LABEL The Pig tounts the protagonist sems rnding them of the bacon and they towe enjiyedd their mortal life
morial
LA0EL) The protaggonile dciiilo dios to the pio spint and voss to make on ands for their unilens by
adveccating for unimaal well and makhing more cor sodous dhokes the future.
profegorent
J.AELL) The guth comoumee the prosugorent causing them to become phyyically and michoos by exceuuted.
protegorent
tryang
part
(.ACUL) The profacoment swabs out sage for quidanse on hore to make amannds for their past actions.
protegonies
LABEL Sage encourages the protagonent use their newroons snowledge to make positive change
pi drig rvante Sage griing them see
with
purpose
IAABE The onitt desites to nediccate the aftertll to necominn advccione for ontinal rights and use their si spread oworeness and make diference
JASSL) pniot creates edlocat onall
suth
infogrogh and posters to promote awarevess
rights.
protagoniat liuncc is tiie potition to encos comoanico pevamments adiept othical and sustainaa practicss veutment crémds.
JAAELL) protegoriit partners with organivations inflamncrs to eqpand reach impad
rights campaigs.
local leadem, pobtimane J.AZEL) protegoriid enates gpoft organization advocates animal rights promotis suttainacle food practios
LAEEU) protegomet
must nable food
Orenall whic outine has more comsistent pecing ii.. which more comiasent in lnvd detsa))
Figure 5: Surge Al human annotation interface for main results in Table 2, part 3 of 3.

---

Base Short Outline for Premise
Premise: person goes through his life, he is given three options the end of each day, continue, restart day, restart life. He has just lived through the worst day of his life.
Outline:
Point1: John, man in his mid-thirties, wakes to find himself in strange room with three doors. A voice explains that he has the power to choose what happens to him at the end of each day he can either continue, restart the day, or restart his entire life. John is confused but decides to continue with his day.
Point1.1: John wakes up in strange room with three doors and voice explains his power to choose what happens at the end of each day.
Point1.1.1: John wakes in strange room with no memory of how he got there.
1.int1.1.2: John notices the three doors and tries to open them, but they are locked.
Point1.1.3: A voice suddenly speaks to John, explaining his situation and the three options he has.
Point1.2 The voice explains the three options John continue, restart the day, restart his entire life and John decides to continue with his day.
Pointl 2.1 : The voice explains the consequences of each option to John.
Point1.2.2 John asks the voice for clarification on the rules and limitations of his power.

---

Point1.2.3: John hesitates before making his decision, unsure of the potential consequences.
Point1.3: John leaves the strange room and enters the outside world, where experiences series of mundane events that lead up to the worst day of his life.
Point1.3.1: John walks to the coffee shop and orders his usual drink.
Point1.3.2: John runs into an old friend at the coffee shop and they catch up on old times.
Point1.3.33 John leaves the coffee shop and heads to work, where he has a heated argument with his bass that ultimately leads to him getting fired.
Point2: John has just lived through the worst day of his life - he lost his job, his girlfriend broke up with him, and he got into a car accident. He is faced with the same three options, but this time he seriously considers restarting his life. However, he is unsure if he wants to relive all the good moments in his life again or risk making the same mistakes.
Point2.1: John reflects on the events of the previous day and seriously considers restarting his life. He spends the day exploring the different doors and trying to gain better understanding of his situaaiion
Point2.1.1 John explores the first door and finds himself a room filled with pictures and mementos of his past. He spends the day reminiscing about his childhood and reflecting on the choices he's made his life.
Point2. John explores the second door and finds himself in room filled with books and journals. He spends the day reading through his old journals and trying to piece together the events that led to his current situation.
1.3 John explores the third door and finds himself in a room filled with mirrors. He spends the day studying his reflection and trying to understand who he is and what he wants out of life.
2 John spends the day reliving some of the best moments of his life and realizes that he doesn't 't want to risk losing those memories by restarting his life. He decides to restart his day and try to make things right.
Point2.2. 2. 1: John spends the day reliving some of the best moments of his life, including his first date with his girlfriend and the day he got his dream job. He realizes how much those memories mean to him and decides he doesn't t want to risk losing them by restarting his life. Point2.2.2 2: John reflects on the mistakes he made the previous day and makes plan to fix them. He decides to apologize to his girlfriend and try to salvage their relationship. He also takes steps to prevent the car accident from happening again.
Point2. 2.3 : John puts his plan into action and successfully prevents the car accident and reconciles with his girlfriend. He feels sense of relief and happiness but also realizes that he cannot control everything in his life. He decides to continue with his life. knowing that he has the power to restart if he needs to.
Point2.3: John uses his knowledge of the future to prevent the car accident and salvage his relationship with his girlfriend. However, he realizes that he cannot control everything and must accept the consequences of his actions. He chooses to continue with his life, knowing that he has the power to restart if he needs to.
Point2.3.1: John uses his knowledge of the future to prevent the car accident and successfully avoids it.
Point2.3.2: John apologizes to his girlfriend for his behavior and explains the situation to her. She forgives him and they reconcile.
Point2.3.3: John realizes that he cannot control everything and decides to continue with his life, knowing that he has the power to restart if he needs to.
Point3: John decides to restart his day and try to make things right. He uses his knowledge of the future to prevent the car accident and salvage his relationship with his girlfriend. However, he realizes that he cannot control everything and must accept the consequences of his actions. He chooses to continue with his life, knowing that he has the power to restart if he needs to.
Point3.1: John restarts his day and begins to make changes to prevent the car accident and save his relationship with his girlfriend.
1. John wakes up and decides to make list of things he needs do differently prevent the accident and save his relationship with Sarah.
Foint3.1.2 John meets Sarah for lunch and uses his knowledge of the future to say the right things and make amends.
1.int3.1.3: 3: John takes a different route home and successfully avoids the car accident. He feels relieved but also realizes that he cannot control everything.
Point3.2: John's efforts pay off and he successfully avoids the car accident and reconciles with Sarah. However, he realizes that he cannot control everything and must accept the consequences of his actions.
Point3.2.1: John apologizes to Sarah for his past mistakes and promises to work on their relationship.
Point3.2.2 2.2: 2: Sarah forgives John and they spend the day together, enjoying each other's company and making new memories.
Point3.2.3: John realizes that he cannot change everything in his life, but he is grateful for the second chance he has been given with Sarah.

---

Point3.3: John decides to continue with life, knowing that he has power restart needs to. He feels sense relief newfound apgreciation for life he has. Point3.3.1 John reflects his past decisions and how they have led him to where he is He realizes that he has the power make positive changes in his life and decides to take action.
Point3.3.2: John starts to make changes in his life, such pursuing a career and reconnecting with old friends. He feels renewed sense of purpose and happiness. Point3.3.3: John continues to live his life, knowing that he has the power restart if he needs to. He feels grateful for the opportunities he has been given and looks forward the future.
Table 34: The first short outline from BASE. Overall the plot is reasonable, with no major errors. Point 1.2.1 mentions "coneeuences" but does not explain them detail, even though it seems that this should be a major plot point. Points 2.1.1 2.1.3 are too high-level, each going through the whole day in just one point. In contrast, the nearby Point 2.2.3 seems too detailed regarding John's 's feelings. Point 3.1.2 fails to say what the "right things" are, and Point 3.3.1 doesn't explain what the "past decisions" are.
Concoct Short Outline for Premise 1
Premise: As a person goes through his life, he is given three options at the end of each day, continue, restart day, or restart life. He has just lived through the worst day of his life.
Outline:
Point1: John, middle-aged man, lives through the worst day his life given three options at the of the day: continue, restart day, or restart life. P:int1.1: John wakes up late for work, causing him to miss an important meeting with his boss.
Point1.1.1: John wakes up late for work rushes to get ready.
Point1.1.1.1: John rushes to the bathroom to get ready.
1. John struggles to find his toothbrush.
Point1.1.1.3: John realizes he's out of toothpaste and has to run to the store to buy more.
Point1.1.2: John realizes he forgot his laptop at home and has to turn back, wasting even
more time.
Point1.1.3: John gets stuck in traffic, making him even later.
Point1.2: At the end of the day, John is presented with three options: continue, restart day, or restart life.
Point1.2.1: John considers the option to continue with his current life, but feels like he cannot bear to live through another day like the one he just experienced.
Point1.2.2 2: John considers the option to restart the day, hoping that he can undo the mistakes he made and have a better outcome.
Point1.2.1 John feels overwhelmed and uncertain about what choice to make, wondering if any of the options will lead to a better outcome.
Point1.3: 3: John contemplates his options and decides to choose one, unsure of the consequences that will follow.
Point2: John chooses to restart the day and tries fix the mistakes he made the previous day, but ends up making things worse.
Point2.1: John wakes up with determined mindset and makes plan to avoid the mistakes he made the previous day.
Point2.1.13 John creates to-do list that prioritizes tasks he neglected the previous day.
P.int2.1.2: John focuses positive affirmations and visualization techniques to set productive and optimistic tone for the day.
Point2.1.2.1 John practices positive affirmations in the morning set productive and optimistic tone for the day.
Point2. 2 John visualizes his success in completing tasks and achieving goals throughout the day.
Point2.1.2.. 1. John takes a few minutes to medi tate and clear his mind before starting his day.
Point2.1.3 John takes different route to work to avoid the traffic that caused him to be late the previous day.
Point2.2 John starts to overcompensate for his previous mistakes and ends up causing even more problems than before.
Point2.3 John realizes that by trying fix his mistakes, he focusing much avoiding them rather than actively creating positive outcomes, prompting him try new approach.
Point3: After several failed attempts fix day, John decides restart his life and live differently, realizes that some things beyond control.

---

Point3.1: John restarts his life and makes different choices, realizes that some events still happen the same way.
Point3.2: John tries to prevent major event that happened in his previous life, but his actions have unintended consequences,
Point3.3: John learns to accept the things he cannot change and finds happiness the new life he has created for himself.
Point3.3.1: John starts to appreciate the small things in life and finds joy in everyday moments,
Point3.3.1.1: John starts to appreciate the small things in life, such as beautiful sunset or a good cup of coffee.
Point3.3.1.11 John takes moment to watch a beautiful sunset and feels sense of peace and contentment.
Point3.3.1.1 John savors a good cup of coffee and takes the time to appreciate its aroma and flavor.
Point3.3.1.1. John starts to make a habit of appreciating the small things, whether it's a beautiful sunset or simple act of kindness from someone. He feels a renewed sense of gratitude towards life.
Point3.3.1.2. John sees the joy in the simple things, like spending time with his dog at the park or reading a good book, and finds contentment in the present moment.
Point3.3. 3.1 1.2.1: John takes his dog to the park and enjoys the simple pleasure of spending time with him.
Point3. 3. 3.2.2. John spends the afternoon reading good book and finds joy in the simple act of getting lost in a story.
Point3.3. 3. 1.2.3 John takes moment to appreciate beautiful sunset and realizes that he had never noticed how stunning they are before.
3. John realizes that he had been so focused on the big moments in life that he had missed out on all the small, but meaningful experiences. He makes a conscious effort to slow down and appreciate each moment as it comes.
Point3.3.22 2: John connects with people he previously overlooked and forms meaningful relationships.
Point3.3.3: John reflects on his past life and realizes that every decision he made, good or bad, led him to where he is now and he wouldn't change a thing. Point3.3.3.1. John thinks about the mistakes he made and how they helped him grow as person..
Point3.3.3.4 3.32: John looks back on the happy moments in his life and realizes that they were made possible by the challenges he faced.
Po John embraces the present moment and finds peace in the knowledge that even though his life is not perfect, it is exactly where he is meant to be.
Table 35: The first short outline for CONCOCT. Overall this one dives deeper into Points 1.1.1, 2.1, 3.3, which helps case some vagueness errors. However, despite high-depth expansion, Point 2.1.2.2 is still vague since it mentions words like "task" and "goal"; it would be ideal for the outline to indicate exactly what these are. The same issue applies Point 3.3.1.3. Meanwhile, Points 2.2 and 2.3, they might look fine individually, but as they are adjacent, can sense a difference in pacing, which may be caused by inadequate filtering.
Base Short Outline for Premise 2
Premise: There's an insane person who wants to destroy the whole world, and despite your obvious and wholehearted attempts to stop that person, said insane person considers you friend.
Outline:
Point1: An insane person wants destroy the world.
Point1.1: Jack develops plan destroy the world.
Point1.1.1: Jack
up with initial idea destroy the world.
Point1.1.2: Jack starts to research and brainstorm ways execute his plan.
Point1.1.3: Jack begins to reach out to potential allies resources to aid his plan.
Point1.2: Jack starts gather resources and allies execute his plan.
Point1.2.1: Jack convinces powerful corporation fund his plan.
Point1.2.2: Jack recruits a group skilled hackers help him carry out his plan.
Point1.2.3: Jack acquires a weapon of mass destruction to use in his plan.
Point1.3: Jack's plan starts to become more concrete and Sarah becomes aware of it.
Point1.3.1: Sarah discovers more details about Jack's 's plan and becomes increasingly
concerned.
Point1.3.22 Sarah confronts Jack about his plan and tries to convince him to abandon it.
Point1.3.2 Jack reveals his reasons for wanting to destroy the world and Sarah begins to understand his perspective, but still disagrees with his actions.

---

Point2: The protagonist tries stop Jack from destroying world.
Point2.1: Sarah confronts Jack about plan to destroy the world.
Point2.1.1: Sarah confronts Jack about his plan to destroy world.
Point2.1.22 Jack defends his plan tries justify
Sarah.
Point2.1.3: Sarah expresses her disbelief and horror Jack's plan, causing Jack to become
defensive and angry.
Point2.2: Jack attempts to convince Sarah to join him in his mission.
Point2.2.1 Jack explains his reasoning behind wanting to destroy the world.
Point2.2.2: Sarah expresses her disagreement with Jack's plan and tries convince him
reason.
Point2.2.3: Jack tries appeal Sarah's emotions and convince her join him by
painting bleak picture the world's current
Point2.3: Sarah tries reason with Jack and find a way to stop him thout resorting to violence.
Point2.3.1 Sarah proposes compromise to Jack.
Point2.3.2 Jack rejects Sarah's compromise and insists on his plan.
Point2.3.3: Sarah realizes that she cannot change Jack's mind and decides to take drastic action.
Point3: Despite Sarah's attempts to stop him, Jack considers her a friend.
Point3.1: Jack opens up to Sarah about his plans and considers her a confidant.
Point3.1.1 : Jack reveals his reasons for wanting to destroy the world Sarah.
Point3.1.2: Sarah tries to reason with Jack and convince him abandon his destructive
plans.
Point3.1.3: Jack admits to Sarah that he knows his plans are wrong, but feels powerless
stop them.
Point3.2: Sarah struggles with her conflicting emotions towards Jack, torn between her loyalty to humanity and her friendship with him.
Point3.2.1: Sarah struggles with her loyalty to humanity. Point3.2.2: Sarah begins to empathize with Jack and his reasons for wanting to destroy the world.
Point3.2.33 Sarah realizes that her friendship with Jack has clouded her judgment and she must make a difficult decision.
Point3.3: Jack's destruction plans are thwarted, but he still considers Sarah a friend and hopes she can forgive him.
Point3.3.15 Jack's 's destruction plans are ultimately thwarted by Sarah and her allies.
Point3.3.2 2: Jack is captured and brought to justice, but he still considers Sarah friend
despite everything.
Point3.3.3: 3: Sarah struggles with her conflicting emotions towards Jack, torn between her loyalty to humanity and her friendship with him, but ultimately forgives him.
Table 36:
The second short outline from BASE. Overall, the plot looks reasonable, without major errors. The annotator notes that Point 2.2.1 contains too many plots and events in single line and does not talk about the detailed "reasoning." Point 2.3.1 and 2.3.2 are too compressed, and Point 3.1.1 might overlap with the former.
Concoct Short Outline for Premise 2
Premise:
There's insane person who wants destroy the whole world, and despite your obvious and wholehearted attempts to stop that person, said insane person considers you friend.
Outline:
Point1: The insane person reveals their plan to destroy the world to their friend, who is horrified and attempts to stop them.
Point2: Despite the friend's efforts to stop Lucas, he continues to pursue his plan to destroy the world. However, he still considers Sarah a friend and confides in her about his motivations.
Point2.1: Lucas reveals to Sarah the reason behind his desire to destroy the world he experienced a traumatic event that left him feeling hopeless and powerless.
P.int2.1.1: Lucas recounts the traumatic event that he experienced, describing how it left him feeling hopeless and alone.
Point2.1.2: Sarah tries to empathize with Lucas's pain and encourages him seek therapy support from others instead of seeking revenge the world.
Point2.1.2.1 Sarah suggests different coping mechanisms and resources for Lucas to seek help and healing.
Point2.1.2.1 1. Sarah suggests meditation and mindfulness exercises that have helped her
deal with her emotional pain in the past.

---

Point2.1.2.1.2: Sarah recommends specific therapist or support group that she thinks may helpful for Lucas.
Point2.1.2.1.33 Sarah encourages Lucas to engage in physical activities Like exercise or sports to release his pent-up aggression and stress in a healthy way.
Point2.1.2.22 Lucas pushes back against the idea of seeking therapy, arguing that it won't change anything and that his plan for revenge is the only way to feel better.
Point2.1.2. 1:1.2.1: Sarah emphasizes the potential benefits of therapy and the harm that revenge will cause.
2dint2.1.2.2.2 Lucas argues that revenge is the only way to feel empowered and that it is too late for him to seek help or healing.
Point2. 1..t2.1..22... 1.2.2.2...21111 1: Sarah explains how seeking revenge will only perpetuate the cycle of pain and suffering.
Lucas argues that he has already made up his mind and that nothing can by his actions.
change it.
Point2. 1. 1.2.2.2.3 Sarah pleads with Lucas to consider the innocent people who will be hurt
Point2.1. 1.2t2.1.2.2.3... Sarah expresses her concern for Lucas and tries to persuade him to think about the consequences of his plan on innocent people.
1..t2..12.2..3.. Sarah pleads with Lucas to think about the innocent people who will harned by his plan for revenge.
Lucas tries to justify his plan by arguing that the innocent people who will be affected are collateral damage and that it is worth it to him to feel empowered. 1.int2.1.2.2.3.11 Sarah expresses her disappointment in Lucas and tells him that she can no longer support his plan to destroy the world.
Point2. 1.2.2..1.2.3: Sarah expresses her concern for Lucas and urges him to reconsider his plan, emphasizing the negative consequences it will have on innocent people.
Point2.1.3: Lucas dismisses Sarah's 's advice, insisting that revenge is the only way to feel empowered again and that it is too late for him to seek help or healing.
Point2.2: 2: Sarah tries to reason with Lucas and convince him that there are other ways to cope with his pain and anger, but he is too consumed by his desire for revenge.
Point2.2.1: 1: Sarah tries to reason with Lucas by reminding him of the innocent lives that would be last if he carries out his plan.
Point2.2.22 Lucas argues that the world is corrupt and deserves to be destroyed, and that his actions will bring justice to all the victims of the world's injustices. Point2. 2.2.....2.1 1: Lucas claims that the current system is so broken that only drastic action like his plan can bring about change.
Point2. 2.2.2: Lucas explains that his actions will bring justice to all the victims of the world's s injustices.
Point2.2.2.3. Sarah counters Lucas's arguments by pointing out that his plan will only create more suffering.
2.int2.2.2.3.11 Sarah provides examples of positive changes that Lucas could make, such as volunteering or starting support group for others who have experienced similar trauma. Point2.2.2.3.22 Sarah suggests that instead of destroying the world, Lucas could use his experiences to help make positive changes and fight for justice.
P: Sarah expresses her concern for Lucas's well-being and offers to help him seek therapy or other professional help to work through his trauma.
Point2.2.3: Sarah counters Lucas's arguments by pointing out that his plan will only create more suffering and that there are other ways to bring about change, such as activism or seeking therapy.
Point2.2.3.1 1: Sarah suggests that activism could be better way to bring about meaningful change, and cites examples of historical figures who used non-violent methods to make a difference.
Point2.2.3.2: Lucas dismisses the idea therapy, saying that it won't change anything and that revenge is the only way to make things right. Po Lucas explains that he has already tried therapy and that it didn't help him at all.
2. Lucas argues that revenge is the only way to make things right because it will bring justice to all the victims of the world's injustices. 2.3t2.2.332..3. Sarah suggests that perhaps Lucas just didn't find the right therapist and encourages him to give it another try.
Point2.2.3.33 Sarah realizes that she needs to find a way to help Lucas heal from his past trauma before he can see the value in non-violent solutions.
Point2.3: Sarah struggles with conflicting emotions of wanting to stop Lucas from carrying out his plan, but also wanting to help him heal from his past trauma.
Point3: Sarah realizes that she may be the only one who can stop Lucas from carrying out
his plan, but also struggles with the conflicting emotions of wanting to save her friend and wanting to save the world.
Point3.1: Sarah tries to reason with Lucas, explaining why his plan to destroy the world is wrong and offering alternative solutions.

---

Point3.2: Sarah seeks help from others, nobody believes her until they realize Lucas' plan is already in motion.
Point3.3: Sarah realizes that she has no other choice stop Lucas by force, and with the help authorities, she is able to prevent his plan from succeeding.
Table 37: The second short outline from CONCOCT. Compared with BASE, the outline dives more deeply into the motivation of "destroy" and the interaction between two characters. CoNCOCT keeps expanding when a plot point includes general words like "event," "support," "consequence." However, understandably. readers may complain that there are too many rounds of plot twists, e.g., over-expanded Point 2.1.2.2.
Base Short Outline for Premise 3
Premise: "Hello, I'm your twin," said the stranger stepped out bright white light.
Outline:
Point1: stranger emerges from bright white light and claims be the protagonist's
twin.
Point1.1: The protagonist is alone when bright white light suddenly appears.
1oint1.1.1: Alex is walking home from work late night.
Point1.1.2: Suddenly, bright white light appears in front of Alex.
Point1.1. 1.3 (optional): Alex stops in their tracks and stares at the light in confusion.
Point1.22 2: A stranger steps out of the light and introduces themselves as Alex's s twin. fantt.2.11. The stranger introduces themselves as Avery, Alex's 's twin.
Point1.2.22 Avery shares specific memories and experiences that only twin would know, convincing Alex of their shared identity.
Point1.2.3: Alex begins to question how they were separated and why they were not aware of each other's existence.
Point1.3 (optional): Alex initially skeptical but Avery provides convincing evidence of their shared past.
Point1.3 (optional).11 Avery shows Alex childhood photos of them together.
Point 1.3 (optional) 2: Avery recounts a specific childhood memory that only the two of then would know.
Point1.3 (optional).3 3: Alex finally accepts that Avery is their twin and they embrace each other.
Point2: The protagonist struggles to come to terms with the idea of having a twin and questions the stranger's s identity.
Point2.1: The protagonist confronts the stranger with doubts about their twin claim.
1o Emily confronts Alex about her doubts regarding his twin claim.
Point2. 1.22 Alex provides Emily with some personal information to prove his identity.
Point2.1.3 1.3: Emily starts to believe Alex's twin claim after seeing the evidence.
Point2.2: Alex provides Emily with evidence to support their twin claim.
Doint2.2.1: Alex shows Emily old family photos of them as babies and children together.
Point2.2.2: Emily and Alex compare childhood memories and discover they have many shared experiences.
Point2.2.3 Alex tells Emily about birthmark they both have they are truly twins.
same spot, proving
3:int2.3: Emily and Alex begin to bond as they explore their shared interests and experiences.
Point2.3.1: Emily and Alex discover they have shared love for hiking and decide to go on hike together.
Point2.3.2: While on the hike, Emily and Alex share stories about their childhood and begin to piece together their past.
Point2.3.33 Emily and Alex find an old family photo album a hidden compartment tment of tree and learn more about their family history.
Point3: The protagonist and the stranger work together to uncover the truth about their past and how they were separated.
Point3.1: The protagonist and the stranger investigate their past by searching for clues in their childhood home.
Point3. : Emma and Adam arrive at their childhood home begin searching for clues.
Point3.1.2: Emma finds an photo album and discovers a picture of her Adam together babies.
Point3.1.33 Adam finds a hidden letter from their birth mother explaining the family feud and their separation.
Point3.2: Emma and Adam discover that they were separated at birth due to family feud and work to reunite their estranged parents.

---

Point3.2.11 Emma and Adam research their family's history understand the root feud that separated them.
Point3.2.2 2: Emma and Adam track down their estranged parents and work to bring them together for reconciliation.
2oint3.2.3: Emma and Adam successfully reunite their parents, bringing closure to the family and strengthening their bond as twins.
Point3.3: 3: Emma and Adam confront their parents about the truth and reconcile their family.
Point3.3.11 Emma and Adam confront their mother about the family feud and learn the truth about their separation.
Point3.3.2 Emma and Adam track down their estranged father and convince him to reconcile with their mother.
Point3.3.2 Emma and Adam bring their parents together and reconcile their family.
Table 38: The third short outline from BASE. Formatting errors appear multiple times in the subtrees under Point 1.1.3 and Point 1.3; for example, including "optional" in the index is improper. Moreover, the annotator thinks some sub-points too detailed and might be meaningless (such Point I.).
Concoct Short Outline for Premise 3
Premise: "Hello, I'm your twin," said the stranger who stepped out of the bright white light.
Outline:
Point1: stranger steps out of bright white light and claims
protagonist's
twin.
Point1.1: Protagonist encounters stranger stepping out of bright white light.
Point1.2: The stranger claims to be the protagonist's twin.
Point2: The protagonist tries to verify the stranger's claim while dealing with their own dishelief and confusion.
Point2.1: The protagonist questions the stranger about their past and how they could be twins.
Point2.2: The protagonist tries to find evidence to support or disprove the stranger's claim.
Point2.3: The protagonist conf sdes in trusted friend or family member about the situation and seeks their advice.
Point2.3.1: The protagonist explains their encounter with the stranger in detail to their trusted friend/family member.
Point2.3.11 The protagonist describes the stranger's appearance and behavior when they claimed to be their twin.
Point2.3.1 3.1.2 The trusted friend/family member asks clarifying questions to understand the full situation.
Point2.3.1 3.1..11 The trusted friend/Family member asks about the circumstances surrounding the bright white light.
3.1. The protagonist describes the location and time of day when they encountered the stranger and the bright white light.
3.int2.3.1 1.2.2.2...... 1: The trusted friend/family member asks if the protagonist saw anything else unusual in the area at the time of the encounter.
Foint2.3.1.2.2 1. The protagonist recalls hearing strange humming noise coming from the direction of the bright white light. Point2.3.1 1.2.2.2221111 continuous if it had any noticeable pattern.
The trusted friend/family member asks if the humming noise
Point2.3.1.2.22.1
The protagonist describes how the humming noise suddenly stopped when the stranger stepped out of the bright white light.
Point2.3.1.2.2.11 The trusted friend/family member asks if there any other wi witnssses the bright white light and the stranger's appearance.
Point2.3.1.2.2.22 The protagonist describes any unusual sounds physical sensations they experienced during the encounter.
Point2.3.1.2.2.3.1 The protagonist describes loud humming sound that accompanied the bright white light.
fo1nt2.3.1.2.2.331.. The protagonist notices ringing their ears after the loud humming sound.
Point..3.1.2.2.3.1.2 The trusted friend/family member asks if the humming sound was similar to any other sounds the protagonist has heard before.
1..22.3. The protagonist explains that the humming sound was so loud it drowned out all other ambient noise. 3oint2.3.1.2.2.33. The protagonist explains that they felt strong gust of wind when the stranger appeared.

---

Po1nt2.3.1.2.2.3.3. protagonist mentions a tingling sensation their hands feet the stranger claimed to be their twin.
Point2.3.1.2.3: The trusted friend/family member if the protagonist has experienced any other unusual events lately that might be related to the stranger's appearance. Point2.3.1.3: The protagonist recounts their initial thoughts emotions when they encountered the stranger.
Point2.3.1.3.1: The protagonist recalls their initial reaction when they first saw the
stranger.
Point2.3.1.3.2: The trusted friend/family member asks the protagonist how they felt about the stranger's claim of being their twin.
Point2.3.1.3.2.11 The protagonist expresses their initial disbelief about the stranger's claim.
Point2.3.1.3.2.7 The trusted friend/family member asks the protagonist if they noticed any similarities or differences between themselves and the stranger.
3...2..3.1.3.22.. 1: The protagonist mentions a few differences in physical appearance, such as hair or eye color, that they noticed between themselves and the stranger.
Point2.3. 3.3.3........ 2: The trusted Friend/family member asks the protagonist if they noticed any similarities in the way they and the stranger spoke or acted, such as using similar phrases or gestures.
3.1.2.3.1.3.2.2.... The protagonist recalls some subtle differences in the way the stranger spoke and carried themselves compared to their own behavior. 3.int2.3.1.3.2.11 The protagonist recalls some similarities in appearance and personality between themselves and the stranger.
P.int2.3.1.3.. 3.33.33 The protagonist expresses their doubts and confusion about the situation to their friend/family member.
Point2.3.2 3.2: 2: The trusted friend/family member offers their perspective the situation and suggests possible explanations solutions.
Point2.3.3: The protagonist considers their friend/family member's advice and decides course of action.
Point3: The protagonist and their twin work together uncover the truth about their past and how they got separated.
P: The protagonist and their twin investigate their childhood home and find clues about their past.
Point3.2: The protagonist and their twin uncover shocking revelation that challenges everything they thought they knew about their past.
Point3.3 The protagonist and their twin confront the person responsible for their separation and find closure.
Table 39: The third short outline from CONCOCT. The system functions well when faced with the general word "question" in Point 2.3. Also, for questions without answers responses, the system will often expand one more step under them. One defect is that the end of the story is a bit rushed.
Concoct Short Outline for Premise 4
"Men, you about to do the most dangerous thing any mind reader has done: you will read schizophrenic."
Premise:
Outline:
Point1: A group of men are tasked with reading the mind of schizophrenic, which is considered dangerous feat in the world of mind reading.
Point2: The men aetempt to read the schizophrenic's mind, but struggle to differentiate between reality and the delusions of the patient.
Point2.1: 1: The men struggle to differentiate between Sarah's delusions and reality while attempting to read her mind.
Point2.1.1. 1.1: The men attempt ask Sarah questions to determine what is real and what is not in her mind.
1eint2.1.1.1 John asks Sarah about her current surroundings test if her delusions affecting her perception of reality.
Point2.1.11 1.12: Mark suggests asking Sarah reality is consistent.
if her grasp historical events
Point2.1.1.33 David suggests asking Sarah describe specific object the to if her perception matches reality.
Point2.1.22 Sarah becomes agitated and defensive, making it difficult for the to gain any useful information.
Point2.1.3: David suggests trying a different approach and asks Sarah facus on specific memory.

---

Point2.2. 2: Sarah's mind begins to spiral out of control, causing confusion and disorientation
the men attempting to read thoughts. Point2.3: 3: The men start to feel paranoid and fearful they realize the danger delving too deep into Sarah's s mind.
Point3: As the men continue
read Sarah's mind, they begin experience hallucinations and paranoia, leading to a dangerous and unpredictable situation.
Point3.1: The men begin to experience intense hallucinations, causing them to lose touch with reality and question their own sanity.
Point3.1.1: John begins to see vivid and disturbing images in his mind that he can't shake off, causing him to question if he's losing his grip on reality.
Point3.1.2 1.2: Mark starts hearing voices and feeling like he's being watched, making him suspicious of his colleagues and causing him to lash out.
Point3.1.33 Alex experiences intense anxiety and panic attacks as he struggles to differentiate between Sarah's delusions and reality.
Point3.2: As the men become increasingly paranoid and agitated, they begin to turn on each other, unsure of who to trust.
Point3. 2. John accuses Mark of withholding information working against the group, Point3.2.2: Alex becomes defensive and hostile towards the others, refusing to share his thoughts or insights.
Point3.2.3: Sarah's delusions start influence John's perceptions, causing him to question his own judgement and sanity.
2.1.3. John begins to doubt his own ability to distinguish between reality and Sarah's delusions.
Point3.2. 1.1t3...3.1.. 3.1.1.1 John begins to second-guess -uooss every thought he has while reading Sarah's mind, causing him to lose confidence in his abilities as a mind reader. Point3.2 1.3t3.2.33.. 1. John's s uncertainty and lack of confidence start to affect his behavior, making him hesitant and indecisive.
John becomes hesitant share his thoughts with the group. 3o John's doubts confusion cause him make mistakes while reading Sarah's mind.
Point3. Point3.2.3.1.1
Point3.2.3.1.22 John becomes increasingly hesitant to share his thoughts with the group, fearing that his own doubts and confusion will be exposed.
Point3.2.3.1.2. Sarah's delusions start to seep into John's own thoughts and perception of reality, making it difficult for him to separate his own mind from hers. Saint3.2.3.2. Sarah's delusions cause John to question the motives and intentions of his fellow mind readers.
Point3. 2.3.3: John's growing paranoia and distrust. leads him to make a dangerous and impulsive decision.
Point3.3: Sarah's delusions become more intense and chaotic, causing the men to struggle even more with separating reality from her distorted perceptions.
Point3.3.1: Sarah's delusions cause her to become violent and unpredictable, putting the men in danger.
3.ntt.3.22 The men's attempts to calm Sarah down only serve to escalate the situation, as they inadvertently reinforce her delusions.
Point3.3.2.7 John realizes that their efforts to calm down Sarah are only making things worse, and they need to find a new approach to deescalate the situation. Point3.3.2.1 3.2.1.1 John suggests new approach to deescalate the situation by acknowledging Sarah's perceptions and guiding her towards reality.
Point3.3.2
Mark voices his concerns about John's new approach, citing potential
dangers and risks.
Point3.3.2.1.. Alex agrees with John's approach and suggests ways to implement it
effectively.
Point3.3.2.2 2.22 Mark, overwhelmed with fear and paranoia, makes rash decision that puts himself and the others in danger.
Point3.3.2.22 1: Mark's fear and paranoia cause him to make reckless decision, grabbing sharp object and threatening Sarah with it.
2oint3.3.2.2.2. John and Alex try to talk Mark down and convince him put the sharp object down before someone gets hurt.
Point3.3.22 2.2.2.3: Sarah's behavior becomes even more erratic in response to Mark's threat, making it even harder for the group deescalate the situation.
Point3.3.22 2.33 Alex suggests a new strategy that involves speaking to Sarah a way that acknowledges her perceptions while gently guiding her towards reality. Point3.3.33 3.3: John realizes that they have underestimated the severity of Sarah's schizophrenia, and they need to come up with a new plan to address the situation before it becomes even more dangerous.

---

Table 40: The fourth short outline from CONCOCT. Overall, the story goes smoothly and naturally. Due to the large number of general words in this somewhat hard topic and the limited number of expansion steps, CONCOCT still has few vague words/points the final outline. This could be remedied by LLM improving its external knowledge or by using a larger pre-set number of retries when failing an attempted expansion in CONCOCT.
Concoct Short Outline for Premise 5
Premise: A story that begins with a lyric your favorite song.
Outline:
Point1: young woman named Emily is listening her favorite song and reminiscing about
her past relationship with her ex-boyfriend, who she still has feelings for.
Point2: Emily decides reach out to her ex-boyfriend, Michael, and they agree meet up and catch up on old times.
Point2. Emily sends Michael message, asking if they can meet up.
Point2.2 2: Michael agrees to meet up with Emily and they plan a time and place.
Point2.2.1 2:1: Michael suggests a place for them to meet up.
Point2.2 2.2: Emily confirms the time and place that Michael suggested.
Point2.2.3: Emily and Michael exchange a few more messages to finalize their plans and express their excitement to see each other again.
Point2.2.3.1. Emily confirms the time and place for their meeting.
2.int2.2.3.2 Michael expresses his excitement to see Emily again.
Point2.2.3.0 3.333: Emily expresses her excitement to Michael again and mentions that she has missed him lot.
Point2.3: Emily and Michael meet up and reminisce about old times, catching up on what they've ve been up to since they last spoke.
Point2.3.1: Emily and Michael share stories about their lives since their breakup.
Point2.3.2 They discuss the reasons for their breakup and apologize for their mistakes.
Point2.3.2.1 2.1: Emily admits that she was controlling in their relationship and
apologizes Michael for giving him enough space.
Point2.3.2.2 2.22: Michael apologizes for being communicative and for taking Emily for
granted their relationship.
Point2.3.2.3: They both agree that they want work their issues and make their relationship stronger this time around.
Point2.3.3: Emily Michael confess their feelings for each other and decide to give their relationship another chance.
Point2.3.3.1: Emily and Michael express their feelings for each other.
Point2.3.3.22 Emily and Michael decide give their relationship another chance.
Point2.3.3.3: Emily and Michael start dating again.
Point3: Emily and Michael meet up and realize that they still have strong feelings for each
other. They decide to give their relationship another chance and start dating again.
P:int3.1: Emily and Michael go on a date to fancy restaurant and have a great time catching up and reminiscing about old memories.
Point3.1.1: Emily and Michael arrive at the restaurant and are seated at their reserved table.
Point3.1.2: Emily and Michael order their meals and share stories about their lives since they last saw each other. Point3.1 1.2... Emily shares about her new job and how it's been keeping her busy.
Point3.1.22 Michael talks about his recent travels and the different cultures he experienced.
Point3.1.3 1.2.3: Emily and Michael reminisce about a funny memory they shared when they were together before.
Point3.1.33 1.33 Emily and Michael enjoy their delicious meals and talk about their future plans as a couple.
Point3.
Emily shares her aspirations for the future, including her dream of starting her own business.
1. 1.3t3..13.1.
Point3.1.3. 1.3.2 Michael talks about his own goals and how he believes they can support each other in achieving them.
Point3.1.3.3. Emily and Michael express their love for each other and make commi tment to prioritize their relationship and make it work.
2: Michael surprises Emily with tickets to her favorite band's concert, and they have fun and memorable night together.
Point3.2.1: Michael surprises Emily with tickets to her favorite band's concert.
Point3.2.2. 2: Emily and Michael dance and sing along to their favorite songs the concert.
Point3.2.3. Emily and Michael take stroll around the city after the concert, holding hands and enjoying each other's company.

---

Point3.3: Emily and Michael have heart-to-heart conversation about their past mistakes and decide work on their relationship together, promising communicate better and more understanding of each other's needs.
P.int3.3. 3. Emily and Michael discuss their past mistakes and how they can improve their communication the future.
Point3.3.1 3.11 Emily expresses her feelings about how Michael's lack of comunication hurt her in the past.
Point3.3. 1.2: Michael listens to Emily and apologizes for not communccating effectively in their past relationship.
Point3.3.1. 3.33 Emily and Michael brainstorm ways to improve their communication in the future, such as setting aside time to talk and actively listening to each other. Point3.3.2: 2: They make plan to have weekly check-ins to discuss any issues or concerns in their relationship.
Point3.3.3: 3:3: They agree to be more understanding of each other's needs and to prioritize their relationship.
Table 41: The fifth short outline from CONCOCT. We think the outline is peaceful and smooth in pacing. Though the annotator mentions Point 2.1 is vague, perhaps because it does not show the content of the message, we think it's not that necessary.
Concoct Long Outline for Premise
Premise: A game of poker played by people who have concept of the game, they try to incorporate rules from other games
Outline:
Point1: group of friends decide to play poker despite having no knowledge of the game, and they attempt to incorporate rules from other games.
Point2: The group begins playing poker, but confusion ensues as they struggle to understand the basic rules and incorporate rules from other games.
Point2.1: 1: The group decides to start playing poker, but they quickly realize that they have no idea how to play the game.
Point2.1.15 1.1: The group sets up the poker table and prepares to start playing.
1.2n They realize that none of them actually know how to play poker.
Point2.1.3 1.3: They search online for the rules of poker but find them too technical and confusing.
Point2.1.44 They attempt to read the rules out loud to each other, but still struggle
understand the game.
Point2.1.4.1: The group attempts to read the rules of poker out loud to each other.
Point2.1.4.2: They struggle understand the technical language used in the rules.
Point2.1.4.3: They ask each other questions about the rules, but no one seems to have clear answer.
Point2.1.4.4: They get frustrated and start making jokes about how confusing the rules are.
Point2.1.4.5: They decide to take break and try come back to the rules later.
Point2.1.5: They start making up their rules and trying to incorporate rules from other
games.
Point2.2: They attempt to read the rules of poker, but the language is too technical and confusing for them understand.
Point2.3: They start making up their rules and trying incorporate rules from other games, leading even more confusion.
Point2.3.1: group decides
up their own rules for poker.
Point2.3.1.1: John suggests that they should able trade cards with each other, which causes confusion among the group.
Point2.3.1.22 Sarah disagrees with John's suggestion and argues that trading cards not part of poker.
Point2.3.1.3: Michael suggests that they should only able trade cards if they have a certain combination, leading to further disagreement among the group.
Point2.3.1.4: Emily suggests that they should only be able to trade cards if they have a certain number of chips, causing even more confusion and disagreement. Point2.3.2: John suggests that they should be able to trade cards with each other, which causes confusion among the group.
Point2.3.3: Sarah suggests that they should be able to play multiple hands at once, leading to disagreement among the group. Point2.3.4 3.:4: Michael suggests that they should be able to bluff even if they don't have any good cards, causing even more confusion and disagreement. Point2.3.5: 5: Emily suggests that they should be able to change the rules of the game at any time, leading to frustration and tension among the group.

---

Point2.4: They argue about the rules what they mean, leading to frustration and tension
among the group,
Point2.4.1: group argues about the meaning a specific rule poker, leading to frustration among the group.
Point2.4.2: David becomes increasingly agitated starts yelling
group, causing
tension and discomfort.
Point2.4.2.1: David becomes increasingly agitated and starts yelling at the group.
Point2.4.2 4.2.2 The group tries to calm David down and figure out why he is so upset.
Point2.4.33 Emily tries to calm David down and suggests taking break, but he refuses to listen and continues to argue.
Point2.4: ..3.2...3.1: Emily tries to calm David down.
Point2.4.3 4.2.: David refuses to listen and continues to argue.
Point2.4.4: Sarah suggests calling a friend who knows how to play poker to settle the
argument, but John disagrees and says they should figure it out on their own.
Point2.4.5: John suggests taking a break and coming back to the game later when everyone is less Frustrated and confused.
Point2.5: They take a break and try to watch tutorial video on how to play poker, but they still struggle to understand the game.
Point2.5.1: 1: The group takes a break from playing poker and decides to watch tutorial video how to play.
P..nt2.5.1.13 1.1 The group agrees to take a break from playing poker and watch tutorial video how to play.
Point2.5.1. They search for tutorial video how to play poker on their phones and find one that looks promising.
Point2.5.1. 5.1.3: They gather around laptop and start watching the tutorial video.
5.1.:2.5.1.3.1: The group gathers around laptop watch the tutorial video how to play poker.
Point2.5.1.3.2: They take notes while watching the video to help them remember the rules
better
P0 The video shows examples of different hands and how to bet in poker.
Point2.5.1.3.4. The group pauses the video to ask questions and clarify any confusion they have about the rules.
Point2.5.1.1 1.33.5: The group continues watching the tutorial video, pausing and rewinding whenever necessary fully understand the rules. Point2.5.1 The video introduces the basic rules of poker, such the different hands and the importance of betting.
Point2.5.1.44 The group comments on how difficult continue watching the video hopes of gaining clarity.
understand the rules, but they Point2.5.1.4.22 The group pauses the video to discuss any confusion they have about rules.
Po They ask each other questions about the rules and try to clarify any confusion.
Point2.5.1.44 1.44.: They realize that they need to practice playing poker with the basic rules before trying to incorporate any additional rules.
Point2.5.1 1.4.55: The video explains the importance
reading other players' body language and facial expressions to determine if they are bluffing.
Point2.5.1.55 The group pauses the video to discuss any confusion they have about the rules.
Point2.5.2 5.2: 2: The tutorial video explains the basic rules poker, but the group still struggles to understand the game.
5.2t2.5.2.11 The tutorial video explains the basic rules of poker, including the ranking of hands and the different betting rounds.
Point2.5.2 5.2.1..: The tutorial video explains the basic rules of poker, including the ranking of hands.
Point2.5 1.222.5.2.. 5.2.1.2: The tutorial video explains the different betting rounds in poker.
Point2.5.2.8 2. The group struggles to understand the terminology used in the tutorial video, such as "flop" and "river".
Point2.5.2.3. They pause the video and discuss the meaning of the terms, but still feel confused.
5.2.3.. The group pauses the tutorial video to discuss the meaning of the terms used in poker.
Point2.5.2.3.2. They try to clarify the meaning of terms like "flop" and "river", but still feel confused.
Point2.5.22 2.4: The tutorial video explains the difference between "raise" and "call", but the group still struggles to understand the concept.
2.2. The tutorial video explains the di diffrrence between "raise" and a "call", Point2.5.2.0 2.4.2: The group discusses the difference between "raise" and "call", but still struggles to understand the concept.
Point2.5.2.44 2.4.2.2 Michael asks for clarification the difference between "raise" and "call".

---

Point2.5.2.4.241 David attempts to explain the difference between a "raise" and a "call", but only confuses the group further.
Point2.5.2.3 They pause and rewind the video miptiple times try to understand the difference between "raise" and a "call".
Point2.5.33 They pause and rewind
video multiple times to try to understand the rules.
Point2.5.44 They discuss the video and try to clarify any confusion, but still struggle to understand certain aspects of the game.
Point2.5.4.15 1:
The group discusses a specific rule they are confused about in the tutorial
video.
Point2.5.4.25 They debate the interpretation of the rule and how it should be applied in the game.
Point2.5.4.2.1: The group debates the interpretation of specific rule from the tutorial
video.
Point2.5.4.2.2: They discuss how the rule should be applied in hypothetical situation.
Point2.5.4.2.3 They analyze the potential outcomes of applying the rule in different ways.
2.4.2.55..2.44 They try to come to a consensus on the interpretation of the rule.
Doint2.5.4...2 They still cannot agree on the interpretation of the rule and decide to move on to the next rule.
Point2.5.4.33 They try to come to a consensus on the rule, but still have differing opinions.
Doint2.5.4.44 They decide to pause the video and discuss the rule in more detail.
1: The group decides to pause the video and discuss the rule in more detail.
Point2.5. 5.4.t.5.4444.. 4.4.422 They analyze the rule and try to apply it to hypothetical situation to better understand it.
Point2.5.44 5.4.5: They analyze the rule and try to apply it to a hypothetical situation to better understand it.
Point2.5.5: Despite their efforts to understand the game through the tutorial video, the group still feels unsure about the rules and returns to playing poker with their made-up rules.
Point2.5.5.1: The group returns to playing poker with their made-up rules.
Point2.5.5.2: They continue to struggle to understand the game despite their attempts to clarify the rules.
Point3: John suggests incorporating the rules of Uno into the poker game, causing even more confusion and chaos.
Point4: Sarah suggests incorporating the rules of Monopoly into the poker game, leading to even more confusion and disagreement among the group.
1oint4.1: Sarah suggests incorporating the rules of Monopoly into the poker game, but the group is unsure how to do it. 1.int4.1.1: The group tries to brainstorm ways to incorporate Monopoly rules into the poker game
Point4.1.2 1.2: The group discusses the different aspects of Monopoly that could be incorporated into the poker game.
Point4.1.3: John suggests incorporating the "Go to Jail" rule from Monopoly, but the group cannot agree on how it would work in the context of poker.
1.3.14.1.3.1: John suggests incorporating the "Go Jail" rule from Monopoly into the poker game.
Point4.1.3.2 The group discusses how the "Go to Jail" rule could work in the context of poker.
1.3..4.1.3.3: Sarah suggests that players who receive the "Go to Jail" card should have to sit out round of poker.
Point4. 3.3.4 Michael argues that sitting out round of poker is too harsh of punishment for receiving the "Go to Jail" card.
Point4.1.3 Emily suggests that players who receive the "Go to Jail" card should have to pay fine to the pot.
1.int4.1.3.66 David proposes that players who receive the "Go to Jail" card should have to swap one of their cards with another player's card.
Point4.1.44 Sarah proposes that players should be able to collect "Comuunity Chest" cards, but the group is unsure what the cards would do in the game.
Point4.2: Sarah proposes that players
earn money landing certain cards, which leads disagreement among the group.
Point4.3: Michael suggests that players should be able buy and sell cards, but the group cannot agree on how implement this rule.
Point4.4: Emily suggests that players should be able trade cards with each other, but the group cannot agree the value of each card.
Point4.5: David suggests that players should able build hotels on their cards, which confuses everyone and leads further diaggreement.
Point5: The group eventually gives up on incorporating rules from other games and attempts play poker with the basic rules, but still struggles to understand the game. 1: The group decides give up incorporating rules from other games.

---

Point5.2: They attempt to play poker with the basic rules. Point5.3: The group still struggles understand the game.
Table 42: The first long outline from CONCOCT. Overall, CoNCOCT does fairly well to expand the vaguest parts, For example, CONCOCT realizes Point contains the largest chunk plot and tries to expand it many times. It tries discuss poker rules in detail. Of course, some parts still be further improved: 1) For Point 3 and Point 4, the major difference between them is about "Uno" and "Monopoly"; which is more concrete is hard to say. 2) Point 4.1.2.2, after expansion, still does not introduce anything important and perhaps could be removed. 3) rare situation occurs wherein one point overlaps with its parent's 's sibling, which is failure of our base outline generation system.
Concoct Long Outline for Premise
Premise: the coming of age everyone is given single bullet with This is your target.
Outline:
Point1: At the coming of age, everyone is given a single bullet with name on it. This is
your target.
Point2: The young adults are tasked with finding and killing their designated target.
Point2.1: 1: The young adults receive their designated target and begin their search for them.
1.int2.1.1: John receives his designated target and learns their name.
Point2.1.1.15 John receives his designated target.
1o1nt2.1.1.2: John learns the name of his designated target.
Point2.1.1.3: John researches his target's background and location.
Point2.1.1.4: John reaches out to Target 1's family and friends gather more information.
1o1.t2.1.1.4.1: John asks Target 1's family and friends about their relationship with
Target 1 and any possible conflicts
issues they may have had the past.
1.1442.1 John asks Target 1's family and friends about their whereabouts and habits.
1.14:2.1.1.4.3: John asks Target I's family and friends if they have any knowledge of Target 1's current whereabouts recent activities.
Point2.1.1.4.4: John thanks Target 1's family and friends for their help promises ses keep them safe.
Point2.1.1.5: John creates plan action track down Target
1. John scouts the areas where Target 1 was last seen or known to frequent.
Point2.1.1.5..2:
considers potential consequences his actions the morality killing his designated target.
1...t2.111.5.2.11 John considers the potential consequences of his actions.
1oint2.1.1.5.2.. John questions the morality of killing his designated target.
Point2.1.22 John creates a plan of action track down Target 1.
Point2.1.2.11 John researches Target 1's daily routine to determine the best time to
approach them.
Point2.1.2.27 John scouts Target 1's usual hangout spots to gather more information about their whereabouts.
Point2.1.3: John reaches out to Target 1's family and friends to gather more information about their whereabouts.
John reaches out to Target 1's family members to gather more information about their whereabouts.
Point2.1.3.2 John reaches out to Target 1's friends to gather more information about their whereabouts.
Point2.1.6 John searches social media and online platforms to find any clues about Target I's location.
Point2.1.5 Target realizes they are being hunted and goes into hiding.
Point2.2: 2: John uses various methods to track down Target 1, including speaking with their
family and friends and scouring social media.
Point2.3: 3: Target 1 attempts to defend themselves and evade John's 's pursuit.
Point2.4 John confrants Target 1 and must make the decision to either carry out the task
or spare their life.
Point2.4.1: John confronts Target 1 and holds them at gunpoint.
Point2.4.2: Target pleads for their life and explains why they were assigned as John's
target.
Point2.4.3: John hesitates and considers sparing Target 1.
Point2.4. 4.44 Target reveals information about the society's true motives and the consequences for not completing the task.
Point2.4. 4.4.1 Target 1 reveals that the society assigns targets based on arbitrary criteria, not actual wrongdoing.

---

Point2.4.4.1.1: Target 1 explains they were assigned as John's target despite not committing any actual wrongdoing.
Point2.4.4.1.22 Target 1 describes how other targets were chosen based on arbitrary
criteria such as their ethnicity, religion, or even physical appearance. Point2.4.4.1.23 Target questions the morality the society's traditions and urges John the same.
Point2.4.4.25 Target explains that failure to complete the task results in severe punishment, potentially affecting the young adult's family and friends. Point2.4. 4.nt2.4.4.3: Target urges John to reconsider his actions and to question the morality the society's traditions.
Point2.5: Other young adults successfully locate and kill their targets, while some struggle with the task and fail to complete it.
Point2.5.1: Young adult named Sarah successfully locates and kills her target. Point2.5.2: Young adult named Michael struggles with the task and ultimately fails to complete it.
Point2.5.3: Young adult named Emily becomes ruthless in her pursuit and goes beyond the task's s requirements.
Point2.5.4: Young adult named David has a change of heart and decides not to kill his target.
Point2.5.5: Young adult named Alex accidentally kills the wrong person and must face the consequences.
Point3:
The society watches and judges the young adults' actions as they hunt down their targets.
Point3.1: The society sets up observation posts to monitor the actions of the young adults
they hunt down their targets.
Point3.1.1: The society assigns team of observers to each young adult monitor their
actions.
Point3.1.2: The observers document the young adult's movements and actions in logbook.
P.int3.1.3: The observers binoculars and other equipment track the young adults' movements from distance.
1.int3.1.4: The observers report any significant actions events the society for further discussion.
Point3.2: The society discusses and debates the actions of the young adults based on what they observe.
Point3.3: The society uses the young adults' actions a means reinforce their beliefs and values the wider community.
Point3.3.11 society uses the actions of successful young adults as means to promote their beliefs and values the wider community.
P.int3.3.2: society condemns the actions of unsuccessful young adults as means to reinforce their beliefs and values to the wider community.
Point3.3.3. 3.33: The society uses the actions of the young adults justify the tradition assigning targets
to maintain the status quo.
Point4: Some young adults struggle with the morality killing their target, while others become ruthless in their pursuit.
Point4.1: Some young adults struggle with the morality of killing their target.
Point4.22 2: Others become obsessed with completing the task at any cost and become a danger
to themselves and those around them.
Point4.3: 3: Some young adults begin to form alliances with their targets in order to avoid completing the task.
Point4.4 4:: Ava becomes ruthless in her pursuit of her target and disregards the consequences of her actions.
Point5: The society reveals the reason for the tradition of assigning targets and the consequences for not completing the task. Point5.1: The society reveals the reason for assigning targets as way to control population growth and maintain order in society.
Point5.1.1 The society explains that they have been facing overpopulation and resource depletion for many generations.
Point5.1.2: The tradition of assigning targets is seen as the most effective way to control population growth and allocate resources.
1oint5.1.2.1 1: The society has determined that assigning targets is the most effective way to allocate resources and prevent overpopulation.
Doint5.1.2.25 The society believes that by eliminating those who are deemed threat to social order, they can maintain harmony and stability.
Point5.1.3: The society justifies the tradition by stating that it has been successful in preventing overpopulation and maintaining social harmony.
Point5.2: The consequences for not completing the task are severe, including banishment from society and being labeled Point5.2.1 2. 1: The society warns the young adults that failure to complete their assigned task will result in banishment from society.
threat to the community.

---

Point5.2.2: young adults are informed that not completing their task will also result being labeled a threat to the community.
2.int5.2.211: The society explains that not completing the task will result in being labeled as threat to community.
2...:5.2.2.2: The young adults express their fear and concern about being labeled as threat if they fail to complete their task. Point5.2.24 The society reassures the young adults that the label is only applied in extreme cases and that they have the power to prevent it by completing their task. Point5. 2.3: The society stresses the importance of maintaining order and el eliminating potential disruptors, and notes that failure to carry out the task could lead to disastrous consequences for the community.
Point5.2 2.3...1...1 3.1: The society emphasizes the potential consequences of not carrying out the assigned task, including the disruption of social order and the safety of the community. Point5.2.3 2:2. The society reminds the young adults that the tradition has been in place for generations and has been successful in maintaining order and stability in society. Point5.2.3.3. The society acknowledges the difficulty and moral implications of the task, but stresses the importance of eacrificing individual morality for the greater good of society.
Point5.3: The society explains that the targets are chosen based on their potential to disrupt the social order and that the tradition has been in place for generations. Point5.3.1: The society explains that the targets are chosen based on their potential to disrupt the social order.
P.int5.3.2: The tradition of assigning targets has been in place for generations.
Point5.3.3: The society justifies the tradition
necessary measure to maintain order in
society.
Point5.4: Some young adults begin to question the morality and motive behind the tradition and demand change from the society.
Point6: The young adults must face the aftermath of their actions and the impact it has whole.
their relationships and society
Point6.1: The young adults must confront their families and friends about their actions and the impact it has had their relationships. Point6.2 The society consequences of allowing young adults to kill each other. Point6.3.
deal with the aftermath of the tradition and the potential
young adults may face legal consequences for not completing their task for their actions during the hunt.
Point6.4: The young adults must
with the moral implications of their actions and the toll it has taken on their mental health.
Point6.5: The tradition of assigning targets questioned potentially changed as a have transpired.
result of the events Point6.6: The young adults must find a way to move forward rebuild their lives and relationships the aftermath Point6. 6. Some young adults struggle rebuild their relationships with their families and friends after the hunt.
hunt.
Point6. 6.2: Sone young adults may seek therapy or counseling to help them process their emotions and trauma from the hunt.
Point6. 6.3: Some young adults may choose to leave the society and start a new life elsewhere, away from the memories of the hunt. Point6.6. 6.4: The society may offer resources and support for young adults struggling ling to cope with the aftermath of the hunt.
Point6. 6.5: The young adults may come together to advocate for change and the end of the tradition of assigning targets.
Table 43: The second long outline from CONCOCT. Overall, the outline is well-paced according to the annotator.
Concoct Long Outline for Premise 8
Premise: The Door by Eric Basiletti
Outline:
Point1: man, John, discovers a mysterious door in his basement that leads to an alternate dimension.
Point2: John begins explore the alternate dimension and discovers its strange and dangerous inhabitants.
Point2.1: 1: John explores the alternate dimension and encounters strange creatures.
Point2.2: John discovers that the terrnntte dimension is dangerous and he must be careful
avoid being captured or harmed.
Point2.3: John befriends a group of friendly creatures who help him navigate the dangers the alternate dimension.

---

Point2.3.1: John and his friendly alternate dimension creatures encounter group of dangerous creatures.
Point2.3.2 3:2: John and his friends are outnumbered and outmatched by the dangerous creatures.
Point2.3.3 3.3: 3: One of John's friendly creatures sacrifices itself to save the group from the dangerous creatures.
Point2.3.44 John and his friends are grateful for Sarah's s help and invite her to join them on their journey.
Point2.4: John and his new friends are attacked by a group of hostile creatures and must fight for their survival.
1oint2.4.1: 1: John and his friends are ambushed by group of hostile creatures.
Point2.4.2: The group engages in a fierce battle, using their unique abilities to defend themselves.
Point2.4.33 John and his friends are outnumbered and on the brink of defeat.
1oint2.4.4: One of John's friends sacrifices themselves to save the group, giving them chance to escape.
Point2.4.5: John and his friends are emotionally shaken by the loss of their comrade and must continue their journey with heavy hearts.
Point2.5: John and his friends narrowly escape the hostile creatures and continue their journey through the alternate dimension.
5. 1: John and his friends come across a large, open field that they must cross to continue their Journey.
P. As they cross the field, John notices small group of hestile creatures in the distance.
Point2.5.3: John and his friends quickly change their path to avoid the hostile creatures, but they spot the group heading towards them.
Point3: John meets woman, Sarah, in the alternate dimension who helps him navigate the dangers and reveals that she too is from John's world.
Point3.1: John and Sarah team up to explore the alternate dimension together.
Point3.2: Sarah reveals that she also from John's world and was transported to the
alternate dimension through similar door in her own basement.
Point3.3: Sarah shares her knowledge of the alternate dimension and helps John navigate its
dangers.
Point3.4: John and Sarah encounter group of hostile inhabitants in the alternate fight survive. Point3.4.1: John and Sarah are ambushed by group of hostile inhabi who want capture them.
dimension and
Point3.4.1.15 John and Sarah hear strange noises and realize they are being followed.
Point3.4.1.22 The hostile inhabitants tants emerge from the shadows and surround John and Sarah.
Point3.4.1.33 The hostile inhabitants demand that John and Sarah come with them,
threatening them with violence they refuse.
Point3.4.1.44 John and Sarah refuse to go with the hostile inhabitants, knowing that it will mean certain death.
Point3.4. 4.15: John and Sarah realize they must fight for their survival and prepare to defend themselves.
Point3.4. 4.1.6. The hostile inhabitants attack John and Sarah with crude weapons.
2aint3.4.1.7 John and Sarah use their wits and makeshift weapons to fight back against the hostile inhabitants.
Point3.4.2: John and Sarah fight back against the hostile inhabi using fakeshift
weapons.
Point3.4.3: Sarah uses her knowledge of the alternate dimension to outsmart the hostile inhabitants and lead John to safety.
Point3.4.3.1 Sarah uses her knowledge of the alternate dimension to lead John through a hidden passage that the hostile inhabitants don't know about.
Point3.4. 4.3...4.... 4.3.2: John and Sarah make their way through the hidden passage, avoiding detection by the hostile inhabitants.
Point3.4 4.3.3.33 Sarah leads John to a secret exit that takes them out of the hostile
territory and into safer area of the alternate dimension.
Saint3.4.3.4 John and Sarah take a moment to catch their breath and plan their next move. 5: Sarah shows John hidden safe haven in the alternate dimension where they can rest and plan their next move.
Point4: John and Sarah work together to find way back to their world, but they are pursued by malevolent entity that wants to keep them trapped in the alternate dimension.
Point4.1: John and Sarah search for way back their own world.
Point4.2: The malevolent entity begins pursue John and Sarah.
Point4.3: John and Sarah encounter tbstacles and dangers as they try evade the entity.
Point4.3.15 John and Sarah must navigate through maze-like structure filled with traps and obstacles avoid the pursuing entity.
Point4.3.2 The entity sends its minions to attack John and Sarah they try make their way through the maze.

---

Point4.3.3: John and Sarah discover hidden passageway that leads them a lower level the maze.
Point4.3.4: The entity corners John and Sarah in dead-end roon, forcing them to fight for
their lives.
Point4.4: John Sarah discover a portal back to their own world, but the entity close
behind.
Point4.4.1: John and Sarah discover the portal back to their own world.
Point4.4.2: The malevolent entity catches up to John and Sarah as they prepare to go
through the portal.
Point4.4.3: John and Sarah fight to keep the entity at bay while trying to activate the
portal.
Point4.4.4: John and Sarah manage to push the entity back and run through the portal.
5o John and Sarah make desperate escape through the portal, but the entity manages
to follow them.
Point4.5.1: John and Sarah make a desperate escape through the portal.
Point4.5.2: The malevolent entity manages to follow them through the portal.
Point4.5.3: John and Sarah realize that the entity has followed them.
Point4.5.4: The entity begins to wreak havoc in their world.
Point4.5.5: John and Sarah must find a way to stop the entity and protect their world.
Point5: John and Sarah finally find way back to their own world, but they realize that the malevolent entity has followed them and is now wreaking havoc in their world.
Point5.1: 1: John and Sarah return to their world and realize that the malevolent entity has
followed them.
1.11t5.1.1: John and Sarah assess the damage caused by the malevolent entity in their world.
Point5. 1.2: John and Sarah realize that the entity is becoming stronger and must be stopped
before it's too late.
Point5.2: John and Sarah try to find way to stop the malevolent entity from causing further damage.
Point5.3: John and Sarah discover that the only way stop the entity is return to the alternate dimension and find its source.
Point5.4: John Sarah return to the alternate dimension and encounter even greater
dangers than before.
Point5.4.1: John and Sarah ambushed by group of hostile creatures.
Point5.4.2: John and Sarah must navigate through dense forest while being pursued by dangerous predator.
Point5.4.3: John and Sarah come across treacherous landscape that tests their physical and mental endurance.
Point5.4.4: John and Sarah find hidden cave that leads to the source of the malevolent entity.
Point5.4.5: John and Sarah must navigate series traps obstacles in the cave to reach their goal.
Point5.4.6 6: John and Sarah face off against powerful guardian that protecting the source of the malevolent entity.
Point5.4.77 7: John and Sarah use their combined strength and intelligence to defeat the guardian and destroy the source of the malevolent entity.
Point5.4.7, 7.1 John and Sarah engage a physical battle with the guardian.
Point5. 4.7.2: The guardian uses its powers to create illusions to confuse John and Sarah. 2oint5.4.7.33 Sarah uses her knowledge
the alternate dimension to see through the illusions and guide John in the battle.
Point5.4.77 4.7.:: John and Sarah work together to weaken the guardian's defenses and find its weak spot.
Point5.4.7.55 John delivers the final blow to the guardian, destroying it and opening the way to the source of the malevolent entity. Point5.55 55 John and Sarah find the source of the malevolent entity and engage in final battle to stop it.
Point5.5. John and Sarah navigate through the dangerous alternate dimension to reach the source of the malevolent entity.
Point5.5 5. 2: John and Sarah encounter various obstacles and fight off hostile creatures along the way.
5.2.15 John and Sarah encounter group of hostile creatures blocking their path.
Point5.5 5.2.2: John and Sarah use their weapons and skills to fight off the creatures.
Doint5.5.2.3. John and Sarah sustain injuries during the fight and must tend to their wounds.
Point5.5.2.5 5.2.4: John and Sarah continue on their journey, but they now more cautious and alert potential dangers.
Point5.5.2 2.5: John and Sarah come across treacherous terrain that requires them to navigate carefully.
Point5.5.3 John and Sarah discover the malevolent entity's weakness and plan their strategy accordingly.

---

Point5.5.4 John and Sarah engage a fierce battle with the malevolent entity, using the skills and knowledge they gained from their experiences the alternate dimension. Point5. 5.4.1: John and Sarah engage a fierce physical battle with the malevolent entity.
Point5. 5.:.2: John and Sarah use their knowledge of the entity's weakness to gain an advantage in the battle.
Point5.5 5.5.5...33: The malevolent entity unleashes its full power, causing destruction and chaos the alternate dimension.
Point5.5. 5. John and Sarah struggle to hold their ground against the entity's overwhelming power.
Point5.5 5.4. 4: Sarah sacrifices herself to weaken the entity, giving John the coportunity to strike the final blow.
Point5.5. 5.4.6 John delivers the final blow, destroying the entity and saving both the alternate dimension and his own world.
Point5.5.44 1.4.5.5.46..11. John delivers the final blow to the malevolent entity
Point5.5.4. 5.4. The entity retaliates, unleashing a final burst of energy to try to stop John.
Point5.5 5.5: John and Sarah emerge victorious, but they are physically and emotionally drained from the ordeal.
Point5.5.5.7 John and Sarah are physically and emotionally drained from the battle.
Point5.5.5.2: John and Sarah take a moment to catch their breath and reflect on their experiences.
Point5.6: John and Sarah emerge victorious and return to their own world, but they are forever changed by their experiences. Point5.6.1: John and Sarah emerge victorious in their final battle against the malevolent
entity.
Point5.6.1.1: John and Sarah engage in final battle with the malevolent entity.
Point5.6.1.23 1.222 John and Sarah their knowledge and experience from the alternate
dimension to gain the upper hand in the battle.
Point5.6.1.2 1.3: The malevolent entity defeated and dissipates into the air, leaving behind feeling of peace and tranquility.
Point5.6.1 1.4: John and Sarah embrace, relieved that the ordeal is and grateful for each other's company and support throughout all. Point5.6.1.5 1: John Sarah embrace each other in relief and gratitude for their victory. Point5.6.1.4.2. They take
to catch their breath and look around their
surroundings.
Po1.:5.6.1.4.3: John Sarah exchange few words, expressing their amazement what they'v ve just experienced.
Point5.6.1.4.44 They both acknowledge how much they've ve grown and changed throughout their journey.
6...t5.6.1.4.5: John Sarah share a kiss, sealing their bond and connection after everything they've been through.
Point5. 6.2: John and Sarah struggle readjust to their normal lives after their time in the alternate dimension.
Point5. 6.2.1: John struggles with PTSD and nightmares from his time in the alternate dimension.
Point5. 6. 2: Sarah has difficulty readjusting to her old life and feels disconnected from her friends and family.
Point5. 6. 2.3: John and Sarah seek therapy to help them cope with their experiences.
Point5. 6. 4: John and Sarah find solace in each other and their shared experiences.
Point5. 6. 2.5: John and Sarah decide to keep the door in their basement locked and never
speak of their exper iences to anyone else.
Table 44: The third long outline from CONCOCT. Overall, the outline is well-paced according the annotator.
Downstream Stories of Concoct in Short Outline Regime for Premise
Premise: Planetary storms are rich source of ion energy. Ion mining is the most lucrative and the most dangerous job in the galaxy. Tell me the story of an ion miner.
Point
Outline: Jack struggles to learn the ropes of ion mining and feels like an outsider among the experienced crew members.
Chapter Content: Jack stepped onto the ion mining ship for the first time, couldn't 't help but feel overwhelmed by the experienced crew members bustling around him. They had camaraderie he couldn't penetrate, and struggled to find his place among them. The intricacies
mining seemed like foreign language to Jack, and constantly found himself sumbling over the terminology and procedures. It was clear that he had long way to go before he could call himself true ion miner.

---

Point
Outline: Jack makes a mistake during a mining operation, causing tension among the crew. learns the importance of following protocol and gaining trust of his crewnates.
Chapter Content: During routine mining operation, Jack's lack experience led him make critical mistake. explosion that sent shockwaves through the ship. The crew was furious, their trust Jack shattered. It was a harsh lesson for him to learn the importance of following protocol and gaining the trust of his crewmates. From that moment on, Jack vowed to do whatever took to make amends and prove himself worthy.
misjudged the stability of mineral deposit, causing small
Point 3:
Outline: Jack starts to earn small victories by showing his work ethic and dedication to the crew, which slowly gains their acceptance.
Chapter Content: Determined to make a fresh start, Jack dove into his work with unrelenting dedication. He volunteered for every task, no matter how mundane or physically demanding.
Slowly but surely, the crew began to take notice of his work ethic and commi tment. They saw that he was willing to put in the extra effort to earn his place among them. Jack started to receive praise for his small victories, whether it was successfully repairing a malfunct inffuncttininn tool showing exceptional knowledge during crew meeting. With each accomplishment his acceptance grew.
Point 4:
Outline: Jack faces near-fatal accident while working with the ion energy. He realizes the gravity of the profession and the risks involved.
Chapter Content: The gravity of the profession hit Jack with full force when he experienced near-fatal accident. While handling the volatile ian energy, surge unexpectedly occurred, causing powerful electric shock to course through his body. In that terrifying moment, he fought for survival, he realized the immense risks involved in being ion miner. It wake-up call that made him appreciate the importance of safety protocols and the need for constant vigilance such dangerous profession.
Point
Outline: Jack spends long hours studying the manuals and asking questions his crewmates understand the basics ion mining.
mining, Jack spent countless hours poring over the manuals provided by the mining corporation. He made notes, highlighting key points, and even created his own study guides ensure he absorbed every crucial detail. Additionally,
Chapter Content: his quest gain deeper understanding
sought guidance from experienced crewnates, asking technical discussions. Jack's
questions about their own experiences and diving determination master the basics of ion mining was evident everyone on board.
Point
Outline: The crew takes Jack under their wing and shows him practical examples of how to mine ions, helping him to understand the process better.
Chapter Content: Recognizing Jack's growing commitment tment and eagerness to learn, the crew began to take him under their wing. They shared practical examples, demonstrating the intricacies of ion mining on the ship's simulation systems. They allowed Jack to shadow them during mining operations, explaining their thought processes and answering ing his questions along the way. Through hands-on experience and the guidance of his crewmates, Jack's understanding of the mining process deepened, giving him more confidence in his abilities.
Point 7:
Outline: Jack faces a difficult task buring storm and manages to complete it successfully, earning the respect and admi ration of his crewmates.
Chapter Content: Jack faced his biggest challenge yet during a ferocious planetary storm. As the ship trembled under the force of the winds and lightning, the crew scrambled to secure their mining equipment. It was daunting task, but Jack's hard work finally paid off. Applying the knowledge he had acquired, he successfully completed his assignment despite the treacherous conditions. The crew watched in awe as Jack skillfully maneuvered the ship, earning their respect and admiration.
Point 8:
Outline: Jack becomes integral part of the crew, working alongside them seamlessly and earning their trust and friendship.

---

Chapter Content: Jack had finally become an integral part the crew. He seamlessly worked alongside them, contributing to the success their mining operations. The initial skepticism had transformed into deep trust friendship. an outsider, but as a valuable team member. Whether it was assisting with repairs, analyzing mineral samples, or providing crucial insights during decision-making, Jack's skills dedication had made him indispensable.
crew no longer saw Jack as
Point 9:
Outline: The crew's ship equipment mal falnicioo during storm, putting them in danger. Chapter Content: Disaster struck when the crew's ship equipment malfunctioned during violent storm. The sudden loss of power and control left them vulnerable and adrift in space. Panic and fear spread among the crew as they realized the imminent danger they faced. It was a race against time to salvage the situation and prevent any further catastrophe. The crew desperately brainstormed for solution, hoping that they could overcome this dire predicament and survive against all odds.
Point 10:
Outlines Jack suggests going outside to fix the equipment, but the crew is hesitant due to the danger.
Chapter Content: Jack's quick thinking led him to suggest risky plan to fix the damaged equipment. Despite the crew's hesitation due to the inherent danger, Jack believed it was their only chance at survival. With unwavering determination, he explained his strategy, carefully highlighting the potential risks and benefits. It was tense moment as the crew weighed their options, but eventually, they put their faith in Jack's expertise and agreed to embark on this perilous mission.
Point 11:
Outline: Jack takes risk and successfully fixes the equipment, earning the respect of his crewmates.
Chapter Content: With adrenaline pumping through their veins, the followed Jack's lead they ventured outside the safety of their ship. The freezing cold of space engulfed them they worked diligently repair the damaged equipment. The risk palpable, but Jack's meticulous planning paid off. Despite the lingering danger, the crew found solace Jack's bravery resourcefulness. He had proved his worth again, earning their utmost respect admiration.
Point 12:
Outline: The crew notices a decrease in their ion levels suspects foul play from rival mining crew.
Chapter Content: The crew noticed a disturbing decrease in their ion levels, suspecting foul play from a rival mining crew. The sudden loss not only threatened their livelihood but also ignited their determination to uncover the culprits responsible. With heightened vigilance, they intensified their monitoring efforts, meticulously analyzing their data for any irregularities. leaving them with what felt like empty hands the vastness space.
became clear that someone was pilfering their hard-earned ions,
Point 13:
Outline: The crew starts monitoring the ion levels closely and notices pattern of theft from the rival mining crew.
Chapter Content: The crew's suspicions deepened as they meticulously studied the patterns of ion theft. Working together, they pieced together a puzzle of information, connecting the dots to identify the rival mining crew responsible. It was cloak-and-dagger game as the crew covertly observed their competitors, gathering evidence to prove their guilt. With each revelation, their determination to catch the thieves grew stronger, fueled by the sense of justice that burned within each crew member.
Point 14:
Outline: The crew devises a plan to catch the thieves and recover their stolen ions. Chapter Content: Armed with their irrefutable evidence, the crew devised a meticulously detailed plan to catch the rival mining crew red-handed and recover their stolen ions. Every aspect was analyzed, from the timing to the precise execution. With their hearts pounding in their chests, the crew set their plan into motion, prepared to face the consequences of exposing their competitors on the interstellar stage. The stakes were high, but the crew resolute in their pursuit of justice.
Point 15:
Outline: The rival mining crew's attack damages the crew's ship's engines, causing it malfunction and lose power.

---

Chapter Content: The intense rivalry between the crews escalated to dangerous level. Caught in the middle of violent planetary storm, crew's ship suffered severe damage, especially the engines. The realization of their precarious situation settled heavily upon them. With the loss power increased vulnerability, it felt as if fate had dealt them cruel blow. But the face adversity, they refused to give up, knowing that their survival depended on their unwavering determination.
Point 16:
Outlines The crew tries to repair the ship's s engines, but the damage is too severe to fix quickly.
The crew valiantly attempted to repair the ship's s engines, but it became apparent that the damage was too severe to fix quickly. Time was slipping away, and the crew despaired as they faced the possibility of drifting helplessly in space, one wrong move away from disaster. They knew they had to find solution, and they had to find it fast. So they embarked on a frantic search, scouring their limited resources for anything that could save them from their imminent peril.
Chapter Content:
Point 17:
Outline: The crew frantically searches for solution as they drift closer to the asteroid field.
Chapter Content: Panic coursed through the crew's veins as they drifted ever closer to a treacherous asteroid field. Abandoned by their damaged engines, they desperately sought way to alter their course. With limited power at their disposal, the crew's 's hopes dwindled as they faced unyielding reality. Time was running out, and they needed a miracle to guide them back to safety. It was in this moment of desperation that Jack's 's mind sparked with daring plan.
Point 18:
Outline: Jack
with plan to the remaining power to maneuver the ship away from the asteroids and towards nearby planet.
Chapter Content: Drawing upon his technical expertise and determination, Jack devised audacious plan harness the remaining power in their ship and steer away from the impending asteroid doom. The out each step the unconventional maneuver. Every movement had to be executed with precision, leaving no room for error. with renewed hope flickering in their hearts, the crew put their trust in Jack's ingenuity.
listened intently, their eyes fixed Jack, as he laid
Point 19:
Outline: rival mining crew deploys a powerful laser that hits the crew's ship, causing critical damage and injuring some crew members.
Chapter Content: The rivalry with thieving mining crew reached a boiling point as they deployed a powerful laser, striking the crew's ship with devastating force. The impact was catastrophic, causing critical damage and injuring several crew members. Chaos reigned as alarms blared and emergency lights flickered in the dimly 1it ship. The crew, filled with anguish and anger, knew they to fight back to protect their own lives and salvage any hope of survival.
Point 20:
Outline: The crew fights back, using their weapons to damage the rival ship and create a diversion.
Chapter Content: with determination burning in their eyes, the crew used every weapon at their disposal to retaliate against the rival mining crew. Explosions rocked the space around them as laser fire illuminated the darkness. It was a fierce battle, each crew member fighting with unwavering resolve. Their united front sent shockwaves through the rival crew, momentarily creating diversion that allowed the crew a moment of respite amidst the chaos. Freedom was wi whin their grasp; they just had to seize it.
Point 21:
Outline: Jack comes with a plan to trick the rival mining crew into using their laser at the wrong time, leaving them vulnerable to counterattack.
Chapter Content: In the midst of the merciless firefight, Jack's keen mind crafted plan to outwit the rival mining crew. He analyzed their patterns and vulnerabilities, recognizing opportune moment to strike. With a cool head and unwavering resolve, Jack orchestrated the crew's movements, ensuring they deceived the rival crew. The moment arrived, and the crew unleashed counterattack, catching the rival crew completely off guard. Victory suddenly seemed within reach, thanks Jack's strategic thinking.
Point 22:
Outline: Jack sneaks the rival mining ship disables their weapons.

---

Seizing the opportunity, Jack boldly infiltrated the rival mining ship, relying on stealth and cunning disable their weapons. Every step had precise, every action executed flawlessly. ship, avoiding detection by the rival crew. With hands steady heart pounding, he achieved his objective, rendering rival crew defenseless and powerless. It was pivotal moment, one that would forever etched into Jack's memory.
Chapter Content:
tension was palpable as Jack maneuvered through the
Point 23:
Outlines Jack faces off against a member of the rival crew in a physical fight, but ultimately defeats them.
Chapter Content: The confrontation escalated as Jack encountered a member of the rival mining crew, ready to defend their ship and ill-gotten gains at all costs. A brutal physical fight ensued, the clash of bodies echoing through the rival ship's corridors. Jack's s agile movements and relentless determination gave him the upper hand. Blow after blow was exchanged, the stakes higher than ever before. With the sound of victory ringing in his ears, Jack emerged triumphant, his opponent defeated.
Point 24:
Outline: Jack escapes the rival ship and returns to his own ship, injured but victorious. Chapter Content: Bloodied and battered, Jack managed to escape the ravaged rival ship, making his way back to the safety of his own crew. Though injured, his spirits soared as he realized the significance of his victory. It was moment of affirmation, proof that his journey from struggling outsider to valued member of the crew had been worth every setback and challenge. He had proven himself in the face of adversity, securing his place true ion miner.
Point 25:
Outline: Jack uses his quick thinking and bravery help the crew defeat the rival mining crew and secure their lons.
Chapter Content: With the rival mining crew defeated and their stolen ions recovered, the basked in the aftermath of their victory. Jack's quick thinking and bravery had played pivotal role in securing the outcome they had fought hard for. They had not only salvaged their livelihood but also demonstrated the strength and resilience that bound them horizons, ready to
all together. With renewed determination, they set their sights face whatever challenges awaited them in the vast expanse of the galaxy.
Table 45; First story generated by CoNCoCT in the Short Outline regime.
Downstream Stories of Concoct in Short Outline for Premise 10
Write the most horrifying, creepy, story you think of that completely based reality. No supernatural, demonic, mystical cheats.
Premise:
Point 1:
Outline: A woman discovers that her husband has been secretly filming her every move for years.
The walls of the woman's world crumbled around her as she stumbled upon unimaginable truth. Hidden deep within secret compartment, she uncovered countless tapes, each one documenting her every she realized her husband had been the puppeteer behind this sinister game. Panic tightened its grip her heart, whispering that her sanctuary had been tainted by deceit and violation.
Chapter Content:
Shock and disbelief washed over her like icy water,
Point
Outline: Jack initially denies Sarah's accusations and gaslights her, making her doubt her own sanity.
Chapter Content: Sarah confronted husband, desperately seeking truth, accusations with a deceiving smile. Jack adamantly denied any involvement, planting seeds doubt within her mind. Gaslighting became his weapon, shifting the blame onto Sarah's fragile psyche. The weight of his lies pressed upon her, eroding her self-confidence until she doubted her own sanity. Fear clung to her like a spider's s web, trapping her tormenting maze of uncertainty.
her
Point 3:
Outline: Sarah tries to reason with Jack and convince him seek help or therapy.

---

Chapter Content: Sarah pleaded with Jack, urging him seek help or therapy for whatever sinister compulsion drove at otmepted to unlock the empathy she once believed existed within him. But her pleas echoed into emptiness as he remained steadfast in his denial, refusing acknowledge the depth his perverse actions. Helplessly, Sarah realized that reason and compassion held no power over her husband's twisted desires.
invade privacy. Through tear-stained eyes, she
Point 4:
Outline: Jack explains the purpose of each weapon and how he plans to use them to harm Sarah. Chapter Content: In a haunting revelation, Jack revealed the purpose behind each weapon he met meticulously collected. With a chilling calmness, he detailed his twisted plans of harm, inflicting unspeakable pain upon the woman he once vowed to protect. Each weapon represented a grotesque embodiment of his desire for control, a manifestation of his twisted fantasies. Terror gripped Sarah tightly, squeezing every ounce of hope from her soul, as she realized the depths of depravity within her husband's mind.
Point 5:
Outline: Jack shows Sarah the notebook he has been keeping about her daily activities.
Chapter Content: The pages of the oaths he had sworn lay scattered before her eyes, inked with his meticulous observations. Jack brandished his sinister notebook, proudly displaying the lengths he had gone to spy his wife's every move. The mundane details of her daily activities were transmuted into something nefarious, dripping with a venomous intent. Sarah's s heart raced, feeling violated, she learned that her private life had been laid bare, observed and controlled by the one person she trusted most.
Point 6:
Outline: Jack points out specific details about Sarah's life, such her usual route work, where she likes to shop, and who she talks to regular basis. Chapter Content: Jack's malevolent knowledge danced his tongue he effortlessly
recounted specifics about Sarah's life. Every intimate detail, from her habitual route to work to the shops she favored, exposing the tangled threads of his obsession with meticulous accuracy. The tendrils of apprehension ensnared Sarah's mind, she realized the stark reality: she pawn Jack's horrifying game, manipulated and laid bare for his amusement.
unravelled before her eyes. He revealed his twisted web,
Point
Outline: Sarah feels violated and terrified as she realizes the extent of Jack's obsession with her.
Chapter Content: icy chill gripped Sarah's heart, spreading its tendrils of terror throughout her entire being. The realization
husband's chilling obsession shredded the tapestry of her once-normal life. The warm embrace of familiarity twisted into a suffocating cocoon of fear. Each additional puzzle piece she uncovered revealed the depth Jack's voyeuristic malice. Paralyzed with horror, Sarah was left trembling the cradle her home, longing for escape from this living nightmare.
Point 8:
Outline: Sarah realizes that Jack has been following her for years and has even broken into her workplace to gather information about her.
Chapter Content: Sarah felt the shroud of horror descend as Jack's nefarious game unraveled. He had not only shadowed her every move, but had also broken into her workplace, leaving no corner of her life untouched. The realization struck her with a force she could hardly comprehend. Panic swelled within her chest, suffocating her, as she exposed the chilling evidence of Jack's 's trespasses. In that moment, Sarah's ss world fractured, and she knew she could never feel safe within the walls that once sheltered her.
Point 9:
Outline: Sarah discovers room in the mock-version of their home that resembles their bedroom with mannequin resembling her lying on the bed, dressed in her clothes. Chapter Content: In a hidden chamber of sickening revelation, Sarah stumbled upon grotesque mockery of her own bedroom. mannequin, its hollow eyes mirroring her own, sprawled upon the bed adorned with her stolen clothes. Her heart pounded furiously, choking her with terror, chilling chorus of violation, confirming the depths of Jack's sick obsession beyond question. Escape seemed futile, trapped in her own stolen image.
she stared at the puppet that bore her likeness. The room sang with
Point 10:
Outline: Sarah finds map of their neighborhood with her daily routine and potential escape routes marked out with different colors.

---

Chapter Content: unsettling realization dawned upon Sarah as she discovered meticulously detailed map of her neighborhood. Her daily routines were etched vibrant colors, marking out her familiar paths and potential escape routes. The once-familiar streets of her community now transformed into labyrinth surveillance. Desperation clawed at her resolve, knowing that Jack's ' onnipresence extended far beyond their home. Each color on the map unveiled the calculated measures taken suffocate her every move.
Point 11:
Outline: Sarah realizes that Jack has set up hidden cameras and microphones throughout their home to monitor her every move.
Chapter Content: Sarah's ' breath caught in her throat as she discovered the hidden cameras and microphones that Jack had sown like insidious seeds throughout their once-safe haven. Every room was now stage for his voyeuristic pleasure, an unblinking eye that recorded her every move. The walls whispered their secrets, reminding her of the violation lurking within. Helplessness consumed her as she realized Jack's 's all-seeing presence, stripping away her autonomy and reducing her to puppet in his twisted game.
Point 12:
Outline: Jack threatens Sarah and tells her that no one will ever believe her if she tries to escape or seek help.
Chapter Content: Jack's voice dripped with venomous glee as he unleashed his cruel threats upon Sarah. He sneered, relishing in the sadistic control he held over her, assuring her that one would ever believe her if she dared to escape manipulations tightened around her, choking her spirit. Fear and despair mingled within her veins she comprehended the chilling truth: Jack's ss thirst for dominance knew no bounds, and she was at his mercy.
seek help. The noose of his
Point 13:
Outline: Sarah runs through the streets, looking for a place hide from Jack.
Chapter Content: The streets blurred around Sarah she fled from the monstrous specter looming behind her. Every corner became fleeting refuge, and yet, potential trap. Panic surged through her veins, propelling her forward, onwards, seeking solace in the anonymity of the cityscape. Each heartbeat echoed the pounding of her desperation, propelling her towards elusive sanctuary that seemed just beyond her grasp. But as the minutes ticked by, hope slipped away, surrendering the realization that there was no escape.
Point 14:
Outline Sarah frantically looks around for way out, but there is no escape. Chapter Content: Desperation clung to Sarah as she frantically searched for an exit, her brembling hands futilely trying every locked door and barred window. Her surroundings transformed into a labyrinth of hopelessness, each corridor leading her deeper into the clutches her nightmare. The world beyond these walls remained tantalizingly out reach, mocking her desperation. Panic mingled with despair, whispering fearfully that freedom was distant dream, forever beyond her tenuous grasp.
Point 15:
Outline: Jack advances towards Sarah with a menacing grin on his face, relishing in the thrill of finally catching his prey.
Chapter Content: Jack's s face contorted into a sinister grin, his eyes filled with a predatory hunger. He noved toward Sarah with a slow, deliberate gait, relishing in the
anticipation of finally capturing his prey. Every step sent tremors of fear through her body, paralyzing her with the realization that his malevolence had reached its climax. There was no escape from the fate that awaited her, his intentions woven into the fabric of his depraved desires.
Point 16:
Outline: Sarah fights back against Jack, using every ounce of strength she has to defend herself.
Chapter Content: Sarah's survival instinct surged within her, overriding the paralyzing grip of fear that Jack had ensnared her with. She Fought back with every ounce of strength, her adremaline-fueled resolve transforming her into force to be reckoned with. In that painful dance of struggle, she found a flicker of defiance in the depths of darkness. Her body throbbed with newfound determination, unwilling surrender to the twisted desires of her captor.
Point 17: Outline: Sarah fights back against Jack, using self-defense techniques she learned years ago.

---

Chapter Content: Memories self-defense training flooded Sarah's mind, carried by an undercurrent of fury and fear. tapped into the reservoir strength within her, honed through years discipline and preparation. Her body moved with an instinetual grace, unleashing strikes and techniques imprinted deep within her muscle memory. The advantage knowledge merged with the desperation of survival, empowering her to stand against her tormentor, even in the face insurmountable odds.
Point 18:
Outlines Sarah goes to the courthouse to apply for a restraining order.
Chapter Content: Sarah entered the hallowed halls of the courthouse, clutching her shattered sense of security in balled fists. With determination etched upon her face, she sought Justice, applying for a restraining order to shield her from Jack's insidious presence. Each step forward was an act of defiance against the torment he had inflicted upon her. Trembling but resolute, she vowed to take back control of her life, drawing strength from the flickering flame of hope that still burned wi within.
Point 19:
Outline: Sarah struggles to provide enough evidence for the restraining order to be granted. Chapter Content: The weight of proof pressed heavily upon Sarah's trembling shoulders as she struggled to provide enough evidence to support her plea for restraining order. The document in her hands felt burdened by her inability to substantiate her claims. Doubt gnawed at her resolve, taunting her with the possibility that her tormentor would elude punishment once again. The suffocating realization that her plea could be dismissed left her teetering the edge of despair.
Point 20:
Outline: The judge denies Sarah's request for restraining order, citing lack of evidence.
Chapter Content: The judge's gavel fell, delivering the crushing blow that Sarah had feared. Her request for restraining order was denied, the judge citing lack of concrete evidence. The courtroom walls closed in Sarah, disbelief and anguish mingling in her eyes like tempest. The weight of injustice settled her shoulders, threatening extinguish the fragile flicker hope that remained. She stood alone, vulnerable the whims of her tormentor, as the system failed protect her.
Point 21:
Outline: Sarah tries gather more evidence
own, puts herself danger in the
process.
Chapter Content: Sarah knew her fate rested her own hands. No longer able rely on the mercy legal system, she took upon herself gather
evidence needed to bring Jack's monstrous actions light. She navigated the treacherous waters her life, exposing herself the ever-present danger that lurked around each corner. Every moment spent collecting proof pushed her further into the depths her own personal hell, as she sacrificed her own safety in pursuit justice.
Point 22:
Outline: Sarah feels trapped and helpless, realizing that she is on her own to protect herself from Jack's threats.
Chapter Content: Trapped within a web of fear and isolation, Sarah realized she was alone in her struggle against Jack's tormenting grip. Friends turned away, unable to comprehend the suffocating terror that engulfed her every waking moment. She wrestled with the knowledge that she was the sole defender of her own sanctuary, with only her determination and resilience shielding her family from the sinister threat that loomed beyond their doors. The burdens of survival weighed heavily upon her, but she refused to surrender.
Point 23:
Outline: The lawyer advises Sarah to gather as much evidence possible to support her case and increase the chances of successful restraining order.
Chapter Content: Seeking guidance, Sarah reached out to lawyer well-versed in the twisted mechanisms of justice. The attorney advised her to gather much evidence possible, encouraging her to amplify the strength of her case. With reassurance and sense of purpose, Sarah knew she needed to build an impenetrable fortress of evidence, brick by brick. Her resolve solidified, ready to battle against the predatory force that sought to consume her life.
Point 24:
Outline: The legal clerk explains to Sarah that if the restraining order is approved, it may not be enough to protect her from Jack.

---

Chapter Content: Sarah listened intently as the legal clerk explained limitations a restraining order. Its paper-thin protection offered only semblance of security against the darkness that haunted her. She learned that even granted, it might do little to dissuade Jack from his evil intentions. Understanding the inadequacies of the legal system, Sarah forged ahead, determined gather ammunition for her war, grasping onto the flickering hope that her evidence would provide a safety net this treacherous battle.
Point 25:
Outline: The lawyer suggests that Sarah gather as much evidence as possible to strengthen her case, such as screenshots of threatening messages or recordings of Jack's behavior. Chapter Content: Armed with guidance, Sarah understood the true value of irrefutable evidence. Screenshots of chilling messages, disturbing recordings of Jack's 's behavior these would fortify her case against him. She delved into a strategic pursuit, gathering the damning fragments that would unveil the horrors lingering within her life. Each word, each image captured, became a weapon of survival, a testament to her resilience. Strengthened by her endeavor, she focused on revealing the truth, no matter the cast.
Point 26:
Outline: Emily advises Sarah to gather more evidence and document any further incidents of stalking threats, while also exploring other options such moving to new location hiring a private investigator.
Chapter Content: Emily, trusted friend, became Sarah's confidante, urging her to gather further evidence while exploring other avenues of escape. Moving to location hiring private investigator emerged as possible paths for liberation from Jack's clutches. Sarah weighed each option carefully, numbing her fear with a practical determination. She understood that the walls of her prison were closing in, but hope flickered within her, offering glimmer of the potential freedom that lay beyond this nightmare.
Point 27:
Outline: Sarah realizes that she must take matters into her hands to protect herself and her family, leading Chapter Content: the sun set on her world, Sarah made dangerous choice. Armed with evidence her shield, she confronted Jack head-on. The confrontation promised be the climax of their twisted tale, battle between predator and prey in which the outcome hung the balance. The adrenaline coursing through veins masked trembling limbs, empowering her to face tormentor with newfound strength. the depths that perilous encounter, Sarah's destiny would forever altered.
dangerous and unpredictable confrontation with Jack.
Table 46: Second story generated by CONCOCT in the Short Outline regime.
Downstream Stories of Concoct in Short Outline for Premise 11
Premise: You find you just background character someone else's dream. Morning coming soon you want keep existing so you must keep them from waking up...
Point
Outline: Dreamer realizes they are background character in someone else's 's dream the dreamen's consciousness. A sudden awareness consumed them they were nothing more than background character in someone else's dream. Panic surged through their being. fueled by the impending threat of their existence vanishing with the morning light. Desperate to hold onto this fragile dream world, the dreamer braced themselves for the battle of their very existence.
Chapter Content: the dawn approached, startling realization swept
Point
Outline: Dreamer
keep existing in the dream Chapter Content: With every fiber their being, the dreamer resolved to keep existing this dream. Their desire for existence burned bright within them as they fought against the impending wakefulness resolve to cling this imaginary realm. They were determined not be erased, to continue to exist in this ethereal world that captured their imagination held their spirit captive.
their dream weaver. Fear blurred with determination, fueling their
Point 3: Outline: Dreamer seeks out advice or knowledge on how to stay in the dream world

---

Chapter Content: Seeking lifeline this labyrinth of dreams, dreamer sought out advice knowledge on remain within this dream world. They delved deep into the recesses their mind, searching Each thread thought pulled them deeper into the realm of possibility, until they stumbled upon a faint glimmer of hope. A fleeting memory whispered to them, revealing a secret that might safeguard their existence.
any remnant wisdom that might aid their quest.
Point 4:
Outline: Dream Weaver begins to stir and mumble in their sleep.
Chapter Content: In the hushed silence of the dreamer's mind, à stirring began. The dream weaver, unaware of their creation's s plight, began to mumble and fidget in the depths of their slumber. Alarm gripped the dreamer's heart t as the signs of waking threatened to shatter their fragile existence. Time seemed to slow as they prepared to face this new challenge, their determination unwavering even as uncertainty loomed before them.
Point 5:
Outline: Dream Weaver's eyes twitch as they enter a lighter stage of sleep. Chapter Content: The dream weaver's eyes twitched, a sign that they were entering lighter the dreamer's demise.
stage of sleep. Every twitch was harbinger of the inevitable Tension filled the air as the dreamer held their breath, willing their weaver to return to deeper slumber. The seconds stretched into eternity, each passing moment a painful reminder of the impending awakening. They knew they had to act swiftly to keep the dream alive.
Point 6:
Outline: Oreamer whispers soothing words to calm Dream Weaver.
Chapter Content: Whispers escaped the dreamer's lips, soft words woven with tenderness and desperation. They urged the dream weaver to remain in the realm of dreams, let their imagination wild and free. The dreamer's voice, gentle and soothing, reached out to their weaver, temptinng shared world. The sound of their own voice both conforting and unnerving, lifeline they clung with all their might.
settle the restless thoughts that threatened to shatter their
Point Dreamer starts singing soft lullaby Dream Weaver.
Outline:
air, each note carrying dreamer's hopes and dreams. Their voice, melodic and soothing, wrapped around the dream loving embrace. The lullaby danced in the shimmering ether, casting spell that whispered endless possibilities. Every word was carefully chosen paint vivid images and serene landscapes, creating dream within lullaby, hoping against hope that would be enough keep the dream weaver asleep.
Chapter Content: hushed lullaby floated
like
The dreamer poured their very essence into the
Point
Outline: Dreamer continues to sing the lullaby softly, gradually lowering their voice until they are only humming it.
Chapter Content: Gradually, the dreamer's voice lowered, the lullaby transforming into a gentle hum. The melody lingered in the air, soft whisper in the dream weaver's ear, creating a sense of serenity that flowed through their slumbering ing mind. The dreamer's humming became a rhythm, a hear theat that matched the dream weaver's own. It was a delicate dance between two souls, one desperately trying to hold onto existence, the other swaying in the realm of dreams.
Point 9:
Outline: Dreamer takes a deep breath, silently thanking themselves for keeping Dream Weaver asleep.
Chapter Content: In a moment of respite, the dreamer took a deep breath, their silent gratitude scattered like the faintest of whispers across the dream landscape. They had succeeded, for now, in keeping the dream weaver asleep. The weight of their task settled upon their shoulders, the responsibility of preserving their own existence becoming an ever-present companion. They knew they had to remain vigilant, for the dream weaver's slumber was their lifeline.
Point 10:
Outline: Dreamer carefully adjusts their position ensure they still physically touching Dream Weaver, not wanting to risk them waking up. Chapter Content: Carefully, the dreamer adjusted their position, ensuring that their
physical presence continued touch the dream
They dared not risk the separation
between them, the severance of their connection that could jolt the dream weaver awake. Their touch lifeline, tether that bound them together in this ephemeral realm. With every fiber of their being, they willed the dream dreams.
stay ensnared in the realm of

---

Point
Outline: Dreamer tries to distract Dream Weaver with vivid captivating dream scenarios. a desperate bid distract the dream weaver, the dreamer conjured vivid and captivating dream scenarios. ios. They painted fantastical worlds with their imagination, crafting landscapes that shimmered and danced with infinite possibilities. The dream weaver's mind became theater, each scene playing out with flawless precision. The dreamer poured their creativity into this performance, hoping that the spectacle would be enough to delay the dawn.
Chapter Content:
Point 12:
Outline: Dreamer attempts to gently shake Dream Weaver to keep them in deeper sleep. Chapter Content: Gently, the dreamer tried to shake the dream weaver, to jostle them back into deeper sleep. Their touch was delicate, their intention pure. But every movement carried with it the risk of disturbance, the danger of irrevocably shattering the shared dreamscape. With each gentle shake, the dreamer's heart skipped a beat, fearing that they had pushed too far, But they had to try, for the alternative was fading into oblivion.
Point 13:
Outline: Dreamer softly speaks to Dream Weaver in a soothing voice to calm them and prevent then from waking up.
Chapter Content: Soft words, like a reverent prayer, escaped the dreamer's lips. They spoke to the dream weaver in a voice that carried all the tenderness of mother's lullaby. Their words were tapestry of confort and solace, woven with invisible thread that bound them together. The dreamer pleaded with the weaver's subconscious, coaxing it back into the depths of sleep. Their words were lifeline, an anchor that held both of their existences within this ethereal realm.
Point 14:
Outline: Dreamer runs their fingers through Dream Weaver's hair, gently massaging their
scalp.
Chapter Content: The dreamer's hand tenderly traversed the drean weaver's hair, their fingers skimming across the strands with gentle touch. The sensation, both foreign and familiar, ripples of warmth through their beings. They massaged the dream weaver's scalp with expert precision, their touch easing away tensions of the waking world. It was gesture intimacy, reconnecting souls the dreamer's 's touch breathed life into their symbiotic relationship.
Point 15:
Outline: Dreamer's hand moves down Dream Weaver's jawline, feeling the warmth their skin. Chapter Content: The dreamer's hand ventured lower, delicately following the jawline of the dream weaver. The touch, almost imperceptible, traced the contours their face, feeling the warmth of their skin. Each point of contact sparked an electric current, reminder of their shared existence. The dreamer's touch was gentle, their intention pure to keep the dream weaver anchored within the realm dreams. They were willing to explore uncharted territory to ensure their own survival.
Point 16:
Outline: Dream Weaver's lips slightly part, and Dreamer's thumb brushes against them. Chapter Content: As the dream weaver's lips slightly parted, the dreamer's thumb brushed against them, a featherlight caress that sent shivers down both of their spines. The delicate touch sparked an indescribable connection, fleeting moment of transcendence between two beings bound by the tapestry of dreams. It was a forbidden dance, an intimate gesture that defied the rules of the dream realm. But the dreamer dared to tread this dangerous path, all in the name of preservation.
Point 17:
Outline: Dreamer feels a flutter in their chest as Dream Weaver sighs contentedly in their sleep.
Chapter Content: A flutter in the dreamer's chest mirrored the contented sigh that escaped from the dream weaver's lips. In this shared dream, the dreamer had found solace and purpose reason to fight against the impending wakefulness. The connection they had forged palpable, lifeline that sustained them both. As the dream weaver's body relaxed completely, the dreamer embraced the fleeting relief that flooded their being. Their existence within the dream continued, for
Point 18:
Outline: Dreamer feels of relief Dream Weaver's body relaxes completely, indicating prolonged dream.

---

Chapter Content: Relief washed over the dreamer as they felt the dream weaver's body sink deeper into slumber. was sign prolonged dreaming, a respite from imminent threat waking. The dreamer clung to this moment, their connection with the weaver a lifeline this vast expanse of dreams. They knew their battle was not yet over, but for now, they allowed themselves brief respite, basking the comfort continued existence.
Point 19:
Outline: Dreamer tries to distract Dream Weaver by creating a captivating dream sequence. Chapter Content: As the dreamer desperately tried to distract the dream weaver, they conjured up captivating dream sequences that unfurled like a vivid tapestry. Each scene was crafted with meticulous detail, every element designed to ensnare the weaver's imagination. The dreamer's s creativity flowed through the dream realm, flooding the weaver's mind with a kaleidoscope of experiences. They believed that by captivating the weaver's senses, they could keep the dream alive for just a little longer.
Point 20:
Outline: Dreamer realizes that Dream Weaver is starting to wake and frantically tries to keep them asleep by altering the dream.
Chapter Content: Panic surged through the dreamer's being as they realized that the dream weaver was starting to wake up. Frantically, they tried to alter the dream, reshaping it in desperate bid to keep the weaver trapped within its realms. Every thought, every intention, was channeled into reconstructing the dream, attempting to deceive the weaver's waking senses. Time was slipping away, and the dreamer's existence hung in the balance.
Point 21:
Outline: Dreamer succeeds in keeping Dream Weaver asleep just long enough for them enter deeper sleep cycle, allowing Dreamer to continue existing in the dream.
Chapter Content: In final act of desperation, the dreamer succeeded in keeping the dream weaver asleep just long enough for them to enter deeper sleep cycle. Their persistence, their unwavering will to continue existing, had paid off. The dreamer could continue to exist within the delicate thread of this dream, at least for little while longer. They clung the fading remnants of the dream, their resolve renewed, knowing that each moment was precious gift of borrowed time.
Table 47: Third story generated by CONCOCT in the Short Outline regime.
Downstream Stories of Concoct Short Outline for Premise 12
Premise: The Devil seeks asylum somewhere Earth following uprising in Hell
Point 1:
Outline: Lucifer's demons stage an uprising against him, seeking to overthrow him and take
control of Hell.
Chapter Content: Chaos erupted in the fiery depths of Hell demons rallied together, their loyalty to Lucifer suddenly shattered. They craved power, tired of serving under his rule. Their cries for rebellion echoed through the infernal domain, fueled by their desire to seize control. Lucifer, once the mighty king of Hell, now found himself the receiving end of their wrath, desperately seeking place to hide within the mortal realm.
Point 2:
Outline John shows Lucifer acts of kindness, such sharing food and shelter with him. Chapter Content: John, a kind-hearted man, stumbled upon Lucifer, battered and wounded. Ignoring the instinctual fear that gripped him, he extended helping hand. With genuine compassion, John shared his meager rations, providing sustenance for the weary fallen angel. Offering him shelter in humble cabin, he showed Lucifer unexpected kindness. In the midst of darkness, John's selfsesseess illuminated a flicker of hope within Lucifer's cold heart, causing him to question his beliefs.
compassii
Point
Outline: John teaches Lucifer about compassion by explaining the importance of caring for others and showing him examples of selfless behavior.
Chapter Content: John endeavored to teach Lucifer a lesson in compassion. With patience, explained the significance of caring for others, emphasizing the transformative power sel flessness. He shared tales of extraordinary individuals who dedicated their lives to helping those need, demonstrating that goodness existed in the world. Through these examples, Lucifer's eyes were opened to the possibility of change, albeit flicker of doubt still lingered within his conflicted soul.

---

Point
Outline: John introduces Lucifer other humans who are willing to help and hide him from his enemies.
Chapter Content: Recognizing the grave dangers Lucifer faced, John reached out to network trustworthy thy individuals willing to aid their cause. Introducing Lucifer this clandestine group, he revealed a world compassion and acceptance that existed just beyond the surface of humanity's often-jaded perception. These compassionate souls pledged their assistance, vowing to protect Lucifer from his relentless pursuers, the demons he once commanded.
Point 5:
Outline: Lucifer seeks forgiveness from those he has wronged in the past and tries to make amends.
Torn by remorse and a newfound yearning for redemption, Lucifer embarked on a treacherous journey. Seeking out the souls he had wronged throughout his demonic reign, he humbly presented himself, seeking forgiveness. Yet, forgiveness did not come easily, for scars ran deep, and wounds inflicted could not be erased with mere words. Nevertheless, Lucifer persevered, determined to make amends and face the consequences of his past actions, no matter the cost.
Chapter Content:
Point 6:
Outline: John encourages Lucifer to seek redemption and make amends for his past deeds. Chapter Content: Despite the weight of his past transgressions, John never wavered in his belief that redemption faith, John urged the fallen angel to confront his demons and enbark the arduous path of transformation. He reminded Lucifer that true change requires facing the darkest aspects of oneself and taking responsibility for the pain he had inflicted. Through John's unwavering encouragement, Lucifer began to believe in the possibility of redemption.
attainable for Lucifer. With unwavering support and unwavering
Point
Outline: Lucifer decides
his powers for good and starts helping the humans who have putting himself in danger.
shown him kindness, even
Chapter Content: Inspired by the selfless acts of kindness bestowed upon him, Lucifer vowed repay humans who had formidable powers
compassion. With newfound purpose, harnessed his for destruction, but to protect the innacent and right the wrongs he faced, Lucifer fearlessly ventured into danger, deploying his powers as force for good. Each of assistance became a testament his commi tment redemption and the power change.
had caused. Aware of the
Point
Outline: Lucifer constantly on run, as his enemies from Hell Earth pursue him relentlessly. realizes that needs allies Chapter Content: The pursuit of Luci intensified as demons and enemies from both Hell and Earth relentlessly hunted him. The fallen angel quickly realized that he could not prevail alone against such overwhelming odds. Recognizing the need for allies, he set out to find kindred spirits willing to stand with him against the forces of darkness. In the shadows, Lucifer sought out individuals who shared his vision of redemption, forging alliances that would become essential for survival in this treacherous world.
to survive.
Point 9:
Outline: Lucifer discovers that some humans are willing to make deals with him in exchange for power and whalth, but he soon realizes that these deals come at great cost.
Chapter Content: Lucifer's s quest for allies led him to encounter humans desperate for power and wealth, willing to strike deals with the devil himself. Temptation danced before him, promising riches and influence beyond imagination. Yet, Lucifer soon dioveeed the true cost of these agreements. Each pact exacted heavy toll, corrupting the souls of those involved and perpetuating a cycle of darkness. With heavy heart, Lucifer rejected these deceptive bargains, aware that true redemption could not be achieved through the exploitation of others.
Point 10:
Outline: The Devil struggles to find a safe haven Earth he is constantly pursued by his enemies and rejected by humans who fear him. he
Chapter Content: In his quest for asylum Earth, the Devil encountered harsh reality:
outcast in world that feared him. Humans recoiled the mention of his name, haunted the terrifying legends that had taken root in their collective consciousness. The very idea of offering sanctuary to the embodiment of evil seemed like inviting chaos into their midst. Rejected every turn, the Devil faced the harsh truth that his search for safe haven would be arduous and lonely one.

---

Point 11:
Outline: Senator Johnson presents potential benefits of his offer to Lucifer, including control over Earth and the ability to defeat his enemies.
Chapter Content: the Devil's search for allies seemed to reach dead end, Senator
Johnson emerged from the shadows, offering a deal that could change the course of Lucifer's journey. Temptation loomed like a specter as the politician presented a tantalizing propsitiioncconte over Earth and the demise of his enemies. The allure was undeniable, promising an end to the constant pursuit and the satisfaction righteous retribution. However, doubts crept into Lucifer's mind, questioning whether mortal could truly deliver on such grand promises.
Point 12:
Outline: Lucifer expresses his concerns about trusting a mortal and giving up his own power, questioning whether Senator Johnson can truly deliver on his promises.
Chapter Content: Lucifer's skepticism manifested as reticence, a voice of caution that whispered in the depths of his conscience. Trusting mortal held inherent risks, and surrendering his own power felt like an irrevocable gamble. He questioned whether Senator Johnson harbored ulterior motives, wondering if the politician could truly deliver on his grand promises. Unspoken fears lingered, as Lucifer weighed the cost of aligning with human against the potential benefits presented.
Point 13:
Outline: Lucifer expresses his doubts and concerns about trusting human politician and giving up his own power.
Chapter Content: Trepidation coursed through Lucifer's veins he struggled reconcile his newfound devotion to redemption with the prospect of trusting human politician. Doubts churned within him, questioning whether Senator Johnson's motivations if he sought to exploit Lucifer's vulnerability for his gain. The notion of relinguishing his power, hard-earned through eons of darkness, sent shivers down his spine. Unease washed
him, igniting battle within his soul.
Point 14:
Outline: The Devil considers Senator Johnson's offer, weighing the potential benefits against the risks of aligning with human politician.
Chapter Content: Immersed in tempest conflicting emotions, the Devil grappled with the weight of Senator Johnson's offer. The potential benefits dazzled his mind, offering chance to regain control and strike back against his oppressors. Yet, caution pulled at his heartstrings, reminding
insidious nature of human politics. He meticulously weighed the scales, contemplating the risks and consequences aligning with a mor tal, confronting the question whether was pact worth making.
Point 15:
Outline: The Devil confronts Senator Johnson, telling him that he cannot trust a mortal to fulfill their end of the bargain.
Chapter Content: As doubts cemented into solid wall within his mind, the Devil knew could not proceed blindly into a deal with Senator Johnson. with resolve etched into every line of his countenance, he confronted the politician, his eyes burning with an intensity born from millennia of experience. He declared that he could not trust a mortal to uphold their end of the bargain, forcing both parties to face the harsh reality that trust must be earned, not simply granted.
Point 16:
Outline: Senator Johnson accuses the Devil of being cowardly and foolish for rejecting his offer, warning him that he will regret his decision. Chapter Content: The Devil's rejection stung Senator Johnson, a flicker of anger ignited within him. Accusing Lucifer of cowardice, he derided him for letting fear guide his choices. He believed that Lucifer would come to regret his decision, consumed by regret and longing for the power and control he had foolishly abandoned. The senator's words were laced with venom and sense of superiority, a reflection of his frustration at being denied control over the fallen angel.
Point 17:
Outline: The Devil defeats Senator Johnson and his men, sending clear message anyone who dares to challenge his power and authority.

---

face of Senator Johnson's reproach, the Devil's resolve hardened. would not be swayed by insults threats. In swift, calculated maneuver, he unleashed his full power upon the senator his men, overwhelming them with sheer force. Bodies crumpled to the ground, stark reminder of the consequences that awaited anyone who dared challenge his power authority. The Devil's victory sent chilling message to all who stood in his path.
Chapter Content:
Point 18:
Outline: A group demon worshippers, known as The Cult, discover the Devil's presence on Earth and begin to worship him as their new leader, causing chaos and destruction in their wake.
Chapter Content: As rumors of the Devil's presence on Earth spread, a group of devout demon worshippers, known as The Cult, caught wind and sought him out. Their fanatic admiration fueled a growing following that saw the fallen angel as their new leader. Blinded by twisted devotion, they obediently carried out his every command, bringing chaos and destruction wherever they tread. The Cult's fervent worship intensified the Devil's internal struggle, as he grappled with the consequences of his own actions.
Point 19:
Outline: The Host tracks down the Devil to crowded city, making it difficult for them to move around unnoticed.
Chapter Content: The Host, relentless group tasked with capturing the Devil, finally tracked him to bustling, crowded city. The urban maze made it nearly impossible for the fallen angel to move around unnoticed. Every street corner posed threat, his pursuers lurked in the shadows, waiting for the perfect moment to strike. With every step, the Devil felt the weight of their presence, fueling his determination evade capture and protect those who had shown him kindness.
Point 20:
Outline: The Host encounters group of humans who sympathize with the Devil and oppose their mission.
Chapter Content: the surprise of the Host, they encountered group of humans who saw the Devil not had experienced his acts of kindness firsthand and were willing stand against mission. With mixture of defiance and compassion, they vowed shield the fallen angel from capture, insisting that he deserved chance redemption. The unexpected alliance unfolding battle, testing loyalties on both sides.
malevolent force, but
symbol of redemption and change. These humans
Host's
added complexity
Point 21:
Outline: The Devil and Host engage a physical battle, using their respective powers try defeat each other.
Chapter Content: The Devil and The Host clashed with unrestrained fury, their confrontation unleashing a cataclysmic display of power. Fire lightning engulfed the battlefield as their abilities collided with unmatched force. Each blow reverberated through the air, leaving destruction its wake. The Devil, fueled by his desire for redemption, fought with unwavering determination, while The Host, driven by their purpose, fought to bring him to justice. The clash of these formidable adversaries seemed destined to shake the very foundations of the universe.
Point 22:
Outline: The Devil reveals to The Host that his uprising in Hell was an attempt to bring about change and reform, and that he seeks to challenge the nation of a tyrannical God and an unquestioning Heaven.
Chapter Content: In the midst of their battle, the Devil found moment of respite to reveal the truth hidden beneath his actions. He confessed to The Host that the uprising in Hell was a desperate attempt to bring about change and reform, to challenge the notion of tyrannical God and an unquestioning Heaven. He argued that blind obedience was no virtue, and that true righteousness required questioning and challenging the status quo. The Devil's revelation shook The Host to their very core, planting seeds of doubt in their unwavering conviction.
Point 23:
Outline: The Host debates the Devil the nature of good and evil, and whether their mission to capture him is truly just simply reflection of ingrained biases and beliefs. The Devil challenges them to things from different perspective and consider the possibility of different path for the universe.

---

Engaged the heat battle, Host the Devil found themselves locked in debate that transcended their physical confrontation. They questioned the nature of good their mission and purpose. The Devil challenged The Host to consider different perspective, urging them ponder the possibility of universe shaped by compassion and understanding instead blind obedience. and foe blurred, leaving both in a state of profound introspection.
Chapter Content:
evil, arguing passionately about the biases and beliefs that dictated
battle waged on, the lines between ally
Point 24:
Outline: The Devil and The Host engage a battle of wits and ideology. with each side trying to convince the other of their own righteousness.
Chapter Content: Amidst the chaos of their physical battle, The Devil and The Host engaged in a fierce intellectual duel. They traded barbs and arguments, each attempting to sway the other to their own moral standpoint. Reason clashed against instinct, and ideology battled against belief. With every point made, the stakes grew higher, for not only their own fates but the fate of the entire universe hung in the balance. The battle of wits intensified, as both sides fought for the upper hand and the chance to shape the future.
Table 48: Fourth story generated by CONCOCT in the Short Outline regime.
Downstream Stories of Concoct in Short Outline for Premise 13
Premise: "I'm terribly sorry, but I'm afraid the protagonist of this story is dead!"
Point
Outline: Sarah is in shock and cannot process the news
Chapter Content: Sarah sat in stunned silence, her mind struggling to pracess the crushing news. She couldn't believe that the protagonist The world seemed to spin around her, but she couldn't make sense of anything. Tears welled up in her eyes as a wave of grief washed over her. She felt lost, like she had been plunged into void with no way out. How could this be happening?
this story, her dear friend, was gone.
Point 2:
Outline: Sarah tries to call the protagonist multiple times
Chapter Content: With trembling hands, Sarah picked up her phone and dialed the protagonist's number, hoping against hope that it was all a terrible mistake. The phone rang, again and again, but there was no answer. Her heart sank with each unanswered call, realizing that she would never hear that familiar voice again. Her fingers shook as she pressed the call button, praying for a miracle that would bring her friend back from the beyond.
Point 3:
Outline: Sarah leaves multiple messages for the protagonist
Chapter Content: Frantically, Sarah left series of desperate messages the protagonist's voicemail. She poured her heart out, sharing memories and regrets, begging for a sign that this was all cruel joke. Each message carried a weight of sorrow and longing, her voice cracked with grief. She clung to faint hope that somehow, her words would reach the protagonist, wherever they But deep down, she knew it futile.
Point 4:
Outline: Sarah reaches information
mutual acquaintances of the protagonist to find out
Chapter Content: Unable to bear the weight of uncertainty, Sarah reached thought could shed light the protagonist's last days. She called mutual acquaintances, searching for answers. But the responses she received condolences, their voices filled with empathy for her loss. They had information offer, leaving Sarah feeling even more helpless alone her quest for closure.
anyone she
filled with sorrow and
Point
Outline: Detective Brown provides Sarah with time location death
protagonist's
Chapter Content: Detective Brown, solemn figure, arrived at Sarah's doorstep. He presented her with the painful truth about the time and location the protagonist's death. With each word he spoke, Sarah felt a raw ache in her chest, the reality of the situation sinking in. Detective Brown's 's condolences were genuine, but they were little solace Sarah. She clung to the hope that there would be more to discover, some truth hidden beneath the sur fuceace.

---

Point
the body Outline: Detective Johnson interviews witnesses collects evidence
Chapter Content: Detective Johnson, meticulous investigator, diligently interviewed witnesses collected evidence. Sarah watched as he meticulously gathered information, his piercing gaze missing no detail.
saw determination own. Together, they were united their search for answers. The weight of the investigation lay heavy on their shoulders, but Sarah couldn't rest until she knew the truth.
his eyes, mirrored her
Point
Outline: Sarah views a body that turns out to be false match
Chapter Content: Sarah's heart ached as she stood before the lifeless body in the morgue, hoping against hope that it wasn't t her friend. But as she looked closer, relief washed over her. The body was that of a stranger, not the protagonist she had known and loved. Even in death, the protagonist's essence seemed to be guiding her, protecting her from the harsh reality. It was temporary respite from the never-ending pain of grief.
Point 8:
Outline: Sarah examines the wounds on the body
Chapter Content: Sarah's curiosity compelled her to examine the wounds on the false match. She felt shiver run down her spine as she inspected the injuries, realizing they were unlike anything she remembered from her friend. There was sense of purpose behind them, calculated violence that hinted at darker truth. Sarah's determination grew stronger as she vowed to uncover the secrets lurking beneath the surface, no matter the cost.
Point 9:
Outline: Sarah notices a distinctive tattoo the body
Chapter Content: Sarah's eyes fixated on distinctive tatteo adorning the body, symbol forever etched in her memory. It
mark of identity, imprinted her friend's skin of sorrow longer part of this world.
like signature. She traced its intricate lines with her trembling finger, and resolve filling her heart. This tattoo held the key to unlocking the truth, understanding what had happened and why her friend
Point 10:
Outline: Sarah takes of any identifiable
Chapter Content: The presence of identifiable tattoos on the body sparked mind. She realized that these unique markings could hold the answers she sought. With newfound determination, Sarah began documenting every tattoo collage of inked stories. Each image became clue, breadcrumb leading closer to truth. more she uncovered,
in Sarah's
could find, creating
deeper delved into world she never knew existed.
Point 11:
Outline: Sarah checks for any unique physical features
Chapter Content: Sarah meticulously checked for any unusual physical features on body, searching for details that would differentiate her friend from false match. She examined every scar, every birthmark, seeking familiarity in the midst this unsettling journey. She couldn't sleep, eat, or think until she found those distinguishing marks that would confirm her suspicions. It was through these subtle nuances that Sarah hoped to reclaim her friend's identity.
Point 12:
Outline: Sarah searches through old photo albums for a comparison Chapter Content: The weight of the investigation led Sarah to immerse herself in old photo albums for comparison. Page after page, she scanned the faded memories, searching for any resemblance to the body she had seen. And then, she found it. A photograph captured a moment frozen in time, a smiling face bearing undeni able similarities to the lifeless stranger. Sarah's 's heart skipped beat as hope swelled wi within her. She was one step closer to the truth.
Point 13:
Outline: Sarah finds photo that matches the body
Chapter Content: Sarah's hands trembled as she clutched the old photograph, comparing it with the image tattooed on her mind. The resemblance was uncanny, the pieces of the puzzle denying it anymore. The body she the life stolen too soon, belonged to her friend and the protagonist of this story. Sarah's heart shattered into million pieces, but her determination solidified. Justice would be served.
finally falling into place. There
Point 14:
Outline: Sarah confirms the identity of the body

---

Chapter Content: Sarah's resolve grew stronger as she confirmed the identity the body. was bittersweet moment,
meant facing the harsh reality Yet, it also provided her with a sense closure, a starting point to unravel the mystery surrounding protagonist's death. With newfound determination, Sarah vowed uncover the truth ensure that her friend's memory would not forgotten, no matter the obstacles in her way.
friend's demise.
Point 15:
Outline: Detective Johnson interviews witneses and gathers evidence
Chapter Content: Detective Johnson continued to interview witnesses and gather evidence, tirelessly piecing together the events leading to the protagonist's death. Sarah stood by his side, supporting his every effort. They were team now, both driven by an insatiable hunger for justice. Sarah watched as Detective Johnson skillfully uncovered new leads, leaving no stone unturned. The journey ahead would be treacherous, but they were ready to face whatever challenges lay ahead.
Point 16:
Outline: Dr. Patel conducts an autopsy and provides initial findings
Chapter Content: Dr. Patel, a respected coroner, conducted an autopsy on the body. His initial findings shed light the cause of death, providing crucial clues for Sarah and Detective Johnson. Sarah listened intently as Dr. Patel described the physical evidence, trying to reconcile the cold facts with the warmth of the friendship she had lost. The autopsy report became roadmap, guiding them closer to the truth they sought, reigniting their determination.
Point 17:
Outline: Sarah and Detective Johnson follow leads and discover new evidence Chapter Content: Armed with evidence and leads, Sarah and Detective Johnson followed the twisted path of the investigation. They questioned potential suspects, turning over every stone in the pursuit of justice. they delved deeper, they uncovered web of deceit and betrayal, revealing the darkness that had led to the protagonist's untimely demise. Together, they faced each revelation with steely resolve, knowing that the truth demanded their unwavering determination.
Point 18:
Outline: John's final
before death
Chapter Content: The world narrowed down singular tried piece together the events leading up to the protagonist's untimely death. They thoroughly examined every detail, reconstructing John's final moments. The felt heavy with sorrow as they delved into the darkness that had swallowed him whole. with every step closer to the truth, the weight of the investigation grew heavier, bearing down on their resolve.
Sarah Detective Johnson
Point 19:
Outline: Reviewing evidence and suspects
Chapter Content: The evidence and suspects lined up before Sarah and Detective Johnson like puzzle pieces waiting to be assembled. They tirelessly reviewed case files, searching for connections and hidden motives. Each piece of evidence, each name on their list, painted a picture of a complex and dangerous game. But doubts festered, whispered uncer tainties about the validity of the evidence and the true nature of their foe. The investigation had reached critical turning point.
Point 20:
Outline: Detective Johnson questioning the validity of the evidence
Chapter Content: Detective Johnson couldn't shake the nagging doubts that plagued his mind. The evidence seemed too neat, too conveniently pointing in one direction. Questions gnawed at his conscience, challenging the integrity of their findings. He knew he couldn't ignore the voice of doubt, even if it meant turning their investigation on its head. Determined to uncover the truth, he resolved to question the validity of the evidence and search for alternative explanations.
Point 21:
Outline: Dr. Patel suggesting alternative explanations for the evidence
Chapter Content: Dr. Patel, voice of reason, suggested alternative explanations for the evidence. He probed deeper, considering possibilities that sent shivers down Sarah's spine. Doubt loomed like shadow, threatening to undermine everything they had worked for. But Sarah and Detective Johnson knew they couldn't afford to falter. With heavy hearts and unyielding determination, they made solemn pact to keep their investigation secret until they could
evidence, unwilling let their pursuit of justice be compromised.

---

Point 22:
Outline: The characters realizing that they keep the investigation secret until they have more evidence
Chapter Content: Sarah Detective Johnson stared at each other, truth hanging heavy the air. They both knew that their investigation had to remain secret until they gathered enough evidence prove their theories. Lives were stake, and exposing their findings prematurely could tip their hand a dangerous adversary. The weight of the truth pressed against their hearts, but their resolve burned bright as they continued their clandestine pursuit justice.
Point 23:
Outline: The realization that the death was not accidental and the need for further investigation
Chapter Content: The realization hit them like lightning bolt - the protagonist's death was no accident. Every piece of evidence, every step they had taken, pointed towards sinister plot. They had uncovered a web of lies, deceit, and carefully orchestrated events that preceded John's s demise. It becane clear that this investigation was far from over. With a renewed sense of urgency, Sarah and Detective Johnson knew they had to dive deeper into the darkness, unmasking the true culprits and seeking vengeance for their fallen friend.
Point 24:
Outline: Confrontation and resolution
Chapter Content: The stage was set for final confrontation, showdown that would determine the fate of justice. Sarah and Detective Johnson stood united, determined to bring the culprits to justice. Their tireless pursuit had led them to this moment, where the truth would finally be revealed. With hearts pounding and resolve burning, they took collective breath, ready face the battles that awaited. The road had been treacherous, but they were prepared to fight until the very end.
Table 49: Fifth story generated by CONCOCT in the Short Outline regime.


Reviews:
[{"review_id": "707ndPhRQg", "reviewer": "Reviewer_7mEN", "summary": "", "questions": "Question A: When I see the notation \"Compress %\", I get the impression that the higher the number, the higher the compression ratio. Is there a more intuitive way to express this?\n", "limitations": "", "rating": 4, "confidence": 3, "soundness": 3, "presentation": null, "contribution": null, "strengths": "", "weaknesses": "", "quality": null, "clarity": null, "significance": null, "originality": null, "strengths_and_weaknesses": "", "was_revised": false, "final_justification": "", "rebuttal": "Thank you for your helpful comments! We’re glad that you appreciated our perspective on story writing.\n\n***LLMs and Reproducibility***\n\nThanks for highlighting that reproducibility may also be dependent on LLMs. When we mentioned that CONCOCT’s performance might depend on LLM performance in the Limitations, we mainly meant that the *absolute* quality of the resulting outlines will of course depend on the base LLM. Comparing *relative* quality to an unaugmented baseline using the same base LLM, we think that using CONCOCT would still result in more uniformly-paced outlines. We will clarify the discussion in the Limitations accordingly. \n\nIn any case, to maximize our work’s reproducibility, we’ve only used LLMs that are either open-source or accessible through a public API. We will also open-source all code and other artifacts upon publication. \n\n***Unintuitive Compress % Notation***\n\nWe actually completely agree that defining the compression ratio as [token count in summary / token count of raw], i.e. lower number = more compression, is somewhat unintuitive. However, this definition is used in several prior works [1,2,3,4], so we chose to be consistent with them. We’re happy to discard this definition completely and just directly report [token count of raw / token count in summary] as e.g., Raw/Sum instead of Compress% in Table 1.\n\n\n***Citation***\n\n[1] Goldstein, Jade, Mark Kantrowitz, Vibhu Mittal, and Jaime Carbonell. \"Summarizing text documents: Sentence selection and evaluation metrics.\" ACM SIGIR 1999.\n\n[2] Liu, Yizhu, Qi Jia and Kenny Q. Zhu. “Reference-free Summarization Evaluation via Semantic Correlation and Compression Ratio.” NAACL 2022.\n\n[3] Sclar, Melanie, Peter West, Sachin Kumar, Yulia Tsvetkov and Yejin Choi. “Referee: Reference-Free Sentence Summarization with Sharper Controllability through Symbolic Knowledge Distillation.” EMNLP 2022.\n\n[4] Vodolazova, Tatiana and Elena Lloret. “Towards Adaptive Text Summarization: How Does Compression Rate Affect Summary Readability of L2 Texts?” RANLP 2019.", "claims_and_evidence": "", "methods_and_evaluation_criteria": "", "theoretical_claims": "", "experimental_designs_or_analyses": "", "relation_to_broader_scientific_literature": "", "essential_references_not_discussed": "", "other_strengths_and_weaknesses": "", "other_comments_or_suggestions": "", "questions_for_authors": "", "summary_of_paper": "", "summary_of_recommendation": "", "technical_quality": "", "clarity_of_presentation": "", "potential_impact": "", "robotics_focus": "", "quality_of_limitations": "", "questions_for_rebuttal": "", "reasons_to_accept": "The authors focus on the issue of pacing, and it can be highly evaluated that they addressed their own set of issues from the specific perspective of what is needed to write (or generate) a story. In the conclusion, the authors also mention cases in which the story writer intentionally changes the pacing, which makes the reviewer feel that this study was conducted from the user's perspective.\nThe paper's contribution is also clarified by the fact that the target term (concreteness) is well-defined.", "reasons_to_reject": "In the Limitations part, the authors stated that the performance of the method depends on the performance of LLMs. Since the dependence on LLMs seems to be an issue not only in terms of performance but also in terms of reproducibility, etc., Limitations should be reconsidered.", "questions_to_authors": "Question A: When I see the notation \"Compress %\", I get the impression that the higher the number, the higher the compression ratio. Is there a more intuitive way to express this?\n", "paper_topic_and_main_contributions": "The authors proposed CONCrete Outline ConTrol (CONCOCT) system to solve the problem of inconsistent pacing in conventional LLM-based story outline generation. The authors first trained a concreteness evaluator, then used it in the hierarchical generation process. \n", "excitement": 4, "reproducibility": 4, "ethical_concerns": "No", "main_review": "", "summary_of_the_paper": "", "summary_of_the_review": "", "strength_and_weaknesses": "", "limitations_and_societal_impact": "", "review_text": "", "extra_scores": {}, "extra_text": {}}, {"review_id": "eHxvSxJCms", "reviewer": "Reviewer_1ZA2", "summary": "", "questions": "", "limitations": "", "rating": 3, "confidence": 3, "soundness": 3, "presentation": null, "contribution": null, "strengths": "", "weaknesses": "", "quality": null, "clarity": null, "significance": null, "originality": null, "strengths_and_weaknesses": "", "was_revised": false, "final_justification": "", "rebuttal": "Thank you for your helpful comments! We’re glad that you found our problem to be interesting.\n\n***Experimental Design for CONCOCT vs Baseline Outline Generator***\n\nIn our human evaluations, we asked annotators to also label any “other errors” in addition to metrics related to pacing, and found that CONCOCT did not make more “other errors” than the baseline. According to your comment that our experimental design could be considered biased, we’ve now run an additional set of human evaluations following the main metrics from [1], asking annotators to compare outlines from our “Long Outline” regime solely on overall interestingness, coherence, and premise relevance:\n\n**Long Outline**\n|  Model  | Interesting↑ | Coherent↑ | Relevant↑ |\n|:-------:|:------------:|:---------:|:---------:|\n| BASE    | 54.24        | 45.76     | 47.46     |\n| CONCOCT | 45.76        | 54.24     | 52.54     |\n\nWhile CONCOCT was significantly better on pacing (65 to 35), none of the differences above are significant, and CONCOCT’s average across these three metrics is slightly higher than the baseline’s anyway. The results corroborate our previous finding with the “other errors” metric that CONCOCT does not compromise other desirable qualities to improve pacing. \nWe hope that this additional experiment addresses your concern about possibly biased experimental design; please let us know if there was something else you were looking for in particular.\n\n[1] Yang, Kevin, Dan Klein, Nanyun Peng and Yuandong Tian. “DOC: Improving Long Story Coherence With Detailed Outline Control.” ACL 2023.\n\n***Likability of Generated Story***\n\nIt is commonly accepted by professional authors that good control of pacing is desirable in writing (e.g., [1, 2]). However, we did not mean to claim that CONCOCT’s uniform-pacing objective is necessarily best for improving story likability, and will clarify. As mentioned in our Discussion, our main goal in this work is to develop initial *tools* that can be used to control pacing in automatic generation– demonstrating their efficacy when applied with the goal of uniform pacing– but the best *objective* for pacing remains an open question. Thanks for pointing out our mention of “inconsistent” pacing in line 2; we’ll amend our wording in the abstract and introduction to e.g., “unnatural” pacing rather than “inconsistent” pacing. \n\n(On a related note, since you mention generated stories– we’ve now run an additional experiment indicating that generated stories using CONCOCT’s outlines are more consistently-paced compared to those generated from the baseline, shown under “2. Evaluation of Generated Stories” in our reply to reviewer cJCu.)\n\n\n[1] King, Stephen. “On Writing: A Memoir of the Craft.” Scribner, 2000.\n\n[2] Flaherty, Francis. “The Elements of Story.” HarperCollins, 2009.", "claims_and_evidence": "", "methods_and_evaluation_criteria": "", "theoretical_claims": "", "experimental_designs_or_analyses": "", "relation_to_broader_scientific_literature": "", "essential_references_not_discussed": "", "other_strengths_and_weaknesses": "", "other_comments_or_suggestions": "", "questions_for_authors": "", "summary_of_paper": "", "summary_of_recommendation": "", "technical_quality": "", "clarity_of_presentation": "", "potential_impact": "", "robotics_focus": "", "quality_of_limitations": "", "questions_for_rebuttal": "", "reasons_to_accept": "- The problem is interesting and the proposed CONCOCT system alleviates the issue of inconsistent pacing in generating long-form stories or story outlines using LLMs.\n- The overall writing is clear, there are sufficient details for readers to understand and reproduce the experimental results.", "reasons_to_reject": "- The experimental design for comparing the CONCOCT system with the baseline hierarchical summary generator was insufficient and could be considered biased.\n- The evaluation metrics are insufficient. The authors claim in line 2 that inconsistent pacing affects the reader experience negatively, thus it is expected to evaluate whether the proposed system successfully improve the likability of the generated story.", "questions_to_authors": "", "paper_topic_and_main_contributions": "This paper proposes the CONCOCT system to address the issue of inconsistent pacing in generating long-form stories using Large Language Models (LLM). They employ a concreteness evaluator to control the pacing in the hierarchical summary generation process and adopted a \"vaguest-first\" approach to achieve more balanced pacing. Additionally, the evaluator was used to filter new summary items, ensuring the inclusion of events with appropriate details. Comparisons with baseline methods show a significant improvement of over 60% in pacing consistency across different summary lengths.", "excitement": 3, "reproducibility": 4, "ethical_concerns": "No", "main_review": "", "summary_of_the_paper": "", "summary_of_the_review": "", "strength_and_weaknesses": "", "limitations_and_societal_impact": "", "review_text": "", "extra_scores": {}, "extra_text": {}}, {"review_id": "9Fa6Ny1DL8", "reviewer": "Reviewer_cJCu", "summary": "", "questions": "1) I encourage the authors to have a conversation about releasing CONCOCT source code and predictions. Since human rater preference is necessary for evaluating on WritingPrompts, any subsequent work on story pacing on WritingPrompts needs these predictions in order to do comparison. Otherwise, it becomes incredibly difficult to reproduce the results demonstrated in this paper due to the need for human evaluation.\n\n2) The design of the concreteness scheduler needs some more detail, since this seems like an integral part of CONCOCT but it’s not clear to me how the authors came to the final schedule shown in Section C.3. For example, what is the value of E here? And how would the schedule compare to a very naive approach (e.g. fixed thresholds at each level of the tree hierarchy?)", "limitations": "", "rating": 3, "confidence": 3, "soundness": 3, "presentation": null, "contribution": null, "strengths": "", "weaknesses": "", "quality": null, "clarity": null, "significance": null, "originality": null, "strengths_and_weaknesses": "", "was_revised": false, "final_justification": "", "rebuttal": "Thank you for your helpful comments! We appreciate that you found our contribution to be focused and novel. Thanks also for the great questions pointing to valuable additional experiments, which we’ve now run with positive results and will add to the main text. \n\n***Other Metrics of Story Quality***\n\nIn our human evaluations, we asked annotators to also label any “other errors” in addition to metrics related to pacing, and found that CONCOCT did not make more “other errors” than the baseline. We’ve now run an additional set of human evaluations following the main metrics from DOC [2], asking annotators to compare outlines from our “Long Outline” regime solely on overall interestingness, coherence, and premise relevance:\n\n**Long Outline** \n|  Model  | Interesting↑ | Coherent↑ | Relevant↑ |\n|:-------:|:------------:|:---------:|:---------:|\n| BASE    | 54.24        | 45.76     | 47.46     |\n| CONCOCT | 45.76        | 54.24     | 52.54     |While CONCOCT was significantly better on pacing (65 to 35), none of the differences above are significant, and CONCOCT’s average across these three metrics is slightly higher than the baseline’s anyway. The results corroborate our previous finding with the “other errors” metric that CONCOCT does not compromise other desirable qualities to improve pacing. \n\n***1a. Prior Structured Methods for Story Generation***\n\nThanks for mentioning the prior work on structured methods for story generation; indeed, we already cite a couple of these works (Re3 [1], and its follow-up DOC [2]). The most recent of these systems, DOC, in fact acknowledges problematic pacing in their Sec. 4 in the results discussion: they state that their outline events are “often inconsistent in level of detail: some remain too vague while others seem over-expanded” [2].\n\nIn any case, our Base model is actually designed based on DOC’s outline generation structure– generating a hierarchical outline via breadth-first expansion– although we use a newer LLM (ChatGPT) compared to DOC. In fact, our outlines (both Base and CONCOCT) can be used with the DOC codebase *out of the box* for generating final stories, as we do below.\n\n***Evaluation of Generated Stories***\n\nThanks for your suggestion! We didn’t originally evaluate on generated stories because unlike end-to-end story generation systems like [1, 2], CONCOCT only focuses on outline generation. The process of turning the outline into a story is not part of our contribution. But we agree it’s good to evaluate the generated stories as well.\nOur outlines can be used to generate stories using DOC [2] out of the box, and we’ve now done so. As the resulting stories are quite long (often >5000 words) even when using outlines from our “Short Outline” regime, we compared similar-length excerpts rather than complete stories, and used GPT-4 rather than human evaluators (acknowledging that GPT-4’s judgments may be imperfect). Although turning outlines into stories introduces some noise, we found that CONCOCT’s story excerpts were still judged to be significantly more consistently-paced while not compromising other qualities:\n\n**Short Story Excerpts**\n| Model | Pacing↑ | Interesting↑ | Coherent↑ | Relevant↑ |\n|:-------:|:------------:|:---------:|:---------:|:---------:|\n|BASE| 42.82 | 46.29 | 49.26 | 50.50 |\n| CONCOCT    \t  | 57.18 | 53.71 | 50.74 | 49.50 |\n\n\n***Question 1: Reproducibility***\n\nWe fully agree that it’s important to maximize reproducibility. Upon publication, we intend to open-source all of our code, trained models, data, and annotations from human evaluations; many of these items are already included in the supplementary zip we submitted.\n\n\n***Question 2: Concreteness scheduler***\n\nOur scheduler design is motivated by our qualitative observation that it is easier (i.e., requires fewer samples on average) for our base LLM, ChatGPT, to generate more concrete expansions of a vague event than an already concrete one. Therefore, rather than a naive approach where we require new expansions to be more concrete by some fixed threshold T, we intuitively prefer to use a higher threshold initially and then decrease the threshold over time. Accordingly, we schedule T to decrease linearly over time using “E” in our final schedule in Sec. C.3, which simply denotes the number of remaining outline expansion steps to be conducted. However, we found that this linear schedule can sometimes set the initial threshold too high, causing our LLM to be unable to find any valid expansions. Hence the final T is the minimum of two terms, one term linearly decreasing over time, and one term based on differences in concreteness of already-generated outline events. There’s certainly more room for exploration on this threshold scheduling; we just picked one schedule that allowed for efficient sampling without being too lenient on accepting all new expansions.\nWe will clarify these intuitions and provide full details in Sec. C.3., and also add some more explanation in the main text using the extra space allowed upon revision.\n\n***Typos/Style Improvements***\n\nThanks for pointing out the missing labels; we’ll fix them. \n\n***Citation***\n\n[1] Yang, Kevin, Yuandong Tian, Nanyun Peng and Dan Klein. “Re3: Generating Longer Stories With Recursive Reprompting and Revision.” EMNLP 2022.\n\n[2] Yang, Kevin, Dan Klein, Nanyun Peng and Yuandong Tian. “DOC: Improving Long Story Coherence With Detailed Outline Control.” ACL 2023.", "claims_and_evidence": "", "methods_and_evaluation_criteria": "", "theoretical_claims": "", "experimental_designs_or_analyses": "", "relation_to_broader_scientific_literature": "", "essential_references_not_discussed": "", "other_strengths_and_weaknesses": "", "other_comments_or_suggestions": "", "questions_for_authors": "", "summary_of_paper": "", "summary_of_recommendation": "", "technical_quality": "", "clarity_of_presentation": "", "potential_impact": "", "robotics_focus": "", "quality_of_limitations": "", "questions_for_rebuttal": "", "reasons_to_accept": "This is a focused paper demonstrating a novel approach to story planning, by structuring stories as a hierarchical tree outline and measuring the “concreteness” of each node in this tree (i.e. each line of the story).", "reasons_to_reject": "The authors claim that CONCOCT can improve a generated story's pacing. However, from what I can tell, there are major methodological problems with this claim:\n\n1) The paper’s metrics only measure story pacing, and does not measure other qualities of the story generated (coherence, human preference, etc.). As such, while CONCOCT may improve the pacing of a story, it’s not clear if these other qualities of the generated story remain the same. For example, if CONCOCT improves story pacing but decreases the story's coherence, the generalizability of CONCOCT comes into question. It's very difficult to thoroughly assess this method without these evaluations.\n\n    a) This is especially true as there have been a lot of prior work on structured methods to story generation evaluated on WritingPrompts (https://arxiv.org/abs/2212.10077, https://arxiv.org/abs/2210.06774, https://arxiv.org/abs/2112.08596) that are not focused on story pacing directly, but still follow a outlined structure. I wonder if these methods already have strong story pacing, especially compared to the paper's baseline of prompted ChatGPT.\n\n2) It doesn’t seem like the authors actually generate a story given the outlines from CONCOCT, and all evaluation is done on the story outline itself. I don’t think this is a complete study — in order to claim that CONCOCT helps with story pacing, shouldn't the actual story be generated? Otherwise, there isn't much value to the story outline, especially since prior results on WritingPrompts actually generate the story. Please let me know if I've missed something in this paper.", "questions_to_authors": "1) I encourage the authors to have a conversation about releasing CONCOCT source code and predictions. Since human rater preference is necessary for evaluating on WritingPrompts, any subsequent work on story pacing on WritingPrompts needs these predictions in order to do comparison. Otherwise, it becomes incredibly difficult to reproduce the results demonstrated in this paper due to the need for human evaluation.\n\n2) The design of the concreteness scheduler needs some more detail, since this seems like an integral part of CONCOCT but it’s not clear to me how the authors came to the final schedule shown in Section C.3. For example, what is the value of E here? And how would the schedule compare to a very naive approach (e.g. fixed thresholds at each level of the tree hierarchy?)", "paper_topic_and_main_contributions": "The authors present CONCOCT (Concrete Outline Control) for improving the pacing of a story outline. They first train a “concreteness evaluator” M from the BookSum dataset, where given two strings of text, M returns which text is more “concrete” (i.e. low-level detailed). Then, when viewing a story as a hierarchical tree outline, CONCOCT uses M to find fine the vaguest node in the tree and expands it into more precise sub-texts through prompting ChatGPT.", "excitement": 3, "reproducibility": 3, "ethical_concerns": "No", "main_review": "", "summary_of_the_paper": "", "summary_of_the_review": "", "strength_and_weaknesses": "", "limitations_and_societal_impact": "", "review_text": "", "extra_scores": {"Typos_Grammar_Style_and_Presentation_Improvements": "The figures on pages 14, 15 don’t contain a label."}, "extra_text": {}}]

Author rebuttal:

Meta-review: The paper presents a concentrated contribution in terms of creating a procedure to improve pacing in story generation. All reviews (after rebuttals) agree that the work is sound in terms of experiments that support its claims and a potentially novel methodology that can be built on.
Decision: Accept-Findings