SlowGuess/NAACL_2022_OCR huggingface dataset:
Input Story: Once upon a time there was a spring who lived happily and safely inside a pen. Although he heard many noises coming from outside, he lived believing that outside his world inside the pen, there was nothing good. Even just to think about leaving his pen made him so scared that he was quite content to spend his life compacting and stretching himself again and again inside that tiny space. However, one day, the ink ran out, and when the pen's owner was busy changing it, there was an accident. The spring was flung through the air and landed in the toilet drain, well out of sight. Terrified, and cursing his bad luck, the spring was flushed through pipe after pipe, each time thinking it might be his end. During the journey, he did not dare open his eyes out of pure fear. Nor did he every stop crying. Swept away by the water, he travelled on and on and on, until he ended up in a river. When the river current lost its force, and the spring could see that things had calmed down a bit, he stopped crying and listened all around him. Hearing birdsong and wind in the trees, he felt encouraged to finally open his eyes. What the spring saw was the pure, crystal waters of the river, the rich green rocks of the riverbed, and all kinds of fish of many colours, whose skin seemed to dance under the sunlight. Now he understood that the world was much greater than the space inside the pen, and that there had always been many things outside, waiting to be enjoyed. After spending a while playing with the fish, he went over to the riverbank, and then moved on to a field of flowers. There he heard weeping. He followed the sound, which took him to a lovely flower that had been flattened by a rabbit, and could no longer stand up straight. The spring realised that he could help the flower, so he offered to be his support. The flower accepted, and slipped through the middle of the spring. There they lived happily together. And they would always laugh when remembering how the spring used to think that all there was to life was being a sad and fearful spring.
GPT2: Always think of what you can do to make things better.
T5: Fear and frustration are one thing, but they can be turned into happiness.
RA-T5: Life should not be afraid of the unknown. There should be lots of positive things out there.
Top-5 Retrieved Morals by RA-T5:
(1) Everything in life has its unpleasant or uncomfortable side. These aspects cannot be removed from life.
(2) It's always better to have friends and be happy - even though it may bring discomfort - than isolate yourself from people in order to avoid problems.
(3) Most fear is without foundation, and plays on what is unknown or different.
(4) Friends are for cheering you up in your worst moments.
(5) Someone who harm's no one is still very far from being good.
True Moral: Changes are not a bad thing, it is up to ourselves to open the eyes and make something positive of them.
Input Moral: Never give up.
GPT2: One day a dragon and a dino met in the late jurassic period. They were friends, and on the way they met a huge tree. Dragon was huge and his big claws were full and he was going to kill him. Dino was going to die. Dino was going to die. When the dragon made half of the tree, he was about to die. Dragon was going to die, and all the beasts and beasts were dead. Dino had no idea what to do. He was the strongest dino in the whole tree. Dragon was a total surprise. Dino was going to die. He was about to die. He was going to die. The dragon was astonished. Dino was not able to die. Dino was so angry, he started to die. Dino was so angry, and the dragon threw his big claws at the tree and ran to the forest. This was the best match. Then the dino was nearly killed.
T5: One day a dragon and a dino met in the late jurassic period. The dragon was standing next to a huge tree. It was full of beasts, lions and zebras that were strong enough to carry out their duties. The dragon was so strong that he could move himself without losing his foot. The dino was so strong that he could carry anything, even if that tree had much more branches. But the dino was very weak, so he could not carry anything. The dragon came to the tree and said, "I will do everything I can to get my foot into the tree." Then the dino started running through the tree. The dragon made half way through the tree and put on his big claws. Then he took off his big claws in his claws. Just then a huge tree started to go through a storm. Then the monster took out his fiery breath. The dino could not contain his fiery breath and flew away.
RA-T5: One day a dragon and a dino met in the late jurassic period. The dragon was very proud of the dino because of his big claws and fiery breath. The dino was going to jump on a huge tree and climb it up. But the dragon didn't know how to jump. The dragon made half way up the tree and started to roll down. The dino was completely surprised. The dragon said, "I can't jump," The dragon started to jump. Then the tree started to roll. The dino started to roll over the top of the tree and jumped up. The tree started to thrash off. Suddenly, the dino saw that the dragon had a fiery breath. The dragon said, "That's my strength." The dino was all alone. Then he stood, looking at the dragon. Then the dragon stopped, shouted at him, "Hello dino! what a total surprise." The dino started running and jumping towards the tree, and the dragon got close to him. Then he hit the tree. Now he found a boulder on the tree started to crash and he jumped on the tree. Then the strongest dino ever was surprised.
Top-5 Retrieved Story Outlines:
(1) {baldwin flew, baldwin scratched rattler, team beat baldwin, baldwin dodged rattler, football game, goal post, baldwin threw rattler, baldwin started}
(2) {eagle resting, tree top, tortoise rested, eagle answered, deep sleep, tortoise sleeping, tortoise smiled, hunter suddenly}]
(3) {loud thump, man happened, cry intruded, ugly wolf, wolf named pete walked, long neck, man walked, thin air}
(4) {cat suddenly fell, bird flew, started climbing, cat thanked}
(5) {lion won, race started, croc won}
True Story: One day a dragon and a dino met in the late jurassic period. The dragon said, "I'm stronger than you!" The dino said, "I'm the strongest dino ever!" The next day the dino and the dragon met in the forest. The dragon made half of a tree fall down with its big claws and fiery breath. The dragon said, "You can't beat that!" The dino started running toward a huge tree. The dino rammed the huge tree with its head. Nothing happened. The dragon laughed. Then the tree started to fall. The dragon just stared in total surprise.
Table 21: Cases generated by different models for the generation tasks. The underlined words are improper concepts/events which leads to incoherence or unfaithfulness. Bold words for MO2ST are the given first sentence and the outline of multiple phrases. The red moral for ST2MO is related to the generated moral of RA-T5 in semantics. Note that we only take concepts in these retrieved morals as input for RA-T5. And red words in the retrieved outlines for MO2ST indicate that they also show up in the generated story of RA-T5.
models still often state events involved with specific characters (e.g., "owls") but do not tell what is right and what is wrong. And Case 2 shows that they struggle to conclude related concepts from the story (e.g., "greedy" is not embodied in the story at all). Furthermore, in Case 3, the models conclude a
conflicting value preference with the story despite correct concepts (e.g., the story shows that "it is bad to be scared" but not "good"). On the other hand, models also are shown to suffer from similar issues when generating stories. In Case 4, the model only describes some scenes (e.g., "it was