Example “quanta” for the TinyStories dataset
Cluster 11: predicting the correct noun	Cluster 31: “time” after “Once upon a”
Lily asked her mom, “Can I touch the sunflower?” Her mom replied, “No, Lily. The sunflower is not for touching. It's for looking at.”\nLily was sad, but she understood. The next day, Lily rode her bike past the sun	Once upon a time
Once upon a time
Once upon a time
Once upon a time
Once upon a time, there was a big house with a door. The door was brown and it could move when people opened it. One day, a little boy came to the house and he saw the impressive door. He wanted to open it and see what was inside. So he moved the door	Once upon a time
Once upon a time
Once upon a time
When they got to the park, Tim saw a man with a sack. The man had found Tim's wagon and put it in the sack to keep it safe. Tim was happy to have his wagon back and thanked the man. He put his wagon	Once upon a time
Once upon a time
Lily and Ben went to the park with Mom. They saw a big pond with many ducks and swans. Lily liked the swans. They were white and graceful. She wanted to feed them some bread.\n\n"Mom, can I give some bread to the sw	Once upon a time
Once upon a time
Lily and Ben nod. They promise to be careful. They ask mom to read the letter to them. Mom smiles. She reads the letter. It is from grandma. She says she loves them a lot. She sends them kisses and hugs. Lily and Ben are happy. They send kisses and hugs back to grandma. They thank mom for the letter	Once upon a time
Cluster 75: comma after temporal phrase	Cluster 77: beginning of quote
One day, Jack wanted to show off his cool sunglasses. He spotted a nice patch of grass in the park, and he decided to sit down and enjoy the sun. He put his sunglasses on and just sat. He felt so special.\nA few moments later,	Jack showed her the big blue ticket and said, “This is my ticket. I'm going to lay it down.”\nThe girl asked, “Where will you lay it down?”\nJack answered,
Jack happily agreed and they started the game. At first, it was a bit tricky for both of them to get the squash to the other, but after a few tries, Jack was a pro. He laughed and cheered as he ran back and forth to get the squash.\nMommy and Jack played until the sun started to go down. Then,	When she found her mom she said, “Mom, I have news!” Her mom said, “What is it, Jane?” Jane said, “I want to stir something up and make it more fun!”\nHer mom said,
Bob loves to go on adventures. He went for a walk along the beach, looking for fun and exciting things. All of a sudden,	The twin jumped back in surprise. She had never heard a flower talk before! She asked the flower, “Who are you?”\n“My name is Pinky,” said the flower.\nThe twin was now even more surprised. She asked,
Linda was a little girl who loved wandering around in nature. She was eager to explore and find what she could. One day, Linda was wandering around in the woods when she spotted a big yellow flower. She was so excited that she ran over to it. She scooped the flower up and inspected it more closely.	He asked Jill, “What's in this jar?” Jill smiled and said, “It's sugar! Would you like some?”\nJackshok his head and said, “No, thank you. I don't think I should eat sugar. My mom won't allow it.”\nJill nodded and said,
Next, her mom told Emma to wipe the floor clean. Emma grabbed a cloth and wiped the floor. When she was finished, it was as clean as a new penny.\nFinally,	Nearby, her mom was watching and called out, “Lucy, come here! What's that you have there?”\nLucy proudly held up the hoop and announced,