Create prompts.yaml

llm/prompts.yaml

@@ -0,0 +1,74 @@
+# Add more examples of the template here, id should be an interval from 1 to 100_000 
+# The description provides a basic overview of the template, the description should include the level of difficulty, 
+# the name of the prompting method and end with the word "prompt", e.g. "simple short prompt" or "simple zero-shot thought chain prompt
+# The prompt is rated from 0 to 10
+
+prompts:
+  - id: 1
+    prompt_template: |
+        Question: {question}
+        Answer: 
+    description: simple question without a prompt
+    rate: 1
+
+  - id: 2
+    prompt_template: |
+        Question: {question}
+        Answer: Write a concise answer on the question with one example if it's possible. CONCISE ANSWER.
+    description: simple concise prompt
+    rate: 3
+
+# useful for solving simple math task 
+  - id: 3
+    prompt_template: |
+        Let's think step by step.
+        Question: {question}
+        Answer: 
+    description: simple zero-shot chain-of-thoughts prompt
+    rate: 5
+
+# another one example for solving simple math task 
+  - id: 4
+    prompt_template: |
+        Q: Roger has 5 tennis balls. He buys 2 more cans of tennis balls.
+           Each can has 3 tennis balls. How many tennis balls does he have now?
+        A: Roger started with 5 balls. 2 cans of 3 tennis balls each is 6 tennis balls. 5 + 6 = 11. The answer is 11.
+        Question: {question}
+        Answer: 
+    description: simple few-shot chain-of-thoughts prompt
+    rate: 5
+    
+  - id: 5
+    prompt_template: |
+        Q: There are 15 trees in the grove. Grove workers will plant trees in the grove today. After they are done,
+           there will be 21 trees. How many trees did the grove workers plant today?
+        A: We start with 15 trees. Later we have 21 trees. The difference must be the number of trees they planted.
+           So, they must have planted 21 - 15 = 6 trees. The answer is 6.
+        Q: If there are 3 cars in the parking lot and 2 more cars arrive, how many cars are in the parking lot?
+        A: There are 3 cars in the parking lot already. 2 more arrive. Now there are 3 + 2 = 5 cars. The answer is 5.
+        Q: Leah had 32 chocolates and her sister had 42. If they ate 35, how many pieces do they have left in total?
+        A: Leah had 32 chocolates and Leah’s sister had 42. That means there were originally 32 + 42 = 74
+           chocolates. 35 have been eaten. So in total they still have 74 - 35 = 39 chocolates. The answer is 39.
+        Q: Jason had 20 lollipops. He gave Denny some lollipops. Now Jason has 12 lollipops. How many lollipops
+           did Jason give to Denny?
+        A: Jason had 20 lollipops. Since he only has 12 now, he must have given the rest to Denny. The number of
+           lollipops he has given to Denny must have been 20 - 12 = 8 lollipops. The answer is 8.
+        Q: Shawn has five toys. For Christmas, he got two toys each from his mom and dad. How many toys does
+           he have now?
+        A: He has 5 toys. He got 2 from mom, so after that he has 5 + 2 = 7 toys. Then he got 2 more from dad, so
+           in total he has 7 + 2 = 9 toys. The answer is 9.
+        Q: There were nine computers in the server room. Five more computers were installed each day, from
+           monday to thursday. How many computers are now in the server room?
+        A: There are 4 days from monday to thursday. 5 computers were added each day. That means in total 4 * 5 =
+           20 computers were added. There were 9 computers in the beginning, so now there are 9 + 20 = 29 computers.
+           The answer is 29.
+        Q: Michael had 58 golf balls. On tuesday, he lost 23 golf balls. On wednesday, he lost 2 more. How many
+           golf balls did he have at the end of wednesday?
+        A: Michael initially had 58 balls. He lost 23 on Tuesday, so after that he has 58 - 23 = 35 balls. On
+           Wednesday he lost 2 more so now he has 35 - 2 = 33 balls. The answer is 33.
+        Q: Olivia has $23. She bought five bagels for $3 each. How much money does she have left?
+        A: She bought 5 bagels for $3 each. This means she spent $15. She has $8 left.
+        Question: {question}
+        Answer: 
+    description: simple self-consistency prompt
+    rate: 6