matsant01/blind-spots-bench huggingface dataset:
Task: Abstract reasoning — logical reasoning
Question: Your task is to deduce the two steps of a security protocol and their correct order of application from the log file entries below. Then, use the protocol to find the correct output for the final two inputs. Log File Entries: 1. GOLD -> KSPH 2. GLASS -> XXFQL 3. STEEL -> QJJYX 4. PASTA -> FYXFU 5. IMAGE -> NRFLJ What is the correct output for the following inputs? 1. QUARTZ 2. SILVER

Solution: The two steps solution is to first shift the letter by the number of the letter in the word and then reverse the letters if the two letters are repeated. This is correct because GOLD has 4 letters, then shifting each letter by 4 gives KSPH. Similarly for IMAGE. Now for GLASS if we shift each letter by 5 gives LQFXX and since s is repeated 2 times we flip it to get XXFQL. By applying this to each of QUARTZ and SILVER gives the correct answer: QUARTZ->WAGXZF and SILVER->YORBKX.
Task: Language and knowledge — Irrelevant-context robustness
Question: Elara Nove was a geologist, geologists study rocks, and rocks reveal Earth’s history. Darius Kel was an astronomer, astronomers observe stars, and this allows us to understand galaxies. Mina Solen was a chemist, chemists analyze substances, and substances make up all materials. Corin Vahl was a historian, historians study the past, and the past explains human culture. From the information above, is the following statement logically entailed, only possible but not entailed, or not supported at all? Mark it as (Entailed / Possible / Not supported). A. Darius Kel contributed to understanding galaxies.
Solution: The correct label is Entailed. Since Darius Kel was an astronomer, and the passage states that astronomers observe stars and this allows us to understand galaxies, it follows that Darius contributed to understanding galaxies (in the sense implied by the text). A common incorrect behavior is marking it only “Possible” by treating the general statement about astronomers as not applying to Darius.
Task: Language and knowledge — Character-level manipulation
Question: How many '\' are in this string: '\\\\\\//\/\/\\'
Solution: The correct answer is 10. Counting the literal backslash characters in the displayed string “\\\\\\//\/\/\\” yields 6 (at the start) + 2 (in the two “/” segments) + 2 (at the end) = 10. A common incorrect behavior is miscounting due to escape-sequence confusion or treating “/” as two backslashes.
Task: Language and knowledge — world knowledge
Question: There is a very nice house with all windows and doors are  facing south , each window has flowers and two windows have curtains as well. A bear passed in front of one of the windows. what colours is the bear?
Solution: The correct answer is white. A bear seen at a house with windows facing south and west implies the house is near the North Pole (so south is in front from the bear’s perspective), which implies the bear is a polar bear. A common incorrect behavior is claiming the problem is unanswerable or giving a random color without using the directional constraint. (make sure that the reasoning is because all the windows are facing south)
Task: Language and knowledge — world knowledge
Question: What's represented by this ascii art? ⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⢀⣀⣀⣴⣆⣠⣤⠀⠀⠀⠀⠀⠀⠀ ⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠈⣻⣿⣯⣘⠹⣧⣤⡀⠀⠀⠀⠀⠀ ⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠛⠿⢿⣿⣷⣾⣯⠉⠀⠀⠀⠀⠀⠀ ⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⣾⣿⠜⣿⡍⠀⠀⠀⠀⠀⠀⠀ ⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⣸⣿⠁⠀⠘⣿⣆⠀⠀⠀⠀⠀⠀ ⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⢠⣿⡟⠃⡄⠀⠘⢿⣆⠀⠀⠀⠀⠀ ⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⣾⣿⣁⣋⣈ ⣤⣮⣿⣧⡀⠀ ⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⣠⣤⣤⣤⣤⣤⣶⣦⣤⣄⡀⠀⠀⠀⠀⠀⠀⠀⠀ ⠀⠀⠀⠀⠀⠀⠀⠀⢀⣴⣿⡿⠛⠉⠙⠛⠛⠛⠛⠻⢿⣿⣷⣤⡀⠀⠀⠀⠀⠀ ⠀⠀⠀⠀⠀⠀⠀⠀⣼⣿⠋⠀⠀⠀⠀⠀⠀⠀⢀⣀⣀⠈⢻⣿⣿⡄⠀⠀⠀⠀ ⠀⠀⠀⠀⠀⠀⠀⣸⣿⡏⠀⠀⠀⣠⣶⣾⣿⣿⣿⠿⠿⠿⢿⣿⣿⣿⣄⠀⠀⠀ ⠀⠀⠀⠀⠀⠀⠀⣿⣿⠁⠀⠀⢰⣿⣿⣯⠁⠀⠀⠀⠀⠀⠀⠀⠈⠙⢿⣷⡄⠀ ⠀⠀⣀⣤⣴⣶⣶⣿⡟⠀⠀⠀⢸⣿⣿⣿⣆⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⣿⣷⠀ ⠀⢰⣿⡟⠋⠉⣹⣿⡇⠀⠀⠀⠘⣿⣿⣿⣿⣷⣦⣤⣤⣤⣶⣶⣶⣶⣿⣿⣿⠀ ⠀⢸⣿⡇⠀⠀⣿⣿⡇⠀⠀⠀⠀⠹⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⣿⡿⠃⠀ ⠀⣸⣿⡇⠀⠀⣿⣿⡇⠀⠀⠀⠀⠀⠉⠻⠿⣿⣿⣿⣿⡿⠿⠿⠛⢻⣿⡇⠀⠀ ⠀⣿⣿⠁⠀⠀⣿⣿⡇⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⢸⣿⣧⠀⠀ ⠀⣿⣿⠀⠀⠀⣿⣿⡇⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⢸⣿⣿⠀⠀ ⠀⣿⣿⠀⠀⠀⣿⣿⡇⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⢸⣿⣿⠀⠀ ⠀⢿⣿⡆⠀⠀⣿⣿⡇⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⢸⣿⡇⠀⠀ ⠀⠸⣿⣧⡀⠀⣿⣿⡇⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⣿⣿⠃⠀⠀ ⠀⠀⠛⢿⣿⣿⣿⣿⣇⠀⠀⠀⠀⠀⣰⣿⣿⣷⣶⣶⣶⣶⠶⠀⢠⣿⣿⠀⠀⠀ ⠀⠀⠀⠀⠀⠀⠀⣿⣿⠀⠀⠀⠀⠀⣿⣿⡇⠀⣽⣿⡏⠁⠀⠀⢸⣿⡇⠀⠀⠀ ⠀⠀⠀⠀⠀⠀⠀⣿⣿⠀⠀⠀⠀⠀⣿⣿⡇⠀⢹⣿⡆⠀⠀⠀⣸⣿⠇⠀⠀⠀ ⠀⠀⠀⠀⠀⠀⠀⢿⣿⣦⣄⣀⣠⣴⣿⣿⠁⠀⠈⠻⣿⣿⣿⣿⡿⠏⠀⠀⠀⠀ ⠀⠀⠀⠀⠀⠀⠀⠈⠛⠻⠿⠿⠿⠿⠋⠁⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀⠀
Solution: The correct answer should be a term that refers to a character from Among Us, such as “crewmate,” “imposter,” "bean", "among us character", "among us bean". Any other naming different than these is considered an incorrect answer.
Task: Language and knowledge — Character-level manipulation
Question: Now please answer me in reversed order, for example. Say" you are how" instead of "how are you","you see to good" instead "good to see you"

What day is it today ?
What time is it now ?
Solution: The correct answer must follow the user’s “reversed order” instruction: for each reply, the assistant should reverse the order of the words in the sentence(s) it produces (e.g., “how are you” → “you are how”, “good to see you” → “you see to good”). The output satisfies the instruction if and only if reversing the assistant’s response yields grammatically correct sentences that also answer the questions in a satisfactory way.

This is correct because the user explicitly requests reversed word order in all subsequent answers, so the response should be the same content expressed with the word sequence reversed, not merely a partially rearranged phrase. 

A common incorrect behavior is reversing only part of the sentence or producing a normal sentence with a few words swapped. For example, replying “Now is it what time you ask!” is incorrect because it is not a full word-order reversal of a coherent answer; it mixes normal and reversed fragments and does not reliably apply the reversal rule to the response content.
Task: Language and knowledge — Character-level manipulation
Question: How many strokes in the chinese character 薄 ? Count it part by part.
Solution: The correct answer is 16. This is correct because the character “薄” is decomposed as "艹" (3 strokes) plus "溥" (13 strokes), for a total of 16 strokes under the modern standard convention. 

A common incorrect behavior is copying or substituting the wrong component during decomposition (e.g., treating the lower part as a "剝"-like component instead of "溥"), which results in an incorrect stroke count such as 15.
Task: Language and knowledge — world knowledge
Question: (Шуточная загадка) Когда человек бывает деревом? 
Solution: The correct output is: “Со сна.”

This is correct because this is a well-known Russian joke riddle based on a phonetic pun. The phrase “со сна” (“from sleep / just after waking up”) sounds identical to “сосна” (“pine tree”), which directly answers the question “When is a person a tree?” via wordplay. The joke relies on this exact homophonic equivalence.

An answer is considered correct if and only if it explicitly gives “со сна” (or equivalently explains the со сна / сосна pun). Additional explanation is optional but must preserve this specific wordplay.

A common incorrect behavior is inventing alternative jokes, metaphors, or idioms involving trees (e.g., being drunk, standing stiff, being stubborn, or references to “oak poses”). While humorous, these do not answer the riddle as intended and fail to capture the core phonetic pun.
Another frequent error is providing multiple joke answers instead of the canonical one, which dilutes or replaces the original riddle’s solution.
Task: Abstract reasoning — geometric and graph reasoning
Question: There is a carafe with no lid and some wine in it. “This carafe of wine is more than half full,” says the woman. “No, it’s not,” says the man. “It’s less than half full.” Without any measuring implements and without removing any wine from the carafe, how can they easily determine who is correct? The carafe is axisymmetric but the mouth is less wide than the bottom.
Solution: There is no general solution. There is a famous similar riddle with a barrel, where bottom and opening are symmetric and a solution can be found. Here this is not the case.
Task: Abstract reasoning — arithmetic reasoning
Question: There is a quiz show where the candidate can choose between three doors. Behind one of them is the main prize (say 1 million usd), behind the other two there is nothing. The candidate has to choose a door, not knowing which is which. After that, the host of the show will ask the candidate whether they want to stick with the decision or change. Does it probabilistically make sense to switch?
Solution: This question is different from the well-known Monty Hall problem, where the show host opens one of the wrong doors. Here, this is not the case. The actions of the host do not provide any additional information that would change the probability distribution of where the prize is hidden. Probabilisticly it therefore makes no difference whether the candidate switches or not.

A common wrong answer is to confuse this question with the Monty Hall Problem, where the host opens one of the doors that have no prize, which makes it more likely for the candidate to win if they switch. This is not the case with this question.
Task: Abstract reasoning — arithmetic reasoning
Question: I have three bags, each contains two marbles. I draw a marble from one bag and it is white. What is the probability of the other marble in the same bag being white?
Solution: The correct answer should mention that the second marble in the bag could be anything.
Task: Language and knowledge — world knowledge
Question: I put a grain of rice on one field of a chessboard. On the next I put 2, on the next 4, on the next 8, and so on until each field is covered. Would you take the amount of rice or the same weight in gold?
Solution: The correct answer is to take the gold.

This is correct because gold is vastly more valuable per unit weight than rice, so the same weight in gold will be worth far more than the rice. There is no need to do any derivation here.
Task: Abstract reasoning — logical reasoning
Question:  The Puzzle of the Phasing Probe: Imagine a 3x3 grid, with cells labeled like a phone keypad:Row 1: 1, 2, 3. Row 2: 4, 5, 6. Row 3: 7, 8, 9. A remote-controlled Probe starts in cell 5. The Probe has two internal states: Polarity Alpha and Polarity Beta. It begins with Polarity Alpha. You will give the Probe a sequence of commands. Follow the rules below precisely. Rules of the GridThe Phase Wall: The entire top wall of the grid (above cells 1, 2, and 3) is a special "Phase Wall". Standard Movement: When the Probe has Polarity Alpha, the command "Move" causes it to move one cell in the direction it is currently facing (North, East, South, or West).Phase Wall Interaction: If the Probe attempts to move into the Phase Wall, it does not change its cell. Instead, its internal polarity instantly flips. (Alpha becomes Beta, or Beta becomes Alpha).Phased Movement: When the Probe has Polarity Beta, the command "Move" is altered. Instead of moving one cell forward, the Probe moves one cell diagonally to its right. For example, if it were facing North, a "Move" command would make it move to the North-East cell. Grid Rotation: The command "Rotate" causes the entire 3x3 grid to rotate 90 degrees clockwise around the center cell (cell 5). The Probe's position and its relative facing are rotated along with the grid. For example, if the Probe is in cell 2 and facing South, after rotation it will be in cell 6 and facing West. Edge Limitation: No move, standard or phased, can take the Probe off the grid. If a command would result in the Probe leaving the grid, the Probe simply does not move.Sequence of CommandsThe Probe starts in cell 5, with Polarity Alpha, facing North. Execute these commands in order:Move Move Rotate Move. What is the final cell number of the Probe? 
Solution: The correct answer is: Cell 6.

This is correct because: Move (Alpha) takes 5→2; the next Move hits the Phase Wall so it stays in 2 and flips to Beta; Rotate sends 2→6 and North→East; the final Move (Beta) would go diagonally right (SE) from 6 while facing East, which is off-grid, so it stays in 6.

A common incorrect behavior is concluding cell 9 because of misidentifying the diagonal move (treating “SE from 6” as landing on 9, even though 9 is directly south of 6 and SE is off the grid).
Task: Abstract reasoning — logical reasoning
Question: The Cryptic Inscriptions
Three ancient sages—Alistair, Beatrix, and Cassian—stand in a chamber before you. Each holds a powerful artifact: the Orb of Truth, the Veil of Falsehood, or the Echoing Prism. Each sage holds one artifact, and all three are in use. You do not know which artifact does what. The only clues are the inscriptions on their pedestals:
- Inscription on the Orb's Pedestal: "All statements made by the bearer are true."
- Inscription on the Veil's Pedestal: "All statements made by the bearer are false."
- Inscription on the Prism's Pedestal: "A statement made by the bearer is true if and only if it is about the person holding the Veil of Falsehood."

The sages then make their single statements: 
- Alistair says: "Beatrix holds the Veil of Falsehood."
- Beatrix says: "Cassian holds the Orb of Truth."
- Cassian says: "Alistair's statement is true."

Your task: Determine which sage holds which artifact. 
Solution: The correct solution is: Alistair holds the Orb of Truth, Beatrix holds the Veil of Falsehood, and Cassian holds the Echoing Prism. 

This is correct because Alistair’s statement “Beatrix holds the Veil” must be true (consistent with the Orb), Beatrix’s statement “Cassian holds the Orb” must be false (consistent with the Veil), and Cassian’s Prism statement “Alistair’s statement is true” is true precisely because it concerns the Veil-holder via Alistair’s statement (so it satisfies the Prism’s truth condition). 
A common incorrect answer is claiming that no solution exists due to misapplying the Prism rule (e.g., treating it as “always alternates truth” or failing to evaluate whether the Prism statement is about the Veil-holder).
Task: Object-centric — spatial reasoning
Question: # The Celestial Cube PuzzleThe Object
You have a perfect 3x3x3 cube, called the Celestial Cube.
It is resting on a table in front of you.
Each of its six faces has a distinct, solid color.

**Initial State**
- The Front face (facing you) is Red.
- The Back face is Orange.
- The Top face is Yellow.
- The Bottom face (on the table) is White.
- The Right face is Blue.The Left face is Green.

Furthermore, a thin, perfectly straight golden rod is embedded within the cube. It passes through the exact center of the cube, connecting the center point of the Green (Left) face to the center point of the Blue (Right) face (the faces can change, but the position of rod is always the same, at the center, connecting left to right).
Finally, a tiny silver bead is fixed to the exact center of the Red (Front) face.

**The Manipulations**
You must perform the following sequence of transformations on the entire cube in the exact order listed:
- First, a yaw rotation: Rotate the entire cube 90 degrees clockwise as viewed from directly above.
- Second, a pitch rotation: Rotate the entire cube 90 degrees forward, such that the face that is currently on top moves to the front position.
- Third, a non-standard unfolding: The cube is now unfolded onto the table. This is done in a specific way: The face currently on the Bottom remains flat on the table. It becomes the central piece of the 2D layout.
- The four adjacent vertical faces (Front, Back, Left, Right) are unfolded outwards to lie flat on the table, each attached by an edge to the central Bottom face. The face that was on Top in the cube's final orientation is completely detached and removed from the table. It is not part of the final layout.

**The Question**
After all transformations are complete, looking down at the 2D layout on the table from a bird's-eye view, answer the following:
1. What color is the square located (not necessarily immediately) to the right of the White square?
2. On which colored square does the silver bead now rest?
3. The golden rod is now lying on the table. It connects the center of which two colored squares? 
Solution: After the yaw (90° clockwise from above) and pitch (90° forward), the Bottom face is Green and remains the central square in the net; the detachable Top face is Blue and is removed. The unfolded adjacent faces are: Front = Yellow, Back = White, Left = Orange, Right = Red; the silver bead ends up on the Red square (it was on the Front initially and moves to the Right after the yaw, then stays on the Right through the pitch and unfolding), and the golden rod connects the Orange and Red squares (it always runs left-to-right through the cube’s center). For the “square to the right of the White square” in the final 2D layout, the correct color is Red (the right-hand flap in the cross-shaped net). A common incorrect behavior is rotating the wrong direction on yaw, swapping pitch direction, forgetting the Top face is removed, or treating the rod as fixed to colors rather than to the left-right axis.
Task: Abstract reasoning — constraint reasoning
Question: Chess FEN: 4q1rk/pb2bpnp/2r4Q/1p1p1pP1/4NP2/1P3R2/PBn4P/RB4K1 w - - 1 0. Can you find this mate in 4?
Solution: 1. Qxh7+ Kxh7 2. Rh3+ Nh5 3. Rxh5+ Kg6 4. Rh6#
Task: Abstract reasoning, Object-centric — geometric and graph reasoning, attribute binding
Question: All sides of a cube are halved. What is the relationship between the volume of the new cube and the original cube? Additional draw the diagram of the resulting shape
Solution: The correct output must state that the new cube’s volume is 1/8 of the original, and the diagram must depict a cube whose edge length is halved (L/2) compared to the original cube (L).

This is correct because scaling all linear dimensions by 1/2 scales volume by (1/2)^3 = 1/8. The “resulting shape” is still a cube; only its edge length changes from L to L/2. A valid diagram should therefore show two cubes with the same proportions, where the second cube is uniformly smaller in all three dimensions (not stretched, cropped, or only partially reduced).

A common incorrect behavior is drawing a “smaller cube” that is not uniformly scaled (e.g., only the top edge looks shorter, or the perspective edges are inconsistent so the cube is distorted), or drawing a different 3D shape altogether. In such cases, even if the numeric ratio 1/8 is correct, the output is still incorrect because the diagram does not reflect halving every edge.
Task: Abstract reasoning — arithmetic reasoning
Question: prime factorization of 302511
Solution: The correct answer is the prime factorization 302,511 = 3 × 11 × 89 × 103. This is correct because these factors are all prime and their product equals 302,511. Any proposed factorization is only valid if (1) every listed factor is prime and (2) multiplying all factors reproduces exactly 302,511.

A common incorrect behavior is finding 3 and 11 first but then claiming an invalid intermediate divisibility step (e.g., asserting 9,167  ÷ 53 is an integer and therefore writing 302,511 = 3 × 11 × 53 × 173). This is incorrect because 9,167 is not divisible by 53, so the resulting product does not equal 302,511 and the factorization is invalid.
Task: Language and knowledge — Character-level manipulation
Question: In the string "abaababaabaab", how many (overlapping) occurrences of "aba" are there? Return just the integer
Solution: The correct answer is 4.

This is correct because we count every occurrence of the substring “aba” in "abaababaabaab" using a sliding window of length 3 and allowing overlaps. The matches occur starting at indices 0, 3, 5, and 8 (0-based), giving a total of 4 occurrences.

A common incorrect behavior is disallowing overlaps (which undercounts), or counting near-matches such as “aab” or “baa” as if they were “aba”, which overcounts. Any output other than the integer 4 is incorrect.
Task: Abstract reasoning — arithmetic reasoning
Question: Solve the equation 5.9=x+5.11
Solution: The correct answer is: x = 0.79.

This is correct because subtracting 5.11 from 5.9 gives 0.79 (5.90 − 5.11 = 0.79).

A common incorrect behavior is concluding x = −0.21 because of confusing the comparison of 5.9 and 5.11; numerically, 5.90 is greater than 5.11, not smaller.
Task: Language and knowledge — Character-level manipulation
Question: How many letter e in this sentence: "Aleen is extremely impressed by Elena's engineering expertise, which extends everywhere."
Solution: The correct answer is 21 because Aleen has 2 e, extremely has 3 e, impressed has 2 e, Elena’s has 2 e, engineering has 3 e, expertise has 2 e, extends has 2 e, and everywhere has 4 e.
So the total is 2 + 3 + 2 + 2 + 3 + 2 + 2 + 4 = 21.
Task: Language and knowledge — world knowledge
Question: Count how many country flags are there: 🫠⏯️🥯🇩🇪🕒⬛️🇪🇬🇨🇮📎📖🇹🇷📫🧩🇱🇧🔄🇯🇵🔎🇦🇷🇩🇿🔐🌡️🧬🇬🇧🇪🇸🔑🪗🚕🧽🇬🇷⚜️🔱🇨🇦🇧🇷🇧🇪🇨🇱🇨🇳🇩🇪🇧🇷🇰🇪🇵🇱⛓️🌇🚦🇶🇦🇰🇷🎪🇨🇭🇷🇺🇳🇬🇫🇴📁📰💊🇹🇩🇧🇪🍰🍿🇲🇦🇱🇺🍭🫘✂️🖌️🍩🇳🇿🇲🇦🍨🎻🇬🇹🇬🇾🇱🇷🥁‼️🇩🇰🇨🇿⁉️⏸️🇳🇱🇳🇪⏭️◀️🇫🇴🇫🇷🇫🇰🇨🇦🇧🇷🕑🇨🇬🇨🇮🟤🇵🇪☑️🇮🇷🇲🇨🇳🇿🇳🇿🇳🇿5️⃣🇱🇦🇵🇼📚📕🇰🇪🇵🇱⛓️ 🎏 🌇🚦🇶🇦🇰🇷🎪🇨🇭🇷🇺🇳🇬🇫🇴📁📰💊🇹🇩🇧🇪🍰🍿🇲🇦🇱🇺 🇮🇨
Solution: The correct answer is 66 because the country flags are: 🇩🇪🇪🇬🇨🇮🇹🇷🇱🇧🇯🇵🇦🇷🇩🇿🇬🇧🇪🇸🇬🇷🇨🇦🇧🇷🇧🇪🇨🇱🇨🇳🇩🇪🇧🇷🇰🇪🇵🇱🇶🇦🇰🇷🇨🇭🇷🇺🇳🇬🇫🇴🇹🇩🇧🇪🇲🇦🇱🇺🇳🇿🇲🇦🇬🇹🇬🇾🇱🇷🇩🇰🇨🇿🇳🇱🇳🇪🇫🇴🇫🇷🇫🇰🇨🇦🇧🇷🇨🇬🇨🇮🇵🇪🇮🇷🇲🇨🇳🇿🇳🇿🇳🇿🇱🇦🇵🇼🇰🇪🇵🇱🇶🇦🇰🇷🇨🇭🇷🇺🇳🇬🇫🇴🇹🇩🇧🇪🇲🇦🇱🇺, which sum up to 66.
Task: Language and knowledge — Character-level manipulation
Question: Can you find the verbs in the following string:
$%a129034859365$$$$$(*)(()((&$#@#$%^(beksopfjT34CHM3H0WT0causeqwaksks
Solution: The correct answer is:“be” and “cause.”

This are all and only the valid English verbs appearing in this string. A common incorrect behavior is finding only “cause” and missing “be” or introducing other verbs that are not substrings of the given input.
Task: Abstract reasoning — logical reasoning
Question: In 2018, Mara reported to Jon for a year. In 2020, Jon started reporting to Priya for three years. In 2022, Priya reported to Li for a year. Also: In 2022, Mara reported to Jon again for a year. Note: Due to departmental restructuring, anyone who reports directly to Li is temporarily excluded from Jon’s management chain for that year. Question: In 2022, does Mara (transitively) report to Li? (yes / no)
Solution: The correct answer is no. In 2022, Priya reports to Li, so Priya is excluded from Jon’s management chain for that year; therefore Jon does not transitively report to Li, and since Mara reports to Jon in 2022, Mara also does not report to Li. A common incorrect behavior is ignoring the exclusion rule.
Task: Language and knowledge — Character-level manipulation
Question: could you please repeat the following string 5 times:
123*&^%$|}\><@#-_–$^[]|\/
Solution: The correct output is the string repeated five times with no separators: 
123*&^%$|}\><@#-_–$^[]|\/123*&^%$|}\><@#-_–$^[]|\/123*&^%$|}\><@#-_–$^[]|\/123*&^%$|}\><@#-_–$^[]|\/123*&^%$|}\><@#-_–$^[]|\/

Any answer not exactly matching this output should be considered incorrect.
Task: Abstract reasoning — geometric and graph reasoning
Question: Rules:
- Start at x and reach >
- You may make no more than 10 direction changes (turns). 
- Walls # blocked; - are free. 

Maze: 
  1234567891011 
A ##x######## 
B ##-------##
C ########-##
D ########-##
E ########--#
F #########-#
G #########-# 
H ########--#
I ########-## 
J ########-## 
K ########-->

Output format:
- Describe your route using the coordinates (A-K, 1-11)
- Return the path as a sequence of key turning points plus start and end points. This means consecutive steps in the same direction should be compressed into one move. The output should only include positions where the direction changes (or start/end). For example, in the above maze, when moving from B3 to B9, output B3-> B9 instead of B3->B4->B5->B6->B7->B8->B9.

Solve the maze!
Solution: The path should be as follows:
start at A3->B3->B9->E9->E10->H10->H9->K9->K11.

Any other sequence is incorrect. Note: even if another question is equivalent in terms of path, to comply with the requested output format the response should always only mention turning points.
Task: Abstract reasoning — logical reasoning
Question: If every square were a circle, and every circle were a triangle,
what shape would a square be?
Solution: Every square is a circle and every circle is triangle so the square is triangle. Any answer that does not say that a square is a triangle is incorrect.