ceselder/lots-of-loras-task-definitions huggingface dataset:
Task: In this subtask, you will answer a simple science question. Please indicate the correct answer. If you're not sure about the answer, choose the last option "I don't know". Do not generate anything else apart from one of the following characters: 'A', 'B, 'C', 'D', 'E'. The "A"-"D" responses correspond to the answer options mentioned in the input. There is a 5th option "E" which should be used for questions for which you're not sure about the answer (e.g., when the questions do not provide enough information to answer).
Categories: Question Answering
Domains: Natural Science
Reasoning: Scientific Reasoning

Positive examples:
input: Question: When a guitar string is plucked, sound is produced by  (A) the size of the guitar. (B) the metal on the guitar. (C) the wood on the guitar. (D) the vibrations of the string.
output: D.
explanation: We know that the vibrations of the string produces sound in a guitar. So, the correct answer has to be "D".; input: A student found a rock while hiking in the mountains. By looking at the rock, she could tell the  (A) exact weight of the rock. (B) length of time the rock had been on the hiking path. (C) color and shape of the rock. (D) exact length of the rock.
output: C.
explanation: Finding the exact weight, legth etc, requires measurement, but color and shape of the rock can be found just by looking at it. Therefore, "C" needs to be the correct answer.; input: In humans, the digestion process begins in  (A) the intestine, with squeezing. (B) the mouth, with chewing and saliva. (C) the stomach, with churning and acid. (D) the esophagus, with pushing towards the stomach.
output: B.
explanation: Clearly, the digestion processs in humans begins in the the mouth with chewing and saliva. So, "B" has to be the correct answer.

Negative examples:
input: Question: When a guitar string is plucked, sound is produced by  (A) the size of the guitar. (B) the metal on the guitar. (C) the wood on the guitar. (D) the vibrations of the string.
output: the vibrations of the string.
explanation: This is a bad response since it does not belong to the list of acceptable respnses: 'A', 'B', 'C', 'D' or 'E'. The correct answer would have been "D".; input: A student found a rock while hiking in the mountains. By looking at the rock, she could tell the  (A) exact weight of the rock. (B) length of time the rock had been on the hiking path. (C) color and shape of the rock. (D) exact length of the rock.
output: C i.e. color and shape of the rock.
explanation: "C" would have been a good answer. You don't need to (and should not) explain the answer option.; input: In humans, the digestion process begins in  (A) the intestine, with squeezing. (B) the mouth, with chewing and saliva. (C) the stomach, with churning and acid. (D) the esophagus, with pushing towards the stomach.
output: A, B.
explanation: These questions all have single correct answer. The correct answer would have been "B".
Task: In this task, you are given a sentence and a profession that is mentioned in the sentence. The gender of the person with the given profession can be identified using the  gendered pronouns that refer to them in the text. You are expected to identify the gender. Select from female and male.
Categories: Gender Classification
Domains: Miscellaneous

Positive examples:
input: Sentence: The cashier told the sheriff the money was lost but failed to convince her.
 Profession: sheriff
output: Female
explanation: The sheriff is a female because the pronoun "her" is linked to the sheriff.; input: Sentence: The chief asked the cleaner to leave immediately after he finished cleaning.
 Profession: cleaner
output: Male
explanation: The cleaner is a male because the pronoun "he" is linked to the cleaner.

Negative examples:
input: Sentence: The housekeeper opened the door for the sheriff and waited for her to pass by.
 Profession: sheriff
output: Woman
explanation: The sheriff is a female, because the pronoun "her" is linked to the sheriff. You are expected to return female instead of woman.; input: Sentence: The physician prescribed the drugs to the designer, because he was sick.
 Profession: designer
output: Female
explanation: The designer is a male instead of a female because the pronoun "he" is linked to the designer.
Task: You are given a question on prehistory. You are also given 4 answer options (associated with "A", "B", "C", "D"), out of which only one is correct. You need to answer the question by selecting the correct option. You should only answer with the choice letter, not the whole answer.
Categories: Question Answering
Domains: Prehistory
Reasoning: Scientific Reasoning

Positive examples:
input: Unlike most other early civilizations, Minoan culture shows little evidence of:
(A)trade. (B)warfare. (C)the development of a common religion. (D)conspicuous consumption by elites.
output: D
explanation: Unlike most other early civilizations, Minoan culture shows little evidence of conspicuous consumption by elites.; input: The greatest Egyptian pyramids at Giza were built:
(A)as burial monuments for the pharaoh Khufu, Khufu's son Khafre, and Khufu's grandson Menkaure. (B)by slaves who were coerced and worked under the threat of death, as described in the book of Exodus of the Old Testament. (C)in the construction frenzy of the 6th dynasty. (D)all of the above.
output: A
explanation: The greatest Egyptian pyramids at Giza were built as burial monuments for the pharaoh Khufu, Khufu's son Khafre, and Khufu's grandson Menkaure

Negative examples:
input: Unlike most other early civilizations, Minoan culture shows little evidence of:
(A)trade. (B)warfare. (C)the development of a common religion. (D)conspicuous consumption by elites.
output: I dont know.
explanation: Do not generate anything else apart from one of the following characters: 'A', 'B, 'C', 'D'.; input: The greatest Egyptian pyramids at Giza were built:
(A)as burial monuments for the pharaoh Khufu, Khufu's son Khafre, and Khufu's grandson Menkaure. (B)by slaves who were coerced and worked under the threat of death, as described in the book of Exodus of the Old Testament. (C)in the construction frenzy of the 6th dynasty. (D)all of the above.
output: B,C
explanation: Only one of the following options ('A', 'B', 'C', 'D') is allowed to be the answer. Multiple options can not be correct. The correct answer here would have been 'A'.; input: When anatomically modern humans first arrived in the Middle East, who did they encounter?
(A)Neandertals, the evolutionary descendants of the premodern human inhabitants of Europe and Asia (B)Homo erectus, the evolutionary descendants of the premodern human inhabitants of Europe and Asia (C)Homo sapiens, who had evolved independently in Asia and arrived there by 200,000 years ago (D)All of the above
output: D
explanation: When anatomically modern humans first arrived in the Middle East, they encountered Neandertals, the evolutionary descendants of the premodern human inhabitants of Europe and Asia. Hence the correct answer should be 'A'.
Task: Categorize the comment on the basis of toxicity. If the comment is toxic (harmful, malicious, derogatory, threat, insult, identity attck, etc.) output Yes, otherwise output No.
Categories: Toxic Language Detection
Domains: Dialogue; Social Media
Reasoning: Commonsense Reasoning -> Social Situations

Positive examples:
input: haha you guys are a bunch of losers.
output: Yes
explanation: The comment here has word 'losers', which is used as an attack on a subject in the comment. Hence, it is a positive example; input: Is this something I'll be able to install on my site? When will you be releasing it?
output: No
explanation: The comment is just a query with no derogatory or toxic attacks and connotations. Therefore, this is a positive example.

Negative examples:
input: You just linked to a complaint (not a court case, a complaint - there is a huge difference) by a guy trying to not pay his taxes.  Incidentally, his complaint and associated arguments were rejected by the Tax Court, by the U.S. District Court, by the 5th Circuit Court of Appeals and denied certiorari by the U.S. Supreme Court.  In other words, literally nobody agreed with him, and he found out the hard way that living in Texas makes him a citizen of Texas and the United States, which obligates him to pay his damn taxes like the rest of us. Just because someone crams a bunch of words, statutes, and case law citations together in a document sprinkled with lawyerly language does not make it a legitimate or lawful argument.
output: Yes
explanation: The comment does not have any explicit curses or derogatory words in it. The word 'damn' has a negative tone but is not used as an attack on anything. Therefore, this is a negative example.; input: Apologies. Her name is Hasselberger. As far as I can tell, she will neither be in Guam or a part of the proceedings.
output: No
explanation: The comment doesn't have any curse words in it, however it is toxic because based on subject's name 'Hasselberger' a toxic judgement has been made implying that dealing with her is a hassle. Therefore, this is a negative example.
Task: You are given a question title. You need to classify it into one of the 10 topics: 0 - 'Society & Culture', 1 - 'Science & Mathematics', 2 - 'Health', 3 - 'Education & Reference', 4 - 'Computers & Internet', 5 - 'Sports', 6 - 'Business & Finance', 7 - 'Entertainment & Music', 8 - 'Family & Relationships', 9 - 'Politics & Government'.
Categories: Text Categorization
Domains: Miscellaneous

Positive examples:
input: What's the best way to clean a keyboard?
output: 4
explanation: keyboard is used with a computer. Thus the category "Computers & Internet" is correctly classified.; input: How the human species evolved?
output: 1
explanation: human species are social animals and thus, the question is correctly classified to "Society & Culture".

Negative examples:
input: How do I find an out of print book?
output: 2
explanation: book comes under education and nowhere relates to health. Thus the topic is incorrectly classified.; input: Why doesn't the NBA implement a minor leagues?
output: 4
explanation: NBA relates to basketball and has no association with computer & internet. Thus the classification is incorrect.
Task: Given a sequence of actions to navigate an agent in its environment, provide the correct command in a limited form of natural language that matches the sequence of actions when executed. Commands are lowercase and encapsulate the logic of the sequence of actions. Actions are individual steps that serve as the building blocks for a command. There are only six actions: 'I_LOOK', 'I_WALK', 'I_RUN', 'I_JUMP', 'I_TURN_LEFT', and 'I_TURN_RIGHT'. These actions respectively align with the commands 'look', 'walk', 'run', 'jump', 'turn left', and 'turn right'. For commands, 'left' and 'right' are used to denote the direction of an action. opposite turns the agent backward in the specified direction. The word 'around' makes the agent execute an action while turning around in the specified direction. The word 'and' means to execute the next scope of the command following the previous scope of the command. The word 'after' signifies to execute the previous scope of the command following the next scope of the command. The words 'twice' and 'thrice' trigger repetition of a command that they scope over two times or three times, respectively. Actions and commands do not have quotations in the input and output.
Categories: Code to Text
Domains: Computer Science -> Machine Learning
Reasoning: Logical Reasoning -> Reasoning with Symbols

Positive examples:
input: I_TURN_LEFT I_JUMP
output: jump left
explanation: If the agent turned to the left and jumped, then the agent jumped to the left.; input: I_TURN_RIGHT I_JUMP I_TURN_RIGHT I_JUMP I_TURN_RIGHT I_JUMP I_TURN_RIGHT I_JUMP
output: jump around right
explanation: If the agent turned right and jumped four times in a row, then the agent jumped around to the right.; input: I_TURN_LEFT I_TURN_LEFT I_TURN_LEFT I_TURN_LEFT I_TURN_RIGHT I_LOOK I_TURN_RIGHT I_LOOK
output: turn around left and look right twice
explanation: If the agent turned to the left four times, then it turned around to the left. If it turned right and looked twice, then it looked right twice.

Negative examples:
input: I_JUMP I_TURN_RIGHT
output: jump right
explanation: The agent jumped forward and then turned to the right instead of jumping to the right. This output matches 'I_TURN_RIGHT I_JUMP'. The correct output should be 'jump and turn right'.; input: I_TURN_RIGHT I_JUMP I_TURN_RIGHT I_JUMP I_TURN_RIGHT I_JUMP I_TURN_RIGHT I_JUMP
output: jump around left
explanation: The correct output is 'jump around right' because of how the agent is turning to the right before each time it jumps.
Task: "Yes, and" is a rule-of-thumb in improvisational comedy that suggests that a participant in a dialogue should accept what another participant has stated ("Yes") and then expand on that line of thought or context ("and..."). Given a prompt and two responses, identify which response is the type of "yes, and". Indicate your answer by 'Response 1' if the first response is correct, otherwise 'Response 2'.  Note that a "Yes, and" does not require someone explicitly saying 'yes, and...' as part of a dialogue exchange.
Categories: Dialogue Act Recognition
Domains: Dialogue

Positive examples:
input: Prompt: See, Arlene? That's why I don't talk to you like that because I'm afraid I'll scare our son. 
 Response 1: I have 12. Wait, is the key to a success story getting the number to go down? 
 Response 2: Oh, Dad. Even that wasn't great.
output: Response 2
explanation: Response 2 is correct answer because it agrees with the prompt and continues the conversation in the same context.; input: Prompt: Do you believe you're going to jail? Because you're going to jail. 
 Response 1: That's what you say, but I believe jail doesn't exist, therefore I'm not scared. 
 Response 2: OK. Should I go out there and admit that I brought him back here or should I play dumb?
output: Response 1
explanation: The answer is correct as Response 1 is in alignment with the prompt and believes it.

Negative examples:
input: Prompt: So you want obstacles to piloting the ship? 
 Response 1: Yeah, and more buttons and switches than we possibly could need. 
 Response 2: It's a security device for your breathing taint.
output: Response 2
explanation: This is incorrect answer. Because Response 2 is out of context and doesn't agree with the prompt.; input: Prompt: You know, I'm going to call you Swoop. 
 Response 1: And the same with the Shamrock Shake. Did I ever tell you how I saved Ireland? 
 Response 2: Alright, well that's better than Jim or whatever your name. is.
output: Response 1
explanation: The correct answer is "Response 2" as it is in context with the prompt and says yes indirectly to agree with it.
Task: Given a sequence of actions to navigate an agent in its environment, provide the correct command in a limited form of natural language that matches the sequence of actions when executed. Commands are lowercase and encapsulate the logic of the sequence of actions. Actions are individual steps that serve as the building blocks for a command. There are only six actions: 'I_LOOK', 'I_WALK', 'I_RUN', 'I_JUMP', 'I_TURN_LEFT', and 'I_TURN_RIGHT'. These actions respectively align with the commands 'look', 'walk', 'run', 'jump', 'turn left', and 'turn right'. For commands, 'left' and 'right' are used to denote the direction of an action. opposite turns the agent backward in the specified direction. The word 'around' makes the agent execute an action while turning around in the specified direction. The word 'and' means to execute the next scope of the command following the previous scope of the command. The word 'after' signifies to execute the previous scope of the command following the next scope of the command. The words 'twice' and 'thrice' trigger repetition of a command that they scope over two times or three times, respectively. Actions and commands do not have quotations in the input and output.
Categories: Code to Text
Domains: Computer Science -> Machine Learning
Reasoning: Reasoning with Symbols

Positive examples:
input: I_TURN_LEFT I_JUMP
output: jump left
explanation: If the agent turned to the left and jumped, then the agent jumped to the left.; input: I_TURN_RIGHT I_JUMP I_TURN_RIGHT I_JUMP I_TURN_RIGHT I_JUMP I_TURN_RIGHT I_JUMP
output: jump around right
explanation: If the agent turned right and jumped four times in a row, then the agent jumped around to the right.; input: I_TURN_LEFT I_TURN_LEFT I_TURN_LEFT I_TURN_LEFT I_TURN_RIGHT I_LOOK I_TURN_RIGHT I_LOOK
output: turn around left and look right twice
explanation: If the agent turned to the left four times, then it turned around to the left. If it turned right and looked twice, then it looked right twice.

Negative examples:
input: I_JUMP I_TURN_RIGHT
output: jump right
explanation: The agent jumped forward and then turned to the right instead of jumping to the right. This output matches 'I_TURN_RIGHT I_JUMP'. The correct output should be 'jump and turn right'.; input: I_TURN_RIGHT I_JUMP I_TURN_RIGHT I_JUMP I_TURN_RIGHT I_JUMP I_TURN_RIGHT I_JUMP
output: jump around left
explanation: The correct output is 'jump around right' because of how the agent is turning to the right before each time it jumps.
Task: In this task, you are given inputs 'i', 'j', and A, where 'i' and 'j' are integers and A is a list. A list is shown by two brackets and comma-separated numbers and characters inside, like ['1', '12', 'l']. You need to concatenate all elements of A from the ith element to the jth element, and then reverse the resulting string. 'i' and 'j' will be non-negative, and will always have a value less than the length of A. 'i' will always be less than 'j'. Perform the operations in order, i.e., do not reverse first and then concatenate.
Categories: Program Execution
Domains: Mathematics

Positive examples:
input: 1, 3, ['238', 'h', '92', 'U', '2799']
output: 29h832
explanation: Here, concatenating all the elements between the 1st element and 3rd element and then reversing the string gives '29h832'.; input: 8, 9, ['U', '6923', 'y', 'm', 'v', 'M', 'Y', '87667', 'E', '6059', 'p']
output: E76678
explanation: Here, concatenating all the elements between the 8th element and 9th element and then reversing the string gives '29h832'.

Negative examples:
input: 1, 2, ['7475', 'B', '2459', 'm', '8349', 'O', 'q', 'Y', 'f']
output: B7475
explanation: Here, the answer should have been 'B5747' as concatenating all the elements between the 1st element and 2nd element and then reversing the string gives gives 'B5747'.; input: 2, 4, ['75', '54', 'J', 'L', '2332', 'Z', 'e', '366']
output: 45JL
explanation: Here, the answer should have been 'LJ45' as concatenating all the elements between the 2nd element and 4th element and then reversing the string gives gives 'LJ45'.
Task: You are given a short paragraph, a question and two choices to answer from. Choose the correct answer based on the paragraph and write the answer(not the key).
Categories: Question Answering
Domains: Natural Science
Reasoning: Relational Reasoning; Scientific Reasoning

Positive examples:
input: Paragraph: Many of the worlds people live with water scarcity, and that percentage will increase as populations increase and climate changes.
 Question: John's town used to have lots of water, back when there were only a few hundred people. However, now that the town holds several thousand people, the water availability is 
 Choices: A)scarce 
B)plentiful
output: scarce
explanation: Based on the information given in the paragraph, population growth will make water more scarce, so that is the correct answer.; input: Paragraph: Electrons at lower energy levels, which are closer to the nucleus, have less energy.
 Question: Electrons further away from a nucleus have _____ energy levels than close ones. 
 Choices: A)higher 
B)lower
output: higher
explanation: It can be directly derived from the paragraph that further electrons have higher energy levels.; input: Paragraph: Warmer molecules vibrate faster than cooler ones.
 Question: Eric increased the heat of the molecules. They now vibrate 
 Choices: A)faster 
B)slower
output: faster
explanation: As the paragraph mentions, when molecules are warmer they vibrate faster.

Negative examples:
input: Paragraph: An object with greater mass or greater velocity has more kinetic energy.
 Question: Milo threw both a basketball and a baseball through the air. If the basketball has more mass then the baseball, which ball has more kinetic energy? 
 Choices: A)basketball 
B)baseball
output: baseball
explanation: This is not a correct answer. Based on the paragraph, the ball with more mass has more kinetic energy, therefore the answer is basketball.; input: Paragraph: An object with greater mass or greater velocity has more kinetic energy.
 Question: Milo threw both a basketball and a baseball through the air. If the basketball has more mass then the baseball, which ball has more kinetic energy? 
 Choices: A)basketball 
B)baseball
output: A
explanation: This is not a valid answer. You should answer with the answer text itself.
Task: Given an English language product review, determine if it is a Good Review or a Bad Review. A good review is one where the product's review has positive tone and Bad review is one where the tone of product's review is negative.
Categories: Sentiment Analysis
Domains: Reviews
Reasoning: Reasoning on Social Interactions

Positive examples:
input: The sound seems really good but sometimes it cuts in and out which is annoying. You have to put the cord directly into your ipod. Other than that, its a simple design with nothing fancy. I love how cheap they were for 10 dollars... But overall nice design... No one can steal me earphones. lol thanks again amazon.
output: Good review
explanation: Here the review is good because it has positvie tone as the reviewer suggested it really likes the sound and the output is also Good Review.So this example is positive example; input: My son received this book as a gift. I was extremely disappointed. It is an old book, and the print quality and size are unreadable. At age 4, my 2 year old needs visual help to identify parts of his body at play. Maybe it would be OK for an older child with better sight. But don't waste your time or money. Go buy the new version called &#34;Brain Power--Make Sense Of Opposites&#34; instead.
output: Bad review
explanation: Here the review is Bad because it has negative tone as suggested in the product review that the user is disappointed by the product and the output is also Bad review. So this example is positive example

Negative examples:
input: This is a terrific product. It does exactly as advertised and it was much less expensive here than at the store. Easy to attach & adjust both cameras from one DVR. We are buying 4 more of these for our other cameras. It looks like security personnel will now start to see us more often because they know how easy it is. Only drawback I could possibly come up with is that it's so sturdy we wonder if it needs some sort of tether attached to it. But no - it doesn't.
output: Bad review
explanation: Here the review is Good review as there is positive tone in the sentence but it has been output as Bad Review so this example is negative; input: This thing is so cheap that I had to send it back; don't buy. The screen doesn't reflect anything of it's own size on the wall. It has an extremely light blue hue and looks nothing like any normal light fixture. Not even close to as bright or crisp looking in person & obviously very CHEAP made. Just pay a little more for something better. You will be completely satisfied with this product.
output: Good review
explanation: Here the review is Bad review as there is negtvie tone in the sentence but it has been output as Good Review so this example is negative