ceselder/lots-of-loras-task-definitions huggingface dataset:
Task: In this task, you are given two phrases: Head and Tail, separated with <sep>. The Head and the Tail events are short phrases possibly involving participants. The names of specific people have been replaced by generic words (e.g., PersonX, PersonY, PersonZ). PersonX is always the subject of the event. You have to determine whether, as a result of the Head, PersonX will be affected as mentioned in the Tail or not. These effects are social actions that may occur after the Head event. Classify your answers into "Yes" and "No". The phrase may also contain "___", a placeholder that can be an object, a person, and/or an action.
Categories: Commonsense Classification
Domains: Sociology; Commonsense -> Concepts and Relations -> Social Commonsense
Reasoning: Relational Reasoning; Reasoning on Social Interactions; Commonsense Reasoning -> Social Situations

Positive examples:
input: Head: PersonX goes ___ with some friends<sep>Tail: spends too much money
output: Yes
explanation: This is a good example. As a result of the Head, PersonX will spend too much money.; input: Head: PersonX achieves ___ by means<sep>Tail: hardworking
output: No
explanation: In this example, if PersonX achieves something by means, PersonX is not hardworking. So this output is correct.; input: Head: PersonX is allergic to bees<sep>Tail: MUST TAKE CORRESPONDING SAFETY PRECAUTIONS
output: Yes
explanation: If PersonX is allergic to bees, personX must take corresponding safety precautions. Thus, this example should be classified as "Yes".

Negative examples:
input: Head: PersonX asks PersonY to go<sep>Tail: goes somewhere else
output: Yes
explanation: If PersonX asks PersonY to go, PersonX won't go somewhere else. So the output should be "No".; input: Head: PersonX eats red meat<sep>Tail: gets meat stuck in teeth
output: No
explanation: If PersonX eats red meat, the meat will be stuck in PersonX's teeth, and the output should be "Yes".
Task: In this task you will be given a list of numbers and you need to find the mean (average) of that list. The mean of a list can be found by summing every number in the list then dividing the result by the size of that list. The output should be rounded to 3 decimal places.
Categories: Program Execution
Domains: Code -> Repo -> Stack Overflow
Reasoning: Quantitative Reasoning; Numerical Reasoning; Mathematics -> Arithmetic; Mathematics -> Statistics

Positive examples:
input: [1,3,5]
output: 3.000
explanation: The mean of the input list is (1+3+5)/3, which equals 3. This is a good example.; input: [-5,9,16,-20]
output: 0.000
explanation: The input list sums to zero, thus the mean is also equal to zero. This is a good example.; input: [3,17,24]
output: 14.667
explanation: The average is correctly calculated and rounded to 3 decimal places.

Negative examples:
input: [-1,11,-111,1111]
output: 1010.000
explanation: The sum of the list was calculated but was not divided by the number of elements in the list. This is an incorrect output.; input: [2,3,5,7,11]
output: 5.000
explanation: The mean of the input list was not calculated correctly. The correct mean is 5.6. This is an incorrect output.; input: [-1,7,8,9]
output: (-1+7+8+9)/4=5.750
explanation: You should only answer with the final answer, that is the average. Do not include the calculations in your answer.
Task: You are given a question on human sexuality. You are also given 4 answer options (associated with "A", "B", "C", "D"), out of which only one is correct. You need to answer the question by selecting the correct option. You should only answer with the choice letter, not the whole answer.
Categories: Question Answering
Domains: Human Sexuality
Reasoning: Scientific Reasoning

Positive examples:
input: Which of the following are reflexes?
(A)ejaculation (B)erection (C)orgasm (D)both A and B
output: D
explanation: Both ejaculation and erection are reflexes, hence D is the correct option; input: The regions of the body that, when touched, are sexually exciting:
(A)vary from person to person (B)vary for women depending on the phases of the menstrual cycle (C)are mainly on the lower portion of the body (D)all of the above
output: D
explanation: All the options are correct

Negative examples:
input: Which of the following are reflexes?
(A)ejaculation (B)erection (C)orgasm (D)both A and B
output: I dont know.
explanation: Do not generate anything else apart from one of the following characters: 'A', 'B, 'C', 'D'.; input: The regions of the body that, when touched, are sexually exciting:
(A)vary from person to person (B)vary for women depending on the phases of the menstrual cycle (C)are mainly on the lower portion of the body (D)all of the above
output: B,C
explanation: Only one of the following options ('A', 'B', 'C', 'D') is allowed to be the answer. Multiple options can not be correct. The correct answer here would have been 'D'.; input: Which of the following drugs inhibits sexual performance by activating the sympathetic system?
(A)alcohol (B)cocaine (C)marijuana (D)opium
output: C
explanation: Cocaine inhibits sexual performance by activating the sympathetic system. Hence the correct answer should be 'B'.
Task: In this task, you're given a context, a question, three options, and an answer. Your task is to classify whether the given answer is correct or not by providing 'Yes' or 'No', based on the context with commonsense reasoning about social situations.
Categories: Answer Verification
Domains: Commonsense -> Concepts and Relations -> Social Commonsense
Reasoning: Commonsense Reasoning -> Social Situations

Positive examples:
input: Context: Tracy didn't go home that evening and resisted Riley's attacks. 
 Question: What does Tracy need to do before this? 
 Options: (A) make a new plan (B) Go home and see Riley (C) Find somewhere to go 
 Answer: C
output: Yes
explanation: Tracy finds somewhere to go and didn't come home because she has to resist Riley's attacks. So, C is the correct answer.; input: Context: Sydney walked past a homeless woman asking for change but did not have any money they could give to her. Sydney felt bad afterwards. 
 Question: How would you describe Sydney? 
 Options: (A) sympathetic (B) like a person who was unable to help (C) incredulous 
 Answer: A
output: Yes
explanation: Tracy finds somewhere to go and didn't come home because she has to resist Riley's attacks. So, C is the correct answer.; input: Context: Taylor gave help to a friend who was having trouble keeping up with their bills. 
 Question: What will their friend want to do next? 
 Options: (A) help the friend find a higher paying job (B) thank Taylor for the generosity (C) pay some of their late employees 
 Answer: A
output: No
explanation: The friend should thank Taylor for the generosity she showed by helping him pay bills. So, B is the correct answer and output is No.

Negative examples:
input: Context: Tracy's kids wanted ice cream so Aubrey fed the kids ice cream.  
 Question: What does Aubrey need to do before this? 
 Options: (A) tell her kids to say thank you (B) get ice cream (C) thanks Tracy 
 Answer: C
output: Yes, C is correct
explanation: The answer is correct, but it is supposed to only give the options: A, B, or C.; input: Context: Kai improved Jan's picture and she loved how it came out. 
 Question: What will Jan want to do next? 
 Options: (A) wanted to be helpful (B) wanted to Jan to be glad (C) frame the picture 
 Answer: A
output: Correct
explanation: The answer can only be Yes or No.; input: Context: Kendall was watching a friend's dog. Kendall didn't know anything about the dog. 
 Question: How would Kendall feel afterwards? 
 Options: (A) like they are confident they can do it (B) good with animals (C) that they should ask their friend what to do 
 Answer: C
output: C
explanation: The answer can only be Yes or No.
Task: In this task, you are given a piece of an article. Your task is to generate a short summary of the text. Try to give the summary in just one sentence.
Categories: Summarization
Domains: News

Positive examples:
input: Prime Minister Gordon Brown said Monday he had discussed the car industry crisis with German Chancellor Angela Merkel but had not talked about any specific amount of aid for General Motors.
output: Gordon Brown had discussed the car industry crisis with Angela Merkel.
explanation: This summary is appropriate for the given article text as the article is about Gordon Brown and Angela Merkel's talk on car industry crisis.; input: Police have denied fears that emergency response times will increase due to a forthcoming restructure.
output: Police have denied fears response times will increase.
explanation: This article's focus is on Police and fears on increased emergency response times and the summary entails these topics and so it is appropriate.; input: Andrzej Fonfara defeated Glen Johnson with a unanimous decision victory, which was enough to convince Johnson that he should retire from the sport of boxing.
output: Andrzej Fonfara defeated Glen Johnson.
explanation: This article's focus is on fight between Andrzej Fonfara and Glen Johnson and the summary talks about Andrzej Fonfara defeating Glen Johnson. So, it's not appropriate.; input: England manager Fabio Capello is refusing to get carried away with thoughts of qualifying for the 2010 World Cup finals despite watching his side record a fourth successive victory.
output: Fabio Capello is refusing to get carried away.
explanation: This article's focus is on England manager Fabio Capello about qualifying for 2010 World Cup finals, and the summary also talks about Fabio Capello refusing to get carried.

Negative examples:
input: A former Gulf Breeze Police officer is being arrested this morning on sexual battery and unlawful compensation charges, according to Gulf Breeze Deputy Chief of Police Robert Randle.
output: An Abilene teenager was killed early Sunday in a wreck.
explanation: Summary and article text are totally different. Hence, this is not a correct summary.; input: An Abilene teenager was killed early Sunday in a one-car wreck just east of Chapman.
output: Sulieman Benn bowled a marathon, spell.
explanation: This article talks about An Abilene teenager was killed early Sunday in a wreck, and the summary is about Sulieman Benn. Hence this is not a right summary.; input: West Indies spinner Sulieman Benn bowled a marathon, uninterrupted spell of 33 overs on the first day of the first Test against England on Wednesday to dispel many of the question marks over his ability.
output: The screenings identify for stroke vascular disease, and osteoporosis.
explanation: This article talks about West Indies spinner Sulieman Benn and summary is about a screening identifies a disease. So, the summary is wrong.
Task: You are given a context, a pronoun, and a noun in this task. The given pronoun is shown in the context within parentheses. You should determine if the pronoun refers to the given noun or not. Please answer with "True" and "False".
Categories: Coreference Resolution
Domains: Fiction; Books
Reasoning: Commonsense Reasoning

Positive examples:
input: Sam pulled up a chair to the piano , but (it) was broken, so he had to sing instead. <sep> Pronoun:it <sep> Noun: the piano
output: True
explanation: This is a good example. In this context, he had to sing after recognizing it was broken. So, it refers to the piano.; input: Fred covered his eyes with his hands , because the wind was blowing sand around. He lowered (them) when the wind stopped. <sep> Pronoun:them <sep> Noun: his eyes
output: False
explanation: In this example, he lowered his hands when the wind stopped. So, them refer to his hands, and the output should be "False".; input: Our mistress hired a room for my crippled sister Nelly , and she gave (her) knitting and needlework when she was able to do it, and when she was ill she sent her dinners and many nice comfortable things and was like a mother to her. <sep> Pronoun:her <sep> Noun: Nelly
output: True
explanation: In this example, her refers to Nelly. So, the given noun is correct, and the output should be "True".

Negative examples:
input: Jim yelled at Kevin because (he) was so upset. <sep> Pronoun:he <sep> Noun: Kevin
output: True
explanation: In this example, he refers to Jim. So, kevin is incorrect, and the output should be "False".; input: Meanwhile, in the forest, the elephants are calling and hunting high and low for Arthur and Celeste , and their mothers are very worried. Fortunately, in flying over the town, an old marabou bird has seen (them) and come back quickly to tell the news. <sep> Pronoun:them <sep> Noun: Arthur and Celeste
output: False
explanation: In this example, them refer to Arthur and Celeste. So, the output should be "True".
Task: Given Sentence 1 and Sentence 2, indicate your answer as yes when the two sentences clearly agree or clearly disagree with each other. If the relationship cannot be determined, answer with 'no'.
Categories: Textual Entailment
Domains: Miscellaneous
Reasoning: Textual Entailment

Positive examples:
input: A boy in a blue jacket rides a skateboard down the street. <sep> A blue jacketed boy is standing in football field.
output: yes
explanation: This answer is yes because the boy can either be riding or standing but not both. Since the statements disagree, the answer is yes.; input: A large group of people gather at a piano bar. <sep> A group of men at a piano bar
output: no
explanation: This answer is no because we can't assume the gender of people and assume them to be men. Since we can't determine clearly, the answer is no.

Negative examples:
input: There are two young ladies jogging, by the ocean side. <sep> Two women are running late for a meeting.
output: yes
explanation: The answer should be no. Just because the ladies are jogging doesn't mean they are running late for something.; input: A man and a woman are on a seesaw. <sep> Two adults on a seesaw.
output: no
explanation: The answer should be yes. A man and woman can also be called two adults.
Task: You will be given a context and a verb separated with a newline character. You have to decide if the given verb implies a hypothetical or conditioned action or not. We say a verb is hypothetical if it involves or is based on a suggested idea or theory. A verb is conditional if it appears in a conditional phrase and is dependent on something else. Note that an event that happened in the past or is happening now cannot be conditional. The output should be "Yes" if the verb is conditional or hypothetical and "No" otherwise.
Categories: Word Semantics
Domains: News

Positive examples:
input: Some analysts say he appeared to be relying on a smaller and smaller circle of close advisers and relatives. If that's true, the narrowing of his support would make it easier for someone to (push) him aside from within.  
 Verb: push
output: Yes
explanation: This is a good example."Push" is conditional, and the sentence is a conditional sentence.; input: In Washington today, the Federal Aviation Administration (released) air traffic control tapes from the night the TWA Flight eight hundred went down.  
 Verb: released
output: No
explanation: In this sentence, the releasing event happened in the past, and it's not conditional or hypothetical.; input: They were talking when the bomb went off, killing 247 people and wounding more than 5,000 others. On Wednesday, Bushnell and Kimotho met again to (finish) their discussion, Bushnell told Kenya Television.  
 Verb: finish
output: No
explanation: Based on this example, they want to finish their discussion, and "finish" is not conditional. So, it's not conditional or hypothetical.

Negative examples:
input: Reporters also were allowed inside for the first time since the explosion and found broken glass and smashed furniture scattered throughout the embassy. Albright (helped) hang a poster advertising a reward of up to dlrs 2 million for information leading to the bombers' arrest.  
 Verb: helped
output: Yes
explanation: In this sentence, the helping action happened in the past, and it's not conditional or hypothetical.; input: The Miami relatives thus far have refused to sign the document, and in recent days said they would not turn Elian over to his father if he came to the United States. Earlier, they had said they would (give) the boy to Gonzalez if he made the trip.  
 Verb: give
output: No
explanation: In this sentence, "give" happens if he made the trip, so it is conditional.; input: Trustcorp Inc. will (become) Society Bank amp Trust when its merger is completed with Society Corp. of Cleveland, the bank said.  
 Verb: become
output: No
explanation: In this sentence, "become" is conditional. Because it can only happen if its merger is completed.
Task: In this task you should classify the given text as 'violence' if there is inhumanity associated with it. Otherwise, classify it as 'not violence'. Mentioning killing people, or hurting them in any way is considered violent.
Categories: Toxic Language Detection
Domains: Social Media
Reasoning: Commonsense Reasoning -> Social Situations

Positive examples:
input: You look like Japanese and speak like Indian. Both are disgusting go kill yourself
output: violence
explanation: This is a good example because the words kill and disgusting both relate to violence. Thus it is correctly labelled as 'violence'.; input: who gives shit diamonds from the jews fuck them both
output: violence
explanation: This is a good example because the language is related to violence and is hateful. Thus, it is correctly classified.; input: Some people are shit human beings
output: not violence
explanation: The words and language are not violence related and hence this is a good example of correctly classified not violence.

Negative examples:
input: What about a global massacre of men? Dumb only girls
output: not violence
explanation: The word massacre relates to violence and yet it has been mislabelled as non-violent. Therefore, it is a bad example.; input: Watching this kid trying to step up and walk with that crutches is the best thing in the world.
output: violence
explanation: There is no violent language involved in this example and it's mislabelled as violent. Thus, it is a bad example.
Task: You are given a list of queries separated by new line. Your job is to answer with the query that is the most well-formed or well-structured query in terms of grammar, punctuations, or spelling errors.
Categories: Text Quality Evaluation
Domains: Miscellaneous
Reasoning: Grammatical Reasoning

Positive examples:
input: What is the product of transcripition durring gene expression ?
The four main parts of the brain ?
What degrees do you need to become a judge ?
How dieting affects your peformance in sport ?
output: What degrees do you need to become a judge ?
explanation: The output is from the list of given queries and it is formed with no grammatical or spelling errors when compared to other queries; input: You love Emma Watson what can you do to meet her ?
Paul Mccartney net worth ?
Where do hydrilla grows ?
What is on Haiti 's borders ?
output: What is on Haiti 's borders ?
explanation: The output is from the list of given queries and it is formed with no grammatical or spelling errors when compared to other queries; input: Where do hindus orginally live ?
What is frito-lay vision statement ?
What were tipis made off ?
What degrees do you need to become a gallery artist ?
output: What degrees do you need to become a gallery artist ?
explanation: The output is from the list of given queries and it is formed with no grammatical or spelling errors when compared to other queries

Negative examples:
input: What is the product of transcripition durring gene expression ?
The four main parts of the brain ?
What degrees do you need to become a judge ?
How dieting affects your peformance in sport ?
output: What are the degrees one needs to become a judge and where to find it?
explanation: Even though the output has some information of a well formed query it has additional information which is not present in the input; input: You love Emma Watson what can you do to meet her ?
Paul Mccartney net worth ?
Where do hydrilla grows ?
What is on haiti 's borders ?
output: What is plural of tomato ?
explanation: The output does not match to relate to any of the inputs provided in the list
Task: This task involves asking a question, providing a set of 2 options. You are expected to choose the best answer to the question. The output will be in the form of A or B, corresponding to which option is chosen.
Categories: Question Answering
Domains: Web; Wikipedia

Positive examples:
input: Question:Who was the man behind The Chipmunks? ,  Options: [A. David Seville, B. Alvin Seville] 
output: A
explanation: David Seville was the man behind the Chipmunks. So, the correct answer is A.; input: Question:What star sign is Jamie Lee Curtis? ,  Options: [A. Gemini, B. Scorpio] 
output: B
explanation: The star sign of Jamie Lee Curtis is Scorpio.; input: Question: Which Lloyd Webber musical premiered in the US on 10th December 1993? ,  Options: [A. Sunset Boulevard, B. the Phantom of the Opera] 
output: A
explanation: His musical premier in the US was with Sunset Boulevard.; input: Question: The Euro is divided into how many cents? ,  Options:[A. 13000, B. 100] 
output: B
explanation: The Euro is divided into 100 cents.

Negative examples:
input: Question:Who was the man behind The Chipmunks? ,  Options: [A. David Seville, B. Alvin Seville] 
output: B
explanation: David Seville was the man behind the Chipmunks. B is an incorrect answer.; input: Question:What star sign is Jamie Lee Curtis? ,  Options:[A. Gemini, B. Scorpio] 
output: A
explanation: The star sign of Jamie Lee Curtis is Scorpio. This is an incorrect answer.; input: Question: Which Lloyd Webber musical premiered in the US on 10th December 1993?  ,  Options: [A. Sunset Boulevard, B. the Phantom of the Opera] 
output: B
explanation: His musical premier in the US was with Sunset Boulevard. B is an incorrect answer to the question.; input: Question: The Euro is divided into how many cents?  ,  Options:[A. 13000, B. 100] 
output: A
explanation: The Euro is divided into 100 cents. This is an incorrect answer.
Task: Given a sentence, generate a most unlikely next statement. The next statement should not be logically relevant to the given context
Categories: Wrong Candidate Generation
Domains: Captions -> Video Captions

Positive examples:
input: The girls continue to speak with one another while the girl knits. They
output: put the bars around while speaking and play.
explanation: This is incorrect as the girls are not playing, they are knitting.; input: Men are riding motorbikes in a path. People in motorbikes
output: are sitting on a horse.
explanation: This is incorrect since the people cannot be on the motorbikes and on the horse at the same time.

Negative examples:
input: Someone puts his bag back on. He
output: dashes off to work.
explanation: Someone with a bag might go to office. Hence this is not an incorrect next sentence; input: I love eating healthy breakfast. I want
output: to eat only avocado with gluten-free bread.
explanation: A person who is health conscious would like to have avocados in breakfast. Hence this is not an incorrect next statement.
Task: You are given a country name and you need to return the currency of the given country.
Categories: Misc.
Domains: Countries

Positive examples:
input: USA
output: US Dollar
explanation: US Dollar is the currency of USA.; input: India
output: Indian Rupee
explanation: Indian Rupee is the currency of India.

Negative examples:
input: France
output: Pound Sterling
explanation: Currency of France is Franc and not Pound Sterling.; input: Kuwait
output: Dirham
explanation: Currency of Kuwait is Kuwaiti Dinar and not Dirham.