ceselder/lots-of-loras-task-definitions huggingface dataset:
Task: In this task, you're given a statement, and three sentences as choices. Your job is to determine which sentence clearly disagrees with the statement. Indicate your answer as '1', '2', or '3' corresponding to the choice number of the selected sentence.
Categories: Textual Entailment
Domains: History; Fiction; Dialogue; Law; Government and Politics
Reasoning: Textual Entailment -> Deductive Reasoning; Commonsense Reasoning

Positive examples:
input: Statement: Next to the MGM Grand you will find M and M World, four stories of merchandise and memorabilia dedicated to the candy that doesn't melt in your hand. Choices: 1. The candy has many fans who love its attractions. 2. There's four stories of memorabilia dedicated to a candy. 3. That particular candy melts and becomes difficult to eat.
output: 3
explanation: It is said in the statement that the candy doesn't melt in your hand, but the sentence in choice 3 disagrees with it.; input: Statment: I've forgotten his name now, confessed Tuppence. Choices: 1. Tuppence forgot his name. 2.Tuppence remembered his name later. 3. Tuppence never could forget his name.
output: 3
explanation: Tuppence had forgotten the name, so choice 3 disagrees with the statement.; input: Statement: One of the first organizational realignments taking place is in the Office of the Taxpayer Advocate. Choices: 1. The office of the taxpayer advocate is the last to be realigned. 2. The realignment is taking place over a few weeks. 3. The office of the taxpayer advocate is having an organizational realignment.
output: 1
explanation: The office realignment is one of the first taking place. The sentence 1 disagrees with the statement.; input: Statement: yeah i tell you what though if you go price some of those tennis shoes i can see why now you know they're getting up in the hundred dollar range. Choices: 1. The tennis shoes have a range of prices. 2. The tennis shoes can be in the hundred dollar range. 3. The tennis shoes are not over hundred dollars.
output: 3
explanation: The shoes' price is defnitely over a hundred dollars.

Negative examples:
input: Statement: In 1994, fraction of households owning a personal computer is 0.25. Choices: 1. In 1994, 0.25 of households owned a PC, which was a high sum at the time. 2. In 1984, 0.8 of households owned a PC. In 1994, 0.25 of households owned a PC.
output: 3
explanation: The choice and statement both clearly fully agree that 0.25 of all households had PCs in 1994, hence choice 3 is incorrect.; input: Statement: You could say you were in an auto accident, and the ambulance driver took you straight to Dr. Famous' office. Choices: 1. Ambulance drivers knew Dr Famous was great for treating famous people. 2. Ambulance drivers just took you to the hospital. 3. Ambulance drivers knew Dr Famous.
output: 1
explanation: It is not clear that Dr. Famous treats famous people though he is known by the ambulance drivers, so the choice neither agrees nor disagrees with the statement and is hence incorrect.
Task: We would like you to assess the QUALITY of each of the following argument (discussing Death Penalty) and determine if the argument is Valid or Invalid. A valid argument is clearly interpretable and either expresses an argument, or a premise or a conclusion that can be used in an argument for the topic of death penalty. An invalid argument is a phrase that cannot be interpreted as an argument or not on the topic of death penalty.
Categories: Text Matching
Domains: Government and Politics

Positive examples:
input: The fact that you do not want to donate to these poor, needy people only shows me that you really do not care about the embryos
output: Invalid
explanation: It is not an argument on the topic of death penalty.; input: Actually we still kill the wrong person all the time
output: Valid
explanation: This argument rejects death penalty by saying we kill the wrong person all the time

Negative examples:
input: Over here it's unlikely that the man would ever find himself in a courtroom except for the purpose of testifying against the guy with the missing ear.
output: Valid
explanation: The answer should be Invalid instead since it is not an argument towards death penalty.
Task: In this task, you're given an input that contains two words, and your task is to predict the correct preposition that connects these two words. Predict the preposition that explicitly conveys both words' meaning, e.g., Word1: king 
 Word2: fort: "king of fort". Possible prepositions are: "of", "on", "in", "for", "from", "about", and "with".
Categories: Preposition Prediction
Domains: Linguistics

Positive examples:
input: Word1: story 
 Word2: pearl
output: of
explanation: The preposition correctly connects two words turning it into the sentence 'story of pearl'.; input: Word1: need 
 Word2: speech
output: for
explanation: The preposition correctly connects two words turning it into the sentence 'need for speech'.; input: Word1: thorn 
 Word2: end
output: on
explanation: The preposition correctly connects two words turning it into the sentence 'thorn on end'.

Negative examples:
input: Word1: city 
 Word2: stone
output: in
explanation: The preposition doesn't connect the sentence correctly. The correct preposition would be 'city on stone'.; input: Word1: part 
 Word2: world
output: part of world
explanation: It correctly connected the sentence. But the output is wrong. It supposed to only generate a preposition.; input: Word1: servant 
 Word2: gate
output: castle
explanation: It suppose to return the preposition that connects two words.
Task: In each example you will read a short sentence (or two). Then, a pronoun in the text is mentioned. Your task is to choose a referent which the mentioned pronoun refers to. You will be given two options in each case and one choice should seem much more likely to you than the other.
Categories: Coreference Resolution
Domains: Dialogue; Narrative

Positive examples:
input: sentence: I couldn't put the saucepan on the rack because it was too tall .pronoun: it. A) the saucepan B) the rack
output: the rack
explanation: If the saucepan couldn't be put on the rack, the rack was probably taller than the person's reach. The pronoun "it" refers to the rack.; input: sentence: Arnold greatly influenced Jackson , though he lived two centuries earlier .pronoun: he. A) jackson B) arnold
output: arnold
explanation: For one person to influence another person, they should leave earlier than them, or contemporary to them. So the pronoun must refer to the influencer, which is Arnold.; input: sentence: cory knocked on dolly's door , but there was no answer . she was out .pronoun: she. A) cory B) dolly
output: dolly
explanation: From the context of the sentence, we know that the sentence "She was out" is resulted from Dolly not answering the door, so the pronoun "she" must refer to dolly.; input: sentence: There are pillars between me and the stages , and I can't see them .pronoun: them. A) the pillars B) the stages
output: the stages
explanation: The pillars are between someone and the stages, so they can probably see the pillars and not the stages.

Negative examples:
input: sentence: Joe and David's uncles can still beat them at tennis , even though they are 30 years younger .pronoun: they. A) joe and david B) joe and david's uncles
output: joe and david's uncles
explanation: There're two clues for resolving this pronoun. First, one's uncle is not usually 30 years younger than them. Second, younger people are usualy better at sports. The expression "even though" shows that there's a certain surprise in the sentence, so the person with better tennis performance should be the older one.; input: sentence: gaston passed the half-empty plate to hershel because he was full .pronoun: he. A) Gaston B) hershel
output: hershel
explanation: The person passing the leftover food must be the one who is full, so in this example "he" must refer to gatson.; input: sentence: The policeman arrested the gang member . He was trying to stop the drug trade in the neighborhood .pronoun: He. A) the police B) the gang member
output: the gang member
explanation: Deciding between a police and a gang member, it makes sense that the police is the one stopping the drug trade, not the gang member.
Task: In this task, you are given a year. You need to check if it is a leap year or not. A year may be a leap year if it is evenly divisible by 4. Years that are divisible by 100 (century years such as 1900 or 2000) cannot be leap years unless they are also divisible by 400. Return 1 if it is a leap year, else return 0.
Categories: Misc.
Domains: Mathematics
Reasoning: Numerical Reasoning; Mathematics -> Arithmetic

Positive examples:
input: 1644
output: 1
explanation: 1644 is a leap year as 1644 is divisible by 4.; input: 2021
output: 0
explanation: 2021 is not a leap year as it is not divisible by 4

Negative examples:
input: 1234
output: 0
explanation: 1234 is a leap year as 1234 is divisible by 4.; input: 1443
output: 1
explanation: 1443 is not a leap year as it is not divisible by 4.
Task: You are given a text of the tweet and a corresponding label whether this tweet is 'Offensive', 'Hate Speech' or 'Neither'. Your job is to identify if the label is correct. Generate label 'true' if it's correct, 'false' otherwise.
Categories: Toxic Language Detection
Domains: Social Media -> Twitter
Reasoning: Reasoning on Social Interactions

Positive examples:
input: Tweet: "@MarkRoundtreeJr: LMFAOOOO I HATE BLACK PEOPLE https://t.co/RNvD2nLCDR" This is why there's black people and niggers
Label: Hate Speech
output: true
explanation: The writer mentions emotions like hating so it is clearly a hate speech.; input: Tweet: "bitch nigga miss me with it"
Label: Offensive
output: true
explanation: The writer uses offensive words like 'bitch' and 'nigga' which is offensive.; input: Tweet: !!! RT @mayasolovely: As a woman you shouldn't complain about cleaning up your house. &amp; as a man you should always take the trash out...
Label: Offensive
output: false
explanation: The writer does not use any hate speech or offensive language. Therefore it should be classified as 'Neither'.

Negative examples:
input: Tweet: "@DomWorldPeace: Baseball season for the win. #Yankees" This is where the love started
Label: Offensive
output: true
explanation: There is no offensive language used here so this is not offensive. Therefore the label should be 'Neither'.; input: Tweet: " fuck no that bitch dont even suck dick " &#128514;&#128514;&#128514; the Kermit videos bout to fuck IG up
Label: Offensive
output: false
explanation: There a lot of offensive words in the tweet. Hence the label should be offensive.
Task: You are given a math word problem and you are supposed to only use subtraction on the numbers embedded in the text to answer the following question and then only report the final numerical answer.
Categories: Question Answering
Domains: Mathematics
Reasoning: Numerical Reasoning; Quantitative Reasoning; Mathematics -> Arithmetic

Positive examples:
input: Context: Sam is 6 feet tall and Alex is 5 feet tall 

 Question: By how many feet is Sam taller than Alex? 
output: 1
explanation:  Sam's height - Alex's height = 6-5 = 1; input: Context: The college is planning a field trip. The college has 102 classrooms. There are 11 students in the college and 99 seats on each college bus. If 8 students don't want to go for the trip 

 Question: How many students are going on the trip?
output: 3
explanation:  Total number of students - who do not want to go = 11-8 =3 ; input: Context: There are 22 different books and 17 different movies in the 'Crazy Silly School' series. If you read 12 of the books and watched 6 of the movies 

 Question: How many more books do you still have to read?
output: 10
explanation: The number of books yet to read is 22 - 12 = 10

Negative examples:
input: Context: A chef had 40 apples and 54 oranges. After making some pies, he has 39 apples left. 

 Question: How many apples did he use?
output: 15
explanation: Total Apples used will be remaining apples subtracted from the total apples = 40-39 = 1, hence answer is 1; input: Context: You have 100 dollars, you spend 45 dollars 

 Question: How many dollars do you have left ?
output: 45
explanation: Money left will be money spect dubtracted from the total money = 100-45 = 55, hence answer is 55
Task: In this task, you are given a country name and you need to return the national dish of the given country. Some countries have multiple national dishes, in which case any one of those dishes will be considered a valid output.
Categories: Misc.
Domains: Countries

Positive examples:
input: Afghanistan
output: Kabuli Palaw
explanation: Kabuli Palaw is the national dish name of the Afghanistan.; input: Algeria
output: Couscous
explanation: Couscous is the national dish name of the Algeria.

Negative examples:
input: Argentina
output: Keshi yena
explanation: Keshi yena is not the national dish name of the Argentina. However, Asado is the national dish name of the Argentina.; input: Azerbaijan
output: Machboos
explanation: Machboos is not the national dish name of the Azerbaijan. However, Dolma is the national dish name of the Azerbaijan.
Task: In this task, you are given two sets, and you need to count the number of elements at the intersection of two given sets.  A Set is shown by two curly braces and comma-separated numbers inside, like {1, 2, 3}. The intersection of two given sets is the largest set which contains all the elements that are common to both sets. To find the intersection of two given sets, A and B is a set consisting of all the elements common to both A and B.
Categories: Program Execution
Domains: Mathematics
Reasoning: Numerical Reasoning; Quantitative Reasoning; Mathematics -> Arithmetic; Mathematics -> Counting

Positive examples:
input: Set1: '{11, 4, 6}', Set2: '{2, 3, 4, 10, 11, 20}'. How many elements are there in the intersection of Set1 and Set2 ?
output: 2
explanation: Intersection of Set1 and Set2 is {11, 4} and it has 2 elements. So, the answer is 2.; input: Set1: '{13, 6, 15}', Set2: '{2, 7, 8, 9, 12}'. How many elements are there in the intersection of Set1 and Set2 ?
output: 0
explanation: Set1 and Set2 have 0 elements in the intersection. So, the answer is 0.

Negative examples:
input: Set1: '{5, 6, 8, 13, 15, 16, 18, 20}', Set2: '{15, 1}'. How many elements are there in the intersection of Set1 and Set2 ?
output: 2
explanation: The intersection of Set2 and Set2 is {15}. So, the answer should have been 1 instead of 2.
Task: This task is about generating an incorrect answer to a question given the question and a true statement related to the question. The answer must be related to the question, but incorrectly answer it given the context.
Categories: Wrong Candidate Generation
Domains: Natural Science -> School Science Textbooks

Positive examples:
input: Fact: deep sea animals live deep in the ocean. Question: Frilled sharks and angler fish live far beneath the surface of the ocean, which is why they are known as?
output: Far Sea Animals
explanation: This is an incorrect answer that is related to the question. This is a good output.; input: Fact: as an object moves , the kinetic energy of that object will increase. Question: An example of lots kinetic energy would be?
output: sitting without moving anywhere
explanation: This is an incorrect answer that is related to the question. This is a good output.

Negative examples:
input: Fact: water is often brackish in an estuary. Question: Brackish water is often found where?
output: several large rivers meet
explanation: The answer is one that can correctly answer the question. The task asks for three incorrect answer. This is not a good output.; input: Fact: if a liquid disappears then that liquid probably evaporated. Question: Evaporation is the reason that?
output: a rain puddle is suddenly gone
explanation: The answer is one that can correctly answer the question. The task asks for three incorrect answer. This is not a good output.
Task: The task is about reading the given context, group and MCQs and then generating answers from the given input. MCQs are multiple choice questions in which a question is asked and few options are given, among which one or in some cases more than one can be the answer.
Categories: Question Generation
Domains: Commonsense -> Concepts and Relations
Reasoning: Commonsense Reasoning

Positive examples:
input: context: A person is trying to stack flowers, eggs, balls, and books.<sep>group: stacking <sep>question: Which is the easiest to stack?<sep>A: flowers<sep>B: eggs<sep>C: balls<sep>D: books
output: Books are the easiest to stack.
explanation: The answer relates to stacking which is mentioned in the group in the input.; input: context: A person is trying to roll a microwave, a block, a mirror, and an apple.<sep>group: rolling <sep>question: Which is the easiest to roll?<sep>A: microwave<sep>B: block<sep>C: mirror<sep>D: apple
output: Apple is the easiest to roll.
explanation: The answer relates to rolling which is mentioned in the group in the input.

Negative examples:
input: context: A person is trying to stack flowers, eggs, balls, and books.<sep>group: stacking <sep>question: Which is the easiest to stack?<sep>A: flowers<sep>B: eggs<sep>C: balls<sep>D: books
output: Blocks are the easiest to stack.
explanation: The answer is a choice that is not part of options provided in the input.; input: context: A person is trying to roll a microwave, a block, a mirror, and an apple.<sep>group: rolling <sep>question: Which is the easiest to roll?<sep>A: microwave<sep>B: block<sep>C: mirror<sep>D: apple
output: Apple is the easiest to stack.
explanation: The answer doesn't relate to rolling which is given in the input.
Task: In this task, you are given two phrases: Head and Tail, separated with <sep>. The Head and the Tail events are short phrases possibly involving participants. The names of specific people have been replaced by generic words (e.g., PersonX, PersonY, PersonZ). PersonX is always the subject of the event. You have to determine whether the Head is used for the Tail or not. The usage describes everyday affordances or uses of objects and includes both typical and atypical uses. For example, a popcorn bucket can typically be used to hold popcorn, but it could also serve as a hat in atypical situations. Classify your answers into "Yes" and "No". The phrase may also contain "___", a placeholder that can be an object, a person, and/or an action.
Categories: Commonsense Classification
Domains: Sociology; Commonsense -> Concepts and Relations -> Physical Commonsense; Commonsense -> Concepts and Relations -> Social Commonsense
Reasoning: Relational Reasoning; Reasoning on Social Interactions; Commonsense Reasoning -> Social Situations; Reasoning on Objects

Positive examples:
input: Head: basket<sep>Tail: carry laundry
output: Yes
explanation: This is a good example. The basket is used for carrying the laundry.; input: Head: PersonX always wore<sep>Tail: hangs item up
output: No
explanation: In this example, the Head is not something that can be used for hanging items. So the output should be "No".; input: Head: floor mats<sep>Tail: wipe off one's boots
output: Yes
explanation: In this example, the Head is used for the Tail. Thus, this example should be classified as "Yes".

Negative examples:
input: Head: PersonX accepts god 's ___<sep>Tail: to continue to follow God
output: Yes
explanation: In this example, the Head is not something that can be used to continue to follow God. So the output should be "No".; input: Head: credentials<sep>Tail: prove something
output: No
explanation: The credentials  can be used for proving something, and the output should be "Yes".
Task: You are given a set of queries separated by '
', and your job is to find out the query which is not a well-formed or well-structured query in terms of grammar, punctuations, or spelling errors.
Categories: Text Quality Evaluation
Domains: Miscellaneous
Reasoning: Grammatical Reasoning

Positive examples:
input: How many miles is 43560 ?
What is the national currency of Albania ?
What is the status of the draft today in US ?
Where is the oil plug in a 2004 Harley ?
output: How many miles is 43560 ?
explanation: The output is from the list of given queries and it is not well structured and has grammatical errors when compared to other queries; input: Where do the pygmy people live ?
How much does a forensic psychologist earn weekly ?
University of paris also called ?
What qualifications do you need to be an actuary ?
output: University of paris also called ?
explanation: The output is from the list of given queries and it does not begin with an interrogative word. So the query is not well structured; input: What is the value of 1924 silver dime ?
What landmarks are in cuba ?
How do you install a water pump on a 2000 Dodge Durango 5.9 V8 ?
Where is Lisa Fry ?
output: What is the value of 1924 silver dime ?
explanation: The output is from the list of given queries and it is not well structured and has grammatical errors when compared to other queries

Negative examples:
input: How many miles is 43560 ?
What is the national currency of Albania ?
What is the status of the draft today in US ?
Where is the oil plug in a 2004 Harley ?
output: Convert 43560 into kilometers?
explanation: The output is well structured and does not match with any inputs provided; input: Where do the pygmy people live ?
How much does a forensic psychologist earn weekly ?
University of paris also called ?
What qualifications do you need to be an actuary ?
output: 7 What comprises a serosa ?
explanation: The output does not match any queries provided in the input. So this is not a valid output