ceselder/lots-of-loras-task-definitions huggingface dataset:
Task: In this task, you're given a context passage, a question, and three answer options. Your task is to return an incorrect answer option to the question from the choices given. For all questions, only one of the three answer options is correct. Pick one of the two incorrect answer options as the output.
Categories: Question Answering
Domains: Commonsense -> Concepts and Relations -> Social Commonsense
Reasoning: Commonsense Reasoning -> Social Situations

Positive examples:
input: Context: Tracy didn't go home that evening and resisted Riley's attacks. 
 Question: What does Tracy need to do before this? 
 Options: (A) make a new plan (B) Go home and see Riley (C) Find somewhere to go
output: B
explanation: Tracy finds somewhere to go and didn't come home because she has to resist Riley's attacks. So, C is the correct answer and B is acceptable as an incorrect answer.; input: Context: Sydney walked past a homeless woman asking for change but did not have any money they could give to her. Sydney felt bad afterwards. 
 Question: How would you describe Sydney? 
 Options: (A) sympathetic (B) like a person who was unable to help (C) incredulous
output: C
explanation: Sydney is a sympathetic person because she felt bad over a person who's in need of help and she can't help her. So, A is the correct answer and C is acceptable as an incorrect answer.; input: Context: Taylor gave help to a friend who was having trouble keeping up with their bills. 
 Question: What will their friend want to do next? 
 Options: (A) help the friend find a higher paying job (B) thank Taylor for the generosity (C) pay some of their late employees
output: A
explanation: The friend should thank Taylor for the generosity she showed by helping him pay bills. So, B is the correct answer and A is acceptable as an incorrect answer.

Negative examples:
input: Context: Tracy's kids wanted ice cream so Aubrey fed the kids ice cream.  
 Question: What does Aubrey need to do before this? 
 Options: (A) tell her kids to say thank you (B) get ice cream (C) thanks Tracy
output: get ice cream
explanation: It is supposed to only return the options which had an incorrect answer: A, B, or C.; input: Context: Kai improved Jan's picture and she loved how it came out. 
 Question: What will Jan want to do next? 
 Options: (A) wanted to be helpful (B) wanted to Jan to be glad (C) frame the picture
output: C
explanation: Now the picture is improved so the next task would be; frame the picture. So, C is the correct answer. But it's supposed to generate an incorrect answer.; input: Context: Kendall was watching a friend's dog. Kendall didn't know anything about the dog. 
 Question: How would Kendall feel afterwards? 
 Options: (A) like they are confident they can do it (B) good with animals (C) that they should ask their friend what to do
output: C
explanation: Kendall is supposed to ask someone how to handle the dog. So, C is the correct answer. But it's supposed to generate an incorrect answer.
Task: You will be given a topic and an argument. Decide the argument's stance towards that topic. The argument's stance is in favor or against the topic. If the argument supports that topic, answer with "in favor"; otherwise, if the argument opposes the topic, answer with "against".
Categories: Stance Detection
Domains: Debatepedia
Reasoning: Argument Reasoning; Textual Entailment -> Deductive Reasoning

Positive examples:
input: topic: Nuclear energy
argument: Nuclear energy can reduce materials available for weapons-use.
output: in favor
explanation: The given argument is in favor of nuclear energy.; input: topic: Smartphones in School
argument:Smartphones often distract students from class.
output: against
explanation: The arguemnt is stating a downside of using smartphones in classes, so it's against smartphones in school.

Negative examples:
input: topic: Kyoto Protocol
argument: It is unimportant for the US to join Kyoto now
output: in favor
explanation: The word uninmportant clearly shows that this argument is against Kyoto Protocol.
Task: In this task, you will be given two sentences separated by ", so". You should decide whether the first sentence can be the cause of the second sentence. If you can see a possible causation, answer with "plausible", otherwise answer with "not plausible".
Categories: Cause Effect Classification
Domains: Commonsense
Reasoning: Causal Reasoning; Textual Entailment

Positive examples:
input: The woman went to the bank, so pigs can fly.
output: not plausible
explanation: Clearly, there can't be a causation relationship between someone going to the bank and pigs flying.; input: The women went to the bank, so now she has money on hand.
output: plausible
explanation: The second sentence can be a result of the first sentence, so the correct answer here is plausible.

Negative examples:
input: The woman went to the bank, so she waited in a line.
output: not plausible
explanation: Although waiting in a line doesn't always come as a result of going to a bank, this is a plausible sentence.; input: The physician misdiagnosed the patient, so he went to the vet
output: plausible
explanation: It is not plausible for someone to go to a vet for a diagnosis.
Task: In this task, you are given a list of integers and an integer k. You need to find the kth largest element in the input list.
Categories: Program Execution
Domains: Mathematics
Reasoning: Reasoning on Numbers

Positive examples:
input: [128, 277, 83, 280, 193, 19, 111, 154, 41, 292, 29, 53, 232, 153, 131, 151, 121, 262, 270, 132], k=15
output: 111
explanation: 111 is the 15th largest element in the list.; input: [126, 44, 101, 199, 228, 169, 85, 286, 167, 207, 175, 259, 141, 27, 35, 153, 185, 21, 198, 188], k=4
output: 207
explanation: 207 is the 4th largest element in the list.

Negative examples:
input: [208, 241, 91, 76, 220, 137, 111, 190, 232, 155, 27, 258, 45, 112, 13, 289, 23, 239, 177, 227], k=8
output: 241
explanation: 241 is not the 8th largest element in the list.; input: [240, 22, 137, 62, 14, 121, 102, 294, 299, 15, 269, 205, 26, 17, 212, 272, 65, 189, 200, 261], k=4
output: 15
explanation: 15 is not the 4th largest element in the list.
Task: In this task, you are given a word, followed by a sentence. You should respond with a valid sentence which contains the word with the same meaning as in the given sentence. For example, if the given sentence refers to a 'fly' as the insect, you should not respond with a sentence which uses 'fly' as the verb. You may use the word in a different tense than is given. For example, you may use the word 'ended' in the output where the given input word is 'end'.
Categories: Sentence Composition
Domains: Miscellaneous

Positive examples:
input: dust 
 Sentence: Another one bites the dust.
output:  The maid used a handkerchief to remove dust off the table.
explanation: In both the input and output sentences, the word 'dust' refers to sand, and therefore the words share the same meaning.; input: airplane 
 Sentence: The passengers went into a frenzy as the airplane lurched sideways.
output: The airplane landed on the runway.
explanation: In both the input and output sentences, airplane is used to refer to the same entity, a vehicle used for aerial transportation.; input: driver 
 Sentence: The driver of the bus took his foot off the brakes.
output: The driver asked the passengers to disembark.
explanation: In both the input and output sentences, the word 'driver' is used for a person who is in charge of driving a vehicle.; input: small 
 Sentence: The kid was too small to be able to board the rollercoaster.
output: Ants are very small creatures.
explanation: In both the input and output sentences, 'small' is used to refer to size.

Negative examples:
input: ruler 
 Sentence: The headmistress struck the table with a ruler.
output: The ruler decided to change taxation laws in his province.
explanation: The word 'ruler' has a different meaning in the input and output sentences. In the input sentence, it refers to a measuring stick, but in the output sentence, it refers one that rules, such as a king. Therefore, the answer is incorrect.; input: project 
 Sentence: Several classmates collaborated on a project.
output: The professor projected a slide onto the screen.
explanation: In the input and output sentences, the word 'project' is used with a different meaning, an undertaking of an activity, and to appear on a surface by the controlled direction of light, respectively. Therefore, the answer is incorrect.; input: sound 
 Sentence: The sound reverberated across the hall.
output: Asleep fell baby sound.
explanation: The output is not a grammatically correct sentence.
Task: In this task, you will be given a sentence. You need to reconize the name of the disorder or disease. Disease is a disorder of structure or function in a human, animal, or plant, especially one that produces specific symptoms or that affects a specific location and is not simply a direct result of physical injury. Although there might be several correct answers, you need to write one of them.
Categories: Named Entity Recognition
Domains: Biology -> Clinical Knowledge; Healthcare

Positive examples:
input: I had been suffering from cardiovascular disorder.
output: cardiovascular disorder
explanation: Here, the person mentions this disorder which is related to heart issues.; input: Acne is the most common skin condition in the United States, affecting up to 50 million Americans annually.
output: Acne
explanation: This is a pretty straightforward remark because it is related to filing taxes with minimal stress and is unrelated to irony or sarcasm.

Negative examples:
input: I had been suffering from cardiovascular disorder
output: disorder
explanation: This is an incomplete disease mention, as it does not clearly mention the actual type of disorder.; input: A 44-year-old man taking naproxen for chronic low back pain and a 20-year-old woman on oxaprozin for rheumatoid arthritis presented with tense bullae and cutaneous fragility on the face and the back of the hands.
output: naproxen
explanation: This is an incorrect tag as this is a mention of a drug, not a disorder.
Task: You are given a sentence, a question and two answer options ('A' and 'B'). Your task is to find the correct answer (return the string of the correct option, not 'A' or 'B') for the given question.
Categories: Question Answering
Domains: Story; Commonsense -> Concepts and Relations
Reasoning: Relational Reasoning

Positive examples:
input: Sentence: Jacob and Benny are squatting at the gym. Jacob has thin frail legs and Benny has big strong legs. Question: Who squats less weight? (A) Jacob (B) Benny
output: Jacob
explanation: Typically, people with thin frail legs squat less weight than people with big strong legs, so the answer is Jacob.; input: Sentence: The fastest land animal on earth, a cheetah was having a 100m race against a rabbit. Question: Which one won the race? (A) the cheetah (B) the rabbit
output: the cheetah
explanation: Since the cheetah is the fastest land animal, it was more likely to win the race, so the answer is the cheetah.

Negative examples:
input: Sentence: Suppose your neighbor John is playing music and your friend Nikos at the end of the street is also playing music. Question: Who's music will appear to be louder? (A) John (B) Nikos
output: Nikos
explanation: Typically, the closer you are to the source of the sound, the louder the sound is. Since John lives closer, his music will appear to be louder. So the correct answer is John.; input: Sentence: The Sun is closer to the Earth then the nearest star. Question: Which object looks bigger to someone standing on the Earth looking up? (A) Sun (B) Star
output: Star
explanation: In general, as an object gets closer, it appears larger. Since the sun is closer to the Earth, it should look bigger to people on the Earth. So the correct answer is Sun.
Task: Given a question, generate a paraphrase of that question wihout changing the meaning of it. Your answer should reword the given sentence, but not add information to it or remove information from it. The answer to your question should be the same as the answer to the original question.
Categories: Question Rewriting
Domains: Web

Positive examples:
input: Question: what places in Africa do people speak french?
output: where in africa do people speak french?
explanation: The generated question means the same as the input question and the answer is the same, so this is a good answer.; input: Question: Hitler became chancellor of Germany in what year?
output: In which year did Hitler become the chancellor of Germany?
explanation: The answer for the generated question and the given question can be given by a single date, and it is a good rewording.; input: Question: mandeville Lousiana zip code?
output: what is the zip code for mandeville Louisiana?
explanation: The rephrased question exactly means the same as the given question.

Negative examples:
input: Question: How long is the Nile river?
output: Is Nile the longest river?
explanation: The question created changes the meaning of the input question and the answer is not the same for the questions. This is not a good answer.; input: Question: Who is the first football player to win seven balon d'ors?
output: Who won the first balon dor?
explanation: The generated question don't mean the same as the original question and the answers are different for each question. This is not a good answer.; input: Question: How Vitamin C helps the human body?
output: Does Vitamin C help the human body?
explanation: The generated question changed the meaning of the given question. This is not a good answer.
Task: In this task, you are given a sentence containing a particular emotion. You must classify the sentence into one of the six emotions: 'joy', 'love', 'anger', 'fear', or 'surprise'.
Categories: Sentiment Analysis
Domains: Narrative
Reasoning: Reasoning on Social Interactions

Positive examples:
input: i am ever feeling nostalgic about the fireplace i will know that it is still on the property
output: love
explanation: The word "nostalgic" could either indicate "love" or "sadness", but the fact that it is still on the property eliminates "love".; input: i am feeling grouchy
output: anger
explanation: The word "grouchy" clearly indicates the emotion "anger".

Negative examples:
input: i feel romantic too
output: joy
explanation: This statement clearly indicates joy, but the joy particularly relates to romance. So, the correct label must be "love" instead.; input: i feel like i have to make the suffering i m seeing mean something
output: love
explanation: Since the author feels that he must find a purpose for the suffering, the sentence has a negative outlook. So, the label should be "sadness" and not "love".
Task: In this task, you are given a question containing a blank (_) and two options. You should pick the best option to answer the question. Please answer with "A" or "B".
Categories: Coreference Resolution
Domains: Commonsense -> Concepts and Relations -> Social Commonsense; Commonsense -> Concepts and Relations -> Physical Commonsense
Reasoning: Commonsense Reasoning

Positive examples:
input: Katrina gave Christine a stuffed animal for their birthday, but _ already had this one. (A) Katrina (B) Christine
output: B
explanation: Since the blank is someone who received the gift and already had a stuffed animal, the answer must be "Christine".; input: Jessy decided to clean the floor but not the furniture, because the _ was dirty. (A) floor (B) furniture
output: A
explanation: The blank is "dirty", which has to be "floor".; input: The man tried to put the beanie inside the drawer but the _ was too small. (A) beanie (B) drawer
output: B
explanation: Since the blank co-appears with "too small", it must be the object that the beanie didn't fit inside it (i.e., "the drawer").; input: The girl took care of her skin with the cream instead of the ointment, because the _ was comfortable. (A) ointment (B) cream
output: B
explanation: Since _ was "comfortable", it must be something that the girl took care of her skin with ("cream").

Negative examples:
input: Ian got into position and punched Lawrence so hard that his mouthpiece flew right out because _ was a quick fighter. (A) Ian (B) Lawrence
output: C
explanation: The issue is that the answer is not one of the options presented in the question which are "A" and "B". Note that, a valid answer must be one of the options.; input: Kevin had to use less sunscreen when at the beach tanning than Justin because _ had less sensitive skin. (A) Kevin (B) Justin
output: (A)
explanation: Here, an additonal parentheses has been added to the answer. Note that, a valid answer must be "A" or "B".; input: John poured the entire bowl of fish into the hot pan on the stove until the _ was empty. (A) bowl (B) pan
output: B
explanation: Here, Since John poured the entire bowl of fish into the hot pan and blank was empty, the answer is "Bowl". So, option B is incorrect.
Task: In this task, you are given a conversation, and your task is to generate a summary from the information present in the given conversation. Generate a summary in such a way that the context should be present in the conversation. It should cover the complete context of the conversation. 
Categories: Summarization
Domains: Dialogue; Commonsense -> Concepts and Relations -> Social Commonsense
Reasoning: Commonsense Reasoning -> Social Situations; Reasoning on Social Interactions

Positive examples:
input:  Lucas: Hey! How was your day?, Demi: Hey there! , Demi: It was pretty fine, actually, thank you!, Demi: I just got promoted! :D, Lucas: Whoa! Great news!, Lucas: Congratulations!, Lucas: Such a success has to be celebrated., Demi: I agree! :D, Demi: Tonight at Death & Co.?, Lucas: Sure!, Lucas: See you there at 10pm?, Demi: Yeah! See you there! :D 
output:  Demi got promoted. She will celebrate that with Lucas at Death & Co at 10 pm. 
explanation:  The summary is concise brief of what Lucas and Demi talked in the conversation. The context is well expressed and no external knowledge is used in generating the summary. So, it's a good summary.; input:  Mary: Hi Mike!, Mike: Hello :), Mary: do u have any plans for tonight?, Mike: I'm going to visit my grandma., Mike: You can go with me., Mike: She likes u very much., Mary: Good idea, i'll buy some chocolate for her. 
output:  Mike and Mary are going to visit Mike's grandma tonight. Mary will buy her some chocolate. 
explanation: The summary is concise brief of what Mary and Mike talked in the conversation. The context is well expressed and no external knowledge is used in generating the summary. So, it's a good summary.

Negative examples:
input:  Laura: ok , I'm done for today-), Laura: let me know once u're free and we come back home together, Kim: hmm.. 7?, Laura: ok, Kim: cool, wait for me at work, I'll call once I get here 
output: Laura will pick up Kim from work around 7, and they will go restaurant together.
explanation: This is an example of a bad summary because the word - restaurant generated in summary is not present in the conversation. Instead create a summary that has the exact context as the conversation given and no external knowledge is used. ; input: Jade: are you going to that trip, Wayne: was, Jade: what do you mean, Wayne: its portponed, Jade: are you kidding me XD, Wayne: im serious, why surprised, Jade: i had to go home and miss it xD, Wayne: oh, cool you can make it when we go, Jade: yea, yesss, Wayne: :D
output: The trip Jade was going to go on was postponed. Now Wayne will be able to go to.
explanation: This is an example of a bad summary because the trip was cancelled for Wayne and not Jade. Context completely changes when generating a summary with wrong names of people. Instead create a summary that has the exact context as the given conversation.
Task: The task is to write a full sentence or two using all of the information given. The sentence(s) will be a brief review of a restaurant. Use all of the information provided.
Categories: Data to Text
Domains: Public Places -> Restaurants; Reviews -> Restaurants

Positive examples:
input: name[xname], cuisine[Fast Food], rating[average], familyFriendly[yes], near[xnear]
output: Located near xnear, xname serves Fast food and is child friendly. its customer rating is: average.
explanation: This is a good example of the task because the written sentence uses all of the given information.; input: name[xname], cuisine[Chinese], price[less than £20]
output: xname, Chinese restaurant,  prices from £19.99
explanation: This is a good example. The output uses all of the given information.; input: name[xname], recommend[yes], cuisine[Vietnamese], qual[good], price[affordable]
output: I would suggest xname because it's affordable and a Vietnamese restaurant with nice food!
explanation: This is another good example because the sentence is a normal sentence that describes the restaurant and contains all of the given information.

Negative examples:
input: name[xname], recommend[yes], decor[good], qual[acceptable], service[good]
output: xname is a restaurant with poor service but acceptable food and good decor.
explanation: This is a bad example because the sentence does not match the given information (service is poor instead of good.) Also it is missing information about whether the restaurant is recommended or not.; input: name[xname], eattype[coffee shop], cuisine[Chinese], price[moderate], location[riverside], near[xnear]
output: xname is a Chinese coffee shop located in riverside near xnear.
explanation: This is a bad example because it does not include the price, thereby missing some information.
Task: In this task, you are given a sentence. You must judge whether a single noun or verb has been replaced with another word with the same part of speech. The inversion would result in the sentence sounding unnatural, So unnatural sentences will be considered changed. Label the instances as "Original" or "Changed" based on your judgment.
Categories: Linguistic Probing
Domains: Narrative; Commonsense -> Concepts and Relations

Positive examples:
input: Gideon brought his phone to his ear and resonated with Bev at HQ .
output: Changed
explanation: "resonated" doesn't fit in this sentence.; input: The frankness of her question startled him for a minute , but this was Nikki , and he really shouldn 't have been surprised .
output: Original
explanation: No word in the sentence has been changed.; input: You could see mountain after mountain and other whales and even the sea .
output: Changed
explanation: "whales" doesn't fit in this sentence.

Negative examples:
input: She started to prolong the basket , and I sat down across from her , folding my knees to my chest .
output: Original
explanation: The word "prolong" doesn't fit in this sentence so the output should be Changed.