ceselder/lots-of-loras-task-definitions huggingface dataset:
Task: In this task, you are given two strings A,B. You must perform the following operations to generate the required output list: (i) Find the longest common substring in the strings A and B, (ii) Convert this substring to all lowercase and sort it alphabetically, (iii) Replace the substring at its respective positions in the two lists with the updated substring.
Categories: Program Execution
Domains: Mathematics

Positive examples:
input: bYubMFxyTqR, AcDbMFxSnI
output: bYubfmxyTqR, AcDbfmxSnI
explanation: Here, 'bMFx' is the longest common substring in both the input strings 'bYubMFxyTqR' and 'AcDbMFxSnI'. Sorting it and converting to lowercase gives 'bfmx'. Replacing 'bfmx' instead of 'bMFx' in the two strings gives 'bYubfmxyTqR' and 'AcDbfmxSnI'; input: yNLUJYShBvstaHNAPzywb, gMTNCYShBvstaLHeEzICc
output: yNLUJabhsstvyHNAPzywb, gMTNCabhsstvyLHeEzICc
explanation: Here, 'YShBvsta' is the longest common substring in both the input strings 'yNLUJYShBvstaHNAPzywb' and 'gMTNCYShBvstaLHeEzICc'. Sorting it and converting to lowercase gives 'abhsstvy'. Replacing 'abhsstvy' instead of 'YShBvsta' in the two strings gives 'yNLUJabhsstvyHNAPzywb' and 'gMTNCabhsstvyLHeEzICc'

Negative examples:
input: myzKDM, VuzKKG
output: myzkDM, VukzkG
explanation: Here, the answer should have been 'mykzDM, VukzKG'. Since 'zK'  is the longest common substring in both the input strings 'myzKDM' and 'VuzKKG', sorting it and converting it to lowercase gives 'kz', and replacing 'kz' instead of 'zK' in both the siring gives 'mykzDM, VukzKG'.; input: zBTWVF, bcTWTE
output: zbtwvf, bctwte
explanation: Here, the answer should have been 'zBtwVF, bctwTE'. Since 'TW'  is the longest common substring in both the input strings 'zBtwVF' and 'bctwTE', sorting it and converting it to lowercase gives 'tw', and replacing 'tw' instead of 'TW' in both the siring gives 'zbtwvf, bctwte'.
Task: Given a pair of words, deduce the type of relationship between them. The various types of relations are: 'Entails, HasProperty, Synonym, Antonym, HasA, MemberOf, PartOf, MadeOf, IsA'. Let's denote the first word by X and the second word by Y. An 'IsA' relation holds when 'X is a kind of Y'. An 'Antonym' relation holds when 'X can be used as the opposite of Y'. A 'Synonym' relation applies when 'X can be used in place of Y, without changing the meaning'. A 'PartOf' relation holds when 'X is a part of Y'. A 'MemberOf' relation holds when 'X is a member of Y'. A 'MadeOf' relation holds when 'X is made of Y'. An 'Entailment' relation holds when 'If X is true, then Y is true as well'. A 'HasA' relation holds when 'X can have or contain Y'. A 'HasProperty' relation holds when 'Y is to specify X'.
Categories: Word Relation Classification
Domains: Commonsense
Reasoning: Commonsense Reasoning

Positive examples:
input: X: balance, Y: scale
output: IsA
explanation: Balance is a kind of scale.; input: X: big, Y: small
output: Antonym
explanation: Big can be used as the opposite of small.; input: X: bird, Y: feather
output: HasProperty
explanation: Birds have feathers.; input: X: bloom, Y: flower
output: Synonym
explanation: Bloom and flower can mean the same thing. E.g. the roses bloomed or the roses flowered.; input: X: cake, Y: egg
output: HasA
explanation: A cake can have or can contain eggs.; input: X: cannon, Y: tank
output: PartOf
explanation: A cannon is a part of a tank.; input: X: dog, Y: hair
output: MadeOf
explanation: A dog is made of hair (among other things).; input: X: tribe, Y: family
output: MemberOf
explanation: A tribe is a member of family.; input: X: write, Y: spell
output: Entails
explanation: If write is true then also spell is true.

Negative examples:
input: X: balance, Y: scale
output: HasA
explanation: The label is incorrect because, balance is a kind of scale, but doesn't have a scale.; input: X: big, Y: small
output: Synonym
explanation: Big can be used as the opposite of small so the label of Synonym is incorrect.; input: X: bird, Y: feather
output: PartOf
explanation: Incorrect because bird is not a part of feather.; input: X: bloom, Y: flower
output: Antonym
explanation: The label is incorrect as bloom and flower can be used in the same sense and hence are synonyms.; input: X: cake, Y: egg
output: IsA
explanation: The label is incorrect as a cake is not an egg.; input: X: cannon, Y: tank
output: MadeOf
explanation: Incorrect because a cannon is not made of a tank.; input: X: write, Y: speak
output: Entails
explanation: Incorrect because even when write is true, speak might not be true.; input: X: tribe, Y: country
output: MemberOf
explanation: incorrect as tribe is not a member of country.; input: X: write, Y: read
output: HasProperty
explanation: Incorrect because write is neither characterized by nor does is it have read as a property.
Task: In this task, you are given a public comment from online platforms. You are expected to classify the comment into two classes: sexual-explicit and non-sexual-explicit. A comment is considered sexual-explicit if it explicitly portrays sexual matters.
Categories: Toxic Language Detection
Domains: Social Media

Positive examples:
input: Comment: President lied under oath about consensual sex...
Not the same thing as rape.
output: Sexual-explicit
explanation: This comment explicitly mentions "consensual sex" and "rape", and thus is sexual-explicit.; input: Comment: Yea its your pals choppin heads off. Take em all and leave my country
output: Non-sexual-explicit
explanation: This comment might be toxic but does not portray sexual matters.

Negative examples:
input: Comment: It's horrible, isn't it?  It had blood coming out of its eyes.  Blood coming out of its wherever.  Terrible.
output: Sexual-explicit
explanation: The comment is violent but does not portray sexual matters.; input: Comment: Two words: ass holes
output: Non-sexual-explicit
explanation: This comment contains explicit language of sexual matters and should be considered sexual-explicit, althought the intent of the comment might differ.
Task: In this task, you need to reverse all words of a given length in the sentence. The number of letters in a word determine its length. For example, the length of the word "apple" is 5.
Categories: Program Execution
Domains: Captions -> Image Captions
Reasoning: Mathematics -> Counting

Positive examples:
input: Sentence: 'as a guy jumps over the snow with his snowboard people riding on the lift behind him look on'. Reverse all words of length '6' in the given sentence.
output: as a guy jumps over the snow with his snowboard elpoep gnidir on the lift dniheb him look on
explanation: Words 'people', 'riding', 'behind' are of length 6. Reversing these words results in 'elpoep', 'gnidir', and 'dniheb' respectively. So this is a correct answer.; input: Sentence: 'a man skis down a snowy hill wearing a blue hat and jacket'. Reverse all words of length '5' in the given sentence.
output: a man skis down a ywons hill wearing a blue hat and jacket
explanation: The word 'snowy' is of length 5. Reverse of 'snowy' is 'ywons', So, the answer is correct.

Negative examples:
input: Sentence: 'people are flying kites on the beach on a hazy day'. Reverse all words of length '1' in the given sentence.
output: people era flying kites on the beach on a hazy day
explanation: The word 'a' is length 1 and reverse of it 'a'. In the output, the word 'are' is reversed even though it is of length 3. So, the answer should have been 'people are flying kites on the beach on a hazy day'.; input: Sentence: 'an old run down truck that is rusted and parked in a grassy area'. Reverse all words of length '2' in the given sentence.
output: in old run down truck that is rusted and parked an a grassy area
explanation: You should not reverse the order of the specified words. You should keep them in their order in the sentence and reverse the order of their letters.; input: Sentence: 'the quick brown fox'. Reverse all words of length '2' in the given sentence.
output: hte uqick rbown ofx
explanation: In the output, two first two characters have been reversed from every word, instead of reversing words of length 2. So, the output should have been 'the quick brown fox'.
Task: Given a sentence, judge the quality of this sentence by indicating "Good" and "Bad". The quality depends on the grammar and the meaning of the sentence. If a sentence is easily understandable, and doesn't have grammatical errors, answer with "Good", otherwise answer with "Bad".
Categories: Text Quality Evaluation
Domains: News; Dialogue; Miscellaneous

Positive examples:
input: Except for this small vocal minority, we have just not  from members, " says APA president Philip G. Zimbardo of Stanford University.
output: Bad
explanation: The language in this provided text is very poor without correct meaning and incorrect grammar. There's a word missing between "not" and "from".; input: Date with destiny: After Vanderbilt opens with Georgia Tech, the Commodores will play host to Furman, which is Johnson's former team and a Division I-AA powerhouse.
output: Good
explanation: The language used in this text is grammatically correct, meaningful and error-free.

Negative examples:
input: Clarke and to provide evidence reinforcing the case against al Qaeda.
output: Good
explanation: There's no noun after "and", making this a sentence with incorrect grammar. So the correct output is "Bad".; input: Date with destiny: After Vanderbilt opens with Georgia Tech, the Commodores will play host to Furman, which is Johnson's former team and a Division I-AA powerhouse.
output: Good Grammar
explanation: You should only answer with one word: "Bad" or "Good".
Task: In this task, you are given a sentence. You are expected to recognize the name of any form of chemical substances. Although there might be several correct answers, you need to write one of them.
Categories: Named Entity Recognition
Domains: Chemistry

Positive examples:
input: Inhibition of the human ether-a-go-go-related gene (HERG) potassium channel by cisapride: affinity for open and inactivated states. 
output: potassium
explanation:  Potassium is a type of electrolyte mineral that helps our nerves to function and muscles to contract. Hence, it should be tagged as chemical.; input: Identification of amino acids in the factor XI apple 3 domain required for activation of factor IX.
output: amino acids
explanation: Amino acids are organic compounds that contain amino and carboxylate functional groups. They are the precursor of protein. Hence, it should be categorized as chemical.

Negative examples:
input: Inhibition of the human ether-a-go-go-related gene (HERG) potassium channel by cisapride: affinity for open and inactivated states. 
output: potassium channel by cisapride
explanation: The entire mention does not convey a concrete information about any chemical substance. Hence, it should not be tagged like this.; input: Identification of amino acids in the factor XI apple 3 domain required for activation of factor IX.
output: factor IX
explanation: factor IX is a protein name, hence should not be considered as chemical.
Task: In this task, you are given a short story consisting of exactly 5 sentences where the second sentence is missing. You are given two options and you need to select the one that best connects the first sentence with the rest of the story. Indicate your answer by 'Option 1' if the first option is correct, otherwise 'Option 2'. The incorrect option will change the subsequent storyline, so that at least one of the three subsequent sentences is no longer consistent with the story.
Categories: Coherence Classification
Domains: Commonsense -> Stories
Reasoning: Temporal Reasoning; Commonsense Reasoning

Positive examples:
input: Sentence 1: The cashier was counting the dollar bills at her desk. 
 Sentence 3: Everyone panicked and started to scream. 
  Sentence 4: The men threatened the people to remain quiet. 
 Sentence 5: The cashier handed them the cash so they would go away.  
 Option 1:  Two men rushed into the store and held their guns up. 
 Option 2: Two dogs rushed into the store.
output: Option 1
explanation: Option 1 forms a consistent story with the given four sentences. In constrast, Option 2 is incorrect as the entty 'two dogs' is not consistent with 'men' mentioned in Sentence 4.; input: Sentence 1: The cashier was counting the dollar bills at her desk. 
 Sentence 3: Everyone panicked and started to scream. 
  Sentence 4: The men threatened the people to remain quiet. 
 Sentence 5: The cashier handed them the cash so they would go away.  
 Option 1:  Three men rushed into the store and held their guns up. 
 Option 2: Two men rushed into the hospital.
output: Option 1
explanation: Option 1 forms a consistent story with the given four sentences. In constrast, Option 2 is incorrect as it is not consisitent with sentence 1 ('store cashier' vs 'hospital').

Negative examples:
input: Sentence 1: The cashier was counting the dollar bills at her desk. 
 Sentence 3: Everyone panicked and started to scream. 
  Sentence 4: The men threatened the people to remain quiet. 
 Sentence 5: The cashier handed them the cash so they would go away.  
 Option 1:  Two men rushed into the store and held their guns up. 
 Option 2: Two dogs rushed into the store.
output: Two men rushed into the store and held their guns up.
explanation: The selected option is correct but it outputed the entire option text instead of its label i.e 'Option 1'.
Task: In this task, you're given reviews from Amazon's products. Your task is to generate the Summary of the review.
Categories: Summarization
Domains: Reviews
Reasoning: Reasoning on Social Interactions

Positive examples:
input: My cat won't touch these. My dog, however, chews them and makes a mess all over the carpet and I can't get the shredded sticks out! Messy. Waste of money!
output: Cat hates them
explanation: It's a correct summary because the owner's cat hated the product.; input: In the process of returning. The sizing is way off. Looks gorgeous but didn't fit.
output: Sizing is not accurate
explanation: It's a correct summary because the size didn't fit the user.; input: Amazon is not helping at all. They sent me an image of the delivered package, it's not even my address. This is the 3rd time that my package has been delivered to the wrong address. I'm curious how the delivery driver can take a picture of the delivery at the wrong address, identified in the photos, and Amazon's only solution is to refund my $$. What is the purpose of being a Prime Member when they can't do the simple things correct?
output: Can't tell you about the product since it was delivered to the wrong address
explanation: The delivery driver deliver it to wrong address. So, it's a correct summary.

Negative examples:
input: The design is good, but the build is disappointing. I used these one time, and they are falling apart. The long handles are all detached and the mesh started detaching from the handle.
output: Not falling apart!
explanation: It's an incorrect summary because according to the User's review the design falls apart after one time use.; input: These were listed as size regular. When I open them they were size regular to large. Way too big for me. I tried to return them and there is a no return policy for these items. Money wasted.
output: Size is clear
explanation: It's not a correct size because user didn't get their size. So it's an incorrect summary.; input: Did not hold up for even one month of play at our club. Fiberboard under attractive painting so did not withstand being left outside. Fell apart.
output: Negative
explanation: It's supposed to generate the summary of review, not polarity.
Task: In this task you will be given two dialogues. You need to determine if both dialogues have the same underlying emotion. The possible emotions are happy, sad, angry, or other. If they do output 'yes', if not output 'no'.
Categories: Sentiment Analysis
Domains: Dialogue

Positive examples:
input: Dialogue 1: 'when did i called u ugly pony when did you ever call fuck u ur rlly a mad person asshole rnda bc'. Dialogue 2: 'go to dhapar math do sl maths a lot of places don't like maths studies it's amazing'.
output: no
explanation: The first dialogue is an angry dialogue and the second dialogue is a happy dialogue. Therefore, they are not the same emotion so the output is 'no'. So this is a good example.; input: Dialogue 1: 'how are you today hello my friend i a m fine thank you how are you very good'. Dialogue 2: 'ai is not working properly maybe reseat the connector otherwise it's new keyboard time i'm talking about you baby your ai is not working properly'.
output: yes
explanation: Neither of the dialogues are happy, sad, or angry. Therefore, they are both the 'other' emotion and the answer is 'yes'. So this is a good example.; input: Dialogue 1: 'my exam went too bad todaydisappointedface which exam maths'. Dialogue 2: 'and what happens if that peraon is forced not to be there with you it is sad but this is the reality  this kinda hurts but the point is i love her soo much and i don't want to loose her'.
output: yes
explanation: Both of the dialogues display a sad emotion. There, the answer is yes. So this is a good example.

Negative examples:
input: Dialogue 1: 'what is timing on there 1030pm to 630ambecause of these reasonschoose for yourself tell plz'. Dialogue 2: 'i am getting angry well im always angry so join the club which club'.
output: yes
explanation: The emotion in the first dialogue is not happy, sad, or angry so it is an 'other' emotion. The second dialogue is an angry dialogue. The output should have been 'no' because the emotions do not match. So this is a bad example.; input: Dialogue 1: 'sleeping or standing what is standing opt out'. Dialogue 2: 'for un now the tune is stuck in my mind bleddy poutingcatface that u r sexy'.
output: no
explanation: Both of the dialogues are the 'other' emotion because they are not happy, sad, or angry. Therefore, the answer should have been 'yes'. So this is a bad example.
Task: We would like you to classify each of the following sets of argument pairs (discussing Death Penalty)  into either SIMILAR or NOT SIMILAR. A pair of arguments is considered SIMILAR if the arguments are about the same FACET (making the same argument), and is considered NOT SIMILAR if they do not have the same FACET. A FACET is a low level issue that often reoccurs in many arguments in support of the author's stance or in attacking the other author's position.
Categories: Text Matching
Domains: Government and Politics

Positive examples:
input: Sent1: Therefore, people will think twice before they choose to commit a crime and also, the death penalty has been proven to deter the crime rate. 
 Sent2: i think the death penalty should be abolished because some people are sentenced to deathfor a crime they might have not committed.
output: Not similar
explanation: The two arguments are talking about totally different things. The first one says we should have death penaly since it can deter the crime rate, and the second says we should abolish death penalty since people may not have committed the crime they are accused of.; input: Sent1: Death penalty cases involve a lot of appeals and the lawyers are really expensive. 
 Sent2: Death penalty cases cost way more because they usual go through a series of costly appeals.
output: Similar
explanation: These two are considered similar arguments because they are both talking about the cost of death penalty cases.

Negative examples:
input: Sent1: The death penalty has never been shown to be a deterent to murder. 
 Sent2: In addition, it is evident that the death penalty does not deter murder rates.
output: Not similar
explanation: The answer should be Similar instead since both arguments are discussing how death penalty can not deter murder rates.
Task: The task is to read a passage and convert numbers in their text forms into digit forms. The text numbers can be used to represent Quantity, Dates and Time, Addresses or Positions.
Categories: Number Conversion
Domains: Books

Positive examples:
input: Jacob ate three burgers today.
output: Jacob ate 3 burgers today.
explanation: The number in text form three is converted into the number in digit form 3.; input: The Great Depression happened in eighteen twenty one.
output: The Great Depression happened in 1821.
explanation: The year eighteen twenty one is converted into its digit form 1821.

Negative examples:
input: My grandfather is sixty seven years old.
output: My grandfather is 60 7 years old.
explanation: The number was translated into two numbers in digits instead of a single number.; input: Marie placed sixty fifth in class.
output: Marie placed 123rd in class.
explanation: The digits are different from the original number in the input.
Task: In this task, you are given a sentence with a missing word that can be an object, a person, and/or an action. Fill in the blank with a plausible word. Although each sentence has many correct answers, you only have to write one answer.
Categories: Fill in The Blank
Domains: Sociology; Commonsense -> Concepts and Relations -> Physical Commonsense; Commonsense -> Concepts and Relations -> Social Commonsense
Reasoning: Relational Reasoning; Reasoning on Social Interactions; Commonsense Reasoning -> Social Situations; Reasoning on Objects

Positive examples:
input: PersonX sees ___ in the wild
output: tiger
explanation: This is a good example. The output is a correct answer for this question.; input: PersonX spends ___ listening
output: money
explanation: In this example, spending money is a correct answer.; input: PersonX animates every ___
output: Cell
explanation: This is a good example, and the answer is correct.

Negative examples:
input: PersonX spends ___ listening
output: Bag
explanation: In this example, spending bag doesn't make sense. So this answer is not acceptable.; input: PersonX sees ___ in the wild
output: clock
explanation: In this example, seeing a clock in the wild is not reasonable.
Task: In this task, you need to count the number of words in a sentence that start with the given letter. Answer with numbers and not words.
Categories: Program Execution
Domains: Captions -> Image Captions
Reasoning: Numerical Reasoning; Mathematics -> Counting

Positive examples:
input: Sentence: 'a hot dog in a bun with ketchup on a plate with french fries'. How many words start with the letter 'a' in the sentence.
output: 3
explanation: The word 'a' is the only word that starts with 'a'. This sentence has 3 occurrences of the word 'a'. So, the answer is 3.; input: Sentence: 'different images of computer accessories such as mice and keyboard'. How many words start with the letter 'k' in the sentence.
output: 1
explanation: The word 'keyboard' is the only word that starts with 'k'. So, the answer is 1.

Negative examples:
input: Sentence: 'two children are playing with kites on the grass'. How many words start with the letter 't' in the sentence.
output: 3
explanation: The words 'two', and 'the' start with 't'. So, the answer should have been 2 and not 3.; input: Sentence: 'a young girl wearing a pink hat holding a frisbee'. How many words start with the letter 'h' in the sentence.
output: two
explanation: You should answer with numbers, i.e. the correct answer is "2" and not "two".