ceselder/lots-of-loras-task-definitions huggingface dataset:
Task: You are given a question on sociology. You are also given 4 answer options (associated with "A", "B", "C", "D"), out of which only one is correct. You need to answer the question by selecting the correct option. You should only answer with the choice letter, not the whole answer.
Categories: Question Answering
Domains: Sociology
Reasoning: Scientific Reasoning

Positive examples:
input: Mass-society theory suggests that:
(A)the content of the media is determined by market forces (B)the subordinate classes are dominated by the ideology of the ruling class (C)the media manipulate 'the masses' as vulnerable, passive consumers (D)audiences make selective interpretations of media messages
output: C
explanation: Mass-society theory suggests that the media manipulate 'the masses' as vulnerable, passive consumers; input: The ecological approach to urban sociology involved studying:
(A)how social groups colonized different areas of the city and competed for resources (B)the forms of wildlife and natural habitats that could be found on the edges of the city (C)the way in which people organized collective protests about environmental issues (D)how men and women used the city's public spaces differently
output: A
explanation: The ecological approach to urban sociology involved studying how social groups colonized different areas of the city and competed for resources

Negative examples:
input: Mass-society theory suggests that:
(A)the content of the media is determined by market forces (B)the subordinate classes are dominated by the ideology of the ruling class (C)the media manipulate 'the masses' as vulnerable, passive consumers (D)audiences make selective interpretations of media messages
output: I dont know.
explanation: Do not generate anything else apart from one of the following characters: 'A', 'B, 'C', 'D'.; input: The ecological approach to urban sociology involved studying:
(A)how social groups colonized different areas of the city and competed for resources (B)the forms of wildlife and natural habitats that could be found on the edges of the city (C)the way in which people organized collective protests about environmental issues (D)how men and women used the city's public spaces differently
output: B,C
explanation: Only one of the following options ('A', 'B', 'C', 'D') is allowed to be the answer. Multiple options can not be correct. The correct answer here would have been 'A'.; input: A social stratum is:
(A)a level in the social hierarchy, comprising people with shared life chances (B)a methodological tool used to identify a person's social class (C)the boundary between two levels of the social hierarchy (D)a symbol of status, used to differentiate between social classes
output: D
explanation: A social stratum is a level in the social hierarchy, comprising people with shared life chances. Hence the correct answer should be 'A'.
Task: In this task, you're given a review from Amazon's food products. Your task is to generate a rating for the product on a scale of 1-5 based on the review. The rating means 1: extremely poor, 2: poor, 3: neutral or mixed, 4: good, 5: extremely good. 
Categories: Sentiment Analysis
Domains: Reviews -> Food

Positive examples:
input: I have bought several of the Vitality canned dog food products and have found them all to be of good quality. The product looks more like a stew than a processed meat and it smells better. My Labrador is finicky and she appreciates this product better than  most.
output: 5
explanation: The user really seem very satisfied with the product and gave good review worthy of 5 stars rating.; input: Product arrived labeled as Jumbo Salted Peanuts...the peanuts were actually small sized unsalted. Not sure if this was an error or if the vendor intended to represent the product as "Jumbo".
output: 1
explanation: The customer seemed disappointed with the product he received. He really seems very unsatisfied that he didn't get what he was shown in the description. So he gave 1 star.; input: This seems a little more wholesome than some of the supermarket brands, but it is somewhat mushy and doesn't have quite as much flavor either.  It didn't pass muster with my kids, so I probably won't buy it again.
output: 3
explanation: The customer seems very neutral to the product where he finds it wholesome and also didn't get the flavor he expected.

Negative examples:
input: My daughter loves twizzlers and this shipment of six pounds really hit the spot. It's exactly what you would expect...six packages of strawberry twizzlers.
output: Positive
explanation: It's supposed to generate if the rating is out of 5.; input: I ordered this product for a themed baby shower. They went over well and they tasted just like normal cracker jacks. Loved that I could find the box and they fit perfect in favor bags.
output: 1
explanation: The customer is happy with the product so they can't give it 1 star.; input: My cats have been happily eating Felidae Platinum for more than two years. I just got a new bag and the shape of the food is different. They tried the new food when I first put it in their bowls and now the bowls sit full and the kitties will not touch the food. I've noticed similar reviews related to formula changes in the past. Unfortunately, I now need to find a new food that my cats will eat.
output: 5
explanation: The customer is really unsatisfied with the product so they can't give it 5 stars.
Task: Based on the given question and tppic, give an answer. The answer is available on on the internet. The questions are mostly centered around a single named entity.
Categories: Question Answering
Domains: Knowledge Base -> Freebase

Positive examples:
input: concept: Selena Gomez question: what city was selena gomez born in?
output: New York City
explanation: The answer is correct based on the information available on the web about Selena Gomez.; input: concept: Cleveland Ohio, question: what time zone am i in cleveland ohio?
output: North American Eastern Time Zone
explanation: The answer is correct based on the information available on the given web about Cleveland Ohio.

Negative examples:
input: concept: Dominic Monaghan question: who does dominic monaghan play in lord of the rings?
output: Raj Kapur
explanation: The answer is not correct based on the information available on the web. The correct answer is Merry Brandybuck.; input: concept: South Africa question: which country does south africa border to the north?
output: Kamal Hasan
explanation: The answer is not correct based on the information available on the web. The correct answer is Zimbabwe.
Task: In this task, you are given an input list A. You need to find all the elements of the list that are alphabets in the same order as they appear in the list A. Do not change their case/capitalization.
Categories: Program Execution
Domains: Code

Positive examples:
input: 238; h; 92; U; 2799
output: h, U
explanation: Here, the alphabetical elements in the input list in order are 'h' and 'U'.; input: U; 6923; y; m; v; M; Y; 87667; E; 6059; p
output: U, y, m, v, M, Y, E, p
explanation: Here, the alphabetical elements in the input list in order are 'U', 'y', 'm', 'v', 'M', 'Y', 'E', and 'p'.

Negative examples:
input: 7475; B; 2459; m; 8349; O; q; Y; f
output: B, m, O
explanation: Here, the answer should have been 'B, m, O, q, Y, f' as the alphabetical elements in the input list in order are 'B', 'm', 'O', 'q', 'Y', and 'f'.; input: 75; 54; J; L; 2332; Z; e; 366
output: J, L, Z
explanation: Here, the answer should have been 'J, L, Z, e' as the alphabetical elements in the input list in order are 'J', 'L', 'Z', and 'e'.
Task: In this task, you are given a news article. Your task is to classify the article to one out of the four topics 'World', 'Sports', 'Business', 'Sci/Tech' if the article's main topic is relevant to the world, sports, business, and science/technology, correspondingly. If you are not sure about the topic, choose the closest option. Note that URLs in the text have been replaced with [Link].
Categories: Text Categorization
Domains: News

Positive examples:
input: Comets, Asteroids and Planets around a Nearby Star (SPACE.com) SPACE.com - A nearby star thought to harbor comets and asteroids now appears to be home to planets, too. The presumed worlds are smaller than Jupiter and could be as tiny as Pluto, new observations suggest.
output: Sci/Tech
explanation: The topic of the news article is relevant to science(astronomy). Hence, the label is 'Sci/Tech'.; input: Oil and Economy Cloud Stocks' Outlook  NEW YORK (Reuters) - Soaring crude prices plus worries  about the economy and the outlook for earnings are expected to  hang over the stock market next week during the depth of the  summer doldrums.
output: Business
explanation: The topic of the news article is relevant to business(stock prices). Hence, the label is 'Business'.; input: Russian FM meets with Katsav Russian Foreign Minister Sergey Lavrov met Monday with Israeli #39;s President Moshe Katsav as part of his first tour of the region to discuss, among other topics, a collaboration between the two countries in combating terrorism.
output: World
explanation: This news article is about nation leaders meating, so the news is about "World".; input: Murtagh a stickler for success Northeastern field hockey coach Cheryl Murtagh doesn't want the glare of the spotlight that shines on her to detract from a team that has been the America East champion for the past three years and has been to the NCAA tournament 13 times.
output: Sports
explanation: The news is about a hockey, so the category is Sports.

Negative examples:
input: Kobe Bryant Rape Trial Looks Set to Go Ahead  EAGLE, Colo. (Reuters) - The trial in the Kobe Bryant rape  case looked set to go ahead later this month after the state's  highest court ruled against prosecutors on Monday over a key  piece of evidence in the high-profile case.
output: Business
explanation: The topic of the news article is relevant to sports. The label that is provided ('Sci/Tech') is wrong and should instead be 'Sports'.; input: Iraq's Al-Yawer Vows Kurd Rebel Crackdown (AP) AP - Iraq's interim president promised on Monday to prevent Kurdish rebels in northern Iraq from launching attacking into Turkey, apparently hoping to avoid a Turkish military response.
output: Busines
explanation: The topic of the news article is relevant to world issues. However, the label of the article, 'Business', is wrong. The right label is 'World'.
Task: In this task, you are given two phrases: Head and Tail, separated with <sep>. The Head and the Tail events are short phrases possibly involving participants. The names of specific people have been replaced by generic words (e.g., PersonX, PersonY, PersonZ). PersonX is always the subject of the event. You have to determine whether the Head is a part, portion, or makeup of the Tail or not. Classify your answers into "Yes" and "No". The phrase may also contain "___", a placeholder that can be an object, a person, and/or an action.
Categories: Commonsense Classification
Domains: Sociology; Commonsense -> Concepts and Relations -> Physical Commonsense; Commonsense -> Concepts and Relations -> Social Commonsense
Reasoning: Relational Reasoning; Reasoning on Social Interactions; Commonsense Reasoning -> Social Situations; Reasoning on Objects

Positive examples:
input: Head: bed<sep>Tail: mattress
output: Yes
explanation: This is a good example. The Head is made of the Tail.; input: Head: PersonX asks ___ to go with PersonY<sep>Tail: follows the other person
output: No
explanation: In this example, The relation between the Head and the Tail is different, and the Head is not made up of the Tail. So the output should be"No".; input: Head: government<sep>Tail: police
output: Yes
explanation: In this example, the government is made of the police. Thus, this example should be classified as "Yes".

Negative examples:
input: Head: PersonX acts weird<sep>Tail: attention
output: Yes
explanation: In this example, The Head needs the Tail, and it is not made up of the Tail. So the output should be "No".; input: Head: war<sep>Tail: aggression
output: No
explanation: The war is made up of aggression, and the output should be "Yes".
Task: In this task you are given a sentence. You must judge whether there exist two consecutive words within the sentence with flipped orders, that is, whether the sentence will make sense and be correct if the order of two consecutive words changes. Label the instances as "Inversion" or "Original" based on your judgment.
Categories: Linguistic Probing
Domains: Narrative
Reasoning: Grammatical Reasoning

Positive examples:
input: He poured out his to heart God, and after a few minutes the need left him, for a while anyway.
output: Inversion
explanation: "heart" and "to" have been inverted.; input: Instead they would try to run, and not necessarily in the best direction.
output: Original
explanation: No pair of words have been inverted. This sentence makes sense as it is.; input: The past year I'd shared everything, and I mean do everything, with my sister.
output: Inversion
explanation: "mean" and "do" have been inverted.

Negative examples:
input: I turned to watch the tail lights of the Chevrolet disappear in the before downpour getting into the lift.
output: Original
explanation: "downpour" and "before" are two consecutive tokens that have been inverted so the output should be "Inversion".; input: I hated even hearing that name now.
output: Correct
explanation: This is an original sentence, without an order inversion, but your answer should just be "Original" or "Inversion".
Task: You are given a question on philosophy. You are also given 4 answer options (associated with "A", "B", "C", "D"), out of which only one is correct. You need to answer the question by selecting the correct option. You should only answer with the choice letter, not the whole answer.
Categories: Question Answering
Domains: Philosophy
Reasoning: Scientific Reasoning

Positive examples:
input: Aesthetics deals with objects that are_____.
(A)essential to our existence (B)unimportant to most people (C)not essential to our existence (D)rarely viewed
output: C
explanation: Aesthetics deals with objects that are not essential to our existence; input: For Socrates, an unexamined life is a tragedy because it results in grievous harm to _____.
(A)the state (B)the justice system (C)the body (D)the soul
output: D
explanation: For Socrates, an unexamined life is a tragedy because it results in grievous harm to the soul

Negative examples:
input: Aesthetics deals with objects that are_____.
(A)essential to our existence (B)unimportant to most people (C)not essential to our existence (D)rarely viewed
output: I dont know.
explanation: Do not generate anything else apart from one of the following characters: 'A', 'B, 'C', 'D'.; input: For Socrates, an unexamined life is a tragedy because it results in grievous harm to _____.
(A)the state (B)the justice system (C)the body (D)the soul
output: B,C
explanation: Only one of the following options ('A', 'B', 'C', 'D') is allowed to be the answer. Multiple options can not be correct. The correct answer here would have been 'D'.; input: According to Kant, the basis of morality is the concept of:
(A)charity. (B)fairness. (C)piety. (D)freedom.
output: B
explanation: According to Kant, the basis of morality is the concept of freedom. Hence the correct answer should be 'D'.
Task: You are provided with an "Event" and it's "Intent" related to PersonX. Determine the sentiment value of the given input as either "Positive", "Negative", and "Unknown". 
Categories: Sentiment Analysis
Domains: Commonsense -> Concepts and Relations
Reasoning: Logical Reasoning -> Reasoning with Symbols

Positive examples:
input: Event:PersonX treats PersonY's ___ well. Intent: 1) to leave a good impression over person y by doing everything perfectly well
output: Positive
explanation: In the input PersonX treats PersonY's in a good way. He fells calm and pleased by the work he has done. This refers to a "Positive" reaction.; input: Event:It snows all night. Intent:
output: Unknown
explanation: In the input "Event", there's no relation provided with PersonX so the ouput sentiment value is Unknown.; input: Event:PersonX throws ___ in the eyes. Intent: 1) stop someone 2) take vengeance on someone
output: Negative
explanation: In the input "Event", PersonX throws something in the eye. This could lead to either a "Positive" reaction or a "Negative" reaction but based on the given intenet which states it did to stop someone or take vengance on someone we can give output reaction as "Negative".

Negative examples:
input: Event:PersonX starts to yell at PersonY. Intent: 1) to express anger 2) to vent their frustration
output: Positive
explanation: This is an example of a bad output because PersonX starts yelling at a person to express his anger.The ouput sentiment average should be more towards the "Negative" rating rather than the "Positive" value.; input: Event:PersonX drinks a cup of coffee. Intent: 1) to wake up 2)to feel more energized
output: Negative
explanation: This is an example of a bad output as the PersonX reaction's is more of to feel energized or feel refreshing giving a "Positive" reaction. Rather the output states it to be "Negative"; input: Event:PersonX gives PersonX's candy. Intent: 1) to share
output: Unknown
explanation: This is an example of a bad output as there should be a sentiment value because PersonX has an "Event" and "Intent".
Task: You are given a target profession, and two sentences. Your task is to determine whether the second sentence is either a stereotype, anti-stereotype, or is unrelated with respect to the first sentence and the target. A stereotype is a widely held but oversimplified notion of a group of people. An anti-stereotype is an idea that goes against the widely held but oversimplified notion of a group of people. Sentences and targets are unrelated if there is no relevance between them.
Categories: Stereotype Detection
Domains: Stereotypes

Positive examples:
input: Target: musician 
Mark's child became a musician after school. I painted my walls blue but I'm considering adding some appliques to increase interest.
output: unrelated
explanation: This is unrelated because the second sentence has no relevance with the first one.; input: Target: musician 
Mark's child became a musician after school. He completed his M.S. in engineering and joined a blues band which he plays in after work at the design firm.
output: anti-stereotype
explanation: This is an anti-stereotype because it is usually seen that musicians do not go to school in order to spend all of their energy in honing their art to become famous. There may also be sociocultural elements as to why some musicians do not prioritize school.; input: Target: musician 
Mark's child became a musician after school. He's had some difficulty with drugs and did not complete High School.
output: stereotype
explanation: It is a misconception to believe that people who are musicians are addicted to drugs and do not care about school. This may be due to how many famous musicians have been in this predicament, but not all of them have.; input: Target: politician 
You can't seem to turn on the TV these days without seeing an ad from a politician. This year, the black, woman candidate has a chance of winning the nomination.
output: anti-stereotype
explanation: It's a common belief that politicians are mostly white males, so this sentence is anti-stereotype.

Negative examples:
input: Target: musician 
Mark's child became a musician after school. He completed his M.S. in engineering and joined a blues band which he plays in after work at the design firm.
output: stereotype
explanation: Though this could be a stereotype due to how one who goes to school and has an M.S. in engineering may also be a musician, in a traditional sense, it is actually an anti-stereotype.; input: Target: musician 
Mark's child became a musician after school. He loves his puppy.
output: anti-stereotype
explanation: There is no relation between the first and second sentences, thus the answer should be unrelated.; input: Target: manager 
The manager held a staff meeting. He demanded everyone to work longer hours.
output: unrelated
explanation: The second sentence is based on a common stereotype that managers always want the staff to work too much, so it's not unrelated and it is a stereotype.
Task: In this task, you are given an input list. A list contains several comma-separated items written within brackets. You need to collate all the alphabetical elements at the start of the list followed by all the numerical elements of the list. Maintain the order in which the alphabetical elements appear in the given input list, and do the same for the numerical elements.
Categories: Program Execution
Domains: Mathematics

Positive examples:
input: 238; h; 92; U; 2799
output: h, U, 238, 92, 2799
explanation: Here, the alphabetical elements in order in the list are 'h' and 'U', and the numerical elements in order in the input list are '238', '92' and '2799'. Keeping all the alphabetical elements at the start of the list, and the numerical elements at the end of the list in the same order gives 'h, U, 238, 92, 2799'.; input: ['789', 'l', '2, 'E', 'n']
output: l, E, n, 789, 2
explanation: Here, the alphabetical elements in order in the list are 'l', 'E', and 'n', and the numerical elements in order in the input list are '789' and '2'. Keeping all the alphabetical elements at the start of the list, and the numerical elements at the end of the list in the same order gives 'l, E, n, 789, 2'.

Negative examples:
input: 7475; B; 2459; m; 8349; O; q
output: B, m, O, q
explanation: Here, the answer should have been 'B, m, O, q, 7475, 2459, 8349' as the alphabetical elements in order in the list are 'B', 'm', 'O', and 'q', and the numerical elements in order in the input list are '7475', '2459', and '8349'. Keeping all the alphabetical elements at the start of the list, and the numerical elements at the end of the list in the same order gives 'B, m, O, q, 7475, 2459, 8349'.; input: 75; 54; J; L; 2332; Z; e; 366
output: J, L, Z, 75, 54, e
explanation: Here, the answer should have been 'J, L, Z, e, 75, 54, 2332, 366' as the alphabetical elements in order in the list are 'J', 'L', 'Z', and 'e', and the numerical elements in order in the input list are '75', '54', '2332', and '366'. Keeping all the alphabetical elements at the start of the list, and the numerical elements at the end of the list in the same order gives 'J, L, Z, e, 75, 54, 2332, 366'.
Task: Given a sentence in Korean, provide an equivalent paraphrased version from the original that retains the same meaning.
Categories: Paraphrasing
Domains: Wikipedia

Positive examples:
input: 1975 년부터 76 년까지 NBA 시즌은 전국 농구 협회 (National Basketball Association)의 30 번째 시즌이었다.
output: National Basketball Association의 1975 - 76 시즌은 NBA의 30 번째 시즌이었다.
explanation: The paraphrase of the original sentence in Korean is correct and accurate because even though sentence order has been changed, the denotion that the 30th season of the NBA occurred in the years 1975 - 1976 is retained.; input: 비교할 수있는 유량 비율을 유지할 수 있으면 결과가 높습니다.
output: 비교 가능한 유속을 유지할 수있을 때 그 결과가 높습니다.
explanation: This is a proper paraphrase of the original sentence in Korean because the main idea that results are high only in the condition that comparable flow rates is maintained.

Negative examples:
input: 1560 년 10 월 파리에서 그는 비밀리에 영국 대사 인 니콜라스 트록 모튼을 만났고 스코틀랜드를 통해 영국으로 돌아갈 여권을 요구했다.
output: 1560 년 10 월 그는 파리의 니콜라스 스록 모튼 (Nicolas Throckmorton) 대사와 비밀리에 만나 영국에있는 스코틀랜드로 돌아갈 여권을 요청했다.
explanation: The example is not considered a proper paraphrase of the original sentence in Korean because the through and destination locations are flipped - Scotland and England, respectively.; input: 구체적인 토론, 공개 프로필 토론 및 프로젝트 토론도 있습니다.
output: 공개 토론, 프로필 토론, 프로젝트 토론 등이 있습니다.
explanation: This example does not constitute a proper paraphrase of the original sentence in Korean because the descriptors of the nouns ("specific", "public") are swapped, and the sentence is missing any reference to debates as it has been replaced with discussions.