DataHammer/scimrc huggingface dataset:
Question: What is the top floor of the King's Building based on this article? What floor is found below that?
Evidence: The King's Building is a Grade I listed building that forms part of the Strand Campus of King's College London in the United Kingdom. Originally named the College Building, the King's Building was designed by Sir Robert Smirke in the course of the College's foundation in 1829. As the founding building, it was built between 1829 and 1831 on land granted to King's College by the Government to complete the riverside frontage of Somerset House.

There are today a total of eight floors in the King's Building: Basement level, Ground level, Levels 1 to 4, Level 4U and Level 6. The King's Building houses a number of administrative departments (Estates & Facilities Offices, Admissions Office, Accommodation and Cashiers' Office), lecture theatres (most notably the Edmond J. Safra Lecture Theatre and Anatomy Lecture Theatre), the College Chapel, the Great Hall, various function rooms (Old Council Room, Committee Room, River Room, Somerset Room, St David's Room), study rooms and a catering outlet.
Answer: The top floor is Level 6, and below that is level 4U.
Question: Who sold more CDs in 2016 than Beyonce?
Answer: In 2016, Mozart sold More CDs than Beyoncé.
Question: In which countries in Pinot Noir most commonly grown ?
Evidence: Pinot noir's home is France's Burgundy region, particularly Côte-d'Or. It is also planted in Argentina, Australia, Austria, Bulgaria, Canada, Chile, northern parts of Croatia, Czech Republic, England, the Republic of Georgia, Germany, Greece, Israel, Italy, Hungary, Kosovo, the Republic of Macedonia, Moldova, New Zealand, Romania, Serbia, Slovakia, Slovenia, South Africa, Switzerland, Ukraine, United States, and Uruguay. The United States has increasingly become a major pinot noir producer, with some of the best regarded coming from Oregon's Willamette Valley, and California's Sonoma County with its Russian River Valley and Sonoma Coast appellations. Lesser-known appellations are found in Mendocino County's Anderson Valley, the Central Coast's Santa Lucia Highlands appellation, the Santa Maria Valley, and Sta. Rita Hills American Viticulture Area in Santa Barbara County. In New Zealand, it is principally grown in Martinborough, Marlborough, Waipara, and Central Otago
Answer: Pinot Noir is grown in France, Argentina, Australia, Austria, Bulgaria, Canada, Chile, Croatia, Czech Republic, England, the Republic of Georgia, Germany, Greece, Israel, Italy, Hungary, Kosovo, the Republic of Macedonia, Moldova, New Zealand, Romania, Serbia, Slovakia, Slovenia, South Africa, Switzerland, Ukraine, United States, and Uruguay.
Question: Identify which instrument is string or percussion: Pandeiro, Kudlung
Answer: Pandeiro is percussion, Kudlung is string.
Question: Extract a comma separated list of places mentioned in this entry on the history of coffee
Evidence: The history of coffee dates back to centuries of old oral tradition in modern day Ethiopia. However, neither where coffee was first cultivated nor direct evidence of its consumption prior to the 15th century have been found. Sufi monasteries in Yemen employed coffee as an aid to concentration during prayers. Coffee later spread to the Levant and Persia in the early 16th century; it caused some controversy on whether it was halal in Ottoman and Mamluk society. Coffee arrived in Italy the second half of the 16th century through commercial Mediterranean trade routes, while Central and Eastern Europeans learnt of coffee from the Ottomans. By the mid 17th century, it had reached India and the East Indies.


Coffeepot (cafetière "campanienne"), part of a service, 1836, hard-paste porcelain, Metropolitan Museum of Art
Coffee houses would establish themselves in Western Europe by the late 17th century, especially in England and Germany. One of the earliest cultivations of coffee in the New World was when Gabriel de Clieu brought coffee seedlings to Martinique in 1720. These beans later sprouted 18,680 coffee trees which enabled its spread to other Caribbean islands like Saint-Domingue and also to Mexico. By 1788, Saint-Domingue supplied half the world's coffee.

By 1852, globally, Brazil became the largest producer of coffee and has held that status ever since. The period since 1950 saw the widening of the playing field due to the emergence of several other major producers, notably Colombia, Ivory Coast, Ethiopia, and Vietnam; the latter overtook Colombia and became the second-largest producer in 1999. Modern production techniques along with the mass productization of coffee has made it a household item today.
Answer: Ethiopia, Yemen, the Levant, Persia, Central Europe, Eastern Europe, India, East Indies, Western Europe, England, Germany, Martinique, Saint-Domingue, Caribbean, Mexico, Brazil, Colombia, Ivory Coast, Vietnam
Question: What was the conclusion of the experiment?
Evidence: We proposed a simple yet efficient TF-IDF method to extract and corroborate useful keywords from pathology cancer reports. Encoding a pathology report for cancer and tumor surveillance is a laborious task, and sometimes it is subjected to human errors and variability in the interpretation. One of the most important aspects of encoding a pathology report involves extracting the primary diagnosis. This may be very useful for content-based image retrieval to combine with visual information. We used existing classification model and TF-IDF features to predict the primary diagnosis. We achieved up to 92% accuracy using XGBoost classifier. The prediction accuracy empowers the adoption of machine learning methods for automated information extraction from pathology reports.
The prediction accuracy empowers the adoption of machine learning methods for automated information extraction from pathology reports.
Answer: The prediction accuracy empowers the adoption of machine learning methods for automated information extraction from pathology reports.
Question: Why the same training data as in [9] is used?
Evidence: Language modeling is a probabilistic description of language phenomenon. It provides essential context to distinguish words which sound similar and therefore has one of the most useful applications in Natural Language Processing (NLP) especially in downstreaming tasks like Automatic Speech Recognition (ASR). Recurrent Neural Networks (RNN) especially Long Short Term Memory (LSTM) networks BIBREF0 have been the typical solution to language modeling which do achieve strong results. In spite of these results, their fundamental sequential computation constraint has restricted their use in the modeling of long-term dependencies in sequential data. To address these issues Transformer architecture was introduced. Transformers relies completely on an attention mechanism to form global dependencies between input and output. It also offers more parallelization and has achieved SOTA results in language modeling outperforming LSTM models BIBREF1.
In recent years,we have seen a lot of development based on this standard transformer models particularly on unsupervised pre-training(BIBREF2, BIBREF3, BIBREF4, BIBREF5, BIBREF6, BIBREF7 which have set state-of-the art results on multiple NLP benchmarks. One such model architecture has been the Bidirectional Encoder Representations from Transformers (BERT) model which uses a deep bidirectional transformer architecture.
Another architecture of interest would be the Transformer-XL, which introduces the notion of recurrence in a self-attention model.
The primary research focus though has been mostly on English language for which abundant data is present. It is interesting to see the performance of these models for an agglutinative language like Finnish, which is morphologically richer than English.
In this project, we explore the implementation of Transformer-based models (BERT and Transformer-XL) in language modeling for Finnish. We will use the same training data as in BIBREF8 so that we can do fair comparisons with the performance of the LSTM models. Also, as the BERT model is a bi-directional transformer, we will have to approximate the conditional probabilities given a sequence of words. We also experiment with using sub-word units with Transformer-XL to cope with the large vocabulary problems associated with the Finnish Language. With smaller units, the modeled sequences are longer, and we hope that the recursive XL architecture can allow us to still model long term effects. To the best of our knowledge this is the first work with the Finnish language to use the following:
Approximation of perplexity using a BERT architecture
Using Transformer-XL architecture with sub-word units.
Comparison of Transformer and LSTM models as language models in the same comparable settings with an agglutinative language.
We will use the same training data as in [9] so that we can do fair comparisons with the performance of the LSTM models.
Answer: To do fair comparisons with the performance of the LSTM models.
Question: Given a reference text about parks in Edina, determine the average size of its parks.
Evidence: Edina's parkland and open space total more than 1,550 acres (6.3 km2). The Edina Park and Recreation Department oversees 44 parks, which include amenities such as baseball, football and soccer fields; softball diamonds; basketball and tennis courts; outdoor skating rinks; playground equipment for young children; and picnic shelters. The Department also maintains eight miles (13 km) of scenic pathways for bicycling, walking, jogging, cross-country skiing and snowshoeing.
Answer: Since there are 44 total parks and a total of 1,550 acres across all parks, the average size of each park would be about 35 acres, because 1,550 divided by 44 is 35 after rounding to the nearest whole number.
Question: At the concert last night, identify each of these musicians as singer, drummer, guitarist, or bassist: Steve Harris, Bruce Dickinson, George Lynch, Nicko McBrain, Angus Young
Answer: Steve Harris - bassist
Bruce Dickinson - singer
George Lynch - guitarist
Nicko McBrain - drummer
Angus Young - guitarist
Question: Who is Marshall Strickland
Evidence: Marshall Strickland (born March 1, 1983) is an American former professional basketball player. He played college basketball at Indiana University for four years from 2002 to 2006. He is originally from Kingston, Massachusetts and went to Winchendon Prep in Winchendon before transferring to South Carroll High School in Carroll County, Maryland. He is 6 ft 2 in (1.88 m) tall and weighs 195 pounds (88 kg). He is the son of Marshall and Joanna Strickland, and younger brother of former Maryland Terrapins star Marche Strickland. Marshall is a graduate of the University of Maryland School of Dentistry in 2017.
Answer: Marshall Strickland (born March 1, 1983) is an American former professional basketball player. He played college basketball at Indiana University for four years from 2002 to 2006. 

He is originally from Kingston, Massachusetts and went to Winchendon Prep in Winchendon before transferring to South Carroll High School in Carroll County, Maryland. He is 6 ft 2 in (1.88 m) tall and weighs 195 pounds (88 kg). 

He is the son of Marshall and Joanna Strickland, and younger brother of former Maryland Terrapins star Marche Strickland. Marshall is a graduate of the University of Maryland School of Dentistry in 2017.
Question: Did Harry Potter put his own name in the goblet of fire?
Answer: Harry did not put his own name in the goblet of fire. Barty Crouch Junior, using polyjuice potion to disguise himself as Alistair Moody, put Harry's name in the goblet of fire as part of his plan to deliver Harry into Lord Voldemort's hands.
Question: What is the best way to wake up fresh in the morning?
Answer: 1. Sleep on time at night. Those who sleep at the same time daily tend to wake up fresher
2. Have a ton of water as soon as you wake up
3. Do a little yoga stretch first thing in the morning to relax your body 
4. Wake up at the same time everyday.
Question: What are the titles to the six volumes of Sir Winston Churchill's "The Second World War"?
Answer: The six volumes of Sir Winston Churchill's "The Second World War" were published between 1948 and 1953. They are:
1. The Gathering Storm
2. Their Finest Hour
3. The Grand Alliance
4. The Hinge of Fate
5. Closing the Ring
6. Triumph and Tragedy
Question: Extract the names of villages in the commune of Dăeni from the text. Separate them with a comma.
Evidence: Dăeni is a commune in Tulcea County, Northern Dobruja, Romania. It is composed of a single village, Dăeni.
Answer: Dăeni
Question: Name some famous anime shows?
Answer: Attack on Titan, Naruto, Dragon Ball, Bleach, One Piece
Question: How has the designated hitter role affected baseball players' careers?
Evidence: Advocates of the designated hitter point to the extension of many careers it has enabled, and, in a few cases, created long, productive careers for players who are weak fielders or have a history of injuries, such as Cecil Fielder and David Ortiz. Hall of Fame members George Brett, Carl Yastrzemski, Paul Molitor, Harold Baines and Edgar Martínez continued their careers longer than they ordinarily would have without the rule. Barry Bonds, who spent his entire career in the National League and even won eight Gold Gloves earlier in his career, was used strictly as a DH later in his career when the San Francisco Giants played away interleague games because of his diminishing fielding skills. Some believe that extending careers of older players is more of a disadvantage than an advantage, filling spots that otherwise may have been taken by younger players who end up not finding a place in the major leagues.
Answer: The designated hitter role has extended the careers of baseball players who are weak fielders or have a history of injuries. However, this means they take up team roster spots that otherwise might be filled by younger players.
Question: Why was Harry Potter famous in the wizarding world?
Evidence: Harry Potter lives with his abusive aunt and uncle, Vernon and Petunia Dursley, and their bullying son, Dudley. On Harry's eleventh birthday, a half-giant named Rubeus Hagrid personally delivers an acceptance letter to Hogwarts School of Witchcraft and Wizardry, revealing that Harry's parents, James and Lily Potter, were wizards. When Harry was one year old, an evil and powerful dark wizard, Lord Voldemort, murdered his parents. Harry survived Voldemort's killing curse that rebounded and seemingly destroyed the Dark Lord, leaving a lightning bolt-shaped scar on his forehead. Unknown to Harry, this act made him famous in the wizarding world.
Answer: Harry Potter survived the killing curse of a powerful dark wizard - Lord Voldemort.
Question: According to the paragraph below, what is the relationship between Dungeon Master and Venger?
Evidence: Throughout the series, a connection is suggested between Dungeon Master and Venger. At the end of the episode "The Dragon's Graveyard", Dungeon Master calls Venger "my son". The final unproduced episode "Requiem" would have confirmed that Venger is the Dungeon Master's corrupted son (making Kareena the sister of Venger and the daughter of Dungeon Master), redeemed Venger (giving those trapped in the realm their freedom), and ended on a cliffhanger where the six children could finally return home or deal with evil that still existed in the realm.
Answer: Venger is Dungeon Master's son.
Question: Why do authors choose QANet as the base model?
Evidence: The used architecture of the QA model is briefly summarized below. Here we choose QANet BIBREF2 as the base model due to the following reasons: 1) it achieves the second best performance on SQuAD, and 2) since there are completely no recurrent networks in QANet, its training speed is 5x faster than BiDAF BIBREF17 when reaching the same performance on SQuAD.
The network architecture is illustrated in Figure FIGREF2 . The left blocks and the right blocks form two QANets, each of which takes a document and a question as the input and outputs an answer. In QANet, firstly, an embedding encoder obtains word and character embeddings for each word in INLINEFORM0 or INLINEFORM1 and then models the temporal interactions between words and refines word vectors to contextualized word representations. All encoder blocks used in QANet are composed exclusively of depth-wise separable convolutions and self-attention. The intuition here is that convolution components can model local interactions and self-attention components focus on modeling global interactions. The context-query attention layer generates the question-document similarity matrix and computes the question-aware vector representations of the context words. After that, a model encoder layer containing seven encoder blocks captures the interactions among the context words conditioned on the question. Finally, the output layer predicts a start position and an end position in the document to extract the answer span from the document.
Here we choose QANet [3] as the base model due to the following reasons: 1) it achieves the second best performance on SQuAD, and 2) since there are completely no recurrent networks in QANet, its training speed is 5x faster than BiDAF [18] when reaching the same performance on SQuAD.
Answer: 1) it achieves the second best performance on SQuAD, and 2) since there are completely no recurrent networks in QANet, its training speed is 5x faster than BiDAF [18] when reaching the same performance on SQuAD.
Question: Which is a bird or fish: Red-backed shrike, Red salmon
Answer: Red salmon is a fish, Red-backed shrike is a bird
Question: Based on this paragraph, how many jobs are created by tourism in Germany?
Evidence: Germany is the ninth-most visited country in the world as of 2017, with 37.4 million visits. Domestic and international travel and tourism combined directly contribute over €105.3 billion to German GDP. Including indirect and induced impacts, the industry supports 4.2 million jobs.
Answer: 4.2 million jobs are created by tourism in Germany.
Question: From the passage provided, extract all the accessories provided with the Advanced Video System
Evidence: In 1982, Nintendo developed a prototype system called the Advanced Video System (AVS). Its accessories include controllers, a tape drive, a joystick, and a lightgun. The system can be used as a simple home computer. It was never released and is on display at the Nintendo World Store in New York. In July 1983, Nintendo released the Family Computer console in Japan, as its first attempt at a cartridge-based video game console. More than 500,000 units were sold within two months at around US$100. After a few months of favorable sales, Nintendo received complaints that some Famicom consoles would freeze on certain games. The fault was found in a malfunctioning chip and Nintendo decided to recall all Famicom units that were currently on store shelves, at a cost of approximately half a million USD.
Answer: Accessories for the Advanced Video System (AVS) were controllers, a tape drive, a joystick, and a lightgun.
Question: What is the Evergreen Game?
Answer: The Evergreen Game is a famous chess game won by Adolf Anderssen against Jean Dufresne in 1852.
Question: Who are the experts?
Evidence: This paper presents a study that compares the opinions of users on microblogs, which is essentially the crowd wisdom, to that of the experts in the field. Specifically, we explore three datasets: US Presidential Debates 2015-16, Grammy Awards 2013, Super Bowl 2013. We determined if the opinions of the crowd and the experts match by using the sentiments of the tweets to predict the outcomes of the debates/Grammys/Super Bowl. We observed that in most of the cases, the predictions were right indicating that crowd wisdom is indeed worth looking at and mining sentiments in microblogs is useful. In some cases where there were disagreements, however, we observed that the opinions of the experts did have some influence on the opinions of the users. We also find that the features that were most useful in our case of multi-label classification was a combination of the document-embedding and topic features.
This paper presents a study that compares the opinions of users on microblogs, which is essentially the crowd wisdom, to that of the experts in the field. Specifically, we explore three datasets: US Presidential Debates 2015-16, Grammy Awards 2013, Super Bowl 2013. 
Answer: The answers are shown as follows:
* the experts in the field
Question: What elements make a soap opera and what are examples?
Answer: A soap opera is typically a long-running show that follows a family. Audiences associate the following key elements with the genre. Most notably, there is family drama regarding the struggle for power over a position.

There’s also sibling rivalry, sometimes in the form of a love triangle. For example, the same woman is the love interest of two brothers. Soap operas are also known for a character’s unidentified paternity, also known as “Who’s the Daddy?” or WTD storyline. Such a plot point typically arises from the previously mentioned love triangle.

Another element soap operas are best known for is soap opera rapid aging syndrome (SORAS), in which a child character is not seen on-screen for a long period of time so that the character is rapidly aged so that they may now participate in adult storylines.

The final element that characterizes a soap opera is a secret relative that seemingly appears out of nowhere, usually to challenge a main character for power.

The best known examples of soap operas are shows on daytime television such as General Hospital, Days of Our Lives, and The Young & the Restless. However, soap operas can also include primetime shows such as Grey’s Anatomy and even blockbuster movies such as Black Panther and Black Panther: Wakanda Forever, which exhibit many elements that allow for these works to be considered soap operas.
Question: What is bond duration?
Answer: Duration is a time-weighted measurement of the average cash flow of an interest paying financial instrument. Bond investors use duration to measure the interest rate sensitivity of an asset. Type of duration calculations include Macaulay, Modified and Effective durations.
Question: List some American candy bars that have chocolate and caramel.
Answer: Twix, Snickers, Rolo, Caramel M&Ms, Milky Way, Milk Duds
Question: Based on this text, what average temperature in degree celsius can I expect in April in Germany?
Evidence: From February 2019 – 2020, average monthly temperatures in Germany ranged from a low of 3.3 °C (37.9 °F) in January 2020 to a high of 19.8 °C (67.6 °F) in June 2019. Average monthly precipitation ranged from 30 litres per square metre in February and April 2019 to 125 litres per square metre in February 2020. Average monthly hours of sunshine ranged from 45 in November 2019 to 300 in June 2019.
Answer: The average temperature in April in Germany is 13.2 °C.
Question: What is Ayurveda?
Answer: Ayurveda is a natural system of medicine that originated in India more than 3,000 years ago. The term Ayurveda is derived from the Sanskrit words ayur (life) and veda (science or knowledge). Thus, Ayurveda translates to knowledge of life. Based on the idea that disease is due to an imbalance or stress in a person's consciousness, Ayurveda encourages certain lifestyle interventions and natural therapies to regain a balance between the body, mind, spirit, and the environment.
Question: Select the odd word from this list and explain why:
Chair
Sofa
Table
Dinosaur
Cupboard
Answer: Dinosaur is the odd word in this list. All of the other words are items of furniture, but dinosaurs are large extinct reptiles, not items of furniture.
Question: What datasets are used to evaluate this approach?
Evidence: FLOAT SELECTED: Table 2: Data Statistics of the benchmarks.
FLOAT SELECTED: Table 2: Data Statistics of the benchmarks.
Answer:  Kinship and Nations knowledge graphs, YAGO3-10 and WN18KGs knowledge graphs