DataHammer/scimrc huggingface dataset:
Question: How to pre-train BERT?
Evidence: BERT (Bidirectional Encoder Representations from Transformers) BIBREF14 is a new language representation model, which uses bidirectional transformers to pre-train a large unlabeled corpus, and fine-tunes the pre-trained model on other tasks. BERT has been widely used and shows great improvement on various natural language processing tasks, e.g., word segmentation, named entity recognition, sentiment analysis, and question answering. We use BERT to extract contextual feature for each character instead of BiLSTM in the original work BIBREF13. To further improve the performance, we optimize the pre-training process of BERT by introducing a semantic-enhanced task.
Original google BERT is pre-trained using two unsupervised tasks, masked language model (MLM) and next sentence prediction (NSP). MLM task enables the model to capture the discriminative contextual feature. NSP task makes it possible to understand the relationship between sentence pairs, which is not directly captured by language modeling. We further design a semantic-enhanced task to enhance the performance of BERT. It incorporate previous sentence prediction and document level prediction. We pre-train BERT by combining MLM, NSP and the semantic-enhanced task together.
We pre-train BERT by combining MLM, NSP and the semantic-enhanced task together [19].
Answer: The authors pre-train BERT by combining MLM, NSP and the semantic-enhanced task together.
Question: Write a paragraph to refute a claim by a colleague that ancient structures such as Stonehenge, the Great Pyramid are evidence of UFO activities on Earth
Answer: There are several strong arguments against concluding that alien races built the structures like the Stonehenge or the Pyramids. First, there is evidence that these magnificent structures were built by humans. For example, tombs of the pyramid builders were found in the vicinity of the Great Pyramind (with human remains!). The technology to move and assemble the massive stones of the Stonehenge has been shown to be available to humans at that time. Second, given that space is vast the chance of finding one tiny planet among billions is infinitesimal. If alien intelligence had indeed found our one inhabited planet they are unlikely to have just created couple of structures and avoided any further contact with Earth and its inhabitants. In science, Occam’s Razor (“the best explanation is the simplest one”) is a guiding principle and until there is much more evidence of alien visitation it would be inadvisable to jump to a conclusion that aliens built these structures.
Question: Which is a species of fish? Nurse or Nurse shark
Answer: Nurse shark
Question: What do the authors design to pinpoint which linguistic features help more than others for early outcome prediction tasks?
Evidence: Negotiations, either between individuals or entities, are ubiquitous in everyday human interactions ranging from sales to legal proceedings. Being a good negotiator is a complex skill, requiring the ability to understand the partner's motives, ability to reason and to communicate effectively, making it a challenging task for an automated system. While research in building automatically negotiating agents has primarily focused on agent-agent negotiations BIBREF0, BIBREF1, there is a recent interest in agent-human negotiations BIBREF2 as well. Such agents may act as mediators or can be helpful for pedagogical purposes BIBREF3.
Efforts in agent-human negotiations involving free-form natural language as a means of communication are rather sparse. Researchers BIBREF4 recently studied natural language negotiations in buyer-seller bargaining setup, which is comparatively less restricted than previously studied game environments BIBREF5, BIBREF6. Lack of a well-defined structure in such negotiations allows humans or agents to express themselves more freely, which better emulates a realistic scenario. Interestingly, this also provides an exciting research opportunity: how can an agent leverage the behavioral cues in natural language to direct its negotiation strategies? Understanding the impact of natural language on negotiation outcomes through a data-driven neural framework is the primary objective of this work.
We focus on buyer-seller negotiations BIBREF4 where two individuals negotiate the price of a given product. Leveraging the recent advancements BIBREF7, BIBREF8 in pre-trained language encoders, we attempt to predict negotiation outcomes early on in the conversation, in a completely data-driven manner (Figure FIGREF3). Early prediction of outcomes is essential for effective planning of an automatically negotiating agent. Although there have been attempts to gain insights into negotiations BIBREF9, BIBREF10, to the best of our knowledge, we are the first to study early natural language cues through a data-driven neural system (Section SECREF3). Our evaluations show that natural language allows the models to make better predictions by looking at only a fraction of the negotiation. Rather than just realizing the strategy in natural language, our empirical results suggest that language can be crucial in the planning as well. We provide a sample negotiation from the test set BIBREF4 along with our model predictions in Table TABREF1.
We design ablation studies and a probing technique for BERT to pinpoint which linguistic features help more than others for early outcome prediction task.
Answer: The authors design ablation studies and a probing technique for BERT to pinpoint which linguistic features help more than others for early outcome prediction task.
Question: What is a pronoun?
Answer: A pronoun is word which is used to refer to something when a noun is not used.  Examples of pronoun words are he, she, it, myself, herself, and himself.  In a sentence you will see the pronoun used like this "John went the store to buy himself and apple and crackers."  In this context John is a proper noun and the pronoun is himself which refers to John.  Another way to consider a pronoun is that it is a less explicit or indirect reference to something.
Question: What is the value of x if x^2 = 4?
Answer: The value of x is either 2 or -2. This is because the square of both those numbers is 4 as shown below:

2 * 2 = 4
-2 * -2 = 4
Question: Identify which instrument is string or percussion: Wobble board, Scheitholt
Answer: Scheitholt is string, Wobble board is percussion.
Question: What is the best place to go downhill mountain biking
Answer: Downhill mountain biking is a sport that you typically would practice in an area that is also used as a ski resort in the winter. No all ski resort are suitable and developed to be great mountain bike location. The name of those mountain bike resorts are bike parks. Some of the most famous ones are Whistler, Châtel, Fort William, Vallnord, Val Di Sole. Sometimes, you can find a bike park in smaller size mountains where there are no ski resorts. Those are typically are in hilly regions like Wales.
Question: Since when did the SR22 include a glass cockpit
Evidence: SR22s and SR20s built before 2003 were equipped with traditional analog instruments and a 10" (later 12") Multi-function display (MFD). In February 2003, Cirrus began offering SR22s with the Avidyne Entegra primary flight display (PFD), making the plane the first of its kind to come with a glass cockpit. Later that year, this instrumentation became standard equipment on all SR-series aircraft and sparked a major transition in general aviation, whereby over 90% of all new light aircraft by the year 2006 were equipped with glass cockpits. Retrofits are available for the older SR aircraft that replace the analog instrument panels with one that includes a PFD, a new MFD and the installation of back-up mechanical instruments.

On 22 May 2008, Cirrus revealed the "Cirrus Perspective" glass cockpit (by Garmin). Both cockpits were available for a while (the Avidyne cockpit was initially standard equipment) and after 2008 the SR22 was sold with only the Perspective panel.

In 2009, the third-generation Cirrus SR22 GTS came equipped with a new enhanced vision system (EVS), a sophisticated dual-wavelength instrument that offers both infrared and synthetic vision.

At the 2010 EAA AirVenture, Cirrus announced its plans to certify Garmin's ESP system (Electronic Stability and Protection) on the Cirrus SR22. It included advanced flight envelope protection that could stabilize the aircraft with the push of a button, to avoid spiral from developing.

The Cirrus Perspective-Plus avionics flight deck was introduced in 2017, with a faster processing speed, animated datalink weather, payload management, visual approach capabilities, wireless database uploads, glass back-up instruments, and more.

In 2020, the Perspective-Plus flight deck included a new stabilized approach advisory system which provides alerts to the pilot of unstable conditions during approach.
Answer: Since February 2003 Cirrus started to offer a glass panel for the SR22. First the Avidyne Entegra was offered to customers. Also retrofits became available for older SR versions. In May 2008, Cirrus revealed the "Cirrus Perspective" glass cockpit, which was based on instruments created by Garmin.

Until today, Cirrus is including Garmin glass cockpits in it's aircrafts.
Question: How many toes do polydactyl cats have?
Answer: Polydactyl cats can have more than five toes on each paw; a typical cat has five (four on its paw pad and a declaw). Polydactyl cats will have six or more toes on each paw.
Question: how many movie genres do they explore?
Evidence: The second source of data was the genres for all reviews which were scraped from the IMDb site. A total of 27 different genres were scraped. A list of all genres can be find in Appendix SECREF8 . A review can have one genre or multiple genres. For example a review can be for a movie that is both Action, Drama and Thriller at the same time while another move only falls into Drama.
A total of 27 different genres were scraped.
Answer: The answers are shown as follows:
* 27
Question: Who is Manchester United's current manager?
Answer: Manchester United's current manager is Eric Ten Hag
Question: Why do people work?
Answer: People work for a number of reasons.  To earn an income and to pay bills are a few reasons that come to mind.  But some people do it simply because they enjoy it and are passionate about the career they are pursing.
Question: How do you define the training set for a specific architecture? For one architecture, and one dataset, you have a single time-varying graphs, no?
Evidence: We first train five different NN architectures, LeNet-5 (Lecun et al., 1998), VGG13 (Simonyan & Zisserman, 2015), AlexNet (Krizhevsky et al., 2012), ResNet-32 and ResNet-44 (He et al., 2016) , on CIFAR-10 dataset and three architectures, LeNet-5, AlexNet and ResNet-50, on ImageNet. During training, the NN parameters are updated using stochastic gradient descent. On each dataset, we train NNs by combining 48 learning rates {1, 1.5, . . . , 4.5} × {10−6 , . . . , 10−1}, and 10 dropout rates {0, 0.1, . . . , 0.9}. All the models are trained for 50 epochs with batch size 128 and an early stopping method by which the training stops when the testing accuracy does not increase for 10 consecutive epochs. Consequently, we obtain 480 NNs per architecture and dataset, with diverse performance. Information for the generated NNs is summarized in Table 2: the range of epochs at which the training stops early, the range of final testing accuracy for the trained NNs, and the accuracy threshold used to map actual NN performance to ‘low/high accuracy’ labels for the classification task. We trained the NNs on an Nvidia 1080Ti GPU with 11G memory, and we conducted all the other experiments on 2.60GHz Intel Xeon E5-2697 v3 platform with 1024G memory. For computational efficiency and to avoid having a largely imbalanced dataset, out of the 480 NNs, we randomly sampled 250 NNs with an even split of high- and low-accuracy networks. For this sample, the first t epochs of training for each configuration were saved as checkpoints to be converted to time-evolving graphs (step (S1)).
Answer: Due to the space limitation we moved the experimental configuration to Appendix A.1. For each architecture and dataset, we train 480 NNs (48 learning rates and 10 dropout values) and then we construct the time-evolving graphs corresponding to those different NN configurations.
Question: What is room temperature?
Answer: Room temperature is a range of air temperatures that most people prefer for indoor settings. This range is generally accepted to be around 20–22 °C or 68–72 °F. While it is subjective to opinion, keeping temperatures outside of these ranges can lead to discomfort and even aggression.
Question: Who won the 1986 Major League Baseball World Series and in how many games?
Evidence: The 1986 World Series was the championship series of Major League Baseball's (MLB) 1986 season. The 83rd edition of the World Series, it was a best-of-seven playoff played between the National League (NL) champion New York Mets and the American League (AL) champion Boston Red Sox. The Mets won the series four games to three to claim their second World Series title and first since 1969. The series is best remembered for its Game 6, which saw the Mets rally from a two run-deficit in the bottom of the 10th inning, despite having two outs and no one on base. The Red Sox, who held a 3–2 series lead, were twice one strike away from securing the championship, but failed to close out the inning as the Mets won off an error by Boston first baseman Bill Buckner. Due to the Mets claiming the series in Game 7, the Game 6 collapse entered baseball lore as part of the Curse of the Bambino superstition used to explain the Red Sox's championship drought after the 1918 World Series.
Answer: The New York Mets beat the Boston Red Sox, 4 games to 3, to win the World Series. The Red Sox were a strike away from winning the series in Game 6 but the Mets won the game due to an error from first baseman Bill Buckner. The Mets went on to easily win Game 7. This was used as another data point in the "Curse of the Bambino" superstition that started in 1918 when the Red Sox traded Babe Ruth to the New York Yankees and hadn't won a World Series since (up til that point in time).
Question: What is the Role of the Fourth Official in Football?
Answer: The main role of the Fourth Official in football is assisting the referee in his control of the match. All the officials should do so under the FIFA Football Laws of the Game

The 4th Official would officiate if any of the other three match officials (referee or assistant referees) are unable to continue to administer the rules and regulations.
Question: What is 75 hard and what are the tasks?
Answer: 75 hard is a mental toughness challenge created by Andy Frisella. For 75 consecutive days, you follow the daily tasks as prescribed, no shortcuts. If you miss a task, you reset to day 1 and start all over again. 

The tasks include: 
- Take a daily progress picture.
- Follow a diet . No cheating and no alcohol.
- Perform TWO separate 45 minute workouts, one of which needs to be outside. 
- Drink 1 gallon of water.
- Read 10 pages of a non-fiction book. Audiobooks don't count.
Question: What are the top five brands of guitars?
Answer: Fender
Gibson
Martin
Gretsch
Taylor
Question: Tell me whether these are cheeses or not: Stinking Bishop, Gouda, Gonzo, Brie, Partisano
Answer: Stinking Bishop, Gouda, and Brie are cheeses. Gonzo and Partisano are not.
Question: Identify which instrument is string or percussion: Tassa, Sitar
Answer: Sitar is string, Tassa is percussion.
Question: How many species of Stingrays are there?
Evidence: Stingrays are a group of sea rays, which are cartilaginous fish related to sharks. They are classified in the suborder Myliobatoidei of the order Myliobatiformes and consist of eight families: Hexatrygonidae (sixgill stingray), Plesiobatidae (deepwater stingray), Urolophidae (stingarees), Urotrygonidae (round rays), Dasyatidae (whiptail stingrays), Potamotrygonidae (river stingrays), Gymnuridae (butterfly rays) and Myliobatidae (eagle rays). There are about 220 known stingray species organized into 29 genera.
Answer: There are about 220 known stingray species organized into 29 genera.
Question: What are the five best sports cars to buy right now, under $200K USD?
Answer: Assuming now authorized dealer markups (ADMs), the following cars are often considered among the best sports cars under $200K. 
1. Porsche 992 GT3, 2. Audi R8 V10, 3. Chevrolet C8 Z06 Corvette, 4. Porsche 718 GT4, 5. Acura NSX
Question: What are some fashion ideas that haven't been done before?
Answer: - Tiny shoes for you ears
- Giant wrestling belt worn with a suit
- Sideways pants (both legs in one pant, the other pant just hanging behind you)
- Shave leg hair into tiger stripe pattern
- Fashionable hazmat suit
Question: Why are dogs so good at smelling?
Answer: Dogs have approximately 300 million olfactory sensors as opposed to 6 million in humans. Their sense of smell is about 40 times better than humans. They are also neophilic which means they are attracted to new and interesting smells. They also have the ability to discern which nostril a smell emanated from.
Question: What are the architectures used for the three tasks?
Evidence: Morphological inflection has been thoroughly studied in monolingual high resource settings, especially through the recent SIGMORPHON challenges BIBREF8, BIBREF9, BIBREF10, with the latest iteration focusing more on low-resource settings, utilizing cross-lingual transfer BIBREF11. We use the guidelines of the state-of-the-art approach of BIBREF12 that achieved the highest inflection accuracy in the latest SIGMORPHON 2019 morphological inflection shared task. Our models are implemented in DyNet BIBREF13.
Morphological analysis is the task of creating a morphosyntactic description for a given word. It can be framed in a context-agnostic manner (as in our case) or within a given context, as for instance for the SIGMORPHON 2019 second shared task BIBREF11. We trained an encoder-decoder model that receives the form as character-level input, encodes it with a BiLSTM encoder, and then an attention enhanced decoder BIBREF14 outputs the corresponding sequence of morphological tags, implemented in DyNet. The baseline results are shown in Table . The exact-match accuracy of 67% is lower than the average accuracy that context-aware systems can achieve, and it highlights the challenge that the complexity of the tonal system of SJQ Chatino can pose.
Lemmatization is the task of retrieving the underlying lemma from which an inflected form was derived. Although in some languages the lemma is distinct from all forms, in SJQ Chatino the lemma is defined as the completive third-person singular form. As a computational task, lemmatization entails producing the lemma given an inflected form (and possibly, given a set of morphological tags describing the input form). Popular approaches tackle it as a character-level edit sequence generation task BIBREF15, or as a character-level sequence-to-sequence task BIBREF16. For our baseline lemmatization systems we follow the latter approach. We trained a character level encoder-decoder model, similar to the above-mentioned inflection system, implemented in DyNet.
We use the guidelines of the state-of-the-art approach of BIBREF12 that achieved the highest inflection accuracy in the latest SIGMORPHON 2019 morphological inflection shared task. Our models are implemented in DyNet BIBREF13.
We trained an encoder-decoder model that receives the form as character-level input, encodes it with a BiLSTM encoder, and then an attention enhanced decoder BIBREF14 outputs the corresponding sequence of morphological tags, implemented in DyNet.
We trained a character level encoder-decoder model, similar to the above-mentioned inflection system, implemented in DyNet.
Answer: The answers are shown as follows:
* DyNet
Question: What do you know about the Fatimid Empire?
Answer: The Fatimid Dynasty was a Shia Ismaili Empire which existed from Tenth to the Twelfth Centuries AD (909 - 1171 CE). They were originated from the Alids & they trace their lineage to Ali-ibn-Abi-Talib, the First Shia Imam, and named after Fatima-Al-Zahra-bint-Mohammed wife of Ali-ibn-Abi-Talib & originating from the Arab. Throughout the time, their reign spanned from North Africa to the Middle East & certain parts of Europe & Asia covering present day areas of North Africa, Egypt, Sudan, Sicily, the Levant, Yemen, Multan and the Hijaz.

Abdullah al-Mahdi Billah was the founder of the Fatimid Dynasty. At present certain sects of Ismaili Shia claim to be the descendants of the Fatimids including the Druze, Nizaris, Taiyabbis & the Dawoodi Bohras.
Question: Tell me whether these styles are related to facial hair or head hair: mohawk, buzz cut, goatee, soul patch, mustache, chin strap, bowl cut
Answer: Mohawk: Head Hair
Buzz Cut: Head Hair
Goatee: Facial Hair
Soul Patch: Facial Hair
Mustache: Facial Hair
Chin Strap: Facial Hair
Bowl Cut: Head Hair
Question: How many slide positions are there on a trombone
Answer: There are 7 slide positions on a trombone, where each slide position is a half step apart from the next slide position. In combination with changes in air pressure to change the pitch of the note, a trombone player adjusts the slide position to produce various tones at various octaves.
Question: Imagine you are the last person on Earth. Write a diary entry describing your thoughts and feelings.
Answer: Dear Diary,
As warned a few days back, all the humans on planet Earth have disappeared. I am now the last person on Earth. There are a lot of positives and, at the same time, many negatives. I now have the freedom to do what I want without anyone being my obstacle. I can live my life according to my wish and do not have to follow the rules and restrictions of society. I can now live the “Hakuna Matata” life without worrying about my future temporarily. Alas! There’s also a negative side to this heaven on Earth. Now that the world's farmers have disappeared, the biodegradable food items would only last for a few days and would start to degrade if not refrigerated. All that would be left would be the canned and packed food items though these foodstuffs would also expire after a few years and eventually start to decompose. Soon the loneliness would also set into the brain. The reason was that man had evolved into a communal organism. Humans are born into an interdependent society where everyone is interdependent in their needs and wants. Without a community, the human race would probably perish. Soon, with no edible food remaining, I may also have to go out hunting for my meals like the early hunter-gatherers or to farm on the farmlands for three meals a day and would also forget about the worldly wants that the human society had created like electronic devices, automobiles, etc.
These devices would be of no use any more as a few months to go, the power reserves would run out of energy, and there would be no energy left to put them to good use.
Finally, I would miss my loved ones, friends, family, etc.
The memories, as I predict, may start to haunt me, and they may also begin to give me nightmares.
Memories would eventually turn to sadness, transforming into depression, but I would learn to live with it. Except for these changes, I don't think any other change will take place in my life.
With this, I end it here.
Yours,
(Name)