DataHammer/scimrc huggingface dataset:
Question: What models did the author evaluate in the experiments?
Evidence: The recently introduced BERT model BIBREF0 exhibits strong performance on several language understanding benchmarks. To what extent does it capture syntax-sensitive structures?
Recent work examines the extent to which RNN-based models capture syntax-sensitive phenomena that are traditionally taken as evidence for the existence in hierarchical structure. In particular, in BIBREF1 we assess the ability of LSTMs to learn subject-verb agreement patterns in English, and evaluate on naturally occurring wikipedia sentences. BIBREF2 also consider subject-verb agreement, but in a “colorless green ideas” setting in which content words in naturally occurring sentences are replaced with random words with the same part-of-speech and inflection, thus ensuring a focus on syntax rather than on selectional-preferences based cues. BIBREF3 consider a wider range of syntactic phenomena (subject-verb agreement, reflexive anaphora, negative polarity items) using manually constructed stimuli, allowing for greater coverage and control than in the naturally occurring setting.
The BERT model is based on the “Transformer” architecture BIBREF4 , which—in contrast to RNNs—relies purely on attention mechanisms, and does not have an explicit notion of word order beyond marking each word with its absolute-position embedding. This reliance on attention may lead one to expect decreased performance on syntax-sensitive tasks compared to RNN (LSTM) models that do model word order directly, and explicitly track states across the sentence. Indeed, BIBREF5 finds that transformer-based models perform worse than LSTM models on the BIBREF1 agreement prediction dataset. In contrast, BIBREF6 find that self-attention performs on par with LSTM for syntax sensitive dependencies in the context of machine-translation, and performance on syntactic tasks is correlated with the number of attention heads in multi-head attention.
I adapt the evaluation protocol and stimuli of BIBREF1 , BIBREF2 and BIBREF3 to the bidirectional setting required by BERT, and evaluate the pre-trained BERT models (both the Large and the Base models). Surprisingly (at least to me), the out-of-the-box models (without any task-specific fine-tuning) perform very well on all the syntactic tasks.
I adapt the evaluation protocol and stimuli of Linzen et al. (2016), Gulordava et al. (2018) and Marvin and Linzen (2018) to the bidirectional setting required by BERT, and evaluate the pre-trained BERT models (both the Large and the Base models).
Answer: The author evaluated the pre-trained BERT models (both the Large and the Base models)
Question: From what perspective do they identify online trolls on Twitter?
Evidence: Recent years have seen a large increase in the amount of disinformation and fake news spread on social media. False information was used to spread fear and anger among people, which in turn, provoked crimes in some countries. The US in the recent years experienced many similar cases during the presidential elections, such as the one commonly known as “Pizzagate" . Later on, Twitter declared that they had detected a suspicious campaign originated in Russia by an organization named Internet Research Agency (IRA), and targeted the US to affect the results of the 2016 presidential elections. The desired goals behind these accounts are to spread fake and hateful news to further polarize the public opinion. Such attempts are not limited to Twitter, since Facebook announced in mid-2019 that they detected a similar attempt originating from UAE, Egypt and Saudi Arabia and targeting other countries such as Qatar, Palestine, Lebanon and Jordan. This attempt used Facebook pages, groups, and user accounts with fake identities to spread fake news supporting their ideological agendas. The automatic detection of such attempts is very challenging, since the true identity of these suspicious accounts is hidden by imitating the profiles of real persons from the targeted audience; in addition, sometimes they publish their suspicious idea in a vague way through their tweets' messages.
A previous work BIBREF0 showed that such suspicious accounts are not bots in a strict sense and they argue that they could be considered as “software-assisted human workers". According to BIBREF1, the online suspicious accounts can be categorized into 3 main types: Robots, Cyborgs, and Human Spammers. We consider IRA accounts as another new emerging type called trolls, which is similar to Cyborgs except that the former focuses on targeting communities instead of individuals.
In this work, we identify online trolls in Twitter, namely IRA trolls, from a textual perspective. We study the effect of a set of text-based features and we propose a machine learning model to detect them. We aim to answer three research questions: RQ1. Does the thematic information improve the detection performance?, RQ2. Can we detect IRA trolls from only a textual perspective? and RQ3. How IRA campaign utilized the emotions to affect the public opinions?
The rest of the paper is structured as follows. In the following section, we present an overview on the literature work on IRA trolls. In Section SECREF3, we describe how the used dataset was compiled. Section SECREF4 describes our proposed features for our approach. The experiments, results, and analyses are presented in Section SECREF5. Finally, we draw some conclusions and discuss possible future work on IRA trolls.
In this work, we identify online trolls in Twitter, namely IRA trolls, from a textual perspective.
Answer: From a textual perspective.
Question: What is a synapse notebook?
Answer: A synapse notebook is a technology built by Microsoft that takes advantage of spark pools.  This is an environment that Data Scientists, Machine Learning Engineers, and Data Engineers can work in to build models, data engineering workflows, and neural networks to name a few.  It is very similar to Jupyter notebook style.  These notebooks environments enable code to be written in a modular format in different cells which can be executed independently of one another.
Question: What were the top 5 best-selling British sports cars manufactured by British Leyland?
Answer: 1. MGB; approximately 524,000 were produced
2. Triumph Spitfire; approximately 315,000 were produced
3. MG Midget; approximately 235,000 were produced
4. Triumph TR7; approximately 115,000 were produced
5. Triumph TR6; approximately 92,000 were produced
Question: How to obtain ground truth graph piece sequence, and why?
Evidence: Algorithm 2 presents the pseudo code for the piece-level decomposition of molecules. The algorithm takes the atom-level molecular graph, the vocabulary of graph pieces and their frequencies of occurrence recorded during the graph piece extraction process as input. Then the algorithm iteratively merge the graph piece pair which has the highest recorded frequency of occurrence in the vocabulary until all graph piece pairs are not in the vocabulary
Answer: We are sorry we didn't make it clear. At test time, we first decompose a molecular graph into atom-level graph pieces, then apply the learned operations to merge the graph pieces into larger ones. This process ensures there is a piece-level decomposition for an arbitrary molecule. We provide the pseudo code for the piece-level decomposition in Appendix A for better understanding. After the piece-level decomposition, we can obtain the ground truth graph piece sequence from the graph.
Question: What is the winter weather like in Salt Lake City, Utah?
Answer: Some years, Utah has massive amounts of snow, up to 700 inches at some ski resorts. Other years, Utah has little precipitation. Often temperatures are just below or just above freezing during winter months.
Question: In which year did the Seattle SuperSonics win the NBA championship?
Evidence: Seattle SuperSonics won the NBA championship in 1979. The franchise won Western Conference titles in 1978, 1979 and 1996; and six divisional titles—their last being in 2005—five in the Pacific Division and one in the Northwest Division. The franchise attained a 1,745–1,585 (.524) regular season win–loss record, as well as a 107–110 (.493) playoff win–loss record during its time in Seattle.[citation needed] Both marks would rank in the top half of the NBA's all-time standings. Settlement terms of a lawsuit between the city of Seattle and Clay Bennett's ownership group stipulated SuperSonics' banners, trophies and retired jerseys remain in Seattle; the nickname, logo and color scheme are available to any subsequent NBA team that plays at KeyArena subject to NBA approval. The SuperSonics' franchise history, however, would be shared with Thunder.
Answer: 1979
Question: Is a tomato a fruit or a vegetable?
Answer: Tomatoes are fruits because they form from a flower and contain seeds.
Question: Given a reference text about a film, tell me who directed it, the main cast, and the Academy Awards it won.
Evidence: A multinational venture, the film was made on a US$17 million budget, and was produced by Edko Films and Zoom Hunt Productions in collaboration with China Film Co-productions Corporation and Asian Union Film & Entertainment for Columbia Pictures Film Production Asia in association with Good Machine International. With dialogue in Standard Chinese, subtitled for various markets, Crouching Tiger, Hidden Dragon became a surprise international success, grossing $213.5 million worldwide. It grossed US$128 million in the United States, becoming the highest-grossing foreign-language film produced overseas in American history. The film was the first foreign-language film to break the $100 million mark in the United States.
Answer: This film was directed by Ang Lee and stars Chow Yun-fat, Michelle Yeoh, Zhang Ziyi, and Chang Chen. In the 73rd Academy Awards in 2001, it won Best Foreign Language Film, Best Art Direction, Best Original Score, and Best Cinematography.
Question: What are some creative ways to get my kids to eat vegetables?
Answer: Different vegetables have varying textures - try feeding your kids a variety of vegetables to see which textures they like and don't like. You can also present vegetables with fun dips and sauces that will make your kids more likely to eat them, like ranch, cheese, salsa and nut butter. If your kids have a hard time with all vegetables, you can sneak them into meals! For example, you can make some pasta sauce even more nutritious by blending carrots, broccoli, cauliflower, and other mild tasting vegetables into the sauce using a blender. Your kids will never know they were there because the strong tomato flavor masks the taste.
Question: Given this reference paragraph about the history of the 'five whys' technique, what was the original intention of asking the 'five whys'?
Evidence: The technique was originally developed by Sakichi Toyoda and was used within the Toyota Motor Corporation during the evolution of its manufacturing methodologies. It is a critical component of problem-solving training, delivered as part of the induction into the Toyota Production System. The architect of the Toyota Production System, Taiichi Ohno, described the five whys method as "the basis of Toyota's scientific approach by repeating why five times the nature of the problem as well as its solution becomes clear." The tool has seen widespread use beyond Toyota, and is now used within Kaizen, lean manufacturing, lean construction and Six Sigma. The five whys were initially developed to understand why new product features or manufacturing techniques were needed, and was not developed for root cause analysis.
Answer: The original intention of asking the 'five whys' was to understand why new product features or manufacturing techniques were needed in Toyota's manufacturing practices.
Question: Were the months that Shirley C. Guthrie Jr. was born and died in the same month or different months?
Evidence: Shirley C. Guthrie Jr. (9 October 1927 – 23 October 2004) was a minister of the Presbyterian Church (USA) and J.B. Green Professor of Systematic Theology at Columbia Theological Seminary for nearly 40 years. He was well known for his book, Christian Doctrine, which was originally written for an Adult Sunday School Book in the old PCUS Covenant life curriculum.
Answer: The same.  Shirley C. Guthrie Jr. was born in October 1927 and died in October 2004.
Question: How to categorize the questions in this corpus?
Evidence: Though Bengali is the seventh most spoken language in terms of number of native speakers BIBREF23, there is no standard corpus of questions available BIBREF0. We have collected total 3500 questions from the Internet and other sources such as books of general knowledge questions, history etc. The corpus contains the questions and the classes each question belongs to.
The set of question categories is known as question taxonomy BIBREF0. We have used two layer taxonomy which was proposed by Xin Li, Dan Roth BIBREF24. This two layer taxonomy is made up of two classes which are Coarse Class and Finer Class. There are six coarse classes such as Numeric, Location, Entity, Description, Human and Abbreviation and fifty finer classes such as city, state, mountain, distance, count, definition, group, expression, substance, creative, vehicle etc as shown in the Table I BIBREF0. A coarse-grained description of a system denotes large components while a fine-grained description denotes smaller sub-components of which the larger ones are composed of.
We have used two layer taxonomy which was proposed by Xin Li, Dan Roth [17]. This two layer taxonomy is made up of two classes which are Coarse Class and Finer Class.
Answer: The authors used the two layer taxonomy which is made up of two classes, which are Coarse Class and Finer Class.
Question: Name some of Sweden's most famous companies
Answer: Here are some examples of Sweden's most famous companies. 
Volvo
Hennes & Mauritz
Electrolux
IKEA
Spotify
Klarna
Question: What is SAML?
Answer: SAML or Security Assertion Markup Language is an open standard and an XML-based framework for authentication and authorization between an identity provider, service provider, and a principal. SAML is used to enable web-browser based single sign-on (SSO).
Question: Which state in the United States the is best?
Answer: There are 50 states, a federal district (District of Columbia), and five unincorporated territories that make up The United States of America. It is vast in geography, political ideology, climate, and leisure interests.  The best state is the one in which your own personal preferences are met.  Some prefer mountains, which Colorado or Washington offer.  Others may desire access to the ocean so Florida may top the list.  Still others may desire all four seasons and Minnesota may be best suited.  The best thing about the United States is the freedom to decide which state is best.
Question: Given a reference text about Justice League Dark, tell me who the main actors are and what roles they played.
Evidence: Justice League Dark is a 2017 American adult animated science fantasy superhero film produced by Warner Bros. Animation and distributed by Warner Home Video. Featuring the DC Comics team of the same name created by Peter Milligan and Mikel Janín, the film is the 27th of the DC Universe Animated Original Movies and the eighth of the DC Animated Movie Universe. Unlike most installments in the DC Animated Universe Movies series, Justice League Dark features an original premise. The film stars Matt Ryan as John Constantine and Jason O'Mara as Batman, reprising their respective roles from previous media. It was released on Digital HD on January 24, 2017, and on DVD and Blu-ray on February 7.

A sequel, Justice League Dark: Apokolips War, was released in May 2020.
Answer: The main actors in Justice League Dark were Matt Ryan and Jason O'Mara. In the film, Matt Ryan is John Constantine and Jason O'Mara is Batman.
Question: What is proteomics?
Answer: Proteomics is the large-scale study of proteins. Proteins are vital parts of living organisms, with many functions such as the formation of structural fibers of muscle tissue, enzymatic digestion of food, or synthesis and replication of DNA. In addition, other kinds of proteins include antibodies that protect an organism from infection, and hormones that send important signals throughout the body.

The proteome is the entire set of proteins produced or modified by an organism or system. Proteomics enables the identification of ever-increasing numbers of proteins. This varies with time and distinct requirements, or stresses, that a cell or organism undergoes.

Proteomics is an interdisciplinary domain that has benefited greatly from the genetic information of various genome projects, including the Human Genome Project. It covers the exploration of proteomes from the overall level of protein composition, structure, and activity, and is an important component of functional genomics.

Proteomics generally denotes the large-scale experimental analysis of proteins and proteomes, but often refers specifically to protein purification and mass spectrometry. Indeed, mass spectrometry is the most powerful method for analysis of proteomes, both in large samples composed of millions of cells and in single cells.
Question: Give me a list of date night ideas that I've never done.
Answer: For your next date night, you could:
- Take a pottery class.
- Find a paint and sip.
- Go axe throwing. 
- Do a walking tour of the best taco joints in your city. 
- Go to your local grocery store, pick snacks out for each other, and put on a movie you've never seen.
Question: Classify the series according to the OTT platform they are on.
The Witcher, Jack Ryan, The Rings of Power, Sweet Tooth
Answer: Netflix - The Witcher, Sweet Tooth
Amazon Prime - Jack Ryan, The Rings of Power
Question: From this passage tell me why Panama Canal is called one of the seven wonders of the modern world
Evidence: The Panama Canal is an artificial 82 km (51 mi) waterway in Panama that connects the Atlantic Ocean with the Pacific Ocean and divides North and South America. The canal cuts across the Isthmus of Panama and is a conduit for maritime trade. One of the largest and most difficult engineering projects ever undertaken, the Panama Canal shortcut greatly reduces the time for ships to travel between the Atlantic and Pacific oceans, enabling them to avoid the lengthy, hazardous Cape Horn route around the southernmost tip of South America via the Drake Passage or Strait of Magellan.

Colombia, France, and later the United States controlled the territory surrounding the canal during construction. France began work on the canal in 1881, but stopped because of lack of investors' confidence due to engineering problems and a high worker mortality rate. The United States took over the project on May 4, 1904, and opened the canal on August 15, 1914. The US continued to control the canal and surrounding Panama Canal Zone until the 1977 Torrijos–Carter Treaties provided for its handover to Panama. After a period of joint American–Panamanian control, the canal was taken over by the Panamanian government in 1999. It is now managed and operated by the government-owned Panama Canal Authority.

Canal locks at each end lift ships up to Gatun Lake, an artificial lake 26 meters (85 ft) above sea level, created to reduce the amount of excavation work required for the canal, and then lower the ships at the other end. The original locks are 33.5 meters (110 ft) wide. A third, wider lane of locks was constructed between September 2007 and May 2016. The expanded waterway began commercial operation on June 26, 2016. The new locks allow transit of larger, New Panamax ships.

Annual traffic has risen from about 1,000 ships in 1914, when the canal opened, to 14,702 vessels in 2008, for a total of 333.7 million Panama Canal/Universal Measurement System (PC/UMS) tons. By 2012, more than 815,000 vessels had passed through the canal. In 2017 it took ships an average of 11.38 hours to pass between the canal's two locks. The American Society of Civil Engineers has ranked the Panama Canal one of the seven wonders of the modern world.
Answer: The American Society of Civil Engineers has ranked the Panama Canal one of the seven wonders of the modern world not only because it was one of the largest and most difficult engineering projects ever undertaken, but also because of its significant impact in maritime trade across the Atlantic and Pacific oceans near the Americas. It is a shortcut which greatly reduces the time for ships to travel between the Atlantic and Pacific oceans, enabling them to avoid the lengthy, hazardous Cape Horn route around the southernmost tip of South America via the Drake Passage or Strait of Magellan.
Question: What dataset do they use for evaluation?
Evidence: We evaluate our model on RACE dataset BIBREF6 , which consists of two subsets: RACE-M and RACE-H. RACE-M comes from middle school examinations while RACE-H comes from high school examinations. RACE is the combination of the two.
We compare our model with the following baselines: MRU(Multi-range Reasoning) BIBREF12 , DFN(Dynamic Fusion Networks) BIBREF11 , HCM(Hierarchical Co-Matching) BIBREF8 , OFT(OpenAI Finetuned Transformer LM) BIBREF13 , RSM(Reading Strategies Model) BIBREF14 . We also compare our model with the BERT baseline and implement the method described in the original paper BIBREF7 , which uses the final hidden vector corresponding to the first input token ([CLS]) as the aggregate representation followed by a classification layer and finally a standard classification loss is computed.
Results are shown in Table 2 . We can see that the performance of BERT $_{base}$ is very close to the previous state-of-the-art and BERT $_{large}$ even outperforms it for 3.7%. But experimental result shows that our model is more powerful and we further improve the result for 2.2% computed to BERT $_{base}$ and 2.2% computed to BERT $_{large}$ .
We evaluate our models on Large-scale ReAding Comprehension Dataset From Examinations (RACE) dataset (Lai et al., 2017), which consists of two subsets: RACE-M and RACE-H corresponding to middle school and high school difficulty level. RACE contains 27,933 passages and 97,687 questions in total, which is recognized as one of the largest and most difficult datasets in multi-choice reading comprehension. Besides, we also evaluate our model on the ROCStories (Spring 2016) dataset which collects 50k fivesentence commonsense stories. One correct ending sentence needs to be selected from two options when given four sentences in ROCStories dataset.
Answer: Large-scale ReAding Comprehension Dataset From Examinations (RACE) dataset and ROCStories (Spring 2016) dataset.
Question: Where is the baseball Hall of Fame?
Answer: The National Baseball Hall of Fame is a history museum and hall of fame in Cooperstown, New York.
Question: What is the “yacht rock” genre of music?
Answer: Yacht rock refers to jazzy rock n’roll music from the late 1970s and early 1980s, although the term wasn’t coined until years later.