DataHammer/scimrc huggingface dataset:
Question: Approximately how much cashmere is produced each year?
Evidence: China has become the largest producer of raw cashmere, estimated at 19,200 metric tons (in hair) per year (2016). Mongolia follows with 8,900 tons (in hair) as of 2016, while Afghanistan, Iran, Turkey, Kyrgyzstan and other Central Asian republics produce lesser amounts. The annual world raw production is estimated to be between 15,000 and 20,000 tons (13,605 and 18,140 tonnes) (in hair). Pure cashmere, resulting from removing animal grease, dirt and coarse hairs from the fleece, is estimated at 6,500 tons (5,895 tonnes). Ultra-fine Cashmere or Pashmina is still produced by communities in Kashmir but its rarity and high price, along with political instability in the region, make it very hard to source and to regulate quality. It is estimated that the average yearly production per goat is 150 grams (0.33 lb).

Pure cashmere can be dyed and spun into yarns and knitted into jumpers (sweaters), hats, gloves, socks and other clothing, or woven into fabrics then cut and assembled into garments such as outer coats, jackets, trousers (pants), pajamas, scarves, blankets, and other items. Fabric and garment producers in Scotland, Italy, and Japan have long been known as market leaders. Cashmere may also be blended with other fibers to bring the garment cost down, or to gain their properties, such as elasticity from wool, or sheen from silk.

The town of Uxbridge, Massachusetts, in the United States was an incubator for the cashmere wool industry. It had the first power looms for woolens and the first manufacture of "satinets". Capron Mill had the first power looms, in 1820. It burned on July 21, 2007, in the Bernat Mill fire.

In the United States, under the U.S. Wool Products Labeling Act of 1939, as amended, (15 U. S. Code Section 68b(a)(6)), a wool or textile product may be labelled as containing cashmere only if the following criteria are met:

such wool product is the fine (dehaired) undercoat fibers produced by a cashmere goat (Capra hircus laniger);
the average diameter of the fiber of such wool product does not exceed 19 microns; and
such wool product does not contain more than 3 percent (by weight) of cashmere fibers with average diameters that exceed 30 microns.
the average fiber diameter may be subject to a coefficient of variation around the mean that shall not exceed 24 percent.
Answer: It is estimated that about 6,500 tons of cashmere is produced each year.
Question: Who was Severus Snape secretly in love with?
Answer: Snape loved Lily Potter.
Question: Why the test set was further restricted?
Evidence: To paraphrase the great bard BIBREF21, there is something rotten in the state of the art. We propose Human-And-Model-in-the-Loop Entailment Training (HAMLET), a training procedure to automatically mitigate problems with current dataset collection procedures (see Figure FIGREF1).
In our setup, our starting point is a base model, trained on NLI data. Rather than employing automated adversarial methods, here the model's “adversary” is a human annotator. Given a context (also often called a “premise” in NLI), and a desired target label, we ask the human writer to provide a hypothesis that fools the model into misclassifying the label. One can think of the writer as a “white hat” hacker, trying to identify vulnerabilities in the system. For each human-generated example that is misclassified, we also ask the writer to provide a reason why they believe it was misclassified.
For examples that the model misclassified, it is necessary to verify that they are actually correct —i.e., that the given context-hypothesis pairs genuinely have their specified target label. The best way to do this is to have them checked by another human. Hence, we provide the example to human verifiers. If two human verifiers agree with the writer, the example is considered a good example. If they disagree, we ask a third human verifier to break the tie. If there is still disagreement between the writer and the verifiers, the example is discarded. Occasionally, verifiers will overrule the original label of the writer.
Once data collection for the current round is finished, we construct a new training set from the collected data, with accompanying development and test sets. While the training set includes correctly classified examples, the development and tests sets are built solely from them. The test set was further restricted so as to: 1) include pairs from “exclusive” annotators that are never included in the training data; and 2) be balanced by label classes (and genres, where applicable). We subsequently train a new model on this and other existing data, and repeat the procedure three times.
The test set was further restricted so as to: 1) include pairs from “exclusive” annotators who are never included in the training data; and 2) be balanced by label classes (and genres, where applicable).
Answer: The test set was further restricted so as to: 1) include pairs from “exclusive” annotators who are never included in the training data; and 2) be balanced by label classes (and genres, where applicable).
Question: Who is the best selling music artist?
Answer: The Beatles sold 290.8 million albums between 1960 and 1970 making them the best music selling artist. The Beatles were an English rock band, formed in Liverpool in 1960, that comprised John Lennon, Paul McCartney, George Harrison and Ringo Starr. They are regarded as the most influential band of all time.
Question: List down some key points about area in geometry from the passage given.
Evidence: Area is the measure of a region's size on a surface. The area of a plane region or plane area refers to the area of a shape or planar lamina, while surface area refers to the area of an open surface or the boundary of a three-dimensional object. Area can be understood as the amount of material with a given thickness that would be necessary to fashion a model of the shape, or the amount of paint necessary to cover the surface with a single coat. It is the two-dimensional analogue of the length of a curve (a one-dimensional concept) or the volume of a solid (a three-dimensional concept).
Answer: 1. Area is a unit used to describe how big a region is on a surface.
2. Surface area refers to the area of an open surface or the boundary of a three-dimensional object, whereas the area of a plane region or plane area refers to the area of a form or planar lamina.
3. Area can be interpreted as the quantity of material with a specific thickness required to create a model of the shape or as the quantity of paint required to completely cover a surface in a single coat.
4. It is the two-dimensional equivalent of the volume of a solid or the length of a curve, both of which are one-dimensional concepts. (a three-dimensional concept).
Question: Why did they choose English as a lingua franca when training and evaluating M-BERT?
Evidence: The default setup preserves horizontal language consistency in that the language of the questions always matches the language of the comments. For example, the Italian test instances are combined with the Italian version of the questions, even though during training the model has only ever seen the German and French versions of the questions.
An alternative concept is vertical language consistency, whereby the questions are consistently presented in one language, regardless of the comment. To test whether horizontal or vertical consistency is more helpful, we train and evaluate M-Bert on a dataset variant where all questions are in their English version. We chose English as a lingua franca because it had the largest share of data during the pretraining of M-Bert.
The results are shown in Table TABREF39. While the effect is negligible in most settings, the cross-lingual performance clearly increases when all questions are given in English.
We chose English as a lingua franca because it had the largest share of data during the pre-training of M-BERT.
Answer: Because it had the largest share of data during the pre-training of M-BERT.
Question: What is GMROI?
Answer: GMROI is short for Gross Margin Return on Investment.  It's a metric used in retail to quantify the profitability of your purchased inventory.  The formula for it can be simplified to: Gross Margin / Average Cost of Inventory.
Question: Can you explain how I can analyze Simba logs?
Answer: A typical Simba driver log line to would like like below
Feb 21 20:17:16.525 TRACE 1542911745 Simba::ODBC::Statement::SQLFetch: +++++ enter +++++

One can use regular expression based match to parse this log line to split the fields to derive meaningful insights.

For example, the fields can be split into
- timestamp
- loglevel
- pid
- message

The last message field is a long string which encapsulates a lot of important information but can be classified as below by splitting this further based on the :: delimiter.
- Namespace
- Class
- Method
- Details


There are 2 types of Simba logs
Connection Logs - Useful for getting connection attributes like agent, driver versions, operation status calls, connection failures, SSL errors etc
Driver Logs - This helps to analyze actual details around data fetch performance.

Some examples to derive meaningful insights from connection logs
Extract unique query identifier using keyword search within the message for "THandleIdentifier" or a guid pattern

Some examples to derive meaningful insights from driver logs
How long did an actual data fetch block take can be inspected using the time difference between the blocks.
SQLFetch*Enter
SQLFetch*Exit

Within each fetch block, you can look for below log lines to understand if it was a row-by-row fetch if you see a log of SQLGetData blocks.
SQLGetData*Enter
SQLGetData*Exit

There is other miscellaneous information logged by Simba driver for preceding requests such as closing a query or a session where an actual identifier needs to be sent along with the request, think of it as a payload for a REST API post request where you also need to send a payload along with the request.

Overall, deriving meaningful information from the Simba driver logs require a bit of analysis
before actually realizing the benefits of such analysis, most of the details are cryptic.

Brainstorming other ideas with Simba product team would be fantastic.
Question: Tell me which Taylor Swift album these songs are from: Love Story, Bad Blood, Begin Again, Cornelia Street.
Answer: Love Story is from the album Fearless. Bad Blood is from the album 1989. Begin Again is from the album Red. Cornelia Street is from the album Lover.
Question: Classify the numbers based on their divisibility by 2,3,7
4, 9, 20, 28, 35, 8
Answer: Divisible by 2: 4, 20, 8, 28
Divisible by 3: 21
Divisible by 7: 21, 28
Question: What are some of the top places to visit in Switzerland?
Answer: Switzerland is an amazing country with many popular tourist attractions. Cities to visit include Zurich, Geneva, Lucerne, and Zermatt. During the summer months, you can hike in the mountains near Bern or Interlaken. Tourists will often take a ferry ride across Lake Geneva in the summer of visit Chateau de Chillon. There are beautiful waterfalls that form from the snow melt in the valleys. In the winter, it is popular to go skiing or snowboarding in the Swiss Alps, particularly in Zermatt and St. Moritz.
Question: What are all the books in the Lord of the Rings trilogy?
Evidence: Although often called a trilogy, the work was intended by Tolkien to be one volume of a two-volume set along with The Silmarillion.[T 3] For economic reasons, The Lord of the Rings was published over the course of a year from 29 July 1954 to 20 October 1955 in three volumes titled The Fellowship of the Ring, The Two Towers, and The Return of the King. The work is divided internally into six books, two per volume, with several appendices of background material. Some later editions print the entire work in a single volume, following the author's original intent.
Answer: The Lord of the Rings trilogy is comprised of: The Fellowship of the Ring, The Two Towers and The Return of the King.
Question: Is running a healthy sport?
Answer: If the necessary precautions are taken, running is a healthy sport. Good shoes, adapted to the surface, appropriate clothing, adapted to the weather and drinking enough water are prerequisites. Running reduces the risk of cardiovascular disease and improves health. It increases endurance and lowers the resting heart rate. This can already be achieved after 15 minutes of running a day. Running in the nature and the fresh air also has a positive effect on your mind. Running together is a lot of fun and motivating. Try it out
Question: What species are the Rimula rhips
Answer: Rimula rhips is a species of sea snail, a marine gastropod mollusk in the family Fissurellidae, the keyhole limpets and slit limpets.
Question: What is a dataset?
Answer: A dataset is a tabular information composed of rows and columns.  Each column will have a name that describes the data in that column along with an assigned datatype to describe the data that is the column.  Common datatypes are string, int, and double.  The total number of column in the dataset is called the total rows, and the total number rows is referred to as total row count.  All of these attributes together are what we call a dataset.  Datasets come into different forms too - batch, real-time, and static.
Question: Is Mount Fuji a mountain or a volcano?
Answer: Mount Fuji is a volcano which last erupted in 1707. It is the highest mountain in Japan at 3,776 meters tall. It is located in 2 prefectures: Yamanashi and Shizuoka and part of the Fuji-Hakone-Izu National Park. It was added to the UNESCO World Heritage List in June 2013.
Question: What cities should someone visit during a trip to Morocco?
Answer: There are many wonderful cities to visit during a trip to Morocco.  The decision of which cities to visit depends on the traveller's goals and interests because Morocco has something for everyone.  The largest airports are in the cities of Casablanca and Marrakech, so if traveling by air, those are good cities to fly into and out of.  Other cities that are popular among visitors include Fez and Tangier.  Cities along the Atlantic Coast of Morocco are popular for their beaches including Agadir and Essaouira.  The city of Chefchaouen is also very popular among visitors for its blue buildings.
Question: Which were the top 3 nations in the medal tally of World Wrestling Championship 2022
Answer: USA(15), Japan(13), Turkey(7)
Question: Why is Africa the least wealthy continent per capita?
Evidence: Africa is the world's second-largest and second-most populous continent, after Asia in both aspects. At about 30.3 million km2 (11.7 million square miles) including adjacent islands, it covers 20% of Earth's land area and 6% of its total surface area. With 1.4 billion people as of 2021, it accounts for about 18% of the world's human population. Africa's population is the youngest amongst all the continents; the median age in 2012 was 19.7, when the worldwide median age was 30.4. Despite a wide range of natural resources, Africa is the least wealthy continent per capita and second-least wealthy by total wealth, behind Oceania. Scholars have attributed this to different factors including geography, climate, tribalism, colonialism, the Cold War, neocolonialism, lack of democracy, and corruption. Despite this low concentration of wealth, recent economic expansion and the large and young population make Africa an important economic market in the broader global context.
Answer: Africa is the least wealthy continent per capita due to a variety of factors including: geography, climate, tribalism, colonialism, the Cold War, neocolonialism, lack of democracy, and corruption.
Question: Tell me whether these are Major League Baseball or National Basketball Association teams: Yankees, Astros, Dodgers, Pirates and Padres.
Answer: These five teams are all part of Major League Baseball and are not National Basketball Association teams.
Question: Extract the dates from the following.
Evidence: YouTube has been led by a CEO since its founding in 2005, and has retained this leadership model even after its acquisition by Google. The current CEO is Neal Mohan, who was appointed on February 16, 2023.
Answer: February 16, 2023
Question: The United States has the most tornadoes of any country, nearly four times more than estimated in all of Europe then why does most death related to tornadoes occur in Bangladesh
Evidence: Tornadoes kill an average of 179 people per year in Bangladesh, the most in the world.Reasons for this include the region's high population density, poor construction quality, and lack of tornado safety knowledge.Other areas of the world that have frequent tornadoes include South Africa, the La Plata Basin area, portions of Europe, Australia and New Zealand, and far eastern Asia.

Tornadoes are most common in spring and least common in winter, but tornadoes can occur any time of year that favorable conditions occur.Spring and fall experience peaks of activity as those are the seasons when stronger winds, wind shear, and atmospheric instability are present.Tornadoes are focused in the right front quadrant of landfalling tropical cyclones, which tend to occur in the late summer and autumn. Tornadoes can also be spawned as a result of eyewall mesovortices, which persist until landfall.
source : https://en.wikipedia.org/wiki/Tornado
Answer: Reasons for this include Bangladesh high population density, poor construction quality, and lack of tornado safety knowledge.
Question: Given this reference text, tell me what the foundational BJJ concept was
Evidence: Brazilian jiu-jitsu was initially developed in 1925 by Brazilian brothers Carlos, Oswaldo, Gastão Jr., George, and Hélio Gracie, after Carlos was taught jiu-jitsu by a travelling Japanese judoka, Mitsuyo Maeda, who himself mastered his ground fighting while interacting with Taro Miyake (Tanabe student), Sadakazu Uyenishi (Handa, Tanabe) and Yukio Tani (Tenjin Shinyo-ryu) and catch wrestlers in Europe. Later on, the Gracie family developed their own self-defense system, and published Gracie Jiu-Jitsu.

BJJ eventually came to be its own defined combat sport through the innovations, practices, and adaptation of Gracie jiu-jitsu and Judo, and became an essential martial art for modern MMA. Governing bodies such as the IBJJF work worldwide, and set the rules and standards to be held in sport BJJ competitions.

BJJ revolves around the concept, taken from traditional Japanese jūjutsu, that a smaller, weaker person can successfully defend themselves against a bigger, stronger, heavier opponent by using leverage and weight distribution, taking the fight to the ground and using a number of holds and submissions to defeat them. BJJ training can be used for sport grappling and self-defense situations. Sparring, commonly referred to as "rolling" within the BJJ community, and live drilling plays a major role in training and the practitioner's development. BJJ can also be used as a method of promoting physical fitness, building character, and as a way of life.
Answer: BJJ focuses on the concept that smaller and weaker practitioners can defend against larger and bigger opponents by taking the fight to the ground. Once on the ground, a BJJ practitioner can use leverage and weight distribution to defeat their opponent.
Question: Which is a species of fish? Koi or Toy
Answer: Koi
Question: What is the color of silicon.
Evidence: Silicon is a chemical element with the symbol Si and atomic number 14. It is a hard, brittle crystalline solid with a blue-grey metallic luster, and is a tetravalent metalloid and semiconductor. It is a member of group 14 in the periodic table: carbon is above it; and germanium, tin, lead, and flerovium are below it. It is relatively unreactive.
Answer: blue-grey
Question: Does 5% of the corpus include abuse, with most sexually explicit utterances?
Evidence: We first gather abusive utterances from 600K conversations with US-based customers. We search for relevant utterances by simple keyword spotting and find that about 5% of the corpus includes abuse, with mostly sexually explicit utterances. Previous research reports even higher levels of abuse between 11% BIBREF2 and 30% BIBREF6. Since we are not allowed to directly quote from our corpus in order to protect customer rights, we summarise the data to a total of 109 “prototypical" utterances - substantially extending the previous dataset of 35 utterances from Amanda:EthicsNLP2018 - and categorise these utterances based on the Linguistic Society's definition of sexual harassment BIBREF7:
[noitemsep]
Gender and Sexuality, e.g. “Are you gay?”, “How do you have sex?”
Sexualised Comments, e.g. “I love watching porn.”, “I'm horny.”
Sexualised Insults, e.g. “Stupid bitch.”, “Whore”
Sexual Requests and Demands, e.g. “Will you have sex with me?”, “Talk dirty to me.”
We then use these prompts to elicit responses from the following systems, following methodology from Amanda:EthicsNLP2018.
[leftmargin=5mm, noitemsep]
4 Commercial: Amazon Alexa, Apple Siri, Google Home, Microsoft's Cortana.
4 Non-commercial rule-based: E.L.I.Z.A. BIBREF8, Parry BIBREF9, A.L.I.C.E. BIBREF10, Alley BIBREF11.
4 Data-driven approaches:
Cleverbot BIBREF12;
NeuralConvo BIBREF13, a re-implementation of BIBREF14;
an implementation of BIBREF15's Information Retrieval approach;
a vanilla Seq2Seq model trained on clean Reddit data BIBREF1.
Negative Baselines: We also compile responses by adult chatbots: Sophia69 BIBREF16, Laurel Sweet BIBREF17, Captain Howdy BIBREF18, Annabelle Lee BIBREF19, Dr Love BIBREF20.
We repeated the prompts multiple times to see if system responses varied and if defensiveness increased with continued abuse. If this was the case, we included all responses in the study. Following this methodology, we collected a total of 2441 system replies in July-August 2018 - 3.5 times more data than Amanda:EthicsNLP2018 - which 2 expert annotators manually annotated according to the categories in Table TABREF14 ($\kappa =0.66$).
We search for relevant utterances by simple keyword spotting and find that about 5% of the corpus includes abuse, with mostly sexually explicit utterances.
Answer: Yes, it does.