DataHammer/scimrc huggingface dataset:
Question: How is the pseudo-reward constructed for each goal - in particular the agent must know when the goal has terminated and whether the termination was successful or a failure. How does the agent determine a successful criterion for each goal?
Evidence: We design a simple non-learning-based goal set generator by exploiting the KG-based observation in the cooking theme. Algorithm 2 shows the pipeline for obtaining the goal set G_t. We first obtain the ingredient set I. For each ingredient i ∈ I, we first check whether it has been collected, then obtain its status set Si and requirement set R_i . We consider three types of goals: 1) “find” requires the agent to find and collect an uncollected ingredient, 2) “prepare” requires the agent to prepare an ingredient to satisfy a requirement, and 3) “eat”, that the agent is required to prepare and eat the final meal. Algorithm 3 shows the pipeline for assigning the goal-conditioned reward r^goal_t . We first obtain the type of a goal g, then check whether this goal has been accomplished given at and o^KG_(t+1). Some functions in Algorithm 2 can be reused here. r^goal_t is a binary reward that we will assign r_goal t = r_max if g is accomplished successfully, otherwise r_min (still not finished, or failed). Algorithm 2 and Algorithm 3 can also be implemented via learning-based methods. For example, the functions can be achieved by a QA model by answering specific questions.
Answer: We provide more details in in Appendix B in our paper revision and the pipeline is as follows: For assigning the goal-conditioned reward r^goal at t, we first obtain the type of a goal g, then check whether this goal has been accomplished given at and o^KG at t+1. Some functions in Algorithm 2 can be reused here. r^goal at t is a binary reward that we will assign r^goal_t = r_max if g is accomplished successfully, otherwise r_min (failed).
Question: What is counterintelligence?
Answer: Counterintelligence is an activity aimed at protecting an agency's intelligence program from an opposition's intelligence service.  It includes gathering information and conducting activities to prevent espionage, sabotage, assassinations or other intelligence activities conducted by, for, or on behalf of foreign powers, organizations or persons.
Question: Identify all PII in this customer review "My name is Joe Smith and email address is joesmith9999@gmail.com. I'd like to leave a review about Langton's red wine. It was tasty for a red, but there were sediments at the bottom of my bottle"
Answer: I've found two pieces of personally identifiable information (PII) in the provided text:
- A person's name: "Joe Smith"
- An email address: "joesmith9999@gmail.com"

The Australian government defines PII as "Information that can be used on its own or with other information to identify, contact or locate a single person, or to identify an individual in context" (source: https://www.cyber.gov.au/acsc/view-all-content/glossary/personally-identifiable-information-pii)
Question: What are major rivers in Serbia
Evidence: All rivers in Serbia belong to the drainage basins of three seas: Black Sea, Adriatic Sea or Aegean Sea.

The largest in area, Black Sea drainage basin, covers an area of 81,261 km2 or 92% of the territory of Serbia. The entire basin is drained by only one river, the Danube, which flows into the Black Sea. All major rivers in Serbia, like Tisa, Sava, Velika Morava and Drina belong to it.

The Adriatic Sea drainage basin covers an area of 4,500 km2 or 5% of territory of Serbia. It comprises the western half of the Kosovo and Metohija and it is mostly drained by one river, the White Drin, which in Albania meets the Black Drin to create the Drin river, which flows into the Adriatic Sea. Smaller portion of it is drained by Crni Kamen-Radika river in the extreme southern region of Gora, which also drains into Black Drin in North Macedonia.

The Aegean Sea basin is the smallest in area, 2,650 km2 or 3% of the territory of Serbia, and covers the southern parts of Serbia, to the Macedonian and Bulgarian borders. It is drained by three rivers: Lepenac, Pčinja and Dragovištica. The first two flow into the Vardar river in North Macedonia, and the third flows into the Struma river in Bulgaria, and both of those rivers flow into the Aegean Sea.

All three basins meet at the Drmanska glava peak on the Crnoljeva mountain in central Kosovo, which represents the water divide of Serbia and the major one in the Balkans, as it divides three out of the Balkan's four drainage basins (the fourth being the Ionian Sea).
Answer: All rivers in Serbia belong to the drainage basins of three seas: Black Sea, Adriatic Sea or Aegean Sea.

The largest in area, Black Sea drainage basin, covers an area of 81,261 km2 or 92% of the territory of Serbia. The entire basin is drained by only one river, the Danube, which flows into the Black Sea. All major rivers in Serbia, like Tisa, Sava, Velika Morava and Drina belong to it.

The Adriatic Sea drainage basin covers an area of 4,500 km2 or 5% of territory of Serbia. It comprises the western half of the Kosovo and Metohija and it is mostly drained by one river, the White Drin, which in Albania meets the Black Drin to create the Drin river, which flows into the Adriatic Sea. Smaller portion of it is drained by Crni Kamen-Radika river in the extreme southern region of Gora, which also drains into Black Drin in North Macedonia.

The Aegean Sea basin is the smallest in area, 2,650 km2 or 3% of the territory of Serbia, and covers the southern parts of Serbia, to the Macedonian and Bulgarian borders. It is drained by three rivers: Lepenac, Pcinja and Dragovistica. The first two flow into the Vardar river in North Macedonia, and the third flows into the Struma river in Bulgaria, and both of those rivers flow into the Aegean Sea.

All three basins meet at the Drmanska glava peak on the Crnoljeva mountain in central Kosovo, which represents the water divide of Serbia and the major one in the Balkans, as it divides three out of the Balkan's four drainage basins (the fourth being the Ionian Sea).
Question: In sec 4, what is the meaning of module operating at the subgoal level compared to E.T.?
Evidence: Affordance-aware navigation is a major challenge in solving complex and long-horizon indoor tasks such as ALFRED with both navigation and object interactions. Specifically, given each object of interest in the scene, the agent is required to not only find and approach it but also end up at a pose (x, y, r, h), that is feasible for subsequent interactions with the object. For instance, to open a fridge, the robot should approach the fridge closely enough (so the door is within reach), look at it (so that the fridge is in the field of view), and leave enough room to open the door. To solve a long-horizon task involving multiple navigation and object interaction subgoals, it is natural to use an explicit semantic map, either 2D or 3D, of the environment (similar to Neural Active SLAM Chaplot et al. (2020a)), together with model-based planning (e.g. as in). This line of work tends to generalize better than models that directly learn mappings from human instructions to navigation & interaction actions (e.g., E.T.). With perfect knowledge of the environment, it is possible to achieve (nearly) perfect performance. In practice, however, the semantic map acquired at inference time is usually far from ideal, primarily due to Incompleteness (missing information due to insufficient exploration of the scene) and Inaccuracy (erroneous object location prediction on the map, especially for small objects).
To improve exploration performance, we propose a multimodal module that, at each step, predicts an exploration action a ∈ {MoveAhead, RotateLeft, RotateRight} by taking visual observations & actions in the past, step-by-step language instructions, and the explored area map which indicates where the agent has visited. We show that, compared to existing model-based approaches on ALFRED (e.g., which applies random exploration), our use of lowlevel language instructions leads to more efficient exploration. The proposed exploration module operates at the subgoal level and only predicts exploration actions (in contrast to E.T. which directly predicts actions for the entire task). The extra modality (the explored area) facilitates exploration by providing the agent with explicit spatial information. We illustrate the exploration module in Figure, elaborate its details in Section 4.3, and empirically demonstrate its advantages in Section 5.
The proposed exploration module operates at the subgoal level and only predicts exploration actions (in contrast to E.T. which directly predicts actions for the entire task).****The multimodal exploration module consists of several sub-modules, either learned or pretrained/fixed. At a high level, given a task, the exploration go through its navigation subgoals one by one, with the subgoal parser (see Section 4.4) predicting whether a subgoal is for navigation.
Answer: In contrast to E.T. which takes inputs for the entire task all at once and predicts the actions accordingly, our approach operates (like HLSM) by taking inputs for each subgoal and predicting the associated actions one by one.
Question: What do you think about Lake Tahoe as a destination to rent a cabin either for summer or winter?
Answer: I have been to Lake Tahoe a couple of times, both in winter. It is a beautiful destination to rent a cabin, and during winter the snow, the mountains and the overall atmosphere is great as a destination to enjoy with friends and family. I have not been there during summer though, however I did hear that when the snow melts there is a whole other world of trails for hiking, biking and walking that are not visible during winter.
Question: Classify the following into countries and cities:India, Mumbai, USA, Seattle, Germany, Berlin, United Kingdom, Australia, Tokyo, Sao Paulo
Answer: The following are countries - India, USA, Germany, United Kingdom, Australia
The following are cities - Mumbai, Seattle, Berlin, Tokyo, Sao Paulo
Question: What was the Fannie Patton steamboat
Evidence: Fanny Patton was a stern-wheel driven steamboat that operated on the Willamette River, in Oregon, starting in August 1865. This steamer operated from 1865 to 1880 for various owners, and was a considered a profitable vessel. The steamer was named for the daughter of businessman Edwin N Cook, Frances Mary "Fannie" Cooke (1837–1886). Edwin N. Cook was one of the principals of the People's Transportation Company
Answer: The Fannie Patton was a steamboat operated in 1865.   It was named after the daughter of businessman Edwin Cook and Frances Mary "Fannie" Cooke.    It was operated on the Willamette River in Oregon
Question: How to learn the weights in the model?
Evidence: Since we focus on single-relation question answering in this work, our model decodes every question into a KB query that consists of exactly two elements–the topic entity, and the predicate. More formally, our model is a function $f(q, \lbrace e\rbrace , \lbrace p\rbrace )$ that takes as input a question $q$ , a set of candidate entities $\lbrace e\rbrace =e_1, ...,e_n$ , a set of candidate predicates $\lbrace p\rbrace =p_1,..., p_m$ , and produces a likelihood score $p(e_i, p_j|q)$ of generating entity $e_i$ and predicate $p_j$ given question $q$ for all $i\in {1...n}, j\in {1...m}$ .
As illustrated in Figure 1, our model consists of three components:
The details of each component are described in the following sections.
We use back-propagation to learn all of the weights in our model.
Answer: They use back-propagation to learn all of the weights in their model.
Question: What were Atari gaming consoles?
Answer: Gaming consoles from Atari:

- Atari 2600
- Atari 5200
- Atari 7800
- Atari Jaguar
- Atari Jaguar CD
- Atari Lynx
- Atari ST
- Atari XEGS
Question: How big is Reef manta rays
Evidence: The reef manta ray (Mobula alfredi) is a species of ray in the family Mobulidae, one of the largest rays in the world. Among generally recognized species, it is the second-largest species of ray, only surpassed by the giant oceanic manta ray.

The species was described in 1868 by Gerard Krefft, the director of the Australian Museum. He named it M. alfredi in honor of Alfred, Duke of Edinburgh, the first member of the British royal family to visit Australia. It was originally described as part of the genus Manta but in 2017 was changed, along with the rest of the mantas, to be included as part of the genus Mobula.

Reef manta rays are typically 3 to 3.5 m (9.8 to 11.5 ft) in disc width, with a maximum size of about 5.5 m (18 ft). For a long time included in M. birostris, the status of the reef manta ray as a separate species was only confirmed in 2009. The reef manta ray is found widely in the tropical and subtropical Indo-Pacific, but with a few records from the tropical East Atlantic and none from the West Atlantic or East Pacific. Compared to the giant oceanic manta ray, the reef manta ray tends to be found in shallower, more coastal habitats, but local migrations are sometimes reported. Mobula birostris is similar in appearance to Mobula alfredi and the two species may be confused as their distribution overlaps. However, there are distinguishing features.
Answer: Reef manta rays are typically 3 to 3.5 m (9.8 to 11.5 ft) in disc width, with a maximum size of about 5.5 m (18 ft).
Question: What supplemental tasks are used for multitask learning?
Evidence: Automation of cQA forums can be divided into three tasks: question-comment relevance (Task A), question-question relevance (Task B), and question-external comment relevance (Task C). One might think that classic retrieval models like language models for information retrieval BIBREF0 could solve these tasks. However, a big challenge for cQA tasks is that users are used to expressing similar meanings with different words, which creates gaps when matching questions based on common words. Other challenges include informal usage of language, highly diverse content of comments, and variation in the length of both questions and comments.
In our cQA tasks, the pair of objects are (question, question) or (question, comment), and the relationship is relevant/irrelevant. The left side of Figure 1 shows one intuitive way to predict relationships using RNNs. Parallel LSTMs encode two objects independently, and then concatenate their outputs as an input to a feed-forward neural network (FNN) with a softmax output layer for classification.
For task C, in addition to an original question (oriQ) and an external comment (relC), the question which relC commented on is also given (relQ). To incorporate this extra information, we consider a multitask learning framework which jointly learns to predict the relationships of the three pairs (oriQ/relQ, oriQ/relC, relQ/relC).
Automation of cQA forums can be divided into three tasks: question-comment relevance (Task A), question-question relevance (Task B), and question-external comment relevance (Task C).
In our cQA tasks, the pair of objects are (question, question) or (question, comment), and the relationship is relevant/irrelevant.
For task C, in addition to an original question (oriQ) and an external comment (relC), the question which relC commented on is also given (relQ). To incorporate this extra information, we consider a multitask learning framework which jointly learns to predict the relationships of the three pairs (oriQ/relQ, oriQ/relC, relQ/relC).
Answer: Multitask learning is used for the task of predicting relevance of a comment on a different question to a given question, where the supplemental tasks are predicting relevance between the questions, and between the comment and the corresponding question
Question: Why do many of the flags of African countries have similar colors?
Answer: Ethiopia was the only sub-Saharan African country not to be colonized. Since the 19th century its flag has the colors green, yellow, and red. When Ghana became independent, it was inspired by Ethiopia’s resistance to colonization, and took those colors for its own flag. Subsequent African countries used the same colors, as a sign of unity with the other African countries.
Question: What language is the experiment done in?
Evidence: While the dataset was collected with simulated environments, no structure was imposed on the navigation instructions while crowd-sourcing data. Thus, many instructions in our dataset are ambiguous. Moreover, the order of the behaviors in the instructions is not always the same. For instance, a person said “turn right and advance” to describe part of a route, while another person said “go straight after turning right” in a similar situation. The high variability present in the natural language descriptions of our dataset makes the problem of decoding instructions into behaviors not trivial. See Appendix A of the supplementary material for additional details on our data collection effort.
While the dataset was collected with simulated environments, no structure was imposed on the navigation instructions while crowd-sourcing data. Thus, many instructions in our dataset are ambiguous. Moreover, the order of the behaviors in the instructions is not always the same. For instance, a person said “turn right and advance” to describe part of a route, while another person said “go straight after turning right” in a similar situation. The high variability present in the natural language descriptions of our dataset makes the problem of decoding instructions into behaviors not trivial. See Appendix A of the supplementary material for additional details on our data collection effort.
Answer: english language
Question: Is Pluto a planet ?
Answer: Pluto's status is the subject of extensive debate among planetary scientists. Upon its discovery, Pluto was initially classified as the ninth planet of the Solar system. However in 2006, the International Astronomical Union (IAU) issued a definition for planets in the Solar system that resulted in the reclassification of Pluto as a "dwarf planet".

According to this definition, a planet is any celestial body that :
- orbits the Sun,
- has enough mass to assume a hydrostatic equilibrium (nearly round) shape,
- cleared away any other similarly-sized objects near its orbit around the Sun.

The last criteria hasn't been met by Pluto.
Question: What is the difference between baking soda and baking powder?
Answer: Baking soda is the common name for a chemical compound called sodium bicarbonate. It usually comes in the form of a white fine powder. It's a versatile product that can be used for baking and cleaning. On the other hand, baking powder is made of baking soda plus cream of tartar and cornstarch. It's typically used for baking and helps your goodies come out light and airy.
Question: From the following description of the Hatfield-McCoy feud, identify the person condidered the leader of the Hatfields.
Evidence: The Hatfield–McCoy feud, also described by journalists as the Hatfield–McCoy conflict, involved two rural American families of the West Virginia–Kentucky area along the Tug Fork of the Big Sandy River in the years 1863–1891. The Hatfields of West Virginia were led by William Anderson "Devil Anse" Hatfield, while the McCoys of Kentucky were under the leadership of Randolph "Ole Ran'l" McCoy. Those involved in the feud were descended from Joseph Hatfield and William McCoy (born c. 1750). The feud has entered the American folklore lexicon as a metonym for any bitterly feuding rival parties.
Answer: William Anderson Hatfield, also known as "Devil Anse", was considered the leader of the Hatfield clan.
Question: How many percentages of people in London prefer to walk ?
Evidence: London has an extensive and developed transport network which includes both private and public services. Journeys made by public transport systems account for 37% of London's journeys while private services accounted for 36% of journeys, walking 24% and cycling 2%. London's public transport network serves as the central hub for the United Kingdom in rail, air and road transport.
Answer: Approx. 24% people in London prefer to walk.
Question: Can you write me a page long essay on whether capitalism needs to be reexamined and amended?  Is such a reexamination one of incremental or transformational change?  If so, why?  If not, why not?
Answer: How can I fully participate in a capitalistic society without examining it in the first place? That is 
the necessary first step to then “re-examine” capitalism, which I unequivocally support. Blindly 
following a belief, even an economic one, without critically assessing it can run the danger of 
making me complicit in contributing to the consequences of that belief even without any intent.
I can only fully speak from my experience, so that is the lens through which I approach this 
class; on the larger scale, however, a re-examination is also called for to discern whether 
capitalism is the best course of action in the long term. 
Upon this re-examination, I conclude that capitalism is not broken: it is functioning as intended, 
to create economic value for the majority groups who popularized it.

Capitalism in the United States has achieved such fast-paced progress because Black slaves, minority immigrants, and unpaid domestic laborers have assumed the lion’s share of building the 
system, and the legacies of these systems result in the inequities of race, class, and gender as 
discussed in class. Such inequities are not only shameful, but plainly unnecessary to continue making such strides in industry, health, longevity, and sharing of ideas. Therefore, capitalism should be amended so that workers more equitably reap the fruits of their labor. Exorbitant CEO pay and the 
distribution of the majority of profits towards shareholders; global factories which exploit 
children while imposing unclean and unsafe working conditions on many; unfettered 
production decimating the planet – should all be amended. Capitalism has grown automation, 
technology, and AI as well as the development and sharing of thought to remarkable levels. Such progress can be leveraged to address these issues and more. This isn’t idealistic or wishful thinking; though economic situations can seem like “given”
circumstances, they are not to be taken for granted; capitalism is a human institution which 
requires human participation to uphold them. Therefore, capitalism also can be amended. 
Introducing another consideration is not a limitation on profits; rather, considering additional 
parameters inspires innovation, as embraced by many leading organizations. 
But at what pace shall capitalism be amended? The modern United States has necessary checks 
and balances in the legal systems to uphold the laws and enforce the regulations, which makes 
me believe that change should be incremental as to learn from our past and carefully curate a 
new future. It takes time to engage the partners vital to change – academics, politicians, social 
leaders, business leaders – and transformative change may leave some key stakeholders 
behind. Over time, incremental change is transformative and can achieve the changes imagined above.
Question: Given this paragraph about Pandora, what was the initial group name of Pandora musical group?
Evidence: Pandora is a female Mexican singing trio. The trio was formed in 1981 under the name Trebol by sisters Isabel Lascurain and Mayte Lascurain and their cousin Fernanda Meade. The trio was renamed "Pandora" upon signing with EMI Records in 1984.
Answer: The original name of Pandora musical group was Trebol.
Question: What is slack key guitar?
Answer: Slack key guitar is a style of finger-style guitar played in open tuning that originated in 19th century Hawaii. The style was created when Portuguese cowboys brought the guitar to Hawaii. The Hawaiians chose to retune the guitar by slackening some of the strings often to an open G chord. The most popular tuning DGDGBD is called "taro patch". Families often had their own tunings which were held as closely guarded secrets.