- How was the data associated with each instance acquired? The data (text) were transcribed from research papers. Papers sometimes would display multiple segments of the text in a table. Therefore, we assemble the text according to the table and experimental settings. We do have to interpret the experimental results based on the paper's table/figures. When papers report an actual mean response score, we add them to the data file (comment section); when the paper doesn't report a mean response score but instead provides a bar plot of ratings, we try to read the height of the bar. Note that since we binarize the responses to "Yes" and "No" - we only need to compare the bar height to the median height, which is relatively easy to do.
- What mechanisms or procedures were used to collect the data (e.g., hardware apparatus or sensor, manual human curation, software program, software API)? Data were collected by two graduate students. Follow-up factor annotation was conducted on TagTog.
- If the dataset is a sample from a larger set, what was the sampling strategy (e.g., deterministic, probabilistic with specific sampling probabilities)? N/A
- Who was involved in the data collection process (e.g., students, crowd workers, contractors) and how they were compensated (e.g., how much were crowd workers paid)? Two graduate students are the data collectors. One of them is the lead author of the paper, who does not seek compensation. The other one is compensated at  $15/hr. The data collection process took about 70 hours, and are compensated for$ 1025 in total. The additional text span annotation took about 20 hours for $25/hr and is compensated for $500 in total. We additionally use Prolific to collect 25 human responses for each story for $12/hr rate. In total, Prolific workers were compensated for $2500 in total for 205 hours of annotation work.
- Over what timeframe was the data collected? Does this The original papers of the dataset were published between 1976 to 2021. We transcribed the data between March 2021 and August 2021. The text segment annotation happened between March 2022 and May 2022. The Prolific crowdsourcing annotation happened during the month of September 2022.
- Were any ethical review processes conducted (e.g., by an institutional review board)? Yes, we obtained IRB approval for our study.
- Does the dataset relate to people? Explained above.
- Did you collect the data from the individuals in question directly, or obtain it via third parties or other sources (e.g., websites)? We accessed the papers through the paper publisher's websites. Our dataset does not include a copy of the original paper, except we do provide a comment that links each data to which paper it was transcribed from.
- Were the individuals in question notified about the data collection? Yes. We have a consent and notification form at the beginning of every study.
- Did the individuals in question consent to the collection and use of their data? Yes. We have a consent form at the beginning of every study.
- If consent was obtained, was the consenting individuals provided with a mechanism to revoke their consent in the future or for certain uses? Yes, on the consent form, we provide the email, phone number, and address of the primary investigator (PI) for the participants to contact.