DOI: 10.5281/zenodo.13844985
title: Data and code associated with "Do We Have a Reproducibility Crisis: How Available is Data and Code Across Journals in Artificial Intelligence and Earth Sciences?"

description: Data and code associated with "Do We Have a Reproducibility Crisis: How Available is Data and Code Across Journals in Artificial Intelligence and Earth Sciences?" by Erin A. Jones,Brandon McClung, Hadi Fawad, and Amy McGovern.

Code:BAMS_plot.py: Code for categorizing data availability statements based on given data              documented below and creating figures 1 and 2. For additional documentation,               please see code file.

Data:DAS_AIES.csv:      CSV file containing relevant data availability statement data for Artificial                    Intelligence for the Earth Systems (AIES)DAS_AI_in_Geo.csv: CSV file containing relevant data availability statement data for Artificial                    Intelligence in Geosciences (AI in Geo.)DAS_AIJ.csv:       CSV file containing relevant data availability statement data for Artificial                    Intelligence (AIJ)DAS_MWR.csv:       CSV file containing relevant data availability statement data for Monthly                    Weather Review (MWR)

Data documentation:All CSV files contain the same format of information for each journal. The CSV files above are needed for the BAMS_plot.py code attached.

Records were analyzed based on the criteria below.

  Records:    1) Title of paper        The title of the examined journal article.    2) Article DOI (or URL)        A link to the examined journal article. For AIES, AI in Geo., MWR, the DOI is         generally given. For AIJ, the URL is given.    3) Journal name        The name of the journal where the examined article is published. Either a full        journal name (e.g., Monthly Weather Review), or the acronym used in the         associated paper (e.g., AIES) is used.    4) Year of publication        The year the article was posted online/in print.    5) Is there a DAS?        If the article contains a DAS in any form, "yes" is recorded. Otherwise, "no"        is recorded.    6) Justification for non-open data?        If a data availability statement contains some justification for why data is        not openly available, the justification is summarized and recorded. If the         statement indicates any data is not openly available and no justification is        provided, or if no statement is provided is provided "None" is recorded. If         the statement indicates openly available data or no data produced, "N/A" is         recorded.    6) All data available        If there is a data availability statement and data is produced, "y" is         recorded if means to access data associated with the article are given and         there is no indication that any data is not openly available; "n" is recorded        if no means to access data are given or there is some indication that some        or all data is not openly available. If there is no data availability        statement or no data is produced, the record is left blank.    7) At least some data available        If there is a data availability statement and data is produced, "y" is        recorded if any means to access data associated with the article are given;        "n" is recorded if no means to access data are given. If there is no data         availability statement or no data is produced, the record is left blank.    8) All code available        If there is a data availability statement and data is produced, "y" is         recorded if means to access code associated with the article are given and         there is no indication that any code is not openly available; "n" is recorded        if no means to access code are given or there is some indication that some        or all code is not openly available. If there is no data availability        statement or no data is produced, the record is left blank.    9) At least some code available        If there is a data availability statement and data is produced, "y" is        recorded if any means to access code associated with the article are given;        "n" is recorded if no means to access code are given. If there is no data         availability statement or no data is produced, the record is left blank.    10) All data available upon request        If there is a data availability statement indicating data is produced and no        data is openly available, "y" is recorded if any data is available upon         request to the authors of the examined journal article (not a request to any         other entity); "n" is recorded if no data is available upon request to the         authors of the examined journal article. If there is no data availability         statement, any data is openly available, or no data is produced, the record        is left blank.    11) At least some data available upon request        If there is a data availability statement indicating data is produced and not         all data is openly available, "y" is recorded if all data is available upon         request to the authors of the examined journal article (not a request to any         other entity); "n" is recorded if not all data is available upon request to         the authors of the examined journal article. If there is no data availability         statement, all data is openly available, or no data is produced, the record        is left blank.    12) no data produced        If there is a data availability statement that indicates that no data was        produced for the examined journal article, "y" is recorded. Otherwise, the        record is left blank.    13) links work        If the data availability statement contains one or more links to a data or         code repository, "y" is recorded if all links work; "n" is recorded if one or        more links do not work. If there is no data availability statement or the        statement does not contain any links to a data or code repository, the record        is left blank.