DOI: 10.5281/zenodo.6841258
title: Dataset of the deleted DOIs extracted from the difference set between Crossref DOIs as of March 2017 and January 2021

description: <strong>Abstract</strong> Digital Object Identifiers (DOIs) are regarded as persistent; however, they are sometimes deleted. Deleted DOIs are an important issue not only for persistent access to scholarly content but also for bibliometrics, because they may cause problems in correctly identifying scholarly articles. However, little is known about how much of deleted DOIs and what causes them. We identified deleted DOIs by comparing the datasets of all Crossref DOIs on two different dates, investigated the number of deleted DOIs in the scholarly content along with the corresponding document types, and analyzed the factors that cause deleted DOIs. Using the proposed method, 708,282 deleted DOIs were identified. The majority corresponded to individual scholarly articles such as journal articles, proceedings articles, and book chapters. There were cases of many DOIs assigned to the same content, e.g., retracted journal articles and abstracts of international conferences. We show the publishers and academic societies which are the most common in deleted DOIs. In addition, the top cases of single scholarly content with a large number of deleted DOIs were revealed. The findings of this study are useful for citation analysis and altmetrics, as well as for avoiding deleted DOIs. <strong>Data Records</strong> The data format of the dataset is JSON lines, where each line is a single record. In this dataset, we identified the deleted DOIs by from the difference set between Crossref DOIs as of March 2017 and January 2021. We note that the file "00_Non-Crossref_DOIs.jsonl.gz" is not deleted DOIs but other files are deleted DOIs. Please refer the conference paper shown in the references for details. Sample of the record is the following. doi -- DOI name (String), e.g., "10.xxxx/xxxx" whichRA -- Registration agency name or error message for the DOI name according to the “whichRA?.” (String). "Airiti," "Crossref," "DOI does not exist," "DataCite," "KISTI," "Public," or "mEDRA." redirects -- Redirected URIs for the DOI name obtained by curl command (Array of String), e.g., ["https://doi.org/10.1001/archinte.166.4.387","http://archinte.jamanetwork.com/article.aspx?doi=10.1001/archinte.166.4.387"] redirect_to_other_doi -- The other DOI when the DOI link redirects to. (Array of String), e.g., "[10.1001/archinte.166.4.387]" timestamp -- Date the data was retrieved (Datetime), "2022-01-30T02:10:45Z" label -- The group where the DOI belongs to. Alias DOIs," "DOIs with Deleted Description in Metadata," "DOIs without Redirects," "Defunct DOIs," "Non-Crossref DOIs," "Non-existing DOIs," or "Other DOIs." As for the file "04_DOIs_with_Deleted_Description_on_Metadata.jsonl.gz," additional records are available as follows. alias_doi -- Alias DOI name, the same as the value of "doi." (String), e.g., "10.1007/bf00400428." primary_doi -- Primary DOI name for the alias DOI name, the same as the first value of "redirect_to_other_doi". (String), e.g., "10.1007/bf00400429" container_title_of_alias_doi -- the container title for the alias DOI according to the Crossref REST API. e.g., "CrossRef Listing of Deleted DOIs." title_of_alias_doi -- the title for the alias DOI according to the Crossref REST API. e.g., "CrossRef Listing of Deleted DOIs." container_title_of_primary_doi -- the container title for the primary DOI according to the Crossref REST API. e.g., "CrossRef Listing of Deleted DOIs." title_of_alias_doi -- the title for the primary DOI according to the Crossref REST API. e.g., "CrossRef Listing of Deleted DOIs." <strong>References</strong> Kikkawa, J., Takaku, M. & Yoshikane, F. "Analysis of the deletions of DOIs: What factors undermine their persistence and to what extent?", Proceedings of the 26th International Conference on Theory and Practice of Digital Libraries (<em>TPDL 2022</em>), (to appear), 2022. <strong>FUNDING</strong> JSPS KAKENHI Grant Number JP21K21303, JP22K18147, JP20K12543, and JP21K12592