Omkar2118/datasets huggingface dataset:
unarXive

A scholarly data set with publications’ full-text, annotated in-text citations, and links to metadata.

The unarXive data set contains

* One million papers in plain text
* 63 million citation contexts
* 39 million reference strings
* A citation network of 16 million connections

The data is generated from all LaTeX sources on [arXiv](https://arxiv.org/) from 1991–2020/07 and therefore of higher quality than data generated from PDF files.
Furthermore, as all citing papers are available in full text, citation contexts of arbitrary size can be extracted.

Typical uses of the data set are approaches in

* Citation recommendation
* Citation context analysis
* Reference string parsing

The code for generating the data set is [publicly available](https://github.com/IllDepence/unarXive).

Introducing paper: unarXive: A Large Scholarly Data Set with Publications' Full-Text, Annotated In-Text Citations, and Links to Metadata