Omkar2118/datasets huggingface dataset:
Linked WikiText-2

The Linked Wikitext-2 language modeling dataset contains over 2 million tokens from Wikipedia articles, along with annotations linking mentions to their corresponding entities and relations in Wikidata. It is designed to match as closely as possible the contents of the popular WikiText-2 dataset.

Introducing paper: Barack's Wife Hillary: Using Knowledge Graphs for Fact-Aware Language Modeling