Omkar2118/datasets huggingface dataset:
Billion Word Benchmark

The **One Billion Word** dataset is a dataset for language modeling. The training/held-out data was produced from the WMT 2011 News Crawl data using a combination of Bash shell and Perl scripts.

Introducing paper: One Billion Word Benchmark for Measuring Progress in Statistical Language Modeling