---
license: mit
datasets:
- wikipedia
language:
- en
metrics:
- perplexity
pipeline_tag: fill-mask
---
# Data Efficient Neural Scaling Law

Peihao Wang, Rameswar Panda, Zhangyang Wang

Pre-trained checkpoints to reproduce ICML 2023 paper [Data Efficient Neural Scaling Law](https://openreview.net/pdf?id=iXYnIz4RRx)