metadata
language: en
datasets:
- scientific_papers
license: apache-2.0
Introduction
Allenai's Longformer Encoder-Decoder (LED).
This is an unofficial led-large-16384 checkpoint that is fine-tuned on the pubmed dataset.
The model was fine-tuned and evaluated as detailed in this notebook
Results
The model achieves a Rouge-2 score of 19.33 on Pubmed which is competitive to state-of-the-art models.