Spaces:

akoksal

/

LongForm-OPT-125M

like 3

Running

This model is based on our recent LongForm paper: https://arxiv.org/abs/2304.08460. We collect corpora examples, generate instructions for them, and train a different set of language models (OPT, LLaMA, T5). We show that LongForm models outperform prior instruction-tuned models such as FLAN-T5 and Alpaca on long text generation tasks.