---
license: apache-2.0
datasets:
- Open-Orca/FLAN
language:
- en
pipeline_tag: text2text-generation
---

T5-small distilled from T5-flan-base using OpenOrca'a FLAN dataset using Seq2seq methodology. The baseline for Seq2seq distillation on T5 decoder models. It is free under Apache License.

The distilled model is a T5-small model with 60M parameters, not a T5-flan-small model.