# T5-base pretrained on CORD-19 dataset

The model has been pretrained on text and abstracts from the CORD-19 dataset, using a manually implemented denoising objetive similar to the original T5 denoising objective.

Model needs to be finetuned on downstream tasks.

Code avaliable in github shortly.