Hugging Face's logo

manueldeprada
/
t5-cord19

Text2Text Generation Transformers PyTorch t5 Inference Endpoints text-generation-inference
Model card Files Community
1
Edit model card
YAML Metadata Warning: empty or missing yaml metadata in repo card (https://huggingface.co/docs/hub/model-cards#model-card-metadata)

T5-base pretrained on CORD-19 dataset

The model has been pretrained on text and abstracts from the CORD-19 dataset, using a manually implemented denoising objetive similar to the original T5 denoising objective.

Model needs to be finetuned on downstream tasks.

Code avaliable in github: https://github.com/manueldeprada/Pretraining-T5-PyTorch-Lightning.

Downloads last month
6