Manuel de Prada
commited on
Commit
•
0559d41
1
Parent(s):
0730831
Create README.md
Browse files
README.md
ADDED
|
@@ -0,0 +1,7 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# T5-base pretrained on CORD-19 dataset
|
| 2 |
+
|
| 3 |
+
The model has been pretrained on text and abstracts from the CORD-19 dataset, using a manually implemented denoising objetive similar to the original T5 denoising objective.
|
| 4 |
+
|
| 5 |
+
Model needs to be finetuned on downstream tasks.
|
| 6 |
+
|
| 7 |
+
Code avaliable in github shortly.
|