Commit
β’
084ecaa
1
Parent(s):
cc917ab
Update README.md
Browse files
README.md
CHANGED
@@ -1,7 +1,15 @@
|
|
1 |
---
|
2 |
license: apache-2.0
|
3 |
datasets:
|
4 |
-
- hl
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
5 |
|
6 |
library_name: pytorch
|
7 |
tags:
|
@@ -11,11 +19,11 @@ tags:
|
|
11 |
|
12 |
# Model Card: VinVL for Captioning πΌοΈ
|
13 |
|
14 |
-
[Microsoft's VinVL](https://github.com/microsoft/Oscar) base fine-tuned on [HL
|
15 |
|
16 |
# Model fine-tuning ποΈβ
|
17 |
|
18 |
-
The model has been finetuned for 10 epochs on the scenes captions of the [HL]()
|
19 |
|
20 |
# Test set metrics π
|
21 |
|
@@ -115,5 +123,16 @@ Please consider citing the original project and the VinVL paper
|
|
115 |
pages={5579--5588},
|
116 |
year={2021}
|
117 |
}
|
118 |
-
|
119 |
```
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
---
|
2 |
license: apache-2.0
|
3 |
datasets:
|
4 |
+
- michelecafagna26/hl
|
5 |
+
language:
|
6 |
+
- en
|
7 |
+
metrics:
|
8 |
+
- sacrebleu
|
9 |
+
- rouge
|
10 |
+
- meteor
|
11 |
+
- spice
|
12 |
+
- cider
|
13 |
|
14 |
library_name: pytorch
|
15 |
tags:
|
|
|
19 |
|
20 |
# Model Card: VinVL for Captioning πΌοΈ
|
21 |
|
22 |
+
[Microsoft's VinVL](https://github.com/microsoft/Oscar) base fine-tuned on [HL dataset](https://arxiv.org/abs/2302.12189?context=cs.CL) for **scene description generation** downstream task.
|
23 |
|
24 |
# Model fine-tuning ποΈβ
|
25 |
|
26 |
+
The model has been finetuned for 10 epochs on the scenes captions of the [HL dataset](https://arxiv.org/abs/2302.12189?context=cs.CL) (available on π€ HUB: [michelecafagna26/hl](https://huggingface.co/datasets/michelecafagna26/hl))
|
27 |
|
28 |
# Test set metrics π
|
29 |
|
|
|
123 |
pages={5579--5588},
|
124 |
year={2021}
|
125 |
}
|
|
|
126 |
```
|
127 |
+
And the HL Dataset paper
|
128 |
+
|
129 |
+
```BibTeX
|
130 |
+
@inproceedings{cafagna2023hl,
|
131 |
+
title={{HL} {D}ataset: {V}isually-grounded {D}escription of {S}cenes, {A}ctions and
|
132 |
+
{R}ationales},
|
133 |
+
author={Cafagna, Michele and van Deemter, Kees and Gatt, Albert},
|
134 |
+
booktitle={Proceedings of the 16th International Natural Language Generation Conference (INLG'23)},
|
135 |
+
address = {Prague, Czech Republic},
|
136 |
+
year={2023}
|
137 |
+
}
|
138 |
+
```
|