Spaces:
Running
Running
typo
Browse files- introduction.md +3 -3
introduction.md
CHANGED
@@ -80,10 +80,10 @@ reason of this choice. With the few images (wrt OpenAI) that we have, we cannot
|
|
80 |
but the captions have to be handled accordingly. We translated 700K captions and we evaluated their quality:
|
81 |
|
82 |
Three of us looked at a sample of 100 of the translations and rated them with scores from 1 to 4.
|
83 |
-
|
84 |
-
but there something wrong; 3
|
85 |
|
86 |
-
The average score was of 3.78 and the
|
87 |
weighting - of 0.858 (great agreement!).
|
88 |
|
89 |
| English Captions | Italian Captions |
|
|
|
80 |
but the captions have to be handled accordingly. We translated 700K captions and we evaluated their quality:
|
81 |
|
82 |
Three of us looked at a sample of 100 of the translations and rated them with scores from 1 to 4.
|
83 |
+
The meaning of the value is as follows: 1, the sentence has lost is meaning or it's not possible to understand it; 2, it is possible to get the idea
|
84 |
+
but there something wrong; 3, good, however a native speaker might complain about some translations; 4, good translation.
|
85 |
|
86 |
+
The average score was of 3.78 and the three annotators had an inter-rater agreement - computed with [Gwet's AC1](https://bpspsychub.onlinelibrary.wiley.com/doi/full/10.1348/000711006X126600) using ordinal
|
87 |
weighting - of 0.858 (great agreement!).
|
88 |
|
89 |
| English Captions | Italian Captions |
|