vinid commited on
Commit
dbb7dfd
1 Parent(s): afcb809
Files changed (1) hide show
  1. introduction.md +3 -3
introduction.md CHANGED
@@ -80,10 +80,10 @@ reason of this choice. With the few images (wrt OpenAI) that we have, we cannot
80
  but the captions have to be handled accordingly. We translated 700K captions and we evaluated their quality:
81
 
82
  Three of us looked at a sample of 100 of the translations and rated them with scores from 1 to 4.
83
- 1: the sentence has lost is meaning or it's not possible to understand it; 2: it is possible to get the idea
84
- but there something wrong; 3: good, however a native speaker might complain about some translations; 4: good translation.
85
 
86
- The average score was of 3.78 and the two annotators had an inter-rater agreement - computed with [Gwet's AC1](https://bpspsychub.onlinelibrary.wiley.com/doi/full/10.1348/000711006X126600) using ordinal
87
  weighting - of 0.858 (great agreement!).
88
 
89
  | English Captions | Italian Captions |
 
80
  but the captions have to be handled accordingly. We translated 700K captions and we evaluated their quality:
81
 
82
  Three of us looked at a sample of 100 of the translations and rated them with scores from 1 to 4.
83
+ The meaning of the value is as follows: 1, the sentence has lost is meaning or it's not possible to understand it; 2, it is possible to get the idea
84
+ but there something wrong; 3, good, however a native speaker might complain about some translations; 4, good translation.
85
 
86
+ The average score was of 3.78 and the three annotators had an inter-rater agreement - computed with [Gwet's AC1](https://bpspsychub.onlinelibrary.wiley.com/doi/full/10.1348/000711006X126600) using ordinal
87
  weighting - of 0.858 (great agreement!).
88
 
89
  | English Captions | Italian Captions |