Definition: In this task, you will be presented with a context from an academic paper and a question separated with a
. You have to answer the question based on the context.
Input: For automatically evaluating our methods, we propose to use widely used metric for image/video captioning. This is because the proposed CommonGen task can be regarded as also a caption task where the context are incomplete scenes with given concept-sets. Therefore, we choose BLEU-3/4 BIBREF28, ROUGE-2/L BIBREF29, CIDEr BIBREF30, and SPICE BIBREF31 as the main metrics. Apart from these classic metrics, we also include a novel embedding-based metric named BERTScore BIBREF32. To make the comparisons more clear, we show the delta of BERTScore results by subtracting the score of merely using input concept-sets as target sentences, named $ riangle $BERTS.
Question: What automatic metrics are used for this task?
Output:
BLEU-3/4 ROUGE-2/L CIDEr SPICE BERTScore