asahi417 commited on
Commit
a969ca9
1 Parent(s): c2db685

model update

Browse files
Files changed (1) hide show
  1. README.md +23 -23
README.md CHANGED
@@ -46,38 +46,38 @@ model-index:
46
  - name: MoverScore (Question Generation)
47
  type: moverscore_question_generation
48
  value: 56.79
49
- - name: BLEU4 (Question & Answer Generation (with Gold Answer))
50
- type: bleu4_question_answer_generation_with_gold_answer
51
  value: 15.44
52
- - name: ROUGE-L (Question & Answer Generation (with Gold Answer))
53
- type: rouge_l_question_answer_generation_with_gold_answer
54
  value: 40.08
55
- - name: METEOR (Question & Answer Generation (with Gold Answer))
56
- type: meteor_question_answer_generation_with_gold_answer
57
  value: 34.31
58
- - name: BERTScore (Question & Answer Generation (with Gold Answer))
59
- type: bertscore_question_answer_generation_with_gold_answer
60
  value: 86.62
61
- - name: MoverScore (Question & Answer Generation (with Gold Answer))
62
- type: moverscore_question_answer_generation_with_gold_answer
63
  value: 60.68
64
- - name: QAAlignedF1Score-BERTScore (Question & Answer Generation (with Gold Answer)) [Gold Answer]
65
- type: qa_aligned_f1_score_bertscore_question_answer_generation_with_gold_answer_gold_answer
66
  value: 87.66
67
- - name: QAAlignedRecall-BERTScore (Question & Answer Generation (with Gold Answer)) [Gold Answer]
68
- type: qa_aligned_recall_bertscore_question_answer_generation_with_gold_answer_gold_answer
69
  value: 87.57
70
- - name: QAAlignedPrecision-BERTScore (Question & Answer Generation (with Gold Answer)) [Gold Answer]
71
- type: qa_aligned_precision_bertscore_question_answer_generation_with_gold_answer_gold_answer
72
  value: 87.76
73
- - name: QAAlignedF1Score-MoverScore (Question & Answer Generation (with Gold Answer)) [Gold Answer]
74
- type: qa_aligned_f1_score_moverscore_question_answer_generation_with_gold_answer_gold_answer
75
  value: 61.6
76
- - name: QAAlignedRecall-MoverScore (Question & Answer Generation (with Gold Answer)) [Gold Answer]
77
- type: qa_aligned_recall_moverscore_question_answer_generation_with_gold_answer_gold_answer
78
  value: 61.48
79
- - name: QAAlignedPrecision-MoverScore (Question & Answer Generation (with Gold Answer)) [Gold Answer]
80
- type: qa_aligned_precision_moverscore_question_answer_generation_with_gold_answer_gold_answer
81
  value: 61.73
82
  ---
83
 
@@ -132,7 +132,7 @@ output = pipe("<hl> Dopo il 1971 <hl> , l' OPEC ha tardato ad adeguare i prezzi
132
  | ROUGE_L | 21.93 | default | [lmqg/qg_itquad](https://huggingface.co/datasets/lmqg/qg_itquad) |
133
 
134
 
135
- - ***Metric (Question & Answer Generation, Reference Answer)***: Each question is generated from *the gold answer*. [raw metric file](https://huggingface.co/lmqg/mt5-small-itquad-qg/raw/main/eval/metric.first.answer.paragraph.questions_answers.lmqg_qg_itquad.default.json)
136
 
137
  | | Score | Type | Dataset |
138
  |:--------------------------------|--------:|:--------|:-----------------------------------------------------------------|
 
46
  - name: MoverScore (Question Generation)
47
  type: moverscore_question_generation
48
  value: 56.79
49
+ - name: BLEU4 (Question & Answer Generation)
50
+ type: bleu4_question_answer_generation
51
  value: 15.44
52
+ - name: ROUGE-L (Question & Answer Generation)
53
+ type: rouge_l_question_answer_generation
54
  value: 40.08
55
+ - name: METEOR (Question & Answer Generation)
56
+ type: meteor_question_answer_generation
57
  value: 34.31
58
+ - name: BERTScore (Question & Answer Generation)
59
+ type: bertscore_question_answer_generation
60
  value: 86.62
61
+ - name: MoverScore (Question & Answer Generation)
62
+ type: moverscore_question_answer_generation
63
  value: 60.68
64
+ - name: QAAlignedF1Score-BERTScore (Question & Answer Generation) [Gold Answer]
65
+ type: qa_aligned_f1_score_bertscore_question_answer_generation_gold_answer
66
  value: 87.66
67
+ - name: QAAlignedRecall-BERTScore (Question & Answer Generation) [Gold Answer]
68
+ type: qa_aligned_recall_bertscore_question_answer_generation_gold_answer
69
  value: 87.57
70
+ - name: QAAlignedPrecision-BERTScore (Question & Answer Generation) [Gold Answer]
71
+ type: qa_aligned_precision_bertscore_question_answer_generation_gold_answer
72
  value: 87.76
73
+ - name: QAAlignedF1Score-MoverScore (Question & Answer Generation) [Gold Answer]
74
+ type: qa_aligned_f1_score_moverscore_question_answer_generation_gold_answer
75
  value: 61.6
76
+ - name: QAAlignedRecall-MoverScore (Question & Answer Generation) [Gold Answer]
77
+ type: qa_aligned_recall_moverscore_question_answer_generation_gold_answer
78
  value: 61.48
79
+ - name: QAAlignedPrecision-MoverScore (Question & Answer Generation) [Gold Answer]
80
+ type: qa_aligned_precision_moverscore_question_answer_generation_gold_answer
81
  value: 61.73
82
  ---
83
 
 
132
  | ROUGE_L | 21.93 | default | [lmqg/qg_itquad](https://huggingface.co/datasets/lmqg/qg_itquad) |
133
 
134
 
135
+ - ***Metric (Question & Answer Generation)***: QAG metrics are computed with *the gold answer* and generated question on it for this model, as the model cannot provide an answer. [raw metric file](https://huggingface.co/lmqg/mt5-small-itquad-qg/raw/main/eval/metric.first.answer.paragraph.questions_answers.lmqg_qg_itquad.default.json)
136
 
137
  | | Score | Type | Dataset |
138
  |:--------------------------------|--------:|:--------|:-----------------------------------------------------------------|