model update

README.md

@@ -46,6 +46,24 @@ model-index:
     - name: MoverScore (Question Generation)
       type: moverscore_question_generation
       value: 57.11
+    - name: QAAlignedF1Score-BERTScore (Question & Answer Generation) [Gold Answer]
+      type: qa_aligned_f1_score_bertscore_question_answer_generation_gold_answer
+      value: 87.93
+    - name: QAAlignedRecall-BERTScore (Question & Answer Generation) [Gold Answer]
+      type: qa_aligned_recall_bertscore_question_answer_generation_gold_answer
+      value: 87.84
+    - name: QAAlignedPrecision-BERTScore (Question & Answer Generation) [Gold Answer]
+      type: qa_aligned_precision_bertscore_question_answer_generation_gold_answer
+      value: 88.02
+    - name: QAAlignedF1Score-MoverScore (Question & Answer Generation) [Gold Answer]
+      type: qa_aligned_f1_score_moverscore_question_answer_generation_gold_answer
+      value: 61.91
+    - name: QAAlignedRecall-MoverScore (Question & Answer Generation) [Gold Answer]
+      type: qa_aligned_recall_moverscore_question_answer_generation_gold_answer
+      value: 61.78
+    - name: QAAlignedPrecision-MoverScore (Question & Answer Generation) [Gold Answer]
+      type: qa_aligned_precision_moverscore_question_answer_generation_gold_answer
+      value: 62.04
 ---
 
 # Model Card of `lmqg/mt5-base-itquad-qg`
@@ -99,6 +117,18 @@ output = pipe("<hl> Dopo il 1971 <hl> , l' OPEC ha tardato ad adeguare i prezzi
 | ROUGE_L    |   22.51 | default | [lmqg/qg_itquad](https://huggingface.co/datasets/lmqg/qg_itquad) |
 
 
+- ***Metric (Question & Answer Generation)***: QAG metrics are computed with *the gold answer* and generated question on it for this model, as the model cannot provide an answer. [raw metric file](https://huggingface.co/lmqg/mt5-base-itquad-qg/raw/main/eval/metric.first.answer.paragraph.questions_answers.lmqg_qg_itquad.default.json)
+
+|                                 |   Score | Type    | Dataset                                                          |
+|:--------------------------------|--------:|:--------|:-----------------------------------------------------------------|
+| QAAlignedF1Score (BERTScore)    |   87.93 | default | [lmqg/qg_itquad](https://huggingface.co/datasets/lmqg/qg_itquad) |
+| QAAlignedF1Score (MoverScore)   |   61.91 | default | [lmqg/qg_itquad](https://huggingface.co/datasets/lmqg/qg_itquad) |
+| QAAlignedPrecision (BERTScore)  |   88.02 | default | [lmqg/qg_itquad](https://huggingface.co/datasets/lmqg/qg_itquad) |
+| QAAlignedPrecision (MoverScore) |   62.04 | default | [lmqg/qg_itquad](https://huggingface.co/datasets/lmqg/qg_itquad) |
+| QAAlignedRecall (BERTScore)     |   87.84 | default | [lmqg/qg_itquad](https://huggingface.co/datasets/lmqg/qg_itquad) |
+| QAAlignedRecall (MoverScore)    |   61.78 | default | [lmqg/qg_itquad](https://huggingface.co/datasets/lmqg/qg_itquad) |
+
+
 
 ## Training hyperparameters