model update

README.md

@@ -46,23 +46,38 @@ model-index:
     - name: MoverScore (Question Generation)
       type: moverscore_question_generation
       value: 64.99
-    - name: QAAlignedF1Score-BERTScore (Question & Answer Generation) [Gold Answer]
-      type: qa_aligned_f1_score_bertscore_question_answer_generation_gold_answer
+    - name: BLEU4 (Question & Answer Generation (with Gold Answer))
+      type: bleu4_question_answer_generation_with_gold_answer
+      value: 13.96
+    - name: ROUGE-L (Question & Answer Generation (with Gold Answer))
+      type: rouge_l_question_answer_generation_with_gold_answer
+      value: 42.37
+    - name: METEOR (Question & Answer Generation (with Gold Answer))
+      type: meteor_question_answer_generation_with_gold_answer
+      value: 40.22
+    - name: BERTScore (Question & Answer Generation (with Gold Answer))
+      type: bertscore_question_answer_generation_with_gold_answer
+      value: 94.63
+    - name: MoverScore (Question & Answer Generation (with Gold Answer))
+      type: moverscore_question_answer_generation_with_gold_answer
+      value: 69.72
+    - name: QAAlignedF1Score-BERTScore (Question & Answer Generation (with Gold Answer)) [Gold Answer]
+      type: qa_aligned_f1_score_bertscore_question_answer_generation_with_gold_answer_gold_answer
       value: 95.54
-    - name: QAAlignedRecall-BERTScore (Question & Answer Generation) [Gold Answer]
-      type: qa_aligned_recall_bertscore_question_answer_generation_gold_answer
+    - name: QAAlignedRecall-BERTScore (Question & Answer Generation (with Gold Answer)) [Gold Answer]
+      type: qa_aligned_recall_bertscore_question_answer_generation_with_gold_answer_gold_answer
       value: 95.49
-    - name: QAAlignedPrecision-BERTScore (Question & Answer Generation) [Gold Answer]
-      type: qa_aligned_precision_bertscore_question_answer_generation_gold_answer
+    - name: QAAlignedPrecision-BERTScore (Question & Answer Generation (with Gold Answer)) [Gold Answer]
+      type: qa_aligned_precision_bertscore_question_answer_generation_with_gold_answer_gold_answer
       value: 95.59
-    - name: QAAlignedF1Score-MoverScore (Question & Answer Generation) [Gold Answer]
-      type: qa_aligned_f1_score_moverscore_question_answer_generation_gold_answer
+    - name: QAAlignedF1Score-MoverScore (Question & Answer Generation (with Gold Answer)) [Gold Answer]
+      type: qa_aligned_f1_score_moverscore_question_answer_generation_with_gold_answer_gold_answer
       value: 70.82
-    - name: QAAlignedRecall-MoverScore (Question & Answer Generation) [Gold Answer]
-      type: qa_aligned_recall_moverscore_question_answer_generation_gold_answer
+    - name: QAAlignedRecall-MoverScore (Question & Answer Generation (with Gold Answer)) [Gold Answer]
+      type: qa_aligned_recall_moverscore_question_answer_generation_with_gold_answer_gold_answer
       value: 70.54
-    - name: QAAlignedPrecision-MoverScore (Question & Answer Generation) [Gold Answer]
-      type: qa_aligned_precision_moverscore_question_answer_generation_gold_answer
+    - name: QAAlignedPrecision-MoverScore (Question & Answer Generation (with Gold Answer)) [Gold Answer]
+      type: qa_aligned_precision_moverscore_question_answer_generation_with_gold_answer_gold_answer
       value: 71.13
   - task:
       name: Text2text Generation
@@ -347,16 +362,24 @@ output = pipe("<hl> Beyonce <hl> further expanded her acting career, starring as
 | ROUGE_L    |   53.85 | default | [lmqg/qg_squad](https://huggingface.co/datasets/lmqg/qg_squad) |
 
 
-- ***Metric (Question & Answer Generation)***: QAG metrics are computed with *the gold answer* and generated question on it for this model, as the model cannot provide an answer. [raw metric file](https://huggingface.co/lmqg/bart-large-squad-qg/raw/main/eval/metric.first.answer.paragraph.questions_answers.lmqg_qg_squad.default.json)
+- ***Metric (Question & Answer Generation, Reference Answer)***: Each question is generated from *the gold answer*. [raw metric file](https://huggingface.co/lmqg/bart-large-squad-qg/raw/main/eval/metric.first.answer.paragraph.questions_answers.lmqg_qg_squad.default.json)
 
 |                                 |   Score | Type    | Dataset                                                        |
 |:--------------------------------|--------:|:--------|:---------------------------------------------------------------|
+| BERTScore                       |   94.63 | default | [lmqg/qg_squad](https://huggingface.co/datasets/lmqg/qg_squad) |
+| Bleu_1                          |   43.22 | default | [lmqg/qg_squad](https://huggingface.co/datasets/lmqg/qg_squad) |
+| Bleu_2                          |   29.09 | default | [lmqg/qg_squad](https://huggingface.co/datasets/lmqg/qg_squad) |
+| Bleu_3                          |   19.77 | default | [lmqg/qg_squad](https://huggingface.co/datasets/lmqg/qg_squad) |
+| Bleu_4                          |   13.96 | default | [lmqg/qg_squad](https://huggingface.co/datasets/lmqg/qg_squad) |
+| METEOR                          |   40.22 | default | [lmqg/qg_squad](https://huggingface.co/datasets/lmqg/qg_squad) |
+| MoverScore                      |   69.72 | default | [lmqg/qg_squad](https://huggingface.co/datasets/lmqg/qg_squad) |
 | QAAlignedF1Score (BERTScore)    |   95.54 | default | [lmqg/qg_squad](https://huggingface.co/datasets/lmqg/qg_squad) |
 | QAAlignedF1Score (MoverScore)   |   70.82 | default | [lmqg/qg_squad](https://huggingface.co/datasets/lmqg/qg_squad) |
 | QAAlignedPrecision (BERTScore)  |   95.59 | default | [lmqg/qg_squad](https://huggingface.co/datasets/lmqg/qg_squad) |
 | QAAlignedPrecision (MoverScore) |   71.13 | default | [lmqg/qg_squad](https://huggingface.co/datasets/lmqg/qg_squad) |
 | QAAlignedRecall (BERTScore)     |   95.49 | default | [lmqg/qg_squad](https://huggingface.co/datasets/lmqg/qg_squad) |
 | QAAlignedRecall (MoverScore)    |   70.54 | default | [lmqg/qg_squad](https://huggingface.co/datasets/lmqg/qg_squad) |
+| ROUGE_L                         |   42.37 | default | [lmqg/qg_squad](https://huggingface.co/datasets/lmqg/qg_squad) |
 
 
 - ***Metrics (Question Generation, Out-of-Domain)***