model update

README.md

@@ -46,21 +46,6 @@ model-index:
     - name: MoverScore (Question Generation)
       type: moverscore_question_generation
       value: 56.84
-    - name: BLEU4 (Question & Answer Generation (with Gold Answer))
-      type: bleu4_question_answer_generation_with_gold_answer
-      value: 15.31
-    - name: ROUGE-L (Question & Answer Generation (with Gold Answer))
-      type: rouge_l_question_answer_generation_with_gold_answer
-      value: 39.83
-    - name: METEOR (Question & Answer Generation (with Gold Answer))
-      type: meteor_question_answer_generation_with_gold_answer
-      value: 34.57
-    - name: BERTScore (Question & Answer Generation (with Gold Answer))
-      type: bertscore_question_answer_generation_with_gold_answer
-      value: 86.58
-    - name: MoverScore (Question & Answer Generation (with Gold Answer))
-      type: moverscore_question_answer_generation_with_gold_answer
-      value: 60.68
     - name: QAAlignedF1Score-BERTScore (Question & Answer Generation (with Gold Answer)) [Gold Answer]
       type: qa_aligned_f1_score_bertscore_question_answer_generation_with_gold_answer_gold_answer
       value: 87.56
@@ -79,21 +64,6 @@ model-index:
     - name: QAAlignedPrecision-MoverScore (Question & Answer Generation (with Gold Answer)) [Gold Answer]
       type: qa_aligned_precision_moverscore_question_answer_generation_with_gold_answer_gold_answer
       value: 61.83
-    - name: BLEU4 (Question & Answer Generation)
-      type: bleu4_question_answer_generation
-      value: 0.85
-    - name: ROUGE-L (Question & Answer Generation)
-      type: rouge_l_question_answer_generation
-      value: 9.06
-    - name: METEOR (Question & Answer Generation)
-      type: meteor_question_answer_generation
-      value: 8.18
-    - name: BERTScore (Question & Answer Generation)
-      type: bertscore_question_answer_generation
-      value: 38.66
-    - name: MoverScore (Question & Answer Generation)
-      type: moverscore_question_answer_generation
-      value: 48.01
     - name: QAAlignedF1Score-BERTScore (Question & Answer Generation) [Gold Answer]
       type: qa_aligned_f1_score_bertscore_question_answer_generation_gold_answer
       value: 40.13
@@ -169,40 +139,24 @@ output = pipe("<hl> Dopo il 1971 <hl> , l' OPEC ha tardato ad adeguare i prezzi
 
 |                                 |   Score | Type    | Dataset                                                          |
 |:--------------------------------|--------:|:--------|:-----------------------------------------------------------------|
-| BERTScore                       |   86.58 | default | [lmqg/qg_itquad](https://huggingface.co/datasets/lmqg/qg_itquad) |
-| Bleu_1                          |   40.47 | default | [lmqg/qg_itquad](https://huggingface.co/datasets/lmqg/qg_itquad) |
-| Bleu_2                          |   28.45 | default | [lmqg/qg_itquad](https://huggingface.co/datasets/lmqg/qg_itquad) |
-| Bleu_3                          |   20.6  | default | [lmqg/qg_itquad](https://huggingface.co/datasets/lmqg/qg_itquad) |
-| Bleu_4                          |   15.31 | default | [lmqg/qg_itquad](https://huggingface.co/datasets/lmqg/qg_itquad) |
-| METEOR                          |   34.57 | default | [lmqg/qg_itquad](https://huggingface.co/datasets/lmqg/qg_itquad) |
-| MoverScore                      |   60.68 | default | [lmqg/qg_itquad](https://huggingface.co/datasets/lmqg/qg_itquad) |
 | QAAlignedF1Score (BERTScore)    |   87.56 | default | [lmqg/qg_itquad](https://huggingface.co/datasets/lmqg/qg_itquad) |
 | QAAlignedF1Score (MoverScore)   |   61.71 | default | [lmqg/qg_itquad](https://huggingface.co/datasets/lmqg/qg_itquad) |
 | QAAlignedPrecision (BERTScore)  |   87.62 | default | [lmqg/qg_itquad](https://huggingface.co/datasets/lmqg/qg_itquad) |
 | QAAlignedPrecision (MoverScore) |   61.83 | default | [lmqg/qg_itquad](https://huggingface.co/datasets/lmqg/qg_itquad) |
 | QAAlignedRecall (BERTScore)     |   87.5  | default | [lmqg/qg_itquad](https://huggingface.co/datasets/lmqg/qg_itquad) |
 | QAAlignedRecall (MoverScore)    |   61.59 | default | [lmqg/qg_itquad](https://huggingface.co/datasets/lmqg/qg_itquad) |
-| ROUGE_L                         |   39.83 | default | [lmqg/qg_itquad](https://huggingface.co/datasets/lmqg/qg_itquad) |
 
 
 - ***Metric (Question & Answer Generation, Pipeline Approach)***: Each question is generated on the answer generated by [`lmqg/mbart-large-cc25-itquad-ae`](https://huggingface.co/lmqg/mbart-large-cc25-itquad-ae). [raw metric file](https://huggingface.co/lmqg/mbart-large-cc25-itquad-qg/raw/main/eval_pipeline/metric.first.answer.paragraph.questions_answers.lmqg_qg_itquad.default.lmqg_mbart-large-cc25-itquad-ae.json)
 
 |                                 |   Score | Type    | Dataset                                                          |
 |:--------------------------------|--------:|:--------|:-----------------------------------------------------------------|
-| BERTScore                       |   38.66 | default | [lmqg/qg_itquad](https://huggingface.co/datasets/lmqg/qg_itquad) |
-| Bleu_1                          |    8.19 | default | [lmqg/qg_itquad](https://huggingface.co/datasets/lmqg/qg_itquad) |
-| Bleu_2                          |    3.98 | default | [lmqg/qg_itquad](https://huggingface.co/datasets/lmqg/qg_itquad) |
-| Bleu_3                          |    1.66 | default | [lmqg/qg_itquad](https://huggingface.co/datasets/lmqg/qg_itquad) |
-| Bleu_4                          |    0.85 | default | [lmqg/qg_itquad](https://huggingface.co/datasets/lmqg/qg_itquad) |
-| METEOR                          |    8.18 | default | [lmqg/qg_itquad](https://huggingface.co/datasets/lmqg/qg_itquad) |
-| MoverScore                      |   48.01 | default | [lmqg/qg_itquad](https://huggingface.co/datasets/lmqg/qg_itquad) |
 | QAAlignedF1Score (BERTScore)    |   40.13 | default | [lmqg/qg_itquad](https://huggingface.co/datasets/lmqg/qg_itquad) |
 | QAAlignedF1Score (MoverScore)   |   27.8  | default | [lmqg/qg_itquad](https://huggingface.co/datasets/lmqg/qg_itquad) |
 | QAAlignedPrecision (BERTScore)  |   40.43 | default | [lmqg/qg_itquad](https://huggingface.co/datasets/lmqg/qg_itquad) |
 | QAAlignedPrecision (MoverScore) |   28.09 | default | [lmqg/qg_itquad](https://huggingface.co/datasets/lmqg/qg_itquad) |
 | QAAlignedRecall (BERTScore)     |   39.88 | default | [lmqg/qg_itquad](https://huggingface.co/datasets/lmqg/qg_itquad) |
 | QAAlignedRecall (MoverScore)    |   27.54 | default | [lmqg/qg_itquad](https://huggingface.co/datasets/lmqg/qg_itquad) |
-| ROUGE_L                         |    9.06 | default | [lmqg/qg_itquad](https://huggingface.co/datasets/lmqg/qg_itquad) |