model update

README.md

@@ -46,21 +46,6 @@ model-index:
     - name: MoverScore (Question Generation)
       type: moverscore_question_generation
       value: 58.91
-    - name: BLEU4 (Question & Answer Generation (with Gold Answer))
-      type: bleu4_question_answer_generation_with_gold_answer
-      value: 12.56
-    - name: ROUGE-L (Question & Answer Generation (with Gold Answer))
-      type: rouge_l_question_answer_generation_with_gold_answer
-      value: 42.33
-    - name: METEOR (Question & Answer Generation (with Gold Answer))
-      type: meteor_question_answer_generation_with_gold_answer
-      value: 37.7
-    - name: BERTScore (Question & Answer Generation (with Gold Answer))
-      type: bertscore_question_answer_generation_with_gold_answer
-      value: 88.95
-    - name: MoverScore (Question & Answer Generation (with Gold Answer))
-      type: moverscore_question_answer_generation_with_gold_answer
-      value: 63.31
     - name: QAAlignedF1Score-BERTScore (Question & Answer Generation (with Gold Answer)) [Gold Answer]
       type: qa_aligned_f1_score_bertscore_question_answer_generation_with_gold_answer_gold_answer
       value: 88.99
@@ -79,21 +64,6 @@ model-index:
     - name: QAAlignedPrecision-MoverScore (Question & Answer Generation (with Gold Answer)) [Gold Answer]
       type: qa_aligned_precision_moverscore_question_answer_generation_with_gold_answer_gold_answer
       value: 63.49
-    - name: BLEU4 (Question & Answer Generation)
-      type: bleu4_question_answer_generation
-      value: 1.72
-    - name: ROUGE-L (Question & Answer Generation)
-      type: rouge_l_question_answer_generation
-      value: 15.06
-    - name: METEOR (Question & Answer Generation)
-      type: meteor_question_answer_generation
-      value: 22.03
-    - name: BERTScore (Question & Answer Generation)
-      type: bertscore_question_answer_generation
-      value: 69.22
-    - name: MoverScore (Question & Answer Generation)
-      type: moverscore_question_answer_generation
-      value: 51.71
     - name: QAAlignedF1Score-BERTScore (Question & Answer Generation) [Gold Answer]
       type: qa_aligned_f1_score_bertscore_question_answer_generation_gold_answer
       value: 79.26
@@ -169,40 +139,24 @@ output = pipe("del <hl> Ministerio de Desarrollo Urbano <hl> , Gobierno de la In
 
 |                                 |   Score | Type    | Dataset                                                          |
 |:--------------------------------|--------:|:--------|:-----------------------------------------------------------------|
-| BERTScore                       |   88.95 | default | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) |
-| Bleu_1                          |   39.18 | default | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) |
-| Bleu_2                          |   26.07 | default | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) |
-| Bleu_3                          |   17.89 | default | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) |
-| Bleu_4                          |   12.56 | default | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) |
-| METEOR                          |   37.7  | default | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) |
-| MoverScore                      |   63.31 | default | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) |
 | QAAlignedF1Score (BERTScore)    |   88.99 | default | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) |
 | QAAlignedF1Score (MoverScore)   |   63.47 | default | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) |
 | QAAlignedPrecision (BERTScore)  |   89    | default | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) |
 | QAAlignedPrecision (MoverScore) |   63.49 | default | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) |
 | QAAlignedRecall (BERTScore)     |   88.97 | default | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) |
 | QAAlignedRecall (MoverScore)    |   63.46 | default | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) |
-| ROUGE_L                         |   42.33 | default | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) |
 
 
 - ***Metric (Question & Answer Generation, Pipeline Approach)***: Each question is generated on the answer generated by [`lmqg/mbart-large-cc25-esquad-ae`](https://huggingface.co/lmqg/mbart-large-cc25-esquad-ae). [raw metric file](https://huggingface.co/lmqg/mbart-large-cc25-esquad-qg/raw/main/eval_pipeline/metric.first.answer.paragraph.questions_answers.lmqg_qg_esquad.default.lmqg_mbart-large-cc25-esquad-ae.json)
 
 |                                 |   Score | Type    | Dataset                                                          |
 |:--------------------------------|--------:|:--------|:-----------------------------------------------------------------|
-| BERTScore                       |   69.22 | default | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) |
-| Bleu_1                          |   10.57 | default | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) |
-| Bleu_2                          |    5.27 | default | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) |
-| Bleu_3                          |    2.86 | default | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) |
-| Bleu_4                          |    1.72 | default | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) |
-| METEOR                          |   22.03 | default | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) |
-| MoverScore                      |   51.71 | default | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) |
 | QAAlignedF1Score (BERTScore)    |   79.26 | default | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) |
 | QAAlignedF1Score (MoverScore)   |   54.68 | default | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) |
 | QAAlignedPrecision (BERTScore)  |   76.78 | default | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) |
 | QAAlignedPrecision (MoverScore) |   53.17 | default | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) |
 | QAAlignedRecall (BERTScore)     |   81.98 | default | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) |
 | QAAlignedRecall (MoverScore)    |   56.37 | default | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) |
-| ROUGE_L                         |   15.06 | default | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) |