commit files to HF hub

README.md

@@ -31,33 +31,33 @@ model-index:
     metrics:
     - name: BLEU4 (Question Answering)
       type: bleu4_question_answering
-      value: 0.0
+      value: 15.81
     - name: ROUGE-L (Question Answering)
       type: rouge_l_question_answering
-      value: 0.04
+      value: 36.21
     - name: METEOR (Question Answering)
       type: meteor_question_answering
-      value: 0.01
+      value: 31.38
     - name: BERTScore (Question Answering)
       type: bertscore_question_answering
-      value: 75.63
+      value: 90.76
     - name: MoverScore (Question Answering)
       type: moverscore_question_answering
-      value: 57.17
+      value: 75.04
     - name: AnswerF1Score (Question Answering)
       type: answer_f1_score__question_answering
-      value: 0.0
+      value: 58.03
     - name: AnswerExactMatch (Question Answering)
       type: answer_exact_match_question_answering
-      value: 0.0
+      value: 37.0
 ---
 
 # Model Card of `vocabtrimmer/mt5-small-trimmed-es-60000-esquad-qa`
-This model is fine-tuned version of [vocabtrimmer/mt5-small-trimmed-es-60000](https://huggingface.co/vocabtrimmer/mt5-small-trimmed-es-60000) for question answering task on the [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) (dataset_name: default) via [`lmqg`](https://github.com/asahi417/lm-question-generation).
+This model is fine-tuned version of [ckpts/mt5-small-trimmed-es-60000](https://huggingface.co/ckpts/mt5-small-trimmed-es-60000) for question answering task on the [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) (dataset_name: default) via [`lmqg`](https://github.com/asahi417/lm-question-generation).
 
 
 ### Overview
-- **Language model:** [vocabtrimmer/mt5-small-trimmed-es-60000](https://huggingface.co/vocabtrimmer/mt5-small-trimmed-es-60000)   
+- **Language model:** [ckpts/mt5-small-trimmed-es-60000](https://huggingface.co/ckpts/mt5-small-trimmed-es-60000)   
 - **Language:** es  
 - **Training data:** [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) (default)
 - **Online Demo:** [https://autoqg.net/](https://autoqg.net/)
@@ -93,16 +93,16 @@ output = pipe("question: ¿Cuál es la población de Nueva York a partir de 2014
 
 |                  |   Score | Type    | Dataset                                                          |
 |:-----------------|--------:|:--------|:-----------------------------------------------------------------|
-| AnswerExactMatch |    0    | default | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) |
-| AnswerF1Score    |    0    | default | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) |
-| BERTScore        |   75.63 | default | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) |
-| Bleu_1           |    0.04 | default | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) |
-| Bleu_2           |    0    | default | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) |
-| Bleu_3           |    0    | default | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) |
-| Bleu_4           |    0    | default | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) |
-| METEOR           |    0.01 | default | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) |
-| MoverScore       |   57.17 | default | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) |
-| ROUGE_L          |    0.04 | default | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) |
+| AnswerExactMatch |   37    | default | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) |
+| AnswerF1Score    |   58.03 | default | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) |
+| BERTScore        |   90.76 | default | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) |
+| Bleu_1           |   25.62 | default | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) |
+| Bleu_2           |   21.27 | default | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) |
+| Bleu_3           |   18.24 | default | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) |
+| Bleu_4           |   15.81 | default | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) |
+| METEOR           |   31.38 | default | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) |
+| MoverScore       |   75.04 | default | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) |
+| ROUGE_L          |   36.21 | default | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) |
 
 
 
@@ -114,15 +114,15 @@ The following hyperparameters were used during fine-tuning:
  - input_types: ['paragraph_question']
  - output_types: ['answer']
  - prefix_types: None
- - model: vocabtrimmer/mt5-small-trimmed-es-60000
+ - model: ckpts/mt5-small-trimmed-es-60000
  - max_length: 512
  - max_length_output: 32
- - epoch: 5
+ - epoch: 13
  - batch: 32
  - lr: 0.001
  - fp16: False
  - random_seed: 1
- - gradient_accumulation_steps: 2
+ - gradient_accumulation_steps: 4
  - label_smoothing: 0.15
 
 The full configuration can be found at [fine-tuning config file](https://huggingface.co/vocabtrimmer/mt5-small-trimmed-es-60000-esquad-qa/raw/main/trainer_config.json).

eval/metric.first.answer.paragraph_question.answer.lmqg_qg_esquad.default.json

@@ -1 +1 @@
-{"validation": {"Bleu_1": 0.00041248699171136233, "Bleu_2": 4.474049597809197e-12, "Bleu_3": 2.1734816055170378e-10, "Bleu_4": 1.5148985728625334e-09, "METEOR": 7.001896175265699e-05, "ROUGE_L": 0.00031084756130530546, "BERTScore": 0.7564456416789157, "MoverScore": 0.5724704342283652, "AnswerF1Score": 0.0, "AnswerExactMatch": 0.0}, "test": {"Bleu_1": 0.00040996457235308904, "Bleu_2": 4.321406028708754e-12, "Bleu_3": 2.079423675330759e-10, "Bleu_4": 1.4424538917612976e-09, "METEOR": 7.11549988116127e-05, "ROUGE_L": 0.0004036776886490134, "BERTScore": 0.7563161283985217, "MoverScore": 0.5717498874976459, "AnswerF1Score": 0.0, "AnswerExactMatch": 0.0}}
+{"validation": {"Bleu_1": 0.2453062943795847, "Bleu_2": 0.20281462239950065, "Bleu_3": 0.17239279784650083, "Bleu_4": 0.14812685771608206, "METEOR": 0.3110814057950505, "ROUGE_L": 0.3548773973945248, "BERTScore": 0.9026185512204382, "MoverScore": 0.7375726581315332, "AnswerF1Score": 55.78295138910964, "AnswerExactMatch": 34.1438032166509}, "test": {"Bleu_1": 0.256207307817409, "Bleu_2": 0.2127005548121441, "Bleu_3": 0.18237532701964873, "Bleu_4": 0.15810471719270472, "METEOR": 0.3138468629788032, "ROUGE_L": 0.3621297952077331, "BERTScore": 0.9076446937127506, "MoverScore": 0.7503555440417273, "AnswerF1Score": 58.02796499082963, "AnswerExactMatch": 37.000946073793756}}