asahi417 commited on
Commit
d62526b
1 Parent(s): 963731a

model update

Browse files
Files changed (1) hide show
  1. README.md +13 -0
README.md CHANGED
@@ -51,6 +51,12 @@ model-index:
51
  - name: MoverScore
52
  type: moverscore
53
  value: 0.583354319136371
 
 
 
 
 
 
54
  ---
55
 
56
  # Model Card of `lmqg/mt5-small-esquad-multitask`
@@ -119,6 +125,13 @@ question = pipe('generate question: del <hl> Ministerio de Desarrollo Urbano <hl
119
  | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) | default | 0.088 | 0.231 | 0.217 | 0.834 | 0.583 | [link](https://huggingface.co/lmqg/mt5-small-esquad-multitask/raw/main/eval/metric.first.sentence.paragraph_answer.question.lmqg_qg_esquad.default.json) |
120
 
121
 
 
 
 
 
 
 
 
122
 
123
 
124
  ## Training hyperparameters
 
51
  - name: MoverScore
52
  type: moverscore
53
  value: 0.583354319136371
54
+ - name: QAAlignedF1Score (BERTScore)
55
+ type: qa_aligned_f1_score_bertscore
56
+ value: 0.7976244828929961
57
+ - name: QAAlignedF1Score (MoverScore)
58
+ type: qa_aligned_f1_score_moverscore
59
+ value: 0.5475287486181891
60
  ---
61
 
62
  # Model Card of `lmqg/mt5-small-esquad-multitask`
 
125
  | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) | default | 0.088 | 0.231 | 0.217 | 0.834 | 0.583 | [link](https://huggingface.co/lmqg/mt5-small-esquad-multitask/raw/main/eval/metric.first.sentence.paragraph_answer.question.lmqg_qg_esquad.default.json) |
126
 
127
 
128
+ ### Metrics (QAG)
129
+
130
+ | Dataset | Type | QA Aligned F1 Score (BERTScore) | QA Aligned F1 Score (MoverScore) | Link |
131
+ |:--------|:-----|--------------------------------:|---------------------------------:|-----:|
132
+ | [lmqg/qg_esquad](https://huggingface.co/datasets/lmqg/qg_esquad) | default | 0.798 | 0.548 | [link](https://huggingface.co/lmqg/mt5-small-esquad-multitask/raw/main/eval/metric.first.answer.paragraph.questions_answers.lmqg_qg_esquad.default.json) |
133
+
134
+
135
 
136
 
137
  ## Training hyperparameters