asahi417 commited on
Commit
976d33f
1 Parent(s): a10ae94

model update

Browse files
Files changed (1) hide show
  1. README.md +13 -0
README.md CHANGED
@@ -51,6 +51,12 @@ model-index:
51
  - name: MoverScore
52
  type: moverscore
53
  value: 0.5662580131358668
 
 
 
 
 
 
54
  ---
55
 
56
  # Model Card of `lmqg/mt5-small-itquad-multitask`
@@ -119,6 +125,13 @@ question = pipe('generate question: <hl> Dopo il 1971 <hl> , l' OPEC ha tardato
119
  | [lmqg/qg_itquad](https://huggingface.co/datasets/lmqg/qg_itquad) | default | 0.072 | 0.218 | 0.175 | 0.806 | 0.566 | [link](https://huggingface.co/lmqg/mt5-small-itquad-multitask/raw/main/eval/metric.first.sentence.paragraph_answer.question.lmqg_qg_itquad.default.json) |
120
 
121
 
 
 
 
 
 
 
 
122
 
123
 
124
  ## Training hyperparameters
 
51
  - name: MoverScore
52
  type: moverscore
53
  value: 0.5662580131358668
54
+ - name: QAAlignedF1Score (BERTScore)
55
+ type: qa_aligned_f1_score_bertscore
56
+ value: 0.8201168576084874
57
+ - name: QAAlignedF1Score (MoverScore)
58
+ type: qa_aligned_f1_score_moverscore
59
+ value: 0.5608719993583443
60
  ---
61
 
62
  # Model Card of `lmqg/mt5-small-itquad-multitask`
 
125
  | [lmqg/qg_itquad](https://huggingface.co/datasets/lmqg/qg_itquad) | default | 0.072 | 0.218 | 0.175 | 0.806 | 0.566 | [link](https://huggingface.co/lmqg/mt5-small-itquad-multitask/raw/main/eval/metric.first.sentence.paragraph_answer.question.lmqg_qg_itquad.default.json) |
126
 
127
 
128
+ ### Metrics (QAG)
129
+
130
+ | Dataset | Type | QA Aligned F1 Score (BERTScore) | QA Aligned F1 Score (MoverScore) | Link |
131
+ |:--------|:-----|--------------------------------:|---------------------------------:|-----:|
132
+ | [lmqg/qg_itquad](https://huggingface.co/datasets/lmqg/qg_itquad) | default | 0.82 | 0.561 | [link](https://huggingface.co/lmqg/mt5-small-itquad-multitask/raw/main/eval/metric.first.answer.paragraph.questions_answers.lmqg_qg_itquad.default.json) |
133
+
134
+
135
 
136
 
137
  ## Training hyperparameters