asahi417 commited on
Commit
005260b
1 Parent(s): 93eb686

model update

Browse files
Files changed (1) hide show
  1. README.md +13 -0
README.md CHANGED
@@ -51,6 +51,12 @@ model-index:
51
  - name: MoverScore
52
  type: moverscore
53
  value: 0.8253569952436216
 
 
 
 
 
 
54
  ---
55
 
56
  # Model Card of `lmqg/mt5-small-koquad-multitask`
@@ -119,6 +125,13 @@ question = pipe('generate question: 1990년 영화 《 <hl> 남부군 <hl> 》
119
  | [lmqg/qg_koquad](https://huggingface.co/datasets/lmqg/qg_koquad) | default | 0.109 | 0.258 | 0.275 | 0.834 | 0.825 | [link](https://huggingface.co/lmqg/mt5-small-koquad-multitask/raw/main/eval/metric.first.sentence.paragraph_answer.question.lmqg_qg_koquad.default.json) |
120
 
121
 
 
 
 
 
 
 
 
122
 
123
 
124
  ## Training hyperparameters
 
51
  - name: MoverScore
52
  type: moverscore
53
  value: 0.8253569952436216
54
+ - name: QAAlignedF1Score (BERTScore)
55
+ type: qa_aligned_f1_score_bertscore
56
+ value: 0.8036359626603298
57
+ - name: QAAlignedF1Score (MoverScore)
58
+ type: qa_aligned_f1_score_moverscore
59
+ value: 0.8283278858086283
60
  ---
61
 
62
  # Model Card of `lmqg/mt5-small-koquad-multitask`
 
125
  | [lmqg/qg_koquad](https://huggingface.co/datasets/lmqg/qg_koquad) | default | 0.109 | 0.258 | 0.275 | 0.834 | 0.825 | [link](https://huggingface.co/lmqg/mt5-small-koquad-multitask/raw/main/eval/metric.first.sentence.paragraph_answer.question.lmqg_qg_koquad.default.json) |
126
 
127
 
128
+ ### Metrics (QAG)
129
+
130
+ | Dataset | Type | QA Aligned F1 Score (BERTScore) | QA Aligned F1 Score (MoverScore) | Link |
131
+ |:--------|:-----|--------------------------------:|---------------------------------:|-----:|
132
+ | [lmqg/qg_koquad](https://huggingface.co/datasets/lmqg/qg_koquad) | default | 0.804 | 0.828 | [link](https://huggingface.co/lmqg/mt5-small-koquad-multitask/raw/main/eval/metric.first.answer.paragraph.questions_answers.lmqg_qg_koquad.default.json) |
133
+
134
+
135
 
136
 
137
  ## Training hyperparameters