asahi417 commited on
Commit
6dc5e32
1 Parent(s): ca0f175

model update

Browse files
Files changed (1) hide show
  1. README.md +13 -0
README.md CHANGED
@@ -42,6 +42,12 @@ model-index:
42
  - name: MoverScore
43
  type: moverscore
44
  value: 0.6053481203449237
 
 
 
 
 
 
45
  ---
46
 
47
  # Model Card of `lmqg/t5-small-tweetqa-qag-np`
@@ -108,6 +114,13 @@ question = pipe(' Beyonce further expanded her acting career, starring as blues
108
  | [lmqg/qag_tweetqa](https://huggingface.co/datasets/lmqg/qag_tweetqa) | default | 0.107 | 0.348 | 0.278 | 0.895 | 0.605 | [link](https://huggingface.co/lmqg/t5-small-tweetqa-qag-np/raw/main/eval/metric.first.answer.paragraph.questions_answers.lmqg_qag_tweetqa.default.json) |
109
 
110
 
 
 
 
 
 
 
 
111
 
112
 
113
  ## Training hyperparameters
 
42
  - name: MoverScore
43
  type: moverscore
44
  value: 0.6053481203449237
45
+ - name: QAAlignedF1Score (BERTScore)
46
+ type: qa_aligned_f1_score_bertscore
47
+ value: 0.9154784387791007
48
+ - name: QAAlignedF1Score (MoverScore)
49
+ type: qa_aligned_f1_score_moverscore
50
+ value: 0.6354786472130932
51
  ---
52
 
53
  # Model Card of `lmqg/t5-small-tweetqa-qag-np`
 
114
  | [lmqg/qag_tweetqa](https://huggingface.co/datasets/lmqg/qag_tweetqa) | default | 0.107 | 0.348 | 0.278 | 0.895 | 0.605 | [link](https://huggingface.co/lmqg/t5-small-tweetqa-qag-np/raw/main/eval/metric.first.answer.paragraph.questions_answers.lmqg_qag_tweetqa.default.json) |
115
 
116
 
117
+ ### Metrics (QAG)
118
+
119
+ | Dataset | Type | QA Aligned F1 Score (BERTScore) | QA Aligned F1 Score (MoverScore) | Link |
120
+ |:--------|:-----|--------------------------------:|---------------------------------:|-----:|
121
+ | [lmqg/qag_tweetqa](https://huggingface.co/datasets/lmqg/qag_tweetqa) | default | 0.915 | 0.635 | [link](https://huggingface.co/lmqg/t5-small-tweetqa-qag-np/raw/main/eval/metric.first.answer.paragraph.questions_answers.lmqg_qag_tweetqa.default.json) |
122
+
123
+
124
 
125
 
126
  ## Training hyperparameters