asahi417 commited on
Commit
50940ae
1 Parent(s): 1c01f20

model update

Browse files
Files changed (1) hide show
  1. README.md +13 -0
README.md CHANGED
@@ -42,6 +42,12 @@ model-index:
42
  - name: MoverScore
43
  type: moverscore
44
  value: 0.622602267900722
 
 
 
 
 
 
45
  ---
46
 
47
  # Model Card of `lmqg/t5-base-tweetqa-qag-np`
@@ -108,6 +114,13 @@ question = pipe(' Beyonce further expanded her acting career, starring as blues
108
  | [lmqg/qag_tweetqa](https://huggingface.co/datasets/lmqg/qag_tweetqa) | default | 0.134 | 0.372 | 0.311 | 0.908 | 0.623 | [link](https://huggingface.co/lmqg/t5-base-tweetqa-qag-np/raw/main/eval/metric.first.answer.paragraph.questions_answers.lmqg_qag_tweetqa.default.json) |
109
 
110
 
 
 
 
 
 
 
 
111
 
112
 
113
  ## Training hyperparameters
 
42
  - name: MoverScore
43
  type: moverscore
44
  value: 0.622602267900722
45
+ - name: QAAlignedF1Score (BERTScore)
46
+ type: qa_aligned_f1_score_bertscore
47
+ value: 0.9239486200615753
48
+ - name: QAAlignedF1Score (MoverScore)
49
+ type: qa_aligned_f1_score_moverscore
50
+ value: 0.6482953232883135
51
  ---
52
 
53
  # Model Card of `lmqg/t5-base-tweetqa-qag-np`
 
114
  | [lmqg/qag_tweetqa](https://huggingface.co/datasets/lmqg/qag_tweetqa) | default | 0.134 | 0.372 | 0.311 | 0.908 | 0.623 | [link](https://huggingface.co/lmqg/t5-base-tweetqa-qag-np/raw/main/eval/metric.first.answer.paragraph.questions_answers.lmqg_qag_tweetqa.default.json) |
115
 
116
 
117
+ ### Metrics (QAG)
118
+
119
+ | Dataset | Type | QA Aligned F1 Score (BERTScore) | QA Aligned F1 Score (MoverScore) | Link |
120
+ |:--------|:-----|--------------------------------:|---------------------------------:|-----:|
121
+ | [lmqg/qag_tweetqa](https://huggingface.co/datasets/lmqg/qag_tweetqa) | default | 0.924 | 0.648 | [link](https://huggingface.co/lmqg/t5-base-tweetqa-qag-np/raw/main/eval/metric.first.answer.paragraph.questions_answers.lmqg_qag_tweetqa.default.json) |
122
+
123
+
124
 
125
 
126
  ## Training hyperparameters