asahi417 commited on
Commit
9d090f4
1 Parent(s): 502fe8f

model update

Browse files
Files changed (1) hide show
  1. README.md +13 -0
README.md CHANGED
@@ -42,6 +42,12 @@ model-index:
42
  - name: MoverScore
43
  type: moverscore
44
  value: 0.6276807689001792
 
 
 
 
 
 
45
  ---
46
 
47
  # Model Card of `lmqg/t5-large-tweetqa-qag`
@@ -108,6 +114,13 @@ question = pipe('generate question and answer: Beyonce further expanded her act
108
  | [lmqg/qag_tweetqa](https://huggingface.co/datasets/lmqg/qag_tweetqa) | default | 0.138 | 0.372 | 0.316 | 0.911 | 0.628 | [link](https://huggingface.co/lmqg/t5-large-tweetqa-qag/raw/main/eval/metric.first.answer.paragraph.questions_answers.lmqg_qag_tweetqa.default.json) |
109
 
110
 
 
 
 
 
 
 
 
111
 
112
 
113
  ## Training hyperparameters
 
42
  - name: MoverScore
43
  type: moverscore
44
  value: 0.6276807689001792
45
+ - name: QAAlignedF1Score (BERTScore)
46
+ type: qa_aligned_f1_score_bertscore
47
+ value: 0.9249592790830291
48
+ - name: QAAlignedF1Score (MoverScore)
49
+ type: qa_aligned_f1_score_moverscore
50
+ value: 0.65046712149093
51
  ---
52
 
53
  # Model Card of `lmqg/t5-large-tweetqa-qag`
 
114
  | [lmqg/qag_tweetqa](https://huggingface.co/datasets/lmqg/qag_tweetqa) | default | 0.138 | 0.372 | 0.316 | 0.911 | 0.628 | [link](https://huggingface.co/lmqg/t5-large-tweetqa-qag/raw/main/eval/metric.first.answer.paragraph.questions_answers.lmqg_qag_tweetqa.default.json) |
115
 
116
 
117
+ ### Metrics (QAG)
118
+
119
+ | Dataset | Type | QA Aligned F1 Score (BERTScore) | QA Aligned F1 Score (MoverScore) | Link |
120
+ |:--------|:-----|--------------------------------:|---------------------------------:|-----:|
121
+ | [lmqg/qag_tweetqa](https://huggingface.co/datasets/lmqg/qag_tweetqa) | default | 0.925 | 0.65 | [link](https://huggingface.co/lmqg/t5-large-tweetqa-qag/raw/main/eval/metric.first.answer.paragraph.questions_answers.lmqg_qag_tweetqa.default.json) |
122
+
123
+
124
 
125
 
126
  ## Training hyperparameters