asahi417 commited on
Commit
56bae3c
1 Parent(s): 92f8fd7

model update

Browse files
Files changed (1) hide show
  1. README.md +13 -0
README.md CHANGED
@@ -42,6 +42,12 @@ model-index:
42
  - name: MoverScore
43
  type: moverscore
44
  value: 0.6051879460523261
 
 
 
 
 
 
45
  ---
46
 
47
  # Model Card of `lmqg/t5-small-tweetqa-qag`
@@ -108,6 +114,13 @@ question = pipe('generate question and answer: Beyonce further expanded her act
108
  | [lmqg/qag_tweetqa](https://huggingface.co/datasets/lmqg/qag_tweetqa) | default | 0.104 | 0.344 | 0.279 | 0.897 | 0.605 | [link](https://huggingface.co/lmqg/t5-small-tweetqa-qag/raw/main/eval/metric.first.answer.paragraph.questions_answers.lmqg_qag_tweetqa.default.json) |
109
 
110
 
 
 
 
 
 
 
 
111
 
112
 
113
  ## Training hyperparameters
 
42
  - name: MoverScore
43
  type: moverscore
44
  value: 0.6051879460523261
45
+ - name: QAAlignedF1Score (BERTScore)
46
+ type: qa_aligned_f1_score_bertscore
47
+ value: 0.9158554176310986
48
+ - name: QAAlignedF1Score (MoverScore)
49
+ type: qa_aligned_f1_score_moverscore
50
+ value: 0.6316423785253936
51
  ---
52
 
53
  # Model Card of `lmqg/t5-small-tweetqa-qag`
 
114
  | [lmqg/qag_tweetqa](https://huggingface.co/datasets/lmqg/qag_tweetqa) | default | 0.104 | 0.344 | 0.279 | 0.897 | 0.605 | [link](https://huggingface.co/lmqg/t5-small-tweetqa-qag/raw/main/eval/metric.first.answer.paragraph.questions_answers.lmqg_qag_tweetqa.default.json) |
115
 
116
 
117
+ ### Metrics (QAG)
118
+
119
+ | Dataset | Type | QA Aligned F1 Score (BERTScore) | QA Aligned F1 Score (MoverScore) | Link |
120
+ |:--------|:-----|--------------------------------:|---------------------------------:|-----:|
121
+ | [lmqg/qag_tweetqa](https://huggingface.co/datasets/lmqg/qag_tweetqa) | default | 0.916 | 0.632 | [link](https://huggingface.co/lmqg/t5-small-tweetqa-qag/raw/main/eval/metric.first.answer.paragraph.questions_answers.lmqg_qag_tweetqa.default.json) |
122
+
123
+
124
 
125
 
126
  ## Training hyperparameters