asahi417 commited on
Commit
496538f
1 Parent(s): a4bb2dd

model update

Browse files
Files changed (1) hide show
  1. README.md +2 -32
README.md CHANGED
@@ -46,29 +46,6 @@ model-index:
46
  - name: MoverScore
47
  type: moverscore
48
  value: 0.5970414895775931
49
- - task:
50
- name: Text2text Generation
51
- type: text2text-generation
52
- dataset:
53
- name: lmqg/qg_squad
54
- type: default
55
- args: default
56
- metrics:
57
- - name: BLEU4
58
- type: bleu4
59
- value: 0.25998008887359414
60
- - name: ROUGE-L
61
- type: rouge-l
62
- value: 0.5334105296354255
63
- - name: METEOR
64
- type: meteor
65
- value: 0.267001949268102
66
- - name: BERTScore
67
- type: bertscore
68
- value: 0.9066512773123694
69
- - name: MoverScore
70
- type: moverscore
71
- value: 0.6472126170593971
72
  ---
73
 
74
  # Language Models Fine-tuning on Question Generation: `lmqg/t5-base-subjqa-tripadvisor`
@@ -93,8 +70,7 @@ model_path = 'lmqg/t5-base-subjqa-tripadvisor'
93
  pipe = pipeline("text2text-generation", model_path)
94
 
95
  # Question Generation
96
- input_text = 'generate question: <hl> Beyonce <hl> further expanded her acting career, starring as blues singer Etta James in the 2008 musical biopic, Cadillac Records.'
97
- question = pipe(input_text)
98
  ```
99
 
100
  ## Evaluation Metrics
@@ -104,15 +80,9 @@ question = pipe(input_text)
104
 
105
  | Dataset | Type | BLEU4 | ROUGE-L | METEOR | BERTScore | MoverScore | Link |
106
  |:--------|:-----|------:|--------:|-------:|----------:|-----------:|-----:|
107
- | [lmqg/qg_subjqa](https://huggingface.co/datasets/lmqg/qg_subjqa) | tripadvisor | 0.017397238839962123 | 0.1606393081191373 | 0.2012557355180759 | 0.9076414438907731 | 0.5970414895775931 | [link](https://huggingface.co/lmqg/t5-base-subjqa-tripadvisor/raw/main/eval/metric.first.sentence.paragraph_answer.question.lmqg_qg_subjqa.tripadvisor.json) |
108
-
109
 
110
 
111
- ### Out-of-domain Metrics
112
-
113
- | Dataset | Type | BLEU4 | ROUGE-L | METEOR | BERTScore | MoverScore | Link |
114
- |:--------|:-----|------:|--------:|-------:|----------:|-----------:|-----:|
115
- | [lmqg/qg_squad](https://huggingface.co/datasets/lmqg/qg_squad) | default | 0.25998008887359414 | 0.5334105296354255 | 0.267001949268102 | 0.9066512773123694 | 0.6472126170593971 | [link](https://huggingface.co/lmqg/t5-base-subjqa-tripadvisor/raw/main/eval_ood/metric.first.sentence.paragraph_answer.question.lmqg_qg_squad.default.json) |
116
 
117
 
118
  ## Training hyperparameters
 
46
  - name: MoverScore
47
  type: moverscore
48
  value: 0.5970414895775931
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
49
  ---
50
 
51
  # Language Models Fine-tuning on Question Generation: `lmqg/t5-base-subjqa-tripadvisor`
 
70
  pipe = pipeline("text2text-generation", model_path)
71
 
72
  # Question Generation
73
+ question = pipe('generate question: <hl> Beyonce <hl> further expanded her acting career, starring as blues singer Etta James in the 2008 musical biopic, Cadillac Records.')
 
74
  ```
75
 
76
  ## Evaluation Metrics
 
80
 
81
  | Dataset | Type | BLEU4 | ROUGE-L | METEOR | BERTScore | MoverScore | Link |
82
  |:--------|:-----|------:|--------:|-------:|----------:|-----------:|-----:|
83
+ | [lmqg/qg_subjqa](https://huggingface.co/datasets/lmqg/qg_subjqa) | tripadvisor | 0.017 | 0.161 | 0.201 | 0.908 | 0.597 | [link](https://huggingface.co/lmqg/t5-base-subjqa-tripadvisor/raw/main/eval/metric.first.sentence.paragraph_answer.question.lmqg_qg_subjqa.tripadvisor.json) |
 
84
 
85
 
 
 
 
 
 
86
 
87
 
88
  ## Training hyperparameters