model update
Browse files
README.md
CHANGED
@@ -52,6 +52,7 @@ model-index:
|
|
52 |
This model is fine-tuned version of [facebook/bart-base](https://huggingface.co/facebook/bart-base) for question generation task on the
|
53 |
[lmqg/qg_squad](https://huggingface.co/datasets/lmqg/qg_squad) (dataset_name: default).
|
54 |
|
|
|
55 |
### Overview
|
56 |
- **Language model:** [facebook/bart-base](https://huggingface.co/facebook/bart-base)
|
57 |
- **Language:** en
|
@@ -70,20 +71,19 @@ pipe = pipeline("text2text-generation", model_path)
|
|
70 |
|
71 |
# Question Generation
|
72 |
input_text = '<hl> Beyonce <hl> further expanded her acting career, starring as blues singer Etta James in the 2008 musical biopic, Cadillac Records.'
|
73 |
-
|
74 |
```
|
75 |
|
76 |
## Evaluation Metrics
|
77 |
-
### In-domain Metrics
|
78 |
|
79 |
|
|
|
|
|
80 |
| Dataset | Type | BLEU4 | ROUGE-L | METEOR | BERTScore | MoverScore | Link |
|
81 |
|:--------|:-----|------:|--------:|-------:|----------:|-----------:|-----:|
|
82 |
| [lmqg/qg_squad](https://huggingface.co/datasets/lmqg/qg_squad) | default | 0.24400683975723286 | 0.5248717762722197 | 0.25985179074924764 | 0.9086545639846674 | 0.644778282518877 | [link](https://huggingface.co/lmqg/bart-base-squad-default/raw/main/eval/metric.first.sentence.paragraph_answer.question.lmqg_qg_squad.default.json) |
|
83 |
|
84 |
|
85 |
-
### Out-of-domain Metrics
|
86 |
-
|
87 |
|
88 |
|
89 |
## Training hyperparameters
|
|
|
52 |
This model is fine-tuned version of [facebook/bart-base](https://huggingface.co/facebook/bart-base) for question generation task on the
|
53 |
[lmqg/qg_squad](https://huggingface.co/datasets/lmqg/qg_squad) (dataset_name: default).
|
54 |
|
55 |
+
|
56 |
### Overview
|
57 |
- **Language model:** [facebook/bart-base](https://huggingface.co/facebook/bart-base)
|
58 |
- **Language:** en
|
|
|
71 |
|
72 |
# Question Generation
|
73 |
input_text = '<hl> Beyonce <hl> further expanded her acting career, starring as blues singer Etta James in the 2008 musical biopic, Cadillac Records.'
|
74 |
+
question = pipe(input_text)
|
75 |
```
|
76 |
|
77 |
## Evaluation Metrics
|
|
|
78 |
|
79 |
|
80 |
+
### Metrics
|
81 |
+
|
82 |
| Dataset | Type | BLEU4 | ROUGE-L | METEOR | BERTScore | MoverScore | Link |
|
83 |
|:--------|:-----|------:|--------:|-------:|----------:|-----------:|-----:|
|
84 |
| [lmqg/qg_squad](https://huggingface.co/datasets/lmqg/qg_squad) | default | 0.24400683975723286 | 0.5248717762722197 | 0.25985179074924764 | 0.9086545639846674 | 0.644778282518877 | [link](https://huggingface.co/lmqg/bart-base-squad-default/raw/main/eval/metric.first.sentence.paragraph_answer.question.lmqg_qg_squad.default.json) |
|
85 |
|
86 |
|
|
|
|
|
87 |
|
88 |
|
89 |
## Training hyperparameters
|