research-backup
/

t5-base-squadshifts-nyt-qg

Text2Text Generation

question generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

asahi417 commited on Oct 6, 2022

Commit

50b1fa0

•

1 Parent(s): 6cc965e

model update

Files changed (1) hide show

README.md +2 -3

README.md CHANGED Viewed

@@ -70,8 +70,7 @@ model_path = 'lmqg/t5-base-squadshifts-nyt'
 pipe = pipeline("text2text-generation", model_path)
 # Question Generation
-input_text = 'generate question: <hl> Beyonce <hl> further expanded her acting career, starring as blues singer Etta James in the 2008 musical biopic, Cadillac Records.'
-question = pipe(input_text)
 ```
 ## Evaluation Metrics
@@ -81,7 +80,7 @@ question = pipe(input_text)
 | Dataset | Type | BLEU4 | ROUGE-L | METEOR | BERTScore | MoverScore | Link |
 |:--------|:-----|------:|--------:|-------:|----------:|-----------:|-----:|
-| [lmqg/qg_squadshifts](https://huggingface.co/datasets/lmqg/qg_squadshifts) | nyt | 0.08526644876436423 | 0.2493349672604139 | 0.25210676004231025 | 0.9268105589600506 | 0.6469994154715311 | [link](https://huggingface.co/lmqg/t5-base-squadshifts-nyt/raw/main/eval/metric.first.sentence.paragraph_answer.question.lmqg_qg_squadshifts.nyt.json) |

 pipe = pipeline("text2text-generation", model_path)
 # Question Generation
+question = pipe('generate question: <hl> Beyonce <hl> further expanded her acting career, starring as blues singer Etta James in the 2008 musical biopic, Cadillac Records.')
 ```
 ## Evaluation Metrics
 | Dataset | Type | BLEU4 | ROUGE-L | METEOR | BERTScore | MoverScore | Link |
 |:--------|:-----|------:|--------:|-------:|----------:|-----------:|-----:|
+| [lmqg/qg_squadshifts](https://huggingface.co/datasets/lmqg/qg_squadshifts) | nyt | 0.085 | 0.249 | 0.252 | 0.927 | 0.647 | [link](https://huggingface.co/lmqg/t5-base-squadshifts-nyt/raw/main/eval/metric.first.sentence.paragraph_answer.question.lmqg_qg_squadshifts.nyt.json) |