research-backup
/

t5-small-squadshifts-nyt-qg

Text2Text Generation

question generation

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

asahi417 commited on Oct 6, 2022

Commit

3510a6a

•

1 Parent(s): 3532c99

model update

Files changed (1) hide show

README.md +2 -3

README.md CHANGED Viewed

@@ -70,8 +70,7 @@ model_path = 'lmqg/t5-small-squadshifts-nyt'
 pipe = pipeline("text2text-generation", model_path)
 # Question Generation
-input_text = 'generate question: <hl> Beyonce <hl> further expanded her acting career, starring as blues singer Etta James in the 2008 musical biopic, Cadillac Records.'
-question = pipe(input_text)
 ```
 ## Evaluation Metrics
@@ -81,7 +80,7 @@ question = pipe(input_text)
 | Dataset | Type | BLEU4 | ROUGE-L | METEOR | BERTScore | MoverScore | Link |
 |:--------|:-----|------:|--------:|-------:|----------:|-----------:|-----:|
-| [lmqg/qg_squadshifts](https://huggingface.co/datasets/lmqg/qg_squadshifts) | nyt | 0.0770766394528476 | 0.2343085731350795 | 0.23703719732964137 | 0.9219972069648569 | 0.6371016730193491 | [link](https://huggingface.co/lmqg/t5-small-squadshifts-nyt/raw/main/eval/metric.first.sentence.paragraph_answer.question.lmqg_qg_squadshifts.nyt.json) |

 pipe = pipeline("text2text-generation", model_path)
 # Question Generation
+question = pipe('generate question: <hl> Beyonce <hl> further expanded her acting career, starring as blues singer Etta James in the 2008 musical biopic, Cadillac Records.')
 ```
 ## Evaluation Metrics
 | Dataset | Type | BLEU4 | ROUGE-L | METEOR | BERTScore | MoverScore | Link |
 |:--------|:-----|------:|--------:|-------:|----------:|-----------:|-----:|
+| [lmqg/qg_squadshifts](https://huggingface.co/datasets/lmqg/qg_squadshifts) | nyt | 0.077 | 0.234 | 0.237 | 0.922 | 0.637 | [link](https://huggingface.co/lmqg/t5-small-squadshifts-nyt/raw/main/eval/metric.first.sentence.paragraph_answer.question.lmqg_qg_squadshifts.nyt.json) |