research-backup
/

t5-base-squadshifts-vanilla-amazon-qg

Text2Text Generation

question generation

Inference Endpoints

text-generation-inference

Model card Files Files and versions Community

asahi417 commited on Oct 6, 2022

Commit

76df80f

•

1 Parent(s): 5ca15e2

model update

Files changed (1) hide show

README.md +2 -3

README.md CHANGED Viewed

@@ -70,8 +70,7 @@ model_path = 'lmqg/t5-base-squadshifts-vanilla-amazon'
 pipe = pipeline("text2text-generation", model_path)
 # Question Generation
-input_text = 'generate question: <hl> Beyonce <hl> further expanded her acting career, starring as blues singer Etta James in the 2008 musical biopic, Cadillac Records.'
-question = pipe(input_text)
 ```
 ## Evaluation Metrics
@@ -81,7 +80,7 @@ question = pipe(input_text)
 | Dataset | Type | BLEU4 | ROUGE-L | METEOR | BERTScore | MoverScore | Link |
 |:--------|:-----|------:|--------:|-------:|----------:|-----------:|-----:|
-| [lmqg/qg_squadshifts](https://huggingface.co/datasets/lmqg/qg_squadshifts) | amazon | 0.07416581041734925 | 0.2543457714376334 | 0.20539291789554912 | 0.9140969733533658 | 0.612648730056147 | [link](https://huggingface.co/lmqg/t5-base-squadshifts-vanilla-amazon/raw/main/eval/metric.first.sentence.paragraph_answer.question.lmqg_qg_squadshifts.amazon.json) |

 pipe = pipeline("text2text-generation", model_path)
 # Question Generation
+question = pipe('generate question: <hl> Beyonce <hl> further expanded her acting career, starring as blues singer Etta James in the 2008 musical biopic, Cadillac Records.')
 ```
 ## Evaluation Metrics
 | Dataset | Type | BLEU4 | ROUGE-L | METEOR | BERTScore | MoverScore | Link |
 |:--------|:-----|------:|--------:|-------:|----------:|-----------:|-----:|
+| [lmqg/qg_squadshifts](https://huggingface.co/datasets/lmqg/qg_squadshifts) | amazon | 0.074 | 0.254 | 0.205 | 0.914 | 0.613 | [link](https://huggingface.co/lmqg/t5-base-squadshifts-vanilla-amazon/raw/main/eval/metric.first.sentence.paragraph_answer.question.lmqg_qg_squadshifts.amazon.json) |