ThomasNLG commited on
Commit
a8d90bb
1 Parent(s): b596acb

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +62 -0
README.md ADDED
@@ -0,0 +1,62 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language: en
3
+ tags:
4
+ - qa
5
+ - question
6
+ - answering
7
+ - SQuAD
8
+ - metric
9
+ - nlg
10
+ - summarization
11
+ - t5-small
12
+ license: mit
13
+ datasets:
14
+ - squad_v2
15
+ model-index:
16
+ - name: t5-qa_squad2neg-en
17
+ results:
18
+ - task:
19
+ name: Question Answering
20
+ type: extractive-qa
21
+ widget:
22
+ - text: "Who was Louis 14? <\/s> Louis 14 was a French King."
23
+ ---
24
+ # t5-qa_squad2neg-en
25
+
26
+ ## Model description
27
+
28
+ This model is a *Question Answering* model based on T5-small.
29
+ It is actually a component of [QuestEval](https://github.com/recitalAI/QuestEval) metric but can be used independently as it is, for QA only.
30
+
31
+
32
+ ## How to use
33
+
34
+ ```python
35
+ from transformers import T5Tokenizer, T5ForConditionalGeneration
36
+
37
+ tokenizer = T5Tokenizer.from_pretrained("ThomasNLG/t5-qa_squad2neg-en")
38
+
39
+ model = T5ForConditionalGeneration.from_pretrained("ThomasNLG/t5-qa_squad2neg-en")
40
+ ```
41
+
42
+ The text input format should follow this template, accordingly to its training stage:
43
+
44
+ `text_input = "{QUESTION} </s> {CONTEXT}"`
45
+
46
+ ## Training data
47
+
48
+ The model was trained on:
49
+ - SQuAD-v2
50
+ - SQuAD-v2 neg: in addition to the training data of SQuAD-v2, for each answerable example, a negative sampled example has been added with the label *unanswerable* to help the model learning when the question is not answerable given the context. For more details, see the [paper](https://arxiv.org/abs/2103.12693).
51
+
52
+
53
+ ### Citation info
54
+
55
+ ```bibtex
56
+ @article{scialom2020QuestEval,
57
+ title={QuestEval: Summarization Asks for Fact-based Evaluation},
58
+ author={Scialom, Thomas and Dray, Paul-Alexis and Gallinari Patrick and Lamprier Sylvain and Piwowarski Benjamin and Staiano Jacopo and Wang Alex},
59
+ journal={arXiv preprint arXiv:2103.12693},
60
+ year={2021}
61
+ }
62
+ ```