mabornea commited on
Commit
b07f467
1 Parent(s): bd3b739

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +51 -0
README.md CHANGED
@@ -1,3 +1,54 @@
1
  ---
 
 
 
 
 
2
  license: apache-2.0
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ tags:
3
+ - Generative QA
4
+ - LFQA
5
+ - ELI5
6
+ - facebook/bart-large
7
  license: apache-2.0
8
  ---
9
+
10
+ # Model description
11
+
12
+ A Fusion in Decoder(FiD) model based on BART for the [KILT-ELI5](https://github.com/facebookresearch/KILT) task.
13
+
14
+ The FiD model was in introduced in the paper 'Leveraging Passage Retrieval with Generative Models for Open Domain Question Answering'.
15
+
16
+ The model has been initialized with [facebook/bart-large](https://huggingface.co/facebook/bart-large).
17
+
18
+ The model was trained with the KILT-ELI5 questions and supporting passages obtained from a ColBERT index of the 2019/08/01 Wikipedia dump.
19
+
20
+ ## Intended uses & limitations
21
+
22
+ You can use the raw model for the generative question answering task. Biases associated with the pre-existing language model, facebook/bart-large, that we used may be present in our fine-tuned model.
23
+
24
+ ## Usage
25
+
26
+ You can use this model directly with the [PrimeQA](https://github.com/primeqa/primeqa)'s [Generative FiD Reader](https://github.com/primeqa/primeqa/tree/primeqa-fid/primeqa/pipelines#readme).
27
+
28
+ ### BibTeX entry and citation info
29
+
30
+ ```bibtex
31
+ @inproceedings{Izacard2021LeveragingPR,
32
+ title={Leveraging Passage Retrieval with Generative Models for Open Domain Question Answering},
33
+ author={Gautier Izacard and Edouard Grave},
34
+ booktitle={EACL},
35
+ year={2021}
36
+ }
37
+ ```
38
+
39
+ ```bibtex
40
+ @inproceedings{petroni-etal-2021-kilt,
41
+ title = "{KILT}: a Benchmark for Knowledge Intensive Language Tasks",
42
+ author = {Petroni, Fabio and Piktus, Aleksandra and
43
+ Fan, Angela and Lewis, Patrick and
44
+ Yazdani, Majid and De Cao, Nicola and
45
+ Thorne, James and Jernite, Yacine and
46
+ Karpukhin, Vladimir and Maillard, Jean and
47
+ Plachouras, Vassilis and Rockt{\"a}schel, Tim and
48
+ Riedel, Sebastian},
49
+ booktitle = "Proceedings of the 2021 Conference of the North American Chapter of the Association
50
+ for Computational Linguistics: Human Language Technologies",
51
+ year = "2021",
52
+ }
53
+
54
+ ```