Commit
•
3ee83a8
1
Parent(s):
bb871b7
Update README.md
Browse files
README.md
CHANGED
|
@@ -22,6 +22,14 @@ Paper: [How Much Knowledge Can You Pack
|
|
| 22 |
Into the Parameters of a Language Model?](https://arxiv.org/abs/1910.10683.pdf)
|
| 23 |
|
| 24 |
Authors: *Adam Roberts, Colin Raffel, Noam Shazeer*
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 25 |
## Usage
|
| 26 |
|
| 27 |
The model can be used as follows for **closed book question answering**:
|
|
|
|
| 22 |
Into the Parameters of a Language Model?](https://arxiv.org/abs/1910.10683.pdf)
|
| 23 |
|
| 24 |
Authors: *Adam Roberts, Colin Raffel, Noam Shazeer*
|
| 25 |
+
|
| 26 |
+
## Results on Natural Questions - Open Test
|
| 27 |
+
|
| 28 |
+
|Id | link | Exact Match |
|
| 29 |
+
|---|---|---|
|
| 30 |
+
|T5-small|https://huggingface.co/google/t5-small-ssm-nq|25.5|**|T5-large|https://huggingface.co/google/t5-large-ssm-nq|30.4|**|T5-xl|https://huggingface.co/google/t5-xl-ssm-nq|35.6||T5-xxl|https://huggingface.co/google/t5-xxl-ssm-nq|37.9||T5-3b|https://huggingface.co/google/t5-3b-ssm-nq|33.2|
|
| 31 |
+
|T5-11b|https://huggingface.co/google/t5-11b-ssm-nq|36.6|
|
| 32 |
+
|
| 33 |
## Usage
|
| 34 |
|
| 35 |
The model can be used as follows for **closed book question answering**:
|