|
--- |
|
license: mit |
|
--- |
|
|
|
# T5-ANCE |
|
|
|
T5-ANCE generally follows the training procedure described in [this page](https://openmatch.readthedocs.io/en/latest/dr-msmarco-passage.html), but uses a much larger batch size. |
|
|
|
Dataset used for training: |
|
- MS MARCO Passage |
|
|
|
Evaluation result: |
|
|
|
|Dataset|Metric|Result| |
|
|---|---|---| |
|
|MS MARCO Passage (dev) | MRR@10 | 0.3570| |
|
|
|
Important hyper-parameters: |
|
|
|
|Name|Value| |
|
|---|---| |
|
|Global batch size|256| |
|
|Learning rate|5e-6| |
|
|Maximum length of query|32| |
|
|Maximum length of document|128| |
|
|Template for query|`<text>`| |
|
|Template for document|`Title: <title> Text: <text>`| |
|
|
|
### Paper |
|
|
|
\- |
