File size: 618 Bytes
5fa8a72
 
 
8461b15
 
 
265a344
8461b15
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
---
license: mit
---

# T5-ANCE

T5-ANCE generally follows the training procedure described in [this page](https://openmatch.readthedocs.io/en/latest/dr-msmarco-passage.html), but uses a much larger batch size.

Dataset used for training:
- MS MARCO Passage

Evaluation result:

|Dataset|Metric|Result|
|---|---|---|
|MS MARCO Passage (dev) | MRR@10 | 0.3570|

Important hyper-parameters:

|Name|Value|
|---|---|
|Global batch size|256|
|Learning rate|5e-6|
|Maximum length of query|32|
|Maximum length of document|128|
|Template for query|`<text>`|
|Template for document|`Title: <title> Text: <text>`|

### Paper

\-