File size: 374 Bytes
e34df3e
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
---
language: 
  - en
tags:
- question-answering
license: mit
datasets:
- SQuAD
metrics:
- EM
- F1
---

# Test model for DL4NLP 2022 HW06  
xtremedistil-l6-h256-uncased trained on SQuAD

## Hyper parameters
- learning rate: 1e-5 
- weight decay: 0.01
- warm up steps: 0
- learning rate scheduler: linear 
- epochs: 1

## Metric results on the dev set
- F1: 65.48
- EM: 51.67