Commit
•
75e1ff4
1
Parent(s):
b84ed2c
Update README.md
Browse files
README.md
CHANGED
|
@@ -28,13 +28,13 @@ See https://deepset.ai/germanquad for more details and dataset download in SQuAD
|
|
| 28 |
|
| 29 |
## Hyperparameters
|
| 30 |
```
|
| 31 |
-
batch_size =
|
| 32 |
-
n_epochs =
|
| 33 |
max_seq_len = 384
|
| 34 |
learning_rate = 3e-5
|
| 35 |
lr_schedule = LinearWarmup
|
| 36 |
embeds_dropout_prob = 0.1
|
| 37 |
-
temperature =
|
| 38 |
distillation_loss_weight = 0.75
|
| 39 |
```
|
| 40 |
## Performance
|
|
|
|
| 28 |
|
| 29 |
## Hyperparameters
|
| 30 |
```
|
| 31 |
+
batch_size = 56
|
| 32 |
+
n_epochs = 4
|
| 33 |
max_seq_len = 384
|
| 34 |
learning_rate = 3e-5
|
| 35 |
lr_schedule = LinearWarmup
|
| 36 |
embeds_dropout_prob = 0.1
|
| 37 |
+
temperature = 3
|
| 38 |
distillation_loss_weight = 0.75
|
| 39 |
```
|
| 40 |
## Performance
|