Update README.md
Browse files
README.md
CHANGED
@@ -14,13 +14,13 @@ The model for the Basque language was trained using [BDT corpus]().
|
|
14 |
|
15 |
# Training Hyperparameters
|
16 |
|
17 |
-
SEED:
|
18 |
-
EPOCHS:
|
19 |
-
BATCH SIZE:
|
20 |
-
GRADIENT ACCUMULATION STEPS:
|
21 |
-
LEARNING RATE:
|
22 |
-
WARMUP:
|
23 |
-
WEIGHT DECAY:
|
24 |
|
25 |
# Results
|
26 |
|
|
|
14 |
|
15 |
# Training Hyperparameters
|
16 |
|
17 |
+
SEED: 42
|
18 |
+
EPOCHS: 20
|
19 |
+
BATCH SIZE: 8
|
20 |
+
GRADIENT ACCUMULATION STEPS: 2
|
21 |
+
LEARNING RATE: 0.00005
|
22 |
+
WARMUP: 0.06
|
23 |
+
WEIGHT DECAY: 0.01
|
24 |
|
25 |
# Results
|
26 |
|