Matthijs0
/

Distilled-RoBERTa

Question Answering

Inference Endpoints

Model card Files Files and versions Community

Matthijs0 commited on Apr 8

Commit

6fc12df

•

1 Parent(s): 6822670

Update README.md

Files changed (1) hide show

README.md +2 -1

README.md CHANGED Viewed

@@ -11,7 +11,8 @@ batch_size = 16
 n_epochs = 3
 max_seq_len = 512
 learning_rate = 2e-5
-optimizer=Adam
 weight_decay=0.01
 embeds_dropout_prob = 0.1
 ```

 n_epochs = 3
 max_seq_len = 512
 learning_rate = 2e-5
+optimizer=AdamW
+lr_schedule = LinearWarmup
 weight_decay=0.01
 embeds_dropout_prob = 0.1
 ```