hsohn3 commited on
Commit
7231e58
1 Parent(s): 21b4fd7

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +4 -3
README.md CHANGED
@@ -20,8 +20,6 @@ It achieves the following results on the evaluation set:
20
  ## Model description
21
  - Base Model: bert-base-uncased
22
  - Block_size: 512
23
- - Batch_size: 8
24
- - Num_epochs: 10
25
 
26
  ## Intended uses & limitations
27
 
@@ -29,7 +27,7 @@ More information needed
29
 
30
  ## Training and evaluation data
31
 
32
- - CCHS visit-level texts
33
 
34
  ## Training procedure
35
 
@@ -38,6 +36,9 @@ More information needed
38
  The following hyperparameters were used during training:
39
  - optimizer: {'name': 'AdamWeightDecay', 'learning_rate': 2e-05, 'decay': 0.0, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-07, 'amsgrad': False, 'weight_decay_rate': 0.01}
40
  - training_precision: float32
 
 
 
41
 
42
  ### Training results
43
 
 
20
  ## Model description
21
  - Base Model: bert-base-uncased
22
  - Block_size: 512
 
 
23
 
24
  ## Intended uses & limitations
25
 
 
27
 
28
  ## Training and evaluation data
29
 
30
+ - MAYO visit-level texts
31
 
32
  ## Training procedure
33
 
 
36
  The following hyperparameters were used during training:
37
  - optimizer: {'name': 'AdamWeightDecay', 'learning_rate': 2e-05, 'decay': 0.0, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-07, 'amsgrad': False, 'weight_decay_rate': 0.01}
38
  - training_precision: float32
39
+ - mlm_probability: 0.15
40
+ - batch_size: 8
41
+ - epochs: 10
42
 
43
  ### Training results
44