daekeun-ml commited on
Commit
baed986
1 Parent(s): d249c1c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -0
README.md CHANGED
@@ -34,6 +34,11 @@ python3 ./trdg/run.py -i ocr_dataset_poc.txt -w 5 -t {num_cores} -f 64 -l ko -c
34
  ```
35
 
36
  ## Training
 
 
 
 
 
37
  We used heuristic parameters without separate hyperparameter tuning.
38
  - learning_rate = 4e-5
39
  - epochs = 25
 
34
  ```
35
 
36
  ## Training
37
+
38
+ ### Base model
39
+ The encoder model used `facebook/deit-base-distilled-patch16-384` and the decoder model used `klue/roberta-base`. It is easier than training by starting weights from `microsoft/trocr-base-stage1`.
40
+
41
+ ### Parameters
42
  We used heuristic parameters without separate hyperparameter tuning.
43
  - learning_rate = 4e-5
44
  - epochs = 25