Update README.md

README.md

@@ -4,8 +4,37 @@ language:
 metrics:
 - wer
 - bleu
+- google_bleu
 tags:
 - ASR
 - Error Correction
 - Crossmodal
----
+---
+
+### Model Description
+
+Pre-Training Settings:
+
+166k samples from Common Voice 13.0 was recognized by Whisper tiny.en.
+
+1,000 random samples was selected as the test set, and the rest for training and validation with an 80%-20% split
+
+- Batch size: 256
+
+- Initial learning rate: 1e-5
+
+- Adam optimizer
+
+- 30 epochs
+
+- Cross-entropy loss
+
+- Best checkpoint saved based on WER as the evaluation metric
+
+- Decoding is performed using beam search with a size of 5
+
+- S2S backbone model adopted from ''[Exploring data augmentation for code generation tasks](https://aclanthology.org/2023.findings-eacl.114/)''.
+
+Continue-Training Setting:
+
+- 2 epochs for gold-gold to prevent the over-correction problem on ''[Ted talk data](https://cris.fbk.eu/bitstream/11582/104409/1/WIT3-EAMT2012.pdf)''