Commit
•
4ec5321
1
Parent(s):
ac16011
update readme
Browse files
README.md
CHANGED
|
@@ -57,4 +57,21 @@ Here the training configuration of Transformer model and it's additional paramet
|
|
| 57 |
-dropout' : 0.1
|
| 58 |
-lr : 0.0001
|
| 59 |
|
| 60 |
-
```
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 57 |
-dropout' : 0.1
|
| 58 |
-lr : 0.0001
|
| 59 |
|
| 60 |
+
```
|
| 61 |
+
|
| 62 |
+
|
| 63 |
+
Testing Total Data[195775]:
|
| 64 |
+
BLUE Score : 0.9570595683021429
|
| 65 |
+
|
| 66 |
+
|
| 67 |
+
# Experiemnt Machine Configuration,
|
| 68 |
+
```
|
| 69 |
+
NVIDIA Driver Version: 470.161.03
|
| 70 |
+
CUDA Version: 11.2
|
| 71 |
+
NVIDIA GeForce 3090: 24 GB
|
| 72 |
+
```
|
| 73 |
+
# References
|
| 74 |
+
1. https://torchtutorialstaging.z5.web.core.windows.net/beginner/translation_transformer.html
|
| 75 |
+
2. https://arusl.medium.com/japanese-english-language-translation-with-transformer-using-pytorch-243738146806
|
| 76 |
+
3. https://github.com/hyunwoongko/transformer
|
| 77 |
+
4. https://www.kaggle.com/datasets/ari994/banglaenglishtransliteration
|