English to Kimbundu
Author: Daniel Whitenack
Data
- JW300 en-kmb +
fast_alignbased corpus fitering - Test sets from the Masakhane common test sets:
Model
initializer: "xavier"
bias_initializer: "zeros"
init_gain: 1.0
embed_initializer: "xavier"
embed_init_gain: 1.0
tied_embeddings: True
tied_softmax: True
encoder:
type: "transformer"
num_layers: 6
num_heads: 8
embeddings:
embedding_dim: 512
scale: True
dropout: 0.
# typically ff_size = 4 x hidden_size
hidden_size: 512
ff_size: 2048
dropout: 0.3
decoder:
type: "transformer"
num_layers: 6
num_heads: 8
embeddings:
embedding_dim: 512
scale: True
dropout: 0.
# typically ff_size = 4 x hidden_size
hidden_size: 512
ff_size: 2048
dropout: 0.3
The pre-trained model can be found here.
Analysis
Example 1:
Source: ( read philippians 2 : 5 - 8 . )
Reference: ( tanga filipe 2 : 5 - 8 . )
Hypothesis: ( tanga filipe 2 : 5 - 8 . )
Example 2:
Source: today , more than ever before , there are so many things that can distract us .
Reference: lelu , kuene ima iavulu i tena ku tu landukisa , m’ukulu ndenge .
Hypothesis: lelu , m’ukulu , kuene ima iavulu i tena ku tu landukisa .
Example 3:
Source: the apostle paul warned about what can happen if we please ourselves first .
Reference: ( 1 nzuá 2 : 16 ) o poxolo phaulu ua tu dimuna ku ima i tena kubhita se tu suua ngó o ima i tua uabhela .
Hypothesis: o poxolo phaulu ua dimuna o ima i tu tena kubhanga , se tu dióndo dianga kusota o kitambuijilu kia poxolo .
Example 4:
Source: what a privilege it is to live in these last days and to be part of jehovah’s incredible organization !
Reference: tua tokala ku lembalala izuua ioso kuila , ujitu ua dikota ku tokala mu kilunga kia jihova mu ixi , mu izuua isukidila - ku !
Hypothesis: ujitu ua dikota ku kala mu izuua íii isukidila - ku , ni ku bhanga mbandu ku kilunga kia jihova mu kilunga kiê !
Results
- BLEU train: 28.57
- BLEU dev: 28.81
- BLEU test: 32.76