2020-02-09 13:08:37,412 Hello! This is Joey-NMT. 2020-02-09 13:08:40,281 Total params: 12099840 2020-02-09 13:08:40,283 Trainable parameters: ['decoder.layer_norm.bias', 'decoder.layer_norm.weight', 'decoder.layers.0.dec_layer_norm.bias', 'decoder.layers.0.dec_layer_norm.weight', 'decoder.layers.0.feed_forward.layer_norm.bias', 'decoder.layers.0.feed_forward.layer_norm.weight', 'decoder.layers.0.feed_forward.pwff_layer.0.bias', 'decoder.layers.0.feed_forward.pwff_layer.0.weight', 'decoder.layers.0.feed_forward.pwff_layer.3.bias', 'decoder.layers.0.feed_forward.pwff_layer.3.weight', 'decoder.layers.0.src_trg_att.k_layer.bias', 'decoder.layers.0.src_trg_att.k_layer.weight', 'decoder.layers.0.src_trg_att.output_layer.bias', 'decoder.layers.0.src_trg_att.output_layer.weight', 'decoder.layers.0.src_trg_att.q_layer.bias', 'decoder.layers.0.src_trg_att.q_layer.weight', 'decoder.layers.0.src_trg_att.v_layer.bias', 'decoder.layers.0.src_trg_att.v_layer.weight', 'decoder.layers.0.trg_trg_att.k_layer.bias', 'decoder.layers.0.trg_trg_att.k_layer.weight', 'decoder.layers.0.trg_trg_att.output_layer.bias', 'decoder.layers.0.trg_trg_att.output_layer.weight', 'decoder.layers.0.trg_trg_att.q_layer.bias', 'decoder.layers.0.trg_trg_att.q_layer.weight', 'decoder.layers.0.trg_trg_att.v_layer.bias', 'decoder.layers.0.trg_trg_att.v_layer.weight', 'decoder.layers.0.x_layer_norm.bias', 'decoder.layers.0.x_layer_norm.weight', 'decoder.layers.1.dec_layer_norm.bias', 'decoder.layers.1.dec_layer_norm.weight', 'decoder.layers.1.feed_forward.layer_norm.bias', 'decoder.layers.1.feed_forward.layer_norm.weight', 'decoder.layers.1.feed_forward.pwff_layer.0.bias', 'decoder.layers.1.feed_forward.pwff_layer.0.weight', 'decoder.layers.1.feed_forward.pwff_layer.3.bias', 'decoder.layers.1.feed_forward.pwff_layer.3.weight', 'decoder.layers.1.src_trg_att.k_layer.bias', 'decoder.layers.1.src_trg_att.k_layer.weight', 'decoder.layers.1.src_trg_att.output_layer.bias', 'decoder.layers.1.src_trg_att.output_layer.weight', 'decoder.layers.1.src_trg_att.q_layer.bias', 'decoder.layers.1.src_trg_att.q_layer.weight', 'decoder.layers.1.src_trg_att.v_layer.bias', 'decoder.layers.1.src_trg_att.v_layer.weight', 'decoder.layers.1.trg_trg_att.k_layer.bias', 'decoder.layers.1.trg_trg_att.k_layer.weight', 'decoder.layers.1.trg_trg_att.output_layer.bias', 'decoder.layers.1.trg_trg_att.output_layer.weight', 'decoder.layers.1.trg_trg_att.q_layer.bias', 'decoder.layers.1.trg_trg_att.q_layer.weight', 'decoder.layers.1.trg_trg_att.v_layer.bias', 'decoder.layers.1.trg_trg_att.v_layer.weight', 'decoder.layers.1.x_layer_norm.bias', 'decoder.layers.1.x_layer_norm.weight', 'decoder.layers.2.dec_layer_norm.bias', 'decoder.layers.2.dec_layer_norm.weight', 'decoder.layers.2.feed_forward.layer_norm.bias', 'decoder.layers.2.feed_forward.layer_norm.weight', 'decoder.layers.2.feed_forward.pwff_layer.0.bias', 'decoder.layers.2.feed_forward.pwff_layer.0.weight', 'decoder.layers.2.feed_forward.pwff_layer.3.bias', 'decoder.layers.2.feed_forward.pwff_layer.3.weight', 'decoder.layers.2.src_trg_att.k_layer.bias', 'decoder.layers.2.src_trg_att.k_layer.weight', 'decoder.layers.2.src_trg_att.output_layer.bias', 'decoder.layers.2.src_trg_att.output_layer.weight', 'decoder.layers.2.src_trg_att.q_layer.bias', 'decoder.layers.2.src_trg_att.q_layer.weight', 'decoder.layers.2.src_trg_att.v_layer.bias', 'decoder.layers.2.src_trg_att.v_layer.weight', 'decoder.layers.2.trg_trg_att.k_layer.bias', 'decoder.layers.2.trg_trg_att.k_layer.weight', 'decoder.layers.2.trg_trg_att.output_layer.bias', 'decoder.layers.2.trg_trg_att.output_layer.weight', 'decoder.layers.2.trg_trg_att.q_layer.bias', 'decoder.layers.2.trg_trg_att.q_layer.weight', 'decoder.layers.2.trg_trg_att.v_layer.bias', 'decoder.layers.2.trg_trg_att.v_layer.weight', 'decoder.layers.2.x_layer_norm.bias', 'decoder.layers.2.x_layer_norm.weight', 'decoder.layers.3.dec_layer_norm.bias', 'decoder.layers.3.dec_layer_norm.weight', 'decoder.layers.3.feed_forward.layer_norm.bias', 'decoder.layers.3.feed_forward.layer_norm.weight', 'decoder.layers.3.feed_forward.pwff_layer.0.bias', 'decoder.layers.3.feed_forward.pwff_layer.0.weight', 'decoder.layers.3.feed_forward.pwff_layer.3.bias', 'decoder.layers.3.feed_forward.pwff_layer.3.weight', 'decoder.layers.3.src_trg_att.k_layer.bias', 'decoder.layers.3.src_trg_att.k_layer.weight', 'decoder.layers.3.src_trg_att.output_layer.bias', 'decoder.layers.3.src_trg_att.output_layer.weight', 'decoder.layers.3.src_trg_att.q_layer.bias', 'decoder.layers.3.src_trg_att.q_layer.weight', 'decoder.layers.3.src_trg_att.v_layer.bias', 'decoder.layers.3.src_trg_att.v_layer.weight', 'decoder.layers.3.trg_trg_att.k_layer.bias', 'decoder.layers.3.trg_trg_att.k_layer.weight', 'decoder.layers.3.trg_trg_att.output_layer.bias', 'decoder.layers.3.trg_trg_att.output_layer.weight', 'decoder.layers.3.trg_trg_att.q_layer.bias', 'decoder.layers.3.trg_trg_att.q_layer.weight', 'decoder.layers.3.trg_trg_att.v_layer.bias', 'decoder.layers.3.trg_trg_att.v_layer.weight', 'decoder.layers.3.x_layer_norm.bias', 'decoder.layers.3.x_layer_norm.weight', 'decoder.layers.4.dec_layer_norm.bias', 'decoder.layers.4.dec_layer_norm.weight', 'decoder.layers.4.feed_forward.layer_norm.bias', 'decoder.layers.4.feed_forward.layer_norm.weight', 'decoder.layers.4.feed_forward.pwff_layer.0.bias', 'decoder.layers.4.feed_forward.pwff_layer.0.weight', 'decoder.layers.4.feed_forward.pwff_layer.3.bias', 'decoder.layers.4.feed_forward.pwff_layer.3.weight', 'decoder.layers.4.src_trg_att.k_layer.bias', 'decoder.layers.4.src_trg_att.k_layer.weight', 'decoder.layers.4.src_trg_att.output_layer.bias', 'decoder.layers.4.src_trg_att.output_layer.weight', 'decoder.layers.4.src_trg_att.q_layer.bias', 'decoder.layers.4.src_trg_att.q_layer.weight', 'decoder.layers.4.src_trg_att.v_layer.bias', 'decoder.layers.4.src_trg_att.v_layer.weight', 'decoder.layers.4.trg_trg_att.k_layer.bias', 'decoder.layers.4.trg_trg_att.k_layer.weight', 'decoder.layers.4.trg_trg_att.output_layer.bias', 'decoder.layers.4.trg_trg_att.output_layer.weight', 'decoder.layers.4.trg_trg_att.q_layer.bias', 'decoder.layers.4.trg_trg_att.q_layer.weight', 'decoder.layers.4.trg_trg_att.v_layer.bias', 'decoder.layers.4.trg_trg_att.v_layer.weight', 'decoder.layers.4.x_layer_norm.bias', 'decoder.layers.4.x_layer_norm.weight', 'decoder.layers.5.dec_layer_norm.bias', 'decoder.layers.5.dec_layer_norm.weight', 'decoder.layers.5.feed_forward.layer_norm.bias', 'decoder.layers.5.feed_forward.layer_norm.weight', 'decoder.layers.5.feed_forward.pwff_layer.0.bias', 'decoder.layers.5.feed_forward.pwff_layer.0.weight', 'decoder.layers.5.feed_forward.pwff_layer.3.bias', 'decoder.layers.5.feed_forward.pwff_layer.3.weight', 'decoder.layers.5.src_trg_att.k_layer.bias', 'decoder.layers.5.src_trg_att.k_layer.weight', 'decoder.layers.5.src_trg_att.output_layer.bias', 'decoder.layers.5.src_trg_att.output_layer.weight', 'decoder.layers.5.src_trg_att.q_layer.bias', 'decoder.layers.5.src_trg_att.q_layer.weight', 'decoder.layers.5.src_trg_att.v_layer.bias', 'decoder.layers.5.src_trg_att.v_layer.weight', 'decoder.layers.5.trg_trg_att.k_layer.bias', 'decoder.layers.5.trg_trg_att.k_layer.weight', 'decoder.layers.5.trg_trg_att.output_layer.bias', 'decoder.layers.5.trg_trg_att.output_layer.weight', 'decoder.layers.5.trg_trg_att.q_layer.bias', 'decoder.layers.5.trg_trg_att.q_layer.weight', 'decoder.layers.5.trg_trg_att.v_layer.bias', 'decoder.layers.5.trg_trg_att.v_layer.weight', 'decoder.layers.5.x_layer_norm.bias', 'decoder.layers.5.x_layer_norm.weight', 'encoder.layer_norm.bias', 'encoder.layer_norm.weight', 'encoder.layers.0.feed_forward.layer_norm.bias', 'encoder.layers.0.feed_forward.layer_norm.weight', 'encoder.layers.0.feed_forward.pwff_layer.0.bias', 'encoder.layers.0.feed_forward.pwff_layer.0.weight', 'encoder.layers.0.feed_forward.pwff_layer.3.bias', 'encoder.layers.0.feed_forward.pwff_layer.3.weight', 'encoder.layers.0.layer_norm.bias', 'encoder.layers.0.layer_norm.weight', 'encoder.layers.0.src_src_att.k_layer.bias', 'encoder.layers.0.src_src_att.k_layer.weight', 'encoder.layers.0.src_src_att.output_layer.bias', 'encoder.layers.0.src_src_att.output_layer.weight', 'encoder.layers.0.src_src_att.q_layer.bias', 'encoder.layers.0.src_src_att.q_layer.weight', 'encoder.layers.0.src_src_att.v_layer.bias', 'encoder.layers.0.src_src_att.v_layer.weight', 'encoder.layers.1.feed_forward.layer_norm.bias', 'encoder.layers.1.feed_forward.layer_norm.weight', 'encoder.layers.1.feed_forward.pwff_layer.0.bias', 'encoder.layers.1.feed_forward.pwff_layer.0.weight', 'encoder.layers.1.feed_forward.pwff_layer.3.bias', 'encoder.layers.1.feed_forward.pwff_layer.3.weight', 'encoder.layers.1.layer_norm.bias', 'encoder.layers.1.layer_norm.weight', 'encoder.layers.1.src_src_att.k_layer.bias', 'encoder.layers.1.src_src_att.k_layer.weight', 'encoder.layers.1.src_src_att.output_layer.bias', 'encoder.layers.1.src_src_att.output_layer.weight', 'encoder.layers.1.src_src_att.q_layer.bias', 'encoder.layers.1.src_src_att.q_layer.weight', 'encoder.layers.1.src_src_att.v_layer.bias', 'encoder.layers.1.src_src_att.v_layer.weight', 'encoder.layers.2.feed_forward.layer_norm.bias', 'encoder.layers.2.feed_forward.layer_norm.weight', 'encoder.layers.2.feed_forward.pwff_layer.0.bias', 'encoder.layers.2.feed_forward.pwff_layer.0.weight', 'encoder.layers.2.feed_forward.pwff_layer.3.bias', 'encoder.layers.2.feed_forward.pwff_layer.3.weight', 'encoder.layers.2.layer_norm.bias', 'encoder.layers.2.layer_norm.weight', 'encoder.layers.2.src_src_att.k_layer.bias', 'encoder.layers.2.src_src_att.k_layer.weight', 'encoder.layers.2.src_src_att.output_layer.bias', 'encoder.layers.2.src_src_att.output_layer.weight', 'encoder.layers.2.src_src_att.q_layer.bias', 'encoder.layers.2.src_src_att.q_layer.weight', 'encoder.layers.2.src_src_att.v_layer.bias', 'encoder.layers.2.src_src_att.v_layer.weight', 'encoder.layers.3.feed_forward.layer_norm.bias', 'encoder.layers.3.feed_forward.layer_norm.weight', 'encoder.layers.3.feed_forward.pwff_layer.0.bias', 'encoder.layers.3.feed_forward.pwff_layer.0.weight', 'encoder.layers.3.feed_forward.pwff_layer.3.bias', 'encoder.layers.3.feed_forward.pwff_layer.3.weight', 'encoder.layers.3.layer_norm.bias', 'encoder.layers.3.layer_norm.weight', 'encoder.layers.3.src_src_att.k_layer.bias', 'encoder.layers.3.src_src_att.k_layer.weight', 'encoder.layers.3.src_src_att.output_layer.bias', 'encoder.layers.3.src_src_att.output_layer.weight', 'encoder.layers.3.src_src_att.q_layer.bias', 'encoder.layers.3.src_src_att.q_layer.weight', 'encoder.layers.3.src_src_att.v_layer.bias', 'encoder.layers.3.src_src_att.v_layer.weight', 'encoder.layers.4.feed_forward.layer_norm.bias', 'encoder.layers.4.feed_forward.layer_norm.weight', 'encoder.layers.4.feed_forward.pwff_layer.0.bias', 'encoder.layers.4.feed_forward.pwff_layer.0.weight', 'encoder.layers.4.feed_forward.pwff_layer.3.bias', 'encoder.layers.4.feed_forward.pwff_layer.3.weight', 'encoder.layers.4.layer_norm.bias', 'encoder.layers.4.layer_norm.weight', 'encoder.layers.4.src_src_att.k_layer.bias', 'encoder.layers.4.src_src_att.k_layer.weight', 'encoder.layers.4.src_src_att.output_layer.bias', 'encoder.layers.4.src_src_att.output_layer.weight', 'encoder.layers.4.src_src_att.q_layer.bias', 'encoder.layers.4.src_src_att.q_layer.weight', 'encoder.layers.4.src_src_att.v_layer.bias', 'encoder.layers.4.src_src_att.v_layer.weight', 'encoder.layers.5.feed_forward.layer_norm.bias', 'encoder.layers.5.feed_forward.layer_norm.weight', 'encoder.layers.5.feed_forward.pwff_layer.0.bias', 'encoder.layers.5.feed_forward.pwff_layer.0.weight', 'encoder.layers.5.feed_forward.pwff_layer.3.bias', 'encoder.layers.5.feed_forward.pwff_layer.3.weight', 'encoder.layers.5.layer_norm.bias', 'encoder.layers.5.layer_norm.weight', 'encoder.layers.5.src_src_att.k_layer.bias', 'encoder.layers.5.src_src_att.k_layer.weight', 'encoder.layers.5.src_src_att.output_layer.bias', 'encoder.layers.5.src_src_att.output_layer.weight', 'encoder.layers.5.src_src_att.q_layer.bias', 'encoder.layers.5.src_src_att.q_layer.weight', 'encoder.layers.5.src_src_att.v_layer.bias', 'encoder.layers.5.src_src_att.v_layer.weight', 'src_embed.lut.weight'] 2020-02-09 13:08:44,832 cfg.name : enpcm_transformer 2020-02-09 13:08:44,832 cfg.data.src : en 2020-02-09 13:08:44,832 cfg.data.trg : pcm 2020-02-09 13:08:44,832 cfg.data.train : data/enpcm/train.bpe 2020-02-09 13:08:44,832 cfg.data.dev : data/enpcm/dev.bpe 2020-02-09 13:08:44,832 cfg.data.test : data/enpcm/test.bpe 2020-02-09 13:08:44,832 cfg.data.level : bpe 2020-02-09 13:08:44,832 cfg.data.lowercase : False 2020-02-09 13:08:44,832 cfg.data.max_sent_length : 100 2020-02-09 13:08:44,832 cfg.data.src_vocab : data/enpcm/vocab.txt 2020-02-09 13:08:44,833 cfg.data.trg_vocab : data/enpcm/vocab.txt 2020-02-09 13:08:44,833 cfg.testing.beam_size : 5 2020-02-09 13:08:44,833 cfg.testing.alpha : 1.0 2020-02-09 13:08:44,833 cfg.training.random_seed : 42 2020-02-09 13:08:44,833 cfg.training.optimizer : adam 2020-02-09 13:08:44,833 cfg.training.normalization : tokens 2020-02-09 13:08:44,833 cfg.training.adam_betas : [0.9, 0.999] 2020-02-09 13:08:44,833 cfg.training.scheduling : plateau 2020-02-09 13:08:44,833 cfg.training.patience : 5 2020-02-09 13:08:44,833 cfg.training.learning_rate_factor : 0.5 2020-02-09 13:08:44,833 cfg.training.learning_rate_warmup : 1000 2020-02-09 13:08:44,833 cfg.training.decrease_factor : 0.7 2020-02-09 13:08:44,833 cfg.training.loss : crossentropy 2020-02-09 13:08:44,833 cfg.training.learning_rate : 0.0003 2020-02-09 13:08:44,833 cfg.training.learning_rate_min : 1e-08 2020-02-09 13:08:44,833 cfg.training.weight_decay : 0.0 2020-02-09 13:08:44,834 cfg.training.label_smoothing : 0.1 2020-02-09 13:08:44,834 cfg.training.batch_size : 4096 2020-02-09 13:08:44,834 cfg.training.batch_type : token 2020-02-09 13:08:44,834 cfg.training.eval_batch_size : 3600 2020-02-09 13:08:44,834 cfg.training.eval_batch_type : token 2020-02-09 13:08:44,834 cfg.training.batch_multiplier : 1 2020-02-09 13:08:44,834 cfg.training.early_stopping_metric : ppl 2020-02-09 13:08:44,834 cfg.training.epochs : 200 2020-02-09 13:08:44,834 cfg.training.validation_freq : 1000 2020-02-09 13:08:44,834 cfg.training.logging_freq : 100 2020-02-09 13:08:44,834 cfg.training.eval_metric : bleu 2020-02-09 13:08:44,834 cfg.training.model_dir : models/enpcm_transformer 2020-02-09 13:08:44,834 cfg.training.overwrite : True 2020-02-09 13:08:44,834 cfg.training.shuffle : True 2020-02-09 13:08:44,834 cfg.training.use_cuda : True 2020-02-09 13:08:44,834 cfg.training.max_output_length : 100 2020-02-09 13:08:44,834 cfg.training.print_valid_sents : [0, 1, 2, 3] 2020-02-09 13:08:44,835 cfg.training.keep_last_ckpts : 5 2020-02-09 13:08:44,835 cfg.model.initializer : xavier 2020-02-09 13:08:44,835 cfg.model.bias_initializer : zeros 2020-02-09 13:08:44,835 cfg.model.init_gain : 1.0 2020-02-09 13:08:44,835 cfg.model.embed_initializer : xavier 2020-02-09 13:08:44,835 cfg.model.embed_init_gain : 1.0 2020-02-09 13:08:44,835 cfg.model.tied_embeddings : True 2020-02-09 13:08:44,835 cfg.model.tied_softmax : True 2020-02-09 13:08:44,835 cfg.model.encoder.type : transformer 2020-02-09 13:08:44,835 cfg.model.encoder.num_layers : 6 2020-02-09 13:08:44,835 cfg.model.encoder.num_heads : 4 2020-02-09 13:08:44,835 cfg.model.encoder.embeddings.embedding_dim : 256 2020-02-09 13:08:44,835 cfg.model.encoder.embeddings.scale : True 2020-02-09 13:08:44,835 cfg.model.encoder.embeddings.dropout : 0.2 2020-02-09 13:08:44,835 cfg.model.encoder.hidden_size : 256 2020-02-09 13:08:44,835 cfg.model.encoder.ff_size : 1024 2020-02-09 13:08:44,836 cfg.model.encoder.dropout : 0.3 2020-02-09 13:08:44,836 cfg.model.decoder.type : transformer 2020-02-09 13:08:44,836 cfg.model.decoder.num_layers : 6 2020-02-09 13:08:44,836 cfg.model.decoder.num_heads : 4 2020-02-09 13:08:44,836 cfg.model.decoder.embeddings.embedding_dim : 256 2020-02-09 13:08:44,836 cfg.model.decoder.embeddings.scale : True 2020-02-09 13:08:44,836 cfg.model.decoder.embeddings.dropout : 0.2 2020-02-09 13:08:44,836 cfg.model.decoder.hidden_size : 256 2020-02-09 13:08:44,836 cfg.model.decoder.ff_size : 1024 2020-02-09 13:08:44,836 cfg.model.decoder.dropout : 0.3 2020-02-09 13:08:44,836 Data set sizes: train 20214, valid 1000, test 2101 2020-02-09 13:08:44,836 First training example: [SRC] JE@@ H@@ O@@ V@@ A@@ H@@ ’@@ S servants high@@ ly est@@ e@@ em God’s own holy book , the Bible . [TRG] JE@@ H@@ O@@ V@@ A@@ H people value Bible well well because dem know sey na God holy book . 2020-02-09 13:08:44,836 First 10 words (src): (0) (1) (2) (3) (4) . (5) , (6) the (7) to (8) and (9) dey 2020-02-09 13:08:44,837 First 10 words (trg): (0) (1) (2) (3) (4) . (5) , (6) the (7) to (8) and (9) dey 2020-02-09 13:08:44,837 Number of Src words (types): 4061 2020-02-09 13:08:44,838 Number of Trg words (types): 4061 2020-02-09 13:08:44,838 Model( encoder=TransformerEncoder(num_layers=6, num_heads=4), decoder=TransformerDecoder(num_layers=6, num_heads=4), src_embed=Embeddings(embedding_dim=256, vocab_size=4061), trg_embed=Embeddings(embedding_dim=256, vocab_size=4061)) 2020-02-09 13:08:44,842 EPOCH 1 2020-02-09 13:09:01,154 Epoch 1 Step: 100 Batch Loss: 4.827715 Tokens per Sec: 13096, Lr: 0.000300 2020-02-09 13:09:10,991 Epoch 1 Step: 200 Batch Loss: 4.614224 Tokens per Sec: 20943, Lr: 0.000300 2020-02-09 13:09:12,666 Epoch 1: total training loss 1071.55 2020-02-09 13:09:12,666 EPOCH 2 2020-02-09 13:09:20,841 Epoch 2 Step: 300 Batch Loss: 4.062344 Tokens per Sec: 21707, Lr: 0.000300 2020-02-09 13:09:30,628 Epoch 2 Step: 400 Batch Loss: 3.815988 Tokens per Sec: 21269, Lr: 0.000300 2020-02-09 13:09:33,876 Epoch 2: total training loss 892.39 2020-02-09 13:09:33,876 EPOCH 3 2020-02-09 13:09:40,491 Epoch 3 Step: 500 Batch Loss: 3.743718 Tokens per Sec: 21765, Lr: 0.000300 2020-02-09 13:09:50,349 Epoch 3 Step: 600 Batch Loss: 4.020455 Tokens per Sec: 21096, Lr: 0.000300 2020-02-09 13:09:55,169 Epoch 3: total training loss 791.86 2020-02-09 13:09:55,170 EPOCH 4 2020-02-09 13:10:00,217 Epoch 4 Step: 700 Batch Loss: 3.402556 Tokens per Sec: 20972, Lr: 0.000300 2020-02-09 13:10:10,054 Epoch 4 Step: 800 Batch Loss: 3.404273 Tokens per Sec: 21883, Lr: 0.000300 2020-02-09 13:10:16,470 Epoch 4: total training loss 740.73 2020-02-09 13:10:16,471 EPOCH 5 2020-02-09 13:10:19,994 Epoch 5 Step: 900 Batch Loss: 3.135571 Tokens per Sec: 21375, Lr: 0.000300 2020-02-09 13:10:29,865 Epoch 5 Step: 1000 Batch Loss: 3.272286 Tokens per Sec: 21446, Lr: 0.000300 2020-02-09 13:10:43,280 Hooray! New best validation result [ppl]! 2020-02-09 13:10:43,280 Saving new checkpoint. 2020-02-09 13:10:43,449 Example #0 2020-02-09 13:10:43,450 Raw source: ['Jehovah', 'did', 'not', 'do', 'that', ',', 'but', 'he', 'allowed', 'Satan', 'to', 'test', 'Job', ',', 'st@@', 'ating', ':', '“', 'Every@@', 'thing', 'that', 'he', 'has', 'is', 'in', 'your', 'hand', '.', '”'] 2020-02-09 13:10:43,450 Raw hypothesis: ['E', 'no', 'be', 'sey', ':', '‘', 'Jehovah', 'no', 'dey', 'do', 'wetin', 'Jehovah', 'want', '.', '’', '\u200b', '—', '1', 'Cor', '.'] 2020-02-09 13:10:43,450 Source: Jehovah did not do that , but he allowed Satan to test Job , stating : “ Everything that he has is in your hand . ” 2020-02-09 13:10:43,450 Reference: E tell am sey : ‘ Everything wey e get dey your hand . ’ 2020-02-09 13:10:43,450 Hypothesis: E no be sey : ‘ Jehovah no dey do wetin Jehovah want . ’ ​ — 1 Cor . 2020-02-09 13:10:43,450 Example #1 2020-02-09 13:10:43,450 Raw source: ['Corin@@', 'na', 'said', ':', '“', 'We', 'left', 'our', 'work', 'area', 'in', 'the', 'evening', 'and', 'wal@@', 'ked', 'to', 'a', 'ra@@', 'il@@', 'way', 'st@@', 'ation', '25', 'ki@@', 'lo@@', 'me@@', 'ters', '(', '15', 'miles', ')', 'away', '.'] 2020-02-09 13:10:43,450 Raw hypothesis: ['(', 'Acts', '3', ':', '1', ')', 'But', ',', 'we', 'dey', 'talk', 'sey', ':', '‘', 'When', 'we', 'dey', 'call', 'the', 'brothers', 'and', 'sisters', 'wey', 'dey', 'call', 'the', 'congregation', ',', 'and', 'sisters', 'wey', 'dey', 'call', 'am', '.'] 2020-02-09 13:10:43,450 Source: Corinna said : “ We left our work area in the evening and walked to a railway station 25 kilometers ( 15 miles ) away . 2020-02-09 13:10:43,450 Reference: Corinna talk sey : “ We comot for where we dey work for evening come trek go where people dey enter train wey be 25 kilometer ( 15 miles ) from where the farm dey . 2020-02-09 13:10:43,450 Hypothesis: ( Acts 3 : 1 ) But , we dey talk sey : ‘ When we dey call the brothers and sisters wey dey call the congregation , and sisters wey dey call am . 2020-02-09 13:10:43,450 Example #2 2020-02-09 13:10:43,450 Raw source: ['Ro@@', 'man@@', 'tic', 'love', '(', 'e@@', 'ʹ@@', 'ro@@', 's', ')', 'brings', 'delight', ',', 'and', 'love', 'for', 'family', '(', 'st@@', 'or@@', '·@@', 'ge@@', 'ʹ', ')', 'is', 'vital', 'when', 'children', 'enter', 'the', 'picture', '.'] 2020-02-09 13:10:43,450 Raw hypothesis: ['(', 'b', ')', 'Wetin', 'we', 'dey', 'do', 'to', 'do', 'wetin', 'Jehovah', 'want', 'make', 'dem', 'dey', 'do', 'for', 'the', 'kind', 'thing', 'wey', 'dem', 'dey', 'do', 'for', 'the', 'kind', 'thing', 'wey', 'dem', 'dey', 'do', '.'] 2020-02-09 13:10:43,450 Source: Romantic love ( eʹros ) brings delight , and love for family ( stor·geʹ ) is vital when children enter the picture . 2020-02-09 13:10:43,451 Reference: ( 1 ) Love wey friend get for each other ( Greek , phi·liʹa ) ; ( 2 ) love wey man and woman get for each other ( eʹros ) ; ( 3 ) love wey people for family get for each other ( stor·geʹ ) . 2020-02-09 13:10:43,451 Hypothesis: ( b ) Wetin we dey do to do wetin Jehovah want make dem dey do for the kind thing wey dem dey do for the kind thing wey dem dey do . 2020-02-09 13:10:43,451 Example #3 2020-02-09 13:10:43,451 Raw source: ['As', 'our', 'loving', 'De@@', 'sign@@', 'er', 'and', 'Creator', ',', 'Jehovah', 'knows', 'what', 'we', 'need', 'in', 'order', 'to', 'be', 'truly', 'happy', ',', 'and', 'he', 'f@@', 'ill@@', 's', 'that', 'need', 'ab@@', 'un@@', 'd@@', 'an@@', 'tly', '.'] 2020-02-09 13:10:43,451 Raw hypothesis: ['(', 'Acts', '3', ':', '1', ')', 'But', 'we', 'no', 'dey', 'do', 'wetin', 'we', 'dey', 'do', ',', 'we', 'go', 'do', 'wetin', 'we', 'go', 'do', '.'] 2020-02-09 13:10:43,451 Source: As our loving Designer and Creator , Jehovah knows what we need in order to be truly happy , and he fills that need abundantly . 2020-02-09 13:10:43,451 Reference: Because na Jehovah make us , e know wetin go make us happy . E don even give us pass wetin we need . 2020-02-09 13:10:43,451 Hypothesis: ( Acts 3 : 1 ) But we no dey do wetin we dey do , we go do wetin we go do . 2020-02-09 13:10:43,451 Validation result (greedy) at epoch 5, step 1000: bleu: 2.06, loss: 73394.2344, ppl: 24.6552, duration: 13.5851s 2020-02-09 13:10:51,461 Epoch 5: total training loss 712.52 2020-02-09 13:10:51,461 EPOCH 6 2020-02-09 13:10:53,275 Epoch 6 Step: 1100 Batch Loss: 3.265706 Tokens per Sec: 21850, Lr: 0.000300 2020-02-09 13:11:03,098 Epoch 6 Step: 1200 Batch Loss: 3.291728 Tokens per Sec: 21540, Lr: 0.000300 2020-02-09 13:11:12,990 Epoch 6 Step: 1300 Batch Loss: 2.943817 Tokens per Sec: 20834, Lr: 0.000300 2020-02-09 13:11:12,991 Epoch 6: total training loss 684.58 2020-02-09 13:11:12,991 EPOCH 7 2020-02-09 13:11:22,883 Epoch 7 Step: 1400 Batch Loss: 2.914759 Tokens per Sec: 21785, Lr: 0.000300 2020-02-09 13:11:32,637 Epoch 7 Step: 1500 Batch Loss: 3.037468 Tokens per Sec: 21424, Lr: 0.000300 2020-02-09 13:11:34,103 Epoch 7: total training loss 649.63 2020-02-09 13:11:34,104 EPOCH 8 2020-02-09 13:11:42,433 Epoch 8 Step: 1600 Batch Loss: 2.900786 Tokens per Sec: 21571, Lr: 0.000300 2020-02-09 13:11:52,268 Epoch 8 Step: 1700 Batch Loss: 3.398431 Tokens per Sec: 21592, Lr: 0.000300 2020-02-09 13:11:55,311 Epoch 8: total training loss 628.21 2020-02-09 13:11:55,312 EPOCH 9 2020-02-09 13:12:02,142 Epoch 9 Step: 1800 Batch Loss: 2.778916 Tokens per Sec: 21428, Lr: 0.000300 2020-02-09 13:12:11,969 Epoch 9 Step: 1900 Batch Loss: 2.773610 Tokens per Sec: 21280, Lr: 0.000300 2020-02-09 13:12:16,674 Epoch 9: total training loss 612.58 2020-02-09 13:12:16,674 EPOCH 10 2020-02-09 13:12:21,831 Epoch 10 Step: 2000 Batch Loss: 2.661200 Tokens per Sec: 21429, Lr: 0.000300 2020-02-09 13:12:34,991 Hooray! New best validation result [ppl]! 2020-02-09 13:12:34,991 Saving new checkpoint. 2020-02-09 13:12:35,158 Example #0 2020-02-09 13:12:35,158 Raw source: ['Jehovah', 'did', 'not', 'do', 'that', ',', 'but', 'he', 'allowed', 'Satan', 'to', 'test', 'Job', ',', 'st@@', 'ating', ':', '“', 'Every@@', 'thing', 'that', 'he', 'has', 'is', 'in', 'your', 'hand', '.', '”'] 2020-02-09 13:12:35,158 Raw hypothesis: ['Jehovah', 'no', 'dey', 'do', 'wetin', 'e', 'talk', '.', 'E', 'sey', ':', '‘', 'Jehovah', 'no', 'dey', 'do', 'wetin', 'e', 'talk', '.', '’'] 2020-02-09 13:12:35,158 Source: Jehovah did not do that , but he allowed Satan to test Job , stating : “ Everything that he has is in your hand . ” 2020-02-09 13:12:35,158 Reference: E tell am sey : ‘ Everything wey e get dey your hand . ’ 2020-02-09 13:12:35,158 Hypothesis: Jehovah no dey do wetin e talk . E sey : ‘ Jehovah no dey do wetin e talk . ’ 2020-02-09 13:12:35,158 Example #1 2020-02-09 13:12:35,159 Raw source: ['Corin@@', 'na', 'said', ':', '“', 'We', 'left', 'our', 'work', 'area', 'in', 'the', 'evening', 'and', 'wal@@', 'ked', 'to', 'a', 'ra@@', 'il@@', 'way', 'st@@', 'ation', '25', 'ki@@', 'lo@@', 'me@@', 'ters', '(', '15', 'miles', ')', 'away', '.'] 2020-02-09 13:12:35,159 Raw hypothesis: ['E', 'talk', 'sey', ':', '“', 'E', 'dey', 'hard', 'us', 'to', 'preach', 'to', 'our', 'house', 'and', 'we', 'dey', 'go', 'preach', 'for', 'where', 'we', 'dey', 'call', 'T@@', 'o@@', 'o@@', 'o@@', 'o@@', 'o@@', 'ine', '.'] 2020-02-09 13:12:35,159 Source: Corinna said : “ We left our work area in the evening and walked to a railway station 25 kilometers ( 15 miles ) away . 2020-02-09 13:12:35,159 Reference: Corinna talk sey : “ We comot for where we dey work for evening come trek go where people dey enter train wey be 25 kilometer ( 15 miles ) from where the farm dey . 2020-02-09 13:12:35,159 Hypothesis: E talk sey : “ E dey hard us to preach to our house and we dey go preach for where we dey call Toooooine . 2020-02-09 13:12:35,159 Example #2 2020-02-09 13:12:35,159 Raw source: ['Ro@@', 'man@@', 'tic', 'love', '(', 'e@@', 'ʹ@@', 'ro@@', 's', ')', 'brings', 'delight', ',', 'and', 'love', 'for', 'family', '(', 'st@@', 'or@@', '·@@', 'ge@@', 'ʹ', ')', 'is', 'vital', 'when', 'children', 'enter', 'the', 'picture', '.'] 2020-02-09 13:12:35,159 Raw hypothesis: ['E', 'no', 'be', 'sey', ',', 'Jehovah', 'dey', 'bless', 'us', 'and', 'dey', 'help', 'dem', 'get', 'faith', 'and', 'dey', 'do', 'wetin', 'dem', 'want', '.'] 2020-02-09 13:12:35,159 Source: Romantic love ( eʹros ) brings delight , and love for family ( stor·geʹ ) is vital when children enter the picture . 2020-02-09 13:12:35,159 Reference: ( 1 ) Love wey friend get for each other ( Greek , phi·liʹa ) ; ( 2 ) love wey man and woman get for each other ( eʹros ) ; ( 3 ) love wey people for family get for each other ( stor·geʹ ) . 2020-02-09 13:12:35,159 Hypothesis: E no be sey , Jehovah dey bless us and dey help dem get faith and dey do wetin dem want . 2020-02-09 13:12:35,159 Example #3 2020-02-09 13:12:35,159 Raw source: ['As', 'our', 'loving', 'De@@', 'sign@@', 'er', 'and', 'Creator', ',', 'Jehovah', 'knows', 'what', 'we', 'need', 'in', 'order', 'to', 'be', 'truly', 'happy', ',', 'and', 'he', 'f@@', 'ill@@', 's', 'that', 'need', 'ab@@', 'un@@', 'd@@', 'an@@', 'tly', '.'] 2020-02-09 13:12:35,159 Raw hypothesis: ['If', 'we', 'dey', 'do', 'wetin', 'Jehovah', 'want', ',', 'we', 'go', 'do', 'wetin', 'we', 'go', 'do', 'to', 'do', '.'] 2020-02-09 13:12:35,159 Source: As our loving Designer and Creator , Jehovah knows what we need in order to be truly happy , and he fills that need abundantly . 2020-02-09 13:12:35,159 Reference: Because na Jehovah make us , e know wetin go make us happy . E don even give us pass wetin we need . 2020-02-09 13:12:35,160 Hypothesis: If we dey do wetin Jehovah want , we go do wetin we go do to do . 2020-02-09 13:12:35,160 Validation result (greedy) at epoch 10, step 2000: bleu: 4.45, loss: 62560.9414, ppl: 15.3623, duration: 13.3281s 2020-02-09 13:12:44,997 Epoch 10 Step: 2100 Batch Loss: 1.763262 Tokens per Sec: 21487, Lr: 0.000300 2020-02-09 13:12:51,278 Epoch 10: total training loss 588.89 2020-02-09 13:12:51,279 EPOCH 11 2020-02-09 13:12:54,851 Epoch 11 Step: 2200 Batch Loss: 2.823848 Tokens per Sec: 21730, Lr: 0.000300 2020-02-09 13:13:04,681 Epoch 11 Step: 2300 Batch Loss: 2.997061 Tokens per Sec: 21470, Lr: 0.000300 2020-02-09 13:13:12,584 Epoch 11: total training loss 572.20 2020-02-09 13:13:12,584 EPOCH 12 2020-02-09 13:13:14,589 Epoch 12 Step: 2400 Batch Loss: 2.575049 Tokens per Sec: 20842, Lr: 0.000300 2020-02-09 13:13:24,479 Epoch 12 Step: 2500 Batch Loss: 2.632221 Tokens per Sec: 21450, Lr: 0.000300 2020-02-09 13:13:33,887 Epoch 12: total training loss 553.62 2020-02-09 13:13:33,887 EPOCH 13 2020-02-09 13:13:34,417 Epoch 13 Step: 2600 Batch Loss: 1.527499 Tokens per Sec: 16468, Lr: 0.000300 2020-02-09 13:13:44,302 Epoch 13 Step: 2700 Batch Loss: 1.940548 Tokens per Sec: 21794, Lr: 0.000300 2020-02-09 13:13:54,158 Epoch 13 Step: 2800 Batch Loss: 2.280367 Tokens per Sec: 21558, Lr: 0.000300 2020-02-09 13:13:55,049 Epoch 13: total training loss 535.02 2020-02-09 13:13:55,050 EPOCH 14 2020-02-09 13:14:04,072 Epoch 14 Step: 2900 Batch Loss: 2.631029 Tokens per Sec: 21414, Lr: 0.000300 2020-02-09 13:14:14,098 Epoch 14 Step: 3000 Batch Loss: 2.661278 Tokens per Sec: 21137, Lr: 0.000300 2020-02-09 13:14:29,606 Hooray! New best validation result [ppl]! 2020-02-09 13:14:29,606 Saving new checkpoint. 2020-02-09 13:14:29,774 Example #0 2020-02-09 13:14:29,774 Raw source: ['Jehovah', 'did', 'not', 'do', 'that', ',', 'but', 'he', 'allowed', 'Satan', 'to', 'test', 'Job', ',', 'st@@', 'ating', ':', '“', 'Every@@', 'thing', 'that', 'he', 'has', 'is', 'in', 'your', 'hand', '.', '”'] 2020-02-09 13:14:29,774 Raw hypothesis: ['Jehovah', 'no', 'do', 'wetin', 'e', 'do', ',', 'but', 'e', 'no', 'want', 'make', 'Jehovah', 'happy', '.'] 2020-02-09 13:14:29,774 Source: Jehovah did not do that , but he allowed Satan to test Job , stating : “ Everything that he has is in your hand . ” 2020-02-09 13:14:29,774 Reference: E tell am sey : ‘ Everything wey e get dey your hand . ’ 2020-02-09 13:14:29,774 Hypothesis: Jehovah no do wetin e do , but e no want make Jehovah happy . 2020-02-09 13:14:29,774 Example #1 2020-02-09 13:14:29,774 Raw source: ['Corin@@', 'na', 'said', ':', '“', 'We', 'left', 'our', 'work', 'area', 'in', 'the', 'evening', 'and', 'wal@@', 'ked', 'to', 'a', 'ra@@', 'il@@', 'way', 'st@@', 'ation', '25', 'ki@@', 'lo@@', 'me@@', 'ters', '(', '15', 'miles', ')', 'away', '.'] 2020-02-09 13:14:29,774 Raw hypothesis: ['E', 'talk', 'sey', ':', '“', 'We', 'come', 'dey', 'go', 'preach', 'for', 'one', 'place', 'wey', 'we', 'dey', 'call', 'one', 'village', 'wey', 'we', 'dey', 'call', 'one', 'village', 'wey', 'we', 'dey', 'call', 'one', 'village', '(', 'wey', 'we', 'dey', 'call', 'call', 'one', 'place', ')', '.'] 2020-02-09 13:14:29,774 Source: Corinna said : “ We left our work area in the evening and walked to a railway station 25 kilometers ( 15 miles ) away . 2020-02-09 13:14:29,774 Reference: Corinna talk sey : “ We comot for where we dey work for evening come trek go where people dey enter train wey be 25 kilometer ( 15 miles ) from where the farm dey . 2020-02-09 13:14:29,774 Hypothesis: E talk sey : “ We come dey go preach for one place wey we dey call one village wey we dey call one village wey we dey call one village ( wey we dey call call one place ) . 2020-02-09 13:14:29,774 Example #2 2020-02-09 13:14:29,775 Raw source: ['Ro@@', 'man@@', 'tic', 'love', '(', 'e@@', 'ʹ@@', 'ro@@', 's', ')', 'brings', 'delight', ',', 'and', 'love', 'for', 'family', '(', 'st@@', 'or@@', '·@@', 'ge@@', 'ʹ', ')', 'is', 'vital', 'when', 'children', 'enter', 'the', 'picture', '.'] 2020-02-09 13:14:29,775 Raw hypothesis: ['E', 'no', 'easy', 'for', 'us', 'to', 'love', 'Jehovah', 'and', 'we', 'love', 'dem', '.'] 2020-02-09 13:14:29,775 Source: Romantic love ( eʹros ) brings delight , and love for family ( stor·geʹ ) is vital when children enter the picture . 2020-02-09 13:14:29,775 Reference: ( 1 ) Love wey friend get for each other ( Greek , phi·liʹa ) ; ( 2 ) love wey man and woman get for each other ( eʹros ) ; ( 3 ) love wey people for family get for each other ( stor·geʹ ) . 2020-02-09 13:14:29,775 Hypothesis: E no easy for us to love Jehovah and we love dem . 2020-02-09 13:14:29,775 Example #3 2020-02-09 13:14:29,775 Raw source: ['As', 'our', 'loving', 'De@@', 'sign@@', 'er', 'and', 'Creator', ',', 'Jehovah', 'knows', 'what', 'we', 'need', 'in', 'order', 'to', 'be', 'truly', 'happy', ',', 'and', 'he', 'f@@', 'ill@@', 's', 'that', 'need', 'ab@@', 'un@@', 'd@@', 'an@@', 'tly', '.'] 2020-02-09 13:14:29,775 Raw hypothesis: ['As', 'we', 'dey', 'do', 'wetin', 'Jehovah', 'want', ',', 'we', 'no', 'go', 'happy', '.', 'E', 'dey', 'sure', 'sey', 'we', 'dey', 'happy', '.'] 2020-02-09 13:14:29,775 Source: As our loving Designer and Creator , Jehovah knows what we need in order to be truly happy , and he fills that need abundantly . 2020-02-09 13:14:29,775 Reference: Because na Jehovah make us , e know wetin go make us happy . E don even give us pass wetin we need . 2020-02-09 13:14:29,775 Hypothesis: As we dey do wetin Jehovah want , we no go happy . E dey sure sey we dey happy . 2020-02-09 13:14:29,775 Validation result (greedy) at epoch 14, step 3000: bleu: 7.74, loss: 56698.6953, ppl: 11.8927, duration: 15.6763s 2020-02-09 13:14:32,186 Epoch 14: total training loss 525.88 2020-02-09 13:14:32,186 EPOCH 15 2020-02-09 13:14:39,857 Epoch 15 Step: 3100 Batch Loss: 2.564197 Tokens per Sec: 21377, Lr: 0.000300 2020-02-09 13:14:49,763 Epoch 15 Step: 3200 Batch Loss: 1.934755 Tokens per Sec: 21579, Lr: 0.000300 2020-02-09 13:14:53,607 Epoch 15: total training loss 513.42 2020-02-09 13:14:53,607 EPOCH 16 2020-02-09 13:14:59,689 Epoch 16 Step: 3300 Batch Loss: 2.391761 Tokens per Sec: 21625, Lr: 0.000300 2020-02-09 13:15:09,624 Epoch 16 Step: 3400 Batch Loss: 2.533697 Tokens per Sec: 21201, Lr: 0.000300 2020-02-09 13:15:15,027 Epoch 16: total training loss 505.16 2020-02-09 13:15:15,027 EPOCH 17 2020-02-09 13:15:19,493 Epoch 17 Step: 3500 Batch Loss: 2.162553 Tokens per Sec: 21523, Lr: 0.000300 2020-02-09 13:15:29,371 Epoch 17 Step: 3600 Batch Loss: 2.326906 Tokens per Sec: 21915, Lr: 0.000300 2020-02-09 13:15:36,243 Epoch 17: total training loss 491.85 2020-02-09 13:15:36,244 EPOCH 18 2020-02-09 13:15:39,246 Epoch 18 Step: 3700 Batch Loss: 2.380447 Tokens per Sec: 21543, Lr: 0.000300 2020-02-09 13:15:49,155 Epoch 18 Step: 3800 Batch Loss: 2.020103 Tokens per Sec: 21464, Lr: 0.000300 2020-02-09 13:15:57,601 Epoch 18: total training loss 487.15 2020-02-09 13:15:57,602 EPOCH 19 2020-02-09 13:15:59,043 Epoch 19 Step: 3900 Batch Loss: 2.084379 Tokens per Sec: 19882, Lr: 0.000300 2020-02-09 13:16:08,997 Epoch 19 Step: 4000 Batch Loss: 2.317714 Tokens per Sec: 21471, Lr: 0.000300 2020-02-09 13:16:19,854 Hooray! New best validation result [ppl]! 2020-02-09 13:16:19,855 Saving new checkpoint. 2020-02-09 13:16:20,020 Example #0 2020-02-09 13:16:20,020 Raw source: ['Jehovah', 'did', 'not', 'do', 'that', ',', 'but', 'he', 'allowed', 'Satan', 'to', 'test', 'Job', ',', 'st@@', 'ating', ':', '“', 'Every@@', 'thing', 'that', 'he', 'has', 'is', 'in', 'your', 'hand', '.', '”'] 2020-02-09 13:16:20,020 Raw hypothesis: ['Jehovah', 'no', 'want', 'make', 'Job', 'no', 'do', 'wetin', 'e', 'want', '.', 'But', 'e', 'no', 'do', 'wetin', 'Satan', 'talk', '.'] 2020-02-09 13:16:20,020 Source: Jehovah did not do that , but he allowed Satan to test Job , stating : “ Everything that he has is in your hand . ” 2020-02-09 13:16:20,020 Reference: E tell am sey : ‘ Everything wey e get dey your hand . ’ 2020-02-09 13:16:20,020 Hypothesis: Jehovah no want make Job no do wetin e want . But e no do wetin Satan talk . 2020-02-09 13:16:20,020 Example #1 2020-02-09 13:16:20,021 Raw source: ['Corin@@', 'na', 'said', ':', '“', 'We', 'left', 'our', 'work', 'area', 'in', 'the', 'evening', 'and', 'wal@@', 'ked', 'to', 'a', 'ra@@', 'il@@', 'way', 'st@@', 'ation', '25', 'ki@@', 'lo@@', 'me@@', 'ters', '(', '15', 'miles', ')', 'away', '.'] 2020-02-09 13:16:20,021 Raw hypothesis: ['After', ',', 'dem', 'come', 'talk', 'sey', ':', '“', 'We', 'come', 'dey', 'go', 'house', 'for', 'where', 'we', 'dey', 'go', 'preach', 'for', 'where', 'we', 'dey', 'go', '.'] 2020-02-09 13:16:20,021 Source: Corinna said : “ We left our work area in the evening and walked to a railway station 25 kilometers ( 15 miles ) away . 2020-02-09 13:16:20,021 Reference: Corinna talk sey : “ We comot for where we dey work for evening come trek go where people dey enter train wey be 25 kilometer ( 15 miles ) from where the farm dey . 2020-02-09 13:16:20,021 Hypothesis: After , dem come talk sey : “ We come dey go house for where we dey go preach for where we dey go . 2020-02-09 13:16:20,021 Example #2 2020-02-09 13:16:20,021 Raw source: ['Ro@@', 'man@@', 'tic', 'love', '(', 'e@@', 'ʹ@@', 'ro@@', 's', ')', 'brings', 'delight', ',', 'and', 'love', 'for', 'family', '(', 'st@@', 'or@@', '·@@', 'ge@@', 'ʹ', ')', 'is', 'vital', 'when', 'children', 'enter', 'the', 'picture', '.'] 2020-02-09 13:16:20,021 Raw hypothesis: ['E', 'no', 'easy', 'for', 'people', 'to', 'love', 'theirself', 'and', 'dey', 'show', 'love', 'dem', '.'] 2020-02-09 13:16:20,021 Source: Romantic love ( eʹros ) brings delight , and love for family ( stor·geʹ ) is vital when children enter the picture . 2020-02-09 13:16:20,021 Reference: ( 1 ) Love wey friend get for each other ( Greek , phi·liʹa ) ; ( 2 ) love wey man and woman get for each other ( eʹros ) ; ( 3 ) love wey people for family get for each other ( stor·geʹ ) . 2020-02-09 13:16:20,021 Hypothesis: E no easy for people to love theirself and dey show love dem . 2020-02-09 13:16:20,021 Example #3 2020-02-09 13:16:20,021 Raw source: ['As', 'our', 'loving', 'De@@', 'sign@@', 'er', 'and', 'Creator', ',', 'Jehovah', 'knows', 'what', 'we', 'need', 'in', 'order', 'to', 'be', 'truly', 'happy', ',', 'and', 'he', 'f@@', 'ill@@', 's', 'that', 'need', 'ab@@', 'un@@', 'd@@', 'an@@', 'tly', '.'] 2020-02-09 13:16:20,021 Raw hypothesis: ['Because', 'we', 'love', 'Jehovah', 'and', 'we', 'love', 'am', ',', 'we', 'no', 'go', 'happy', 'sey', 'we', 'need', 'to', 'dey', 'happy', '.'] 2020-02-09 13:16:20,022 Source: As our loving Designer and Creator , Jehovah knows what we need in order to be truly happy , and he fills that need abundantly . 2020-02-09 13:16:20,022 Reference: Because na Jehovah make us , e know wetin go make us happy . E don even give us pass wetin we need . 2020-02-09 13:16:20,022 Hypothesis: Because we love Jehovah and we love am , we no go happy sey we need to dey happy . 2020-02-09 13:16:20,022 Validation result (greedy) at epoch 19, step 4000: bleu: 8.94, loss: 53580.6719, ppl: 10.3788, duration: 11.0240s 2020-02-09 13:16:29,848 Epoch 19 Step: 4100 Batch Loss: 2.156765 Tokens per Sec: 21434, Lr: 0.000300 2020-02-09 13:16:30,045 Epoch 19: total training loss 476.53 2020-02-09 13:16:30,045 EPOCH 20 2020-02-09 13:16:39,801 Epoch 20 Step: 4200 Batch Loss: 2.439323 Tokens per Sec: 21410, Lr: 0.000300 2020-02-09 13:16:49,787 Epoch 20 Step: 4300 Batch Loss: 2.393922 Tokens per Sec: 21434, Lr: 0.000300 2020-02-09 13:16:51,468 Epoch 20: total training loss 466.71 2020-02-09 13:16:51,468 EPOCH 21 2020-02-09 13:16:59,803 Epoch 21 Step: 4400 Batch Loss: 2.056876 Tokens per Sec: 21059, Lr: 0.000300 2020-02-09 13:17:09,793 Epoch 21 Step: 4500 Batch Loss: 2.316501 Tokens per Sec: 21219, Lr: 0.000300 2020-02-09 13:17:13,105 Epoch 21: total training loss 457.23 2020-02-09 13:17:13,106 EPOCH 22 2020-02-09 13:17:19,952 Epoch 22 Step: 4600 Batch Loss: 2.074961 Tokens per Sec: 21435, Lr: 0.000300 2020-02-09 13:17:29,924 Epoch 22 Step: 4700 Batch Loss: 1.109493 Tokens per Sec: 20771, Lr: 0.000300 2020-02-09 13:17:34,798 Epoch 22: total training loss 454.24 2020-02-09 13:17:34,799 EPOCH 23 2020-02-09 13:17:39,934 Epoch 23 Step: 4800 Batch Loss: 2.000134 Tokens per Sec: 20982, Lr: 0.000300 2020-02-09 13:17:49,934 Epoch 23 Step: 4900 Batch Loss: 2.151453 Tokens per Sec: 21163, Lr: 0.000300 2020-02-09 13:17:56,626 Epoch 23: total training loss 450.66 2020-02-09 13:17:56,626 EPOCH 24 2020-02-09 13:17:59,974 Epoch 24 Step: 5000 Batch Loss: 2.229525 Tokens per Sec: 21697, Lr: 0.000300 2020-02-09 13:18:13,124 Hooray! New best validation result [ppl]! 2020-02-09 13:18:13,124 Saving new checkpoint. 2020-02-09 13:18:13,291 Example #0 2020-02-09 13:18:13,291 Raw source: ['Jehovah', 'did', 'not', 'do', 'that', ',', 'but', 'he', 'allowed', 'Satan', 'to', 'test', 'Job', ',', 'st@@', 'ating', ':', '“', 'Every@@', 'thing', 'that', 'he', 'has', 'is', 'in', 'your', 'hand', '.', '”'] 2020-02-09 13:18:13,291 Raw hypothesis: ['Jehovah', 'no', 'let', 'Job', 'do', 'wetin', 'e', 'do', '.', 'E', 'sey', ':', '‘', 'Na', 'your', 'hand', 'e', 'don', 'do', 'for', 'you', '.', '’'] 2020-02-09 13:18:13,291 Source: Jehovah did not do that , but he allowed Satan to test Job , stating : “ Everything that he has is in your hand . ” 2020-02-09 13:18:13,291 Reference: E tell am sey : ‘ Everything wey e get dey your hand . ’ 2020-02-09 13:18:13,291 Hypothesis: Jehovah no let Job do wetin e do . E sey : ‘ Na your hand e don do for you . ’ 2020-02-09 13:18:13,291 Example #1 2020-02-09 13:18:13,291 Raw source: ['Corin@@', 'na', 'said', ':', '“', 'We', 'left', 'our', 'work', 'area', 'in', 'the', 'evening', 'and', 'wal@@', 'ked', 'to', 'a', 'ra@@', 'il@@', 'way', 'st@@', 'ation', '25', 'ki@@', 'lo@@', 'me@@', 'ters', '(', '15', 'miles', ')', 'away', '.'] 2020-02-09 13:18:13,291 Raw hypothesis: ['Dem', 'talk', 'sey', ':', '“', 'We', 'come', 'comot', 'for', 'where', 'we', 'go', 'stay', 'for', 'where', 'we', 'dey', 'stay', 'for', 'where', 'we', 'dey', 'stay', '.', 'We', 'come', 'comot', 'for', 'where', 'we', 'dey', 'stay', '.'] 2020-02-09 13:18:13,291 Source: Corinna said : “ We left our work area in the evening and walked to a railway station 25 kilometers ( 15 miles ) away . 2020-02-09 13:18:13,291 Reference: Corinna talk sey : “ We comot for where we dey work for evening come trek go where people dey enter train wey be 25 kilometer ( 15 miles ) from where the farm dey . 2020-02-09 13:18:13,291 Hypothesis: Dem talk sey : “ We come comot for where we go stay for where we dey stay for where we dey stay . We come comot for where we dey stay . 2020-02-09 13:18:13,292 Example #2 2020-02-09 13:18:13,292 Raw source: ['Ro@@', 'man@@', 'tic', 'love', '(', 'e@@', 'ʹ@@', 'ro@@', 's', ')', 'brings', 'delight', ',', 'and', 'love', 'for', 'family', '(', 'st@@', 'or@@', '·@@', 'ge@@', 'ʹ', ')', 'is', 'vital', 'when', 'children', 'enter', 'the', 'picture', '.'] 2020-02-09 13:18:13,292 Raw hypothesis: ['E', 'no', 'easy', 'for', 'dem', 'to', 'dey', 'show', 'love', 'theirself', 'and', 'dey', 'show', 'love', 'dem', '.'] 2020-02-09 13:18:13,292 Source: Romantic love ( eʹros ) brings delight , and love for family ( stor·geʹ ) is vital when children enter the picture . 2020-02-09 13:18:13,292 Reference: ( 1 ) Love wey friend get for each other ( Greek , phi·liʹa ) ; ( 2 ) love wey man and woman get for each other ( eʹros ) ; ( 3 ) love wey people for family get for each other ( stor·geʹ ) . 2020-02-09 13:18:13,292 Hypothesis: E no easy for dem to dey show love theirself and dey show love dem . 2020-02-09 13:18:13,292 Example #3 2020-02-09 13:18:13,292 Raw source: ['As', 'our', 'loving', 'De@@', 'sign@@', 'er', 'and', 'Creator', ',', 'Jehovah', 'knows', 'what', 'we', 'need', 'in', 'order', 'to', 'be', 'truly', 'happy', ',', 'and', 'he', 'f@@', 'ill@@', 's', 'that', 'need', 'ab@@', 'un@@', 'd@@', 'an@@', 'tly', '.'] 2020-02-09 13:18:13,292 Raw hypothesis: ['As', 'we', 'love', 'Jehovah', 'and', 'e', 'love', 'us', ',', 'we', 'know', 'sey', 'e', 'go', 'really', 'happy', '.'] 2020-02-09 13:18:13,292 Source: As our loving Designer and Creator , Jehovah knows what we need in order to be truly happy , and he fills that need abundantly . 2020-02-09 13:18:13,292 Reference: Because na Jehovah make us , e know wetin go make us happy . E don even give us pass wetin we need . 2020-02-09 13:18:13,292 Hypothesis: As we love Jehovah and e love us , we know sey e go really happy . 2020-02-09 13:18:13,292 Validation result (greedy) at epoch 24, step 5000: bleu: 10.12, loss: 51855.6953, ppl: 9.6257, duration: 13.3177s 2020-02-09 13:18:23,119 Epoch 24 Step: 5100 Batch Loss: 2.074046 Tokens per Sec: 21824, Lr: 0.000300 2020-02-09 13:18:31,275 Epoch 24: total training loss 439.66 2020-02-09 13:18:31,275 EPOCH 25 2020-02-09 13:18:32,990 Epoch 25 Step: 5200 Batch Loss: 2.131806 Tokens per Sec: 21127, Lr: 0.000300 2020-02-09 13:18:42,814 Epoch 25 Step: 5300 Batch Loss: 2.180349 Tokens per Sec: 21469, Lr: 0.000300 2020-02-09 13:18:52,591 Epoch 25 Step: 5400 Batch Loss: 2.024933 Tokens per Sec: 21256, Lr: 0.000300 2020-02-09 13:18:52,689 Epoch 25: total training loss 438.46 2020-02-09 13:18:52,689 EPOCH 26 2020-02-09 13:19:02,421 Epoch 26 Step: 5500 Batch Loss: 1.761211 Tokens per Sec: 21334, Lr: 0.000300 2020-02-09 13:19:12,238 Epoch 26 Step: 5600 Batch Loss: 2.269718 Tokens per Sec: 21752, Lr: 0.000300 2020-02-09 13:19:13,900 Epoch 26: total training loss 425.87 2020-02-09 13:19:13,900 EPOCH 27 2020-02-09 13:19:22,071 Epoch 27 Step: 5700 Batch Loss: 1.753395 Tokens per Sec: 21273, Lr: 0.000300 2020-02-09 13:19:31,889 Epoch 27 Step: 5800 Batch Loss: 2.062914 Tokens per Sec: 21619, Lr: 0.000300 2020-02-09 13:19:35,229 Epoch 27: total training loss 422.60 2020-02-09 13:19:35,230 EPOCH 28 2020-02-09 13:19:41,731 Epoch 28 Step: 5900 Batch Loss: 1.870739 Tokens per Sec: 20986, Lr: 0.000300 2020-02-09 13:19:51,539 Epoch 28 Step: 6000 Batch Loss: 2.292132 Tokens per Sec: 22003, Lr: 0.000300 2020-02-09 13:20:03,538 Hooray! New best validation result [ppl]! 2020-02-09 13:20:03,539 Saving new checkpoint. 2020-02-09 13:20:03,726 Example #0 2020-02-09 13:20:03,726 Raw source: ['Jehovah', 'did', 'not', 'do', 'that', ',', 'but', 'he', 'allowed', 'Satan', 'to', 'test', 'Job', ',', 'st@@', 'ating', ':', '“', 'Every@@', 'thing', 'that', 'he', 'has', 'is', 'in', 'your', 'hand', '.', '”'] 2020-02-09 13:20:03,726 Raw hypothesis: ['Jehovah', 'no', 'let', 'Job', 'do', 'wetin', 'e', 'do', '.', 'But', 'e', 'no', 'do', 'wetin', 'e', 'do', '.', 'E', 'sey', ':', '‘', 'Na', 'you', 'be', 'the', 'God', 'wey', 'dey', 'do', 'you', '.', '’'] 2020-02-09 13:20:03,726 Source: Jehovah did not do that , but he allowed Satan to test Job , stating : “ Everything that he has is in your hand . ” 2020-02-09 13:20:03,726 Reference: E tell am sey : ‘ Everything wey e get dey your hand . ’ 2020-02-09 13:20:03,726 Hypothesis: Jehovah no let Job do wetin e do . But e no do wetin e do . E sey : ‘ Na you be the God wey dey do you . ’ 2020-02-09 13:20:03,726 Example #1 2020-02-09 13:20:03,726 Raw source: ['Corin@@', 'na', 'said', ':', '“', 'We', 'left', 'our', 'work', 'area', 'in', 'the', 'evening', 'and', 'wal@@', 'ked', 'to', 'a', 'ra@@', 'il@@', 'way', 'st@@', 'ation', '25', 'ki@@', 'lo@@', 'me@@', 'ters', '(', '15', 'miles', ')', 'away', '.'] 2020-02-09 13:20:03,726 Raw hypothesis: ['Dem', 'come', 'talk', 'sey', ':', '“', 'We', 'come', 'comot', 'for', 'our', 'house', 'and', 'we', 'come', 'comot', 'for', 'where', 'we', 'dey', 'stay', 'for', 'evening', '.'] 2020-02-09 13:20:03,726 Source: Corinna said : “ We left our work area in the evening and walked to a railway station 25 kilometers ( 15 miles ) away . 2020-02-09 13:20:03,727 Reference: Corinna talk sey : “ We comot for where we dey work for evening come trek go where people dey enter train wey be 25 kilometer ( 15 miles ) from where the farm dey . 2020-02-09 13:20:03,727 Hypothesis: Dem come talk sey : “ We come comot for our house and we come comot for where we dey stay for evening . 2020-02-09 13:20:03,727 Example #2 2020-02-09 13:20:03,727 Raw source: ['Ro@@', 'man@@', 'tic', 'love', '(', 'e@@', 'ʹ@@', 'ro@@', 's', ')', 'brings', 'delight', ',', 'and', 'love', 'for', 'family', '(', 'st@@', 'or@@', '·@@', 'ge@@', 'ʹ', ')', 'is', 'vital', 'when', 'children', 'enter', 'the', 'picture', '.'] 2020-02-09 13:20:03,727 Raw hypothesis: ['Ro@@', 'n@@', 'ur@@', 'se', '(', '1', ')', 'dey', 'show', 'love', 'and', 'love', 'dey', 'make', 'people', 'happy', 'when', 'dem', 'dey', 'do', 'things', 'together', '.'] 2020-02-09 13:20:03,727 Source: Romantic love ( eʹros ) brings delight , and love for family ( stor·geʹ ) is vital when children enter the picture . 2020-02-09 13:20:03,727 Reference: ( 1 ) Love wey friend get for each other ( Greek , phi·liʹa ) ; ( 2 ) love wey man and woman get for each other ( eʹros ) ; ( 3 ) love wey people for family get for each other ( stor·geʹ ) . 2020-02-09 13:20:03,727 Hypothesis: Ronurse ( 1 ) dey show love and love dey make people happy when dem dey do things together . 2020-02-09 13:20:03,727 Example #3 2020-02-09 13:20:03,727 Raw source: ['As', 'our', 'loving', 'De@@', 'sign@@', 'er', 'and', 'Creator', ',', 'Jehovah', 'knows', 'what', 'we', 'need', 'in', 'order', 'to', 'be', 'truly', 'happy', ',', 'and', 'he', 'f@@', 'ill@@', 's', 'that', 'need', 'ab@@', 'un@@', 'd@@', 'an@@', 'tly', '.'] 2020-02-09 13:20:03,727 Raw hypothesis: ['(', 'John', '3', ':', '\u200b', '1', '-', '3', ')', 'As', 'we', 'dey', 'show', 'sey', 'Jehovah', 'love', 'us', ',', 'we', 'dey', 'happy', 'and', 'we', 'dey', 'happy', '.'] 2020-02-09 13:20:03,727 Source: As our loving Designer and Creator , Jehovah knows what we need in order to be truly happy , and he fills that need abundantly . 2020-02-09 13:20:03,727 Reference: Because na Jehovah make us , e know wetin go make us happy . E don even give us pass wetin we need . 2020-02-09 13:20:03,727 Hypothesis: ( John 3 : ​ 1 - 3 ) As we dey show sey Jehovah love us , we dey happy and we dey happy . 2020-02-09 13:20:03,727 Validation result (greedy) at epoch 28, step 6000: bleu: 11.03, loss: 50861.6523, ppl: 9.2168, duration: 12.1881s 2020-02-09 13:20:08,735 Epoch 28: total training loss 417.83 2020-02-09 13:20:08,736 EPOCH 29 2020-02-09 13:20:13,728 Epoch 29 Step: 6100 Batch Loss: 2.070772 Tokens per Sec: 20693, Lr: 0.000300 2020-02-09 13:20:23,554 Epoch 29 Step: 6200 Batch Loss: 1.767040 Tokens per Sec: 21648, Lr: 0.000300 2020-02-09 13:20:30,203 Epoch 29: total training loss 411.22 2020-02-09 13:20:30,203 EPOCH 30 2020-02-09 13:20:33,383 Epoch 30 Step: 6300 Batch Loss: 2.193435 Tokens per Sec: 21178, Lr: 0.000300 2020-02-09 13:20:43,198 Epoch 30 Step: 6400 Batch Loss: 2.159051 Tokens per Sec: 21522, Lr: 0.000300 2020-02-09 13:20:51,537 Epoch 30: total training loss 403.51 2020-02-09 13:20:51,537 EPOCH 31 2020-02-09 13:20:53,142 Epoch 31 Step: 6500 Batch Loss: 0.741025 Tokens per Sec: 20335, Lr: 0.000300 2020-02-09 13:21:02,992 Epoch 31 Step: 6600 Batch Loss: 1.625787 Tokens per Sec: 21500, Lr: 0.000300 2020-02-09 13:21:12,830 Epoch 31 Step: 6700 Batch Loss: 1.612840 Tokens per Sec: 21371, Lr: 0.000300 2020-02-09 13:21:12,931 Epoch 31: total training loss 401.02 2020-02-09 13:21:12,932 EPOCH 32 2020-02-09 13:21:22,663 Epoch 32 Step: 6800 Batch Loss: 1.733360 Tokens per Sec: 21536, Lr: 0.000300 2020-02-09 13:21:32,473 Epoch 32 Step: 6900 Batch Loss: 1.805076 Tokens per Sec: 21552, Lr: 0.000300 2020-02-09 13:21:34,139 Epoch 32: total training loss 394.55 2020-02-09 13:21:34,139 EPOCH 33 2020-02-09 13:21:42,326 Epoch 33 Step: 7000 Batch Loss: 1.426562 Tokens per Sec: 21610, Lr: 0.000300 2020-02-09 13:21:53,898 Hooray! New best validation result [ppl]! 2020-02-09 13:21:53,898 Saving new checkpoint. 2020-02-09 13:21:54,085 Example #0 2020-02-09 13:21:54,085 Raw source: ['Jehovah', 'did', 'not', 'do', 'that', ',', 'but', 'he', 'allowed', 'Satan', 'to', 'test', 'Job', ',', 'st@@', 'ating', ':', '“', 'Every@@', 'thing', 'that', 'he', 'has', 'is', 'in', 'your', 'hand', '.', '”'] 2020-02-09 13:21:54,085 Raw hypothesis: ['Jehovah', 'no', 'let', 'Job', 'do', 'wetin', 'e', 'no', 'like', '.', 'E', 'sey', ':', '‘', 'Satan', 'do', 'you', 'for', 'your', 'hand', '.', '’'] 2020-02-09 13:21:54,085 Source: Jehovah did not do that , but he allowed Satan to test Job , stating : “ Everything that he has is in your hand . ” 2020-02-09 13:21:54,085 Reference: E tell am sey : ‘ Everything wey e get dey your hand . ’ 2020-02-09 13:21:54,085 Hypothesis: Jehovah no let Job do wetin e no like . E sey : ‘ Satan do you for your hand . ’ 2020-02-09 13:21:54,086 Example #1 2020-02-09 13:21:54,086 Raw source: ['Corin@@', 'na', 'said', ':', '“', 'We', 'left', 'our', 'work', 'area', 'in', 'the', 'evening', 'and', 'wal@@', 'ked', 'to', 'a', 'ra@@', 'il@@', 'way', 'st@@', 'ation', '25', 'ki@@', 'lo@@', 'me@@', 'ters', '(', '15', 'miles', ')', 'away', '.'] 2020-02-09 13:21:54,086 Raw hypothesis: ['Corin@@', 'na', ':', '“', 'We', 'come', 'comot', 'for', 'our', 'place', 'for', 'where', 'we', 'dey', 'stay', 'for', 'evening', '.', 'Dem', 'come', 'comot', 'for', 'where', 'we', 'dey', 'stay', '.'] 2020-02-09 13:21:54,086 Source: Corinna said : “ We left our work area in the evening and walked to a railway station 25 kilometers ( 15 miles ) away . 2020-02-09 13:21:54,086 Reference: Corinna talk sey : “ We comot for where we dey work for evening come trek go where people dey enter train wey be 25 kilometer ( 15 miles ) from where the farm dey . 2020-02-09 13:21:54,086 Hypothesis: Corinna : “ We come comot for our place for where we dey stay for evening . Dem come comot for where we dey stay . 2020-02-09 13:21:54,086 Example #2 2020-02-09 13:21:54,086 Raw source: ['Ro@@', 'man@@', 'tic', 'love', '(', 'e@@', 'ʹ@@', 'ro@@', 's', ')', 'brings', 'delight', ',', 'and', 'love', 'for', 'family', '(', 'st@@', 'or@@', '·@@', 'ge@@', 'ʹ', ')', 'is', 'vital', 'when', 'children', 'enter', 'the', 'picture', '.'] 2020-02-09 13:21:54,086 Raw hypothesis: ['Ro@@', 'l@@', 'l@@', 'l@@', 'l@@', 'l@@', 'or@@', 's', '(', 'wey', 'dey', 'give', 'pikin', 'love', 'theirself', ')', ',', 'dey', 'show', 'love', 'im', 'family', 'and', 'children', '.'] 2020-02-09 13:21:54,086 Source: Romantic love ( eʹros ) brings delight , and love for family ( stor·geʹ ) is vital when children enter the picture . 2020-02-09 13:21:54,086 Reference: ( 1 ) Love wey friend get for each other ( Greek , phi·liʹa ) ; ( 2 ) love wey man and woman get for each other ( eʹros ) ; ( 3 ) love wey people for family get for each other ( stor·geʹ ) . 2020-02-09 13:21:54,086 Hypothesis: Rolllllors ( wey dey give pikin love theirself ) , dey show love im family and children . 2020-02-09 13:21:54,086 Example #3 2020-02-09 13:21:54,086 Raw source: ['As', 'our', 'loving', 'De@@', 'sign@@', 'er', 'and', 'Creator', ',', 'Jehovah', 'knows', 'what', 'we', 'need', 'in', 'order', 'to', 'be', 'truly', 'happy', ',', 'and', 'he', 'f@@', 'ill@@', 's', 'that', 'need', 'ab@@', 'un@@', 'd@@', 'an@@', 'tly', '.'] 2020-02-09 13:21:54,086 Raw hypothesis: ['We', 'know', 'sey', 'Jehovah', 'love', 'us', 'and', 'e', 'dey', 'happy', 'well', 'well', '.'] 2020-02-09 13:21:54,086 Source: As our loving Designer and Creator , Jehovah knows what we need in order to be truly happy , and he fills that need abundantly . 2020-02-09 13:21:54,087 Reference: Because na Jehovah make us , e know wetin go make us happy . E don even give us pass wetin we need . 2020-02-09 13:21:54,087 Hypothesis: We know sey Jehovah love us and e dey happy well well . 2020-02-09 13:21:54,087 Validation result (greedy) at epoch 33, step 7000: bleu: 11.48, loss: 50434.1406, ppl: 9.0464, duration: 11.7605s 2020-02-09 13:22:03,973 Epoch 33 Step: 7100 Batch Loss: 1.780194 Tokens per Sec: 21274, Lr: 0.000300 2020-02-09 13:22:07,320 Epoch 33: total training loss 390.49 2020-02-09 13:22:07,320 EPOCH 34 2020-02-09 13:22:13,857 Epoch 34 Step: 7200 Batch Loss: 0.929090 Tokens per Sec: 20885, Lr: 0.000300 2020-02-09 13:22:23,781 Epoch 34 Step: 7300 Batch Loss: 2.028444 Tokens per Sec: 21139, Lr: 0.000300 2020-02-09 13:22:28,797 Epoch 34: total training loss 386.96 2020-02-09 13:22:28,797 EPOCH 35 2020-02-09 13:22:33,632 Epoch 35 Step: 7400 Batch Loss: 1.744092 Tokens per Sec: 20742, Lr: 0.000300 2020-02-09 13:22:43,493 Epoch 35 Step: 7500 Batch Loss: 1.600927 Tokens per Sec: 21578, Lr: 0.000300 2020-02-09 13:22:50,093 Epoch 35: total training loss 380.53 2020-02-09 13:22:50,093 EPOCH 36 2020-02-09 13:22:53,379 Epoch 36 Step: 7600 Batch Loss: 1.619538 Tokens per Sec: 21408, Lr: 0.000300 2020-02-09 13:23:03,279 Epoch 36 Step: 7700 Batch Loss: 1.546237 Tokens per Sec: 21128, Lr: 0.000300 2020-02-09 13:23:11,579 Epoch 36: total training loss 377.24 2020-02-09 13:23:11,580 EPOCH 37 2020-02-09 13:23:13,286 Epoch 37 Step: 7800 Batch Loss: 1.759560 Tokens per Sec: 20812, Lr: 0.000300 2020-02-09 13:23:23,110 Epoch 37 Step: 7900 Batch Loss: 1.936061 Tokens per Sec: 21229, Lr: 0.000300 2020-02-09 13:23:32,932 Epoch 37 Step: 8000 Batch Loss: 1.861286 Tokens per Sec: 21484, Lr: 0.000300 2020-02-09 13:23:44,046 Hooray! New best validation result [ppl]! 2020-02-09 13:23:44,046 Saving new checkpoint. 2020-02-09 13:23:44,231 Example #0 2020-02-09 13:23:44,231 Raw source: ['Jehovah', 'did', 'not', 'do', 'that', ',', 'but', 'he', 'allowed', 'Satan', 'to', 'test', 'Job', ',', 'st@@', 'ating', ':', '“', 'Every@@', 'thing', 'that', 'he', 'has', 'is', 'in', 'your', 'hand', '.', '”'] 2020-02-09 13:23:44,231 Raw hypothesis: ['Jehovah', 'no', 'let', 'Job', 'do', 'wetin', 'e', 'talk', '.', 'E', 'sey', ':', '‘', 'Na', 'you', 'be', 'the', 'God', 'wey', 'dey', 'do', 'for', 'you', '.', '’'] 2020-02-09 13:23:44,231 Source: Jehovah did not do that , but he allowed Satan to test Job , stating : “ Everything that he has is in your hand . ” 2020-02-09 13:23:44,231 Reference: E tell am sey : ‘ Everything wey e get dey your hand . ’ 2020-02-09 13:23:44,231 Hypothesis: Jehovah no let Job do wetin e talk . E sey : ‘ Na you be the God wey dey do for you . ’ 2020-02-09 13:23:44,231 Example #1 2020-02-09 13:23:44,231 Raw source: ['Corin@@', 'na', 'said', ':', '“', 'We', 'left', 'our', 'work', 'area', 'in', 'the', 'evening', 'and', 'wal@@', 'ked', 'to', 'a', 'ra@@', 'il@@', 'way', 'st@@', 'ation', '25', 'ki@@', 'lo@@', 'me@@', 'ters', '(', '15', 'miles', ')', 'away', '.'] 2020-02-09 13:23:44,231 Raw hypothesis: ['Corin@@', 'na', 'comot', 'for', 'prison', ',', 'e', 'come', 'sey', ':', '‘', 'We', 'come', 'comot', 'for', 'where', 'we', 'dey', 'stay', 'for', 'where', 'we', 'dey', 'stay', 'for', 'where', 'we', 'dey', 'stay', '.'] 2020-02-09 13:23:44,231 Source: Corinna said : “ We left our work area in the evening and walked to a railway station 25 kilometers ( 15 miles ) away . 2020-02-09 13:23:44,231 Reference: Corinna talk sey : “ We comot for where we dey work for evening come trek go where people dey enter train wey be 25 kilometer ( 15 miles ) from where the farm dey . 2020-02-09 13:23:44,232 Hypothesis: Corinna comot for prison , e come sey : ‘ We come comot for where we dey stay for where we dey stay for where we dey stay . 2020-02-09 13:23:44,232 Example #2 2020-02-09 13:23:44,232 Raw source: ['Ro@@', 'man@@', 'tic', 'love', '(', 'e@@', 'ʹ@@', 'ro@@', 's', ')', 'brings', 'delight', ',', 'and', 'love', 'for', 'family', '(', 'st@@', 'or@@', '·@@', 'ge@@', 'ʹ', ')', 'is', 'vital', 'when', 'children', 'enter', 'the', 'picture', '.'] 2020-02-09 13:23:44,232 Raw hypothesis: ['Ro@@', 'n@@', 'ur@@', 'se', '(', 'wey', 'love', 'dey', 'show', 'love', ',', 'and', 'wey', 'dey', 'show', 'love', 'their', 'pikin', ',', 'dey', 'show', 'sey', 'dem', 'love', 'dem', '.'] 2020-02-09 13:23:44,232 Source: Romantic love ( eʹros ) brings delight , and love for family ( stor·geʹ ) is vital when children enter the picture . 2020-02-09 13:23:44,232 Reference: ( 1 ) Love wey friend get for each other ( Greek , phi·liʹa ) ; ( 2 ) love wey man and woman get for each other ( eʹros ) ; ( 3 ) love wey people for family get for each other ( stor·geʹ ) . 2020-02-09 13:23:44,232 Hypothesis: Ronurse ( wey love dey show love , and wey dey show love their pikin , dey show sey dem love dem . 2020-02-09 13:23:44,232 Example #3 2020-02-09 13:23:44,232 Raw source: ['As', 'our', 'loving', 'De@@', 'sign@@', 'er', 'and', 'Creator', ',', 'Jehovah', 'knows', 'what', 'we', 'need', 'in', 'order', 'to', 'be', 'truly', 'happy', ',', 'and', 'he', 'f@@', 'ill@@', 's', 'that', 'need', 'ab@@', 'un@@', 'd@@', 'an@@', 'tly', '.'] 2020-02-09 13:23:44,232 Raw hypothesis: ['As', 'we', 'love', 'Jehovah', 'and', 'e', 'know', 'wetin', 'e', 'want', ',', 'we', 'need', 'to', 'really', 'happy', '.'] 2020-02-09 13:23:44,232 Source: As our loving Designer and Creator , Jehovah knows what we need in order to be truly happy , and he fills that need abundantly . 2020-02-09 13:23:44,232 Reference: Because na Jehovah make us , e know wetin go make us happy . E don even give us pass wetin we need . 2020-02-09 13:23:44,232 Hypothesis: As we love Jehovah and e know wetin e want , we need to really happy . 2020-02-09 13:23:44,232 Validation result (greedy) at epoch 37, step 8000: bleu: 12.06, loss: 50059.2305, ppl: 8.8995, duration: 11.3002s 2020-02-09 13:23:44,333 Epoch 37: total training loss 372.70 2020-02-09 13:23:44,333 EPOCH 38 2020-02-09 13:23:54,141 Epoch 38 Step: 8100 Batch Loss: 1.849720 Tokens per Sec: 21401, Lr: 0.000300 2020-02-09 13:24:04,016 Epoch 38 Step: 8200 Batch Loss: 1.739787 Tokens per Sec: 21653, Lr: 0.000300 2020-02-09 13:24:05,685 Epoch 38: total training loss 367.20 2020-02-09 13:24:05,685 EPOCH 39 2020-02-09 13:24:13,938 Epoch 39 Step: 8300 Batch Loss: 1.978657 Tokens per Sec: 21301, Lr: 0.000300 2020-02-09 13:24:23,831 Epoch 39 Step: 8400 Batch Loss: 1.544337 Tokens per Sec: 21534, Lr: 0.000300 2020-02-09 13:24:27,069 Epoch 39: total training loss 363.03 2020-02-09 13:24:27,069 EPOCH 40 2020-02-09 13:24:33,676 Epoch 40 Step: 8500 Batch Loss: 1.669919 Tokens per Sec: 21793, Lr: 0.000300 2020-02-09 13:24:43,529 Epoch 40 Step: 8600 Batch Loss: 0.820153 Tokens per Sec: 21331, Lr: 0.000300 2020-02-09 13:24:48,366 Epoch 40: total training loss 360.14 2020-02-09 13:24:48,366 EPOCH 41 2020-02-09 13:24:53,436 Epoch 41 Step: 8700 Batch Loss: 1.652280 Tokens per Sec: 21471, Lr: 0.000300 2020-02-09 13:25:03,307 Epoch 41 Step: 8800 Batch Loss: 1.807984 Tokens per Sec: 21749, Lr: 0.000300 2020-02-09 13:25:09,601 Epoch 41: total training loss 353.74 2020-02-09 13:25:09,602 EPOCH 42 2020-02-09 13:25:13,181 Epoch 42 Step: 8900 Batch Loss: 1.464720 Tokens per Sec: 20739, Lr: 0.000300 2020-02-09 13:25:22,990 Epoch 42 Step: 9000 Batch Loss: 1.595807 Tokens per Sec: 21590, Lr: 0.000300 2020-02-09 13:25:37,129 Example #0 2020-02-09 13:25:37,130 Raw source: ['Jehovah', 'did', 'not', 'do', 'that', ',', 'but', 'he', 'allowed', 'Satan', 'to', 'test', 'Job', ',', 'st@@', 'ating', ':', '“', 'Every@@', 'thing', 'that', 'he', 'has', 'is', 'in', 'your', 'hand', '.', '”'] 2020-02-09 13:25:37,130 Raw hypothesis: ['Jehovah', 'no', 'let', 'Job', 'do', 'wetin', 'e', 'no', 'like', '.', 'E', 'sey', ':', '‘', 'Na', 'you', 'be', 'the', 'God', 'wey', 'high', 'pass', 'for', 'you', '.', '’'] 2020-02-09 13:25:37,130 Source: Jehovah did not do that , but he allowed Satan to test Job , stating : “ Everything that he has is in your hand . ” 2020-02-09 13:25:37,130 Reference: E tell am sey : ‘ Everything wey e get dey your hand . ’ 2020-02-09 13:25:37,130 Hypothesis: Jehovah no let Job do wetin e no like . E sey : ‘ Na you be the God wey high pass for you . ’ 2020-02-09 13:25:37,130 Example #1 2020-02-09 13:25:37,130 Raw source: ['Corin@@', 'na', 'said', ':', '“', 'We', 'left', 'our', 'work', 'area', 'in', 'the', 'evening', 'and', 'wal@@', 'ked', 'to', 'a', 'ra@@', 'il@@', 'way', 'st@@', 'ation', '25', 'ki@@', 'lo@@', 'me@@', 'ters', '(', '15', 'miles', ')', 'away', '.'] 2020-02-09 13:25:37,130 Raw hypothesis: ['Corin@@', 'na', ':', '“', 'We', 'comot', 'for', 'where', 'we', 'dey', 'stay', 'for', 'evening', 'and', 'we', 'dey', 'travel', 'go', 'the', 'place', 'wey', 'we', 'dey', 'call', 'ra@@', 'il@@', 'ation', '(', '15', 'km', ')', '.'] 2020-02-09 13:25:37,130 Source: Corinna said : “ We left our work area in the evening and walked to a railway station 25 kilometers ( 15 miles ) away . 2020-02-09 13:25:37,130 Reference: Corinna talk sey : “ We comot for where we dey work for evening come trek go where people dey enter train wey be 25 kilometer ( 15 miles ) from where the farm dey . 2020-02-09 13:25:37,130 Hypothesis: Corinna : “ We comot for where we dey stay for evening and we dey travel go the place wey we dey call railation ( 15 km ) . 2020-02-09 13:25:37,130 Example #2 2020-02-09 13:25:37,130 Raw source: ['Ro@@', 'man@@', 'tic', 'love', '(', 'e@@', 'ʹ@@', 'ro@@', 's', ')', 'brings', 'delight', ',', 'and', 'love', 'for', 'family', '(', 'st@@', 'or@@', '·@@', 'ge@@', 'ʹ', ')', 'is', 'vital', 'when', 'children', 'enter', 'the', 'picture', '.'] 2020-02-09 13:25:37,130 Raw hypothesis: ['Ro@@', 'l@@', 'or@@', 's', '(', '1', ')', 'We', 'really', 'love', 'each', 'other', ',', 'and', 'we', 'dey', 'happy', 'as', 'we', 'dey', 'preach', '.'] 2020-02-09 13:25:37,131 Source: Romantic love ( eʹros ) brings delight , and love for family ( stor·geʹ ) is vital when children enter the picture . 2020-02-09 13:25:37,131 Reference: ( 1 ) Love wey friend get for each other ( Greek , phi·liʹa ) ; ( 2 ) love wey man and woman get for each other ( eʹros ) ; ( 3 ) love wey people for family get for each other ( stor·geʹ ) . 2020-02-09 13:25:37,131 Hypothesis: Rolors ( 1 ) We really love each other , and we dey happy as we dey preach . 2020-02-09 13:25:37,131 Example #3 2020-02-09 13:25:37,131 Raw source: ['As', 'our', 'loving', 'De@@', 'sign@@', 'er', 'and', 'Creator', ',', 'Jehovah', 'knows', 'what', 'we', 'need', 'in', 'order', 'to', 'be', 'truly', 'happy', ',', 'and', 'he', 'f@@', 'ill@@', 's', 'that', 'need', 'ab@@', 'un@@', 'd@@', 'an@@', 'tly', '.'] 2020-02-09 13:25:37,131 Raw hypothesis: ['(', 'John', '6', ':', '14', ')', 'As', 'Jehovah', 'love', 'us', ',', 'we', 'know', 'wetin', 'e', 'really', 'need', 'and', 'e', 'dey', 'happy', 'well', 'well', '.'] 2020-02-09 13:25:37,131 Source: As our loving Designer and Creator , Jehovah knows what we need in order to be truly happy , and he fills that need abundantly . 2020-02-09 13:25:37,131 Reference: Because na Jehovah make us , e know wetin go make us happy . E don even give us pass wetin we need . 2020-02-09 13:25:37,131 Hypothesis: ( John 6 : 14 ) As Jehovah love us , we know wetin e really need and e dey happy well well . 2020-02-09 13:25:37,131 Validation result (greedy) at epoch 42, step 9000: bleu: 12.70, loss: 50120.6484, ppl: 8.9234, duration: 14.1406s 2020-02-09 13:25:45,018 Epoch 42: total training loss 350.83 2020-02-09 13:25:45,019 EPOCH 43 2020-02-09 13:25:47,028 Epoch 43 Step: 9100 Batch Loss: 1.502720 Tokens per Sec: 21261, Lr: 0.000300 2020-02-09 13:25:56,925 Epoch 43 Step: 9200 Batch Loss: 1.593139 Tokens per Sec: 21399, Lr: 0.000300 2020-02-09 13:26:06,319 Epoch 43: total training loss 346.06 2020-02-09 13:26:06,319 EPOCH 44 2020-02-09 13:26:06,855 Epoch 44 Step: 9300 Batch Loss: 1.669592 Tokens per Sec: 20145, Lr: 0.000300 2020-02-09 13:26:16,765 Epoch 44 Step: 9400 Batch Loss: 1.565888 Tokens per Sec: 21463, Lr: 0.000300 2020-02-09 13:26:26,549 Epoch 44 Step: 9500 Batch Loss: 1.861203 Tokens per Sec: 21414, Lr: 0.000300 2020-02-09 13:26:27,717 Epoch 44: total training loss 345.56 2020-02-09 13:26:27,717 EPOCH 45 2020-02-09 13:26:36,371 Epoch 45 Step: 9600 Batch Loss: 1.794674 Tokens per Sec: 21314, Lr: 0.000300 2020-02-09 13:26:46,197 Epoch 45 Step: 9700 Batch Loss: 1.868837 Tokens per Sec: 21749, Lr: 0.000300 2020-02-09 13:26:49,030 Epoch 45: total training loss 342.00 2020-02-09 13:26:49,030 EPOCH 46 2020-02-09 13:26:56,034 Epoch 46 Step: 9800 Batch Loss: 1.527628 Tokens per Sec: 21328, Lr: 0.000300 2020-02-09 13:27:05,864 Epoch 46 Step: 9900 Batch Loss: 1.642803 Tokens per Sec: 21055, Lr: 0.000300 2020-02-09 13:27:10,475 Epoch 46: total training loss 342.86 2020-02-09 13:27:10,475 EPOCH 47 2020-02-09 13:27:15,741 Epoch 47 Step: 10000 Batch Loss: 1.579610 Tokens per Sec: 20682, Lr: 0.000300 2020-02-09 13:27:26,907 Hooray! New best validation result [ppl]! 2020-02-09 13:27:26,907 Saving new checkpoint. 2020-02-09 13:27:27,091 Example #0 2020-02-09 13:27:27,091 Raw source: ['Jehovah', 'did', 'not', 'do', 'that', ',', 'but', 'he', 'allowed', 'Satan', 'to', 'test', 'Job', ',', 'st@@', 'ating', ':', '“', 'Every@@', 'thing', 'that', 'he', 'has', 'is', 'in', 'your', 'hand', '.', '”'] 2020-02-09 13:27:27,092 Raw hypothesis: ['Jehovah', 'no', 'let', 'Satan', 'do', 'wetin', 'e', 'talk', '.', 'E', 'sey', ':', '‘', 'Na', 'you', 'be', 'the', 'number', 'one', 'thing', 'for', 'you', '.', '’'] 2020-02-09 13:27:27,092 Source: Jehovah did not do that , but he allowed Satan to test Job , stating : “ Everything that he has is in your hand . ” 2020-02-09 13:27:27,092 Reference: E tell am sey : ‘ Everything wey e get dey your hand . ’ 2020-02-09 13:27:27,092 Hypothesis: Jehovah no let Satan do wetin e talk . E sey : ‘ Na you be the number one thing for you . ’ 2020-02-09 13:27:27,092 Example #1 2020-02-09 13:27:27,092 Raw source: ['Corin@@', 'na', 'said', ':', '“', 'We', 'left', 'our', 'work', 'area', 'in', 'the', 'evening', 'and', 'wal@@', 'ked', 'to', 'a', 'ra@@', 'il@@', 'way', 'st@@', 'ation', '25', 'ki@@', 'lo@@', 'me@@', 'ters', '(', '15', 'miles', ')', 'away', '.'] 2020-02-09 13:27:27,092 Raw hypothesis: ['Corin@@', 'na', 'comot', 'for', 'prison', ',', 'e', 'sey', ':', '“', 'We', 'comot', 'for', 'where', 'we', 'dey', 'stay', 'for', 'evening', 'and', 'we', 'stay', 'there', 'for', '25', 'miles', '(', '15', 'km', ')', '.'] 2020-02-09 13:27:27,092 Source: Corinna said : “ We left our work area in the evening and walked to a railway station 25 kilometers ( 15 miles ) away . 2020-02-09 13:27:27,092 Reference: Corinna talk sey : “ We comot for where we dey work for evening come trek go where people dey enter train wey be 25 kilometer ( 15 miles ) from where the farm dey . 2020-02-09 13:27:27,092 Hypothesis: Corinna comot for prison , e sey : “ We comot for where we dey stay for evening and we stay there for 25 miles ( 15 km ) . 2020-02-09 13:27:27,092 Example #2 2020-02-09 13:27:27,092 Raw source: ['Ro@@', 'man@@', 'tic', 'love', '(', 'e@@', 'ʹ@@', 'ro@@', 's', ')', 'brings', 'delight', ',', 'and', 'love', 'for', 'family', '(', 'st@@', 'or@@', '·@@', 'ge@@', 'ʹ', ')', 'is', 'vital', 'when', 'children', 'enter', 'the', 'picture', '.'] 2020-02-09 13:27:27,092 Raw hypothesis: ['Ro@@', 'l@@', 'or@@', 's', '(', 'wey', 'dey', 'show', 'love', ',', 'and', 'wey', 'dey', 'show', 'love', ',', 'dey', 'show', 'love', 'for', 'family', 'and', 'family', '.'] 2020-02-09 13:27:27,092 Source: Romantic love ( eʹros ) brings delight , and love for family ( stor·geʹ ) is vital when children enter the picture . 2020-02-09 13:27:27,092 Reference: ( 1 ) Love wey friend get for each other ( Greek , phi·liʹa ) ; ( 2 ) love wey man and woman get for each other ( eʹros ) ; ( 3 ) love wey people for family get for each other ( stor·geʹ ) . 2020-02-09 13:27:27,093 Hypothesis: Rolors ( wey dey show love , and wey dey show love , dey show love for family and family . 2020-02-09 13:27:27,093 Example #3 2020-02-09 13:27:27,093 Raw source: ['As', 'our', 'loving', 'De@@', 'sign@@', 'er', 'and', 'Creator', ',', 'Jehovah', 'knows', 'what', 'we', 'need', 'in', 'order', 'to', 'be', 'truly', 'happy', ',', 'and', 'he', 'f@@', 'ill@@', 's', 'that', 'need', 'ab@@', 'un@@', 'd@@', 'an@@', 'tly', '.'] 2020-02-09 13:27:27,093 Raw hypothesis: ['As', 'we', 'love', 'Jehovah', 'and', 'Jehovah', ',', 'we', 'know', 'wetin', 'e', 'really', 'need', 'and', 'wetin', 'e', 'want', 'make', 'we', 'happy', '.'] 2020-02-09 13:27:27,093 Source: As our loving Designer and Creator , Jehovah knows what we need in order to be truly happy , and he fills that need abundantly . 2020-02-09 13:27:27,093 Reference: Because na Jehovah make us , e know wetin go make us happy . E don even give us pass wetin we need . 2020-02-09 13:27:27,093 Hypothesis: As we love Jehovah and Jehovah , we know wetin e really need and wetin e want make we happy . 2020-02-09 13:27:27,093 Validation result (greedy) at epoch 47, step 10000: bleu: 12.58, loss: 49895.8438, ppl: 8.8362, duration: 11.3514s 2020-02-09 13:27:36,949 Epoch 47 Step: 10100 Batch Loss: 1.688607 Tokens per Sec: 21984, Lr: 0.000300 2020-02-09 13:27:43,026 Epoch 47: total training loss 332.75 2020-02-09 13:27:43,026 EPOCH 48 2020-02-09 13:27:46,786 Epoch 48 Step: 10200 Batch Loss: 1.651279 Tokens per Sec: 21345, Lr: 0.000300 2020-02-09 13:27:56,620 Epoch 48 Step: 10300 Batch Loss: 1.034909 Tokens per Sec: 21429, Lr: 0.000300 2020-02-09 13:28:04,303 Epoch 48: total training loss 330.69 2020-02-09 13:28:04,304 EPOCH 49 2020-02-09 13:28:06,502 Epoch 49 Step: 10400 Batch Loss: 1.507079 Tokens per Sec: 20645, Lr: 0.000300 2020-02-09 13:28:16,315 Epoch 49 Step: 10500 Batch Loss: 1.630366 Tokens per Sec: 21649, Lr: 0.000300 2020-02-09 13:28:25,449 Epoch 49: total training loss 325.25 2020-02-09 13:28:25,450 EPOCH 50 2020-02-09 13:28:26,177 Epoch 50 Step: 10600 Batch Loss: 1.349531 Tokens per Sec: 20812, Lr: 0.000300 2020-02-09 13:28:35,985 Epoch 50 Step: 10700 Batch Loss: 1.566842 Tokens per Sec: 21428, Lr: 0.000300 2020-02-09 13:28:45,809 Epoch 50 Step: 10800 Batch Loss: 1.492050 Tokens per Sec: 21841, Lr: 0.000300 2020-02-09 13:28:46,590 Epoch 50: total training loss 321.43 2020-02-09 13:28:46,590 EPOCH 51 2020-02-09 13:28:55,623 Epoch 51 Step: 10900 Batch Loss: 1.727898 Tokens per Sec: 21534, Lr: 0.000300 2020-02-09 13:29:05,462 Epoch 51 Step: 11000 Batch Loss: 1.638900 Tokens per Sec: 21320, Lr: 0.000300 2020-02-09 13:29:16,137 Example #0 2020-02-09 13:29:16,137 Raw source: ['Jehovah', 'did', 'not', 'do', 'that', ',', 'but', 'he', 'allowed', 'Satan', 'to', 'test', 'Job', ',', 'st@@', 'ating', ':', '“', 'Every@@', 'thing', 'that', 'he', 'has', 'is', 'in', 'your', 'hand', '.', '”'] 2020-02-09 13:29:16,137 Raw hypothesis: ['Jehovah', 'no', 'let', 'Satan', 'do', 'wetin', 'e', 'no', 'like', '.', 'But', 'e', 'let', 'Satan', 'do', 'wetin', 'e', 'no', 'like', '.'] 2020-02-09 13:29:16,137 Source: Jehovah did not do that , but he allowed Satan to test Job , stating : “ Everything that he has is in your hand . ” 2020-02-09 13:29:16,137 Reference: E tell am sey : ‘ Everything wey e get dey your hand . ’ 2020-02-09 13:29:16,137 Hypothesis: Jehovah no let Satan do wetin e no like . But e let Satan do wetin e no like . 2020-02-09 13:29:16,137 Example #1 2020-02-09 13:29:16,137 Raw source: ['Corin@@', 'na', 'said', ':', '“', 'We', 'left', 'our', 'work', 'area', 'in', 'the', 'evening', 'and', 'wal@@', 'ked', 'to', 'a', 'ra@@', 'il@@', 'way', 'st@@', 'ation', '25', 'ki@@', 'lo@@', 'me@@', 'ters', '(', '15', 'miles', ')', 'away', '.'] 2020-02-09 13:29:16,137 Raw hypothesis: ['Corin@@', 'na', 'comot', 'for', 'prison', '.', 'Dem', 'come', 'dey', 'prison', 'for', '25', 'miles', '(', '15', 'km', ')', '.'] 2020-02-09 13:29:16,137 Source: Corinna said : “ We left our work area in the evening and walked to a railway station 25 kilometers ( 15 miles ) away . 2020-02-09 13:29:16,137 Reference: Corinna talk sey : “ We comot for where we dey work for evening come trek go where people dey enter train wey be 25 kilometer ( 15 miles ) from where the farm dey . 2020-02-09 13:29:16,137 Hypothesis: Corinna comot for prison . Dem come dey prison for 25 miles ( 15 km ) . 2020-02-09 13:29:16,138 Example #2 2020-02-09 13:29:16,138 Raw source: ['Ro@@', 'man@@', 'tic', 'love', '(', 'e@@', 'ʹ@@', 'ro@@', 's', ')', 'brings', 'delight', ',', 'and', 'love', 'for', 'family', '(', 'st@@', 'or@@', '·@@', 'ge@@', 'ʹ', ')', 'is', 'vital', 'when', 'children', 'enter', 'the', 'picture', '.'] 2020-02-09 13:29:16,138 Raw hypothesis: ['We', 'dey', 'happy', 'well', 'well', 'when', 'we', 'love', 'our', 'family', '(', '1', ')', 'dey', 'show', 'love', ',', 'and', '(', '3', ')', 'dey', 'show', 'dem', 'love', '.'] 2020-02-09 13:29:16,138 Source: Romantic love ( eʹros ) brings delight , and love for family ( stor·geʹ ) is vital when children enter the picture . 2020-02-09 13:29:16,138 Reference: ( 1 ) Love wey friend get for each other ( Greek , phi·liʹa ) ; ( 2 ) love wey man and woman get for each other ( eʹros ) ; ( 3 ) love wey people for family get for each other ( stor·geʹ ) . 2020-02-09 13:29:16,138 Hypothesis: We dey happy well well when we love our family ( 1 ) dey show love , and ( 3 ) dey show dem love . 2020-02-09 13:29:16,138 Example #3 2020-02-09 13:29:16,138 Raw source: ['As', 'our', 'loving', 'De@@', 'sign@@', 'er', 'and', 'Creator', ',', 'Jehovah', 'knows', 'what', 'we', 'need', 'in', 'order', 'to', 'be', 'truly', 'happy', ',', 'and', 'he', 'f@@', 'ill@@', 's', 'that', 'need', 'ab@@', 'un@@', 'd@@', 'an@@', 'tly', '.'] 2020-02-09 13:29:16,138 Raw hypothesis: ['We', 'know', 'sey', 'Jehovah', 'love', 'us', 'and', 'e', 'know', 'wetin', 'we', 'need', '.'] 2020-02-09 13:29:16,138 Source: As our loving Designer and Creator , Jehovah knows what we need in order to be truly happy , and he fills that need abundantly . 2020-02-09 13:29:16,138 Reference: Because na Jehovah make us , e know wetin go make us happy . E don even give us pass wetin we need . 2020-02-09 13:29:16,138 Hypothesis: We know sey Jehovah love us and e know wetin we need . 2020-02-09 13:29:16,138 Validation result (greedy) at epoch 51, step 11000: bleu: 12.10, loss: 50398.8008, ppl: 9.0324, duration: 10.6758s 2020-02-09 13:29:18,600 Epoch 51: total training loss 322.21 2020-02-09 13:29:18,600 EPOCH 52 2020-02-09 13:29:26,067 Epoch 52 Step: 11100 Batch Loss: 0.603823 Tokens per Sec: 21118, Lr: 0.000300 2020-02-09 13:29:35,950 Epoch 52 Step: 11200 Batch Loss: 1.278073 Tokens per Sec: 21599, Lr: 0.000300 2020-02-09 13:29:39,899 Epoch 52: total training loss 315.59 2020-02-09 13:29:39,899 EPOCH 53 2020-02-09 13:29:45,864 Epoch 53 Step: 11300 Batch Loss: 1.335888 Tokens per Sec: 21391, Lr: 0.000300 2020-02-09 13:29:55,820 Epoch 53 Step: 11400 Batch Loss: 1.285490 Tokens per Sec: 21294, Lr: 0.000300 2020-02-09 13:30:01,443 Epoch 53: total training loss 316.14 2020-02-09 13:30:01,443 EPOCH 54 2020-02-09 13:30:05,715 Epoch 54 Step: 11500 Batch Loss: 1.644282 Tokens per Sec: 21015, Lr: 0.000300 2020-02-09 13:30:15,582 Epoch 54 Step: 11600 Batch Loss: 1.424573 Tokens per Sec: 21706, Lr: 0.000300 2020-02-09 13:30:22,787 Epoch 54: total training loss 311.70 2020-02-09 13:30:22,788 EPOCH 55 2020-02-09 13:30:25,473 Epoch 55 Step: 11700 Batch Loss: 1.565390 Tokens per Sec: 21123, Lr: 0.000300 2020-02-09 13:30:35,413 Epoch 55 Step: 11800 Batch Loss: 1.487010 Tokens per Sec: 21247, Lr: 0.000300 2020-02-09 13:30:44,186 Epoch 55: total training loss 309.11 2020-02-09 13:30:44,187 EPOCH 56 2020-02-09 13:30:45,313 Epoch 56 Step: 11900 Batch Loss: 1.130963 Tokens per Sec: 20274, Lr: 0.000300 2020-02-09 13:30:55,211 Epoch 56 Step: 12000 Batch Loss: 1.301956 Tokens per Sec: 21966, Lr: 0.000300 2020-02-09 13:31:06,685 Example #0 2020-02-09 13:31:06,685 Raw source: ['Jehovah', 'did', 'not', 'do', 'that', ',', 'but', 'he', 'allowed', 'Satan', 'to', 'test', 'Job', ',', 'st@@', 'ating', ':', '“', 'Every@@', 'thing', 'that', 'he', 'has', 'is', 'in', 'your', 'hand', '.', '”'] 2020-02-09 13:31:06,685 Raw hypothesis: ['Jehovah', 'no', 'let', 'Satan', 'do', 'wetin', 'e', 'no', 'like', '.', 'E', 'sey', ':', '‘', 'Every@@', 'thing', 'wey', 'Satan', 'don', 'do', 'for', 'you', ',', 'na', 'im', 'be', 'the', 'hand', 'of', 'God', 'wey', 'dey', 'give', 'you', 'hand', '.', '’'] 2020-02-09 13:31:06,685 Source: Jehovah did not do that , but he allowed Satan to test Job , stating : “ Everything that he has is in your hand . ” 2020-02-09 13:31:06,685 Reference: E tell am sey : ‘ Everything wey e get dey your hand . ’ 2020-02-09 13:31:06,686 Hypothesis: Jehovah no let Satan do wetin e no like . E sey : ‘ Everything wey Satan don do for you , na im be the hand of God wey dey give you hand . ’ 2020-02-09 13:31:06,686 Example #1 2020-02-09 13:31:06,686 Raw source: ['Corin@@', 'na', 'said', ':', '“', 'We', 'left', 'our', 'work', 'area', 'in', 'the', 'evening', 'and', 'wal@@', 'ked', 'to', 'a', 'ra@@', 'il@@', 'way', 'st@@', 'ation', '25', 'ki@@', 'lo@@', 'me@@', 'ters', '(', '15', 'miles', ')', 'away', '.'] 2020-02-09 13:31:06,686 Raw hypothesis: ['Corin@@', 'na', 'come', 'talk', 'sey', ':', '“', 'We', 'comot', 'for', 'where', 'we', 'dey', 'stay', 'for', 'where', 'we', 'dey', 'stay', 'for', 'where', 'we', 'dey', 'stay', '.', 'We', 'dey', 'stay', 'there', 'for', 'there', '.'] 2020-02-09 13:31:06,686 Source: Corinna said : “ We left our work area in the evening and walked to a railway station 25 kilometers ( 15 miles ) away . 2020-02-09 13:31:06,686 Reference: Corinna talk sey : “ We comot for where we dey work for evening come trek go where people dey enter train wey be 25 kilometer ( 15 miles ) from where the farm dey . 2020-02-09 13:31:06,686 Hypothesis: Corinna come talk sey : “ We comot for where we dey stay for where we dey stay for where we dey stay . We dey stay there for there . 2020-02-09 13:31:06,686 Example #2 2020-02-09 13:31:06,686 Raw source: ['Ro@@', 'man@@', 'tic', 'love', '(', 'e@@', 'ʹ@@', 'ro@@', 's', ')', 'brings', 'delight', ',', 'and', 'love', 'for', 'family', '(', 'st@@', 'or@@', '·@@', 'ge@@', 'ʹ', ')', 'is', 'vital', 'when', 'children', 'enter', 'the', 'picture', '.'] 2020-02-09 13:31:06,686 Raw hypothesis: ['Ro@@', 'l@@', 'di@@', 's', '(', 'love', 'imself', 'and', 'their', 'family', '.', 'Dem', 'dey', 'like', 'to', 'love', 'their', 'family', 'people', '.'] 2020-02-09 13:31:06,686 Source: Romantic love ( eʹros ) brings delight , and love for family ( stor·geʹ ) is vital when children enter the picture . 2020-02-09 13:31:06,686 Reference: ( 1 ) Love wey friend get for each other ( Greek , phi·liʹa ) ; ( 2 ) love wey man and woman get for each other ( eʹros ) ; ( 3 ) love wey people for family get for each other ( stor·geʹ ) . 2020-02-09 13:31:06,686 Hypothesis: Roldis ( love imself and their family . Dem dey like to love their family people . 2020-02-09 13:31:06,686 Example #3 2020-02-09 13:31:06,686 Raw source: ['As', 'our', 'loving', 'De@@', 'sign@@', 'er', 'and', 'Creator', ',', 'Jehovah', 'knows', 'what', 'we', 'need', 'in', 'order', 'to', 'be', 'truly', 'happy', ',', 'and', 'he', 'f@@', 'ill@@', 's', 'that', 'need', 'ab@@', 'un@@', 'd@@', 'an@@', 'tly', '.'] 2020-02-09 13:31:06,686 Raw hypothesis: ['Jehovah', 'love', 'us', 'and', 'e', 'know', 'wetin', 'e', 'want', 'make', 'we', 'do', '.'] 2020-02-09 13:31:06,687 Source: As our loving Designer and Creator , Jehovah knows what we need in order to be truly happy , and he fills that need abundantly . 2020-02-09 13:31:06,687 Reference: Because na Jehovah make us , e know wetin go make us happy . E don even give us pass wetin we need . 2020-02-09 13:31:06,687 Hypothesis: Jehovah love us and e know wetin e want make we do . 2020-02-09 13:31:06,687 Validation result (greedy) at epoch 56, step 12000: bleu: 12.89, loss: 50478.4766, ppl: 9.0639, duration: 11.4748s 2020-02-09 13:31:16,584 Epoch 56 Step: 12100 Batch Loss: 1.529229 Tokens per Sec: 21081, Lr: 0.000300 2020-02-09 13:31:17,070 Epoch 56: total training loss 305.48 2020-02-09 13:31:17,070 EPOCH 57 2020-02-09 13:31:26,548 Epoch 57 Step: 12200 Batch Loss: 1.529426 Tokens per Sec: 21076, Lr: 0.000300 2020-02-09 13:31:36,413 Epoch 57 Step: 12300 Batch Loss: 1.737350 Tokens per Sec: 21418, Lr: 0.000300 2020-02-09 13:31:38,570 Epoch 57: total training loss 304.36 2020-02-09 13:31:38,570 EPOCH 58 2020-02-09 13:31:46,348 Epoch 58 Step: 12400 Batch Loss: 1.672396 Tokens per Sec: 21211, Lr: 0.000300 2020-02-09 13:31:56,283 Epoch 58 Step: 12500 Batch Loss: 1.629755 Tokens per Sec: 21376, Lr: 0.000300 2020-02-09 13:32:00,024 Epoch 58: total training loss 300.52 2020-02-09 13:32:00,025 EPOCH 59 2020-02-09 13:32:06,235 Epoch 59 Step: 12600 Batch Loss: 1.617129 Tokens per Sec: 20979, Lr: 0.000300 2020-02-09 13:32:16,261 Epoch 59 Step: 12700 Batch Loss: 1.444259 Tokens per Sec: 21139, Lr: 0.000300 2020-02-09 13:32:21,689 Epoch 59: total training loss 298.62 2020-02-09 13:32:21,689 EPOCH 60 2020-02-09 13:32:26,204 Epoch 60 Step: 12800 Batch Loss: 1.523116 Tokens per Sec: 20963, Lr: 0.000300 2020-02-09 13:32:36,146 Epoch 60 Step: 12900 Batch Loss: 1.396388 Tokens per Sec: 21173, Lr: 0.000300 2020-02-09 13:32:43,263 Epoch 60: total training loss 295.90 2020-02-09 13:32:43,263 EPOCH 61 2020-02-09 13:32:46,087 Epoch 61 Step: 13000 Batch Loss: 0.562521 Tokens per Sec: 19269, Lr: 0.000300 2020-02-09 13:33:01,390 Example #0 2020-02-09 13:33:01,390 Raw source: ['Jehovah', 'did', 'not', 'do', 'that', ',', 'but', 'he', 'allowed', 'Satan', 'to', 'test', 'Job', ',', 'st@@', 'ating', ':', '“', 'Every@@', 'thing', 'that', 'he', 'has', 'is', 'in', 'your', 'hand', '.', '”'] 2020-02-09 13:33:01,390 Raw hypothesis: ['Jehovah', 'no', 'let', 'Satan', 'do', 'wetin', 'e', 'no', 'like', '.', 'E', 'sey', ':', '‘', 'Every@@', 'thing', 'wey', 'Satan', 'dey', 'do', ',', 'na', 'im', 'be', 'the', 'true', 'God', 'wey', 'dey', 'give', 'you', 'hand', '.', '’'] 2020-02-09 13:33:01,390 Source: Jehovah did not do that , but he allowed Satan to test Job , stating : “ Everything that he has is in your hand . ” 2020-02-09 13:33:01,390 Reference: E tell am sey : ‘ Everything wey e get dey your hand . ’ 2020-02-09 13:33:01,390 Hypothesis: Jehovah no let Satan do wetin e no like . E sey : ‘ Everything wey Satan dey do , na im be the true God wey dey give you hand . ’ 2020-02-09 13:33:01,390 Example #1 2020-02-09 13:33:01,391 Raw source: ['Corin@@', 'na', 'said', ':', '“', 'We', 'left', 'our', 'work', 'area', 'in', 'the', 'evening', 'and', 'wal@@', 'ked', 'to', 'a', 'ra@@', 'il@@', 'way', 'st@@', 'ation', '25', 'ki@@', 'lo@@', 'me@@', 'ters', '(', '15', 'miles', ')', 'away', '.'] 2020-02-09 13:33:01,391 Raw hypothesis: ['Corin@@', 'na', 'come', 'talk', 'sey', ':', '“', 'We', 'comot', 'for', 'where', 'we', 'dey', 'stay', 'for', 'the', 'prison', ',', 'and', 'we', 'dey', 'stay', 'prison', 'for', '25', 'miles', '(', '15', 'km', ')', '.'] 2020-02-09 13:33:01,391 Source: Corinna said : “ We left our work area in the evening and walked to a railway station 25 kilometers ( 15 miles ) away . 2020-02-09 13:33:01,391 Reference: Corinna talk sey : “ We comot for where we dey work for evening come trek go where people dey enter train wey be 25 kilometer ( 15 miles ) from where the farm dey . 2020-02-09 13:33:01,391 Hypothesis: Corinna come talk sey : “ We comot for where we dey stay for the prison , and we dey stay prison for 25 miles ( 15 km ) . 2020-02-09 13:33:01,391 Example #2 2020-02-09 13:33:01,391 Raw source: ['Ro@@', 'man@@', 'tic', 'love', '(', 'e@@', 'ʹ@@', 'ro@@', 's', ')', 'brings', 'delight', ',', 'and', 'love', 'for', 'family', '(', 'st@@', 'or@@', '·@@', 'ge@@', 'ʹ', ')', 'is', 'vital', 'when', 'children', 'enter', 'the', 'picture', '.'] 2020-02-09 13:33:01,391 Raw hypothesis: ['Ro@@', 'man@@', 'a@@', 'ger', 'wey', 'dey', 'show', 'love', ',', 'dey', 'enjoy', 'love', ',', 'and', 'their', 'family', 'people', 'dey', 'enjoy', 'theirself', '.'] 2020-02-09 13:33:01,391 Source: Romantic love ( eʹros ) brings delight , and love for family ( stor·geʹ ) is vital when children enter the picture . 2020-02-09 13:33:01,391 Reference: ( 1 ) Love wey friend get for each other ( Greek , phi·liʹa ) ; ( 2 ) love wey man and woman get for each other ( eʹros ) ; ( 3 ) love wey people for family get for each other ( stor·geʹ ) . 2020-02-09 13:33:01,391 Hypothesis: Romanager wey dey show love , dey enjoy love , and their family people dey enjoy theirself . 2020-02-09 13:33:01,391 Example #3 2020-02-09 13:33:01,391 Raw source: ['As', 'our', 'loving', 'De@@', 'sign@@', 'er', 'and', 'Creator', ',', 'Jehovah', 'knows', 'what', 'we', 'need', 'in', 'order', 'to', 'be', 'truly', 'happy', ',', 'and', 'he', 'f@@', 'ill@@', 's', 'that', 'need', 'ab@@', 'un@@', 'd@@', 'an@@', 'tly', '.'] 2020-02-09 13:33:01,391 Raw hypothesis: ['(', '1', 'John', '4', ':', '8', ')', 'As', 'we', 'love', 'Jehovah', 'and', 'the', 'things', 'wey', 'e', 'make', ',', 'we', 'know', 'sey', 'e', 'really', 'need', 'to', 'really', 'dey', 'happy', '.'] 2020-02-09 13:33:01,391 Source: As our loving Designer and Creator , Jehovah knows what we need in order to be truly happy , and he fills that need abundantly . 2020-02-09 13:33:01,391 Reference: Because na Jehovah make us , e know wetin go make us happy . E don even give us pass wetin we need . 2020-02-09 13:33:01,392 Hypothesis: ( 1 John 4 : 8 ) As we love Jehovah and the things wey e make , we know sey e really need to really dey happy . 2020-02-09 13:33:01,392 Validation result (greedy) at epoch 61, step 13000: bleu: 12.72, loss: 51401.3750, ppl: 9.4367, duration: 15.3039s 2020-02-09 13:33:11,395 Epoch 61 Step: 13100 Batch Loss: 1.358288 Tokens per Sec: 21458, Lr: 0.000300 2020-02-09 13:33:20,230 Epoch 61: total training loss 294.58 2020-02-09 13:33:20,230 EPOCH 62 2020-02-09 13:33:21,368 Epoch 62 Step: 13200 Batch Loss: 1.458893 Tokens per Sec: 20874, Lr: 0.000300 2020-02-09 13:33:31,321 Epoch 62 Step: 13300 Batch Loss: 1.583393 Tokens per Sec: 21148, Lr: 0.000300 2020-02-09 13:33:41,274 Epoch 62 Step: 13400 Batch Loss: 1.570911 Tokens per Sec: 21341, Lr: 0.000300 2020-02-09 13:33:41,863 Epoch 62: total training loss 290.13 2020-02-09 13:33:41,863 EPOCH 63 2020-02-09 13:33:51,272 Epoch 63 Step: 13500 Batch Loss: 1.357709 Tokens per Sec: 21343, Lr: 0.000300 2020-02-09 13:34:01,250 Epoch 63 Step: 13600 Batch Loss: 1.376045 Tokens per Sec: 20871, Lr: 0.000300 2020-02-09 13:34:03,638 Epoch 63: total training loss 289.45 2020-02-09 13:34:03,638 EPOCH 64 2020-02-09 13:34:11,424 Epoch 64 Step: 13700 Batch Loss: 1.588900 Tokens per Sec: 20835, Lr: 0.000300 2020-02-09 13:34:21,609 Epoch 64 Step: 13800 Batch Loss: 1.281900 Tokens per Sec: 20600, Lr: 0.000300 2020-02-09 13:34:25,639 Epoch 64: total training loss 284.62 2020-02-09 13:34:25,639 EPOCH 65 2020-02-09 13:34:31,810 Epoch 65 Step: 13900 Batch Loss: 1.419438 Tokens per Sec: 20970, Lr: 0.000300 2020-02-09 13:34:41,993 Epoch 65 Step: 14000 Batch Loss: 1.384162 Tokens per Sec: 20759, Lr: 0.000300 2020-02-09 13:34:54,215 Example #0 2020-02-09 13:34:54,215 Raw source: ['Jehovah', 'did', 'not', 'do', 'that', ',', 'but', 'he', 'allowed', 'Satan', 'to', 'test', 'Job', ',', 'st@@', 'ating', ':', '“', 'Every@@', 'thing', 'that', 'he', 'has', 'is', 'in', 'your', 'hand', '.', '”'] 2020-02-09 13:34:54,215 Raw hypothesis: ['Jehovah', 'no', 'let', 'Satan', 'suffer', 'Job', '.', 'But', 'e', 'let', 'Satan', 'suffer', 'Job', '.', 'E', 'sey', ':', '‘', 'Any@@', 'body', 'wey', 'get', 'power', 'dey', 'your', 'hand', 'dey', 'your', 'hand', '.', '’'] 2020-02-09 13:34:54,215 Source: Jehovah did not do that , but he allowed Satan to test Job , stating : “ Everything that he has is in your hand . ” 2020-02-09 13:34:54,215 Reference: E tell am sey : ‘ Everything wey e get dey your hand . ’ 2020-02-09 13:34:54,215 Hypothesis: Jehovah no let Satan suffer Job . But e let Satan suffer Job . E sey : ‘ Anybody wey get power dey your hand dey your hand . ’ 2020-02-09 13:34:54,215 Example #1 2020-02-09 13:34:54,215 Raw source: ['Corin@@', 'na', 'said', ':', '“', 'We', 'left', 'our', 'work', 'area', 'in', 'the', 'evening', 'and', 'wal@@', 'ked', 'to', 'a', 'ra@@', 'il@@', 'way', 'st@@', 'ation', '25', 'ki@@', 'lo@@', 'me@@', 'ters', '(', '15', 'miles', ')', 'away', '.'] 2020-02-09 13:34:54,215 Raw hypothesis: ['Corin@@', 'na', ',', 'wey', 'come', 'from', 'France', 'talk', 'sey', ':', '“', 'We', 'comot', 'for', 'where', 'we', 'dey', 'stay', 'for', 'where', 'we', 'dey', 'stay', '.', 'We', 'still', 'comot', 'go', 'where', 'dem', 'dey', 'call', 'ra@@', 't@@', 'on', 'top', 'to', 'go', '.'] 2020-02-09 13:34:54,215 Source: Corinna said : “ We left our work area in the evening and walked to a railway station 25 kilometers ( 15 miles ) away . 2020-02-09 13:34:54,216 Reference: Corinna talk sey : “ We comot for where we dey work for evening come trek go where people dey enter train wey be 25 kilometer ( 15 miles ) from where the farm dey . 2020-02-09 13:34:54,216 Hypothesis: Corinna , wey come from France talk sey : “ We comot for where we dey stay for where we dey stay . We still comot go where dem dey call raton top to go . 2020-02-09 13:34:54,216 Example #2 2020-02-09 13:34:54,216 Raw source: ['Ro@@', 'man@@', 'tic', 'love', '(', 'e@@', 'ʹ@@', 'ro@@', 's', ')', 'brings', 'delight', ',', 'and', 'love', 'for', 'family', '(', 'st@@', 'or@@', '·@@', 'ge@@', 'ʹ', ')', 'is', 'vital', 'when', 'children', 'enter', 'the', 'picture', '.'] 2020-02-09 13:34:54,216 Raw hypothesis: ['Ro@@', 'man@@', 'e', ',', 'and', 'the', 'kind', 'love', 'wey', 'we', 'get', 'for', 'our', 'family', 'and', 'our', 'family', 'dey', 'make', 'dem', 'happy', '.'] 2020-02-09 13:34:54,216 Source: Romantic love ( eʹros ) brings delight , and love for family ( stor·geʹ ) is vital when children enter the picture . 2020-02-09 13:34:54,216 Reference: ( 1 ) Love wey friend get for each other ( Greek , phi·liʹa ) ; ( 2 ) love wey man and woman get for each other ( eʹros ) ; ( 3 ) love wey people for family get for each other ( stor·geʹ ) . 2020-02-09 13:34:54,216 Hypothesis: Romane , and the kind love wey we get for our family and our family dey make dem happy . 2020-02-09 13:34:54,216 Example #3 2020-02-09 13:34:54,216 Raw source: ['As', 'our', 'loving', 'De@@', 'sign@@', 'er', 'and', 'Creator', ',', 'Jehovah', 'knows', 'what', 'we', 'need', 'in', 'order', 'to', 'be', 'truly', 'happy', ',', 'and', 'he', 'f@@', 'ill@@', 's', 'that', 'need', 'ab@@', 'un@@', 'd@@', 'an@@', 'tly', '.'] 2020-02-09 13:34:54,216 Raw hypothesis: ['We', 'know', 'sey', 'Jehovah', 'love', 'us', 'and', 'e', 'know', 'wetin', 'we', 'suppose', 'do', '.'] 2020-02-09 13:34:54,216 Source: As our loving Designer and Creator , Jehovah knows what we need in order to be truly happy , and he fills that need abundantly . 2020-02-09 13:34:54,216 Reference: Because na Jehovah make us , e know wetin go make us happy . E don even give us pass wetin we need . 2020-02-09 13:34:54,216 Hypothesis: We know sey Jehovah love us and e know wetin we suppose do . 2020-02-09 13:34:54,216 Validation result (greedy) at epoch 65, step 14000: bleu: 13.24, loss: 51182.5859, ppl: 9.3469, duration: 12.2226s 2020-02-09 13:34:59,833 Epoch 65: total training loss 280.51 2020-02-09 13:34:59,833 EPOCH 66 2020-02-09 13:35:04,419 Epoch 66 Step: 14100 Batch Loss: 0.551482 Tokens per Sec: 20886, Lr: 0.000300 2020-02-09 13:35:14,702 Epoch 66 Step: 14200 Batch Loss: 1.378283 Tokens per Sec: 20206, Lr: 0.000300 2020-02-09 13:35:22,014 Epoch 66: total training loss 280.47 2020-02-09 13:35:22,014 EPOCH 67 2020-02-09 13:35:24,923 Epoch 67 Step: 14300 Batch Loss: 1.419129 Tokens per Sec: 19968, Lr: 0.000300 2020-02-09 13:35:35,095 Epoch 67 Step: 14400 Batch Loss: 1.305179 Tokens per Sec: 21055, Lr: 0.000300 2020-02-09 13:35:43,916 Epoch 67: total training loss 276.47 2020-02-09 13:35:43,917 EPOCH 68 2020-02-09 13:35:45,169 Epoch 68 Step: 14500 Batch Loss: 1.365470 Tokens per Sec: 21257, Lr: 0.000300 2020-02-09 13:35:55,142 Epoch 68 Step: 14600 Batch Loss: 1.538778 Tokens per Sec: 21169, Lr: 0.000300 2020-02-09 13:36:05,076 Epoch 68 Step: 14700 Batch Loss: 1.253477 Tokens per Sec: 21499, Lr: 0.000300 2020-02-09 13:36:05,374 Epoch 68: total training loss 273.73 2020-02-09 13:36:05,375 EPOCH 69 2020-02-09 13:36:15,068 Epoch 69 Step: 14800 Batch Loss: 1.171915 Tokens per Sec: 21276, Lr: 0.000300 2020-02-09 13:36:24,979 Epoch 69 Step: 14900 Batch Loss: 1.178302 Tokens per Sec: 21236, Lr: 0.000300 2020-02-09 13:36:26,854 Epoch 69: total training loss 273.45 2020-02-09 13:36:26,855 EPOCH 70 2020-02-09 13:36:34,912 Epoch 70 Step: 15000 Batch Loss: 1.243322 Tokens per Sec: 21426, Lr: 0.000300 2020-02-09 13:36:47,711 Example #0 2020-02-09 13:36:47,711 Raw source: ['Jehovah', 'did', 'not', 'do', 'that', ',', 'but', 'he', 'allowed', 'Satan', 'to', 'test', 'Job', ',', 'st@@', 'ating', ':', '“', 'Every@@', 'thing', 'that', 'he', 'has', 'is', 'in', 'your', 'hand', '.', '”'] 2020-02-09 13:36:47,711 Raw hypothesis: ['Jehovah', 'no', 'let', 'Satan', 'suffer', 'Job', '.', 'But', 'e', 'let', 'Satan', 'direct', 'Job', '.', 'E', 'sey', ':', '‘', 'Any@@', 'body', 'wey', 'get', 'power', ',', 'na', 'im', 'be', 'your', 'hand', '.', '’'] 2020-02-09 13:36:47,711 Source: Jehovah did not do that , but he allowed Satan to test Job , stating : “ Everything that he has is in your hand . ” 2020-02-09 13:36:47,711 Reference: E tell am sey : ‘ Everything wey e get dey your hand . ’ 2020-02-09 13:36:47,711 Hypothesis: Jehovah no let Satan suffer Job . But e let Satan direct Job . E sey : ‘ Anybody wey get power , na im be your hand . ’ 2020-02-09 13:36:47,711 Example #1 2020-02-09 13:36:47,712 Raw source: ['Corin@@', 'na', 'said', ':', '“', 'We', 'left', 'our', 'work', 'area', 'in', 'the', 'evening', 'and', 'wal@@', 'ked', 'to', 'a', 'ra@@', 'il@@', 'way', 'st@@', 'ation', '25', 'ki@@', 'lo@@', 'me@@', 'ters', '(', '15', 'miles', ')', 'away', '.'] 2020-02-09 13:36:47,712 Raw hypothesis: ['Corin@@', 'na', 'comot', 'for', 'prison', ',', 'e', 'come', 'sey', ':', '“', 'We', 'comot', 'for', 'where', 'we', 'dey', 'stay', 'for', 'where', 'we', 'dey', 'stay', '.', 'We', 'waka', 'for', 'there', 'and', 'we', 'waka', 'for', 'there', '.'] 2020-02-09 13:36:47,712 Source: Corinna said : “ We left our work area in the evening and walked to a railway station 25 kilometers ( 15 miles ) away . 2020-02-09 13:36:47,712 Reference: Corinna talk sey : “ We comot for where we dey work for evening come trek go where people dey enter train wey be 25 kilometer ( 15 miles ) from where the farm dey . 2020-02-09 13:36:47,712 Hypothesis: Corinna comot for prison , e come sey : “ We comot for where we dey stay for where we dey stay . We waka for there and we waka for there . 2020-02-09 13:36:47,712 Example #2 2020-02-09 13:36:47,712 Raw source: ['Ro@@', 'man@@', 'tic', 'love', '(', 'e@@', 'ʹ@@', 'ro@@', 's', ')', 'brings', 'delight', ',', 'and', 'love', 'for', 'family', '(', 'st@@', 'or@@', '·@@', 'ge@@', 'ʹ', ')', 'is', 'vital', 'when', 'children', 'enter', 'the', 'picture', '.'] 2020-02-09 13:36:47,712 Raw hypothesis: ['Ro@@', 'l@@', 'ro@@', 'e@@', 'k', 'and', 'family', 'love', 'dey', 'make', 'dem', 'enjoy', 'theirself', '.', 'Dem', 'dey', 'show', 'love', 'play', ',', 'and', 'dem', 'love', 'their', 'family', 'pass', 'as', 'dem', 'dey', 'do', '.'] 2020-02-09 13:36:47,712 Source: Romantic love ( eʹros ) brings delight , and love for family ( stor·geʹ ) is vital when children enter the picture . 2020-02-09 13:36:47,712 Reference: ( 1 ) Love wey friend get for each other ( Greek , phi·liʹa ) ; ( 2 ) love wey man and woman get for each other ( eʹros ) ; ( 3 ) love wey people for family get for each other ( stor·geʹ ) . 2020-02-09 13:36:47,712 Hypothesis: Rolroek and family love dey make dem enjoy theirself . Dem dey show love play , and dem love their family pass as dem dey do . 2020-02-09 13:36:47,712 Example #3 2020-02-09 13:36:47,712 Raw source: ['As', 'our', 'loving', 'De@@', 'sign@@', 'er', 'and', 'Creator', ',', 'Jehovah', 'knows', 'what', 'we', 'need', 'in', 'order', 'to', 'be', 'truly', 'happy', ',', 'and', 'he', 'f@@', 'ill@@', 's', 'that', 'need', 'ab@@', 'un@@', 'd@@', 'an@@', 'tly', '.'] 2020-02-09 13:36:47,712 Raw hypothesis: ['We', 'know', 'sey', 'na', 'Jehovah', 'love', 'us', ',', 'and', 'e', 'know', 'wetin', 'we', 'suppose', 'do', '.'] 2020-02-09 13:36:47,713 Source: As our loving Designer and Creator , Jehovah knows what we need in order to be truly happy , and he fills that need abundantly . 2020-02-09 13:36:47,713 Reference: Because na Jehovah make us , e know wetin go make us happy . E don even give us pass wetin we need . 2020-02-09 13:36:47,713 Hypothesis: We know sey na Jehovah love us , and e know wetin we suppose do . 2020-02-09 13:36:47,713 Validation result (greedy) at epoch 70, step 15000: bleu: 13.68, loss: 51892.3750, ppl: 9.6412, duration: 12.7998s 2020-02-09 13:36:57,564 Epoch 70 Step: 15100 Batch Loss: 1.466820 Tokens per Sec: 21558, Lr: 0.000300 2020-02-09 13:37:00,923 Epoch 70: total training loss 268.52 2020-02-09 13:37:00,923 EPOCH 71 2020-02-09 13:37:07,505 Epoch 71 Step: 15200 Batch Loss: 1.100581 Tokens per Sec: 21126, Lr: 0.000300 2020-02-09 13:37:17,430 Epoch 71 Step: 15300 Batch Loss: 1.263563 Tokens per Sec: 21414, Lr: 0.000300 2020-02-09 13:37:22,304 Epoch 71: total training loss 266.92 2020-02-09 13:37:22,304 EPOCH 72 2020-02-09 13:37:27,420 Epoch 72 Step: 15400 Batch Loss: 1.193709 Tokens per Sec: 20689, Lr: 0.000300 2020-02-09 13:37:37,383 Epoch 72 Step: 15500 Batch Loss: 0.802885 Tokens per Sec: 21147, Lr: 0.000300 2020-02-09 13:37:43,831 Epoch 72: total training loss 266.82 2020-02-09 13:37:43,832 EPOCH 73 2020-02-09 13:37:47,366 Epoch 73 Step: 15600 Batch Loss: 0.445664 Tokens per Sec: 21176, Lr: 0.000300 2020-02-09 13:37:57,363 Epoch 73 Step: 15700 Batch Loss: 1.272757 Tokens per Sec: 21335, Lr: 0.000300 2020-02-09 13:38:05,375 Epoch 73: total training loss 263.86 2020-02-09 13:38:05,376 EPOCH 74 2020-02-09 13:38:07,298 Epoch 74 Step: 15800 Batch Loss: 1.240086 Tokens per Sec: 22479, Lr: 0.000300 2020-02-09 13:38:17,277 Epoch 74 Step: 15900 Batch Loss: 1.174128 Tokens per Sec: 21232, Lr: 0.000300 2020-02-09 13:38:26,900 Epoch 74: total training loss 261.45 2020-02-09 13:38:26,901 EPOCH 75 2020-02-09 13:38:27,244 Epoch 75 Step: 16000 Batch Loss: 0.969944 Tokens per Sec: 19715, Lr: 0.000300 2020-02-09 13:38:39,014 Example #0 2020-02-09 13:38:39,014 Raw source: ['Jehovah', 'did', 'not', 'do', 'that', ',', 'but', 'he', 'allowed', 'Satan', 'to', 'test', 'Job', ',', 'st@@', 'ating', ':', '“', 'Every@@', 'thing', 'that', 'he', 'has', 'is', 'in', 'your', 'hand', '.', '”'] 2020-02-09 13:38:39,014 Raw hypothesis: ['Jehovah', 'no', 'let', 'Job', 'suffer', 'Job', '.', 'But', 'e', 'let', 'am', 'suffer', 'Job', '.', 'E', 'sey', ':', '‘', 'Any@@', 'body', 'wey', 'dey', 'your', 'hand', 'dey', ',', 'na', 'im', 'be', 'the', 'hand', 'of', 'am', '.', '’'] 2020-02-09 13:38:39,015 Source: Jehovah did not do that , but he allowed Satan to test Job , stating : “ Everything that he has is in your hand . ” 2020-02-09 13:38:39,015 Reference: E tell am sey : ‘ Everything wey e get dey your hand . ’ 2020-02-09 13:38:39,015 Hypothesis: Jehovah no let Job suffer Job . But e let am suffer Job . E sey : ‘ Anybody wey dey your hand dey , na im be the hand of am . ’ 2020-02-09 13:38:39,015 Example #1 2020-02-09 13:38:39,015 Raw source: ['Corin@@', 'na', 'said', ':', '“', 'We', 'left', 'our', 'work', 'area', 'in', 'the', 'evening', 'and', 'wal@@', 'ked', 'to', 'a', 'ra@@', 'il@@', 'way', 'st@@', 'ation', '25', 'ki@@', 'lo@@', 'me@@', 'ters', '(', '15', 'miles', ')', 'away', '.'] 2020-02-09 13:38:39,015 Raw hypothesis: ['Corin@@', 'na', ',', 'wey', 'come', 'from', 'prison', ',', 'talk', 'sey', ':', '“', 'We', 'comot', 'for', 'where', 'we', 'dey', 'stay', ',', 'and', 'we', 'waka', 'comot', 'go', 'one', 'place', 'wey', 'far', 'well', 'well', '.'] 2020-02-09 13:38:39,015 Source: Corinna said : “ We left our work area in the evening and walked to a railway station 25 kilometers ( 15 miles ) away . 2020-02-09 13:38:39,015 Reference: Corinna talk sey : “ We comot for where we dey work for evening come trek go where people dey enter train wey be 25 kilometer ( 15 miles ) from where the farm dey . 2020-02-09 13:38:39,015 Hypothesis: Corinna , wey come from prison , talk sey : “ We comot for where we dey stay , and we waka comot go one place wey far well well . 2020-02-09 13:38:39,015 Example #2 2020-02-09 13:38:39,015 Raw source: ['Ro@@', 'man@@', 'tic', 'love', '(', 'e@@', 'ʹ@@', 'ro@@', 's', ')', 'brings', 'delight', ',', 'and', 'love', 'for', 'family', '(', 'st@@', 'or@@', '·@@', 'ge@@', 'ʹ', ')', 'is', 'vital', 'when', 'children', 'enter', 'the', 'picture', '.'] 2020-02-09 13:38:39,015 Raw hypothesis: ['Ro@@', 'me@@', 'tri@@', 'us', '(', '1', ')', 'We', 'love', 'people', 'and', 'our', 'family', 'people', ',', 'we', 'dey', 'enjoy', 'their', 'love', '.', 'We', 'dey', 'show', 'dem', 'love', '.'] 2020-02-09 13:38:39,015 Source: Romantic love ( eʹros ) brings delight , and love for family ( stor·geʹ ) is vital when children enter the picture . 2020-02-09 13:38:39,015 Reference: ( 1 ) Love wey friend get for each other ( Greek , phi·liʹa ) ; ( 2 ) love wey man and woman get for each other ( eʹros ) ; ( 3 ) love wey people for family get for each other ( stor·geʹ ) . 2020-02-09 13:38:39,015 Hypothesis: Rometrius ( 1 ) We love people and our family people , we dey enjoy their love . We dey show dem love . 2020-02-09 13:38:39,016 Example #3 2020-02-09 13:38:39,016 Raw source: ['As', 'our', 'loving', 'De@@', 'sign@@', 'er', 'and', 'Creator', ',', 'Jehovah', 'knows', 'what', 'we', 'need', 'in', 'order', 'to', 'be', 'truly', 'happy', ',', 'and', 'he', 'f@@', 'ill@@', 's', 'that', 'need', 'ab@@', 'un@@', 'd@@', 'an@@', 'tly', '.'] 2020-02-09 13:38:39,016 Raw hypothesis: ['As', 'Jehovah', 'take', 'love', 'us', ',', 'na', 'im', 'make', 'us', 'dey', 'happy', 'and', 'na', 'im', 'make', 'us', 'dey', 'happy', '.'] 2020-02-09 13:38:39,016 Source: As our loving Designer and Creator , Jehovah knows what we need in order to be truly happy , and he fills that need abundantly . 2020-02-09 13:38:39,016 Reference: Because na Jehovah make us , e know wetin go make us happy . E don even give us pass wetin we need . 2020-02-09 13:38:39,016 Hypothesis: As Jehovah take love us , na im make us dey happy and na im make us dey happy . 2020-02-09 13:38:39,016 Validation result (greedy) at epoch 75, step 16000: bleu: 13.60, loss: 52236.7031, ppl: 9.7872, duration: 11.7712s 2020-02-09 13:38:48,988 Epoch 75 Step: 16100 Batch Loss: 1.245626 Tokens per Sec: 21099, Lr: 0.000210 2020-02-09 13:38:58,902 Epoch 75 Step: 16200 Batch Loss: 1.151787 Tokens per Sec: 21349, Lr: 0.000210 2020-02-09 13:39:00,200 Epoch 75: total training loss 254.01 2020-02-09 13:39:00,201 EPOCH 76 2020-02-09 13:39:08,929 Epoch 76 Step: 16300 Batch Loss: 1.073789 Tokens per Sec: 21096, Lr: 0.000210 2020-02-09 13:39:18,865 Epoch 76 Step: 16400 Batch Loss: 1.273003 Tokens per Sec: 21137, Lr: 0.000210 2020-02-09 13:39:21,841 Epoch 76: total training loss 251.17 2020-02-09 13:39:21,841 EPOCH 77 2020-02-09 13:39:28,804 Epoch 77 Step: 16500 Batch Loss: 1.339782 Tokens per Sec: 21548, Lr: 0.000210 2020-02-09 13:39:38,726 Epoch 77 Step: 16600 Batch Loss: 0.925406 Tokens per Sec: 20585, Lr: 0.000210 2020-02-09 13:39:43,426 Epoch 77: total training loss 249.06 2020-02-09 13:39:43,426 EPOCH 78 2020-02-09 13:39:48,751 Epoch 78 Step: 16700 Batch Loss: 1.370967 Tokens per Sec: 20947, Lr: 0.000210 2020-02-09 13:39:58,731 Epoch 78 Step: 16800 Batch Loss: 1.172879 Tokens per Sec: 21553, Lr: 0.000210 2020-02-09 13:40:05,009 Epoch 78: total training loss 246.34 2020-02-09 13:40:05,009 EPOCH 79 2020-02-09 13:40:08,736 Epoch 79 Step: 16900 Batch Loss: 1.280709 Tokens per Sec: 20360, Lr: 0.000210 2020-02-09 13:40:18,717 Epoch 79 Step: 17000 Batch Loss: 1.374907 Tokens per Sec: 21610, Lr: 0.000210 2020-02-09 13:40:31,020 Example #0 2020-02-09 13:40:31,020 Raw source: ['Jehovah', 'did', 'not', 'do', 'that', ',', 'but', 'he', 'allowed', 'Satan', 'to', 'test', 'Job', ',', 'st@@', 'ating', ':', '“', 'Every@@', 'thing', 'that', 'he', 'has', 'is', 'in', 'your', 'hand', '.', '”'] 2020-02-09 13:40:31,020 Raw hypothesis: ['Jehovah', 'no', 'let', 'Satan', 'suffer', 'Job', '.', 'But', 'e', 'let', 'Satan', 'do', 'wetin', 'e', 'talk', '.', 'E', 'sey', ':', '‘', 'Any@@', 'body', 'wey', 'dey', 'use', 'im', 'hand', 'swear', 'for', 'your', 'hand', '.', '’'] 2020-02-09 13:40:31,020 Source: Jehovah did not do that , but he allowed Satan to test Job , stating : “ Everything that he has is in your hand . ” 2020-02-09 13:40:31,020 Reference: E tell am sey : ‘ Everything wey e get dey your hand . ’ 2020-02-09 13:40:31,020 Hypothesis: Jehovah no let Satan suffer Job . But e let Satan do wetin e talk . E sey : ‘ Anybody wey dey use im hand swear for your hand . ’ 2020-02-09 13:40:31,020 Example #1 2020-02-09 13:40:31,021 Raw source: ['Corin@@', 'na', 'said', ':', '“', 'We', 'left', 'our', 'work', 'area', 'in', 'the', 'evening', 'and', 'wal@@', 'ked', 'to', 'a', 'ra@@', 'il@@', 'way', 'st@@', 'ation', '25', 'ki@@', 'lo@@', 'me@@', 'ters', '(', '15', 'miles', ')', 'away', '.'] 2020-02-09 13:40:31,021 Raw hypothesis: ['Corin@@', 'na', ',', 'wey', 'come', 'from', 'prison', ',', 'talk', 'sey', ':', '“', 'We', 'stay', 'for', 'one', 'place', 'wey', 'dem', 'dey', 'call', 'ra@@', 't@@', 'on', '.', 'We', 'waka', 'comot', 'go', 'where', 'we', 'dey', 'stay', '.', 'We', 'waka', 'for', 'there', '.'] 2020-02-09 13:40:31,021 Source: Corinna said : “ We left our work area in the evening and walked to a railway station 25 kilometers ( 15 miles ) away . 2020-02-09 13:40:31,021 Reference: Corinna talk sey : “ We comot for where we dey work for evening come trek go where people dey enter train wey be 25 kilometer ( 15 miles ) from where the farm dey . 2020-02-09 13:40:31,021 Hypothesis: Corinna , wey come from prison , talk sey : “ We stay for one place wey dem dey call raton . We waka comot go where we dey stay . We waka for there . 2020-02-09 13:40:31,021 Example #2 2020-02-09 13:40:31,021 Raw source: ['Ro@@', 'man@@', 'tic', 'love', '(', 'e@@', 'ʹ@@', 'ro@@', 's', ')', 'brings', 'delight', ',', 'and', 'love', 'for', 'family', '(', 'st@@', 'or@@', '·@@', 'ge@@', 'ʹ', ')', 'is', 'vital', 'when', 'children', 'enter', 'the', 'picture', '.'] 2020-02-09 13:40:31,021 Raw hypothesis: ['Ro@@', 'st@@', 'ro@@', 'e@@', 'k', 'love', 'dey', 'make', 'people', 'respect', 'each', 'other', ',', 'and', 'their', 'pikin', 'dey', 'show', 'love', '.', 'Dem', 'dey', 'care', 'for', 'their', 'family', 'when', 'dem', 'dey', 'chop', 'their', 'pikin', 'when', 'dem', 'dey', 'chop', '.'] 2020-02-09 13:40:31,021 Source: Romantic love ( eʹros ) brings delight , and love for family ( stor·geʹ ) is vital when children enter the picture . 2020-02-09 13:40:31,021 Reference: ( 1 ) Love wey friend get for each other ( Greek , phi·liʹa ) ; ( 2 ) love wey man and woman get for each other ( eʹros ) ; ( 3 ) love wey people for family get for each other ( stor·geʹ ) . 2020-02-09 13:40:31,021 Hypothesis: Rostroek love dey make people respect each other , and their pikin dey show love . Dem dey care for their family when dem dey chop their pikin when dem dey chop . 2020-02-09 13:40:31,021 Example #3 2020-02-09 13:40:31,021 Raw source: ['As', 'our', 'loving', 'De@@', 'sign@@', 'er', 'and', 'Creator', ',', 'Jehovah', 'knows', 'what', 'we', 'need', 'in', 'order', 'to', 'be', 'truly', 'happy', ',', 'and', 'he', 'f@@', 'ill@@', 's', 'that', 'need', 'ab@@', 'un@@', 'd@@', 'an@@', 'tly', '.'] 2020-02-09 13:40:31,021 Raw hypothesis: ['We', 'know', 'sey', 'na', 'Jehovah', 'make', 'everything', ',', 'and', 'wetin', 'e', 'really', 'need', '.'] 2020-02-09 13:40:31,021 Source: As our loving Designer and Creator , Jehovah knows what we need in order to be truly happy , and he fills that need abundantly . 2020-02-09 13:40:31,022 Reference: Because na Jehovah make us , e know wetin go make us happy . E don even give us pass wetin we need . 2020-02-09 13:40:31,022 Hypothesis: We know sey na Jehovah make everything , and wetin e really need . 2020-02-09 13:40:31,022 Validation result (greedy) at epoch 79, step 17000: bleu: 13.63, loss: 52756.6953, ppl: 10.0120, duration: 12.3041s 2020-02-09 13:40:38,846 Epoch 79: total training loss 244.83 2020-02-09 13:40:38,846 EPOCH 80 2020-02-09 13:40:40,980 Epoch 80 Step: 17100 Batch Loss: 1.366554 Tokens per Sec: 20688, Lr: 0.000210 2020-02-09 13:40:50,887 Epoch 80 Step: 17200 Batch Loss: 0.921662 Tokens per Sec: 21148, Lr: 0.000210 2020-02-09 13:41:00,293 Epoch 80: total training loss 243.67 2020-02-09 13:41:00,293 EPOCH 81 2020-02-09 13:41:00,837 Epoch 81 Step: 17300 Batch Loss: 1.227142 Tokens per Sec: 19506, Lr: 0.000210 2020-02-09 13:41:10,745 Epoch 81 Step: 17400 Batch Loss: 1.014282 Tokens per Sec: 21354, Lr: 0.000210 2020-02-09 13:41:20,759 Epoch 81 Step: 17500 Batch Loss: 1.388654 Tokens per Sec: 21215, Lr: 0.000210 2020-02-09 13:41:21,836 Epoch 81: total training loss 241.66 2020-02-09 13:41:21,837 EPOCH 82 2020-02-09 13:41:30,702 Epoch 82 Step: 17600 Batch Loss: 1.071036 Tokens per Sec: 21079, Lr: 0.000210 2020-02-09 13:41:40,662 Epoch 82 Step: 17700 Batch Loss: 1.366563 Tokens per Sec: 21398, Lr: 0.000210 2020-02-09 13:41:43,343 Epoch 82: total training loss 239.91 2020-02-09 13:41:43,343 EPOCH 83 2020-02-09 13:41:50,607 Epoch 83 Step: 17800 Batch Loss: 0.447479 Tokens per Sec: 20887, Lr: 0.000210 2020-02-09 13:42:00,555 Epoch 83 Step: 17900 Batch Loss: 1.230339 Tokens per Sec: 21363, Lr: 0.000210 2020-02-09 13:42:04,916 Epoch 83: total training loss 239.55 2020-02-09 13:42:04,916 EPOCH 84 2020-02-09 13:42:10,509 Epoch 84 Step: 18000 Batch Loss: 1.350716 Tokens per Sec: 21147, Lr: 0.000210 2020-02-09 13:42:22,835 Example #0 2020-02-09 13:42:22,836 Raw source: ['Jehovah', 'did', 'not', 'do', 'that', ',', 'but', 'he', 'allowed', 'Satan', 'to', 'test', 'Job', ',', 'st@@', 'ating', ':', '“', 'Every@@', 'thing', 'that', 'he', 'has', 'is', 'in', 'your', 'hand', '.', '”'] 2020-02-09 13:42:22,836 Raw hypothesis: ['Jehovah', 'no', 'let', 'Satan', 'suffer', 'Job', '.', 'But', 'e', 'let', 'am', 'suffer', 'Job', '.', 'E', 'tell', 'am', 'sey', ':', '‘', 'Any@@', 'body', 'wey', 'don', 'get', 'power', ',', 'e', 'don', 'use', 'your', 'hand', 'do', 'wetin', 'e', 'want', '.', '’'] 2020-02-09 13:42:22,836 Source: Jehovah did not do that , but he allowed Satan to test Job , stating : “ Everything that he has is in your hand . ” 2020-02-09 13:42:22,836 Reference: E tell am sey : ‘ Everything wey e get dey your hand . ’ 2020-02-09 13:42:22,836 Hypothesis: Jehovah no let Satan suffer Job . But e let am suffer Job . E tell am sey : ‘ Anybody wey don get power , e don use your hand do wetin e want . ’ 2020-02-09 13:42:22,836 Example #1 2020-02-09 13:42:22,836 Raw source: ['Corin@@', 'na', 'said', ':', '“', 'We', 'left', 'our', 'work', 'area', 'in', 'the', 'evening', 'and', 'wal@@', 'ked', 'to', 'a', 'ra@@', 'il@@', 'way', 'st@@', 'ation', '25', 'ki@@', 'lo@@', 'me@@', 'ters', '(', '15', 'miles', ')', 'away', '.'] 2020-02-09 13:42:22,836 Raw hypothesis: ['Corin@@', 'na', ',', 'wey', 'come', 'from', 'prison', ',', 'talk', 'sey', ':', '“', 'We', 'comot', 'for', 'where', 'we', 'dey', 'stay', 'for', 'where', 'we', 'dey', 'stay', '.', 'We', 'come', 'comot', 'go', 'where', 'dem', 'dey', 'call', 'ra@@', 't@@', 'on', 'top', 'wo@@', 'od', '.'] 2020-02-09 13:42:22,836 Source: Corinna said : “ We left our work area in the evening and walked to a railway station 25 kilometers ( 15 miles ) away . 2020-02-09 13:42:22,836 Reference: Corinna talk sey : “ We comot for where we dey work for evening come trek go where people dey enter train wey be 25 kilometer ( 15 miles ) from where the farm dey . 2020-02-09 13:42:22,836 Hypothesis: Corinna , wey come from prison , talk sey : “ We comot for where we dey stay for where we dey stay . We come comot go where dem dey call raton top wood . 2020-02-09 13:42:22,836 Example #2 2020-02-09 13:42:22,836 Raw source: ['Ro@@', 'man@@', 'tic', 'love', '(', 'e@@', 'ʹ@@', 'ro@@', 's', ')', 'brings', 'delight', ',', 'and', 'love', 'for', 'family', '(', 'st@@', 'or@@', '·@@', 'ge@@', 'ʹ', ')', 'is', 'vital', 'when', 'children', 'enter', 'the', 'picture', '.'] 2020-02-09 13:42:22,836 Raw hypothesis: ['We', 'dey', 'show', 'love', ',', 'we', 'love', 'dem', ',', 'and', 'we', 'dey', 'show', 'love', 'dem', '.', 'We', 'dey', 'show', 'dem', 'love', '.'] 2020-02-09 13:42:22,836 Source: Romantic love ( eʹros ) brings delight , and love for family ( stor·geʹ ) is vital when children enter the picture . 2020-02-09 13:42:22,837 Reference: ( 1 ) Love wey friend get for each other ( Greek , phi·liʹa ) ; ( 2 ) love wey man and woman get for each other ( eʹros ) ; ( 3 ) love wey people for family get for each other ( stor·geʹ ) . 2020-02-09 13:42:22,837 Hypothesis: We dey show love , we love dem , and we dey show love dem . We dey show dem love . 2020-02-09 13:42:22,837 Example #3 2020-02-09 13:42:22,837 Raw source: ['As', 'our', 'loving', 'De@@', 'sign@@', 'er', 'and', 'Creator', ',', 'Jehovah', 'knows', 'what', 'we', 'need', 'in', 'order', 'to', 'be', 'truly', 'happy', ',', 'and', 'he', 'f@@', 'ill@@', 's', 'that', 'need', 'ab@@', 'un@@', 'd@@', 'an@@', 'tly', '.'] 2020-02-09 13:42:22,837 Raw hypothesis: ['As', 'Jehovah', 'love', 'us', 'and', 'e', 'know', 'wetin', 'we', 'need', ',', 'e', 'know', 'wetin', 'go', 'really', 'make', 'us', 'happy', '.'] 2020-02-09 13:42:22,837 Source: As our loving Designer and Creator , Jehovah knows what we need in order to be truly happy , and he fills that need abundantly . 2020-02-09 13:42:22,837 Reference: Because na Jehovah make us , e know wetin go make us happy . E don even give us pass wetin we need . 2020-02-09 13:42:22,837 Hypothesis: As Jehovah love us and e know wetin we need , e know wetin go really make us happy . 2020-02-09 13:42:22,837 Validation result (greedy) at epoch 84, step 18000: bleu: 13.39, loss: 53123.7109, ppl: 10.1738, duration: 12.3279s 2020-02-09 13:42:32,815 Epoch 84 Step: 18100 Batch Loss: 1.229728 Tokens per Sec: 20826, Lr: 0.000210 2020-02-09 13:42:38,961 Epoch 84: total training loss 238.82 2020-02-09 13:42:38,961 EPOCH 85 2020-02-09 13:42:42,782 Epoch 85 Step: 18200 Batch Loss: 1.178186 Tokens per Sec: 20938, Lr: 0.000210 2020-02-09 13:42:52,711 Epoch 85 Step: 18300 Batch Loss: 1.064565 Tokens per Sec: 21595, Lr: 0.000210 2020-02-09 13:43:00,435 Epoch 85: total training loss 235.47 2020-02-09 13:43:00,435 EPOCH 86 2020-02-09 13:43:02,664 Epoch 86 Step: 18400 Batch Loss: 0.958826 Tokens per Sec: 21064, Lr: 0.000210 2020-02-09 13:43:12,630 Epoch 86 Step: 18500 Batch Loss: 1.276298 Tokens per Sec: 20971, Lr: 0.000210 2020-02-09 13:43:22,059 Epoch 86: total training loss 234.78 2020-02-09 13:43:22,059 EPOCH 87 2020-02-09 13:43:22,606 Epoch 87 Step: 18600 Batch Loss: 0.976016 Tokens per Sec: 18135, Lr: 0.000210 2020-02-09 13:43:32,521 Epoch 87 Step: 18700 Batch Loss: 1.222425 Tokens per Sec: 21613, Lr: 0.000210 2020-02-09 13:43:42,430 Epoch 87 Step: 18800 Batch Loss: 1.335187 Tokens per Sec: 21328, Lr: 0.000210 2020-02-09 13:43:43,514 Epoch 87: total training loss 232.08 2020-02-09 13:43:43,515 EPOCH 88 2020-02-09 13:43:52,405 Epoch 88 Step: 18900 Batch Loss: 1.283226 Tokens per Sec: 21084, Lr: 0.000210 2020-02-09 13:44:02,465 Epoch 88 Step: 19000 Batch Loss: 1.182344 Tokens per Sec: 21357, Lr: 0.000210 2020-02-09 13:44:14,514 Example #0 2020-02-09 13:44:14,514 Raw source: ['Jehovah', 'did', 'not', 'do', 'that', ',', 'but', 'he', 'allowed', 'Satan', 'to', 'test', 'Job', ',', 'st@@', 'ating', ':', '“', 'Every@@', 'thing', 'that', 'he', 'has', 'is', 'in', 'your', 'hand', '.', '”'] 2020-02-09 13:44:14,514 Raw hypothesis: ['Jehovah', 'no', 'let', 'Satan', 'suffer', 'Job', '.', 'But', 'e', 'let', 'am', 'suffer', 'Job', '.', 'E', 'sey', ':', '‘', 'Any@@', 'body', 'wey', 'get', 'power', ',', 'na', 'im', 'dey', 'give', 'you', 'hand', '.', '’'] 2020-02-09 13:44:14,514 Source: Jehovah did not do that , but he allowed Satan to test Job , stating : “ Everything that he has is in your hand . ” 2020-02-09 13:44:14,514 Reference: E tell am sey : ‘ Everything wey e get dey your hand . ’ 2020-02-09 13:44:14,514 Hypothesis: Jehovah no let Satan suffer Job . But e let am suffer Job . E sey : ‘ Anybody wey get power , na im dey give you hand . ’ 2020-02-09 13:44:14,514 Example #1 2020-02-09 13:44:14,514 Raw source: ['Corin@@', 'na', 'said', ':', '“', 'We', 'left', 'our', 'work', 'area', 'in', 'the', 'evening', 'and', 'wal@@', 'ked', 'to', 'a', 'ra@@', 'il@@', 'way', 'st@@', 'ation', '25', 'ki@@', 'lo@@', 'me@@', 'ters', '(', '15', 'miles', ')', 'away', '.'] 2020-02-09 13:44:14,514 Raw hypothesis: ['Corin@@', 'na', ',', 'wey', 'come', 'sey', ':', '“', 'We', 'stay', 'for', 'evening', ',', 'we', 'come', 'travel', 'go', 'another', 'place', 'wey', 'far', 'well', 'well', '.'] 2020-02-09 13:44:14,514 Source: Corinna said : “ We left our work area in the evening and walked to a railway station 25 kilometers ( 15 miles ) away . 2020-02-09 13:44:14,514 Reference: Corinna talk sey : “ We comot for where we dey work for evening come trek go where people dey enter train wey be 25 kilometer ( 15 miles ) from where the farm dey . 2020-02-09 13:44:14,514 Hypothesis: Corinna , wey come sey : “ We stay for evening , we come travel go another place wey far well well . 2020-02-09 13:44:14,515 Example #2 2020-02-09 13:44:14,515 Raw source: ['Ro@@', 'man@@', 'tic', 'love', '(', 'e@@', 'ʹ@@', 'ro@@', 's', ')', 'brings', 'delight', ',', 'and', 'love', 'for', 'family', '(', 'st@@', 'or@@', '·@@', 'ge@@', 'ʹ', ')', 'is', 'vital', 'when', 'children', 'enter', 'the', 'picture', '.'] 2020-02-09 13:44:14,515 Raw hypothesis: ['We', 'no', 'dey', 'show', 'love', 'play', '.', 'We', 'dey', 'enjoy', 'our', 'family', ',', 'and', 'we', 'dey', 'show', 'love', 'play', '.'] 2020-02-09 13:44:14,515 Source: Romantic love ( eʹros ) brings delight , and love for family ( stor·geʹ ) is vital when children enter the picture . 2020-02-09 13:44:14,515 Reference: ( 1 ) Love wey friend get for each other ( Greek , phi·liʹa ) ; ( 2 ) love wey man and woman get for each other ( eʹros ) ; ( 3 ) love wey people for family get for each other ( stor·geʹ ) . 2020-02-09 13:44:14,515 Hypothesis: We no dey show love play . We dey enjoy our family , and we dey show love play . 2020-02-09 13:44:14,515 Example #3 2020-02-09 13:44:14,515 Raw source: ['As', 'our', 'loving', 'De@@', 'sign@@', 'er', 'and', 'Creator', ',', 'Jehovah', 'knows', 'what', 'we', 'need', 'in', 'order', 'to', 'be', 'truly', 'happy', ',', 'and', 'he', 'f@@', 'ill@@', 's', 'that', 'need', 'ab@@', 'un@@', 'd@@', 'an@@', 'tly', '.'] 2020-02-09 13:44:14,515 Raw hypothesis: ['As', 'Jehovah', 'love', 'us', ',', 'e', 'know', 'wetin', 'e', 'really', 'need', 'and', 'wetin', 'e', 'really', 'need', '.'] 2020-02-09 13:44:14,515 Source: As our loving Designer and Creator , Jehovah knows what we need in order to be truly happy , and he fills that need abundantly . 2020-02-09 13:44:14,515 Reference: Because na Jehovah make us , e know wetin go make us happy . E don even give us pass wetin we need . 2020-02-09 13:44:14,515 Hypothesis: As Jehovah love us , e know wetin e really need and wetin e really need . 2020-02-09 13:44:14,516 Validation result (greedy) at epoch 88, step 19000: bleu: 13.57, loss: 53380.0625, ppl: 10.2883, duration: 12.0500s 2020-02-09 13:44:17,207 Epoch 88: total training loss 230.15 2020-02-09 13:44:17,207 EPOCH 89 2020-02-09 13:44:24,557 Epoch 89 Step: 19100 Batch Loss: 0.548133 Tokens per Sec: 20741, Lr: 0.000210 2020-02-09 13:44:34,597 Epoch 89 Step: 19200 Batch Loss: 0.832117 Tokens per Sec: 21632, Lr: 0.000210 2020-02-09 13:44:38,896 Epoch 89: total training loss 229.20 2020-02-09 13:44:38,896 EPOCH 90 2020-02-09 13:44:44,624 Epoch 90 Step: 19300 Batch Loss: 0.876124 Tokens per Sec: 21552, Lr: 0.000210 2020-02-09 13:44:54,566 Epoch 90 Step: 19400 Batch Loss: 1.264800 Tokens per Sec: 21036, Lr: 0.000210 2020-02-09 13:45:00,410 Epoch 90: total training loss 228.24 2020-02-09 13:45:00,410 EPOCH 91 2020-02-09 13:45:04,549 Epoch 91 Step: 19500 Batch Loss: 1.024360 Tokens per Sec: 20341, Lr: 0.000210 2020-02-09 13:45:14,535 Epoch 91 Step: 19600 Batch Loss: 1.097890 Tokens per Sec: 21405, Lr: 0.000210 2020-02-09 13:45:22,045 Epoch 91: total training loss 227.40 2020-02-09 13:45:22,045 EPOCH 92 2020-02-09 13:45:24,575 Epoch 92 Step: 19700 Batch Loss: 0.919955 Tokens per Sec: 20557, Lr: 0.000210 2020-02-09 13:45:34,523 Epoch 92 Step: 19800 Batch Loss: 1.160814 Tokens per Sec: 21590, Lr: 0.000210 2020-02-09 13:45:43,594 Epoch 92: total training loss 226.09 2020-02-09 13:45:43,594 EPOCH 93 2020-02-09 13:45:44,429 Epoch 93 Step: 19900 Batch Loss: 1.192731 Tokens per Sec: 22762, Lr: 0.000210 2020-02-09 13:45:54,382 Epoch 93 Step: 20000 Batch Loss: 0.361479 Tokens per Sec: 21149, Lr: 0.000210 2020-02-09 13:46:07,578 Example #0 2020-02-09 13:46:07,578 Raw source: ['Jehovah', 'did', 'not', 'do', 'that', ',', 'but', 'he', 'allowed', 'Satan', 'to', 'test', 'Job', ',', 'st@@', 'ating', ':', '“', 'Every@@', 'thing', 'that', 'he', 'has', 'is', 'in', 'your', 'hand', '.', '”'] 2020-02-09 13:46:07,578 Raw hypothesis: ['Jehovah', 'no', 'let', 'Satan', 'suffer', 'Job', '.', 'But', 'e', 'let', 'Satan', 'do', 'wetin', 'e', 'talk', '.', 'E', 'sey', ':', '‘', 'Any@@', 'body', 'wey', 'get', 'for', 'hand', ',', 'e', 'don', 'use', 'im', 'hand', 'do', 'wetin', 'e', 'want', '.', '’'] 2020-02-09 13:46:07,578 Source: Jehovah did not do that , but he allowed Satan to test Job , stating : “ Everything that he has is in your hand . ” 2020-02-09 13:46:07,578 Reference: E tell am sey : ‘ Everything wey e get dey your hand . ’ 2020-02-09 13:46:07,578 Hypothesis: Jehovah no let Satan suffer Job . But e let Satan do wetin e talk . E sey : ‘ Anybody wey get for hand , e don use im hand do wetin e want . ’ 2020-02-09 13:46:07,578 Example #1 2020-02-09 13:46:07,578 Raw source: ['Corin@@', 'na', 'said', ':', '“', 'We', 'left', 'our', 'work', 'area', 'in', 'the', 'evening', 'and', 'wal@@', 'ked', 'to', 'a', 'ra@@', 'il@@', 'way', 'st@@', 'ation', '25', 'ki@@', 'lo@@', 'me@@', 'ters', '(', '15', 'miles', ')', 'away', '.'] 2020-02-09 13:46:07,578 Raw hypothesis: ['Corin@@', 'na', ',', 'wey', 'come', 'from', 'prison', ',', 'talk', 'sey', ':', '“', 'We', 'comot', 'for', 'where', 'we', 'dey', 'stay', ',', 'and', 'we', 'waka', 'comot', 'go', 'where', 'we', 'dey', 'stay', '.', 'We', 'waka', 'for', 'there', 'go', 'where', 'dem', 'dey', 'call', 'ra@@', 'ki@@', 'lo@@', 'me@@', 'ters', '(', '15', 'miles', ')', '.'] 2020-02-09 13:46:07,578 Source: Corinna said : “ We left our work area in the evening and walked to a railway station 25 kilometers ( 15 miles ) away . 2020-02-09 13:46:07,578 Reference: Corinna talk sey : “ We comot for where we dey work for evening come trek go where people dey enter train wey be 25 kilometer ( 15 miles ) from where the farm dey . 2020-02-09 13:46:07,579 Hypothesis: Corinna , wey come from prison , talk sey : “ We comot for where we dey stay , and we waka comot go where we dey stay . We waka for there go where dem dey call rakilometers ( 15 miles ) . 2020-02-09 13:46:07,579 Example #2 2020-02-09 13:46:07,579 Raw source: ['Ro@@', 'man@@', 'tic', 'love', '(', 'e@@', 'ʹ@@', 'ro@@', 's', ')', 'brings', 'delight', ',', 'and', 'love', 'for', 'family', '(', 'st@@', 'or@@', '·@@', 'ge@@', 'ʹ', ')', 'is', 'vital', 'when', 'children', 'enter', 'the', 'picture', '.'] 2020-02-09 13:46:07,579 Raw hypothesis: ['We', 'like', 'to', 'marry', '(', 'picture', '.', ')', 'We', 'dey', 'show', 'dem', 'love', ',', 'and', 'we', 'love', 'their', 'family', '(', 'Gal', '.'] 2020-02-09 13:46:07,579 Source: Romantic love ( eʹros ) brings delight , and love for family ( stor·geʹ ) is vital when children enter the picture . 2020-02-09 13:46:07,579 Reference: ( 1 ) Love wey friend get for each other ( Greek , phi·liʹa ) ; ( 2 ) love wey man and woman get for each other ( eʹros ) ; ( 3 ) love wey people for family get for each other ( stor·geʹ ) . 2020-02-09 13:46:07,579 Hypothesis: We like to marry ( picture . ) We dey show dem love , and we love their family ( Gal . 2020-02-09 13:46:07,579 Example #3 2020-02-09 13:46:07,579 Raw source: ['As', 'our', 'loving', 'De@@', 'sign@@', 'er', 'and', 'Creator', ',', 'Jehovah', 'knows', 'what', 'we', 'need', 'in', 'order', 'to', 'be', 'truly', 'happy', ',', 'and', 'he', 'f@@', 'ill@@', 's', 'that', 'need', 'ab@@', 'un@@', 'd@@', 'an@@', 'tly', '.'] 2020-02-09 13:46:07,579 Raw hypothesis: ['We', 'know', 'sey', 'Jehovah', 'love', 'us', 'and', 'e', 'know', 'wetin', 'we', 'need', '.'] 2020-02-09 13:46:07,579 Source: As our loving Designer and Creator , Jehovah knows what we need in order to be truly happy , and he fills that need abundantly . 2020-02-09 13:46:07,579 Reference: Because na Jehovah make us , e know wetin go make us happy . E don even give us pass wetin we need . 2020-02-09 13:46:07,579 Hypothesis: We know sey Jehovah love us and e know wetin we need . 2020-02-09 13:46:07,579 Validation result (greedy) at epoch 93, step 20000: bleu: 13.91, loss: 53823.9727, ppl: 10.4897, duration: 13.1968s 2020-02-09 13:46:17,536 Epoch 93 Step: 20100 Batch Loss: 1.070482 Tokens per Sec: 21340, Lr: 0.000210 2020-02-09 13:46:18,325 Epoch 93: total training loss 224.44 2020-02-09 13:46:18,325 EPOCH 94 2020-02-09 13:46:27,463 Epoch 94 Step: 20200 Batch Loss: 1.145636 Tokens per Sec: 21201, Lr: 0.000210 2020-02-09 13:46:37,448 Epoch 94 Step: 20300 Batch Loss: 0.872220 Tokens per Sec: 21358, Lr: 0.000210 2020-02-09 13:46:39,841 Epoch 94: total training loss 222.53 2020-02-09 13:46:39,842 EPOCH 95 2020-02-09 13:46:47,500 Epoch 95 Step: 20400 Batch Loss: 1.130787 Tokens per Sec: 20967, Lr: 0.000210 2020-02-09 13:46:57,491 Epoch 95 Step: 20500 Batch Loss: 1.082057 Tokens per Sec: 21452, Lr: 0.000210 2020-02-09 13:47:01,392 Epoch 95: total training loss 221.00 2020-02-09 13:47:01,393 EPOCH 96 2020-02-09 13:47:07,518 Epoch 96 Step: 20600 Batch Loss: 1.183320 Tokens per Sec: 20816, Lr: 0.000210 2020-02-09 13:47:17,572 Epoch 96 Step: 20700 Batch Loss: 1.090420 Tokens per Sec: 21015, Lr: 0.000210 2020-02-09 13:47:23,146 Epoch 96: total training loss 221.56 2020-02-09 13:47:23,147 EPOCH 97 2020-02-09 13:47:27,580 Epoch 97 Step: 20800 Batch Loss: 0.864067 Tokens per Sec: 21545, Lr: 0.000210 2020-02-09 13:47:37,599 Epoch 97 Step: 20900 Batch Loss: 1.084702 Tokens per Sec: 21511, Lr: 0.000210 2020-02-09 13:47:44,692 Epoch 97: total training loss 217.74 2020-02-09 13:47:44,692 EPOCH 98 2020-02-09 13:47:47,636 Epoch 98 Step: 21000 Batch Loss: 0.787406 Tokens per Sec: 20613, Lr: 0.000210 2020-02-09 13:47:59,112 Example #0 2020-02-09 13:47:59,112 Raw source: ['Jehovah', 'did', 'not', 'do', 'that', ',', 'but', 'he', 'allowed', 'Satan', 'to', 'test', 'Job', ',', 'st@@', 'ating', ':', '“', 'Every@@', 'thing', 'that', 'he', 'has', 'is', 'in', 'your', 'hand', '.', '”'] 2020-02-09 13:47:59,112 Raw hypothesis: ['Jehovah', 'no', 'let', 'Satan', 'do', 'wetin', 'e', 'no', 'like', '.', 'E', 'let', 'Satan', 'do', 'wetin', 'e', 'promise', '.', 'E', 'sey', ':', '‘', 'Any@@', 'body', 'wey', 'dey', 'your', 'hand', 'don', 'weak', ',', 'but', 'e', 'never', 'do', 'wetin', 'e', 'want', '.', '’'] 2020-02-09 13:47:59,112 Source: Jehovah did not do that , but he allowed Satan to test Job , stating : “ Everything that he has is in your hand . ” 2020-02-09 13:47:59,112 Reference: E tell am sey : ‘ Everything wey e get dey your hand . ’ 2020-02-09 13:47:59,112 Hypothesis: Jehovah no let Satan do wetin e no like . E let Satan do wetin e promise . E sey : ‘ Anybody wey dey your hand don weak , but e never do wetin e want . ’ 2020-02-09 13:47:59,112 Example #1 2020-02-09 13:47:59,112 Raw source: ['Corin@@', 'na', 'said', ':', '“', 'We', 'left', 'our', 'work', 'area', 'in', 'the', 'evening', 'and', 'wal@@', 'ked', 'to', 'a', 'ra@@', 'il@@', 'way', 'st@@', 'ation', '25', 'ki@@', 'lo@@', 'me@@', 'ters', '(', '15', 'miles', ')', 'away', '.'] 2020-02-09 13:47:59,112 Raw hypothesis: ['Corin@@', 'na', ',', 'wey', 'come', 'from', 'prison', ',', 'talk', 'sey', ':', '“', 'We', 'stay', 'for', 'evening', 'and', 'we', 'waka', 'comot', '.', 'We', 'waka', 'comot', 'for', 'where', 'dem', 'dey', 'call', 'ra@@', 'ki@@', 'lo@@', 'me@@', 'ters', '(', '15', 'km', ')', '.'] 2020-02-09 13:47:59,112 Source: Corinna said : “ We left our work area in the evening and walked to a railway station 25 kilometers ( 15 miles ) away . 2020-02-09 13:47:59,113 Reference: Corinna talk sey : “ We comot for where we dey work for evening come trek go where people dey enter train wey be 25 kilometer ( 15 miles ) from where the farm dey . 2020-02-09 13:47:59,113 Hypothesis: Corinna , wey come from prison , talk sey : “ We stay for evening and we waka comot . We waka comot for where dem dey call rakilometers ( 15 km ) . 2020-02-09 13:47:59,113 Example #2 2020-02-09 13:47:59,113 Raw source: ['Ro@@', 'man@@', 'tic', 'love', '(', 'e@@', 'ʹ@@', 'ro@@', 's', ')', 'brings', 'delight', ',', 'and', 'love', 'for', 'family', '(', 'st@@', 'or@@', '·@@', 'ge@@', 'ʹ', ')', 'is', 'vital', 'when', 'children', 'enter', 'the', 'picture', '.'] 2020-02-09 13:47:59,113 Raw hypothesis: ['We', 'love', 'Ro@@', 'st@@', 'ro@@', 'ke', '(', 'wey', 'dey', 'show', 'our', 'family', 'love', ',', 'and', 'wey', 'dey', 'show', 'love', 'theirself', '.'] 2020-02-09 13:47:59,113 Source: Romantic love ( eʹros ) brings delight , and love for family ( stor·geʹ ) is vital when children enter the picture . 2020-02-09 13:47:59,113 Reference: ( 1 ) Love wey friend get for each other ( Greek , phi·liʹa ) ; ( 2 ) love wey man and woman get for each other ( eʹros ) ; ( 3 ) love wey people for family get for each other ( stor·geʹ ) . 2020-02-09 13:47:59,113 Hypothesis: We love Rostroke ( wey dey show our family love , and wey dey show love theirself . 2020-02-09 13:47:59,113 Example #3 2020-02-09 13:47:59,113 Raw source: ['As', 'our', 'loving', 'De@@', 'sign@@', 'er', 'and', 'Creator', ',', 'Jehovah', 'knows', 'what', 'we', 'need', 'in', 'order', 'to', 'be', 'truly', 'happy', ',', 'and', 'he', 'f@@', 'ill@@', 's', 'that', 'need', 'ab@@', 'un@@', 'd@@', 'an@@', 'tly', '.'] 2020-02-09 13:47:59,113 Raw hypothesis: ['As', 'Jehovah', 'love', 'us', ',', 'we', 'know', 'wetin', 'e', 'really', 'need', 'and', 'e', 'dey', 'make', 'us', 'happy', '.'] 2020-02-09 13:47:59,113 Source: As our loving Designer and Creator , Jehovah knows what we need in order to be truly happy , and he fills that need abundantly . 2020-02-09 13:47:59,113 Reference: Because na Jehovah make us , e know wetin go make us happy . E don even give us pass wetin we need . 2020-02-09 13:47:59,113 Hypothesis: As Jehovah love us , we know wetin e really need and e dey make us happy . 2020-02-09 13:47:59,113 Validation result (greedy) at epoch 98, step 21000: bleu: 13.27, loss: 54286.3945, ppl: 10.7037, duration: 11.4772s 2020-02-09 13:48:09,145 Epoch 98 Step: 21100 Batch Loss: 0.896528 Tokens per Sec: 21080, Lr: 0.000210 2020-02-09 13:48:17,765 Epoch 98: total training loss 217.97 2020-02-09 13:48:17,765 EPOCH 99 2020-02-09 13:48:19,095 Epoch 99 Step: 21200 Batch Loss: 0.963753 Tokens per Sec: 20769, Lr: 0.000210 2020-02-09 13:48:29,002 Epoch 99 Step: 21300 Batch Loss: 1.070642 Tokens per Sec: 21223, Lr: 0.000210 2020-02-09 13:48:38,915 Epoch 99 Step: 21400 Batch Loss: 1.051394 Tokens per Sec: 21467, Lr: 0.000210 2020-02-09 13:48:39,214 Epoch 99: total training loss 216.58 2020-02-09 13:48:39,214 EPOCH 100 2020-02-09 13:48:48,886 Epoch 100 Step: 21500 Batch Loss: 1.141423 Tokens per Sec: 20934, Lr: 0.000210 2020-02-09 13:48:58,818 Epoch 100 Step: 21600 Batch Loss: 1.209352 Tokens per Sec: 21579, Lr: 0.000210 2020-02-09 13:49:00,698 Epoch 100: total training loss 215.87 2020-02-09 13:49:00,698 EPOCH 101 2020-02-09 13:49:08,758 Epoch 101 Step: 21700 Batch Loss: 1.094492 Tokens per Sec: 21748, Lr: 0.000210 2020-02-09 13:49:18,671 Epoch 101 Step: 21800 Batch Loss: 0.616443 Tokens per Sec: 21013, Lr: 0.000210 2020-02-09 13:49:22,246 Epoch 101: total training loss 215.19 2020-02-09 13:49:22,246 EPOCH 102 2020-02-09 13:49:28,668 Epoch 102 Step: 21900 Batch Loss: 1.103251 Tokens per Sec: 20765, Lr: 0.000210 2020-02-09 13:49:38,643 Epoch 102 Step: 22000 Batch Loss: 1.094959 Tokens per Sec: 21129, Lr: 0.000210 2020-02-09 13:49:51,805 Example #0 2020-02-09 13:49:51,806 Raw source: ['Jehovah', 'did', 'not', 'do', 'that', ',', 'but', 'he', 'allowed', 'Satan', 'to', 'test', 'Job', ',', 'st@@', 'ating', ':', '“', 'Every@@', 'thing', 'that', 'he', 'has', 'is', 'in', 'your', 'hand', '.', '”'] 2020-02-09 13:49:51,806 Raw hypothesis: ['Jehovah', 'no', 'let', 'Satan', 'suffer', 'Job', '.', 'But', 'e', 'let', 'am', 'suffer', 'Job', '.', 'E', 'tell', 'am', 'sey', ':', '‘', 'Any@@', 'body', 'wey', 'get', 'power', ',', 'e', 'don', 'use', 'your', 'hand', 'do', 'wetin', 'e', 'want', '.', '’'] 2020-02-09 13:49:51,806 Source: Jehovah did not do that , but he allowed Satan to test Job , stating : “ Everything that he has is in your hand . ” 2020-02-09 13:49:51,806 Reference: E tell am sey : ‘ Everything wey e get dey your hand . ’ 2020-02-09 13:49:51,806 Hypothesis: Jehovah no let Satan suffer Job . But e let am suffer Job . E tell am sey : ‘ Anybody wey get power , e don use your hand do wetin e want . ’ 2020-02-09 13:49:51,806 Example #1 2020-02-09 13:49:51,806 Raw source: ['Corin@@', 'na', 'said', ':', '“', 'We', 'left', 'our', 'work', 'area', 'in', 'the', 'evening', 'and', 'wal@@', 'ked', 'to', 'a', 'ra@@', 'il@@', 'way', 'st@@', 'ation', '25', 'ki@@', 'lo@@', 'me@@', 'ters', '(', '15', 'miles', ')', 'away', '.'] 2020-02-09 13:49:51,806 Raw hypothesis: ['Corin@@', 'na', ',', 'e', 'come', 'sey', ':', '“', 'We', 'comot', 'for', 'where', 'we', 'dey', 'stay', ',', 'and', 'we', 'waka', 'comot', 'from', 'where', 'we', 'dey', 'stay', '.', 'We', 'waka', 'for', 'there', 'go', 'there', '.', 'We', 'dey', 'there', 'to', '25', 'miles', '(', '15', 'km', ')', '.'] 2020-02-09 13:49:51,806 Source: Corinna said : “ We left our work area in the evening and walked to a railway station 25 kilometers ( 15 miles ) away . 2020-02-09 13:49:51,806 Reference: Corinna talk sey : “ We comot for where we dey work for evening come trek go where people dey enter train wey be 25 kilometer ( 15 miles ) from where the farm dey . 2020-02-09 13:49:51,806 Hypothesis: Corinna , e come sey : “ We comot for where we dey stay , and we waka comot from where we dey stay . We waka for there go there . We dey there to 25 miles ( 15 km ) . 2020-02-09 13:49:51,806 Example #2 2020-02-09 13:49:51,807 Raw source: ['Ro@@', 'man@@', 'tic', 'love', '(', 'e@@', 'ʹ@@', 'ro@@', 's', ')', 'brings', 'delight', ',', 'and', 'love', 'for', 'family', '(', 'st@@', 'or@@', '·@@', 'ge@@', 'ʹ', ')', 'is', 'vital', 'when', 'children', 'enter', 'the', 'picture', '.'] 2020-02-09 13:49:51,807 Raw hypothesis: ['We', 'like', 'to', 'enjoy', 'their', 'picture', '.', 'We', 'dey', 'enjoy', 'our', 'family', ',', 'and', 'we', 'dey', 'show', 'love', 'play', '.', 'We', 'dey', 'show', 'dem', 'how', 'to', 'care', 'for', 'family', 'and', 'when', 'dem', 'dey', 'chop', 'our', 'pikin', '.'] 2020-02-09 13:49:51,807 Source: Romantic love ( eʹros ) brings delight , and love for family ( stor·geʹ ) is vital when children enter the picture . 2020-02-09 13:49:51,807 Reference: ( 1 ) Love wey friend get for each other ( Greek , phi·liʹa ) ; ( 2 ) love wey man and woman get for each other ( eʹros ) ; ( 3 ) love wey people for family get for each other ( stor·geʹ ) . 2020-02-09 13:49:51,807 Hypothesis: We like to enjoy their picture . We dey enjoy our family , and we dey show love play . We dey show dem how to care for family and when dem dey chop our pikin . 2020-02-09 13:49:51,807 Example #3 2020-02-09 13:49:51,807 Raw source: ['As', 'our', 'loving', 'De@@', 'sign@@', 'er', 'and', 'Creator', ',', 'Jehovah', 'knows', 'what', 'we', 'need', 'in', 'order', 'to', 'be', 'truly', 'happy', ',', 'and', 'he', 'f@@', 'ill@@', 's', 'that', 'need', 'ab@@', 'un@@', 'd@@', 'an@@', 'tly', '.'] 2020-02-09 13:49:51,807 Raw hypothesis: ['As', 'Jehovah', 'love', 'us', 'and', 'e', 'know', 'wetin', 'we', 'need', ',', 'e', 'know', 'wetin', 'we', 'need', 'and', 'e', 'dey', 'really', 'make', 'us', 'happy', '.'] 2020-02-09 13:49:51,807 Source: As our loving Designer and Creator , Jehovah knows what we need in order to be truly happy , and he fills that need abundantly . 2020-02-09 13:49:51,807 Reference: Because na Jehovah make us , e know wetin go make us happy . E don even give us pass wetin we need . 2020-02-09 13:49:51,807 Hypothesis: As Jehovah love us and e know wetin we need , e know wetin we need and e dey really make us happy . 2020-02-09 13:49:51,807 Validation result (greedy) at epoch 102, step 22000: bleu: 13.92, loss: 54675.6367, ppl: 10.8871, duration: 13.1641s 2020-02-09 13:49:56,998 Epoch 102: total training loss 213.19 2020-02-09 13:49:56,998 EPOCH 103 2020-02-09 13:50:01,802 Epoch 103 Step: 22100 Batch Loss: 1.089305 Tokens per Sec: 21327, Lr: 0.000147 2020-02-09 13:50:11,727 Epoch 103 Step: 22200 Batch Loss: 0.896127 Tokens per Sec: 21282, Lr: 0.000147 2020-02-09 13:50:18,547 Epoch 103: total training loss 207.89 2020-02-09 13:50:18,547 EPOCH 104 2020-02-09 13:50:21,751 Epoch 104 Step: 22300 Batch Loss: 0.938026 Tokens per Sec: 20639, Lr: 0.000147 2020-02-09 13:50:31,744 Epoch 104 Step: 22400 Batch Loss: 1.021022 Tokens per Sec: 21276, Lr: 0.000147 2020-02-09 13:50:40,010 Epoch 104: total training loss 205.96 2020-02-09 13:50:40,011 EPOCH 105 2020-02-09 13:50:41,742 Epoch 105 Step: 22500 Batch Loss: 0.934909 Tokens per Sec: 21536, Lr: 0.000147 2020-02-09 13:50:51,699 Epoch 105 Step: 22600 Batch Loss: 1.191996 Tokens per Sec: 21250, Lr: 0.000147 2020-02-09 13:51:01,456 Epoch 105: total training loss 204.10 2020-02-09 13:51:01,456 EPOCH 106 2020-02-09 13:51:01,701 Epoch 106 Step: 22700 Batch Loss: 1.001169 Tokens per Sec: 19329, Lr: 0.000147 2020-02-09 13:51:11,630 Epoch 106 Step: 22800 Batch Loss: 0.846913 Tokens per Sec: 21166, Lr: 0.000147 2020-02-09 13:51:21,535 Epoch 106 Step: 22900 Batch Loss: 0.811543 Tokens per Sec: 21118, Lr: 0.000147 2020-02-09 13:51:23,030 Epoch 106: total training loss 204.36 2020-02-09 13:51:23,030 EPOCH 107 2020-02-09 13:51:31,487 Epoch 107 Step: 23000 Batch Loss: 0.401998 Tokens per Sec: 21023, Lr: 0.000147 2020-02-09 13:51:43,727 Example #0 2020-02-09 13:51:43,727 Raw source: ['Jehovah', 'did', 'not', 'do', 'that', ',', 'but', 'he', 'allowed', 'Satan', 'to', 'test', 'Job', ',', 'st@@', 'ating', ':', '“', 'Every@@', 'thing', 'that', 'he', 'has', 'is', 'in', 'your', 'hand', '.', '”'] 2020-02-09 13:51:43,728 Raw hypothesis: ['Jehovah', 'no', 'let', 'Satan', 'do', 'wetin', 'e', 'no', 'like', '.', 'E', 'tell', 'Job', 'sey', ':', '‘', 'Any@@', 'body', 'wey', 'dey', 'your', 'hand', 'don', 'turn', 'to', 'am', ',', 'but', 'e', 'don', 'already', 'talk', 'sey', 'e', 'don', 'already', 'do', 'wetin', 'you', 'want', '.', '’'] 2020-02-09 13:51:43,728 Source: Jehovah did not do that , but he allowed Satan to test Job , stating : “ Everything that he has is in your hand . ” 2020-02-09 13:51:43,728 Reference: E tell am sey : ‘ Everything wey e get dey your hand . ’ 2020-02-09 13:51:43,728 Hypothesis: Jehovah no let Satan do wetin e no like . E tell Job sey : ‘ Anybody wey dey your hand don turn to am , but e don already talk sey e don already do wetin you want . ’ 2020-02-09 13:51:43,728 Example #1 2020-02-09 13:51:43,728 Raw source: ['Corin@@', 'na', 'said', ':', '“', 'We', 'left', 'our', 'work', 'area', 'in', 'the', 'evening', 'and', 'wal@@', 'ked', 'to', 'a', 'ra@@', 'il@@', 'way', 'st@@', 'ation', '25', 'ki@@', 'lo@@', 'me@@', 'ters', '(', '15', 'miles', ')', 'away', '.'] 2020-02-09 13:51:43,728 Raw hypothesis: ['Corin@@', 'na', ',', 'wey', 'come', 'sey', ':', '“', 'We', 'comot', 'for', 'where', 'we', 'dey', 'stay', ',', 'we', 'come', 'dey', 'stay', 'for', 'where', 'we', 'dey', 'stay', '.', 'We', 'waka', 'for', 'there', 'go', 'another', 'place', 'for', 'evening', '.'] 2020-02-09 13:51:43,728 Source: Corinna said : “ We left our work area in the evening and walked to a railway station 25 kilometers ( 15 miles ) away . 2020-02-09 13:51:43,728 Reference: Corinna talk sey : “ We comot for where we dey work for evening come trek go where people dey enter train wey be 25 kilometer ( 15 miles ) from where the farm dey . 2020-02-09 13:51:43,728 Hypothesis: Corinna , wey come sey : “ We comot for where we dey stay , we come dey stay for where we dey stay . We waka for there go another place for evening . 2020-02-09 13:51:43,728 Example #2 2020-02-09 13:51:43,728 Raw source: ['Ro@@', 'man@@', 'tic', 'love', '(', 'e@@', 'ʹ@@', 'ro@@', 's', ')', 'brings', 'delight', ',', 'and', 'love', 'for', 'family', '(', 'st@@', 'or@@', '·@@', 'ge@@', 'ʹ', ')', 'is', 'vital', 'when', 'children', 'enter', 'the', 'picture', '.'] 2020-02-09 13:51:43,728 Raw hypothesis: ['We', 'dey', 'show', 'love', ',', 'family', '(', '1', ')', 'how', 'we', 'love', 'and', 'our', 'family', 'and', 'our', 'family', 'people', 'dey', 'show', 'love', '.'] 2020-02-09 13:51:43,729 Source: Romantic love ( eʹros ) brings delight , and love for family ( stor·geʹ ) is vital when children enter the picture . 2020-02-09 13:51:43,729 Reference: ( 1 ) Love wey friend get for each other ( Greek , phi·liʹa ) ; ( 2 ) love wey man and woman get for each other ( eʹros ) ; ( 3 ) love wey people for family get for each other ( stor·geʹ ) . 2020-02-09 13:51:43,729 Hypothesis: We dey show love , family ( 1 ) how we love and our family and our family people dey show love . 2020-02-09 13:51:43,729 Example #3 2020-02-09 13:51:43,729 Raw source: ['As', 'our', 'loving', 'De@@', 'sign@@', 'er', 'and', 'Creator', ',', 'Jehovah', 'knows', 'what', 'we', 'need', 'in', 'order', 'to', 'be', 'truly', 'happy', ',', 'and', 'he', 'f@@', 'ill@@', 's', 'that', 'need', 'ab@@', 'un@@', 'd@@', 'an@@', 'tly', '.'] 2020-02-09 13:51:43,729 Raw hypothesis: ['As', 'Jehovah', 'take', 'love', 'us', ',', 'na', 'im', 'make', 'us', 'know', 'wetin', 'we', 'really', 'need', 'and', 'e', 'dey', 'make', 'us', 'happy', '.'] 2020-02-09 13:51:43,729 Source: As our loving Designer and Creator , Jehovah knows what we need in order to be truly happy , and he fills that need abundantly . 2020-02-09 13:51:43,729 Reference: Because na Jehovah make us , e know wetin go make us happy . E don even give us pass wetin we need . 2020-02-09 13:51:43,729 Hypothesis: As Jehovah take love us , na im make us know wetin we really need and e dey make us happy . 2020-02-09 13:51:43,729 Validation result (greedy) at epoch 107, step 23000: bleu: 14.01, loss: 54995.6445, ppl: 11.0403, duration: 12.2415s 2020-02-09 13:51:53,642 Epoch 107 Step: 23100 Batch Loss: 1.059401 Tokens per Sec: 21711, Lr: 0.000147 2020-02-09 13:51:56,792 Epoch 107: total training loss 203.60 2020-02-09 13:51:56,792 EPOCH 108 2020-02-09 13:52:03,582 Epoch 108 Step: 23200 Batch Loss: 1.087745 Tokens per Sec: 21250, Lr: 0.000147 2020-02-09 13:52:13,496 Epoch 108 Step: 23300 Batch Loss: 1.063015 Tokens per Sec: 21327, Lr: 0.000147 2020-02-09 13:52:18,377 Epoch 108: total training loss 202.56 2020-02-09 13:52:18,377 EPOCH 109 2020-02-09 13:52:23,481 Epoch 109 Step: 23400 Batch Loss: 1.082638 Tokens per Sec: 21526, Lr: 0.000147 2020-02-09 13:52:33,333 Epoch 109 Step: 23500 Batch Loss: 0.983980 Tokens per Sec: 20850, Lr: 0.000147 2020-02-09 13:52:39,747 Epoch 109: total training loss 200.99 2020-02-09 13:52:39,747 EPOCH 110 2020-02-09 13:52:43,235 Epoch 110 Step: 23600 Batch Loss: 1.046511 Tokens per Sec: 21247, Lr: 0.000147 2020-02-09 13:52:53,140 Epoch 110 Step: 23700 Batch Loss: 1.021222 Tokens per Sec: 21363, Lr: 0.000147 2020-02-09 13:53:01,274 Epoch 110: total training loss 200.96 2020-02-09 13:53:01,274 EPOCH 111 2020-02-09 13:53:03,110 Epoch 111 Step: 23800 Batch Loss: 0.839858 Tokens per Sec: 20800, Lr: 0.000147 2020-02-09 13:53:13,121 Epoch 111 Step: 23900 Batch Loss: 1.081153 Tokens per Sec: 21154, Lr: 0.000147 2020-02-09 13:53:22,706 Epoch 111: total training loss 197.80 2020-02-09 13:53:22,707 EPOCH 112 2020-02-09 13:53:23,051 Epoch 112 Step: 24000 Batch Loss: 1.055055 Tokens per Sec: 21954, Lr: 0.000147 2020-02-09 13:53:35,284 Example #0 2020-02-09 13:53:35,284 Raw source: ['Jehovah', 'did', 'not', 'do', 'that', ',', 'but', 'he', 'allowed', 'Satan', 'to', 'test', 'Job', ',', 'st@@', 'ating', ':', '“', 'Every@@', 'thing', 'that', 'he', 'has', 'is', 'in', 'your', 'hand', '.', '”'] 2020-02-09 13:53:35,284 Raw hypothesis: ['Jehovah', 'no', 'let', 'Satan', 'suffer', 'Job', '.', 'But', 'e', 'let', 'am', 'know', 'sey', ':', '‘', 'Any@@', 'body', 'wey', 'dey', 'your', 'hand', 'don', 'weak', ',', 'but', 'e', 'never', 'do', 'am', '.', '’'] 2020-02-09 13:53:35,284 Source: Jehovah did not do that , but he allowed Satan to test Job , stating : “ Everything that he has is in your hand . ” 2020-02-09 13:53:35,285 Reference: E tell am sey : ‘ Everything wey e get dey your hand . ’ 2020-02-09 13:53:35,285 Hypothesis: Jehovah no let Satan suffer Job . But e let am know sey : ‘ Anybody wey dey your hand don weak , but e never do am . ’ 2020-02-09 13:53:35,285 Example #1 2020-02-09 13:53:35,285 Raw source: ['Corin@@', 'na', 'said', ':', '“', 'We', 'left', 'our', 'work', 'area', 'in', 'the', 'evening', 'and', 'wal@@', 'ked', 'to', 'a', 'ra@@', 'il@@', 'way', 'st@@', 'ation', '25', 'ki@@', 'lo@@', 'me@@', 'ters', '(', '15', 'miles', ')', 'away', '.'] 2020-02-09 13:53:35,285 Raw hypothesis: ['Corin@@', 'na', ',', 'wey', 'come', 'sey', ':', '“', 'We', 'stay', 'for', 'where', 'we', 'dey', 'stay', ',', 'we', 'dey', 'stay', 'there', 'for', 'where', 'we', 'dey', 'stay', '.', 'We', 'waka', 'for', 'there', 'go', 'another', 'place', 'for', 'evening', '.'] 2020-02-09 13:53:35,285 Source: Corinna said : “ We left our work area in the evening and walked to a railway station 25 kilometers ( 15 miles ) away . 2020-02-09 13:53:35,285 Reference: Corinna talk sey : “ We comot for where we dey work for evening come trek go where people dey enter train wey be 25 kilometer ( 15 miles ) from where the farm dey . 2020-02-09 13:53:35,285 Hypothesis: Corinna , wey come sey : “ We stay for where we dey stay , we dey stay there for where we dey stay . We waka for there go another place for evening . 2020-02-09 13:53:35,285 Example #2 2020-02-09 13:53:35,285 Raw source: ['Ro@@', 'man@@', 'tic', 'love', '(', 'e@@', 'ʹ@@', 'ro@@', 's', ')', 'brings', 'delight', ',', 'and', 'love', 'for', 'family', '(', 'st@@', 'or@@', '·@@', 'ge@@', 'ʹ', ')', 'is', 'vital', 'when', 'children', 'enter', 'the', 'picture', '.'] 2020-02-09 13:53:35,285 Raw hypothesis: ['We', 'dey', 'show', 'love', 'play', ',', 'and', 'we', 'dey', 'enjoy', 'our', 'family', '.', 'We', 'dey', 'show', 'love', 'when', 'we', 'dey', 'show', 'dem', 'how', 'to', 'love', 'their', 'pikin', '.'] 2020-02-09 13:53:35,285 Source: Romantic love ( eʹros ) brings delight , and love for family ( stor·geʹ ) is vital when children enter the picture . 2020-02-09 13:53:35,286 Reference: ( 1 ) Love wey friend get for each other ( Greek , phi·liʹa ) ; ( 2 ) love wey man and woman get for each other ( eʹros ) ; ( 3 ) love wey people for family get for each other ( stor·geʹ ) . 2020-02-09 13:53:35,286 Hypothesis: We dey show love play , and we dey enjoy our family . We dey show love when we dey show dem how to love their pikin . 2020-02-09 13:53:35,286 Example #3 2020-02-09 13:53:35,286 Raw source: ['As', 'our', 'loving', 'De@@', 'sign@@', 'er', 'and', 'Creator', ',', 'Jehovah', 'knows', 'what', 'we', 'need', 'in', 'order', 'to', 'be', 'truly', 'happy', ',', 'and', 'he', 'f@@', 'ill@@', 's', 'that', 'need', 'ab@@', 'un@@', 'd@@', 'an@@', 'tly', '.'] 2020-02-09 13:53:35,286 Raw hypothesis: ['As', 'Jehovah', 'love', 'us', ',', 'na', 'im', 'make', 'us', 'and', 'wetin', 'we', 'need', 'to', 'really', 'dey', 'happy', '.'] 2020-02-09 13:53:35,286 Source: As our loving Designer and Creator , Jehovah knows what we need in order to be truly happy , and he fills that need abundantly . 2020-02-09 13:53:35,286 Reference: Because na Jehovah make us , e know wetin go make us happy . E don even give us pass wetin we need . 2020-02-09 13:53:35,286 Hypothesis: As Jehovah love us , na im make us and wetin we need to really dey happy . 2020-02-09 13:53:35,286 Validation result (greedy) at epoch 112, step 24000: bleu: 13.91, loss: 55179.3203, ppl: 11.1293, duration: 12.2347s 2020-02-09 13:53:45,184 Epoch 112 Step: 24100 Batch Loss: 1.099728 Tokens per Sec: 21260, Lr: 0.000147 2020-02-09 13:53:55,036 Epoch 112 Step: 24200 Batch Loss: 0.993745 Tokens per Sec: 21659, Lr: 0.000147 2020-02-09 13:53:56,220 Epoch 112: total training loss 196.97 2020-02-09 13:53:56,220 EPOCH 113 2020-02-09 13:54:04,936 Epoch 113 Step: 24300 Batch Loss: 0.848847 Tokens per Sec: 21065, Lr: 0.000147 2020-02-09 13:54:14,853 Epoch 113 Step: 24400 Batch Loss: 1.102259 Tokens per Sec: 21254, Lr: 0.000147 2020-02-09 13:54:17,838 Epoch 113: total training loss 198.78 2020-02-09 13:54:17,838 EPOCH 114 2020-02-09 13:54:24,836 Epoch 114 Step: 24500 Batch Loss: 1.077271 Tokens per Sec: 21529, Lr: 0.000147 2020-02-09 13:54:34,761 Epoch 114 Step: 24600 Batch Loss: 0.907009 Tokens per Sec: 21087, Lr: 0.000147 2020-02-09 13:54:39,311 Epoch 114: total training loss 196.42 2020-02-09 13:54:39,311 EPOCH 115 2020-02-09 13:54:44,712 Epoch 115 Step: 24700 Batch Loss: 0.819712 Tokens per Sec: 21185, Lr: 0.000147 2020-02-09 13:54:54,651 Epoch 115 Step: 24800 Batch Loss: 0.818831 Tokens per Sec: 21395, Lr: 0.000147 2020-02-09 13:55:00,797 Epoch 115: total training loss 196.22 2020-02-09 13:55:00,798 EPOCH 116 2020-02-09 13:55:04,582 Epoch 116 Step: 24900 Batch Loss: 1.006718 Tokens per Sec: 21151, Lr: 0.000147 2020-02-09 13:55:14,478 Epoch 116 Step: 25000 Batch Loss: 1.004069 Tokens per Sec: 21288, Lr: 0.000147 2020-02-09 13:55:26,365 Example #0 2020-02-09 13:55:26,366 Raw source: ['Jehovah', 'did', 'not', 'do', 'that', ',', 'but', 'he', 'allowed', 'Satan', 'to', 'test', 'Job', ',', 'st@@', 'ating', ':', '“', 'Every@@', 'thing', 'that', 'he', 'has', 'is', 'in', 'your', 'hand', '.', '”'] 2020-02-09 13:55:26,366 Raw hypothesis: ['Jehovah', 'no', 'let', 'Satan', 'suffer', 'Job', '.', 'But', 'e', 'let', 'am', 'suffer', 'Job', '.', 'E', 'tell', 'am', 'sey', ':', '‘', 'Any@@', 'body', 'wey', 'get', 'power', ',', 'na', 'im', 'be', 'that', '.', '’'] 2020-02-09 13:55:26,366 Source: Jehovah did not do that , but he allowed Satan to test Job , stating : “ Everything that he has is in your hand . ” 2020-02-09 13:55:26,366 Reference: E tell am sey : ‘ Everything wey e get dey your hand . ’ 2020-02-09 13:55:26,366 Hypothesis: Jehovah no let Satan suffer Job . But e let am suffer Job . E tell am sey : ‘ Anybody wey get power , na im be that . ’ 2020-02-09 13:55:26,366 Example #1 2020-02-09 13:55:26,366 Raw source: ['Corin@@', 'na', 'said', ':', '“', 'We', 'left', 'our', 'work', 'area', 'in', 'the', 'evening', 'and', 'wal@@', 'ked', 'to', 'a', 'ra@@', 'il@@', 'way', 'st@@', 'ation', '25', 'ki@@', 'lo@@', 'me@@', 'ters', '(', '15', 'miles', ')', 'away', '.'] 2020-02-09 13:55:26,366 Raw hypothesis: ['Corin@@', 'na', ',', 'comot', 'for', 'prison', ',', 'e', 'come', 'sey', ':', '“', 'We', 'stay', 'there', 'for', 'where', 'we', 'dey', 'stay', '.', 'We', 'waka', 'comot', 'go', 'where', 'dem', 'dey', 'call', 'ra@@', 'ki@@', 'lo@@', 'me@@', 'ters', '(', '15', 'km', ')', '.'] 2020-02-09 13:55:26,366 Source: Corinna said : “ We left our work area in the evening and walked to a railway station 25 kilometers ( 15 miles ) away . 2020-02-09 13:55:26,366 Reference: Corinna talk sey : “ We comot for where we dey work for evening come trek go where people dey enter train wey be 25 kilometer ( 15 miles ) from where the farm dey . 2020-02-09 13:55:26,366 Hypothesis: Corinna , comot for prison , e come sey : “ We stay there for where we dey stay . We waka comot go where dem dey call rakilometers ( 15 km ) . 2020-02-09 13:55:26,366 Example #2 2020-02-09 13:55:26,366 Raw source: ['Ro@@', 'man@@', 'tic', 'love', '(', 'e@@', 'ʹ@@', 'ro@@', 's', ')', 'brings', 'delight', ',', 'and', 'love', 'for', 'family', '(', 'st@@', 'or@@', '·@@', 'ge@@', 'ʹ', ')', 'is', 'vital', 'when', 'children', 'enter', 'the', 'picture', '.'] 2020-02-09 13:55:26,366 Raw hypothesis: ['We', 'like', 'to', 'dey', 'wear', 'love', ',', 'and', 'we', 'dey', 'enjoy', 'our', 'family', 'pass', 'before', '.'] 2020-02-09 13:55:26,366 Source: Romantic love ( eʹros ) brings delight , and love for family ( stor·geʹ ) is vital when children enter the picture . 2020-02-09 13:55:26,367 Reference: ( 1 ) Love wey friend get for each other ( Greek , phi·liʹa ) ; ( 2 ) love wey man and woman get for each other ( eʹros ) ; ( 3 ) love wey people for family get for each other ( stor·geʹ ) . 2020-02-09 13:55:26,367 Hypothesis: We like to dey wear love , and we dey enjoy our family pass before . 2020-02-09 13:55:26,367 Example #3 2020-02-09 13:55:26,367 Raw source: ['As', 'our', 'loving', 'De@@', 'sign@@', 'er', 'and', 'Creator', ',', 'Jehovah', 'knows', 'what', 'we', 'need', 'in', 'order', 'to', 'be', 'truly', 'happy', ',', 'and', 'he', 'f@@', 'ill@@', 's', 'that', 'need', 'ab@@', 'un@@', 'd@@', 'an@@', 'tly', '.'] 2020-02-09 13:55:26,367 Raw hypothesis: ['As', 'Jehovah', 'love', 'us', ',', 'na', 'im', 'make', 'us', 'dey', 'really', 'happy', 'and', 'e', 'know', 'wetin', 'we', 'need', '.'] 2020-02-09 13:55:26,367 Source: As our loving Designer and Creator , Jehovah knows what we need in order to be truly happy , and he fills that need abundantly . 2020-02-09 13:55:26,367 Reference: Because na Jehovah make us , e know wetin go make us happy . E don even give us pass wetin we need . 2020-02-09 13:55:26,367 Hypothesis: As Jehovah love us , na im make us dey really happy and e know wetin we need . 2020-02-09 13:55:26,367 Validation result (greedy) at epoch 116, step 25000: bleu: 14.03, loss: 55375.5195, ppl: 11.2250, duration: 11.8887s 2020-02-09 13:55:34,094 Epoch 116: total training loss 195.01 2020-02-09 13:55:34,095 EPOCH 117 2020-02-09 13:55:36,312 Epoch 117 Step: 25100 Batch Loss: 0.982647 Tokens per Sec: 20719, Lr: 0.000147 2020-02-09 13:55:46,223 Epoch 117 Step: 25200 Batch Loss: 1.044865 Tokens per Sec: 21176, Lr: 0.000147 2020-02-09 13:55:55,563 Epoch 117: total training loss 193.82 2020-02-09 13:55:55,563 EPOCH 118 2020-02-09 13:55:56,208 Epoch 118 Step: 25300 Batch Loss: 0.924655 Tokens per Sec: 20524, Lr: 0.000147 2020-02-09 13:56:06,103 Epoch 118 Step: 25400 Batch Loss: 0.868301 Tokens per Sec: 21374, Lr: 0.000147 2020-02-09 13:56:16,158 Epoch 118 Step: 25500 Batch Loss: 1.074172 Tokens per Sec: 21530, Lr: 0.000147 2020-02-09 13:56:16,952 Epoch 118: total training loss 191.56 2020-02-09 13:56:16,953 EPOCH 119 2020-02-09 13:56:26,153 Epoch 119 Step: 25600 Batch Loss: 0.846564 Tokens per Sec: 21172, Lr: 0.000147 2020-02-09 13:56:36,067 Epoch 119 Step: 25700 Batch Loss: 1.155276 Tokens per Sec: 21148, Lr: 0.000147 2020-02-09 13:56:38,532 Epoch 119: total training loss 193.32 2020-02-09 13:56:38,532 EPOCH 120 2020-02-09 13:56:46,027 Epoch 120 Step: 25800 Batch Loss: 0.948716 Tokens per Sec: 20924, Lr: 0.000147 2020-02-09 13:56:55,976 Epoch 120 Step: 25900 Batch Loss: 1.005189 Tokens per Sec: 21534, Lr: 0.000147 2020-02-09 13:57:00,048 Epoch 120: total training loss 191.30 2020-02-09 13:57:00,048 EPOCH 121 2020-02-09 13:57:05,941 Epoch 121 Step: 26000 Batch Loss: 0.358310 Tokens per Sec: 21418, Lr: 0.000147 2020-02-09 13:57:18,531 Example #0 2020-02-09 13:57:18,532 Raw source: ['Jehovah', 'did', 'not', 'do', 'that', ',', 'but', 'he', 'allowed', 'Satan', 'to', 'test', 'Job', ',', 'st@@', 'ating', ':', '“', 'Every@@', 'thing', 'that', 'he', 'has', 'is', 'in', 'your', 'hand', '.', '”'] 2020-02-09 13:57:18,532 Raw hypothesis: ['Jehovah', 'no', 'let', 'Satan', 'suffer', 'Job', '.', 'But', 'e', 'let', 'am', 'know', 'sey', ':', '‘', 'Any@@', 'body', 'wey', 'e', 'want', 'do', ',', 'na', 'im', 'dey', 'give', 'am', 'hand', '.', '’'] 2020-02-09 13:57:18,532 Source: Jehovah did not do that , but he allowed Satan to test Job , stating : “ Everything that he has is in your hand . ” 2020-02-09 13:57:18,532 Reference: E tell am sey : ‘ Everything wey e get dey your hand . ’ 2020-02-09 13:57:18,532 Hypothesis: Jehovah no let Satan suffer Job . But e let am know sey : ‘ Anybody wey e want do , na im dey give am hand . ’ 2020-02-09 13:57:18,532 Example #1 2020-02-09 13:57:18,532 Raw source: ['Corin@@', 'na', 'said', ':', '“', 'We', 'left', 'our', 'work', 'area', 'in', 'the', 'evening', 'and', 'wal@@', 'ked', 'to', 'a', 'ra@@', 'il@@', 'way', 'st@@', 'ation', '25', 'ki@@', 'lo@@', 'me@@', 'ters', '(', '15', 'miles', ')', 'away', '.'] 2020-02-09 13:57:18,532 Raw hypothesis: ['Corin@@', 'na', ',', 'wey', 'come', 'from', 'prison', ',', 'talk', 'sey', ':', '“', 'We', 'comot', 'for', 'where', 'we', 'dey', 'stay', '.', 'We', 'come', 'comot', 'go', 'where', 'dem', 'dey', 'call', 'ra@@', 'ki@@', 'lo@@', 'me@@', 'ters', '(', '15', 'km', ')', '.'] 2020-02-09 13:57:18,532 Source: Corinna said : “ We left our work area in the evening and walked to a railway station 25 kilometers ( 15 miles ) away . 2020-02-09 13:57:18,532 Reference: Corinna talk sey : “ We comot for where we dey work for evening come trek go where people dey enter train wey be 25 kilometer ( 15 miles ) from where the farm dey . 2020-02-09 13:57:18,532 Hypothesis: Corinna , wey come from prison , talk sey : “ We comot for where we dey stay . We come comot go where dem dey call rakilometers ( 15 km ) . 2020-02-09 13:57:18,532 Example #2 2020-02-09 13:57:18,532 Raw source: ['Ro@@', 'man@@', 'tic', 'love', '(', 'e@@', 'ʹ@@', 'ro@@', 's', ')', 'brings', 'delight', ',', 'and', 'love', 'for', 'family', '(', 'st@@', 'or@@', '·@@', 'ge@@', 'ʹ', ')', 'is', 'vital', 'when', 'children', 'enter', 'the', 'picture', '.'] 2020-02-09 13:57:18,532 Raw hypothesis: ['We', 'no', 'dey', 'show', 'love', 'play', '.', 'We', 'dey', 'enjoy', 'to', 'love', 'our', 'family', '(', '1', ')', 'love', 'dey', 'control', 'ourself', 'when', 'we', 'dey', 'chop', 'our', 'pikin', '.'] 2020-02-09 13:57:18,533 Source: Romantic love ( eʹros ) brings delight , and love for family ( stor·geʹ ) is vital when children enter the picture . 2020-02-09 13:57:18,533 Reference: ( 1 ) Love wey friend get for each other ( Greek , phi·liʹa ) ; ( 2 ) love wey man and woman get for each other ( eʹros ) ; ( 3 ) love wey people for family get for each other ( stor·geʹ ) . 2020-02-09 13:57:18,533 Hypothesis: We no dey show love play . We dey enjoy to love our family ( 1 ) love dey control ourself when we dey chop our pikin . 2020-02-09 13:57:18,533 Example #3 2020-02-09 13:57:18,533 Raw source: ['As', 'our', 'loving', 'De@@', 'sign@@', 'er', 'and', 'Creator', ',', 'Jehovah', 'knows', 'what', 'we', 'need', 'in', 'order', 'to', 'be', 'truly', 'happy', ',', 'and', 'he', 'f@@', 'ill@@', 's', 'that', 'need', 'ab@@', 'un@@', 'd@@', 'an@@', 'tly', '.'] 2020-02-09 13:57:18,533 Raw hypothesis: ['As', 'Jehovah', 'love', 'us', ',', 'na', 'im', 'make', 'us', 'fit', 'really', 'know', 'wetin', 'we', 'need', 'and', 'e', 'dey', 'happy', '.'] 2020-02-09 13:57:18,533 Source: As our loving Designer and Creator , Jehovah knows what we need in order to be truly happy , and he fills that need abundantly . 2020-02-09 13:57:18,533 Reference: Because na Jehovah make us , e know wetin go make us happy . E don even give us pass wetin we need . 2020-02-09 13:57:18,533 Hypothesis: As Jehovah love us , na im make us fit really know wetin we need and e dey happy . 2020-02-09 13:57:18,533 Validation result (greedy) at epoch 121, step 26000: bleu: 13.91, loss: 56022.5273, ppl: 11.5467, duration: 12.5917s 2020-02-09 13:57:28,520 Epoch 121 Step: 26100 Batch Loss: 0.563409 Tokens per Sec: 21045, Lr: 0.000147 2020-02-09 13:57:34,308 Epoch 121: total training loss 191.19 2020-02-09 13:57:34,309 EPOCH 122 2020-02-09 13:57:38,539 Epoch 122 Step: 26200 Batch Loss: 1.093610 Tokens per Sec: 21572, Lr: 0.000147 2020-02-09 13:57:48,594 Epoch 122 Step: 26300 Batch Loss: 0.408293 Tokens per Sec: 20788, Lr: 0.000147 2020-02-09 13:57:55,991 Epoch 122: total training loss 190.34 2020-02-09 13:57:55,991 EPOCH 123 2020-02-09 13:57:58,594 Epoch 123 Step: 26400 Batch Loss: 0.932069 Tokens per Sec: 20273, Lr: 0.000147 2020-02-09 13:58:08,571 Epoch 123 Step: 26500 Batch Loss: 0.758683 Tokens per Sec: 21504, Lr: 0.000147 2020-02-09 13:58:17,515 Epoch 123: total training loss 189.80 2020-02-09 13:58:17,515 EPOCH 124 2020-02-09 13:58:18,548 Epoch 124 Step: 26600 Batch Loss: 0.991884 Tokens per Sec: 19099, Lr: 0.000147 2020-02-09 13:58:28,482 Epoch 124 Step: 26700 Batch Loss: 0.715300 Tokens per Sec: 21201, Lr: 0.000147 2020-02-09 13:58:38,437 Epoch 124 Step: 26800 Batch Loss: 0.970540 Tokens per Sec: 21578, Lr: 0.000147 2020-02-09 13:58:39,037 Epoch 124: total training loss 188.82 2020-02-09 13:58:39,037 EPOCH 125 2020-02-09 13:58:48,432 Epoch 125 Step: 26900 Batch Loss: 0.984332 Tokens per Sec: 21287, Lr: 0.000147 2020-02-09 13:58:58,405 Epoch 125 Step: 27000 Batch Loss: 0.889066 Tokens per Sec: 21171, Lr: 0.000147 2020-02-09 13:59:11,081 Example #0 2020-02-09 13:59:11,081 Raw source: ['Jehovah', 'did', 'not', 'do', 'that', ',', 'but', 'he', 'allowed', 'Satan', 'to', 'test', 'Job', ',', 'st@@', 'ating', ':', '“', 'Every@@', 'thing', 'that', 'he', 'has', 'is', 'in', 'your', 'hand', '.', '”'] 2020-02-09 13:59:11,081 Raw hypothesis: ['Jehovah', 'no', 'let', 'Satan', 'do', 'wetin', 'e', 'no', 'like', '.', 'E', 'tell', 'Job', 'sey', ':', '‘', 'Any@@', 'body', 'wey', 'dey', 'your', 'hand', 'don', 'weak', '.', '’'] 2020-02-09 13:59:11,081 Source: Jehovah did not do that , but he allowed Satan to test Job , stating : “ Everything that he has is in your hand . ” 2020-02-09 13:59:11,081 Reference: E tell am sey : ‘ Everything wey e get dey your hand . ’ 2020-02-09 13:59:11,081 Hypothesis: Jehovah no let Satan do wetin e no like . E tell Job sey : ‘ Anybody wey dey your hand don weak . ’ 2020-02-09 13:59:11,082 Example #1 2020-02-09 13:59:11,082 Raw source: ['Corin@@', 'na', 'said', ':', '“', 'We', 'left', 'our', 'work', 'area', 'in', 'the', 'evening', 'and', 'wal@@', 'ked', 'to', 'a', 'ra@@', 'il@@', 'way', 'st@@', 'ation', '25', 'ki@@', 'lo@@', 'me@@', 'ters', '(', '15', 'miles', ')', 'away', '.'] 2020-02-09 13:59:11,082 Raw hypothesis: ['Corin@@', 'na', ',', 'wey', 'come', 'from', 'prison', ',', 'talk', 'sey', ':', '“', 'We', 'stay', 'for', 'where', 'we', 'dey', 'stay', '.', 'We', 'waka', 'comot', 'from', 'where', 'dem', 'dey', 'call', 'ra@@', 'il@@', 'or', '.', 'We', 'waka', 'comot', 'go', 'there', '.'] 2020-02-09 13:59:11,082 Source: Corinna said : “ We left our work area in the evening and walked to a railway station 25 kilometers ( 15 miles ) away . 2020-02-09 13:59:11,082 Reference: Corinna talk sey : “ We comot for where we dey work for evening come trek go where people dey enter train wey be 25 kilometer ( 15 miles ) from where the farm dey . 2020-02-09 13:59:11,082 Hypothesis: Corinna , wey come from prison , talk sey : “ We stay for where we dey stay . We waka comot from where dem dey call railor . We waka comot go there . 2020-02-09 13:59:11,082 Example #2 2020-02-09 13:59:11,082 Raw source: ['Ro@@', 'man@@', 'tic', 'love', '(', 'e@@', 'ʹ@@', 'ro@@', 's', ')', 'brings', 'delight', ',', 'and', 'love', 'for', 'family', '(', 'st@@', 'or@@', '·@@', 'ge@@', 'ʹ', ')', 'is', 'vital', 'when', 'children', 'enter', 'the', 'picture', '.'] 2020-02-09 13:59:11,082 Raw hypothesis: ['We', 'no', 'dey', 'show', 'love', 'play', 'with', 'our', 'family', '(', 'mu@@', 'c@@', '·@@', 'ga@@', 'ʹ@@', 'st@@', 'ation', ')', 'and', 'our', 'family', 'people', 'wey', 'dey', 'show', 'love', 'theirself', '.'] 2020-02-09 13:59:11,082 Source: Romantic love ( eʹros ) brings delight , and love for family ( stor·geʹ ) is vital when children enter the picture . 2020-02-09 13:59:11,082 Reference: ( 1 ) Love wey friend get for each other ( Greek , phi·liʹa ) ; ( 2 ) love wey man and woman get for each other ( eʹros ) ; ( 3 ) love wey people for family get for each other ( stor·geʹ ) . 2020-02-09 13:59:11,082 Hypothesis: We no dey show love play with our family ( muc·gaʹstation ) and our family people wey dey show love theirself . 2020-02-09 13:59:11,082 Example #3 2020-02-09 13:59:11,082 Raw source: ['As', 'our', 'loving', 'De@@', 'sign@@', 'er', 'and', 'Creator', ',', 'Jehovah', 'knows', 'what', 'we', 'need', 'in', 'order', 'to', 'be', 'truly', 'happy', ',', 'and', 'he', 'f@@', 'ill@@', 's', 'that', 'need', 'ab@@', 'un@@', 'd@@', 'an@@', 'tly', '.'] 2020-02-09 13:59:11,082 Raw hypothesis: ['As', 'Jehovah', 'love', 'us', ',', 'e', 'know', 'wetin', 'we', 'need', 'and', 'wetin', 'we', 'really', 'need', '.'] 2020-02-09 13:59:11,082 Source: As our loving Designer and Creator , Jehovah knows what we need in order to be truly happy , and he fills that need abundantly . 2020-02-09 13:59:11,083 Reference: Because na Jehovah make us , e know wetin go make us happy . E don even give us pass wetin we need . 2020-02-09 13:59:11,083 Hypothesis: As Jehovah love us , e know wetin we need and wetin we really need . 2020-02-09 13:59:11,083 Validation result (greedy) at epoch 125, step 27000: bleu: 14.00, loss: 56223.9844, ppl: 11.6487, duration: 12.6771s 2020-02-09 13:59:13,278 Epoch 125: total training loss 187.16 2020-02-09 13:59:13,279 EPOCH 126 2020-02-09 13:59:21,195 Epoch 126 Step: 27100 Batch Loss: 0.721855 Tokens per Sec: 21094, Lr: 0.000147 2020-02-09 13:59:31,130 Epoch 126 Step: 27200 Batch Loss: 1.002054 Tokens per Sec: 21434, Lr: 0.000147 2020-02-09 13:59:34,703 Epoch 126: total training loss 186.39 2020-02-09 13:59:34,703 EPOCH 127 2020-02-09 13:59:41,080 Epoch 127 Step: 27300 Batch Loss: 0.944836 Tokens per Sec: 21220, Lr: 0.000147 2020-02-09 13:59:50,994 Epoch 127 Step: 27400 Batch Loss: 0.957453 Tokens per Sec: 21689, Lr: 0.000147 2020-02-09 13:59:56,110 Epoch 127: total training loss 185.56 2020-02-09 13:59:56,110 EPOCH 128 2020-02-09 14:00:01,064 Epoch 128 Step: 27500 Batch Loss: 0.765037 Tokens per Sec: 21447, Lr: 0.000147 2020-02-09 14:00:10,996 Epoch 128 Step: 27600 Batch Loss: 0.911300 Tokens per Sec: 21127, Lr: 0.000147 2020-02-09 14:00:17,688 Epoch 128: total training loss 185.93 2020-02-09 14:00:17,688 EPOCH 129 2020-02-09 14:00:21,040 Epoch 129 Step: 27700 Batch Loss: 1.015439 Tokens per Sec: 20892, Lr: 0.000147 2020-02-09 14:00:31,050 Epoch 129 Step: 27800 Batch Loss: 1.008666 Tokens per Sec: 21374, Lr: 0.000147 2020-02-09 14:00:39,172 Epoch 129: total training loss 184.66 2020-02-09 14:00:39,172 EPOCH 130 2020-02-09 14:00:41,003 Epoch 130 Step: 27900 Batch Loss: 0.991815 Tokens per Sec: 21419, Lr: 0.000147 2020-02-09 14:00:50,930 Epoch 130 Step: 28000 Batch Loss: 0.447445 Tokens per Sec: 21173, Lr: 0.000147 2020-02-09 14:01:03,622 Example #0 2020-02-09 14:01:03,622 Raw source: ['Jehovah', 'did', 'not', 'do', 'that', ',', 'but', 'he', 'allowed', 'Satan', 'to', 'test', 'Job', ',', 'st@@', 'ating', ':', '“', 'Every@@', 'thing', 'that', 'he', 'has', 'is', 'in', 'your', 'hand', '.', '”'] 2020-02-09 14:01:03,622 Raw hypothesis: ['Jehovah', 'no', 'let', 'Satan', 'do', 'wetin', 'e', 'no', 'like', '.', 'E', 'tell', 'Job', 'sey', ':', '‘', 'Any@@', 'body', 'wey', 'dey', 'your', 'hand', 'don', 'turn', 'to', 'your', 'hand', '.', '’'] 2020-02-09 14:01:03,622 Source: Jehovah did not do that , but he allowed Satan to test Job , stating : “ Everything that he has is in your hand . ” 2020-02-09 14:01:03,622 Reference: E tell am sey : ‘ Everything wey e get dey your hand . ’ 2020-02-09 14:01:03,622 Hypothesis: Jehovah no let Satan do wetin e no like . E tell Job sey : ‘ Anybody wey dey your hand don turn to your hand . ’ 2020-02-09 14:01:03,622 Example #1 2020-02-09 14:01:03,622 Raw source: ['Corin@@', 'na', 'said', ':', '“', 'We', 'left', 'our', 'work', 'area', 'in', 'the', 'evening', 'and', 'wal@@', 'ked', 'to', 'a', 'ra@@', 'il@@', 'way', 'st@@', 'ation', '25', 'ki@@', 'lo@@', 'me@@', 'ters', '(', '15', 'miles', ')', 'away', '.'] 2020-02-09 14:01:03,622 Raw hypothesis: ['Corin@@', 'na', ',', 'wey', 'come', 'from', 'prison', ',', 'talk', 'sey', ':', '“', 'We', 'stay', 'for', 'where', 'we', 'dey', 'stay', '.', 'We', 'waka', 'for', 'there', 'and', 'we', 'waka', 'comot', 'go', 'where', 'dem', 'dey', 'call', 'ra@@', 'ki@@', 'lo@@', 'me@@', 'ters', '(', '15', 'km', ')', '.'] 2020-02-09 14:01:03,622 Source: Corinna said : “ We left our work area in the evening and walked to a railway station 25 kilometers ( 15 miles ) away . 2020-02-09 14:01:03,622 Reference: Corinna talk sey : “ We comot for where we dey work for evening come trek go where people dey enter train wey be 25 kilometer ( 15 miles ) from where the farm dey . 2020-02-09 14:01:03,623 Hypothesis: Corinna , wey come from prison , talk sey : “ We stay for where we dey stay . We waka for there and we waka comot go where dem dey call rakilometers ( 15 km ) . 2020-02-09 14:01:03,623 Example #2 2020-02-09 14:01:03,623 Raw source: ['Ro@@', 'man@@', 'tic', 'love', '(', 'e@@', 'ʹ@@', 'ro@@', 's', ')', 'brings', 'delight', ',', 'and', 'love', 'for', 'family', '(', 'st@@', 'or@@', '·@@', 'ge@@', 'ʹ', ')', 'is', 'vital', 'when', 'children', 'enter', 'the', 'picture', '.'] 2020-02-09 14:01:03,623 Raw hypothesis: ['We', 'no', 'dey', 'show', 'this', 'kind', 'love', 'play', '.', 'We', 'dey', 'enjoy', 'to', 'show', 'dem', 'love', ',', 'and', 'we', 'dey', 'show', 'dem', 'how', 'their', 'pikin', 'dey', 'dress', '.'] 2020-02-09 14:01:03,623 Source: Romantic love ( eʹros ) brings delight , and love for family ( stor·geʹ ) is vital when children enter the picture . 2020-02-09 14:01:03,623 Reference: ( 1 ) Love wey friend get for each other ( Greek , phi·liʹa ) ; ( 2 ) love wey man and woman get for each other ( eʹros ) ; ( 3 ) love wey people for family get for each other ( stor·geʹ ) . 2020-02-09 14:01:03,623 Hypothesis: We no dey show this kind love play . We dey enjoy to show dem love , and we dey show dem how their pikin dey dress . 2020-02-09 14:01:03,623 Example #3 2020-02-09 14:01:03,623 Raw source: ['As', 'our', 'loving', 'De@@', 'sign@@', 'er', 'and', 'Creator', ',', 'Jehovah', 'knows', 'what', 'we', 'need', 'in', 'order', 'to', 'be', 'truly', 'happy', ',', 'and', 'he', 'f@@', 'ill@@', 's', 'that', 'need', 'ab@@', 'un@@', 'd@@', 'an@@', 'tly', '.'] 2020-02-09 14:01:03,623 Raw hypothesis: ['As', 'Jehovah', 'love', 'us', 'and', 'na', 'im', 'make', 'us', ',', 'e', 'know', 'wetin', 'we', 'need', 'and', 'e', 'dey', 'really', 'make', 'us', 'happy', '.'] 2020-02-09 14:01:03,623 Source: As our loving Designer and Creator , Jehovah knows what we need in order to be truly happy , and he fills that need abundantly . 2020-02-09 14:01:03,623 Reference: Because na Jehovah make us , e know wetin go make us happy . E don even give us pass wetin we need . 2020-02-09 14:01:03,623 Hypothesis: As Jehovah love us and na im make us , e know wetin we need and e dey really make us happy . 2020-02-09 14:01:03,623 Validation result (greedy) at epoch 130, step 28000: bleu: 13.99, loss: 56479.9727, ppl: 11.7797, duration: 12.6928s 2020-02-09 14:01:13,502 Epoch 130: total training loss 185.09 2020-02-09 14:01:13,502 EPOCH 131 2020-02-09 14:01:13,650 Epoch 131 Step: 28100 Batch Loss: 0.641208 Tokens per Sec: 12890, Lr: 0.000103 2020-02-09 14:01:23,705 Epoch 131 Step: 28200 Batch Loss: 0.602730 Tokens per Sec: 21146, Lr: 0.000103 2020-02-09 14:01:33,758 Epoch 131 Step: 28300 Batch Loss: 0.435414 Tokens per Sec: 20979, Lr: 0.000103 2020-02-09 14:01:35,267 Epoch 131: total training loss 180.13 2020-02-09 14:01:35,267 EPOCH 132 2020-02-09 14:01:43,812 Epoch 132 Step: 28400 Batch Loss: 1.007265 Tokens per Sec: 21338, Lr: 0.000103 2020-02-09 14:01:53,749 Epoch 132 Step: 28500 Batch Loss: 0.944787 Tokens per Sec: 21310, Lr: 0.000103 2020-02-09 14:01:56,827 Epoch 132: total training loss 179.81 2020-02-09 14:01:56,827 EPOCH 133 2020-02-09 14:02:03,730 Epoch 133 Step: 28600 Batch Loss: 0.863838 Tokens per Sec: 20838, Lr: 0.000103 2020-02-09 14:02:13,794 Epoch 133 Step: 28700 Batch Loss: 0.739012 Tokens per Sec: 21163, Lr: 0.000103 2020-02-09 14:02:18,407 Epoch 133: total training loss 178.48 2020-02-09 14:02:18,407 EPOCH 134 2020-02-09 14:02:23,828 Epoch 134 Step: 28800 Batch Loss: 0.753290 Tokens per Sec: 20431, Lr: 0.000103 2020-02-09 14:02:33,765 Epoch 134 Step: 28900 Batch Loss: 0.892096 Tokens per Sec: 21273, Lr: 0.000103 2020-02-09 14:02:40,117 Epoch 134: total training loss 179.89 2020-02-09 14:02:40,117 EPOCH 135 2020-02-09 14:02:43,710 Epoch 135 Step: 29000 Batch Loss: 0.874406 Tokens per Sec: 20875, Lr: 0.000103 2020-02-09 14:02:56,862 Example #0 2020-02-09 14:02:56,862 Raw source: ['Jehovah', 'did', 'not', 'do', 'that', ',', 'but', 'he', 'allowed', 'Satan', 'to', 'test', 'Job', ',', 'st@@', 'ating', ':', '“', 'Every@@', 'thing', 'that', 'he', 'has', 'is', 'in', 'your', 'hand', '.', '”'] 2020-02-09 14:02:56,862 Raw hypothesis: ['Jehovah', 'no', 'let', 'Satan', 'do', 'wetin', 'e', 'no', 'like', '.', 'E', 'tell', 'Job', 'sey', ':', '‘', 'Any@@', 'body', 'wey', 'dey', 'your', 'hand', 'don', 'already', 'talk', 'sey', 'e', 'don', 'already', 'dey', 'your', 'hand', '.', '’'] 2020-02-09 14:02:56,862 Source: Jehovah did not do that , but he allowed Satan to test Job , stating : “ Everything that he has is in your hand . ” 2020-02-09 14:02:56,862 Reference: E tell am sey : ‘ Everything wey e get dey your hand . ’ 2020-02-09 14:02:56,862 Hypothesis: Jehovah no let Satan do wetin e no like . E tell Job sey : ‘ Anybody wey dey your hand don already talk sey e don already dey your hand . ’ 2020-02-09 14:02:56,862 Example #1 2020-02-09 14:02:56,862 Raw source: ['Corin@@', 'na', 'said', ':', '“', 'We', 'left', 'our', 'work', 'area', 'in', 'the', 'evening', 'and', 'wal@@', 'ked', 'to', 'a', 'ra@@', 'il@@', 'way', 'st@@', 'ation', '25', 'ki@@', 'lo@@', 'me@@', 'ters', '(', '15', 'miles', ')', 'away', '.'] 2020-02-09 14:02:56,862 Raw hypothesis: ['Corin@@', 'na', ',', 'wey', 'come', 'from', 'prison', ',', 'talk', 'sey', ':', '“', 'We', 'comot', 'for', 'where', 'we', 'dey', 'stay', ',', 'and', 'we', 'dey', 'stay', 'there', 'for', 'where', 'dem', 'dey', 'call', 'ra@@', 'ki@@', 'lo@@', 'me@@', 'ters', '(', '15', 'km', ')', '.'] 2020-02-09 14:02:56,862 Source: Corinna said : “ We left our work area in the evening and walked to a railway station 25 kilometers ( 15 miles ) away . 2020-02-09 14:02:56,863 Reference: Corinna talk sey : “ We comot for where we dey work for evening come trek go where people dey enter train wey be 25 kilometer ( 15 miles ) from where the farm dey . 2020-02-09 14:02:56,863 Hypothesis: Corinna , wey come from prison , talk sey : “ We comot for where we dey stay , and we dey stay there for where dem dey call rakilometers ( 15 km ) . 2020-02-09 14:02:56,863 Example #2 2020-02-09 14:02:56,863 Raw source: ['Ro@@', 'man@@', 'tic', 'love', '(', 'e@@', 'ʹ@@', 'ro@@', 's', ')', 'brings', 'delight', ',', 'and', 'love', 'for', 'family', '(', 'st@@', 'or@@', '·@@', 'ge@@', 'ʹ', ')', 'is', 'vital', 'when', 'children', 'enter', 'the', 'picture', '.'] 2020-02-09 14:02:56,863 Raw hypothesis: ['We', 'dey', 'show', 'love', 'play', ',', 'and', 'we', 'dey', 'enjoy', 'our', 'family', '.', 'We', 'dey', 'enjoy', 'to', 'love', 'ourself', 'when', 'we', 'dey', 'teach', 'our', 'children', 'Bible', 'student', '.'] 2020-02-09 14:02:56,863 Source: Romantic love ( eʹros ) brings delight , and love for family ( stor·geʹ ) is vital when children enter the picture . 2020-02-09 14:02:56,863 Reference: ( 1 ) Love wey friend get for each other ( Greek , phi·liʹa ) ; ( 2 ) love wey man and woman get for each other ( eʹros ) ; ( 3 ) love wey people for family get for each other ( stor·geʹ ) . 2020-02-09 14:02:56,863 Hypothesis: We dey show love play , and we dey enjoy our family . We dey enjoy to love ourself when we dey teach our children Bible student . 2020-02-09 14:02:56,863 Example #3 2020-02-09 14:02:56,863 Raw source: ['As', 'our', 'loving', 'De@@', 'sign@@', 'er', 'and', 'Creator', ',', 'Jehovah', 'knows', 'what', 'we', 'need', 'in', 'order', 'to', 'be', 'truly', 'happy', ',', 'and', 'he', 'f@@', 'ill@@', 's', 'that', 'need', 'ab@@', 'un@@', 'd@@', 'an@@', 'tly', '.'] 2020-02-09 14:02:56,863 Raw hypothesis: ['As', 'Jehovah', 'love', 'us', ',', 'na', 'im', 'make', 'us', 'know', 'wetin', 'we', 'need', 'and', 'wetin', 'we', 'no', 'fit', 'do', '.'] 2020-02-09 14:02:56,863 Source: As our loving Designer and Creator , Jehovah knows what we need in order to be truly happy , and he fills that need abundantly . 2020-02-09 14:02:56,863 Reference: Because na Jehovah make us , e know wetin go make us happy . E don even give us pass wetin we need . 2020-02-09 14:02:56,863 Hypothesis: As Jehovah love us , na im make us know wetin we need and wetin we no fit do . 2020-02-09 14:02:56,863 Validation result (greedy) at epoch 135, step 29000: bleu: 14.12, loss: 56550.9883, ppl: 11.8162, duration: 13.1529s 2020-02-09 14:03:06,791 Epoch 135 Step: 29100 Batch Loss: 0.807884 Tokens per Sec: 21170, Lr: 0.000103 2020-02-09 14:03:14,881 Epoch 135: total training loss 178.83 2020-02-09 14:03:14,881 EPOCH 136 2020-02-09 14:03:16,803 Epoch 136 Step: 29200 Batch Loss: 0.718593 Tokens per Sec: 21128, Lr: 0.000103 2020-02-09 14:03:26,802 Epoch 136 Step: 29300 Batch Loss: 0.791574 Tokens per Sec: 20882, Lr: 0.000103 2020-02-09 14:03:36,667 Epoch 136: total training loss 178.04 2020-02-09 14:03:36,667 EPOCH 137 2020-02-09 14:03:36,811 Epoch 137 Step: 29400 Batch Loss: 0.804677 Tokens per Sec: 16783, Lr: 0.000103 2020-02-09 14:03:46,736 Epoch 137 Step: 29500 Batch Loss: 0.883674 Tokens per Sec: 21302, Lr: 0.000103 2020-02-09 14:03:56,702 Epoch 137 Step: 29600 Batch Loss: 0.312471 Tokens per Sec: 21321, Lr: 0.000103 2020-02-09 14:03:58,207 Epoch 137: total training loss 176.31 2020-02-09 14:03:58,207 EPOCH 138 2020-02-09 14:04:06,750 Epoch 138 Step: 29700 Batch Loss: 0.816679 Tokens per Sec: 20878, Lr: 0.000103 2020-02-09 14:04:16,690 Epoch 138 Step: 29800 Batch Loss: 0.350733 Tokens per Sec: 21533, Lr: 0.000103 2020-02-09 14:04:19,777 Epoch 138: total training loss 175.87 2020-02-09 14:04:19,778 EPOCH 139 2020-02-09 14:04:26,668 Epoch 139 Step: 29900 Batch Loss: 0.878610 Tokens per Sec: 20752, Lr: 0.000103 2020-02-09 14:04:36,582 Epoch 139 Step: 30000 Batch Loss: 0.955152 Tokens per Sec: 21934, Lr: 0.000103 2020-02-09 14:04:48,774 Example #0 2020-02-09 14:04:48,774 Raw source: ['Jehovah', 'did', 'not', 'do', 'that', ',', 'but', 'he', 'allowed', 'Satan', 'to', 'test', 'Job', ',', 'st@@', 'ating', ':', '“', 'Every@@', 'thing', 'that', 'he', 'has', 'is', 'in', 'your', 'hand', '.', '”'] 2020-02-09 14:04:48,774 Raw hypothesis: ['Jehovah', 'no', 'let', 'Satan', 'do', 'wetin', 'e', 'no', 'like', '.', 'E', 'tell', 'Job', 'sey', ':', '‘', 'Any@@', 'body', 'wey', 'dey', 'do', 'wetin', 'e', 'want', ',', 'na', 'im', 'get', 'the', 'right', 'hand', 'wey', 'you', 'get', '.', '’'] 2020-02-09 14:04:48,774 Source: Jehovah did not do that , but he allowed Satan to test Job , stating : “ Everything that he has is in your hand . ” 2020-02-09 14:04:48,774 Reference: E tell am sey : ‘ Everything wey e get dey your hand . ’ 2020-02-09 14:04:48,774 Hypothesis: Jehovah no let Satan do wetin e no like . E tell Job sey : ‘ Anybody wey dey do wetin e want , na im get the right hand wey you get . ’ 2020-02-09 14:04:48,774 Example #1 2020-02-09 14:04:48,774 Raw source: ['Corin@@', 'na', 'said', ':', '“', 'We', 'left', 'our', 'work', 'area', 'in', 'the', 'evening', 'and', 'wal@@', 'ked', 'to', 'a', 'ra@@', 'il@@', 'way', 'st@@', 'ation', '25', 'ki@@', 'lo@@', 'me@@', 'ters', '(', '15', 'miles', ')', 'away', '.'] 2020-02-09 14:04:48,774 Raw hypothesis: ['Corin@@', 'na', ',', 'wey', 'come', 'from', 'prison', ',', 'talk', 'sey', ':', '“', 'We', 'comot', 'for', 'where', 'we', 'dey', 'stay', '.', 'We', 'come', 'comot', 'from', 'where', 'we', 'dey', 'stay', '.', 'We', 'dey', 'there', 'to', 'go', 'preach', 'for', 'where', 'dem', 'dey', 'call', 'ra@@', 'ki@@', 'lo@@', 'me@@', 'ters', '(', '15', 'km', ')', '.'] 2020-02-09 14:04:48,775 Source: Corinna said : “ We left our work area in the evening and walked to a railway station 25 kilometers ( 15 miles ) away . 2020-02-09 14:04:48,775 Reference: Corinna talk sey : “ We comot for where we dey work for evening come trek go where people dey enter train wey be 25 kilometer ( 15 miles ) from where the farm dey . 2020-02-09 14:04:48,775 Hypothesis: Corinna , wey come from prison , talk sey : “ We comot for where we dey stay . We come comot from where we dey stay . We dey there to go preach for where dem dey call rakilometers ( 15 km ) . 2020-02-09 14:04:48,775 Example #2 2020-02-09 14:04:48,775 Raw source: ['Ro@@', 'man@@', 'tic', 'love', '(', 'e@@', 'ʹ@@', 'ro@@', 's', ')', 'brings', 'delight', ',', 'and', 'love', 'for', 'family', '(', 'st@@', 'or@@', '·@@', 'ge@@', 'ʹ', ')', 'is', 'vital', 'when', 'children', 'enter', 'the', 'picture', '.'] 2020-02-09 14:04:48,775 Raw hypothesis: ['We', 'no', 'dey', 'show', 'love', 'play', '.', 'We', 'dey', 'enjoy', 'to', 'love', 'our', 'family', '(', '1', ')', 'love', 'ourself', 'when', 'we', 'dey', 'show', 'dem', 'love', '.'] 2020-02-09 14:04:48,775 Source: Romantic love ( eʹros ) brings delight , and love for family ( stor·geʹ ) is vital when children enter the picture . 2020-02-09 14:04:48,775 Reference: ( 1 ) Love wey friend get for each other ( Greek , phi·liʹa ) ; ( 2 ) love wey man and woman get for each other ( eʹros ) ; ( 3 ) love wey people for family get for each other ( stor·geʹ ) . 2020-02-09 14:04:48,775 Hypothesis: We no dey show love play . We dey enjoy to love our family ( 1 ) love ourself when we dey show dem love . 2020-02-09 14:04:48,775 Example #3 2020-02-09 14:04:48,775 Raw source: ['As', 'our', 'loving', 'De@@', 'sign@@', 'er', 'and', 'Creator', ',', 'Jehovah', 'knows', 'what', 'we', 'need', 'in', 'order', 'to', 'be', 'truly', 'happy', ',', 'and', 'he', 'f@@', 'ill@@', 's', 'that', 'need', 'ab@@', 'un@@', 'd@@', 'an@@', 'tly', '.'] 2020-02-09 14:04:48,775 Raw hypothesis: ['As', 'Jehovah', 'love', 'us', ',', 'na', 'im', 'make', 'us', 'and', 'e', 'know', 'wetin', 'we', 'really', 'need', 'and', 'e', 'dey', 'make', 'us', 'happy', '.'] 2020-02-09 14:04:48,775 Source: As our loving Designer and Creator , Jehovah knows what we need in order to be truly happy , and he fills that need abundantly . 2020-02-09 14:04:48,775 Reference: Because na Jehovah make us , e know wetin go make us happy . E don even give us pass wetin we need . 2020-02-09 14:04:48,775 Hypothesis: As Jehovah love us , na im make us and e know wetin we really need and e dey make us happy . 2020-02-09 14:04:48,775 Validation result (greedy) at epoch 139, step 30000: bleu: 13.82, loss: 56852.4688, ppl: 11.9728, duration: 12.1930s 2020-02-09 14:04:53,432 Epoch 139: total training loss 175.61 2020-02-09 14:04:53,432 EPOCH 140 2020-02-09 14:04:58,750 Epoch 140 Step: 30100 Batch Loss: 0.935695 Tokens per Sec: 21598, Lr: 0.000103 2020-02-09 14:05:08,709 Epoch 140 Step: 30200 Batch Loss: 0.835252 Tokens per Sec: 21088, Lr: 0.000103 2020-02-09 14:05:14,923 Epoch 140: total training loss 174.31 2020-02-09 14:05:14,924 EPOCH 141 2020-02-09 14:05:18,714 Epoch 141 Step: 30300 Batch Loss: 0.816787 Tokens per Sec: 21864, Lr: 0.000103 2020-02-09 14:05:28,605 Epoch 141 Step: 30400 Batch Loss: 0.801985 Tokens per Sec: 21024, Lr: 0.000103 2020-02-09 14:05:36,393 Epoch 141: total training loss 175.19 2020-02-09 14:05:36,393 EPOCH 142 2020-02-09 14:05:38,499 Epoch 142 Step: 30500 Batch Loss: 0.947238 Tokens per Sec: 20245, Lr: 0.000103 2020-02-09 14:05:48,413 Epoch 142 Step: 30600 Batch Loss: 0.794962 Tokens per Sec: 21181, Lr: 0.000103 2020-02-09 14:05:57,739 Epoch 142: total training loss 173.71 2020-02-09 14:05:57,739 EPOCH 143 2020-02-09 14:05:58,381 Epoch 143 Step: 30700 Batch Loss: 0.692229 Tokens per Sec: 21088, Lr: 0.000103 2020-02-09 14:06:08,357 Epoch 143 Step: 30800 Batch Loss: 0.856696 Tokens per Sec: 21133, Lr: 0.000103 2020-02-09 14:06:18,352 Epoch 143 Step: 30900 Batch Loss: 1.012233 Tokens per Sec: 21072, Lr: 0.000103 2020-02-09 14:06:19,347 Epoch 143: total training loss 172.81 2020-02-09 14:06:19,347 EPOCH 144 2020-02-09 14:06:28,345 Epoch 144 Step: 31000 Batch Loss: 1.026194 Tokens per Sec: 21379, Lr: 0.000103 2020-02-09 14:06:40,857 Example #0 2020-02-09 14:06:40,858 Raw source: ['Jehovah', 'did', 'not', 'do', 'that', ',', 'but', 'he', 'allowed', 'Satan', 'to', 'test', 'Job', ',', 'st@@', 'ating', ':', '“', 'Every@@', 'thing', 'that', 'he', 'has', 'is', 'in', 'your', 'hand', '.', '”'] 2020-02-09 14:06:40,858 Raw hypothesis: ['Jehovah', 'no', 'let', 'Satan', 'do', 'wetin', 'e', 'no', 'like', '.', 'E', 'tell', 'Job', 'sey', ':', '‘', 'Any@@', 'body', 'wey', 'dey', 'do', 'wetin', 'e', 'want', ',', 'na', 'im', 'be', 'your', 'hand', '.', '’'] 2020-02-09 14:06:40,858 Source: Jehovah did not do that , but he allowed Satan to test Job , stating : “ Everything that he has is in your hand . ” 2020-02-09 14:06:40,858 Reference: E tell am sey : ‘ Everything wey e get dey your hand . ’ 2020-02-09 14:06:40,858 Hypothesis: Jehovah no let Satan do wetin e no like . E tell Job sey : ‘ Anybody wey dey do wetin e want , na im be your hand . ’ 2020-02-09 14:06:40,858 Example #1 2020-02-09 14:06:40,858 Raw source: ['Corin@@', 'na', 'said', ':', '“', 'We', 'left', 'our', 'work', 'area', 'in', 'the', 'evening', 'and', 'wal@@', 'ked', 'to', 'a', 'ra@@', 'il@@', 'way', 'st@@', 'ation', '25', 'ki@@', 'lo@@', 'me@@', 'ters', '(', '15', 'miles', ')', 'away', '.'] 2020-02-09 14:06:40,858 Raw hypothesis: ['Corin@@', 'na', ',', 'wey', 'come', 'from', 'prison', ',', 'talk', 'sey', ':', '“', 'We', 'comot', 'for', 'where', 'we', 'dey', 'stay', ',', 'and', 'we', 'dey', 'stay', 'there', 'for', '25', 'ki@@', 'lo@@', 'me@@', 'ters', '(', '15', 'km', ')', 'go', 'there', '.'] 2020-02-09 14:06:40,858 Source: Corinna said : “ We left our work area in the evening and walked to a railway station 25 kilometers ( 15 miles ) away . 2020-02-09 14:06:40,858 Reference: Corinna talk sey : “ We comot for where we dey work for evening come trek go where people dey enter train wey be 25 kilometer ( 15 miles ) from where the farm dey . 2020-02-09 14:06:40,858 Hypothesis: Corinna , wey come from prison , talk sey : “ We comot for where we dey stay , and we dey stay there for 25 kilometers ( 15 km ) go there . 2020-02-09 14:06:40,859 Example #2 2020-02-09 14:06:40,859 Raw source: ['Ro@@', 'man@@', 'tic', 'love', '(', 'e@@', 'ʹ@@', 'ro@@', 's', ')', 'brings', 'delight', ',', 'and', 'love', 'for', 'family', '(', 'st@@', 'or@@', '·@@', 'ge@@', 'ʹ', ')', 'is', 'vital', 'when', 'children', 'enter', 'the', 'picture', '.'] 2020-02-09 14:06:40,859 Raw hypothesis: ['We', 'no', 'dey', 'show', 'our', 'family', 'love', ',', 'and', 'we', 'dey', 'enjoy', 'each', 'other', '.', 'We', 'dey', 'show', 'this', 'kind', 'love', 'pass', 'when', 'we', 'dey', 'show', 'our', 'pikin', '.'] 2020-02-09 14:06:40,859 Source: Romantic love ( eʹros ) brings delight , and love for family ( stor·geʹ ) is vital when children enter the picture . 2020-02-09 14:06:40,859 Reference: ( 1 ) Love wey friend get for each other ( Greek , phi·liʹa ) ; ( 2 ) love wey man and woman get for each other ( eʹros ) ; ( 3 ) love wey people for family get for each other ( stor·geʹ ) . 2020-02-09 14:06:40,859 Hypothesis: We no dey show our family love , and we dey enjoy each other . We dey show this kind love pass when we dey show our pikin . 2020-02-09 14:06:40,859 Example #3 2020-02-09 14:06:40,859 Raw source: ['As', 'our', 'loving', 'De@@', 'sign@@', 'er', 'and', 'Creator', ',', 'Jehovah', 'knows', 'what', 'we', 'need', 'in', 'order', 'to', 'be', 'truly', 'happy', ',', 'and', 'he', 'f@@', 'ill@@', 's', 'that', 'need', 'ab@@', 'un@@', 'd@@', 'an@@', 'tly', '.'] 2020-02-09 14:06:40,859 Raw hypothesis: ['As', 'Jehovah', 'love', 'us', ',', 'we', 'know', 'wetin', 'e', 'really', 'need', 'and', 'wetin', 'we', 'no', 'fit', 'do', 'to', 'really', 'happy', '.'] 2020-02-09 14:06:40,859 Source: As our loving Designer and Creator , Jehovah knows what we need in order to be truly happy , and he fills that need abundantly . 2020-02-09 14:06:40,859 Reference: Because na Jehovah make us , e know wetin go make us happy . E don even give us pass wetin we need . 2020-02-09 14:06:40,859 Hypothesis: As Jehovah love us , we know wetin e really need and wetin we no fit do to really happy . 2020-02-09 14:06:40,859 Validation result (greedy) at epoch 144, step 31000: bleu: 13.60, loss: 57068.2891, ppl: 12.0862, duration: 12.5137s 2020-02-09 14:06:50,861 Epoch 144 Step: 31100 Batch Loss: 0.436261 Tokens per Sec: 21107, Lr: 0.000103 2020-02-09 14:06:53,447 Epoch 144: total training loss 172.98 2020-02-09 14:06:53,447 EPOCH 145 2020-02-09 14:07:00,862 Epoch 145 Step: 31200 Batch Loss: 0.888159 Tokens per Sec: 20952, Lr: 0.000103 2020-02-09 14:07:10,816 Epoch 145 Step: 31300 Batch Loss: 0.976383 Tokens per Sec: 21307, Lr: 0.000103 2020-02-09 14:07:14,905 Epoch 145: total training loss 171.71 2020-02-09 14:07:14,906 EPOCH 146 2020-02-09 14:07:20,808 Epoch 146 Step: 31400 Batch Loss: 0.948343 Tokens per Sec: 21440, Lr: 0.000103 2020-02-09 14:07:30,746 Epoch 146 Step: 31500 Batch Loss: 0.899355 Tokens per Sec: 21194, Lr: 0.000103 2020-02-09 14:07:36,292 Epoch 146: total training loss 171.23 2020-02-09 14:07:36,292 EPOCH 147 2020-02-09 14:07:40,723 Epoch 147 Step: 31600 Batch Loss: 0.714567 Tokens per Sec: 20765, Lr: 0.000103 2020-02-09 14:07:50,675 Epoch 147 Step: 31700 Batch Loss: 0.963298 Tokens per Sec: 21338, Lr: 0.000103 2020-02-09 14:07:57,909 Epoch 147: total training loss 171.62 2020-02-09 14:07:57,909 EPOCH 148 2020-02-09 14:08:00,636 Epoch 148 Step: 31800 Batch Loss: 0.639810 Tokens per Sec: 21075, Lr: 0.000103 2020-02-09 14:08:10,523 Epoch 148 Step: 31900 Batch Loss: 0.846164 Tokens per Sec: 21358, Lr: 0.000103 2020-02-09 14:08:19,535 Epoch 148: total training loss 171.46 2020-02-09 14:08:19,535 EPOCH 149 2020-02-09 14:08:20,573 Epoch 149 Step: 32000 Batch Loss: 0.518559 Tokens per Sec: 20187, Lr: 0.000103 2020-02-09 14:08:32,965 Example #0 2020-02-09 14:08:32,965 Raw source: ['Jehovah', 'did', 'not', 'do', 'that', ',', 'but', 'he', 'allowed', 'Satan', 'to', 'test', 'Job', ',', 'st@@', 'ating', ':', '“', 'Every@@', 'thing', 'that', 'he', 'has', 'is', 'in', 'your', 'hand', '.', '”'] 2020-02-09 14:08:32,965 Raw hypothesis: ['Jehovah', 'no', 'let', 'Satan', 'do', 'wetin', 'e', 'no', 'like', '.', 'E', 'tell', 'Job', 'sey', ':', '‘', 'Any@@', 'body', 'wey', 'dey', 'do', 'wetin', 'e', 'want', ',', 'na', 'im', 'be', 'that', '.', '’'] 2020-02-09 14:08:32,965 Source: Jehovah did not do that , but he allowed Satan to test Job , stating : “ Everything that he has is in your hand . ” 2020-02-09 14:08:32,965 Reference: E tell am sey : ‘ Everything wey e get dey your hand . ’ 2020-02-09 14:08:32,965 Hypothesis: Jehovah no let Satan do wetin e no like . E tell Job sey : ‘ Anybody wey dey do wetin e want , na im be that . ’ 2020-02-09 14:08:32,965 Example #1 2020-02-09 14:08:32,965 Raw source: ['Corin@@', 'na', 'said', ':', '“', 'We', 'left', 'our', 'work', 'area', 'in', 'the', 'evening', 'and', 'wal@@', 'ked', 'to', 'a', 'ra@@', 'il@@', 'way', 'st@@', 'ation', '25', 'ki@@', 'lo@@', 'me@@', 'ters', '(', '15', 'miles', ')', 'away', '.'] 2020-02-09 14:08:32,965 Raw hypothesis: ['Corin@@', 'na', ',', 'wey', 'come', 'from', 'prison', ',', 'talk', 'sey', ':', '“', 'We', 'stay', 'there', 'for', 'evening', 'and', 'we', 'stay', 'there', '.', 'We', 'come', 'dey', 'stay', 'there', 'for', '25', 'ki@@', 'lo@@', 'me@@', 'ters', '(', '15', 'km', ')', 'go', 'there', '.'] 2020-02-09 14:08:32,966 Source: Corinna said : “ We left our work area in the evening and walked to a railway station 25 kilometers ( 15 miles ) away . 2020-02-09 14:08:32,966 Reference: Corinna talk sey : “ We comot for where we dey work for evening come trek go where people dey enter train wey be 25 kilometer ( 15 miles ) from where the farm dey . 2020-02-09 14:08:32,966 Hypothesis: Corinna , wey come from prison , talk sey : “ We stay there for evening and we stay there . We come dey stay there for 25 kilometers ( 15 km ) go there . 2020-02-09 14:08:32,966 Example #2 2020-02-09 14:08:32,966 Raw source: ['Ro@@', 'man@@', 'tic', 'love', '(', 'e@@', 'ʹ@@', 'ro@@', 's', ')', 'brings', 'delight', ',', 'and', 'love', 'for', 'family', '(', 'st@@', 'or@@', '·@@', 'ge@@', 'ʹ', ')', 'is', 'vital', 'when', 'children', 'enter', 'the', 'picture', '.'] 2020-02-09 14:08:32,966 Raw hypothesis: ['We', 'no', 'dey', 'show', 'our', 'family', 'love', ',', 'and', 'we', 'dey', 'enjoy', 'each', 'other', '.', 'We', 'dey', 'show', 'love', 'when', 'we', 'dey', 'show', 'dem', 'love', '.'] 2020-02-09 14:08:32,966 Source: Romantic love ( eʹros ) brings delight , and love for family ( stor·geʹ ) is vital when children enter the picture . 2020-02-09 14:08:32,966 Reference: ( 1 ) Love wey friend get for each other ( Greek , phi·liʹa ) ; ( 2 ) love wey man and woman get for each other ( eʹros ) ; ( 3 ) love wey people for family get for each other ( stor·geʹ ) . 2020-02-09 14:08:32,966 Hypothesis: We no dey show our family love , and we dey enjoy each other . We dey show love when we dey show dem love . 2020-02-09 14:08:32,966 Example #3 2020-02-09 14:08:32,966 Raw source: ['As', 'our', 'loving', 'De@@', 'sign@@', 'er', 'and', 'Creator', ',', 'Jehovah', 'knows', 'what', 'we', 'need', 'in', 'order', 'to', 'be', 'truly', 'happy', ',', 'and', 'he', 'f@@', 'ill@@', 's', 'that', 'need', 'ab@@', 'un@@', 'd@@', 'an@@', 'tly', '.'] 2020-02-09 14:08:32,966 Raw hypothesis: ['As', 'Jehovah', 'love', 'us', ',', 'na', 'wetin', 'make', 'us', 'fit', 'really', 'dey', 'happy', 'and', 'e', 'dey', 'make', 'us', 'happy', '.'] 2020-02-09 14:08:32,966 Source: As our loving Designer and Creator , Jehovah knows what we need in order to be truly happy , and he fills that need abundantly . 2020-02-09 14:08:32,966 Reference: Because na Jehovah make us , e know wetin go make us happy . E don even give us pass wetin we need . 2020-02-09 14:08:32,966 Hypothesis: As Jehovah love us , na wetin make us fit really dey happy and e dey make us happy . 2020-02-09 14:08:32,966 Validation result (greedy) at epoch 149, step 32000: bleu: 13.84, loss: 57246.6211, ppl: 12.1807, duration: 12.3928s 2020-02-09 14:08:42,890 Epoch 149 Step: 32100 Batch Loss: 0.598931 Tokens per Sec: 21004, Lr: 0.000103 2020-02-09 14:08:52,790 Epoch 149 Step: 32200 Batch Loss: 0.738913 Tokens per Sec: 21857, Lr: 0.000103 2020-02-09 14:08:53,473 Epoch 149: total training loss 171.33 2020-02-09 14:08:53,473 EPOCH 150 2020-02-09 14:09:02,722 Epoch 150 Step: 32300 Batch Loss: 0.910482 Tokens per Sec: 21228, Lr: 0.000103 2020-02-09 14:09:12,636 Epoch 150 Step: 32400 Batch Loss: 0.977322 Tokens per Sec: 21299, Lr: 0.000103 2020-02-09 14:09:15,106 Epoch 150: total training loss 171.60 2020-02-09 14:09:15,106 EPOCH 151 2020-02-09 14:09:22,631 Epoch 151 Step: 32500 Batch Loss: 0.694298 Tokens per Sec: 21441, Lr: 0.000103 2020-02-09 14:09:32,506 Epoch 151 Step: 32600 Batch Loss: 0.765342 Tokens per Sec: 21346, Lr: 0.000103 2020-02-09 14:09:36,469 Epoch 151: total training loss 169.09 2020-02-09 14:09:36,469 EPOCH 152 2020-02-09 14:09:42,434 Epoch 152 Step: 32700 Batch Loss: 0.506705 Tokens per Sec: 21083, Lr: 0.000103 2020-02-09 14:09:52,334 Epoch 152 Step: 32800 Batch Loss: 0.951443 Tokens per Sec: 21251, Lr: 0.000103 2020-02-09 14:09:57,979 Epoch 152: total training loss 169.60 2020-02-09 14:09:57,980 EPOCH 153 2020-02-09 14:10:02,257 Epoch 153 Step: 32900 Batch Loss: 0.847457 Tokens per Sec: 21099, Lr: 0.000103 2020-02-09 14:10:12,158 Epoch 153 Step: 33000 Batch Loss: 0.758335 Tokens per Sec: 21422, Lr: 0.000103 2020-02-09 14:10:23,882 Example #0 2020-02-09 14:10:23,882 Raw source: ['Jehovah', 'did', 'not', 'do', 'that', ',', 'but', 'he', 'allowed', 'Satan', 'to', 'test', 'Job', ',', 'st@@', 'ating', ':', '“', 'Every@@', 'thing', 'that', 'he', 'has', 'is', 'in', 'your', 'hand', '.', '”'] 2020-02-09 14:10:23,882 Raw hypothesis: ['Jehovah', 'no', 'let', 'Satan', 'suffer', 'Job', '.', 'But', 'e', 'no', 'leave', 'Job', '.', 'Jehovah', 'tell', 'Job', 'sey', ':', '‘', 'Any@@', 'body', 'wey', 'dey', 'do', 'wetin', 'e', 'want', ',', 'but', 'e', 'never', 'do', 'am', '.', '’'] 2020-02-09 14:10:23,882 Source: Jehovah did not do that , but he allowed Satan to test Job , stating : “ Everything that he has is in your hand . ” 2020-02-09 14:10:23,882 Reference: E tell am sey : ‘ Everything wey e get dey your hand . ’ 2020-02-09 14:10:23,882 Hypothesis: Jehovah no let Satan suffer Job . But e no leave Job . Jehovah tell Job sey : ‘ Anybody wey dey do wetin e want , but e never do am . ’ 2020-02-09 14:10:23,882 Example #1 2020-02-09 14:10:23,883 Raw source: ['Corin@@', 'na', 'said', ':', '“', 'We', 'left', 'our', 'work', 'area', 'in', 'the', 'evening', 'and', 'wal@@', 'ked', 'to', 'a', 'ra@@', 'il@@', 'way', 'st@@', 'ation', '25', 'ki@@', 'lo@@', 'me@@', 'ters', '(', '15', 'miles', ')', 'away', '.'] 2020-02-09 14:10:23,883 Raw hypothesis: ['Corin@@', 'na', ',', 'wey', 'come', 'from', 'prison', ',', 'talk', 'sey', ':', '“', 'We', 'stay', 'for', 'where', 'we', 'dey', 'stay', '.', 'We', 'come', 'dey', 'stay', 'there', 'for', '25', 'ki@@', 'lo@@', 'me@@', 'ters', '(', '15', 'km', ')', 'go', 'there', '.'] 2020-02-09 14:10:23,883 Source: Corinna said : “ We left our work area in the evening and walked to a railway station 25 kilometers ( 15 miles ) away . 2020-02-09 14:10:23,883 Reference: Corinna talk sey : “ We comot for where we dey work for evening come trek go where people dey enter train wey be 25 kilometer ( 15 miles ) from where the farm dey . 2020-02-09 14:10:23,883 Hypothesis: Corinna , wey come from prison , talk sey : “ We stay for where we dey stay . We come dey stay there for 25 kilometers ( 15 km ) go there . 2020-02-09 14:10:23,883 Example #2 2020-02-09 14:10:23,883 Raw source: ['Ro@@', 'man@@', 'tic', 'love', '(', 'e@@', 'ʹ@@', 'ro@@', 's', ')', 'brings', 'delight', ',', 'and', 'love', 'for', 'family', '(', 'st@@', 'or@@', '·@@', 'ge@@', 'ʹ', ')', 'is', 'vital', 'when', 'children', 'enter', 'the', 'picture', '.'] 2020-02-09 14:10:23,883 Raw hypothesis: ['We', 'no', 'dey', 'show', 'love', 'play', '.', 'We', 'dey', 'enjoy', 'to', 'care', 'for', 'our', 'family', '(', 'Matt', '.'] 2020-02-09 14:10:23,883 Source: Romantic love ( eʹros ) brings delight , and love for family ( stor·geʹ ) is vital when children enter the picture . 2020-02-09 14:10:23,883 Reference: ( 1 ) Love wey friend get for each other ( Greek , phi·liʹa ) ; ( 2 ) love wey man and woman get for each other ( eʹros ) ; ( 3 ) love wey people for family get for each other ( stor·geʹ ) . 2020-02-09 14:10:23,883 Hypothesis: We no dey show love play . We dey enjoy to care for our family ( Matt . 2020-02-09 14:10:23,883 Example #3 2020-02-09 14:10:23,883 Raw source: ['As', 'our', 'loving', 'De@@', 'sign@@', 'er', 'and', 'Creator', ',', 'Jehovah', 'knows', 'what', 'we', 'need', 'in', 'order', 'to', 'be', 'truly', 'happy', ',', 'and', 'he', 'f@@', 'ill@@', 's', 'that', 'need', 'ab@@', 'un@@', 'd@@', 'an@@', 'tly', '.'] 2020-02-09 14:10:23,883 Raw hypothesis: ['As', 'Jehovah', 'love', 'us', 'and', 'na', 'im', 'make', 'us', ',', 'e', 'know', 'wetin', 'we', 'need', 'and', 'e', 'dey', 'really', 'make', 'us', 'happy', '.'] 2020-02-09 14:10:23,883 Source: As our loving Designer and Creator , Jehovah knows what we need in order to be truly happy , and he fills that need abundantly . 2020-02-09 14:10:23,883 Reference: Because na Jehovah make us , e know wetin go make us happy . E don even give us pass wetin we need . 2020-02-09 14:10:23,884 Hypothesis: As Jehovah love us and na im make us , e know wetin we need and e dey really make us happy . 2020-02-09 14:10:23,884 Validation result (greedy) at epoch 153, step 33000: bleu: 14.17, loss: 57541.0703, ppl: 12.3383, duration: 11.7248s 2020-02-09 14:10:31,133 Epoch 153: total training loss 168.93 2020-02-09 14:10:31,133 EPOCH 154 2020-02-09 14:10:33,724 Epoch 154 Step: 33100 Batch Loss: 0.773851 Tokens per Sec: 20491, Lr: 0.000103 2020-02-09 14:10:43,585 Epoch 154 Step: 33200 Batch Loss: 0.517397 Tokens per Sec: 21513, Lr: 0.000103 2020-02-09 14:10:52,525 Epoch 154: total training loss 168.41 2020-02-09 14:10:52,525 EPOCH 155 2020-02-09 14:10:53,452 Epoch 155 Step: 33300 Batch Loss: 0.733195 Tokens per Sec: 20157, Lr: 0.000103 2020-02-09 14:11:03,385 Epoch 155 Step: 33400 Batch Loss: 0.783131 Tokens per Sec: 21785, Lr: 0.000103 2020-02-09 14:11:13,375 Epoch 155 Step: 33500 Batch Loss: 0.904125 Tokens per Sec: 20493, Lr: 0.000103 2020-02-09 14:11:14,164 Epoch 155: total training loss 168.12 2020-02-09 14:11:14,164 EPOCH 156 2020-02-09 14:11:23,283 Epoch 156 Step: 33600 Batch Loss: 0.866785 Tokens per Sec: 21310, Lr: 0.000103 2020-02-09 14:11:33,174 Epoch 156 Step: 33700 Batch Loss: 0.948709 Tokens per Sec: 21243, Lr: 0.000103 2020-02-09 14:11:35,752 Epoch 156: total training loss 169.08 2020-02-09 14:11:35,753 EPOCH 157 2020-02-09 14:11:43,115 Epoch 157 Step: 33800 Batch Loss: 0.907475 Tokens per Sec: 21675, Lr: 0.000103 2020-02-09 14:11:53,026 Epoch 157 Step: 33900 Batch Loss: 0.821803 Tokens per Sec: 21435, Lr: 0.000103 2020-02-09 14:11:57,207 Epoch 157: total training loss 166.36 2020-02-09 14:11:57,207 EPOCH 158 2020-02-09 14:12:03,045 Epoch 158 Step: 34000 Batch Loss: 0.839570 Tokens per Sec: 21424, Lr: 0.000103 2020-02-09 14:12:15,485 Example #0 2020-02-09 14:12:15,485 Raw source: ['Jehovah', 'did', 'not', 'do', 'that', ',', 'but', 'he', 'allowed', 'Satan', 'to', 'test', 'Job', ',', 'st@@', 'ating', ':', '“', 'Every@@', 'thing', 'that', 'he', 'has', 'is', 'in', 'your', 'hand', '.', '”'] 2020-02-09 14:12:15,485 Raw hypothesis: ['Jehovah', 'no', 'let', 'Satan', 'do', 'wetin', 'e', 'no', 'like', '.', 'E', 'tell', 'Job', 'sey', ':', '‘', 'Any@@', 'body', 'wey', 'dey', 'do', 'wetin', 'e', 'want', ',', 'na', 'im', 'be', 'your', 'hand', '.', '’'] 2020-02-09 14:12:15,485 Source: Jehovah did not do that , but he allowed Satan to test Job , stating : “ Everything that he has is in your hand . ” 2020-02-09 14:12:15,485 Reference: E tell am sey : ‘ Everything wey e get dey your hand . ’ 2020-02-09 14:12:15,485 Hypothesis: Jehovah no let Satan do wetin e no like . E tell Job sey : ‘ Anybody wey dey do wetin e want , na im be your hand . ’ 2020-02-09 14:12:15,486 Example #1 2020-02-09 14:12:15,486 Raw source: ['Corin@@', 'na', 'said', ':', '“', 'We', 'left', 'our', 'work', 'area', 'in', 'the', 'evening', 'and', 'wal@@', 'ked', 'to', 'a', 'ra@@', 'il@@', 'way', 'st@@', 'ation', '25', 'ki@@', 'lo@@', 'me@@', 'ters', '(', '15', 'miles', ')', 'away', '.'] 2020-02-09 14:12:15,486 Raw hypothesis: ['Corin@@', 'na', ',', 'wey', 'come', 'from', 'prison', ',', 'talk', 'sey', ':', '“', 'We', 'stay', 'there', 'for', 'where', 'we', 'dey', 'stay', '.', 'We', 'come', 'still', 'comot', 'go', 'where', 'dem', 'dey', 'call', 'ra@@', 'ki@@', 'lo@@', 'me@@', 'ters', '(', '15', 'km', ')', '.'] 2020-02-09 14:12:15,486 Source: Corinna said : “ We left our work area in the evening and walked to a railway station 25 kilometers ( 15 miles ) away . 2020-02-09 14:12:15,486 Reference: Corinna talk sey : “ We comot for where we dey work for evening come trek go where people dey enter train wey be 25 kilometer ( 15 miles ) from where the farm dey . 2020-02-09 14:12:15,486 Hypothesis: Corinna , wey come from prison , talk sey : “ We stay there for where we dey stay . We come still comot go where dem dey call rakilometers ( 15 km ) . 2020-02-09 14:12:15,486 Example #2 2020-02-09 14:12:15,486 Raw source: ['Ro@@', 'man@@', 'tic', 'love', '(', 'e@@', 'ʹ@@', 'ro@@', 's', ')', 'brings', 'delight', ',', 'and', 'love', 'for', 'family', '(', 'st@@', 'or@@', '·@@', 'ge@@', 'ʹ', ')', 'is', 'vital', 'when', 'children', 'enter', 'the', 'picture', '.'] 2020-02-09 14:12:15,486 Raw hypothesis: ['We', 'no', 'dey', 'show', 'love', 'play', '.', 'We', 'dey', 'enjoy', 'our', 'family', 'and', 'our', 'family', '(', 'Matt', '.'] 2020-02-09 14:12:15,486 Source: Romantic love ( eʹros ) brings delight , and love for family ( stor·geʹ ) is vital when children enter the picture . 2020-02-09 14:12:15,486 Reference: ( 1 ) Love wey friend get for each other ( Greek , phi·liʹa ) ; ( 2 ) love wey man and woman get for each other ( eʹros ) ; ( 3 ) love wey people for family get for each other ( stor·geʹ ) . 2020-02-09 14:12:15,486 Hypothesis: We no dey show love play . We dey enjoy our family and our family ( Matt . 2020-02-09 14:12:15,486 Example #3 2020-02-09 14:12:15,486 Raw source: ['As', 'our', 'loving', 'De@@', 'sign@@', 'er', 'and', 'Creator', ',', 'Jehovah', 'knows', 'what', 'we', 'need', 'in', 'order', 'to', 'be', 'truly', 'happy', ',', 'and', 'he', 'f@@', 'ill@@', 's', 'that', 'need', 'ab@@', 'un@@', 'd@@', 'an@@', 'tly', '.'] 2020-02-09 14:12:15,486 Raw hypothesis: ['As', 'Jehovah', 'love', 'us', 'and', 'na', 'im', 'make', 'us', ',', 'e', 'know', 'wetin', 'we', 'need', 'and', 'e', 'dey', 'really', 'make', 'us', 'happy', '.'] 2020-02-09 14:12:15,486 Source: As our loving Designer and Creator , Jehovah knows what we need in order to be truly happy , and he fills that need abundantly . 2020-02-09 14:12:15,487 Reference: Because na Jehovah make us , e know wetin go make us happy . E don even give us pass wetin we need . 2020-02-09 14:12:15,487 Hypothesis: As Jehovah love us and na im make us , e know wetin we need and e dey really make us happy . 2020-02-09 14:12:15,487 Validation result (greedy) at epoch 158, step 34000: bleu: 14.23, loss: 57767.6172, ppl: 12.4610, duration: 12.4414s 2020-02-09 14:12:25,433 Epoch 158 Step: 34100 Batch Loss: 0.593047 Tokens per Sec: 21064, Lr: 0.000072 2020-02-09 14:12:31,254 Epoch 158: total training loss 166.39 2020-02-09 14:12:31,255 EPOCH 159 2020-02-09 14:12:35,356 Epoch 159 Step: 34200 Batch Loss: 0.566131 Tokens per Sec: 21527, Lr: 0.000072 2020-02-09 14:12:45,306 Epoch 159 Step: 34300 Batch Loss: 0.323438 Tokens per Sec: 21107, Lr: 0.000072 2020-02-09 14:12:52,781 Epoch 159: total training loss 163.98 2020-02-09 14:12:52,782 EPOCH 160 2020-02-09 14:12:55,289 Epoch 160 Step: 34400 Batch Loss: 0.808073 Tokens per Sec: 20218, Lr: 0.000072 2020-02-09 14:13:05,256 Epoch 160 Step: 34500 Batch Loss: 0.786299 Tokens per Sec: 21327, Lr: 0.000072 2020-02-09 14:13:14,372 Epoch 160: total training loss 163.83 2020-02-09 14:13:14,373 EPOCH 161 2020-02-09 14:13:15,217 Epoch 161 Step: 34600 Batch Loss: 0.875038 Tokens per Sec: 20171, Lr: 0.000072 2020-02-09 14:13:25,164 Epoch 161 Step: 34700 Batch Loss: 0.643738 Tokens per Sec: 21418, Lr: 0.000072 2020-02-09 14:13:35,033 Epoch 161 Step: 34800 Batch Loss: 0.720756 Tokens per Sec: 21346, Lr: 0.000072 2020-02-09 14:13:35,825 Epoch 161: total training loss 163.18 2020-02-09 14:13:35,825 EPOCH 162 2020-02-09 14:13:44,970 Epoch 162 Step: 34900 Batch Loss: 0.716529 Tokens per Sec: 21560, Lr: 0.000072 2020-02-09 14:13:54,844 Epoch 162 Step: 35000 Batch Loss: 0.638049 Tokens per Sec: 21007, Lr: 0.000072 2020-02-09 14:14:06,894 Example #0 2020-02-09 14:14:06,894 Raw source: ['Jehovah', 'did', 'not', 'do', 'that', ',', 'but', 'he', 'allowed', 'Satan', 'to', 'test', 'Job', ',', 'st@@', 'ating', ':', '“', 'Every@@', 'thing', 'that', 'he', 'has', 'is', 'in', 'your', 'hand', '.', '”'] 2020-02-09 14:14:06,894 Raw hypothesis: ['Jehovah', 'no', 'let', 'Satan', 'do', 'wetin', 'e', 'no', 'like', '.', 'E', 'tell', 'Job', 'sey', ':', '‘', 'Any@@', 'body', 'wey', 'dey', 'your', 'hand', 'don', 'weak', ',', 'but', 'e', 'never', 'stop', 'to', 'get', 'your', 'hand', '.', '’'] 2020-02-09 14:14:06,895 Source: Jehovah did not do that , but he allowed Satan to test Job , stating : “ Everything that he has is in your hand . ” 2020-02-09 14:14:06,895 Reference: E tell am sey : ‘ Everything wey e get dey your hand . ’ 2020-02-09 14:14:06,895 Hypothesis: Jehovah no let Satan do wetin e no like . E tell Job sey : ‘ Anybody wey dey your hand don weak , but e never stop to get your hand . ’ 2020-02-09 14:14:06,895 Example #1 2020-02-09 14:14:06,895 Raw source: ['Corin@@', 'na', 'said', ':', '“', 'We', 'left', 'our', 'work', 'area', 'in', 'the', 'evening', 'and', 'wal@@', 'ked', 'to', 'a', 'ra@@', 'il@@', 'way', 'st@@', 'ation', '25', 'ki@@', 'lo@@', 'me@@', 'ters', '(', '15', 'miles', ')', 'away', '.'] 2020-02-09 14:14:06,895 Raw hypothesis: ['Corin@@', 'na', ',', 'wey', 'come', 'from', 'prison', ',', 'talk', 'sey', ':', '“', 'We', 'stay', 'for', 'evening', 'and', 'we', 'dey', 'comot', '.', 'We', 'come', 'dey', 'stay', 'there', 'for', '25', 'ki@@', 'lo@@', 'me@@', 'ters', '(', '15', 'km', ')', 'go', 'there', '.'] 2020-02-09 14:14:06,895 Source: Corinna said : “ We left our work area in the evening and walked to a railway station 25 kilometers ( 15 miles ) away . 2020-02-09 14:14:06,895 Reference: Corinna talk sey : “ We comot for where we dey work for evening come trek go where people dey enter train wey be 25 kilometer ( 15 miles ) from where the farm dey . 2020-02-09 14:14:06,895 Hypothesis: Corinna , wey come from prison , talk sey : “ We stay for evening and we dey comot . We come dey stay there for 25 kilometers ( 15 km ) go there . 2020-02-09 14:14:06,895 Example #2 2020-02-09 14:14:06,895 Raw source: ['Ro@@', 'man@@', 'tic', 'love', '(', 'e@@', 'ʹ@@', 'ro@@', 's', ')', 'brings', 'delight', ',', 'and', 'love', 'for', 'family', '(', 'st@@', 'or@@', '·@@', 'ge@@', 'ʹ', ')', 'is', 'vital', 'when', 'children', 'enter', 'the', 'picture', '.'] 2020-02-09 14:14:06,895 Raw hypothesis: ['We', 'no', 'dey', 'show', 'love', 'play', '.', 'We', 'dey', 'enjoy', 'our', 'family', 'and', 'our', 'family', '(', '4', ')', 'when', 'we', 'dey', 'show', 'love', 'dem', ',', 'e', 'dey', 'make', 'dem', 'get', 'better', 'character', '.'] 2020-02-09 14:14:06,895 Source: Romantic love ( eʹros ) brings delight , and love for family ( stor·geʹ ) is vital when children enter the picture . 2020-02-09 14:14:06,895 Reference: ( 1 ) Love wey friend get for each other ( Greek , phi·liʹa ) ; ( 2 ) love wey man and woman get for each other ( eʹros ) ; ( 3 ) love wey people for family get for each other ( stor·geʹ ) . 2020-02-09 14:14:06,895 Hypothesis: We no dey show love play . We dey enjoy our family and our family ( 4 ) when we dey show love dem , e dey make dem get better character . 2020-02-09 14:14:06,896 Example #3 2020-02-09 14:14:06,896 Raw source: ['As', 'our', 'loving', 'De@@', 'sign@@', 'er', 'and', 'Creator', ',', 'Jehovah', 'knows', 'what', 'we', 'need', 'in', 'order', 'to', 'be', 'truly', 'happy', ',', 'and', 'he', 'f@@', 'ill@@', 's', 'that', 'need', 'ab@@', 'un@@', 'd@@', 'an@@', 'tly', '.'] 2020-02-09 14:14:06,896 Raw hypothesis: ['As', 'Jehovah', 'love', 'us', 'and', 'na', 'im', 'make', 'us', ',', 'e', 'know', 'wetin', 'we', 'need', 'and', 'we', 'no', 'go', 'happy', '.'] 2020-02-09 14:14:06,896 Source: As our loving Designer and Creator , Jehovah knows what we need in order to be truly happy , and he fills that need abundantly . 2020-02-09 14:14:06,896 Reference: Because na Jehovah make us , e know wetin go make us happy . E don even give us pass wetin we need . 2020-02-09 14:14:06,896 Hypothesis: As Jehovah love us and na im make us , e know wetin we need and we no go happy . 2020-02-09 14:14:06,896 Validation result (greedy) at epoch 162, step 35000: bleu: 13.97, loss: 57825.0547, ppl: 12.4923, duration: 12.0512s 2020-02-09 14:14:09,366 Epoch 162: total training loss 162.78 2020-02-09 14:14:09,366 EPOCH 163 2020-02-09 14:14:16,926 Epoch 163 Step: 35100 Batch Loss: 0.860602 Tokens per Sec: 21386, Lr: 0.000072 2020-02-09 14:14:26,798 Epoch 163 Step: 35200 Batch Loss: 0.720456 Tokens per Sec: 21278, Lr: 0.000072 2020-02-09 14:14:30,871 Epoch 163: total training loss 161.83 2020-02-09 14:14:30,871 EPOCH 164 2020-02-09 14:14:36,757 Epoch 164 Step: 35300 Batch Loss: 0.857684 Tokens per Sec: 21221, Lr: 0.000072 2020-02-09 14:14:46,680 Epoch 164 Step: 35400 Batch Loss: 0.476587 Tokens per Sec: 20918, Lr: 0.000072 2020-02-09 14:14:52,433 Epoch 164: total training loss 162.14 2020-02-09 14:14:52,434 EPOCH 165 2020-02-09 14:14:56,642 Epoch 165 Step: 35500 Batch Loss: 0.580762 Tokens per Sec: 21280, Lr: 0.000072 2020-02-09 14:15:06,630 Epoch 165 Step: 35600 Batch Loss: 0.692200 Tokens per Sec: 21404, Lr: 0.000072 2020-02-09 14:15:13,879 Epoch 165: total training loss 160.86 2020-02-09 14:15:13,879 EPOCH 166 2020-02-09 14:15:16,590 Epoch 166 Step: 35700 Batch Loss: 0.814139 Tokens per Sec: 21290, Lr: 0.000072 2020-02-09 14:15:26,529 Epoch 166 Step: 35800 Batch Loss: 0.440191 Tokens per Sec: 21176, Lr: 0.000072 2020-02-09 14:15:35,296 Epoch 166: total training loss 160.49 2020-02-09 14:15:35,296 EPOCH 167 2020-02-09 14:15:36,536 Epoch 167 Step: 35900 Batch Loss: 0.932627 Tokens per Sec: 20986, Lr: 0.000072 2020-02-09 14:15:46,421 Epoch 167 Step: 36000 Batch Loss: 0.772605 Tokens per Sec: 21192, Lr: 0.000072 2020-02-09 14:15:58,696 Example #0 2020-02-09 14:15:58,696 Raw source: ['Jehovah', 'did', 'not', 'do', 'that', ',', 'but', 'he', 'allowed', 'Satan', 'to', 'test', 'Job', ',', 'st@@', 'ating', ':', '“', 'Every@@', 'thing', 'that', 'he', 'has', 'is', 'in', 'your', 'hand', '.', '”'] 2020-02-09 14:15:58,696 Raw hypothesis: ['Jehovah', 'no', 'let', 'Satan', 'do', 'wetin', 'e', 'no', 'like', '.', 'E', 'tell', 'Job', 'sey', ':', '‘', 'Any@@', 'body', 'wey', 'e', 'get', ',', 'na', 'im', 'be', 'the', 'Person', 'wey', 'dey', 'use', 'im', 'hand', 'do', 'wetin', 'e', 'want', '.', '’'] 2020-02-09 14:15:58,696 Source: Jehovah did not do that , but he allowed Satan to test Job , stating : “ Everything that he has is in your hand . ” 2020-02-09 14:15:58,696 Reference: E tell am sey : ‘ Everything wey e get dey your hand . ’ 2020-02-09 14:15:58,696 Hypothesis: Jehovah no let Satan do wetin e no like . E tell Job sey : ‘ Anybody wey e get , na im be the Person wey dey use im hand do wetin e want . ’ 2020-02-09 14:15:58,697 Example #1 2020-02-09 14:15:58,697 Raw source: ['Corin@@', 'na', 'said', ':', '“', 'We', 'left', 'our', 'work', 'area', 'in', 'the', 'evening', 'and', 'wal@@', 'ked', 'to', 'a', 'ra@@', 'il@@', 'way', 'st@@', 'ation', '25', 'ki@@', 'lo@@', 'me@@', 'ters', '(', '15', 'miles', ')', 'away', '.'] 2020-02-09 14:15:58,697 Raw hypothesis: ['Corin@@', 'na', ',', 'wey', 'come', 'from', 'prison', ',', 'talk', 'sey', ':', '“', 'We', 'comot', 'for', 'where', 'we', 'dey', 'stay', '.', 'We', 'come', 'still', 'comot', 'go', 'where', 'we', 'dey', 'go', '.'] 2020-02-09 14:15:58,697 Source: Corinna said : “ We left our work area in the evening and walked to a railway station 25 kilometers ( 15 miles ) away . 2020-02-09 14:15:58,697 Reference: Corinna talk sey : “ We comot for where we dey work for evening come trek go where people dey enter train wey be 25 kilometer ( 15 miles ) from where the farm dey . 2020-02-09 14:15:58,697 Hypothesis: Corinna , wey come from prison , talk sey : “ We comot for where we dey stay . We come still comot go where we dey go . 2020-02-09 14:15:58,697 Example #2 2020-02-09 14:15:58,697 Raw source: ['Ro@@', 'man@@', 'tic', 'love', '(', 'e@@', 'ʹ@@', 'ro@@', 's', ')', 'brings', 'delight', ',', 'and', 'love', 'for', 'family', '(', 'st@@', 'or@@', '·@@', 'ge@@', 'ʹ', ')', 'is', 'vital', 'when', 'children', 'enter', 'the', 'picture', '.'] 2020-02-09 14:15:58,697 Raw hypothesis: ['We', 'no', 'dey', 'show', 'love', 'play', '.', 'We', 'dey', 'enjoy', 'to', 'care', 'for', 'our', 'family', '(', 'Matt', '.'] 2020-02-09 14:15:58,697 Source: Romantic love ( eʹros ) brings delight , and love for family ( stor·geʹ ) is vital when children enter the picture . 2020-02-09 14:15:58,697 Reference: ( 1 ) Love wey friend get for each other ( Greek , phi·liʹa ) ; ( 2 ) love wey man and woman get for each other ( eʹros ) ; ( 3 ) love wey people for family get for each other ( stor·geʹ ) . 2020-02-09 14:15:58,697 Hypothesis: We no dey show love play . We dey enjoy to care for our family ( Matt . 2020-02-09 14:15:58,697 Example #3 2020-02-09 14:15:58,697 Raw source: ['As', 'our', 'loving', 'De@@', 'sign@@', 'er', 'and', 'Creator', ',', 'Jehovah', 'knows', 'what', 'we', 'need', 'in', 'order', 'to', 'be', 'truly', 'happy', ',', 'and', 'he', 'f@@', 'ill@@', 's', 'that', 'need', 'ab@@', 'un@@', 'd@@', 'an@@', 'tly', '.'] 2020-02-09 14:15:58,697 Raw hypothesis: ['As', 'Jehovah', 'love', 'us', 'and', 'na', 'im', 'make', 'us', ',', 'we', 'know', 'wetin', 'we', 'need', 'and', 'we', 'no', 'go', 'really', 'happy', '.'] 2020-02-09 14:15:58,697 Source: As our loving Designer and Creator , Jehovah knows what we need in order to be truly happy , and he fills that need abundantly . 2020-02-09 14:15:58,698 Reference: Because na Jehovah make us , e know wetin go make us happy . E don even give us pass wetin we need . 2020-02-09 14:15:58,698 Hypothesis: As Jehovah love us and na im make us , we know wetin we need and we no go really happy . 2020-02-09 14:15:58,698 Validation result (greedy) at epoch 167, step 36000: bleu: 13.99, loss: 57961.2656, ppl: 12.5668, duration: 12.2759s 2020-02-09 14:16:08,591 Epoch 167 Step: 36100 Batch Loss: 0.651248 Tokens per Sec: 21533, Lr: 0.000072 2020-02-09 14:16:08,987 Epoch 167: total training loss 161.08 2020-02-09 14:16:08,988 EPOCH 168 2020-02-09 14:16:18,537 Epoch 168 Step: 36200 Batch Loss: 0.704232 Tokens per Sec: 21435, Lr: 0.000072 2020-02-09 14:16:28,401 Epoch 168 Step: 36300 Batch Loss: 0.684729 Tokens per Sec: 21561, Lr: 0.000072 2020-02-09 14:16:30,265 Epoch 168: total training loss 159.60 2020-02-09 14:16:30,265 EPOCH 169 2020-02-09 14:16:38,278 Epoch 169 Step: 36400 Batch Loss: 0.832892 Tokens per Sec: 21379, Lr: 0.000072 2020-02-09 14:16:48,172 Epoch 169 Step: 36500 Batch Loss: 0.603741 Tokens per Sec: 21275, Lr: 0.000072 2020-02-09 14:16:51,618 Epoch 169: total training loss 160.18 2020-02-09 14:16:51,618 EPOCH 170 2020-02-09 14:16:58,056 Epoch 170 Step: 36600 Batch Loss: 0.663849 Tokens per Sec: 21777, Lr: 0.000072 2020-02-09 14:17:07,895 Epoch 170 Step: 36700 Batch Loss: 0.863176 Tokens per Sec: 21184, Lr: 0.000072 2020-02-09 14:17:13,018 Epoch 170: total training loss 159.95 2020-02-09 14:17:13,018 EPOCH 171 2020-02-09 14:17:17,904 Epoch 171 Step: 36800 Batch Loss: 0.693530 Tokens per Sec: 21226, Lr: 0.000072 2020-02-09 14:17:27,829 Epoch 171 Step: 36900 Batch Loss: 0.840549 Tokens per Sec: 21402, Lr: 0.000072 2020-02-09 14:17:34,547 Epoch 171: total training loss 159.53 2020-02-09 14:17:34,548 EPOCH 172 2020-02-09 14:17:37,752 Epoch 172 Step: 37000 Batch Loss: 0.823699 Tokens per Sec: 22034, Lr: 0.000072 2020-02-09 14:17:50,241 Example #0 2020-02-09 14:17:50,241 Raw source: ['Jehovah', 'did', 'not', 'do', 'that', ',', 'but', 'he', 'allowed', 'Satan', 'to', 'test', 'Job', ',', 'st@@', 'ating', ':', '“', 'Every@@', 'thing', 'that', 'he', 'has', 'is', 'in', 'your', 'hand', '.', '”'] 2020-02-09 14:17:50,241 Raw hypothesis: ['Jehovah', 'no', 'let', 'Satan', 'do', 'wetin', 'e', 'no', 'like', '.', 'E', 'tell', 'Job', 'sey', ':', '‘', 'Any@@', 'body', 'wey', 'dey', 'your', 'hand', 'don', 'turn', 'to', 'your', 'hand', '.', '’'] 2020-02-09 14:17:50,241 Source: Jehovah did not do that , but he allowed Satan to test Job , stating : “ Everything that he has is in your hand . ” 2020-02-09 14:17:50,241 Reference: E tell am sey : ‘ Everything wey e get dey your hand . ’ 2020-02-09 14:17:50,242 Hypothesis: Jehovah no let Satan do wetin e no like . E tell Job sey : ‘ Anybody wey dey your hand don turn to your hand . ’ 2020-02-09 14:17:50,242 Example #1 2020-02-09 14:17:50,242 Raw source: ['Corin@@', 'na', 'said', ':', '“', 'We', 'left', 'our', 'work', 'area', 'in', 'the', 'evening', 'and', 'wal@@', 'ked', 'to', 'a', 'ra@@', 'il@@', 'way', 'st@@', 'ation', '25', 'ki@@', 'lo@@', 'me@@', 'ters', '(', '15', 'miles', ')', 'away', '.'] 2020-02-09 14:17:50,242 Raw hypothesis: ['Corin@@', 'na', ',', 'wey', 'come', 'from', 'prison', ',', 'talk', 'sey', ':', '“', 'We', 'stay', 'for', 'where', 'we', 'dey', 'stay', '.', 'We', 'come', 'dey', 'stay', 'there', 'for', '25', 'ki@@', 'lo@@', 'me@@', 'ters', '(', '15', 'km', ')', 'go', 'there', '.'] 2020-02-09 14:17:50,242 Source: Corinna said : “ We left our work area in the evening and walked to a railway station 25 kilometers ( 15 miles ) away . 2020-02-09 14:17:50,242 Reference: Corinna talk sey : “ We comot for where we dey work for evening come trek go where people dey enter train wey be 25 kilometer ( 15 miles ) from where the farm dey . 2020-02-09 14:17:50,242 Hypothesis: Corinna , wey come from prison , talk sey : “ We stay for where we dey stay . We come dey stay there for 25 kilometers ( 15 km ) go there . 2020-02-09 14:17:50,242 Example #2 2020-02-09 14:17:50,242 Raw source: ['Ro@@', 'man@@', 'tic', 'love', '(', 'e@@', 'ʹ@@', 'ro@@', 's', ')', 'brings', 'delight', ',', 'and', 'love', 'for', 'family', '(', 'st@@', 'or@@', '·@@', 'ge@@', 'ʹ', ')', 'is', 'vital', 'when', 'children', 'enter', 'the', 'picture', '.'] 2020-02-09 14:17:50,242 Raw hypothesis: ['We', 'no', 'dey', 'show', 'love', 'play', '.', 'We', 'dey', 'enjoy', 'to', 'care', 'for', 'our', 'family', '(', 'Matt', '.'] 2020-02-09 14:17:50,242 Source: Romantic love ( eʹros ) brings delight , and love for family ( stor·geʹ ) is vital when children enter the picture . 2020-02-09 14:17:50,242 Reference: ( 1 ) Love wey friend get for each other ( Greek , phi·liʹa ) ; ( 2 ) love wey man and woman get for each other ( eʹros ) ; ( 3 ) love wey people for family get for each other ( stor·geʹ ) . 2020-02-09 14:17:50,242 Hypothesis: We no dey show love play . We dey enjoy to care for our family ( Matt . 2020-02-09 14:17:50,242 Example #3 2020-02-09 14:17:50,242 Raw source: ['As', 'our', 'loving', 'De@@', 'sign@@', 'er', 'and', 'Creator', ',', 'Jehovah', 'knows', 'what', 'we', 'need', 'in', 'order', 'to', 'be', 'truly', 'happy', ',', 'and', 'he', 'f@@', 'ill@@', 's', 'that', 'need', 'ab@@', 'un@@', 'd@@', 'an@@', 'tly', '.'] 2020-02-09 14:17:50,243 Raw hypothesis: ['As', 'Jehovah', 'love', 'us', ',', 'we', 'know', 'wetin', 'e', 'really', 'need', 'and', 'wetin', 'we', 'no', 'fit', 'do', 'to', 'make', 'am', 'happy', '.'] 2020-02-09 14:17:50,243 Source: As our loving Designer and Creator , Jehovah knows what we need in order to be truly happy , and he fills that need abundantly . 2020-02-09 14:17:50,243 Reference: Because na Jehovah make us , e know wetin go make us happy . E don even give us pass wetin we need . 2020-02-09 14:17:50,243 Hypothesis: As Jehovah love us , we know wetin e really need and wetin we no fit do to make am happy . 2020-02-09 14:17:50,243 Validation result (greedy) at epoch 172, step 37000: bleu: 13.90, loss: 58058.8984, ppl: 12.6205, duration: 12.4897s 2020-02-09 14:18:00,155 Epoch 172 Step: 37100 Batch Loss: 0.769521 Tokens per Sec: 21285, Lr: 0.000072 2020-02-09 14:18:08,438 Epoch 172: total training loss 158.29 2020-02-09 14:18:08,438 EPOCH 173 2020-02-09 14:18:10,182 Epoch 173 Step: 37200 Batch Loss: 0.821173 Tokens per Sec: 22753, Lr: 0.000072 2020-02-09 14:18:20,110 Epoch 173 Step: 37300 Batch Loss: 0.305585 Tokens per Sec: 21509, Lr: 0.000072 2020-02-09 14:18:29,890 Epoch 173: total training loss 157.98 2020-02-09 14:18:29,890 EPOCH 174 2020-02-09 14:18:30,136 Epoch 174 Step: 37400 Batch Loss: 0.743520 Tokens per Sec: 18172, Lr: 0.000072 2020-02-09 14:18:40,052 Epoch 174 Step: 37500 Batch Loss: 0.572477 Tokens per Sec: 21162, Lr: 0.000072 2020-02-09 14:18:49,984 Epoch 174 Step: 37600 Batch Loss: 0.582629 Tokens per Sec: 21819, Lr: 0.000072 2020-02-09 14:18:51,292 Epoch 174: total training loss 158.26 2020-02-09 14:18:51,292 EPOCH 175 2020-02-09 14:19:00,037 Epoch 175 Step: 37700 Batch Loss: 0.719113 Tokens per Sec: 21360, Lr: 0.000072 2020-02-09 14:19:10,054 Epoch 175 Step: 37800 Batch Loss: 0.837759 Tokens per Sec: 21285, Lr: 0.000072 2020-02-09 14:19:12,815 Epoch 175: total training loss 157.71 2020-02-09 14:19:12,815 EPOCH 176 2020-02-09 14:19:20,090 Epoch 176 Step: 37900 Batch Loss: 0.820353 Tokens per Sec: 20788, Lr: 0.000072 2020-02-09 14:19:30,138 Epoch 176 Step: 38000 Batch Loss: 0.584996 Tokens per Sec: 21018, Lr: 0.000072 2020-02-09 14:19:42,516 Example #0 2020-02-09 14:19:42,516 Raw source: ['Jehovah', 'did', 'not', 'do', 'that', ',', 'but', 'he', 'allowed', 'Satan', 'to', 'test', 'Job', ',', 'st@@', 'ating', ':', '“', 'Every@@', 'thing', 'that', 'he', 'has', 'is', 'in', 'your', 'hand', '.', '”'] 2020-02-09 14:19:42,516 Raw hypothesis: ['Jehovah', 'no', 'let', 'Satan', 'suffer', 'Job', '.', 'But', 'e', 'no', 'leave', 'wetin', 'e', 'want', '.', 'Jehovah', 'tell', 'Job', 'sey', ':', '‘', 'Any@@', 'body', 'wey', 'get', 'power', ',', 'but', 'e', 'never', 'do', 'am', '.', '’'] 2020-02-09 14:19:42,517 Source: Jehovah did not do that , but he allowed Satan to test Job , stating : “ Everything that he has is in your hand . ” 2020-02-09 14:19:42,517 Reference: E tell am sey : ‘ Everything wey e get dey your hand . ’ 2020-02-09 14:19:42,517 Hypothesis: Jehovah no let Satan suffer Job . But e no leave wetin e want . Jehovah tell Job sey : ‘ Anybody wey get power , but e never do am . ’ 2020-02-09 14:19:42,517 Example #1 2020-02-09 14:19:42,517 Raw source: ['Corin@@', 'na', 'said', ':', '“', 'We', 'left', 'our', 'work', 'area', 'in', 'the', 'evening', 'and', 'wal@@', 'ked', 'to', 'a', 'ra@@', 'il@@', 'way', 'st@@', 'ation', '25', 'ki@@', 'lo@@', 'me@@', 'ters', '(', '15', 'miles', ')', 'away', '.'] 2020-02-09 14:19:42,517 Raw hypothesis: ['Corin@@', 'na', ',', 'wey', 'come', 'from', 'prison', ',', 'talk', 'sey', ':', '“', 'We', 'stay', 'for', 'where', 'we', 'dey', 'stay', '.', 'We', 'come', 'still', 'dey', 'stay', 'there', 'for', '25', 'ki@@', 'lo@@', 'me@@', 'ters', '(', '15', 'km', ')', 'go', 'there', '.'] 2020-02-09 14:19:42,517 Source: Corinna said : “ We left our work area in the evening and walked to a railway station 25 kilometers ( 15 miles ) away . 2020-02-09 14:19:42,517 Reference: Corinna talk sey : “ We comot for where we dey work for evening come trek go where people dey enter train wey be 25 kilometer ( 15 miles ) from where the farm dey . 2020-02-09 14:19:42,517 Hypothesis: Corinna , wey come from prison , talk sey : “ We stay for where we dey stay . We come still dey stay there for 25 kilometers ( 15 km ) go there . 2020-02-09 14:19:42,517 Example #2 2020-02-09 14:19:42,517 Raw source: ['Ro@@', 'man@@', 'tic', 'love', '(', 'e@@', 'ʹ@@', 'ro@@', 's', ')', 'brings', 'delight', ',', 'and', 'love', 'for', 'family', '(', 'st@@', 'or@@', '·@@', 'ge@@', 'ʹ', ')', 'is', 'vital', 'when', 'children', 'enter', 'the', 'picture', '.'] 2020-02-09 14:19:42,517 Raw hypothesis: ['We', 'no', 'dey', 'show', 'love', 'play', '.', 'We', 'dey', 'enjoy', 'to', 'care', 'for', 'our', 'family', '(', 'Matt', '.'] 2020-02-09 14:19:42,517 Source: Romantic love ( eʹros ) brings delight , and love for family ( stor·geʹ ) is vital when children enter the picture . 2020-02-09 14:19:42,517 Reference: ( 1 ) Love wey friend get for each other ( Greek , phi·liʹa ) ; ( 2 ) love wey man and woman get for each other ( eʹros ) ; ( 3 ) love wey people for family get for each other ( stor·geʹ ) . 2020-02-09 14:19:42,517 Hypothesis: We no dey show love play . We dey enjoy to care for our family ( Matt . 2020-02-09 14:19:42,518 Example #3 2020-02-09 14:19:42,518 Raw source: ['As', 'our', 'loving', 'De@@', 'sign@@', 'er', 'and', 'Creator', ',', 'Jehovah', 'knows', 'what', 'we', 'need', 'in', 'order', 'to', 'be', 'truly', 'happy', ',', 'and', 'he', 'f@@', 'ill@@', 's', 'that', 'need', 'ab@@', 'un@@', 'd@@', 'an@@', 'tly', '.'] 2020-02-09 14:19:42,518 Raw hypothesis: ['As', 'Jehovah', 'love', 'us', ',', 'we', 'know', 'wetin', 'e', 'really', 'need', 'and', 'wetin', 'we', 'no', 'fit', 'do', 'to', 'make', 'am', 'happy', '.'] 2020-02-09 14:19:42,518 Source: As our loving Designer and Creator , Jehovah knows what we need in order to be truly happy , and he fills that need abundantly . 2020-02-09 14:19:42,518 Reference: Because na Jehovah make us , e know wetin go make us happy . E don even give us pass wetin we need . 2020-02-09 14:19:42,518 Hypothesis: As Jehovah love us , we know wetin e really need and wetin we no fit do to make am happy . 2020-02-09 14:19:42,518 Validation result (greedy) at epoch 176, step 38000: bleu: 13.88, loss: 58165.6484, ppl: 12.6795, duration: 12.3789s 2020-02-09 14:19:46,882 Epoch 176: total training loss 157.69 2020-02-09 14:19:46,882 EPOCH 177 2020-02-09 14:19:52,491 Epoch 177 Step: 38100 Batch Loss: 0.839295 Tokens per Sec: 21240, Lr: 0.000072 2020-02-09 14:20:02,412 Epoch 177 Step: 38200 Batch Loss: 0.867415 Tokens per Sec: 21135, Lr: 0.000072 2020-02-09 14:20:08,444 Epoch 177: total training loss 157.32 2020-02-09 14:20:08,445 EPOCH 178 2020-02-09 14:20:12,471 Epoch 178 Step: 38300 Batch Loss: 0.684579 Tokens per Sec: 20472, Lr: 0.000072 2020-02-09 14:20:22,483 Epoch 178 Step: 38400 Batch Loss: 0.888620 Tokens per Sec: 21269, Lr: 0.000072 2020-02-09 14:20:30,008 Epoch 178: total training loss 157.04 2020-02-09 14:20:30,008 EPOCH 179 2020-02-09 14:20:32,406 Epoch 179 Step: 38500 Batch Loss: 0.747984 Tokens per Sec: 20546, Lr: 0.000072 2020-02-09 14:20:42,318 Epoch 179 Step: 38600 Batch Loss: 0.880630 Tokens per Sec: 21455, Lr: 0.000072 2020-02-09 14:20:51,587 Epoch 179: total training loss 158.21 2020-02-09 14:20:51,587 EPOCH 180 2020-02-09 14:20:52,223 Epoch 180 Step: 38700 Batch Loss: 0.715024 Tokens per Sec: 19638, Lr: 0.000072 2020-02-09 14:21:02,175 Epoch 180 Step: 38800 Batch Loss: 0.700444 Tokens per Sec: 21450, Lr: 0.000072 2020-02-09 14:21:12,087 Epoch 180 Step: 38900 Batch Loss: 0.672916 Tokens per Sec: 21168, Lr: 0.000072 2020-02-09 14:21:13,071 Epoch 180: total training loss 155.96 2020-02-09 14:21:13,072 EPOCH 181 2020-02-09 14:21:22,093 Epoch 181 Step: 39000 Batch Loss: 0.338834 Tokens per Sec: 21004, Lr: 0.000072 2020-02-09 14:21:34,349 Example #0 2020-02-09 14:21:34,349 Raw source: ['Jehovah', 'did', 'not', 'do', 'that', ',', 'but', 'he', 'allowed', 'Satan', 'to', 'test', 'Job', ',', 'st@@', 'ating', ':', '“', 'Every@@', 'thing', 'that', 'he', 'has', 'is', 'in', 'your', 'hand', '.', '”'] 2020-02-09 14:21:34,349 Raw hypothesis: ['Jehovah', 'no', 'let', 'Satan', 'do', 'wetin', 'e', 'no', 'like', '.', 'E', 'tell', 'Job', 'sey', ':', '‘', 'Any@@', 'body', 'wey', 'dey', 'do', 'wetin', 'e', 'want', ',', 'na', 'im', 'be', 'your', 'hand', '.', '’'] 2020-02-09 14:21:34,349 Source: Jehovah did not do that , but he allowed Satan to test Job , stating : “ Everything that he has is in your hand . ” 2020-02-09 14:21:34,349 Reference: E tell am sey : ‘ Everything wey e get dey your hand . ’ 2020-02-09 14:21:34,349 Hypothesis: Jehovah no let Satan do wetin e no like . E tell Job sey : ‘ Anybody wey dey do wetin e want , na im be your hand . ’ 2020-02-09 14:21:34,349 Example #1 2020-02-09 14:21:34,350 Raw source: ['Corin@@', 'na', 'said', ':', '“', 'We', 'left', 'our', 'work', 'area', 'in', 'the', 'evening', 'and', 'wal@@', 'ked', 'to', 'a', 'ra@@', 'il@@', 'way', 'st@@', 'ation', '25', 'ki@@', 'lo@@', 'me@@', 'ters', '(', '15', 'miles', ')', 'away', '.'] 2020-02-09 14:21:34,350 Raw hypothesis: ['Corin@@', 'na', ',', 'wey', 'come', 'from', 'prison', ',', 'talk', 'sey', ':', '‘', 'We', 'comot', 'for', 'where', 'we', 'dey', 'stay', '.', 'We', 'come', 'comot', 'go', 'where', 'we', 'dey', 'go', '.', 'We', 'dey', 'stay', 'for', 'there', 'for', '15', 'ki@@', 'lo@@', 'me@@', 'ters', '(', '15', 'km', ')', '.'] 2020-02-09 14:21:34,350 Source: Corinna said : “ We left our work area in the evening and walked to a railway station 25 kilometers ( 15 miles ) away . 2020-02-09 14:21:34,350 Reference: Corinna talk sey : “ We comot for where we dey work for evening come trek go where people dey enter train wey be 25 kilometer ( 15 miles ) from where the farm dey . 2020-02-09 14:21:34,350 Hypothesis: Corinna , wey come from prison , talk sey : ‘ We comot for where we dey stay . We come comot go where we dey go . We dey stay for there for 15 kilometers ( 15 km ) . 2020-02-09 14:21:34,350 Example #2 2020-02-09 14:21:34,350 Raw source: ['Ro@@', 'man@@', 'tic', 'love', '(', 'e@@', 'ʹ@@', 'ro@@', 's', ')', 'brings', 'delight', ',', 'and', 'love', 'for', 'family', '(', 'st@@', 'or@@', '·@@', 'ge@@', 'ʹ', ')', 'is', 'vital', 'when', 'children', 'enter', 'the', 'picture', '.'] 2020-02-09 14:21:34,350 Raw hypothesis: ['We', 'no', 'dey', 'like', 'to', 'play', '.', 'We', 'dey', 'enjoy', 'to', 'show', 'love', ',', 'and', 'our', 'family', '(', '4', ')', 'when', 'we', 'dey', 'show', 'dem', 'love', '.'] 2020-02-09 14:21:34,350 Source: Romantic love ( eʹros ) brings delight , and love for family ( stor·geʹ ) is vital when children enter the picture . 2020-02-09 14:21:34,350 Reference: ( 1 ) Love wey friend get for each other ( Greek , phi·liʹa ) ; ( 2 ) love wey man and woman get for each other ( eʹros ) ; ( 3 ) love wey people for family get for each other ( stor·geʹ ) . 2020-02-09 14:21:34,350 Hypothesis: We no dey like to play . We dey enjoy to show love , and our family ( 4 ) when we dey show dem love . 2020-02-09 14:21:34,350 Example #3 2020-02-09 14:21:34,350 Raw source: ['As', 'our', 'loving', 'De@@', 'sign@@', 'er', 'and', 'Creator', ',', 'Jehovah', 'knows', 'what', 'we', 'need', 'in', 'order', 'to', 'be', 'truly', 'happy', ',', 'and', 'he', 'f@@', 'ill@@', 's', 'that', 'need', 'ab@@', 'un@@', 'd@@', 'an@@', 'tly', '.'] 2020-02-09 14:21:34,350 Raw hypothesis: ['As', 'Jehovah', 'love', 'us', ',', 'na', 'im', 'make', 'us', 'and', 'wetin', 'we', 'need', 'to', 'really', 'dey', 'happy', '.'] 2020-02-09 14:21:34,350 Source: As our loving Designer and Creator , Jehovah knows what we need in order to be truly happy , and he fills that need abundantly . 2020-02-09 14:21:34,350 Reference: Because na Jehovah make us , e know wetin go make us happy . E don even give us pass wetin we need . 2020-02-09 14:21:34,351 Hypothesis: As Jehovah love us , na im make us and wetin we need to really dey happy . 2020-02-09 14:21:34,351 Validation result (greedy) at epoch 181, step 39000: bleu: 14.05, loss: 58317.5391, ppl: 12.7639, duration: 12.2573s 2020-02-09 14:21:44,280 Epoch 181 Step: 39100 Batch Loss: 0.770275 Tokens per Sec: 21262, Lr: 0.000072 2020-02-09 14:21:46,863 Epoch 181: total training loss 155.99 2020-02-09 14:21:46,864 EPOCH 182 2020-02-09 14:21:54,235 Epoch 182 Step: 39200 Batch Loss: 0.227631 Tokens per Sec: 21109, Lr: 0.000072 2020-02-09 14:22:04,147 Epoch 182 Step: 39300 Batch Loss: 0.759427 Tokens per Sec: 21534, Lr: 0.000072 2020-02-09 14:22:08,424 Epoch 182: total training loss 156.69 2020-02-09 14:22:08,424 EPOCH 183 2020-02-09 14:22:14,115 Epoch 183 Step: 39400 Batch Loss: 0.530501 Tokens per Sec: 21576, Lr: 0.000072 2020-02-09 14:22:24,037 Epoch 183 Step: 39500 Batch Loss: 0.611335 Tokens per Sec: 20774, Lr: 0.000072 2020-02-09 14:22:30,008 Epoch 183: total training loss 156.20 2020-02-09 14:22:30,008 EPOCH 184 2020-02-09 14:22:34,037 Epoch 184 Step: 39600 Batch Loss: 0.632424 Tokens per Sec: 20706, Lr: 0.000072 2020-02-09 14:22:44,046 Epoch 184 Step: 39700 Batch Loss: 0.458936 Tokens per Sec: 21489, Lr: 0.000072 2020-02-09 14:22:51,656 Epoch 184: total training loss 156.09 2020-02-09 14:22:51,656 EPOCH 185 2020-02-09 14:22:54,090 Epoch 185 Step: 39800 Batch Loss: 0.359203 Tokens per Sec: 20522, Lr: 0.000072 2020-02-09 14:23:04,002 Epoch 185 Step: 39900 Batch Loss: 0.567300 Tokens per Sec: 21396, Lr: 0.000072 2020-02-09 14:23:13,377 Epoch 185: total training loss 156.37 2020-02-09 14:23:13,378 EPOCH 186 2020-02-09 14:23:14,013 Epoch 186 Step: 40000 Batch Loss: 0.797387 Tokens per Sec: 19579, Lr: 0.000072 2020-02-09 14:23:26,217 Example #0 2020-02-09 14:23:26,217 Raw source: ['Jehovah', 'did', 'not', 'do', 'that', ',', 'but', 'he', 'allowed', 'Satan', 'to', 'test', 'Job', ',', 'st@@', 'ating', ':', '“', 'Every@@', 'thing', 'that', 'he', 'has', 'is', 'in', 'your', 'hand', '.', '”'] 2020-02-09 14:23:26,217 Raw hypothesis: ['Jehovah', 'no', 'let', 'Satan', 'do', 'wetin', 'e', 'no', 'like', '.', 'E', 'tell', 'Job', 'sey', ':', '‘', 'Any@@', 'body', 'wey', 'dey', 'do', 'wetin', 'e', 'want', ',', 'na', 'im', 'be', 'your', 'hand', '.', '’'] 2020-02-09 14:23:26,217 Source: Jehovah did not do that , but he allowed Satan to test Job , stating : “ Everything that he has is in your hand . ” 2020-02-09 14:23:26,217 Reference: E tell am sey : ‘ Everything wey e get dey your hand . ’ 2020-02-09 14:23:26,217 Hypothesis: Jehovah no let Satan do wetin e no like . E tell Job sey : ‘ Anybody wey dey do wetin e want , na im be your hand . ’ 2020-02-09 14:23:26,217 Example #1 2020-02-09 14:23:26,217 Raw source: ['Corin@@', 'na', 'said', ':', '“', 'We', 'left', 'our', 'work', 'area', 'in', 'the', 'evening', 'and', 'wal@@', 'ked', 'to', 'a', 'ra@@', 'il@@', 'way', 'st@@', 'ation', '25', 'ki@@', 'lo@@', 'me@@', 'ters', '(', '15', 'miles', ')', 'away', '.'] 2020-02-09 14:23:26,217 Raw hypothesis: ['Corin@@', 'na', ',', 'wey', 'come', 'from', 'prison', ',', 'talk', 'sey', ':', '‘', 'We', 'comot', 'for', 'where', 'we', 'dey', 'stay', '.', 'We', 'stay', 'there', 'for', '25', 'ki@@', 'lo@@', 'me@@', 'ters', '(', '15', 'km', ')', 'go', 'there', '.'] 2020-02-09 14:23:26,217 Source: Corinna said : “ We left our work area in the evening and walked to a railway station 25 kilometers ( 15 miles ) away . 2020-02-09 14:23:26,218 Reference: Corinna talk sey : “ We comot for where we dey work for evening come trek go where people dey enter train wey be 25 kilometer ( 15 miles ) from where the farm dey . 2020-02-09 14:23:26,218 Hypothesis: Corinna , wey come from prison , talk sey : ‘ We comot for where we dey stay . We stay there for 25 kilometers ( 15 km ) go there . 2020-02-09 14:23:26,218 Example #2 2020-02-09 14:23:26,218 Raw source: ['Ro@@', 'man@@', 'tic', 'love', '(', 'e@@', 'ʹ@@', 'ro@@', 's', ')', 'brings', 'delight', ',', 'and', 'love', 'for', 'family', '(', 'st@@', 'or@@', '·@@', 'ge@@', 'ʹ', ')', 'is', 'vital', 'when', 'children', 'enter', 'the', 'picture', '.'] 2020-02-09 14:23:26,218 Raw hypothesis: ['We', 'no', 'dey', 'show', 'love', 'play', '.', 'We', 'dey', 'enjoy', 'to', 'love', 'dem', '(', 'other', 'people', ')', 'when', 'dem', 'dey', 'show', 'love', 'their', 'family', 'and', 'other', 'things', '.'] 2020-02-09 14:23:26,218 Source: Romantic love ( eʹros ) brings delight , and love for family ( stor·geʹ ) is vital when children enter the picture . 2020-02-09 14:23:26,218 Reference: ( 1 ) Love wey friend get for each other ( Greek , phi·liʹa ) ; ( 2 ) love wey man and woman get for each other ( eʹros ) ; ( 3 ) love wey people for family get for each other ( stor·geʹ ) . 2020-02-09 14:23:26,218 Hypothesis: We no dey show love play . We dey enjoy to love dem ( other people ) when dem dey show love their family and other things . 2020-02-09 14:23:26,218 Example #3 2020-02-09 14:23:26,218 Raw source: ['As', 'our', 'loving', 'De@@', 'sign@@', 'er', 'and', 'Creator', ',', 'Jehovah', 'knows', 'what', 'we', 'need', 'in', 'order', 'to', 'be', 'truly', 'happy', ',', 'and', 'he', 'f@@', 'ill@@', 's', 'that', 'need', 'ab@@', 'un@@', 'd@@', 'an@@', 'tly', '.'] 2020-02-09 14:23:26,218 Raw hypothesis: ['As', 'Jehovah', 'love', 'us', 'and', 'na', 'im', 'make', 'us', ',', 'e', 'know', 'wetin', 'we', 'need', 'and', 'wetin', 'we', 'really', 'need', '.'] 2020-02-09 14:23:26,218 Source: As our loving Designer and Creator , Jehovah knows what we need in order to be truly happy , and he fills that need abundantly . 2020-02-09 14:23:26,218 Reference: Because na Jehovah make us , e know wetin go make us happy . E don even give us pass wetin we need . 2020-02-09 14:23:26,218 Hypothesis: As Jehovah love us and na im make us , e know wetin we need and wetin we really need . 2020-02-09 14:23:26,218 Validation result (greedy) at epoch 186, step 40000: bleu: 14.23, loss: 58420.3828, ppl: 12.8213, duration: 12.2052s 2020-02-09 14:23:36,067 Epoch 186 Step: 40100 Batch Loss: 0.371000 Tokens per Sec: 21901, Lr: 0.000050 2020-02-09 14:23:45,919 Epoch 186 Step: 40200 Batch Loss: 0.779848 Tokens per Sec: 21101, Lr: 0.000050 2020-02-09 14:23:46,902 Epoch 186: total training loss 153.79 2020-02-09 14:23:46,902 EPOCH 187 2020-02-09 14:23:55,806 Epoch 187 Step: 40300 Batch Loss: 0.666796 Tokens per Sec: 21358, Lr: 0.000050 2020-02-09 14:24:05,679 Epoch 187 Step: 40400 Batch Loss: 0.693041 Tokens per Sec: 21568, Lr: 0.000050 2020-02-09 14:24:08,231 Epoch 187: total training loss 153.45 2020-02-09 14:24:08,231 EPOCH 188 2020-02-09 14:24:15,587 Epoch 188 Step: 40500 Batch Loss: 0.745225 Tokens per Sec: 21125, Lr: 0.000050 2020-02-09 14:24:25,460 Epoch 188 Step: 40600 Batch Loss: 0.297083 Tokens per Sec: 21297, Lr: 0.000050 2020-02-09 14:24:29,691 Epoch 188: total training loss 153.67 2020-02-09 14:24:29,692 EPOCH 189 2020-02-09 14:24:35,369 Epoch 189 Step: 40700 Batch Loss: 0.654812 Tokens per Sec: 21283, Lr: 0.000050 2020-02-09 14:24:45,250 Epoch 189 Step: 40800 Batch Loss: 0.321035 Tokens per Sec: 21423, Lr: 0.000050 2020-02-09 14:24:51,077 Epoch 189: total training loss 152.52 2020-02-09 14:24:51,078 EPOCH 190 2020-02-09 14:24:55,157 Epoch 190 Step: 40900 Batch Loss: 0.579763 Tokens per Sec: 20671, Lr: 0.000050 2020-02-09 14:25:05,078 Epoch 190 Step: 41000 Batch Loss: 0.804572 Tokens per Sec: 21245, Lr: 0.000050 2020-02-09 14:25:17,237 Example #0 2020-02-09 14:25:17,237 Raw source: ['Jehovah', 'did', 'not', 'do', 'that', ',', 'but', 'he', 'allowed', 'Satan', 'to', 'test', 'Job', ',', 'st@@', 'ating', ':', '“', 'Every@@', 'thing', 'that', 'he', 'has', 'is', 'in', 'your', 'hand', '.', '”'] 2020-02-09 14:25:17,237 Raw hypothesis: ['Jehovah', 'no', 'let', 'Satan', 'do', 'wetin', 'e', 'no', 'like', '.', 'E', 'tell', 'Job', 'sey', ':', '‘', 'Any@@', 'body', 'wey', 'dey', 'do', 'wetin', 'e', 'want', ',', 'na', 'im', 'be', 'the', 'true', 'God', '.', '’'] 2020-02-09 14:25:17,238 Source: Jehovah did not do that , but he allowed Satan to test Job , stating : “ Everything that he has is in your hand . ” 2020-02-09 14:25:17,238 Reference: E tell am sey : ‘ Everything wey e get dey your hand . ’ 2020-02-09 14:25:17,238 Hypothesis: Jehovah no let Satan do wetin e no like . E tell Job sey : ‘ Anybody wey dey do wetin e want , na im be the true God . ’ 2020-02-09 14:25:17,238 Example #1 2020-02-09 14:25:17,238 Raw source: ['Corin@@', 'na', 'said', ':', '“', 'We', 'left', 'our', 'work', 'area', 'in', 'the', 'evening', 'and', 'wal@@', 'ked', 'to', 'a', 'ra@@', 'il@@', 'way', 'st@@', 'ation', '25', 'ki@@', 'lo@@', 'me@@', 'ters', '(', '15', 'miles', ')', 'away', '.'] 2020-02-09 14:25:17,238 Raw hypothesis: ['Corin@@', 'na', ',', 'e', 'come', 'sey', ':', '‘', 'We', 'comot', 'for', 'where', 'we', 'dey', 'stay', '.', 'We', 'dey', 'stay', 'there', 'for', 'where', 'we', 'dey', 'go', '.', 'We', 'dey', 'go', 'preach', 'for', 'there', '.'] 2020-02-09 14:25:17,238 Source: Corinna said : “ We left our work area in the evening and walked to a railway station 25 kilometers ( 15 miles ) away . 2020-02-09 14:25:17,238 Reference: Corinna talk sey : “ We comot for where we dey work for evening come trek go where people dey enter train wey be 25 kilometer ( 15 miles ) from where the farm dey . 2020-02-09 14:25:17,238 Hypothesis: Corinna , e come sey : ‘ We comot for where we dey stay . We dey stay there for where we dey go . We dey go preach for there . 2020-02-09 14:25:17,238 Example #2 2020-02-09 14:25:17,238 Raw source: ['Ro@@', 'man@@', 'tic', 'love', '(', 'e@@', 'ʹ@@', 'ro@@', 's', ')', 'brings', 'delight', ',', 'and', 'love', 'for', 'family', '(', 'st@@', 'or@@', '·@@', 'ge@@', 'ʹ', ')', 'is', 'vital', 'when', 'children', 'enter', 'the', 'picture', '.'] 2020-02-09 14:25:17,238 Raw hypothesis: ['We', 'no', 'dey', 'show', 'love', 'to', 'enjoy', 'our', 'family', '(', 'ad@@', 'ca@@', 's', ')', 'when', 'we', 'dey', 'show', 'love', 'play', 'our', 'pikin', ',', 'and', 'we', 'dey', 'show', 'our', 'children', 'love', '.'] 2020-02-09 14:25:17,238 Source: Romantic love ( eʹros ) brings delight , and love for family ( stor·geʹ ) is vital when children enter the picture . 2020-02-09 14:25:17,238 Reference: ( 1 ) Love wey friend get for each other ( Greek , phi·liʹa ) ; ( 2 ) love wey man and woman get for each other ( eʹros ) ; ( 3 ) love wey people for family get for each other ( stor·geʹ ) . 2020-02-09 14:25:17,238 Hypothesis: We no dey show love to enjoy our family ( adcas ) when we dey show love play our pikin , and we dey show our children love . 2020-02-09 14:25:17,239 Example #3 2020-02-09 14:25:17,239 Raw source: ['As', 'our', 'loving', 'De@@', 'sign@@', 'er', 'and', 'Creator', ',', 'Jehovah', 'knows', 'what', 'we', 'need', 'in', 'order', 'to', 'be', 'truly', 'happy', ',', 'and', 'he', 'f@@', 'ill@@', 's', 'that', 'need', 'ab@@', 'un@@', 'd@@', 'an@@', 'tly', '.'] 2020-02-09 14:25:17,239 Raw hypothesis: ['As', 'Jehovah', 'love', 'us', ',', 'na', 'im', 'make', 'us', 'and', 'wetin', 'we', 'need', 'to', 'really', 'dey', 'happy', '.'] 2020-02-09 14:25:17,239 Source: As our loving Designer and Creator , Jehovah knows what we need in order to be truly happy , and he fills that need abundantly . 2020-02-09 14:25:17,239 Reference: Because na Jehovah make us , e know wetin go make us happy . E don even give us pass wetin we need . 2020-02-09 14:25:17,239 Hypothesis: As Jehovah love us , na im make us and wetin we need to really dey happy . 2020-02-09 14:25:17,239 Validation result (greedy) at epoch 190, step 41000: bleu: 13.84, loss: 58521.4727, ppl: 12.8780, duration: 12.1607s 2020-02-09 14:25:24,905 Epoch 190: total training loss 154.18 2020-02-09 14:25:24,905 EPOCH 191 2020-02-09 14:25:27,111 Epoch 191 Step: 41100 Batch Loss: 0.751742 Tokens per Sec: 20157, Lr: 0.000050 2020-02-09 14:25:36,981 Epoch 191 Step: 41200 Batch Loss: 0.704487 Tokens per Sec: 21397, Lr: 0.000050 2020-02-09 14:25:46,267 Epoch 191: total training loss 152.09 2020-02-09 14:25:46,268 EPOCH 192 2020-02-09 14:25:46,910 Epoch 192 Step: 41300 Batch Loss: 0.321632 Tokens per Sec: 18733, Lr: 0.000050 2020-02-09 14:25:56,826 Epoch 192 Step: 41400 Batch Loss: 0.707680 Tokens per Sec: 21317, Lr: 0.000050 2020-02-09 14:26:06,661 Epoch 192 Step: 41500 Batch Loss: 0.677484 Tokens per Sec: 21201, Lr: 0.000050 2020-02-09 14:26:07,841 Epoch 192: total training loss 153.01 2020-02-09 14:26:07,841 EPOCH 193 2020-02-09 14:26:16,621 Epoch 193 Step: 41600 Batch Loss: 0.795605 Tokens per Sec: 21411, Lr: 0.000050 2020-02-09 14:26:26,461 Epoch 193 Step: 41700 Batch Loss: 0.748809 Tokens per Sec: 21260, Lr: 0.000050 2020-02-09 14:26:29,311 Epoch 193: total training loss 152.26 2020-02-09 14:26:29,311 EPOCH 194 2020-02-09 14:26:36,362 Epoch 194 Step: 41800 Batch Loss: 0.730199 Tokens per Sec: 20853, Lr: 0.000050 2020-02-09 14:26:46,246 Epoch 194 Step: 41900 Batch Loss: 0.782122 Tokens per Sec: 21153, Lr: 0.000050 2020-02-09 14:26:50,892 Epoch 194: total training loss 151.95 2020-02-09 14:26:50,893 EPOCH 195 2020-02-09 14:26:56,155 Epoch 195 Step: 42000 Batch Loss: 0.748613 Tokens per Sec: 21127, Lr: 0.000050 2020-02-09 14:27:08,746 Example #0 2020-02-09 14:27:08,746 Raw source: ['Jehovah', 'did', 'not', 'do', 'that', ',', 'but', 'he', 'allowed', 'Satan', 'to', 'test', 'Job', ',', 'st@@', 'ating', ':', '“', 'Every@@', 'thing', 'that', 'he', 'has', 'is', 'in', 'your', 'hand', '.', '”'] 2020-02-09 14:27:08,746 Raw hypothesis: ['Jehovah', 'no', 'let', 'Satan', 'do', '.', 'E', 'no', 'leave', 'Job', '.', 'But', 'e', 'do', 'wetin', 'Satan', 'talk', '.', 'E', 'sey', ':', '‘', 'Any@@', 'body', 'wey', 'get', 'power', ',', 'e', 'don', 'use', 'your', 'hand', 'do', 'wetin', 'e', 'want', '.', '’'] 2020-02-09 14:27:08,746 Source: Jehovah did not do that , but he allowed Satan to test Job , stating : “ Everything that he has is in your hand . ” 2020-02-09 14:27:08,746 Reference: E tell am sey : ‘ Everything wey e get dey your hand . ’ 2020-02-09 14:27:08,746 Hypothesis: Jehovah no let Satan do . E no leave Job . But e do wetin Satan talk . E sey : ‘ Anybody wey get power , e don use your hand do wetin e want . ’ 2020-02-09 14:27:08,746 Example #1 2020-02-09 14:27:08,747 Raw source: ['Corin@@', 'na', 'said', ':', '“', 'We', 'left', 'our', 'work', 'area', 'in', 'the', 'evening', 'and', 'wal@@', 'ked', 'to', 'a', 'ra@@', 'il@@', 'way', 'st@@', 'ation', '25', 'ki@@', 'lo@@', 'me@@', 'ters', '(', '15', 'miles', ')', 'away', '.'] 2020-02-09 14:27:08,747 Raw hypothesis: ['Corin@@', 'na', ',', 'wey', 'come', 'from', 'prison', ',', 'talk', 'sey', ':', '‘', 'We', 'stay', 'for', 'where', 'we', 'dey', 'stay', '.', 'We', 'come', 'dey', 'stay', 'there', 'for', '25', 'ki@@', 'lo@@', 'me@@', 'ters', '(', '15', 'km', ')', 'go', 'where', 'dem', 'dey', 'call', 'us', 'go', '.'] 2020-02-09 14:27:08,747 Source: Corinna said : “ We left our work area in the evening and walked to a railway station 25 kilometers ( 15 miles ) away . 2020-02-09 14:27:08,747 Reference: Corinna talk sey : “ We comot for where we dey work for evening come trek go where people dey enter train wey be 25 kilometer ( 15 miles ) from where the farm dey . 2020-02-09 14:27:08,747 Hypothesis: Corinna , wey come from prison , talk sey : ‘ We stay for where we dey stay . We come dey stay there for 25 kilometers ( 15 km ) go where dem dey call us go . 2020-02-09 14:27:08,747 Example #2 2020-02-09 14:27:08,747 Raw source: ['Ro@@', 'man@@', 'tic', 'love', '(', 'e@@', 'ʹ@@', 'ro@@', 's', ')', 'brings', 'delight', ',', 'and', 'love', 'for', 'family', '(', 'st@@', 'or@@', '·@@', 'ge@@', 'ʹ', ')', 'is', 'vital', 'when', 'children', 'enter', 'the', 'picture', '.'] 2020-02-09 14:27:08,747 Raw hypothesis: ['We', 'no', 'dey', 'show', 'love', 'play', '.', 'We', 'dey', 'enjoy', 'to', 'care', 'for', 'our', 'family', '(', 'Eph', '.', '4', ':', '5', ')', 'We', 'go', 'still', 'show', 'dem', 'love', ',', 'and', 'our', 'pikin', '.'] 2020-02-09 14:27:08,747 Source: Romantic love ( eʹros ) brings delight , and love for family ( stor·geʹ ) is vital when children enter the picture . 2020-02-09 14:27:08,747 Reference: ( 1 ) Love wey friend get for each other ( Greek , phi·liʹa ) ; ( 2 ) love wey man and woman get for each other ( eʹros ) ; ( 3 ) love wey people for family get for each other ( stor·geʹ ) . 2020-02-09 14:27:08,747 Hypothesis: We no dey show love play . We dey enjoy to care for our family ( Eph . 4 : 5 ) We go still show dem love , and our pikin . 2020-02-09 14:27:08,747 Example #3 2020-02-09 14:27:08,748 Raw source: ['As', 'our', 'loving', 'De@@', 'sign@@', 'er', 'and', 'Creator', ',', 'Jehovah', 'knows', 'what', 'we', 'need', 'in', 'order', 'to', 'be', 'truly', 'happy', ',', 'and', 'he', 'f@@', 'ill@@', 's', 'that', 'need', 'ab@@', 'un@@', 'd@@', 'an@@', 'tly', '.'] 2020-02-09 14:27:08,748 Raw hypothesis: ['As', 'Jehovah', 'love', 'us', 'and', 'na', 'im', 'make', 'us', ',', 'e', 'know', 'wetin', 'we', 'need', 'and', 'e', 'dey', 'really', 'make', 'us', 'happy', '.'] 2020-02-09 14:27:08,748 Source: As our loving Designer and Creator , Jehovah knows what we need in order to be truly happy , and he fills that need abundantly . 2020-02-09 14:27:08,748 Reference: Because na Jehovah make us , e know wetin go make us happy . E don even give us pass wetin we need . 2020-02-09 14:27:08,748 Hypothesis: As Jehovah love us and na im make us , e know wetin we need and e dey really make us happy . 2020-02-09 14:27:08,748 Validation result (greedy) at epoch 195, step 42000: bleu: 13.85, loss: 58654.3438, ppl: 12.9530, duration: 12.5924s 2020-02-09 14:27:18,631 Epoch 195 Step: 42100 Batch Loss: 0.613583 Tokens per Sec: 20873, Lr: 0.000050 2020-02-09 14:27:25,049 Epoch 195: total training loss 151.98 2020-02-09 14:27:25,049 EPOCH 196 2020-02-09 14:27:28,526 Epoch 196 Step: 42200 Batch Loss: 0.743989 Tokens per Sec: 21417, Lr: 0.000050 2020-02-09 14:27:38,351 Epoch 196 Step: 42300 Batch Loss: 0.844665 Tokens per Sec: 21317, Lr: 0.000050 2020-02-09 14:27:46,325 Epoch 196: total training loss 151.28 2020-02-09 14:27:46,325 EPOCH 197 2020-02-09 14:27:48,219 Epoch 197 Step: 42400 Batch Loss: 0.708702 Tokens per Sec: 20393, Lr: 0.000050 2020-02-09 14:27:58,071 Epoch 197 Step: 42500 Batch Loss: 0.415755 Tokens per Sec: 21924, Lr: 0.000050 2020-02-09 14:28:07,718 Epoch 197: total training loss 151.09 2020-02-09 14:28:07,718 EPOCH 198 2020-02-09 14:28:07,963 Epoch 198 Step: 42600 Batch Loss: 0.825495 Tokens per Sec: 19112, Lr: 0.000050 2020-02-09 14:28:17,795 Epoch 198 Step: 42700 Batch Loss: 0.843647 Tokens per Sec: 21215, Lr: 0.000050 2020-02-09 14:28:27,679 Epoch 198 Step: 42800 Batch Loss: 0.833294 Tokens per Sec: 21857, Lr: 0.000050 2020-02-09 14:28:29,056 Epoch 198: total training loss 150.54 2020-02-09 14:28:29,057 EPOCH 199 2020-02-09 14:28:37,595 Epoch 199 Step: 42900 Batch Loss: 0.795709 Tokens per Sec: 20923, Lr: 0.000050 2020-02-09 14:28:47,518 Epoch 199 Step: 43000 Batch Loss: 0.664702 Tokens per Sec: 21448, Lr: 0.000050 2020-02-09 14:28:59,836 Example #0 2020-02-09 14:28:59,836 Raw source: ['Jehovah', 'did', 'not', 'do', 'that', ',', 'but', 'he', 'allowed', 'Satan', 'to', 'test', 'Job', ',', 'st@@', 'ating', ':', '“', 'Every@@', 'thing', 'that', 'he', 'has', 'is', 'in', 'your', 'hand', '.', '”'] 2020-02-09 14:28:59,836 Raw hypothesis: ['Jehovah', 'no', 'let', 'Satan', 'do', 'wetin', 'e', 'no', 'like', '.', 'E', 'tell', 'Job', 'sey', ':', '‘', 'Any@@', 'body', 'wey', 'dey', 'do', 'wetin', 'e', 'want', ',', 'na', 'im', 'be', 'your', 'hand', '.', '’'] 2020-02-09 14:28:59,836 Source: Jehovah did not do that , but he allowed Satan to test Job , stating : “ Everything that he has is in your hand . ” 2020-02-09 14:28:59,836 Reference: E tell am sey : ‘ Everything wey e get dey your hand . ’ 2020-02-09 14:28:59,837 Hypothesis: Jehovah no let Satan do wetin e no like . E tell Job sey : ‘ Anybody wey dey do wetin e want , na im be your hand . ’ 2020-02-09 14:28:59,837 Example #1 2020-02-09 14:28:59,837 Raw source: ['Corin@@', 'na', 'said', ':', '“', 'We', 'left', 'our', 'work', 'area', 'in', 'the', 'evening', 'and', 'wal@@', 'ked', 'to', 'a', 'ra@@', 'il@@', 'way', 'st@@', 'ation', '25', 'ki@@', 'lo@@', 'me@@', 'ters', '(', '15', 'miles', ')', 'away', '.'] 2020-02-09 14:28:59,837 Raw hypothesis: ['Corin@@', 'na', ',', 'wey', 'come', 'from', 'prison', ',', 'talk', 'sey', ':', '‘', 'We', 'stay', 'for', 'where', 'we', 'dey', 'stay', '.', 'We', 'come', 'still', 'dey', 'comot', 'for', 'where', 'dem', 'dey', 'call', 'ra@@', 'ki@@', 'lo@@', 'me@@', 'ters', '(', '15', 'km', ')', 'go', 'preach', '.'] 2020-02-09 14:28:59,837 Source: Corinna said : “ We left our work area in the evening and walked to a railway station 25 kilometers ( 15 miles ) away . 2020-02-09 14:28:59,837 Reference: Corinna talk sey : “ We comot for where we dey work for evening come trek go where people dey enter train wey be 25 kilometer ( 15 miles ) from where the farm dey . 2020-02-09 14:28:59,837 Hypothesis: Corinna , wey come from prison , talk sey : ‘ We stay for where we dey stay . We come still dey comot for where dem dey call rakilometers ( 15 km ) go preach . 2020-02-09 14:28:59,837 Example #2 2020-02-09 14:28:59,837 Raw source: ['Ro@@', 'man@@', 'tic', 'love', '(', 'e@@', 'ʹ@@', 'ro@@', 's', ')', 'brings', 'delight', ',', 'and', 'love', 'for', 'family', '(', 'st@@', 'or@@', '·@@', 'ge@@', 'ʹ', ')', 'is', 'vital', 'when', 'children', 'enter', 'the', 'picture', '.'] 2020-02-09 14:28:59,837 Raw hypothesis: ['We', 'no', 'dey', 'show', 'love', 'play', '.', 'We', 'dey', 'enjoy', 'to', 'care', 'for', 'our', 'family', '(', '4', ')', 'when', 'we', 'dey', 'show', 'love', 'their', 'children', '.'] 2020-02-09 14:28:59,837 Source: Romantic love ( eʹros ) brings delight , and love for family ( stor·geʹ ) is vital when children enter the picture . 2020-02-09 14:28:59,837 Reference: ( 1 ) Love wey friend get for each other ( Greek , phi·liʹa ) ; ( 2 ) love wey man and woman get for each other ( eʹros ) ; ( 3 ) love wey people for family get for each other ( stor·geʹ ) . 2020-02-09 14:28:59,837 Hypothesis: We no dey show love play . We dey enjoy to care for our family ( 4 ) when we dey show love their children . 2020-02-09 14:28:59,837 Example #3 2020-02-09 14:28:59,837 Raw source: ['As', 'our', 'loving', 'De@@', 'sign@@', 'er', 'and', 'Creator', ',', 'Jehovah', 'knows', 'what', 'we', 'need', 'in', 'order', 'to', 'be', 'truly', 'happy', ',', 'and', 'he', 'f@@', 'ill@@', 's', 'that', 'need', 'ab@@', 'un@@', 'd@@', 'an@@', 'tly', '.'] 2020-02-09 14:28:59,838 Raw hypothesis: ['As', 'Jehovah', 'love', 'us', 'and', 'na', 'this', 'one', 'make', 'us', 'sabi', 'wetin', 'we', 'need', ',', 'we', 'dey', 'really', 'happy', '.'] 2020-02-09 14:28:59,838 Source: As our loving Designer and Creator , Jehovah knows what we need in order to be truly happy , and he fills that need abundantly . 2020-02-09 14:28:59,838 Reference: Because na Jehovah make us , e know wetin go make us happy . E don even give us pass wetin we need . 2020-02-09 14:28:59,838 Hypothesis: As Jehovah love us and na this one make us sabi wetin we need , we dey really happy . 2020-02-09 14:28:59,838 Validation result (greedy) at epoch 199, step 43000: bleu: 14.20, loss: 58695.1172, ppl: 12.9761, duration: 12.3193s 2020-02-09 14:29:02,928 Epoch 199: total training loss 150.54 2020-02-09 14:29:02,928 EPOCH 200 2020-02-09 14:29:09,841 Epoch 200 Step: 43100 Batch Loss: 0.733609 Tokens per Sec: 21135, Lr: 0.000050 2020-02-09 14:29:19,853 Epoch 200 Step: 43200 Batch Loss: 0.636086 Tokens per Sec: 21286, Lr: 0.000050 2020-02-09 14:29:24,549 Epoch 200: total training loss 149.87 2020-02-09 14:29:24,550 Training ended after 200 epochs. 2020-02-09 14:29:24,550 Best validation result (greedy) at step 10000: 8.84 ppl. 2020-02-09 14:29:39,550 dev bleu: 12.78 [Beam search decoding with beam size = 5 and alpha = 1.0] 2020-02-09 14:29:39,551 Translations saved to: models/enpcm_transformer/00010000.hyps.dev 2020-02-09 14:30:02,666 test bleu: 24.29 [Beam search decoding with beam size = 5 and alpha = 1.0] 2020-02-09 14:30:02,667 Translations saved to: models/enpcm_transformer/00010000.hyps.test