2020-02-12 15:55:50,862 Hello! This is Joey-NMT. 2020-02-12 15:55:52,201 Total params: 12152320 2020-02-12 15:55:52,202 Trainable parameters: ['decoder.layer_norm.bias', 'decoder.layer_norm.weight', 'decoder.layers.0.dec_layer_norm.bias', 'decoder.layers.0.dec_layer_norm.weight', 'decoder.layers.0.feed_forward.layer_norm.bias', 'decoder.layers.0.feed_forward.layer_norm.weight', 'decoder.layers.0.feed_forward.pwff_layer.0.bias', 'decoder.layers.0.feed_forward.pwff_layer.0.weight', 'decoder.layers.0.feed_forward.pwff_layer.3.bias', 'decoder.layers.0.feed_forward.pwff_layer.3.weight', 'decoder.layers.0.src_trg_att.k_layer.bias', 'decoder.layers.0.src_trg_att.k_layer.weight', 'decoder.layers.0.src_trg_att.output_layer.bias', 'decoder.layers.0.src_trg_att.output_layer.weight', 'decoder.layers.0.src_trg_att.q_layer.bias', 'decoder.layers.0.src_trg_att.q_layer.weight', 'decoder.layers.0.src_trg_att.v_layer.bias', 'decoder.layers.0.src_trg_att.v_layer.weight', 'decoder.layers.0.trg_trg_att.k_layer.bias', 'decoder.layers.0.trg_trg_att.k_layer.weight', 'decoder.layers.0.trg_trg_att.output_layer.bias', 'decoder.layers.0.trg_trg_att.output_layer.weight', 'decoder.layers.0.trg_trg_att.q_layer.bias', 'decoder.layers.0.trg_trg_att.q_layer.weight', 'decoder.layers.0.trg_trg_att.v_layer.bias', 'decoder.layers.0.trg_trg_att.v_layer.weight', 'decoder.layers.0.x_layer_norm.bias', 'decoder.layers.0.x_layer_norm.weight', 'decoder.layers.1.dec_layer_norm.bias', 'decoder.layers.1.dec_layer_norm.weight', 'decoder.layers.1.feed_forward.layer_norm.bias', 'decoder.layers.1.feed_forward.layer_norm.weight', 'decoder.layers.1.feed_forward.pwff_layer.0.bias', 'decoder.layers.1.feed_forward.pwff_layer.0.weight', 'decoder.layers.1.feed_forward.pwff_layer.3.bias', 'decoder.layers.1.feed_forward.pwff_layer.3.weight', 'decoder.layers.1.src_trg_att.k_layer.bias', 'decoder.layers.1.src_trg_att.k_layer.weight', 'decoder.layers.1.src_trg_att.output_layer.bias', 'decoder.layers.1.src_trg_att.output_layer.weight', 'decoder.layers.1.src_trg_att.q_layer.bias', 'decoder.layers.1.src_trg_att.q_layer.weight', 'decoder.layers.1.src_trg_att.v_layer.bias', 'decoder.layers.1.src_trg_att.v_layer.weight', 'decoder.layers.1.trg_trg_att.k_layer.bias', 'decoder.layers.1.trg_trg_att.k_layer.weight', 'decoder.layers.1.trg_trg_att.output_layer.bias', 'decoder.layers.1.trg_trg_att.output_layer.weight', 'decoder.layers.1.trg_trg_att.q_layer.bias', 'decoder.layers.1.trg_trg_att.q_layer.weight', 'decoder.layers.1.trg_trg_att.v_layer.bias', 'decoder.layers.1.trg_trg_att.v_layer.weight', 'decoder.layers.1.x_layer_norm.bias', 'decoder.layers.1.x_layer_norm.weight', 'decoder.layers.2.dec_layer_norm.bias', 'decoder.layers.2.dec_layer_norm.weight', 'decoder.layers.2.feed_forward.layer_norm.bias', 'decoder.layers.2.feed_forward.layer_norm.weight', 'decoder.layers.2.feed_forward.pwff_layer.0.bias', 'decoder.layers.2.feed_forward.pwff_layer.0.weight', 'decoder.layers.2.feed_forward.pwff_layer.3.bias', 'decoder.layers.2.feed_forward.pwff_layer.3.weight', 'decoder.layers.2.src_trg_att.k_layer.bias', 'decoder.layers.2.src_trg_att.k_layer.weight', 'decoder.layers.2.src_trg_att.output_layer.bias', 'decoder.layers.2.src_trg_att.output_layer.weight', 'decoder.layers.2.src_trg_att.q_layer.bias', 'decoder.layers.2.src_trg_att.q_layer.weight', 'decoder.layers.2.src_trg_att.v_layer.bias', 'decoder.layers.2.src_trg_att.v_layer.weight', 'decoder.layers.2.trg_trg_att.k_layer.bias', 'decoder.layers.2.trg_trg_att.k_layer.weight', 'decoder.layers.2.trg_trg_att.output_layer.bias', 'decoder.layers.2.trg_trg_att.output_layer.weight', 'decoder.layers.2.trg_trg_att.q_layer.bias', 'decoder.layers.2.trg_trg_att.q_layer.weight', 'decoder.layers.2.trg_trg_att.v_layer.bias', 'decoder.layers.2.trg_trg_att.v_layer.weight', 'decoder.layers.2.x_layer_norm.bias', 'decoder.layers.2.x_layer_norm.weight', 'decoder.layers.3.dec_layer_norm.bias', 'decoder.layers.3.dec_layer_norm.weight', 'decoder.layers.3.feed_forward.layer_norm.bias', 'decoder.layers.3.feed_forward.layer_norm.weight', 'decoder.layers.3.feed_forward.pwff_layer.0.bias', 'decoder.layers.3.feed_forward.pwff_layer.0.weight', 'decoder.layers.3.feed_forward.pwff_layer.3.bias', 'decoder.layers.3.feed_forward.pwff_layer.3.weight', 'decoder.layers.3.src_trg_att.k_layer.bias', 'decoder.layers.3.src_trg_att.k_layer.weight', 'decoder.layers.3.src_trg_att.output_layer.bias', 'decoder.layers.3.src_trg_att.output_layer.weight', 'decoder.layers.3.src_trg_att.q_layer.bias', 'decoder.layers.3.src_trg_att.q_layer.weight', 'decoder.layers.3.src_trg_att.v_layer.bias', 'decoder.layers.3.src_trg_att.v_layer.weight', 'decoder.layers.3.trg_trg_att.k_layer.bias', 'decoder.layers.3.trg_trg_att.k_layer.weight', 'decoder.layers.3.trg_trg_att.output_layer.bias', 'decoder.layers.3.trg_trg_att.output_layer.weight', 'decoder.layers.3.trg_trg_att.q_layer.bias', 'decoder.layers.3.trg_trg_att.q_layer.weight', 'decoder.layers.3.trg_trg_att.v_layer.bias', 'decoder.layers.3.trg_trg_att.v_layer.weight', 'decoder.layers.3.x_layer_norm.bias', 'decoder.layers.3.x_layer_norm.weight', 'decoder.layers.4.dec_layer_norm.bias', 'decoder.layers.4.dec_layer_norm.weight', 'decoder.layers.4.feed_forward.layer_norm.bias', 'decoder.layers.4.feed_forward.layer_norm.weight', 'decoder.layers.4.feed_forward.pwff_layer.0.bias', 'decoder.layers.4.feed_forward.pwff_layer.0.weight', 'decoder.layers.4.feed_forward.pwff_layer.3.bias', 'decoder.layers.4.feed_forward.pwff_layer.3.weight', 'decoder.layers.4.src_trg_att.k_layer.bias', 'decoder.layers.4.src_trg_att.k_layer.weight', 'decoder.layers.4.src_trg_att.output_layer.bias', 'decoder.layers.4.src_trg_att.output_layer.weight', 'decoder.layers.4.src_trg_att.q_layer.bias', 'decoder.layers.4.src_trg_att.q_layer.weight', 'decoder.layers.4.src_trg_att.v_layer.bias', 'decoder.layers.4.src_trg_att.v_layer.weight', 'decoder.layers.4.trg_trg_att.k_layer.bias', 'decoder.layers.4.trg_trg_att.k_layer.weight', 'decoder.layers.4.trg_trg_att.output_layer.bias', 'decoder.layers.4.trg_trg_att.output_layer.weight', 'decoder.layers.4.trg_trg_att.q_layer.bias', 'decoder.layers.4.trg_trg_att.q_layer.weight', 'decoder.layers.4.trg_trg_att.v_layer.bias', 'decoder.layers.4.trg_trg_att.v_layer.weight', 'decoder.layers.4.x_layer_norm.bias', 'decoder.layers.4.x_layer_norm.weight', 'decoder.layers.5.dec_layer_norm.bias', 'decoder.layers.5.dec_layer_norm.weight', 'decoder.layers.5.feed_forward.layer_norm.bias', 'decoder.layers.5.feed_forward.layer_norm.weight', 'decoder.layers.5.feed_forward.pwff_layer.0.bias', 'decoder.layers.5.feed_forward.pwff_layer.0.weight', 'decoder.layers.5.feed_forward.pwff_layer.3.bias', 'decoder.layers.5.feed_forward.pwff_layer.3.weight', 'decoder.layers.5.src_trg_att.k_layer.bias', 'decoder.layers.5.src_trg_att.k_layer.weight', 'decoder.layers.5.src_trg_att.output_layer.bias', 'decoder.layers.5.src_trg_att.output_layer.weight', 'decoder.layers.5.src_trg_att.q_layer.bias', 'decoder.layers.5.src_trg_att.q_layer.weight', 'decoder.layers.5.src_trg_att.v_layer.bias', 'decoder.layers.5.src_trg_att.v_layer.weight', 'decoder.layers.5.trg_trg_att.k_layer.bias', 'decoder.layers.5.trg_trg_att.k_layer.weight', 'decoder.layers.5.trg_trg_att.output_layer.bias', 'decoder.layers.5.trg_trg_att.output_layer.weight', 'decoder.layers.5.trg_trg_att.q_layer.bias', 'decoder.layers.5.trg_trg_att.q_layer.weight', 'decoder.layers.5.trg_trg_att.v_layer.bias', 'decoder.layers.5.trg_trg_att.v_layer.weight', 'decoder.layers.5.x_layer_norm.bias', 'decoder.layers.5.x_layer_norm.weight', 'encoder.layer_norm.bias', 'encoder.layer_norm.weight', 'encoder.layers.0.feed_forward.layer_norm.bias', 'encoder.layers.0.feed_forward.layer_norm.weight', 'encoder.layers.0.feed_forward.pwff_layer.0.bias', 'encoder.layers.0.feed_forward.pwff_layer.0.weight', 'encoder.layers.0.feed_forward.pwff_layer.3.bias', 'encoder.layers.0.feed_forward.pwff_layer.3.weight', 'encoder.layers.0.layer_norm.bias', 'encoder.layers.0.layer_norm.weight', 'encoder.layers.0.src_src_att.k_layer.bias', 'encoder.layers.0.src_src_att.k_layer.weight', 'encoder.layers.0.src_src_att.output_layer.bias', 'encoder.layers.0.src_src_att.output_layer.weight', 'encoder.layers.0.src_src_att.q_layer.bias', 'encoder.layers.0.src_src_att.q_layer.weight', 'encoder.layers.0.src_src_att.v_layer.bias', 'encoder.layers.0.src_src_att.v_layer.weight', 'encoder.layers.1.feed_forward.layer_norm.bias', 'encoder.layers.1.feed_forward.layer_norm.weight', 'encoder.layers.1.feed_forward.pwff_layer.0.bias', 'encoder.layers.1.feed_forward.pwff_layer.0.weight', 'encoder.layers.1.feed_forward.pwff_layer.3.bias', 'encoder.layers.1.feed_forward.pwff_layer.3.weight', 'encoder.layers.1.layer_norm.bias', 'encoder.layers.1.layer_norm.weight', 'encoder.layers.1.src_src_att.k_layer.bias', 'encoder.layers.1.src_src_att.k_layer.weight', 'encoder.layers.1.src_src_att.output_layer.bias', 'encoder.layers.1.src_src_att.output_layer.weight', 'encoder.layers.1.src_src_att.q_layer.bias', 'encoder.layers.1.src_src_att.q_layer.weight', 'encoder.layers.1.src_src_att.v_layer.bias', 'encoder.layers.1.src_src_att.v_layer.weight', 'encoder.layers.2.feed_forward.layer_norm.bias', 'encoder.layers.2.feed_forward.layer_norm.weight', 'encoder.layers.2.feed_forward.pwff_layer.0.bias', 'encoder.layers.2.feed_forward.pwff_layer.0.weight', 'encoder.layers.2.feed_forward.pwff_layer.3.bias', 'encoder.layers.2.feed_forward.pwff_layer.3.weight', 'encoder.layers.2.layer_norm.bias', 'encoder.layers.2.layer_norm.weight', 'encoder.layers.2.src_src_att.k_layer.bias', 'encoder.layers.2.src_src_att.k_layer.weight', 'encoder.layers.2.src_src_att.output_layer.bias', 'encoder.layers.2.src_src_att.output_layer.weight', 'encoder.layers.2.src_src_att.q_layer.bias', 'encoder.layers.2.src_src_att.q_layer.weight', 'encoder.layers.2.src_src_att.v_layer.bias', 'encoder.layers.2.src_src_att.v_layer.weight', 'encoder.layers.3.feed_forward.layer_norm.bias', 'encoder.layers.3.feed_forward.layer_norm.weight', 'encoder.layers.3.feed_forward.pwff_layer.0.bias', 'encoder.layers.3.feed_forward.pwff_layer.0.weight', 'encoder.layers.3.feed_forward.pwff_layer.3.bias', 'encoder.layers.3.feed_forward.pwff_layer.3.weight', 'encoder.layers.3.layer_norm.bias', 'encoder.layers.3.layer_norm.weight', 'encoder.layers.3.src_src_att.k_layer.bias', 'encoder.layers.3.src_src_att.k_layer.weight', 'encoder.layers.3.src_src_att.output_layer.bias', 'encoder.layers.3.src_src_att.output_layer.weight', 'encoder.layers.3.src_src_att.q_layer.bias', 'encoder.layers.3.src_src_att.q_layer.weight', 'encoder.layers.3.src_src_att.v_layer.bias', 'encoder.layers.3.src_src_att.v_layer.weight', 'encoder.layers.4.feed_forward.layer_norm.bias', 'encoder.layers.4.feed_forward.layer_norm.weight', 'encoder.layers.4.feed_forward.pwff_layer.0.bias', 'encoder.layers.4.feed_forward.pwff_layer.0.weight', 'encoder.layers.4.feed_forward.pwff_layer.3.bias', 'encoder.layers.4.feed_forward.pwff_layer.3.weight', 'encoder.layers.4.layer_norm.bias', 'encoder.layers.4.layer_norm.weight', 'encoder.layers.4.src_src_att.k_layer.bias', 'encoder.layers.4.src_src_att.k_layer.weight', 'encoder.layers.4.src_src_att.output_layer.bias', 'encoder.layers.4.src_src_att.output_layer.weight', 'encoder.layers.4.src_src_att.q_layer.bias', 'encoder.layers.4.src_src_att.q_layer.weight', 'encoder.layers.4.src_src_att.v_layer.bias', 'encoder.layers.4.src_src_att.v_layer.weight', 'encoder.layers.5.feed_forward.layer_norm.bias', 'encoder.layers.5.feed_forward.layer_norm.weight', 'encoder.layers.5.feed_forward.pwff_layer.0.bias', 'encoder.layers.5.feed_forward.pwff_layer.0.weight', 'encoder.layers.5.feed_forward.pwff_layer.3.bias', 'encoder.layers.5.feed_forward.pwff_layer.3.weight', 'encoder.layers.5.layer_norm.bias', 'encoder.layers.5.layer_norm.weight', 'encoder.layers.5.src_src_att.k_layer.bias', 'encoder.layers.5.src_src_att.k_layer.weight', 'encoder.layers.5.src_src_att.output_layer.bias', 'encoder.layers.5.src_src_att.output_layer.weight', 'encoder.layers.5.src_src_att.q_layer.bias', 'encoder.layers.5.src_src_att.q_layer.weight', 'encoder.layers.5.src_src_att.v_layer.bias', 'encoder.layers.5.src_src_att.v_layer.weight', 'src_embed.lut.weight'] 2020-02-12 15:55:55,584 cfg.name : entiv_transformer 2020-02-12 15:55:55,584 cfg.data.src : en 2020-02-12 15:55:55,584 cfg.data.trg : tiv 2020-02-12 15:55:55,584 cfg.data.train : data/entiv/train.bpe 2020-02-12 15:55:55,585 cfg.data.dev : data/entiv/dev.bpe 2020-02-12 15:55:55,585 cfg.data.test : data/entiv/test.bpe 2020-02-12 15:55:55,585 cfg.data.level : bpe 2020-02-12 15:55:55,585 cfg.data.lowercase : False 2020-02-12 15:55:55,585 cfg.data.max_sent_length : 100 2020-02-12 15:55:55,585 cfg.data.src_vocab : data/entiv/vocab.txt 2020-02-12 15:55:55,585 cfg.data.trg_vocab : data/entiv/vocab.txt 2020-02-12 15:55:55,585 cfg.testing.beam_size : 5 2020-02-12 15:55:55,585 cfg.testing.alpha : 1.0 2020-02-12 15:55:55,585 cfg.training.random_seed : 42 2020-02-12 15:55:55,585 cfg.training.optimizer : adam 2020-02-12 15:55:55,585 cfg.training.normalization : tokens 2020-02-12 15:55:55,585 cfg.training.adam_betas : [0.9, 0.999] 2020-02-12 15:55:55,585 cfg.training.scheduling : plateau 2020-02-12 15:55:55,585 cfg.training.patience : 5 2020-02-12 15:55:55,586 cfg.training.learning_rate_factor : 0.5 2020-02-12 15:55:55,586 cfg.training.learning_rate_warmup : 1000 2020-02-12 15:55:55,586 cfg.training.decrease_factor : 0.7 2020-02-12 15:55:55,586 cfg.training.loss : crossentropy 2020-02-12 15:55:55,586 cfg.training.learning_rate : 0.0003 2020-02-12 15:55:55,586 cfg.training.learning_rate_min : 1e-08 2020-02-12 15:55:55,586 cfg.training.weight_decay : 0.0 2020-02-12 15:55:55,586 cfg.training.label_smoothing : 0.1 2020-02-12 15:55:55,586 cfg.training.batch_size : 4096 2020-02-12 15:55:55,586 cfg.training.batch_type : token 2020-02-12 15:55:55,586 cfg.training.eval_batch_size : 3600 2020-02-12 15:55:55,586 cfg.training.eval_batch_type : token 2020-02-12 15:55:55,586 cfg.training.batch_multiplier : 1 2020-02-12 15:55:55,586 cfg.training.early_stopping_metric : ppl 2020-02-12 15:55:55,586 cfg.training.epochs : 150 2020-02-12 15:55:55,586 cfg.training.validation_freq : 1000 2020-02-12 15:55:55,587 cfg.training.logging_freq : 100 2020-02-12 15:55:55,587 cfg.training.eval_metric : bleu 2020-02-12 15:55:55,587 cfg.training.model_dir : models/entiv_transformer 2020-02-12 15:55:55,587 cfg.training.overwrite : True 2020-02-12 15:55:55,587 cfg.training.shuffle : True 2020-02-12 15:55:55,587 cfg.training.use_cuda : True 2020-02-12 15:55:55,587 cfg.training.max_output_length : 100 2020-02-12 15:55:55,587 cfg.training.print_valid_sents : [0, 1, 2, 3] 2020-02-12 15:55:55,587 cfg.training.keep_last_ckpts : 5 2020-02-12 15:55:55,587 cfg.model.initializer : xavier 2020-02-12 15:55:55,587 cfg.model.bias_initializer : zeros 2020-02-12 15:55:55,587 cfg.model.init_gain : 1.0 2020-02-12 15:55:55,587 cfg.model.embed_initializer : xavier 2020-02-12 15:55:55,587 cfg.model.embed_init_gain : 1.0 2020-02-12 15:55:55,587 cfg.model.tied_embeddings : True 2020-02-12 15:55:55,588 cfg.model.tied_softmax : True 2020-02-12 15:55:55,588 cfg.model.encoder.type : transformer 2020-02-12 15:55:55,588 cfg.model.encoder.num_layers : 6 2020-02-12 15:55:55,588 cfg.model.encoder.num_heads : 4 2020-02-12 15:55:55,588 cfg.model.encoder.embeddings.embedding_dim : 256 2020-02-12 15:55:55,588 cfg.model.encoder.embeddings.scale : True 2020-02-12 15:55:55,588 cfg.model.encoder.embeddings.dropout : 0.2 2020-02-12 15:55:55,588 cfg.model.encoder.hidden_size : 256 2020-02-12 15:55:55,588 cfg.model.encoder.ff_size : 1024 2020-02-12 15:55:55,588 cfg.model.encoder.dropout : 0.3 2020-02-12 15:55:55,588 cfg.model.decoder.type : transformer 2020-02-12 15:55:55,588 cfg.model.decoder.num_layers : 6 2020-02-12 15:55:55,588 cfg.model.decoder.num_heads : 4 2020-02-12 15:55:55,588 cfg.model.decoder.embeddings.embedding_dim : 256 2020-02-12 15:55:55,588 cfg.model.decoder.embeddings.scale : True 2020-02-12 15:55:55,589 cfg.model.decoder.embeddings.dropout : 0.2 2020-02-12 15:55:55,589 cfg.model.decoder.hidden_size : 256 2020-02-12 15:55:55,589 cfg.model.decoder.ff_size : 1024 2020-02-12 15:55:55,589 cfg.model.decoder.dropout : 0.3 2020-02-12 15:55:55,589 Data set sizes: train 185707, valid 1000, test 375 2020-02-12 15:55:55,589 First training example: [SRC] How we say something can be as important as what we say . [TRG] Gbenda u se er kwagh la ngu a inja vough er kwaghôron wase la nahan . 2020-02-12 15:55:55,589 First 10 words (src): (0) (1) (2) (3) (4) , (5) . (6) u (7) a (8) the (9) i 2020-02-12 15:55:55,590 First 10 words (trg): (0) (1) (2) (3) (4) , (5) . (6) u (7) a (8) the (9) i 2020-02-12 15:55:55,590 Number of Src words (types): 4266 2020-02-12 15:55:55,590 Number of Trg words (types): 4266 2020-02-12 15:55:55,590 Model( encoder=TransformerEncoder(num_layers=6, num_heads=4), decoder=TransformerDecoder(num_layers=6, num_heads=4), src_embed=Embeddings(embedding_dim=256, vocab_size=4266), trg_embed=Embeddings(embedding_dim=256, vocab_size=4266)) 2020-02-12 15:55:55,595 EPOCH 1 2020-02-12 15:56:06,328 Epoch 1 Step: 100 Batch Loss: 5.058401 Tokens per Sec: 20734, Lr: 0.000300 2020-02-12 15:56:16,422 Epoch 1 Step: 200 Batch Loss: 4.870168 Tokens per Sec: 21861, Lr: 0.000300 2020-02-12 15:56:26,533 Epoch 1 Step: 300 Batch Loss: 4.652421 Tokens per Sec: 22052, Lr: 0.000300 2020-02-12 15:56:36,611 Epoch 1 Step: 400 Batch Loss: 4.356110 Tokens per Sec: 21940, Lr: 0.000300 2020-02-12 15:56:46,722 Epoch 1 Step: 500 Batch Loss: 4.122426 Tokens per Sec: 21766, Lr: 0.000300 2020-02-12 15:56:56,734 Epoch 1 Step: 600 Batch Loss: 4.076796 Tokens per Sec: 21913, Lr: 0.000300 2020-02-12 15:57:06,588 Epoch 1 Step: 700 Batch Loss: 4.210296 Tokens per Sec: 22534, Lr: 0.000300 2020-02-12 15:57:16,444 Epoch 1 Step: 800 Batch Loss: 3.956947 Tokens per Sec: 22428, Lr: 0.000300 2020-02-12 15:57:26,470 Epoch 1 Step: 900 Batch Loss: 3.769588 Tokens per Sec: 22100, Lr: 0.000300 2020-02-12 15:57:36,389 Epoch 1 Step: 1000 Batch Loss: 3.811076 Tokens per Sec: 22413, Lr: 0.000300 2020-02-12 15:57:58,754 Hooray! New best validation result [ppl]! 2020-02-12 15:57:58,754 Saving new checkpoint. 2020-02-12 15:57:58,924 Example #0 2020-02-12 15:57:58,924 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 15:57:58,925 Raw hypothesis: ['(', 'Mateu', '4', ':', '1', ')', 'Nahan', 'kpa', ',', 'se', 'fatyô', 'u', 'se', 'lu', 'a', 'mi', 'sha', 'ci', 'u', 'se', 'lu', 'a', 'mi', 'la', ',', 'se', 'lu', 'a', 'mi', 'yô', ',', 'se', 'lu', 'a', 'mi', 'sha', 'ci', 'u', 'se', 'lu', 'a', 'mi', 'la', '.'] 2020-02-12 15:57:58,925 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 15:57:58,925 Reference: 10 : ​ 6 - 9 . 2020-02-12 15:57:58,925 Hypothesis: ( Mateu 4 : 1 ) Nahan kpa , se fatyô u se lu a mi sha ci u se lu a mi la , se lu a mi yô , se lu a mi sha ci u se lu a mi la . 2020-02-12 15:57:58,925 Example #1 2020-02-12 15:57:58,925 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 15:57:58,925 Raw hypothesis: ['(', '1', 'Mbakorinte', '1', ':', '1', ')', 'Nahan', 'kpa', ',', 'se', 'lu', '“', 'ishima', 'i', 'nan', 've', 'ishima', 'i', 'nan', 've', 've', 'ishima', 'i', 'nan', 've', 'la', '.'] 2020-02-12 15:57:58,925 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 15:57:58,925 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 15:57:58,925 Hypothesis: ( 1 Mbakorinte 1 : 1 ) Nahan kpa , se lu “ ishima i nan ve ishima i nan ve ve ishima i nan ve la . 2020-02-12 15:57:58,925 Example #2 2020-02-12 15:57:58,925 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 15:57:58,925 Raw hypothesis: ['(', 'Mateu', '3', ':', '1', ')', 'Nahan', 'kpa', ',', 'm', 'lu', 'a', 'mi', 'yô', ',', 'm', 'lu', 'a', 'mi', 'yô', ',', 'm', 'lu', 'a', 'mi', '.'] 2020-02-12 15:57:58,926 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 15:57:58,926 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 15:57:58,926 Hypothesis: ( Mateu 3 : 1 ) Nahan kpa , m lu a mi yô , m lu a mi yô , m lu a mi . 2020-02-12 15:57:58,926 Example #3 2020-02-12 15:57:58,926 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 15:57:58,926 Raw hypothesis: ['(', '1', 'Mbakorinte', '4', ':', '1', ')', 'Nahan', 'kpa', ',', 'se', 'fatyô', 'u', 'se', 'lu', 'a', 'mi', 'yô', ',', 'se', 'fatyô', 'u', 'se', 'lu', 'a', 'mi', 'la', '.'] 2020-02-12 15:57:58,926 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 15:57:58,926 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 15:57:58,926 Hypothesis: ( 1 Mbakorinte 4 : 1 ) Nahan kpa , se fatyô u se lu a mi yô , se fatyô u se lu a mi la . 2020-02-12 15:57:58,926 Validation result (greedy) at epoch 1, step 1000: bleu: 2.24, loss: 105431.4141, ppl: 35.2121, duration: 22.5367s 2020-02-12 15:58:09,004 Epoch 1 Step: 1100 Batch Loss: 3.681341 Tokens per Sec: 21252, Lr: 0.000300 2020-02-12 15:58:19,066 Epoch 1 Step: 1200 Batch Loss: 3.286341 Tokens per Sec: 22182, Lr: 0.000300 2020-02-12 15:58:29,003 Epoch 1 Step: 1300 Batch Loss: 3.167710 Tokens per Sec: 22510, Lr: 0.000300 2020-02-12 15:58:38,931 Epoch 1 Step: 1400 Batch Loss: 3.563505 Tokens per Sec: 22049, Lr: 0.000300 2020-02-12 15:58:48,935 Epoch 1 Step: 1500 Batch Loss: 3.639344 Tokens per Sec: 22684, Lr: 0.000300 2020-02-12 15:58:58,889 Epoch 1 Step: 1600 Batch Loss: 3.228676 Tokens per Sec: 22208, Lr: 0.000300 2020-02-12 15:59:08,764 Epoch 1 Step: 1700 Batch Loss: 3.194575 Tokens per Sec: 21941, Lr: 0.000300 2020-02-12 15:59:18,664 Epoch 1 Step: 1800 Batch Loss: 3.024248 Tokens per Sec: 22794, Lr: 0.000300 2020-02-12 15:59:28,757 Epoch 1 Step: 1900 Batch Loss: 3.275215 Tokens per Sec: 21176, Lr: 0.000300 2020-02-12 15:59:38,827 Epoch 1 Step: 2000 Batch Loss: 3.323348 Tokens per Sec: 22144, Lr: 0.000300 2020-02-12 16:00:02,229 Hooray! New best validation result [ppl]! 2020-02-12 16:00:02,229 Saving new checkpoint. 2020-02-12 16:00:02,400 Example #0 2020-02-12 16:00:02,400 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 16:00:02,400 Raw hypothesis: ['Er', 'nan', 've', 'i', 'gbe', 'u', 'se', 'lu', 'a', 'mi', 'sha', 'u', 'eren', 'tom', 'u', 'Yehova', 'a', 'lu', 'a', 'mi', 'la', 'yô', ',', 'ka', 'u', 'eren', 'kwagh', 'u', 'a', 'lu', 'a', 'mi', 'la', ',', 'shi', 'a', 'lu', 'a', 'mi', 'sha', 'ci', 'u', 've', 'lu', 'a', 'mi', 'la', '.', '—', '1', ':', '1', ',', '4', '.'] 2020-02-12 16:00:02,400 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 16:00:02,400 Reference: 10 : ​ 6 - 9 . 2020-02-12 16:00:02,400 Hypothesis: Er nan ve i gbe u se lu a mi sha u eren tom u Yehova a lu a mi la yô , ka u eren kwagh u a lu a mi la , shi a lu a mi sha ci u ve lu a mi la . — 1 : 1 , 4 . 2020-02-12 16:00:02,400 Example #1 2020-02-12 16:00:02,400 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 16:00:02,400 Raw hypothesis: ['Se', 'fatyô', 'u', '‘', 'eren', 'msen', '’', 'sha', 'ci', 'u', 'se', 'lu', 'a', 'mi', 'la', '.', '—', 'Ps', '.'] 2020-02-12 16:00:02,400 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 16:00:02,400 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 16:00:02,401 Hypothesis: Se fatyô u ‘ eren msen ’ sha ci u se lu a mi la . — Ps . 2020-02-12 16:00:02,401 Example #2 2020-02-12 16:00:02,401 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 16:00:02,401 Raw hypothesis: ['(', 'Mateu', '9', ':', '9', ')', 'Ken', 'inyom', 'i', '19@@', '9', 'la', ',', 'i', 'nger', 'ken', 'inyom', 'i', '19@@', '5@@', '9', 'la', ',', 'i', 'lu', 'ken', 'inyom', 'i', '19@@', '9', 'la', '.'] 2020-02-12 16:00:02,401 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 16:00:02,401 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 16:00:02,401 Hypothesis: ( Mateu 9 : 9 ) Ken inyom i 199 la , i nger ken inyom i 1959 la , i lu ken inyom i 199 la . 2020-02-12 16:00:02,401 Example #3 2020-02-12 16:00:02,401 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 16:00:02,401 Raw hypothesis: ['(', '1', 'Mbakorinte', '4', ':', '1', ')', 'Ka', 'sha', 'u', 'tesen', 'ér', 'ka', 'u', 'eren', 'kwagh', 'u', 'a', 'lu', 'a', 'mi', 'ga', 'yô', ',', 'ka', 'u', 'er', 'kwagh', 'u', 'a', 'lu', 'a', 'mi', 'ga', '.'] 2020-02-12 16:00:02,401 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 16:00:02,401 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 16:00:02,401 Hypothesis: ( 1 Mbakorinte 4 : 1 ) Ka sha u tesen ér ka u eren kwagh u a lu a mi ga yô , ka u er kwagh u a lu a mi ga . 2020-02-12 16:00:02,401 Validation result (greedy) at epoch 1, step 2000: bleu: 3.88, loss: 90648.3359, ppl: 21.3709, duration: 23.5734s 2020-02-12 16:00:12,468 Epoch 1 Step: 2100 Batch Loss: 2.993847 Tokens per Sec: 22237, Lr: 0.000300 2020-02-12 16:00:22,577 Epoch 1 Step: 2200 Batch Loss: 3.233315 Tokens per Sec: 22031, Lr: 0.000300 2020-02-12 16:00:32,535 Epoch 1 Step: 2300 Batch Loss: 2.942458 Tokens per Sec: 22381, Lr: 0.000300 2020-02-12 16:00:42,407 Epoch 1 Step: 2400 Batch Loss: 2.957521 Tokens per Sec: 22137, Lr: 0.000300 2020-02-12 16:00:47,977 Epoch 1: total training loss 9082.40 2020-02-12 16:00:47,978 EPOCH 2 2020-02-12 16:00:52,569 Epoch 2 Step: 2500 Batch Loss: 2.771921 Tokens per Sec: 20169, Lr: 0.000300 2020-02-12 16:01:02,396 Epoch 2 Step: 2600 Batch Loss: 2.767326 Tokens per Sec: 22158, Lr: 0.000300 2020-02-12 16:01:12,241 Epoch 2 Step: 2700 Batch Loss: 2.821128 Tokens per Sec: 22720, Lr: 0.000300 2020-02-12 16:01:22,095 Epoch 2 Step: 2800 Batch Loss: 2.964184 Tokens per Sec: 22927, Lr: 0.000300 2020-02-12 16:01:31,914 Epoch 2 Step: 2900 Batch Loss: 3.064916 Tokens per Sec: 22691, Lr: 0.000300 2020-02-12 16:01:41,772 Epoch 2 Step: 3000 Batch Loss: 2.732623 Tokens per Sec: 22483, Lr: 0.000300 2020-02-12 16:02:06,481 Hooray! New best validation result [ppl]! 2020-02-12 16:02:06,481 Saving new checkpoint. 2020-02-12 16:02:06,649 Example #0 2020-02-12 16:02:06,649 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 16:02:06,649 Raw hypothesis: ['Er', 'i', 'lu', 'u', 'civir', 'Yehova', 'a', 'ishima', 'i', 'môm', 'yô', ',', 'ka', 'u', 'lun', 'a', 'aeren', 'a', 'dedoo', 'a', 'dedoo', 'a', 'dedoo', 'a', 'dedoo', 'a', 'a', 'a', 'lu', 'a', 'mi', 'la', ',', 'ka', 'u', 'tesen', 'ér', 'ka', 'u', 'eren', 'kwagh', 'u', 'dedoo', 'a', 'lu', 'a', 'mi', 'la', ',', 'shi', 'ka', 'u', 'tesen', 'ér', 'ka', 'u', 'eren', 'kwagh', 'u', 'dedoo', 'u', 'dedoo', 'u', 'nan', 've', 'lu', 'a', 'mi', 'la', '.', '—', 'Pasalmi', '119', ':', '10', '-', '11', '.'] 2020-02-12 16:02:06,649 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 16:02:06,649 Reference: 10 : ​ 6 - 9 . 2020-02-12 16:02:06,650 Hypothesis: Er i lu u civir Yehova a ishima i môm yô , ka u lun a aeren a dedoo a dedoo a dedoo a dedoo a a a lu a mi la , ka u tesen ér ka u eren kwagh u dedoo a lu a mi la , shi ka u tesen ér ka u eren kwagh u dedoo u dedoo u nan ve lu a mi la . — Pasalmi 119 : 10 - 11 . 2020-02-12 16:02:06,650 Example #1 2020-02-12 16:02:06,650 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 16:02:06,650 Raw hypothesis: ['Se', 'fatyô', 'u', 'kaan', 'ser', ',', '“', 'Ka', 'sha', 'ci', 'u', 'se', 'lu', 'a', 'mi', 'la', ',', 'man', 'se', 'lu', 'a', 'mi', 'je', 'la', '.', '”', '—', 'Ps', '.'] 2020-02-12 16:02:06,650 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 16:02:06,650 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 16:02:06,650 Hypothesis: Se fatyô u kaan ser , “ Ka sha ci u se lu a mi la , man se lu a mi je la . ” — Ps . 2020-02-12 16:02:06,650 Example #2 2020-02-12 16:02:06,650 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 16:02:06,650 Raw hypothesis: ['Nahan', ',', 'Paulu', 'lu', 'ôron', 'kwagh', 'u', 'i', 'yer', 'un', 'ér', 'S@@', 'ef@@', 'ania', 'la', ',', 'a', 'kaa', 'ér', ':', '“', 'Ka', 'sha', 'ci', 'u', 'M@@', 'ika', '.'] 2020-02-12 16:02:06,650 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 16:02:06,650 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 16:02:06,650 Hypothesis: Nahan , Paulu lu ôron kwagh u i yer un ér Sefania la , a kaa ér : “ Ka sha ci u Mika . 2020-02-12 16:02:06,650 Example #3 2020-02-12 16:02:06,650 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 16:02:06,650 Raw hypothesis: ['Ka', 'kwagh', 'u', 'injaa', 'u', 'i', 'gbe', 'u', 'se', 'er', 'kwagh', 'u', 'or', 'u', 'nan', 'lu', 'a', 'mi', 'la', 'ga', '.'] 2020-02-12 16:02:06,651 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 16:02:06,651 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 16:02:06,651 Hypothesis: Ka kwagh u injaa u i gbe u se er kwagh u or u nan lu a mi la ga . 2020-02-12 16:02:06,651 Validation result (greedy) at epoch 2, step 3000: bleu: 4.98, loss: 83058.2344, ppl: 16.5377, duration: 24.8784s 2020-02-12 16:02:16,482 Epoch 2 Step: 3100 Batch Loss: 2.755773 Tokens per Sec: 22019, Lr: 0.000300 2020-02-12 16:02:26,339 Epoch 2 Step: 3200 Batch Loss: 2.941496 Tokens per Sec: 22699, Lr: 0.000300 2020-02-12 16:02:36,258 Epoch 2 Step: 3300 Batch Loss: 2.974449 Tokens per Sec: 22175, Lr: 0.000300 2020-02-12 16:02:46,160 Epoch 2 Step: 3400 Batch Loss: 2.765259 Tokens per Sec: 21327, Lr: 0.000300 2020-02-12 16:02:56,017 Epoch 2 Step: 3500 Batch Loss: 3.028700 Tokens per Sec: 22024, Lr: 0.000300 2020-02-12 16:03:05,907 Epoch 2 Step: 3600 Batch Loss: 3.162649 Tokens per Sec: 23086, Lr: 0.000300 2020-02-12 16:03:15,832 Epoch 2 Step: 3700 Batch Loss: 2.648297 Tokens per Sec: 22559, Lr: 0.000300 2020-02-12 16:03:26,061 Epoch 2 Step: 3800 Batch Loss: 2.949837 Tokens per Sec: 21189, Lr: 0.000300 2020-02-12 16:03:36,181 Epoch 2 Step: 3900 Batch Loss: 2.998596 Tokens per Sec: 21572, Lr: 0.000300 2020-02-12 16:03:46,322 Epoch 2 Step: 4000 Batch Loss: 2.707163 Tokens per Sec: 22097, Lr: 0.000300 2020-02-12 16:04:09,240 Hooray! New best validation result [ppl]! 2020-02-12 16:04:09,240 Saving new checkpoint. 2020-02-12 16:04:09,409 Example #0 2020-02-12 16:04:09,409 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 16:04:09,410 Raw hypothesis: ['Er', 'nan', 've', 'i', 'gbe', 'u', 'or', 'u', 'nan', 'lu', 'a', 'mi', 'sha', 'ci', 'u', 'Yehova', 'yô', ',', 'ka', 'u', 'nan', 'lu', 'a', 'dooshima', 'u', 'nan', 'a', 'lu', 'a', 'mi', 'la', ',', 'ka', 'u', 'nan', 'lu', 'a', 'mi', 'sha', 'u', 'nan', 'jighjigh', 'u', 'nan', 'man', 'u', 'nan', 'u', 'nan', 'man', 'u', 'nan', 'u', 'nan', 'la', '.', '—', 'Luka', '6', ':', '9', '-', '9', '.'] 2020-02-12 16:04:09,410 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 16:04:09,410 Reference: 10 : ​ 6 - 9 . 2020-02-12 16:04:09,410 Hypothesis: Er nan ve i gbe u or u nan lu a mi sha ci u Yehova yô , ka u nan lu a dooshima u nan a lu a mi la , ka u nan lu a mi sha u nan jighjigh u nan man u nan u nan man u nan u nan la . — Luka 6 : 9 - 9 . 2020-02-12 16:04:09,410 Example #1 2020-02-12 16:04:09,410 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 16:04:09,410 Raw hypothesis: ['Se', 'fatyô', 'u', 'kaan', 'ser', ',', '“', 'Ka', 'sha', 'shighe', 'u', 'se', 'lu', 'a', 'mi', 'la', ',', '”', 'man', 'se', 'lu', 'a', 'mi', 'sha', 'shighe', 'u', 'se', 'lu', 'a', 'mi', 'la', 'je', '!', '—', 'Ps', '.'] 2020-02-12 16:04:09,410 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 16:04:09,410 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 16:04:09,410 Hypothesis: Se fatyô u kaan ser , “ Ka sha shighe u se lu a mi la , ” man se lu a mi sha shighe u se lu a mi la je ! — Ps . 2020-02-12 16:04:09,410 Example #2 2020-02-12 16:04:09,410 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 16:04:09,410 Raw hypothesis: ['Ken', 'masejime', 'yô', ',', 'Paulu', 'lu', 'anyom', 'a', 'karen', 'imôngo', ',', 'a', 'lu', 'ken', 'K@@', 'orinte', ',', 'man', 'Yohane', 'man', 'Yohane', 'man', 'Yohane', '.'] 2020-02-12 16:04:09,410 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 16:04:09,410 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 16:04:09,411 Hypothesis: Ken masejime yô , Paulu lu anyom a karen imôngo , a lu ken Korinte , man Yohane man Yohane man Yohane . 2020-02-12 16:04:09,411 Example #3 2020-02-12 16:04:09,411 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 16:04:09,411 Raw hypothesis: ['(', '1', 'Mbakorinte', '3', ':', '1', ')', 'Kwagh', 'ne', 'una', 'fatyô', 'u', 'eren', 'kwagh', 'u', 'a', 'lu', 'a', 'mi', 'ga', '.'] 2020-02-12 16:04:09,411 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 16:04:09,411 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 16:04:09,411 Hypothesis: ( 1 Mbakorinte 3 : 1 ) Kwagh ne una fatyô u eren kwagh u a lu a mi ga . 2020-02-12 16:04:09,411 Validation result (greedy) at epoch 2, step 4000: bleu: 7.26, loss: 77589.7812, ppl: 13.7484, duration: 23.0879s 2020-02-12 16:04:19,315 Epoch 2 Step: 4100 Batch Loss: 2.247452 Tokens per Sec: 22159, Lr: 0.000300 2020-02-12 16:04:29,221 Epoch 2 Step: 4200 Batch Loss: 2.779771 Tokens per Sec: 22260, Lr: 0.000300 2020-02-12 16:04:39,354 Epoch 2 Step: 4300 Batch Loss: 2.120739 Tokens per Sec: 21882, Lr: 0.000300 2020-02-12 16:04:49,391 Epoch 2 Step: 4400 Batch Loss: 2.848859 Tokens per Sec: 21879, Lr: 0.000300 2020-02-12 16:04:59,376 Epoch 2 Step: 4500 Batch Loss: 2.804246 Tokens per Sec: 22455, Lr: 0.000300 2020-02-12 16:05:09,519 Epoch 2 Step: 4600 Batch Loss: 2.565914 Tokens per Sec: 21965, Lr: 0.000300 2020-02-12 16:05:19,682 Epoch 2 Step: 4700 Batch Loss: 2.769480 Tokens per Sec: 21692, Lr: 0.000300 2020-02-12 16:05:29,775 Epoch 2 Step: 4800 Batch Loss: 2.822880 Tokens per Sec: 21512, Lr: 0.000300 2020-02-12 16:05:39,817 Epoch 2 Step: 4900 Batch Loss: 2.971874 Tokens per Sec: 21757, Lr: 0.000300 2020-02-12 16:05:41,955 Epoch 2: total training loss 6929.75 2020-02-12 16:05:41,955 EPOCH 3 2020-02-12 16:05:50,184 Epoch 3 Step: 5000 Batch Loss: 2.465707 Tokens per Sec: 21611, Lr: 0.000300 2020-02-12 16:06:10,123 Hooray! New best validation result [ppl]! 2020-02-12 16:06:10,123 Saving new checkpoint. 2020-02-12 16:06:10,303 Example #0 2020-02-12 16:06:10,303 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 16:06:10,303 Raw hypothesis: ['Er', 'nan', 've', 'i', 'gbe', 'u', 'or', 'u', 'nan', 'lu', 'a', 'inja', 'i', 'Yehova', 'yô', ',', 'ka', 'u', 'nan', 'lu', 'a', 'inja', 'i', 'nan', 'sha', 'ci', 'u', 'nan', 'lu', 'a', 'inja', 'i', 'nan', 'ga', ',', 'shin', 'nan', 'ngu', 'a', 'inja', 'i', 'nan', 'sha', 'dooshima', 'u', 'nan', 'a', 'lu', 'a', 'mi', 'la', '.', '—', 'Marku', '6', ':', '9', '-', '9', '.'] 2020-02-12 16:06:10,303 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 16:06:10,303 Reference: 10 : ​ 6 - 9 . 2020-02-12 16:06:10,304 Hypothesis: Er nan ve i gbe u or u nan lu a inja i Yehova yô , ka u nan lu a inja i nan sha ci u nan lu a inja i nan ga , shin nan ngu a inja i nan sha dooshima u nan a lu a mi la . — Marku 6 : 9 - 9 . 2020-02-12 16:06:10,304 Example #1 2020-02-12 16:06:10,304 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 16:06:10,304 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', 'nengen', 'er', '“', 'ayange', 'a', 'masejime', '”', 'la', ',', 'shi', 'se', 'fatyô', 'u', 'lun', 'a', 'inja', 'kpishi', '!', '—', 'Mat', '.'] 2020-02-12 16:06:10,304 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 16:06:10,304 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 16:06:10,304 Hypothesis: Se kpa se fatyô u nengen er “ ayange a masejime ” la , shi se fatyô u lun a inja kpishi ! — Mat . 2020-02-12 16:06:10,304 Example #2 2020-02-12 16:06:10,304 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 16:06:10,304 Raw hypothesis: ['Ken', 'anyom', 'kar', 'kar', 'kar', 'yô', ',', 'Paulu', 'lu', 'ken', 'mzough', 'u', 'ken', 'E@@', 'fese', ',', 'u', 'a', 'lu', 'ken', 'E@@', 'fese', 'la', '.'] 2020-02-12 16:06:10,304 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 16:06:10,304 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 16:06:10,304 Hypothesis: Ken anyom kar kar kar yô , Paulu lu ken mzough u ken Efese , u a lu ken Efese la . 2020-02-12 16:06:10,304 Example #3 2020-02-12 16:06:10,304 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 16:06:10,304 Raw hypothesis: ['Kwagh', 'ne', 'una', 'fatyô', 'u', 'lun', 'a', 'inja', 'kpishi', ',', 'nahan', 'kwagh', 'ne', 'una', 'fatyô', 'u', 'eren', 'kwagh', 'u', 'a', 'lu', 'a', 'mi', 'ga', '.'] 2020-02-12 16:06:10,305 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 16:06:10,305 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 16:06:10,305 Hypothesis: Kwagh ne una fatyô u lun a inja kpishi , nahan kwagh ne una fatyô u eren kwagh u a lu a mi ga . 2020-02-12 16:06:10,305 Validation result (greedy) at epoch 3, step 5000: bleu: 9.31, loss: 73523.7891, ppl: 11.9840, duration: 20.1207s 2020-02-12 16:06:20,256 Epoch 3 Step: 5100 Batch Loss: 2.387710 Tokens per Sec: 22109, Lr: 0.000300 2020-02-12 16:06:30,107 Epoch 3 Step: 5200 Batch Loss: 2.558197 Tokens per Sec: 22568, Lr: 0.000300 2020-02-12 16:06:39,985 Epoch 3 Step: 5300 Batch Loss: 2.618725 Tokens per Sec: 21998, Lr: 0.000300 2020-02-12 16:06:49,981 Epoch 3 Step: 5400 Batch Loss: 2.448833 Tokens per Sec: 22080, Lr: 0.000300 2020-02-12 16:06:59,848 Epoch 3 Step: 5500 Batch Loss: 2.614009 Tokens per Sec: 22340, Lr: 0.000300 2020-02-12 16:07:09,770 Epoch 3 Step: 5600 Batch Loss: 2.469665 Tokens per Sec: 22276, Lr: 0.000300 2020-02-12 16:07:19,707 Epoch 3 Step: 5700 Batch Loss: 2.449043 Tokens per Sec: 22438, Lr: 0.000300 2020-02-12 16:07:29,688 Epoch 3 Step: 5800 Batch Loss: 2.619204 Tokens per Sec: 22450, Lr: 0.000300 2020-02-12 16:07:39,714 Epoch 3 Step: 5900 Batch Loss: 2.670405 Tokens per Sec: 21551, Lr: 0.000300 2020-02-12 16:07:49,805 Epoch 3 Step: 6000 Batch Loss: 2.711541 Tokens per Sec: 22025, Lr: 0.000300 2020-02-12 16:08:11,891 Hooray! New best validation result [ppl]! 2020-02-12 16:08:11,891 Saving new checkpoint. 2020-02-12 16:08:12,079 Example #0 2020-02-12 16:08:12,079 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 16:08:12,079 Raw hypothesis: ['Er', 'Yehova', 'a', 'lu', 'a', 'isharen', 'i', 'eren', 'ivese', 'i', 'vesen', 'yô', ',', 'ka', 'u', 'wasen', 'mba', 've', 'lu', 'ken', 'mzough', 'la', ',', 'ka', 'u', 'wasen', 'mba', 've', 'lu', 'a', 'dooshima', 'la', ',', 'shi', 've', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'sha', 'u', 'wasen', 've', 'u', 'lun', 'a', 'dooshima', 'la', '.', '—', 'Marku', '9', ':', '9', '-', '9', '.'] 2020-02-12 16:08:12,079 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 16:08:12,080 Reference: 10 : ​ 6 - 9 . 2020-02-12 16:08:12,080 Hypothesis: Er Yehova a lu a isharen i eren ivese i vesen yô , ka u wasen mba ve lu ken mzough la , ka u wasen mba ve lu a dooshima la , shi ve lu a dooshima u a lu a mi sha u wasen ve u lun a dooshima la . — Marku 9 : 9 - 9 . 2020-02-12 16:08:12,080 Example #1 2020-02-12 16:08:12,080 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 16:08:12,080 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', 'nengen', '“', 'shighe', 'u', 'se', 'lu', 'a', 'mi', '”', 'la', ',', 'shi', 'se', 'nenge', 'a', 'shighe', 'u', 'se', 'lu', 'a', 'mi', 'la', '.', '—', 'Rom', '.'] 2020-02-12 16:08:12,080 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 16:08:12,080 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 16:08:12,080 Hypothesis: Se kpa se fatyô u nengen “ shighe u se lu a mi ” la , shi se nenge a shighe u se lu a mi la . — Rom . 2020-02-12 16:08:12,080 Example #2 2020-02-12 16:08:12,080 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 16:08:12,080 Raw hypothesis: ['Ken', 'masejime', 'yô', ',', 'Paulu', 'lu', 'ken', 'bem', 'ken', 'E@@', 'fese', ',', 'ken', 'E@@', 'fese', ',', 'man', 'lu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 16:08:12,080 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 16:08:12,080 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 16:08:12,080 Hypothesis: Ken masejime yô , Paulu lu ken bem ken Efese , ken Efese , man lu ken Efese . 2020-02-12 16:08:12,080 Example #3 2020-02-12 16:08:12,081 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 16:08:12,081 Raw hypothesis: ['(', '1', 'Mbakorinte', '4', ':', '1', ')', 'Kwagh', 'ne', 'una', 'fatyô', 'u', 'eren', 'kwagh', 'u', 'a', 'lu', 'u', 'or', 'u', 'nan', 'lu', 'a', 'mi', 'la', 'ga', '.'] 2020-02-12 16:08:12,081 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 16:08:12,081 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 16:08:12,081 Hypothesis: ( 1 Mbakorinte 4 : 1 ) Kwagh ne una fatyô u eren kwagh u a lu u or u nan lu a mi la ga . 2020-02-12 16:08:12,081 Validation result (greedy) at epoch 3, step 6000: bleu: 10.51, loss: 70898.3906, ppl: 10.9670, duration: 22.2757s 2020-02-12 16:08:22,005 Epoch 3 Step: 6100 Batch Loss: 2.803612 Tokens per Sec: 21733, Lr: 0.000300 2020-02-12 16:08:31,886 Epoch 3 Step: 6200 Batch Loss: 2.231687 Tokens per Sec: 22270, Lr: 0.000300 2020-02-12 16:08:41,774 Epoch 3 Step: 6300 Batch Loss: 2.216193 Tokens per Sec: 22390, Lr: 0.000300 2020-02-12 16:08:51,805 Epoch 3 Step: 6400 Batch Loss: 2.739138 Tokens per Sec: 22473, Lr: 0.000300 2020-02-12 16:09:01,679 Epoch 3 Step: 6500 Batch Loss: 2.276480 Tokens per Sec: 22256, Lr: 0.000300 2020-02-12 16:09:11,583 Epoch 3 Step: 6600 Batch Loss: 2.295534 Tokens per Sec: 22182, Lr: 0.000300 2020-02-12 16:09:21,610 Epoch 3 Step: 6700 Batch Loss: 2.598059 Tokens per Sec: 22170, Lr: 0.000300 2020-02-12 16:09:31,677 Epoch 3 Step: 6800 Batch Loss: 2.492252 Tokens per Sec: 21920, Lr: 0.000300 2020-02-12 16:09:41,752 Epoch 3 Step: 6900 Batch Loss: 2.634245 Tokens per Sec: 22390, Lr: 0.000300 2020-02-12 16:09:51,806 Epoch 3 Step: 7000 Batch Loss: 2.221498 Tokens per Sec: 21928, Lr: 0.000300 2020-02-12 16:10:13,381 Hooray! New best validation result [ppl]! 2020-02-12 16:10:13,381 Saving new checkpoint. 2020-02-12 16:10:13,567 Example #0 2020-02-12 16:10:13,567 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 16:10:13,567 Raw hypothesis: ['Er', 'ivese', 'i', 'lu', 'hange', 'hange', 'u', 'Yehova', 'a', 'lu', 'a', 'mi', 'sha', 'u', 'lun', 'a', 'inja', 'yô', ',', 'ka', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'sha', 'u', 'wasen', 'mba', 've', 'lu', 'ken', 'dooshima', 'la', ',', 'shi', 've', 'lu', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'la', 'kpaa', '.', '—', 'Marku', '9', ':', '9', '-', '9', '.'] 2020-02-12 16:10:13,567 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 16:10:13,567 Reference: 10 : ​ 6 - 9 . 2020-02-12 16:10:13,567 Hypothesis: Er ivese i lu hange hange u Yehova a lu a mi sha u lun a inja yô , ka u lun a dooshima u a lu a mi sha u wasen mba ve lu ken dooshima la , shi ve lu a dooshima u ve lu a mi la kpaa . — Marku 9 : 9 - 9 . 2020-02-12 16:10:13,568 Example #1 2020-02-12 16:10:13,568 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 16:10:13,568 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', 'nengen', 'a', '“', 'shighe', 'u', 'i', 'lu', 'van', '”', 'la', ',', 'shi', 'se', 'mba', 'nengen', 'a', 'mi', 'sha', 'shighe', 'u', 'i', 'lu', 'van', 'la', '.', '—', 'Rom', '.'] 2020-02-12 16:10:13,568 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 16:10:13,568 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 16:10:13,568 Hypothesis: Se kpa se fatyô u nengen a “ shighe u i lu van ” la , shi se mba nengen a mi sha shighe u i lu van la . — Rom . 2020-02-12 16:10:13,568 Example #2 2020-02-12 16:10:13,568 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 16:10:13,568 Raw hypothesis: ['Ken', 'masejime', 'yô', ',', 'Paulu', 'lu', 'ken', 'E@@', 'fese', ',', 'ken', 'tar', 'u', 'E@@', 'fese', ',', 'shi', 'lu', 'ken', 'E@@', 'fese', 'je', '.'] 2020-02-12 16:10:13,568 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 16:10:13,568 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 16:10:13,568 Hypothesis: Ken masejime yô , Paulu lu ken Efese , ken tar u Efese , shi lu ken Efese je . 2020-02-12 16:10:13,568 Example #3 2020-02-12 16:10:13,568 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 16:10:13,568 Raw hypothesis: ['Kwagh', 'ne', 'una', 'fatyô', 'u', 'lun', 'or', 'u', 'nan', 'lu', 'a', 'mi', 'sha', 'gbenda', 'u', 'nan', 'lu', 'a', 'mi', 'la', 'ga', '.'] 2020-02-12 16:10:13,568 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 16:10:13,569 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 16:10:13,569 Hypothesis: Kwagh ne una fatyô u lun or u nan lu a mi sha gbenda u nan lu a mi la ga . 2020-02-12 16:10:13,569 Validation result (greedy) at epoch 3, step 7000: bleu: 11.87, loss: 68224.2266, ppl: 10.0198, duration: 21.7623s 2020-02-12 16:10:23,420 Epoch 3 Step: 7100 Batch Loss: 2.392289 Tokens per Sec: 22390, Lr: 0.000300 2020-02-12 16:10:33,255 Epoch 3 Step: 7200 Batch Loss: 2.308585 Tokens per Sec: 22352, Lr: 0.000300 2020-02-12 16:10:43,111 Epoch 3 Step: 7300 Batch Loss: 2.353991 Tokens per Sec: 22982, Lr: 0.000300 2020-02-12 16:10:51,099 Epoch 3: total training loss 6184.23 2020-02-12 16:10:51,099 EPOCH 4 2020-02-12 16:10:53,407 Epoch 4 Step: 7400 Batch Loss: 2.594020 Tokens per Sec: 18604, Lr: 0.000300 2020-02-12 16:11:03,264 Epoch 4 Step: 7500 Batch Loss: 2.548170 Tokens per Sec: 22402, Lr: 0.000300 2020-02-12 16:11:13,196 Epoch 4 Step: 7600 Batch Loss: 2.366792 Tokens per Sec: 22935, Lr: 0.000300 2020-02-12 16:11:23,085 Epoch 4 Step: 7700 Batch Loss: 2.471555 Tokens per Sec: 22248, Lr: 0.000300 2020-02-12 16:11:32,991 Epoch 4 Step: 7800 Batch Loss: 2.077398 Tokens per Sec: 22014, Lr: 0.000300 2020-02-12 16:11:42,916 Epoch 4 Step: 7900 Batch Loss: 2.559347 Tokens per Sec: 22381, Lr: 0.000300 2020-02-12 16:11:52,902 Epoch 4 Step: 8000 Batch Loss: 2.120636 Tokens per Sec: 22261, Lr: 0.000300 2020-02-12 16:12:12,928 Hooray! New best validation result [ppl]! 2020-02-12 16:12:12,928 Saving new checkpoint. 2020-02-12 16:12:13,115 Example #0 2020-02-12 16:12:13,115 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 16:12:13,115 Raw hypothesis: ['Er', 'ivese', 'i', 'vesen', 'i', 'Yehova', 'a', 'lu', 'a', 'mi', 'sha', 'ci', 'u', 'mba', 've', 'lu', 'a', 'mi', 'la', 'ka', 'kwagh', 'u', 'hange', 'hange', 'yô', ',', 'ka', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', ',', 'ka', 'u', 'lun', 'a', 'dooshima', 'man', 'dooshima', 'u', 've', 'a', 'lu', 'a', 'mi', 'ken', 'dooshima', 'la', '.', '—', 'Marku', '9', ':', '9', '-', '10', '.'] 2020-02-12 16:12:13,115 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 16:12:13,115 Reference: 10 : ​ 6 - 9 . 2020-02-12 16:12:13,115 Hypothesis: Er ivese i vesen i Yehova a lu a mi sha ci u mba ve lu a mi la ka kwagh u hange hange yô , ka u lun a dooshima u a lu a mi la , ka u lun a dooshima man dooshima u ve a lu a mi ken dooshima la . — Marku 9 : 9 - 10 . 2020-02-12 16:12:13,115 Example #1 2020-02-12 16:12:13,115 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 16:12:13,115 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', 'nengen', '“', 'shighe', 'u', 'mkur', '”', 'la', ',', 'shi', 'se', 'mba', 'a', 'iwanger', 'i', 'kpilighyol', 'kpen', 'kpen', '!', '—', 'Rom', '.'] 2020-02-12 16:12:13,115 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 16:12:13,116 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 16:12:13,116 Hypothesis: Se kpa se fatyô u nengen “ shighe u mkur ” la , shi se mba a iwanger i kpilighyol kpen kpen ! — Rom . 2020-02-12 16:12:13,116 Example #2 2020-02-12 16:12:13,116 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 16:12:13,116 Raw hypothesis: ['Ken', 'anyom', 'a', 'karen', 'ne', ',', 'Paulu', 'lu', 'ken', 'E@@', 'fese', ',', 'nahan', 'a', 'lu', 'ken', 'bem', '.'] 2020-02-12 16:12:13,116 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 16:12:13,116 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 16:12:13,116 Hypothesis: Ken anyom a karen ne , Paulu lu ken Efese , nahan a lu ken bem . 2020-02-12 16:12:13,116 Example #3 2020-02-12 16:12:13,116 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 16:12:13,116 Raw hypothesis: ['Kwagh', 'ne', 'una', 'fatyô', 'u', 'lun', 'a', 'inja', 'sha', 'gbenda', 'u', 'vesen', 'u', 'a', 'lu', 'a', 'mi', 'la', 'ga', '.'] 2020-02-12 16:12:13,116 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 16:12:13,116 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 16:12:13,116 Hypothesis: Kwagh ne una fatyô u lun a inja sha gbenda u vesen u a lu a mi la ga . 2020-02-12 16:12:13,116 Validation result (greedy) at epoch 4, step 8000: bleu: 13.13, loss: 66128.5703, ppl: 9.3350, duration: 20.2143s 2020-02-12 16:12:23,104 Epoch 4 Step: 8100 Batch Loss: 2.234457 Tokens per Sec: 22093, Lr: 0.000300 2020-02-12 16:12:33,030 Epoch 4 Step: 8200 Batch Loss: 2.701011 Tokens per Sec: 22751, Lr: 0.000300 2020-02-12 16:12:42,909 Epoch 4 Step: 8300 Batch Loss: 2.481467 Tokens per Sec: 22401, Lr: 0.000300 2020-02-12 16:12:52,825 Epoch 4 Step: 8400 Batch Loss: 2.432872 Tokens per Sec: 22500, Lr: 0.000300 2020-02-12 16:13:02,840 Epoch 4 Step: 8500 Batch Loss: 2.528447 Tokens per Sec: 23059, Lr: 0.000300 2020-02-12 16:13:12,701 Epoch 4 Step: 8600 Batch Loss: 2.325520 Tokens per Sec: 22765, Lr: 0.000300 2020-02-12 16:13:22,552 Epoch 4 Step: 8700 Batch Loss: 2.364350 Tokens per Sec: 22233, Lr: 0.000300 2020-02-12 16:13:32,427 Epoch 4 Step: 8800 Batch Loss: 2.461168 Tokens per Sec: 21916, Lr: 0.000300 2020-02-12 16:13:42,554 Epoch 4 Step: 8900 Batch Loss: 2.226756 Tokens per Sec: 22067, Lr: 0.000300 2020-02-12 16:13:52,682 Epoch 4 Step: 9000 Batch Loss: 2.398198 Tokens per Sec: 21802, Lr: 0.000300 2020-02-12 16:14:14,582 Hooray! New best validation result [ppl]! 2020-02-12 16:14:14,582 Saving new checkpoint. 2020-02-12 16:14:14,773 Example #0 2020-02-12 16:14:14,773 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 16:14:14,773 Raw hypothesis: ['Er', 'ivese', 'i', 'lu', 'sha', 'ci', 'u', 'Yehova', 'yô', ',', 'ka', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'lu', 'a', 'dooshima', ',', 'shin', 'vea', 'lu', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'lu', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'la', 'kpaa', '.', '—', 'Marku', '10', ':', '9', '-', '9', '.'] 2020-02-12 16:14:14,773 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 16:14:14,773 Reference: 10 : ​ 6 - 9 . 2020-02-12 16:14:14,773 Hypothesis: Er ivese i lu sha ci u Yehova yô , ka hange hange u noov man kasev vea lu a dooshima , shin vea lu a dooshima u ve lu a mi la , shi vea lu a dooshima u ve lu a mi la kpaa . — Marku 10 : 9 - 9 . 2020-02-12 16:14:14,773 Example #1 2020-02-12 16:14:14,773 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 16:14:14,773 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', 'nengen', '“', 'shighe', 'u', 'doon', '”', 'ne', ',', 'shi', 'se', 'mba', 'a', 'shighe', 'u', 'i', 'lu', 'van', 'la', '.', '—', 'Rom', '.'] 2020-02-12 16:14:14,773 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 16:14:14,773 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 16:14:14,774 Hypothesis: Se kpa se fatyô u nengen “ shighe u doon ” ne , shi se mba a shighe u i lu van la . — Rom . 2020-02-12 16:14:14,774 Example #2 2020-02-12 16:14:14,774 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 16:14:14,774 Raw hypothesis: ['Paulu', 'yange', 'er', 'kwagh', 'ne', 'anyom', 'kar', 'imôngo', 'ken', 'tar', 'u', 'E@@', 'fese', ',', 'nahan', 'a', 'lu', 'ken', 'bem', '.'] 2020-02-12 16:14:14,774 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 16:14:14,774 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 16:14:14,774 Hypothesis: Paulu yange er kwagh ne anyom kar imôngo ken tar u Efese , nahan a lu ken bem . 2020-02-12 16:14:14,774 Example #3 2020-02-12 16:14:14,774 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 16:14:14,774 Raw hypothesis: ['Kwagh', 'ne', 'una', 'fatyô', 'u', 'lun', 'or@@', 'maren', 'u', 'nan', 'lu', 'a', 'tahav', 'mbu', 'eren', 'kwagh', 'u', 'nan', 'soo', 'la', 'ga', '.'] 2020-02-12 16:14:14,774 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 16:14:14,774 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 16:14:14,774 Hypothesis: Kwagh ne una fatyô u lun ormaren u nan lu a tahav mbu eren kwagh u nan soo la ga . 2020-02-12 16:14:14,774 Validation result (greedy) at epoch 4, step 9000: bleu: 14.41, loss: 64338.4922, ppl: 8.7873, duration: 22.0916s 2020-02-12 16:14:24,848 Epoch 4 Step: 9100 Batch Loss: 2.023343 Tokens per Sec: 22034, Lr: 0.000300 2020-02-12 16:14:34,855 Epoch 4 Step: 9200 Batch Loss: 2.337622 Tokens per Sec: 22289, Lr: 0.000300 2020-02-12 16:14:44,757 Epoch 4 Step: 9300 Batch Loss: 2.306293 Tokens per Sec: 22518, Lr: 0.000300 2020-02-12 16:14:54,749 Epoch 4 Step: 9400 Batch Loss: 2.179697 Tokens per Sec: 22299, Lr: 0.000300 2020-02-12 16:15:04,763 Epoch 4 Step: 9500 Batch Loss: 2.449395 Tokens per Sec: 22183, Lr: 0.000300 2020-02-12 16:15:14,689 Epoch 4 Step: 9600 Batch Loss: 2.093209 Tokens per Sec: 21866, Lr: 0.000300 2020-02-12 16:15:24,779 Epoch 4 Step: 9700 Batch Loss: 2.653842 Tokens per Sec: 22260, Lr: 0.000300 2020-02-12 16:15:34,682 Epoch 4 Step: 9800 Batch Loss: 2.267682 Tokens per Sec: 21629, Lr: 0.000300 2020-02-12 16:15:37,566 Epoch 4: total training loss 5722.38 2020-02-12 16:15:37,566 EPOCH 5 2020-02-12 16:15:44,904 Epoch 5 Step: 9900 Batch Loss: 1.966238 Tokens per Sec: 21832, Lr: 0.000300 2020-02-12 16:15:54,844 Epoch 5 Step: 10000 Batch Loss: 2.487109 Tokens per Sec: 22467, Lr: 0.000300 2020-02-12 16:16:14,759 Hooray! New best validation result [ppl]! 2020-02-12 16:16:14,759 Saving new checkpoint. 2020-02-12 16:16:14,948 Example #0 2020-02-12 16:16:14,948 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 16:16:14,948 Raw hypothesis: ['Er', 'ivese', 'i', 'lu', 'i', 'Yehova', 'a', 'lu', 'a', 'mi', 'sha', 'kwagh', 'u', 'iv@@', 'es@@', 'egh', 'yô', ',', 'ka', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'lu', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'lu', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'sha', 'u', 'eren', 'kwagh', 'u', 'dooshima', 'la', 'kpaa', '.', '—', 'Marku', '10', ':', '9', '-', '9', '.'] 2020-02-12 16:16:14,948 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 16:16:14,949 Reference: 10 : ​ 6 - 9 . 2020-02-12 16:16:14,949 Hypothesis: Er ivese i lu i Yehova a lu a mi sha kwagh u ivesegh yô , ka hange hange u noov man kasev vea lu a dooshima u ve lu a mi la , shi vea lu a dooshima u ve lu a mi sha u eren kwagh u dooshima la kpaa . — Marku 10 : 9 - 9 . 2020-02-12 16:16:14,949 Example #1 2020-02-12 16:16:14,949 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 16:16:14,949 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', 'nengen', '“', 'shighe', 'u', 'doon', '”', 'ne', ',', 'shi', 'se', 'mba', 'a', 'shighe', 'u', 'doon', 'tsung', '!', '—', 'Rom', '.'] 2020-02-12 16:16:14,949 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 16:16:14,949 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 16:16:14,949 Hypothesis: Se kpa se fatyô u nengen “ shighe u doon ” ne , shi se mba a shighe u doon tsung ! — Rom . 2020-02-12 16:16:14,949 Example #2 2020-02-12 16:16:14,949 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 16:16:14,949 Raw hypothesis: ['Ken', 'anyom', 'pue', 'kar', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 16:16:14,949 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 16:16:14,949 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 16:16:14,949 Hypothesis: Ken anyom pue kar yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 16:16:14,950 Example #3 2020-02-12 16:16:14,950 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 16:16:14,950 Raw hypothesis: ['Kwagh', 'ne', 'una', 'fatyô', 'u', 'eren', 'kwagh', 'u', 'or', 'u', 'nan', 'lu', 'a', 'mi', 'sha', 'gbenda', 'u', 'nan', 'soo', 'u', 'eren', 'la', 'ga', '.'] 2020-02-12 16:16:14,950 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 16:16:14,950 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 16:16:14,950 Hypothesis: Kwagh ne una fatyô u eren kwagh u or u nan lu a mi sha gbenda u nan soo u eren la ga . 2020-02-12 16:16:14,950 Validation result (greedy) at epoch 5, step 10000: bleu: 15.51, loss: 62378.2969, ppl: 8.2243, duration: 20.1053s 2020-02-12 16:16:24,819 Epoch 5 Step: 10100 Batch Loss: 1.982166 Tokens per Sec: 22377, Lr: 0.000300 2020-02-12 16:16:34,695 Epoch 5 Step: 10200 Batch Loss: 2.273010 Tokens per Sec: 22155, Lr: 0.000300 2020-02-12 16:16:44,558 Epoch 5 Step: 10300 Batch Loss: 2.021907 Tokens per Sec: 22818, Lr: 0.000300 2020-02-12 16:16:54,489 Epoch 5 Step: 10400 Batch Loss: 2.374995 Tokens per Sec: 22376, Lr: 0.000300 2020-02-12 16:17:04,457 Epoch 5 Step: 10500 Batch Loss: 2.002748 Tokens per Sec: 22170, Lr: 0.000300 2020-02-12 16:17:14,423 Epoch 5 Step: 10600 Batch Loss: 2.368401 Tokens per Sec: 21915, Lr: 0.000300 2020-02-12 16:17:24,329 Epoch 5 Step: 10700 Batch Loss: 2.217776 Tokens per Sec: 22016, Lr: 0.000300 2020-02-12 16:17:34,280 Epoch 5 Step: 10800 Batch Loss: 1.833345 Tokens per Sec: 22474, Lr: 0.000300 2020-02-12 16:17:44,366 Epoch 5 Step: 10900 Batch Loss: 2.128143 Tokens per Sec: 21638, Lr: 0.000300 2020-02-12 16:17:54,498 Epoch 5 Step: 11000 Batch Loss: 2.304907 Tokens per Sec: 22062, Lr: 0.000300 2020-02-12 16:18:15,938 Hooray! New best validation result [ppl]! 2020-02-12 16:18:15,939 Saving new checkpoint. 2020-02-12 16:18:16,126 Example #0 2020-02-12 16:18:16,127 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 16:18:16,127 Raw hypothesis: ['Er', 'Yehova', 'a', 'lu', 'a', 'ian', 'i', 'eren', 'ivese', 'i', 'vesen', 'yô', ',', 'ka', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'lu', 'a', 'dooshima', 'shi', 'vea', 'lu', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'la', ',', 'vea', 'lu', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'la', ',', 'vea', 'lu', 'a', 'mi', 'sha', 'u', 'lun', 'a', 'dooshima', 'u', 'Aôndo', '.', '—', 'Marku', '6', ':', '9', '-', '9', '.'] 2020-02-12 16:18:16,127 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 16:18:16,127 Reference: 10 : ​ 6 - 9 . 2020-02-12 16:18:16,127 Hypothesis: Er Yehova a lu a ian i eren ivese i vesen yô , ka hange hange u noov man kasev vea lu a dooshima shi vea lu a dooshima u ve lu a mi la , vea lu a dooshima u ve lu a mi la , vea lu a mi sha u lun a dooshima u Aôndo . — Marku 6 : 9 - 9 . 2020-02-12 16:18:16,127 Example #1 2020-02-12 16:18:16,127 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 16:18:16,127 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', 'nengen', 'a', '“', 'shighe', 'u', 'kpilighyol', '”', '—', 'Rom', '.'] 2020-02-12 16:18:16,127 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 16:18:16,127 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 16:18:16,127 Hypothesis: Se kpa se fatyô u nengen a “ shighe u kpilighyol ” — Rom . 2020-02-12 16:18:16,127 Example #2 2020-02-12 16:18:16,128 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 16:18:16,128 Raw hypothesis: ['Ken', 'anyom', 'pue', 'kar', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', '.'] 2020-02-12 16:18:16,128 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 16:18:16,128 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 16:18:16,128 Hypothesis: Ken anyom pue kar yô , Paulu lu ken Masedonia man Timoteu . 2020-02-12 16:18:16,128 Example #3 2020-02-12 16:18:16,128 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 16:18:16,128 Raw hypothesis: ['Alaghga', 'or', 'nana', 'fatyô', 'u', 'lun', 'a', 'imba', 'gbenda', 'la', 'sha', 'gbenda', 'u', 'nan', 'soo', 'u', 'eren', 'kwagh', 'u', 'nan', 'soo', 'la', 'ga', '.'] 2020-02-12 16:18:16,128 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 16:18:16,128 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 16:18:16,128 Hypothesis: Alaghga or nana fatyô u lun a imba gbenda la sha gbenda u nan soo u eren kwagh u nan soo la ga . 2020-02-12 16:18:16,128 Validation result (greedy) at epoch 5, step 11000: bleu: 15.66, loss: 61080.1367, ppl: 7.8714, duration: 21.6300s 2020-02-12 16:18:26,323 Epoch 5 Step: 11100 Batch Loss: 2.487456 Tokens per Sec: 21972, Lr: 0.000300 2020-02-12 16:18:36,370 Epoch 5 Step: 11200 Batch Loss: 2.282746 Tokens per Sec: 22104, Lr: 0.000300 2020-02-12 16:18:46,378 Epoch 5 Step: 11300 Batch Loss: 2.207912 Tokens per Sec: 21580, Lr: 0.000300 2020-02-12 16:18:56,373 Epoch 5 Step: 11400 Batch Loss: 2.507225 Tokens per Sec: 21892, Lr: 0.000300 2020-02-12 16:19:06,311 Epoch 5 Step: 11500 Batch Loss: 2.211894 Tokens per Sec: 22288, Lr: 0.000300 2020-02-12 16:19:16,292 Epoch 5 Step: 11600 Batch Loss: 2.177078 Tokens per Sec: 22076, Lr: 0.000300 2020-02-12 16:19:26,169 Epoch 5 Step: 11700 Batch Loss: 2.290599 Tokens per Sec: 22705, Lr: 0.000300 2020-02-12 16:19:36,062 Epoch 5 Step: 11800 Batch Loss: 2.441172 Tokens per Sec: 22458, Lr: 0.000300 2020-02-12 16:19:45,980 Epoch 5 Step: 11900 Batch Loss: 1.976811 Tokens per Sec: 21963, Lr: 0.000300 2020-02-12 16:19:55,868 Epoch 5 Step: 12000 Batch Loss: 2.123380 Tokens per Sec: 22256, Lr: 0.000300 2020-02-12 16:20:15,868 Hooray! New best validation result [ppl]! 2020-02-12 16:20:15,868 Saving new checkpoint. 2020-02-12 16:20:16,057 Example #0 2020-02-12 16:20:16,058 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 16:20:16,058 Raw hypothesis: ['Er', 'ivese', 'i', 'lu', 'i', 'Yehova', 'a', 'lu', 'a', 'mi', 'la', 'i', 'lu', 'kwagh', 'u', 'vesen', 'u', 'vesen', 'yô', ',', 'ka', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'lu', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'la', ',', 'vea', 'lu', 'a', 'mi', 'sha', 'u', 'lun', 'a', 'dooshima', 'man', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'la', '.', '—', 'Marku', '10', ':', '9', '-', '9', '.'] 2020-02-12 16:20:16,058 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 16:20:16,058 Reference: 10 : ​ 6 - 9 . 2020-02-12 16:20:16,058 Hypothesis: Er ivese i lu i Yehova a lu a mi la i lu kwagh u vesen u vesen yô , ka hange hange u noov man kasev vea lu a dooshima u ve lu a mi la , vea lu a mi sha u lun a dooshima man dooshima u ve lu a mi la . — Marku 10 : 9 - 9 . 2020-02-12 16:20:16,058 Example #1 2020-02-12 16:20:16,058 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 16:20:16,058 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', 'a', 'shighe', 'u', 'doon', 'tsung', ',', '’', 'shi', 'se', 'mba', 'a', 'shighe', 'u', 'doon', 'tsung', 'je', 'kpaa', '!', '—', 'Rom', '.'] 2020-02-12 16:20:16,058 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 16:20:16,058 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 16:20:16,058 Hypothesis: Se kpa se fatyô u ‘ nengen a shighe u doon tsung , ’ shi se mba a shighe u doon tsung je kpaa ! — Rom . 2020-02-12 16:20:16,058 Example #2 2020-02-12 16:20:16,058 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 16:20:16,059 Raw hypothesis: ['Shighe', 'kar', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', ',', 'ken', 'E@@', 'fese', '.'] 2020-02-12 16:20:16,059 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 16:20:16,059 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 16:20:16,059 Hypothesis: Shighe kar yô , Paulu lu ken Masedonia man Timoteu , ken Efese . 2020-02-12 16:20:16,059 Example #3 2020-02-12 16:20:16,059 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 16:20:16,059 Raw hypothesis: ['Kwagh', 'ne', 'una', 'fatyô', 'u', 'lun', 'or@@', 'maren', 'u', 'lun', 'a', 'inja', 'sha', 'gbenda', 'u', 'i', 'gbe', 'u', 'nana', 'er', 'kwagh', 'sha', 'mi', 'ga', 'yô', '.'] 2020-02-12 16:20:16,059 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 16:20:16,059 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 16:20:16,059 Hypothesis: Kwagh ne una fatyô u lun ormaren u lun a inja sha gbenda u i gbe u nana er kwagh sha mi ga yô . 2020-02-12 16:20:16,059 Validation result (greedy) at epoch 5, step 12000: bleu: 16.63, loss: 59583.0781, ppl: 7.4833, duration: 20.1909s 2020-02-12 16:20:25,904 Epoch 5 Step: 12100 Batch Loss: 2.391531 Tokens per Sec: 22426, Lr: 0.000300 2020-02-12 16:20:35,758 Epoch 5 Step: 12200 Batch Loss: 2.188322 Tokens per Sec: 22498, Lr: 0.000300 2020-02-12 16:20:44,605 Epoch 5: total training loss 5428.09 2020-02-12 16:20:44,605 EPOCH 6 2020-02-12 16:20:45,882 Epoch 6 Step: 12300 Batch Loss: 2.308112 Tokens per Sec: 17816, Lr: 0.000300 2020-02-12 16:20:55,822 Epoch 6 Step: 12400 Batch Loss: 1.998952 Tokens per Sec: 22357, Lr: 0.000300 2020-02-12 16:21:05,708 Epoch 6 Step: 12500 Batch Loss: 2.275053 Tokens per Sec: 22686, Lr: 0.000300 2020-02-12 16:21:15,612 Epoch 6 Step: 12600 Batch Loss: 2.252143 Tokens per Sec: 22486, Lr: 0.000300 2020-02-12 16:21:25,643 Epoch 6 Step: 12700 Batch Loss: 2.169776 Tokens per Sec: 22205, Lr: 0.000300 2020-02-12 16:21:35,512 Epoch 6 Step: 12800 Batch Loss: 1.907391 Tokens per Sec: 21538, Lr: 0.000300 2020-02-12 16:21:45,430 Epoch 6 Step: 12900 Batch Loss: 2.397996 Tokens per Sec: 22504, Lr: 0.000300 2020-02-12 16:21:55,386 Epoch 6 Step: 13000 Batch Loss: 2.280136 Tokens per Sec: 22440, Lr: 0.000300 2020-02-12 16:22:14,869 Hooray! New best validation result [ppl]! 2020-02-12 16:22:14,869 Saving new checkpoint. 2020-02-12 16:22:15,058 Example #0 2020-02-12 16:22:15,058 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 16:22:15,059 Raw hypothesis: ['Er', 'Yehova', 'a', 'lu', 'a', 'awashima', 'u', 'vough', 'yô', ',', 'ka', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'lu', 'a', 'isharen', 'i', 'eren', 'kwagh', 'u', 'dedoo', ',', 'shi', 'vea', 'lu', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'la', ',', 'vea', 'lu', 'a', 'mi', 'sha', 'u', 'tesen', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'la', '.', '—', 'Marku', '10', ':', '9', '-', '9', '.'] 2020-02-12 16:22:15,059 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 16:22:15,059 Reference: 10 : ​ 6 - 9 . 2020-02-12 16:22:15,059 Hypothesis: Er Yehova a lu a awashima u vough yô , ka hange hange u noov man kasev vea lu a isharen i eren kwagh u dedoo , shi vea lu a dooshima u ve lu a mi la , vea lu a mi sha u tesen dooshima u ve lu a mi la . — Marku 10 : 9 - 9 . 2020-02-12 16:22:15,059 Example #1 2020-02-12 16:22:15,059 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 16:22:15,059 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'kpilighyol', 'ne', ',', 'shi', 'se', 'mba', 'ikyua', 'a', 'Yehova', 'kpaa', '.', '—', 'Rom', '.'] 2020-02-12 16:22:15,059 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 16:22:15,059 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 16:22:15,059 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u kpilighyol ne , shi se mba ikyua a Yehova kpaa . — Rom . 2020-02-12 16:22:15,059 Example #2 2020-02-12 16:22:15,059 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 16:22:15,060 Raw hypothesis: ['Ken', 'anyom', 'nga', 'kar', 'pue', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 16:22:15,060 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 16:22:15,060 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 16:22:15,060 Hypothesis: Ken anyom nga kar pue yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 16:22:15,060 Example #3 2020-02-12 16:22:15,060 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 16:22:15,060 Raw hypothesis: ['Alaghga', 'or', 'nana', 'fatyô', 'u', 'eren', 'kwagh', 'u', 'nan', 'soo', 'u', 'eren', 'la', 'sha', 'gbenda', 'u', 'nan', 'lu', 'a', 'mi', 'ga', '.'] 2020-02-12 16:22:15,060 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 16:22:15,060 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 16:22:15,060 Hypothesis: Alaghga or nana fatyô u eren kwagh u nan soo u eren la sha gbenda u nan lu a mi ga . 2020-02-12 16:22:15,060 Validation result (greedy) at epoch 6, step 13000: bleu: 16.84, loss: 58631.8945, ppl: 7.2467, duration: 19.6735s 2020-02-12 16:22:25,010 Epoch 6 Step: 13100 Batch Loss: 2.109484 Tokens per Sec: 22544, Lr: 0.000300 2020-02-12 16:22:34,934 Epoch 6 Step: 13200 Batch Loss: 1.922879 Tokens per Sec: 21784, Lr: 0.000300 2020-02-12 16:22:44,877 Epoch 6 Step: 13300 Batch Loss: 2.186911 Tokens per Sec: 22893, Lr: 0.000300 2020-02-12 16:22:54,871 Epoch 6 Step: 13400 Batch Loss: 1.936656 Tokens per Sec: 21614, Lr: 0.000300 2020-02-12 16:23:04,832 Epoch 6 Step: 13500 Batch Loss: 2.064526 Tokens per Sec: 22143, Lr: 0.000300 2020-02-12 16:23:14,760 Epoch 6 Step: 13600 Batch Loss: 2.143647 Tokens per Sec: 22323, Lr: 0.000300 2020-02-12 16:23:24,762 Epoch 6 Step: 13700 Batch Loss: 2.014436 Tokens per Sec: 22092, Lr: 0.000300 2020-02-12 16:23:34,673 Epoch 6 Step: 13800 Batch Loss: 1.766890 Tokens per Sec: 22426, Lr: 0.000300 2020-02-12 16:23:44,490 Epoch 6 Step: 13900 Batch Loss: 1.993079 Tokens per Sec: 21993, Lr: 0.000300 2020-02-12 16:23:54,419 Epoch 6 Step: 14000 Batch Loss: 1.970243 Tokens per Sec: 22196, Lr: 0.000300 2020-02-12 16:24:13,490 Hooray! New best validation result [ppl]! 2020-02-12 16:24:13,491 Saving new checkpoint. 2020-02-12 16:24:13,690 Example #0 2020-02-12 16:24:13,690 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 16:24:13,690 Raw hypothesis: ['Er', 'i', 'lu', 'kwagh', 'u', 'iv@@', 'es@@', 'egh', 'i', 'Yehova', 'a', 'lu', 'a', 'mi', 'sha', 'u', 'lun', 'uma', 'gbem', 'yô', ',', 'ka', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'lu', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'lu', 'a', 'mi', 'sha', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'la', 'kpaa', '.', '—', 'Marku', '10', ':', '9', '-', '9', '.'] 2020-02-12 16:24:13,691 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 16:24:13,691 Reference: 10 : ​ 6 - 9 . 2020-02-12 16:24:13,691 Hypothesis: Er i lu kwagh u ivesegh i Yehova a lu a mi sha u lun uma gbem yô , ka hange hange u noov man kasev vea lu a dooshima u ve lu a mi la , shi vea lu a mi sha dooshima u ve lu a mi la kpaa . — Marku 10 : 9 - 9 . 2020-02-12 16:24:13,691 Example #1 2020-02-12 16:24:13,691 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 16:24:13,691 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'kpilighyol', 'ne', ',', 'shi', 'se', 'mba', 'ikyua', 'a', 'vese', 'kpaa', '!', '—', 'Rom', '.'] 2020-02-12 16:24:13,691 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 16:24:13,691 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 16:24:13,691 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u kpilighyol ne , shi se mba ikyua a vese kpaa ! — Rom . 2020-02-12 16:24:13,691 Example #2 2020-02-12 16:24:13,691 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 16:24:13,691 Raw hypothesis: ['Ken', 'masejime', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 16:24:13,691 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 16:24:13,691 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 16:24:13,692 Hypothesis: Ken masejime yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 16:24:13,692 Example #3 2020-02-12 16:24:13,692 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 16:24:13,692 Raw hypothesis: ['Kwagh', 'ne', 'una', 'fatyô', 'u', 'lun', 'or', 'u', 'nan', 'lu', 'a', 'mi', 'sha', 'gbenda', 'u', 'i', 'lu', 'u', 'nan', 'or', 'u', 'nan', 'lu', 'a', 'mi', 'la', 'ga', '.'] 2020-02-12 16:24:13,692 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 16:24:13,692 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 16:24:13,692 Hypothesis: Kwagh ne una fatyô u lun or u nan lu a mi sha gbenda u i lu u nan or u nan lu a mi la ga . 2020-02-12 16:24:13,692 Validation result (greedy) at epoch 6, step 14000: bleu: 17.81, loss: 57596.1562, ppl: 6.9975, duration: 19.2720s 2020-02-12 16:24:23,728 Epoch 6 Step: 14100 Batch Loss: 2.200467 Tokens per Sec: 22066, Lr: 0.000300 2020-02-12 16:24:33,678 Epoch 6 Step: 14200 Batch Loss: 2.461322 Tokens per Sec: 22432, Lr: 0.000300 2020-02-12 16:24:43,582 Epoch 6 Step: 14300 Batch Loss: 2.316701 Tokens per Sec: 22904, Lr: 0.000300 2020-02-12 16:24:53,516 Epoch 6 Step: 14400 Batch Loss: 1.990537 Tokens per Sec: 22172, Lr: 0.000300 2020-02-12 16:25:03,426 Epoch 6 Step: 14500 Batch Loss: 2.032058 Tokens per Sec: 22148, Lr: 0.000300 2020-02-12 16:25:13,430 Epoch 6 Step: 14600 Batch Loss: 1.834708 Tokens per Sec: 22052, Lr: 0.000300 2020-02-12 16:25:23,378 Epoch 6 Step: 14700 Batch Loss: 2.131001 Tokens per Sec: 21988, Lr: 0.000300 2020-02-12 16:25:28,152 Epoch 6: total training loss 5174.43 2020-02-12 16:25:28,153 EPOCH 7 2020-02-12 16:25:33,686 Epoch 7 Step: 14800 Batch Loss: 2.117682 Tokens per Sec: 21193, Lr: 0.000300 2020-02-12 16:25:43,579 Epoch 7 Step: 14900 Batch Loss: 2.088548 Tokens per Sec: 21896, Lr: 0.000300 2020-02-12 16:25:53,570 Epoch 7 Step: 15000 Batch Loss: 2.110936 Tokens per Sec: 21967, Lr: 0.000300 2020-02-12 16:26:13,398 Hooray! New best validation result [ppl]! 2020-02-12 16:26:13,398 Saving new checkpoint. 2020-02-12 16:26:13,588 Example #0 2020-02-12 16:26:13,588 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 16:26:13,588 Raw hypothesis: ['Er', 'ivese', 'i', 'lu', 'kwagh', 'u', 'vesen', 'u', 'Yehova', 'a', 'lu', 'a', 'mi', 'yô', ',', 'ka', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kwagh', 'kpoghuloo', 'sha', 'er', 'vea', 'lu', 'a', 'dooshima', 'man', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'seer', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'ken', 'mzough', 'la', 'kpaa', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 16:26:13,588 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 16:26:13,588 Reference: 10 : ​ 6 - 9 . 2020-02-12 16:26:13,588 Hypothesis: Er ivese i lu kwagh u vesen u Yehova a lu a mi yô , ka hange hange u noov man kasev vea nôngo kwagh kpoghuloo sha er vea lu a dooshima man dooshima u ve lu a mi la , shi vea seer lun a dooshima u a lu ken mzough la kpaa . — Marku 10 : 6 - 9 . 2020-02-12 16:26:13,588 Example #1 2020-02-12 16:26:13,588 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 16:26:13,588 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', 'nengen', '“', 'shighe', '”', 'ne', ',', 'nahan', 'ka', 'shighe', 'u', 'kpilighyol', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 16:26:13,588 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 16:26:13,589 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 16:26:13,589 Hypothesis: Se kpa se fatyô u nengen “ shighe ” ne , nahan ka shighe u kpilighyol je la ! — Rom . 2020-02-12 16:26:13,589 Example #2 2020-02-12 16:26:13,589 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 16:26:13,589 Raw hypothesis: ['Ken', 'anyom', 'nga', 'kar', 'hegen', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 16:26:13,589 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 16:26:13,589 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 16:26:13,589 Hypothesis: Ken anyom nga kar hegen yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 16:26:13,589 Example #3 2020-02-12 16:26:13,589 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 16:26:13,589 Raw hypothesis: ['A', 'fatyô', 'u', 'kaan', 'ér', 'or', 'u', 'nan', 'lu', 'a', 'tahav', 'mbu', 'eren', 'kwagh', 'sha', 'inja', 'ga', 'yô', '.'] 2020-02-12 16:26:13,589 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 16:26:13,589 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 16:26:13,589 Hypothesis: A fatyô u kaan ér or u nan lu a tahav mbu eren kwagh sha inja ga yô . 2020-02-12 16:26:13,589 Validation result (greedy) at epoch 7, step 15000: bleu: 18.55, loss: 56781.5078, ppl: 6.8076, duration: 20.0184s 2020-02-12 16:26:23,593 Epoch 7 Step: 15100 Batch Loss: 2.274362 Tokens per Sec: 22315, Lr: 0.000300 2020-02-12 16:26:33,578 Epoch 7 Step: 15200 Batch Loss: 2.229963 Tokens per Sec: 22084, Lr: 0.000300 2020-02-12 16:26:43,528 Epoch 7 Step: 15300 Batch Loss: 1.852999 Tokens per Sec: 21807, Lr: 0.000300 2020-02-12 16:26:53,515 Epoch 7 Step: 15400 Batch Loss: 1.877712 Tokens per Sec: 22103, Lr: 0.000300 2020-02-12 16:27:03,424 Epoch 7 Step: 15500 Batch Loss: 2.152976 Tokens per Sec: 22229, Lr: 0.000300 2020-02-12 16:27:13,506 Epoch 7 Step: 15600 Batch Loss: 2.379538 Tokens per Sec: 21676, Lr: 0.000300 2020-02-12 16:27:23,701 Epoch 7 Step: 15700 Batch Loss: 1.854567 Tokens per Sec: 21686, Lr: 0.000300 2020-02-12 16:27:33,916 Epoch 7 Step: 15800 Batch Loss: 1.512889 Tokens per Sec: 21490, Lr: 0.000300 2020-02-12 16:27:44,029 Epoch 7 Step: 15900 Batch Loss: 2.030560 Tokens per Sec: 21496, Lr: 0.000300 2020-02-12 16:27:54,053 Epoch 7 Step: 16000 Batch Loss: 1.885270 Tokens per Sec: 22011, Lr: 0.000300 2020-02-12 16:28:13,204 Hooray! New best validation result [ppl]! 2020-02-12 16:28:13,204 Saving new checkpoint. 2020-02-12 16:28:13,391 Example #0 2020-02-12 16:28:13,392 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 16:28:13,392 Raw hypothesis: ['Er', 'i', 'lu', 'hange', 'hange', 'u', 'nom', 'man', 'kwase', 'vea', 'lu', 'a', 'dooshima', 'yô', ',', 'ka', 'hange', 'hange', 'u', 'vea', 'nôngo', 'kwagh', 'kpoghuloo', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'sha', 'kwagh', 'u', 'dooshima', 'la', '.', '—', 'Marku', '10', ':', '9', '-', '9', '.'] 2020-02-12 16:28:13,392 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 16:28:13,392 Reference: 10 : ​ 6 - 9 . 2020-02-12 16:28:13,392 Hypothesis: Er i lu hange hange u nom man kwase vea lu a dooshima yô , ka hange hange u vea nôngo kwagh kpoghuloo vea za hemen u lun a dooshima u ve lu a mi la , shi vea za hemen u lun a dooshima u ve lu a mi sha kwagh u dooshima la . — Marku 10 : 9 - 9 . 2020-02-12 16:28:13,392 Example #1 2020-02-12 16:28:13,392 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 16:28:13,392 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'shi', 'ka', 'shighe', 'u', 'doon', 'tsung', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 16:28:13,392 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 16:28:13,392 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 16:28:13,392 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u doon tsung ne , shi ka shighe u doon tsung je la ! — Rom . 2020-02-12 16:28:13,392 Example #2 2020-02-12 16:28:13,392 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 16:28:13,392 Raw hypothesis: ['Ken', 'anyom', 'pue', 'kar', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', '.'] 2020-02-12 16:28:13,393 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 16:28:13,393 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 16:28:13,393 Hypothesis: Ken anyom pue kar yô , Paulu lu ken Masedonia man Timoteu . 2020-02-12 16:28:13,393 Example #3 2020-02-12 16:28:13,393 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 16:28:13,393 Raw hypothesis: ['Kwagh', 'ne', 'una', 'fatyô', 'u', 'lun', 'nahan', 'sha', 'gbenda', 'u', 'i', 'gbe', 'u', 'or', 'a', 'er', 'kwagh', 'sha', 'mi', 'ga', 'la', '.'] 2020-02-12 16:28:13,393 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 16:28:13,393 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 16:28:13,393 Hypothesis: Kwagh ne una fatyô u lun nahan sha gbenda u i gbe u or a er kwagh sha mi ga la . 2020-02-12 16:28:13,393 Validation result (greedy) at epoch 7, step 16000: bleu: 18.55, loss: 55835.7148, ppl: 6.5935, duration: 19.3396s 2020-02-12 16:28:23,312 Epoch 7 Step: 16100 Batch Loss: 2.202749 Tokens per Sec: 22046, Lr: 0.000300 2020-02-12 16:28:33,240 Epoch 7 Step: 16200 Batch Loss: 1.774728 Tokens per Sec: 22458, Lr: 0.000300 2020-02-12 16:28:43,167 Epoch 7 Step: 16300 Batch Loss: 1.727866 Tokens per Sec: 22257, Lr: 0.000300 2020-02-12 16:28:53,155 Epoch 7 Step: 16400 Batch Loss: 1.883956 Tokens per Sec: 22405, Lr: 0.000300 2020-02-12 16:29:03,116 Epoch 7 Step: 16500 Batch Loss: 1.944116 Tokens per Sec: 22219, Lr: 0.000300 2020-02-12 16:29:13,100 Epoch 7 Step: 16600 Batch Loss: 2.092608 Tokens per Sec: 21733, Lr: 0.000300 2020-02-12 16:29:23,135 Epoch 7 Step: 16700 Batch Loss: 2.157441 Tokens per Sec: 21804, Lr: 0.000300 2020-02-12 16:29:33,063 Epoch 7 Step: 16800 Batch Loss: 2.321883 Tokens per Sec: 22356, Lr: 0.000300 2020-02-12 16:29:43,059 Epoch 7 Step: 16900 Batch Loss: 2.048239 Tokens per Sec: 22476, Lr: 0.000300 2020-02-12 16:29:53,051 Epoch 7 Step: 17000 Batch Loss: 2.074275 Tokens per Sec: 22484, Lr: 0.000300 2020-02-12 16:30:13,380 Hooray! New best validation result [ppl]! 2020-02-12 16:30:13,380 Saving new checkpoint. 2020-02-12 16:30:13,579 Example #0 2020-02-12 16:30:13,579 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 16:30:13,579 Raw hypothesis: ['Er', 'Yehova', 'a', 'ver', 'ivese', 'sha', 'u', 'kuren', 'awashima', 'na', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'vea', 'nôngo', 'sha', 'afatyô', 've', 'cii', 'vea', 'lu', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'la', ',', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'ken', 'mzough', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 16:30:13,579 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 16:30:13,579 Reference: 10 : ​ 6 - 9 . 2020-02-12 16:30:13,579 Hypothesis: Er Yehova a ver ivese sha u kuren awashima na u tsôron yô , gba hange hange u noov vea nôngo sha afatyô ve cii vea lu a dooshima u ve lu a mi la , vea za hemen u lun a dooshima u a lu ken mzough la . — Marku 10 : 6 - 9 . 2020-02-12 16:30:13,580 Example #1 2020-02-12 16:30:13,580 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 16:30:13,580 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', 'nengen', '“', 'shighe', '”', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'doon', 'je', 'la', '.', '—', 'Rom', '.'] 2020-02-12 16:30:13,580 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 16:30:13,580 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 16:30:13,580 Hypothesis: Se kpa se fatyô u nengen “ shighe ” u doon tsung ne , man ka shighe u doon je la . — Rom . 2020-02-12 16:30:13,580 Example #2 2020-02-12 16:30:13,580 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 16:30:13,580 Raw hypothesis: ['Ken', 'masejime', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 16:30:13,580 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 16:30:13,580 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 16:30:13,580 Hypothesis: Ken masejime yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 16:30:13,580 Example #3 2020-02-12 16:30:13,580 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 16:30:13,580 Raw hypothesis: ['Alaghga', 'or', 'nana', 'fatyô', 'u', 'eren', 'kwagh', 'u', 'a', 'lu', 'u', 'shami', 'ga', 'yô', '.'] 2020-02-12 16:30:13,580 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 16:30:13,581 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 16:30:13,581 Hypothesis: Alaghga or nana fatyô u eren kwagh u a lu u shami ga yô . 2020-02-12 16:30:13,581 Validation result (greedy) at epoch 7, step 17000: bleu: 18.45, loss: 55276.6172, ppl: 6.4702, duration: 20.5290s 2020-02-12 16:30:23,623 Epoch 7 Step: 17100 Batch Loss: 2.066772 Tokens per Sec: 22174, Lr: 0.000300 2020-02-12 16:30:33,695 Epoch 7 Step: 17200 Batch Loss: 2.134908 Tokens per Sec: 22273, Lr: 0.000300 2020-02-12 16:30:34,706 Epoch 7: total training loss 5007.08 2020-02-12 16:30:34,707 EPOCH 8 2020-02-12 16:30:44,048 Epoch 8 Step: 17300 Batch Loss: 1.992836 Tokens per Sec: 21293, Lr: 0.000300 2020-02-12 16:30:54,245 Epoch 8 Step: 17400 Batch Loss: 2.089068 Tokens per Sec: 21298, Lr: 0.000300 2020-02-12 16:31:04,383 Epoch 8 Step: 17500 Batch Loss: 1.974792 Tokens per Sec: 21779, Lr: 0.000300 2020-02-12 16:31:14,499 Epoch 8 Step: 17600 Batch Loss: 1.596745 Tokens per Sec: 21819, Lr: 0.000300 2020-02-12 16:31:24,619 Epoch 8 Step: 17700 Batch Loss: 1.985769 Tokens per Sec: 21598, Lr: 0.000300 2020-02-12 16:31:34,727 Epoch 8 Step: 17800 Batch Loss: 2.368596 Tokens per Sec: 21567, Lr: 0.000300 2020-02-12 16:31:44,962 Epoch 8 Step: 17900 Batch Loss: 2.099503 Tokens per Sec: 21588, Lr: 0.000300 2020-02-12 16:31:55,057 Epoch 8 Step: 18000 Batch Loss: 2.024249 Tokens per Sec: 21395, Lr: 0.000300 2020-02-12 16:32:14,614 Hooray! New best validation result [ppl]! 2020-02-12 16:32:14,614 Saving new checkpoint. 2020-02-12 16:32:14,801 Example #0 2020-02-12 16:32:14,801 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 16:32:14,801 Raw hypothesis: ['Er', 'Yehova', 'a', 'lu', 'a', 'ian', 'i', 'eren', 'kwagh', 'u', 'a', 'tsough', 'u', 'eren', 'la', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'vea', 'nôngo', 'kwagh', 'kpoghuloo', 've', 'vea', 'lu', 'a', 'ieren', 'i', 'dedoo', 'i', 'vea', 'lu', 'a', 'mi', 'i', 'lun', 'a', 'dooshima', 'man', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'la', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'mi', 'ken', 'dooshima', 'u', 'a', 'lu', 'ken', 'mzough', 'la', '.', '—', 'Marku', '10', ':', '9', '-', '9', '.'] 2020-02-12 16:32:14,801 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 16:32:14,801 Reference: 10 : ​ 6 - 9 . 2020-02-12 16:32:14,802 Hypothesis: Er Yehova a lu a ian i eren kwagh u a tsough u eren la yô , gba hange hange u noov vea nôngo kwagh kpoghuloo ve vea lu a ieren i dedoo i vea lu a mi i lun a dooshima man dooshima u ve lu a mi la vea za hemen u lun a mi ken dooshima u a lu ken mzough la . — Marku 10 : 9 - 9 . 2020-02-12 16:32:14,802 Example #1 2020-02-12 16:32:14,802 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 16:32:14,802 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'kpilighyol', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'doon', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 16:32:14,802 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 16:32:14,802 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 16:32:14,802 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u kpilighyol ne , man ka shighe u doon je la ! — Rom . 2020-02-12 16:32:14,802 Example #2 2020-02-12 16:32:14,802 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 16:32:14,802 Raw hypothesis: ['Ken', 'anyom', 'nga', 'kar', 'kpuaa', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 16:32:14,802 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 16:32:14,802 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 16:32:14,802 Hypothesis: Ken anyom nga kar kpuaa yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 16:32:14,802 Example #3 2020-02-12 16:32:14,803 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 16:32:14,803 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'a', 'tahav', 'mbu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'nan', 'lu', 'a', 'mi', 'ga', 'yô', '.'] 2020-02-12 16:32:14,803 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 16:32:14,803 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 16:32:14,803 Hypothesis: Alaghga or u nan lu a tahav mbu eren kwagh sha gbenda u nan lu a mi ga yô . 2020-02-12 16:32:14,803 Validation result (greedy) at epoch 8, step 18000: bleu: 19.18, loss: 54626.7266, ppl: 6.3297, duration: 19.7450s 2020-02-12 16:32:24,744 Epoch 8 Step: 18100 Batch Loss: 2.188540 Tokens per Sec: 22123, Lr: 0.000300 2020-02-12 16:32:34,623 Epoch 8 Step: 18200 Batch Loss: 1.939353 Tokens per Sec: 23081, Lr: 0.000300 2020-02-12 16:32:44,478 Epoch 8 Step: 18300 Batch Loss: 2.117628 Tokens per Sec: 21803, Lr: 0.000300 2020-02-12 16:32:54,455 Epoch 8 Step: 18400 Batch Loss: 2.267230 Tokens per Sec: 21838, Lr: 0.000300 2020-02-12 16:33:04,427 Epoch 8 Step: 18500 Batch Loss: 2.009772 Tokens per Sec: 22636, Lr: 0.000300 2020-02-12 16:33:14,384 Epoch 8 Step: 18600 Batch Loss: 2.147149 Tokens per Sec: 22323, Lr: 0.000300 2020-02-12 16:33:24,405 Epoch 8 Step: 18700 Batch Loss: 1.758848 Tokens per Sec: 22389, Lr: 0.000300 2020-02-12 16:33:34,278 Epoch 8 Step: 18800 Batch Loss: 2.362626 Tokens per Sec: 22279, Lr: 0.000300 2020-02-12 16:33:44,210 Epoch 8 Step: 18900 Batch Loss: 1.595763 Tokens per Sec: 22522, Lr: 0.000300 2020-02-12 16:33:54,230 Epoch 8 Step: 19000 Batch Loss: 2.155347 Tokens per Sec: 21937, Lr: 0.000300 2020-02-12 16:34:14,117 Hooray! New best validation result [ppl]! 2020-02-12 16:34:14,117 Saving new checkpoint. 2020-02-12 16:34:14,816 Example #0 2020-02-12 16:34:14,816 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 16:34:14,816 Raw hypothesis: ['Er', 'i', 'lu', 'u', 'nom', 'man', 'kwase', 'vea', 'er', 'ivese', 've', 'i', 'lu', 'sha', 'inja', 'yô', ',', 'ka', 'hange', 'hange', 'u', 'vea', 'nôngo', 'sha', 'afatyô', 've', 'cii', 'vea', 'lu', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'la', 'kpaa', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 16:34:14,816 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 16:34:14,816 Reference: 10 : ​ 6 - 9 . 2020-02-12 16:34:14,816 Hypothesis: Er i lu u nom man kwase vea er ivese ve i lu sha inja yô , ka hange hange u vea nôngo sha afatyô ve cii vea lu a dooshima u ve lu a mi la , shi vea za hemen u lun a dooshima u ve lu a mi la kpaa . — Marku 10 : 6 - 9 . 2020-02-12 16:34:14,816 Example #1 2020-02-12 16:34:14,816 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 16:34:14,816 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'kpilighyol', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'doon', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 16:34:14,816 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 16:34:14,817 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 16:34:14,817 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u kpilighyol ne , man ka shighe u doon je la ! — Rom . 2020-02-12 16:34:14,817 Example #2 2020-02-12 16:34:14,817 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 16:34:14,817 Raw hypothesis: ['Ken', 'anyom', 'pue', 'la', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', '.'] 2020-02-12 16:34:14,817 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 16:34:14,817 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 16:34:14,817 Hypothesis: Ken anyom pue la , Paulu lu ken Masedonia man Timoteu . 2020-02-12 16:34:14,817 Example #3 2020-02-12 16:34:14,817 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 16:34:14,817 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'a', 'tahav', 'mbu', 'eren', 'kwagh', 'u', 'a', 'lu', 'u', 'shami', 'ga', 'la', 'nana', 'lu', 'a', 'mi', 'ga', '.'] 2020-02-12 16:34:14,817 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 16:34:14,817 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 16:34:14,817 Hypothesis: Alaghga or u nan lu a tahav mbu eren kwagh u a lu u shami ga la nana lu a mi ga . 2020-02-12 16:34:14,817 Validation result (greedy) at epoch 8, step 19000: bleu: 19.30, loss: 53792.4180, ppl: 6.1538, duration: 20.5869s 2020-02-12 16:34:24,755 Epoch 8 Step: 19100 Batch Loss: 1.704111 Tokens per Sec: 22431, Lr: 0.000300 2020-02-12 16:34:34,710 Epoch 8 Step: 19200 Batch Loss: 2.043770 Tokens per Sec: 22612, Lr: 0.000300 2020-02-12 16:34:44,838 Epoch 8 Step: 19300 Batch Loss: 1.879913 Tokens per Sec: 22152, Lr: 0.000300 2020-02-12 16:34:55,046 Epoch 8 Step: 19400 Batch Loss: 2.035709 Tokens per Sec: 21450, Lr: 0.000300 2020-02-12 16:35:05,213 Epoch 8 Step: 19500 Batch Loss: 1.800448 Tokens per Sec: 21968, Lr: 0.000300 2020-02-12 16:35:15,358 Epoch 8 Step: 19600 Batch Loss: 1.916712 Tokens per Sec: 22098, Lr: 0.000300 2020-02-12 16:35:22,135 Epoch 8: total training loss 4850.83 2020-02-12 16:35:22,135 EPOCH 9 2020-02-12 16:35:25,547 Epoch 9 Step: 19700 Batch Loss: 1.914348 Tokens per Sec: 20597, Lr: 0.000300 2020-02-12 16:35:35,406 Epoch 9 Step: 19800 Batch Loss: 2.093338 Tokens per Sec: 22488, Lr: 0.000300 2020-02-12 16:35:45,319 Epoch 9 Step: 19900 Batch Loss: 1.731291 Tokens per Sec: 21581, Lr: 0.000300 2020-02-12 16:35:55,409 Epoch 9 Step: 20000 Batch Loss: 1.859691 Tokens per Sec: 21975, Lr: 0.000300 2020-02-12 16:36:13,974 Hooray! New best validation result [ppl]! 2020-02-12 16:36:13,974 Saving new checkpoint. 2020-02-12 16:36:14,163 Example #0 2020-02-12 16:36:14,163 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 16:36:14,163 Raw hypothesis: ['Er', 'Yehova', 'a', 'lu', 'iv@@', 'es@@', 'egh', 'yô', ',', 'ka', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'sha', 'afatyô', 've', 'cii', 'vea', 'lu', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'sha', 'dooshima', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'ken', 'dooshima', 'la', 'kpaa', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 16:36:14,163 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 16:36:14,163 Reference: 10 : ​ 6 - 9 . 2020-02-12 16:36:14,164 Hypothesis: Er Yehova a lu ivesegh yô , ka hange hange u noov man kasev vea nôngo sha afatyô ve cii vea lu a dooshima u ve lu a mi sha dooshima la , shi vea za hemen u lun a dooshima u a lu ken dooshima la kpaa . — Marku 10 : 6 - 9 . 2020-02-12 16:36:14,164 Example #1 2020-02-12 16:36:14,164 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 16:36:14,164 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'kpilighyol', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'doon', 'tsung', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 16:36:14,164 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 16:36:14,164 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 16:36:14,164 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u kpilighyol ne , man ka shighe u doon tsung je la ! — Rom . 2020-02-12 16:36:14,164 Example #2 2020-02-12 16:36:14,164 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 16:36:14,164 Raw hypothesis: ['Ken', 'anyom', 'a', 'kar', 'hegen', 'ne', ',', 'Paulu', 'lu', 'ken', 'tar', 'u', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', '.'] 2020-02-12 16:36:14,164 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 16:36:14,164 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 16:36:14,164 Hypothesis: Ken anyom a kar hegen ne , Paulu lu ken tar u Masedonia man Timoteu . 2020-02-12 16:36:14,164 Example #3 2020-02-12 16:36:14,165 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 16:36:14,165 Raw hypothesis: ['(', 'Mateu', '24', ':', '45', ')', 'A', 'fatyô', 'u', 'kaan', 'ér', 'or', 'ka', 'nana', 'er', 'kwagh', 'sha', 'gbenda', 'u', 'nan', 'soo', 'la', 'ga', '.'] 2020-02-12 16:36:14,165 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 16:36:14,165 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 16:36:14,165 Hypothesis: ( Mateu 24 : 45 ) A fatyô u kaan ér or ka nana er kwagh sha gbenda u nan soo la ga . 2020-02-12 16:36:14,165 Validation result (greedy) at epoch 9, step 20000: bleu: 19.93, loss: 53332.3789, ppl: 6.0589, duration: 18.7555s 2020-02-12 16:36:24,263 Epoch 9 Step: 20100 Batch Loss: 1.730392 Tokens per Sec: 21967, Lr: 0.000300 2020-02-12 16:36:34,395 Epoch 9 Step: 20200 Batch Loss: 2.260367 Tokens per Sec: 21366, Lr: 0.000300 2020-02-12 16:36:44,530 Epoch 9 Step: 20300 Batch Loss: 2.002793 Tokens per Sec: 21622, Lr: 0.000300 2020-02-12 16:36:54,741 Epoch 9 Step: 20400 Batch Loss: 2.105446 Tokens per Sec: 21319, Lr: 0.000300 2020-02-12 16:37:04,804 Epoch 9 Step: 20500 Batch Loss: 1.825804 Tokens per Sec: 22186, Lr: 0.000300 2020-02-12 16:37:14,690 Epoch 9 Step: 20600 Batch Loss: 1.893557 Tokens per Sec: 21966, Lr: 0.000300 2020-02-12 16:37:24,580 Epoch 9 Step: 20700 Batch Loss: 2.006706 Tokens per Sec: 22943, Lr: 0.000300 2020-02-12 16:37:34,430 Epoch 9 Step: 20800 Batch Loss: 1.526448 Tokens per Sec: 21744, Lr: 0.000300 2020-02-12 16:37:44,321 Epoch 9 Step: 20900 Batch Loss: 1.718555 Tokens per Sec: 22066, Lr: 0.000300 2020-02-12 16:37:54,335 Epoch 9 Step: 21000 Batch Loss: 2.056952 Tokens per Sec: 22429, Lr: 0.000300 2020-02-12 16:38:13,847 Hooray! New best validation result [ppl]! 2020-02-12 16:38:13,847 Saving new checkpoint. 2020-02-12 16:38:14,036 Example #0 2020-02-12 16:38:14,036 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 16:38:14,036 Raw hypothesis: ['Er', 'ivese', 'i', 'lu', 'kwagh', 'u', 'vesen', 'u', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'vesen', 'yô', ',', 'ka', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kwagh', 'kpoghuloo', 've', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'sha', 'kwagh', 'u', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'ken', 'tar', 'u', 'dooshima', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 16:38:14,037 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 16:38:14,037 Reference: 10 : ​ 6 - 9 . 2020-02-12 16:38:14,037 Hypothesis: Er ivese i lu kwagh u vesen u Yehova a ver la i lu kwagh u vesen yô , ka hange hange u noov man kasev vea nôngo kwagh kpoghuloo ve vea za hemen u lun a dooshima u ve lu a mi sha kwagh u dooshima u ve lu a mi ken tar u dooshima la . — Marku 10 : 6 - 9 . 2020-02-12 16:38:14,037 Example #1 2020-02-12 16:38:14,037 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 16:38:14,037 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', 'nengen', '“', 'shighe', '”', 'ne', ',', 'nahan', 'se', 'mba', 'ikyua', 'a', 'na', '!', '—', 'Rom', '.'] 2020-02-12 16:38:14,037 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 16:38:14,037 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 16:38:14,037 Hypothesis: Se kpa se fatyô u nengen “ shighe ” ne , nahan se mba ikyua a na ! — Rom . 2020-02-12 16:38:14,037 Example #2 2020-02-12 16:38:14,037 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 16:38:14,037 Raw hypothesis: ['Ken', 'anyom', 'pue', 'la', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', '.'] 2020-02-12 16:38:14,037 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 16:38:14,037 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 16:38:14,037 Hypothesis: Ken anyom pue la , Paulu lu ken Masedonia man Timoteu . 2020-02-12 16:38:14,038 Example #3 2020-02-12 16:38:14,038 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 16:38:14,038 Raw hypothesis: ['Alaghga', 'a', 'lu', 'u', 'or', 'a', 'er', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 16:38:14,038 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 16:38:14,038 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 16:38:14,038 Hypothesis: Alaghga a lu u or a er kwagh sha gbenda u vough ga . 2020-02-12 16:38:14,038 Validation result (greedy) at epoch 9, step 21000: bleu: 20.49, loss: 52872.0273, ppl: 5.9654, duration: 19.7021s 2020-02-12 16:38:23,941 Epoch 9 Step: 21100 Batch Loss: 1.799833 Tokens per Sec: 22347, Lr: 0.000300 2020-02-12 16:38:33,825 Epoch 9 Step: 21200 Batch Loss: 1.947842 Tokens per Sec: 22760, Lr: 0.000300 2020-02-12 16:38:43,708 Epoch 9 Step: 21300 Batch Loss: 1.995403 Tokens per Sec: 22389, Lr: 0.000300 2020-02-12 16:38:53,719 Epoch 9 Step: 21400 Batch Loss: 2.032055 Tokens per Sec: 21861, Lr: 0.000300 2020-02-12 16:39:03,643 Epoch 9 Step: 21500 Batch Loss: 1.759507 Tokens per Sec: 21907, Lr: 0.000300 2020-02-12 16:39:13,660 Epoch 9 Step: 21600 Batch Loss: 1.925145 Tokens per Sec: 21727, Lr: 0.000300 2020-02-12 16:39:23,796 Epoch 9 Step: 21700 Batch Loss: 2.001884 Tokens per Sec: 22486, Lr: 0.000300 2020-02-12 16:39:33,635 Epoch 9 Step: 21800 Batch Loss: 1.871985 Tokens per Sec: 22036, Lr: 0.000300 2020-02-12 16:39:43,447 Epoch 9 Step: 21900 Batch Loss: 2.024700 Tokens per Sec: 22562, Lr: 0.000300 2020-02-12 16:39:53,336 Epoch 9 Step: 22000 Batch Loss: 2.112658 Tokens per Sec: 22287, Lr: 0.000300 2020-02-12 16:40:13,212 Hooray! New best validation result [ppl]! 2020-02-12 16:40:13,212 Saving new checkpoint. 2020-02-12 16:40:13,410 Example #0 2020-02-12 16:40:13,410 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 16:40:13,411 Raw hypothesis: ['Er', 'ivese', 'i', 'lu', 'kwagh', 'u', 'vesen', 'u', 'Yehova', 'a', 'lu', 'a', 'mi', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kwagh', 'kpoghuloo', 'sha', 'er', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', 'yô', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 16:40:13,411 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 16:40:13,411 Reference: 10 : ​ 6 - 9 . 2020-02-12 16:40:13,411 Hypothesis: Er ivese i lu kwagh u vesen u Yehova a lu a mi yô , gba hange hange u noov man kasev vea nôngo kwagh kpoghuloo sha er vea za hemen u lun a dooshima shi vea za hemen u lun a dooshima u a lu hen atô ve la yô . — Marku 10 : 6 - 9 . 2020-02-12 16:40:13,411 Example #1 2020-02-12 16:40:13,411 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 16:40:13,411 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'kpilighyol', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'doon', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 16:40:13,411 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 16:40:13,411 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 16:40:13,411 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u kpilighyol ne , man ka shighe u doon je la ! — Rom . 2020-02-12 16:40:13,411 Example #2 2020-02-12 16:40:13,411 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 16:40:13,411 Raw hypothesis: ['Ken', 'anyom', 'pue', 'la', ',', 'Paulu', 'lu', 'ken', 'gar', 'u', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', '.'] 2020-02-12 16:40:13,411 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 16:40:13,412 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 16:40:13,412 Hypothesis: Ken anyom pue la , Paulu lu ken gar u Masedonia man Timoteu . 2020-02-12 16:40:13,412 Example #3 2020-02-12 16:40:13,412 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 16:40:13,412 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'a', 'ian', 'i', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'a', 'lu', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 16:40:13,412 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 16:40:13,412 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 16:40:13,412 Hypothesis: Alaghga or u nan lu a ian i eren kwagh sha gbenda u a lu u vough ga yô . 2020-02-12 16:40:13,412 Validation result (greedy) at epoch 9, step 22000: bleu: 20.59, loss: 52241.1719, ppl: 5.8396, duration: 20.0752s 2020-02-12 16:40:23,256 Epoch 9 Step: 22100 Batch Loss: 1.694650 Tokens per Sec: 22721, Lr: 0.000300 2020-02-12 16:40:26,694 Epoch 9: total training loss 4742.62 2020-02-12 16:40:26,694 EPOCH 10 2020-02-12 16:40:33,391 Epoch 10 Step: 22200 Batch Loss: 1.824729 Tokens per Sec: 22062, Lr: 0.000300 2020-02-12 16:40:43,318 Epoch 10 Step: 22300 Batch Loss: 1.830457 Tokens per Sec: 22359, Lr: 0.000300 2020-02-12 16:40:53,228 Epoch 10 Step: 22400 Batch Loss: 1.765829 Tokens per Sec: 21978, Lr: 0.000300 2020-02-12 16:41:03,132 Epoch 10 Step: 22500 Batch Loss: 1.860943 Tokens per Sec: 22552, Lr: 0.000300 2020-02-12 16:41:13,053 Epoch 10 Step: 22600 Batch Loss: 1.998243 Tokens per Sec: 22675, Lr: 0.000300 2020-02-12 16:41:22,940 Epoch 10 Step: 22700 Batch Loss: 1.764805 Tokens per Sec: 22413, Lr: 0.000300 2020-02-12 16:41:32,848 Epoch 10 Step: 22800 Batch Loss: 2.115628 Tokens per Sec: 22279, Lr: 0.000300 2020-02-12 16:41:42,965 Epoch 10 Step: 22900 Batch Loss: 1.914941 Tokens per Sec: 21676, Lr: 0.000300 2020-02-12 16:41:53,071 Epoch 10 Step: 23000 Batch Loss: 2.006256 Tokens per Sec: 21552, Lr: 0.000300 2020-02-12 16:42:12,284 Example #0 2020-02-12 16:42:12,284 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 16:42:12,284 Raw hypothesis: ['Er', 'Yehova', 'a', 'lu', 'iv@@', 'es@@', 'egh', 'i', 'iv@@', 'es@@', 'egh', 'yô', ',', 'ka', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'sha', 'afatyô', 've', 'cii', 'sha', 'er', 'vea', 'lu', 'a', 'dooshima', 'shi', 'vea', 'seer', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'ken', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', 'yô', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 16:42:12,284 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 16:42:12,284 Reference: 10 : ​ 6 - 9 . 2020-02-12 16:42:12,285 Hypothesis: Er Yehova a lu ivesegh i ivesegh yô , ka hange hange u noov man kasev vea nôngo sha afatyô ve cii sha er vea lu a dooshima shi vea seer lun a dooshima u a lu ken dooshima u a lu hen atô ve la yô . — Marku 10 : 6 - 9 . 2020-02-12 16:42:12,285 Example #1 2020-02-12 16:42:12,285 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 16:42:12,285 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'kpilighyol', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'doon', 'tsung', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 16:42:12,285 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 16:42:12,285 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 16:42:12,285 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u kpilighyol ne , man ka shighe u doon tsung je la ! — Rom . 2020-02-12 16:42:12,285 Example #2 2020-02-12 16:42:12,285 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 16:42:12,285 Raw hypothesis: ['Ken', 'anyom', 'pue', 'la', ',', 'Paulu', 'lu', 'ken', 'gar', 'u', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', '.'] 2020-02-12 16:42:12,285 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 16:42:12,285 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 16:42:12,285 Hypothesis: Ken anyom pue la , Paulu lu ken gar u Masedonia man Timoteu . 2020-02-12 16:42:12,285 Example #3 2020-02-12 16:42:12,285 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 16:42:12,285 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'a', 'ishima', 'i', 'môm', 'la', 'nana', 'fatyô', 'u', 'lun', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 16:42:12,285 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 16:42:12,286 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 16:42:12,286 Hypothesis: Alaghga or u nan lu a ishima i môm la nana fatyô u lun sha gbenda u vough ga . 2020-02-12 16:42:12,286 Validation result (greedy) at epoch 10, step 23000: bleu: 20.23, loss: 52303.1328, ppl: 5.8519, duration: 19.2143s 2020-02-12 16:42:22,306 Epoch 10 Step: 23100 Batch Loss: 1.815794 Tokens per Sec: 22101, Lr: 0.000300 2020-02-12 16:42:32,260 Epoch 10 Step: 23200 Batch Loss: 1.794646 Tokens per Sec: 21541, Lr: 0.000300 2020-02-12 16:42:42,129 Epoch 10 Step: 23300 Batch Loss: 1.811051 Tokens per Sec: 22865, Lr: 0.000300 2020-02-12 16:42:52,016 Epoch 10 Step: 23400 Batch Loss: 1.560463 Tokens per Sec: 22004, Lr: 0.000300 2020-02-12 16:43:01,867 Epoch 10 Step: 23500 Batch Loss: 1.826227 Tokens per Sec: 22784, Lr: 0.000300 2020-02-12 16:43:11,728 Epoch 10 Step: 23600 Batch Loss: 2.103531 Tokens per Sec: 22769, Lr: 0.000300 2020-02-12 16:43:21,549 Epoch 10 Step: 23700 Batch Loss: 1.933853 Tokens per Sec: 22266, Lr: 0.000300 2020-02-12 16:43:31,390 Epoch 10 Step: 23800 Batch Loss: 2.052123 Tokens per Sec: 23129, Lr: 0.000300 2020-02-12 16:43:41,265 Epoch 10 Step: 23900 Batch Loss: 1.910568 Tokens per Sec: 22354, Lr: 0.000300 2020-02-12 16:43:51,226 Epoch 10 Step: 24000 Batch Loss: 1.875479 Tokens per Sec: 21846, Lr: 0.000300 2020-02-12 16:44:08,702 Hooray! New best validation result [ppl]! 2020-02-12 16:44:08,702 Saving new checkpoint. 2020-02-12 16:44:08,891 Example #0 2020-02-12 16:44:08,891 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 16:44:08,891 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'i', 'lu', 'kwagh', 'môm', 'a', 'mlu', 'u', 'vough', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'sha', 'kwagh', 'u', 'dooshima', 'la', ',', 'vea', 'seer', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'ken', 'dooshima', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 16:44:08,891 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 16:44:08,891 Reference: 10 : ​ 6 - 9 . 2020-02-12 16:44:08,891 Hypothesis: Er ivese i Yehova i lu kwagh môm a mlu u vough yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u ve lu a mi sha kwagh u dooshima la , vea seer lun a dooshima u a lu ken dooshima la . — Marku 10 : 6 - 9 . 2020-02-12 16:44:08,891 Example #1 2020-02-12 16:44:08,891 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 16:44:08,892 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'kpilighyol', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'doon', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 16:44:08,892 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 16:44:08,892 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 16:44:08,892 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u kpilighyol ne , man ka shighe u doon je la ! — Rom . 2020-02-12 16:44:08,892 Example #2 2020-02-12 16:44:08,892 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 16:44:08,892 Raw hypothesis: ['Anyom', 'nga', 'kar', 'pue', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', '.'] 2020-02-12 16:44:08,892 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 16:44:08,892 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 16:44:08,892 Hypothesis: Anyom nga kar pue yô , Paulu lu ken Masedonia man Timoteu . 2020-02-12 16:44:08,892 Example #3 2020-02-12 16:44:08,892 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 16:44:08,892 Raw hypothesis: ['Ka', 'kwagh', 'u', 'or', 'a', 'er', 've', 'nana', 'er', 've', 'nana', 'lu', 'a', 'inja', 'ga', 'yô', '.'] 2020-02-12 16:44:08,892 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 16:44:08,892 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 16:44:08,893 Hypothesis: Ka kwagh u or a er ve nana er ve nana lu a inja ga yô . 2020-02-12 16:44:08,893 Validation result (greedy) at epoch 10, step 24000: bleu: 19.93, loss: 51739.8398, ppl: 5.7416, duration: 17.6659s 2020-02-12 16:44:18,862 Epoch 10 Step: 24100 Batch Loss: 1.889015 Tokens per Sec: 22427, Lr: 0.000300 2020-02-12 16:44:28,745 Epoch 10 Step: 24200 Batch Loss: 1.684302 Tokens per Sec: 21780, Lr: 0.000300 2020-02-12 16:44:38,660 Epoch 10 Step: 24300 Batch Loss: 1.914559 Tokens per Sec: 22128, Lr: 0.000300 2020-02-12 16:44:48,617 Epoch 10 Step: 24400 Batch Loss: 2.252124 Tokens per Sec: 21814, Lr: 0.000300 2020-02-12 16:44:58,517 Epoch 10 Step: 24500 Batch Loss: 1.879817 Tokens per Sec: 22261, Lr: 0.000300 2020-02-12 16:45:07,861 Epoch 10: total training loss 4624.46 2020-02-12 16:45:07,861 EPOCH 11 2020-02-12 16:45:08,738 Epoch 11 Step: 24600 Batch Loss: 1.897348 Tokens per Sec: 12198, Lr: 0.000300 2020-02-12 16:45:18,668 Epoch 11 Step: 24700 Batch Loss: 1.911436 Tokens per Sec: 22010, Lr: 0.000300 2020-02-12 16:45:28,669 Epoch 11 Step: 24800 Batch Loss: 2.049130 Tokens per Sec: 22006, Lr: 0.000300 2020-02-12 16:45:38,715 Epoch 11 Step: 24900 Batch Loss: 1.639738 Tokens per Sec: 21548, Lr: 0.000300 2020-02-12 16:45:48,876 Epoch 11 Step: 25000 Batch Loss: 1.771585 Tokens per Sec: 21238, Lr: 0.000300 2020-02-12 16:46:07,700 Hooray! New best validation result [ppl]! 2020-02-12 16:46:07,700 Saving new checkpoint. 2020-02-12 16:46:07,900 Example #0 2020-02-12 16:46:07,900 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 16:46:07,900 Raw hypothesis: ['Er', 'Yehova', 'a', 'ver', 'ivese', 'i', 'lun', 'gbem', 'sha', 'won', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'sha', 'afatyô', 've', 'cii', 'vea', 'lu', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'sha', 'dooshima', 'la', 'shi', 'vea', 'lu', 'a', 'dooshima', 'u', 'mimi', 'sha', 'kwagh', 'u', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 16:46:07,900 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 16:46:07,900 Reference: 10 : ​ 6 - 9 . 2020-02-12 16:46:07,900 Hypothesis: Er Yehova a ver ivese i lun gbem sha won yô , gba hange hange u noov man kasev vea nôngo sha afatyô ve cii vea lu a dooshima u ve lu a mi sha dooshima la shi vea lu a dooshima u mimi sha kwagh u dooshima u ve lu a mi la . — Marku 10 : 6 - 9 . 2020-02-12 16:46:07,900 Example #1 2020-02-12 16:46:07,900 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 16:46:07,900 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '“', 'nengen', '”', 'imba', 'shighe', 'u', 'kpilighyol', 'ne', ',', 'man', 'ka', 'mgb@@', 'ôghom', 'je', 'la', '.', '—', 'Rom', '.'] 2020-02-12 16:46:07,900 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 16:46:07,900 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 16:46:07,900 Hypothesis: Se kpa se fatyô u “ nengen ” imba shighe u kpilighyol ne , man ka mgbôghom je la . — Rom . 2020-02-12 16:46:07,900 Example #2 2020-02-12 16:46:07,901 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 16:46:07,901 Raw hypothesis: ['Ken', 'anyom', 'pue', 'a', 'karen', 'ne', ',', 'Paulu', 'ngu', 'ken', 'tar', 'u', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', '.'] 2020-02-12 16:46:07,901 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 16:46:07,901 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 16:46:07,901 Hypothesis: Ken anyom pue a karen ne , Paulu ngu ken tar u Masedonia man Timoteu . 2020-02-12 16:46:07,901 Example #3 2020-02-12 16:46:07,901 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 16:46:07,901 Raw hypothesis: ['Alaghga', 'a', 'lu', 'u', 'or', 'nana', 'lu', 'a', 'ishima', 'i', 'nan', 'sha', 'gbenda', 'u', 'i', 'doo', 'u', 'nana', 'er', 'kwagh', 'sha', 'mi', 'ga', 'yô', '.'] 2020-02-12 16:46:07,901 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 16:46:07,901 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 16:46:07,901 Hypothesis: Alaghga a lu u or nana lu a ishima i nan sha gbenda u i doo u nana er kwagh sha mi ga yô . 2020-02-12 16:46:07,901 Validation result (greedy) at epoch 11, step 25000: bleu: 21.48, loss: 51244.4805, ppl: 5.6463, duration: 19.0251s 2020-02-12 16:46:17,886 Epoch 11 Step: 25100 Batch Loss: 1.992092 Tokens per Sec: 22669, Lr: 0.000300 2020-02-12 16:46:27,791 Epoch 11 Step: 25200 Batch Loss: 1.829686 Tokens per Sec: 22128, Lr: 0.000300 2020-02-12 16:46:37,644 Epoch 11 Step: 25300 Batch Loss: 1.771660 Tokens per Sec: 22004, Lr: 0.000300 2020-02-12 16:46:47,580 Epoch 11 Step: 25400 Batch Loss: 1.828283 Tokens per Sec: 22475, Lr: 0.000300 2020-02-12 16:46:57,458 Epoch 11 Step: 25500 Batch Loss: 1.573067 Tokens per Sec: 21617, Lr: 0.000300 2020-02-12 16:47:07,500 Epoch 11 Step: 25600 Batch Loss: 1.939762 Tokens per Sec: 21885, Lr: 0.000300 2020-02-12 16:47:17,446 Epoch 11 Step: 25700 Batch Loss: 1.876702 Tokens per Sec: 22402, Lr: 0.000300 2020-02-12 16:47:27,453 Epoch 11 Step: 25800 Batch Loss: 1.681799 Tokens per Sec: 22376, Lr: 0.000300 2020-02-12 16:47:37,336 Epoch 11 Step: 25900 Batch Loss: 1.932091 Tokens per Sec: 22418, Lr: 0.000300 2020-02-12 16:47:47,256 Epoch 11 Step: 26000 Batch Loss: 1.547129 Tokens per Sec: 21657, Lr: 0.000300 2020-02-12 16:48:06,386 Hooray! New best validation result [ppl]! 2020-02-12 16:48:06,387 Saving new checkpoint. 2020-02-12 16:48:06,575 Example #0 2020-02-12 16:48:06,575 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 16:48:06,575 Raw hypothesis: ['Er', 'i', 'lu', 'hange', 'hange', 'u', 'nom', 'man', 'kwase', 'vea', 'lu', 'a', 'dooshima', 'u', 'mimi', 'yô', ',', 'ka', 'hange', 'hange', 'u', 'vea', 'nôngo', 'sha', 'er', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'sha', 'u', 'tesen', 'dooshima', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'ken', 'dooshima', 'la', 'kpaa', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 16:48:06,575 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 16:48:06,575 Reference: 10 : ​ 6 - 9 . 2020-02-12 16:48:06,575 Hypothesis: Er i lu hange hange u nom man kwase vea lu a dooshima u mimi yô , ka hange hange u vea nôngo sha er vea za hemen u lun a dooshima u ve lu a mi sha u tesen dooshima la , shi vea za hemen u lun a dooshima u a lu ken dooshima la kpaa . — Marku 10 : 6 - 9 . 2020-02-12 16:48:06,575 Example #1 2020-02-12 16:48:06,575 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 16:48:06,575 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'kpilighyol', 'ne', ',', 'man', 'ka', 'kwagh', 'u', 'doon', 'tsung', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 16:48:06,575 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 16:48:06,575 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 16:48:06,576 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u kpilighyol ne , man ka kwagh u doon tsung je la ! — Rom . 2020-02-12 16:48:06,576 Example #2 2020-02-12 16:48:06,576 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 16:48:06,576 Raw hypothesis: ['Anyom', 'nga', 'kar', 'pue', 'yô', ',', 'Paulu', 'ngu', 'ken', 'tar', 'u', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', '.'] 2020-02-12 16:48:06,576 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 16:48:06,576 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 16:48:06,576 Hypothesis: Anyom nga kar pue yô , Paulu ngu ken tar u Masedonia man Timoteu . 2020-02-12 16:48:06,576 Example #3 2020-02-12 16:48:06,576 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 16:48:06,576 Raw hypothesis: ['A', 'fatyô', 'u', 'kaan', 'ér', 'or', 'u', 'nan', 'lu', 'a', 'inja', 'yô', ',', 'ka', 'u', 'nan', 'eren', 'kwagh', 'sha', 'inja', 'ga', '.'] 2020-02-12 16:48:06,576 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 16:48:06,576 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 16:48:06,576 Hypothesis: A fatyô u kaan ér or u nan lu a inja yô , ka u nan eren kwagh sha inja ga . 2020-02-12 16:48:06,576 Validation result (greedy) at epoch 11, step 26000: bleu: 21.42, loss: 51034.2227, ppl: 5.6063, duration: 19.3196s 2020-02-12 16:48:16,467 Epoch 11 Step: 26100 Batch Loss: 1.776893 Tokens per Sec: 22423, Lr: 0.000300 2020-02-12 16:48:26,742 Epoch 11 Step: 26200 Batch Loss: 1.725854 Tokens per Sec: 21500, Lr: 0.000300 2020-02-12 16:48:36,827 Epoch 11 Step: 26300 Batch Loss: 1.515929 Tokens per Sec: 22276, Lr: 0.000300 2020-02-12 16:48:46,883 Epoch 11 Step: 26400 Batch Loss: 1.957026 Tokens per Sec: 22299, Lr: 0.000300 2020-02-12 16:48:56,881 Epoch 11 Step: 26500 Batch Loss: 2.141359 Tokens per Sec: 22566, Lr: 0.000300 2020-02-12 16:49:06,967 Epoch 11 Step: 26600 Batch Loss: 1.896598 Tokens per Sec: 21993, Lr: 0.000300 2020-02-12 16:49:17,102 Epoch 11 Step: 26700 Batch Loss: 1.614436 Tokens per Sec: 22177, Lr: 0.000300 2020-02-12 16:49:27,239 Epoch 11 Step: 26800 Batch Loss: 1.972823 Tokens per Sec: 21934, Lr: 0.000300 2020-02-12 16:49:37,203 Epoch 11 Step: 26900 Batch Loss: 1.526728 Tokens per Sec: 22500, Lr: 0.000300 2020-02-12 16:49:47,155 Epoch 11 Step: 27000 Batch Loss: 2.176866 Tokens per Sec: 21909, Lr: 0.000300 2020-02-12 16:50:05,627 Hooray! New best validation result [ppl]! 2020-02-12 16:50:05,627 Saving new checkpoint. 2020-02-12 16:50:05,816 Example #0 2020-02-12 16:50:05,816 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 16:50:05,816 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'i', 'lu', 'kwagh', 'u', 'vesen', 'u', 'i', 'gbe', 'u', 'a', 'er', 'yô', ',', 'ka', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'sha', 'kwagh', 'u', 'dooshima', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'mi', 'ken', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', 'kpaa', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 16:50:05,817 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 16:50:05,817 Reference: 10 : ​ 6 - 9 . 2020-02-12 16:50:05,817 Hypothesis: Er ivese i Yehova i lu kwagh u vesen u i gbe u a er yô , ka hange hange u noov man kasev vea nôngo kpoghuloo vea za hemen u lun a dooshima u ve lu a mi sha kwagh u dooshima la , shi vea za hemen u lun a mi ken dooshima u a lu hen atô ve la kpaa . — Marku 10 : 6 - 9 . 2020-02-12 16:50:05,817 Example #1 2020-02-12 16:50:05,817 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 16:50:05,817 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'kpilighyol', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'doon', 'tsung', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 16:50:05,817 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 16:50:05,817 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 16:50:05,817 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u kpilighyol ne , man ka shighe u doon tsung je la ! — Rom . 2020-02-12 16:50:05,817 Example #2 2020-02-12 16:50:05,817 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 16:50:05,817 Raw hypothesis: ['Anyom', 'nga', 'kar', 'pue', 'yô', ',', 'Paulu', 'lu', 'ken', 'tar', 'u', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', '.'] 2020-02-12 16:50:05,817 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 16:50:05,817 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 16:50:05,817 Hypothesis: Anyom nga kar pue yô , Paulu lu ken tar u Masedonia man Timoteu . 2020-02-12 16:50:05,818 Example #3 2020-02-12 16:50:05,818 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 16:50:05,818 Raw hypothesis: ['Alaghga', 'a', 'lu', 'u', 'or', 'nana', 'er', 'kwagh', 'sha', 'gbenda', 'u', 'i', 'doo', 'u', 'nana', 'er', 'kwagh', 'sha', 'mi', 'ga', 'yô', '.'] 2020-02-12 16:50:05,818 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 16:50:05,818 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 16:50:05,818 Hypothesis: Alaghga a lu u or nana er kwagh sha gbenda u i doo u nana er kwagh sha mi ga yô . 2020-02-12 16:50:05,818 Validation result (greedy) at epoch 11, step 27000: bleu: 21.24, loss: 50560.1797, ppl: 5.5173, duration: 18.6618s 2020-02-12 16:50:11,248 Epoch 11: total training loss 4543.82 2020-02-12 16:50:11,248 EPOCH 12 2020-02-12 16:50:15,984 Epoch 12 Step: 27100 Batch Loss: 1.761245 Tokens per Sec: 21246, Lr: 0.000300 2020-02-12 16:50:25,994 Epoch 12 Step: 27200 Batch Loss: 1.672341 Tokens per Sec: 22088, Lr: 0.000300 2020-02-12 16:50:35,994 Epoch 12 Step: 27300 Batch Loss: 1.925917 Tokens per Sec: 22314, Lr: 0.000300 2020-02-12 16:50:45,928 Epoch 12 Step: 27400 Batch Loss: 2.294695 Tokens per Sec: 22220, Lr: 0.000300 2020-02-12 16:50:55,831 Epoch 12 Step: 27500 Batch Loss: 1.935423 Tokens per Sec: 22098, Lr: 0.000300 2020-02-12 16:51:05,743 Epoch 12 Step: 27600 Batch Loss: 2.015524 Tokens per Sec: 21841, Lr: 0.000300 2020-02-12 16:51:15,640 Epoch 12 Step: 27700 Batch Loss: 1.969784 Tokens per Sec: 22834, Lr: 0.000300 2020-02-12 16:51:25,638 Epoch 12 Step: 27800 Batch Loss: 1.635526 Tokens per Sec: 22183, Lr: 0.000300 2020-02-12 16:51:35,580 Epoch 12 Step: 27900 Batch Loss: 1.618926 Tokens per Sec: 22099, Lr: 0.000300 2020-02-12 16:51:45,485 Epoch 12 Step: 28000 Batch Loss: 1.790464 Tokens per Sec: 21960, Lr: 0.000300 2020-02-12 16:52:05,194 Hooray! New best validation result [ppl]! 2020-02-12 16:52:05,194 Saving new checkpoint. 2020-02-12 16:52:05,386 Example #0 2020-02-12 16:52:05,386 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 16:52:05,387 Raw hypothesis: ['Er', 'i', 'gbe', 'u', 'nom', 'man', 'kwase', 'vea', 'er', 'ivese', 've', 'ia', 'lu', 'gbem', 'sha', 'won', 'yô', ',', 'doo', 'u', 'vea', 'nôngo', 'sha', 'afatyô', 've', 'cii', 'vea', 'kura', 'dooshima', 've', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'ken', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 16:52:05,387 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 16:52:05,387 Reference: 10 : ​ 6 - 9 . 2020-02-12 16:52:05,387 Hypothesis: Er i gbe u nom man kwase vea er ivese ve ia lu gbem sha won yô , doo u vea nôngo sha afatyô ve cii vea kura dooshima ve shi vea za hemen u lun ken dooshima u ve lu a mi la . — Marku 10 : 6 - 9 . 2020-02-12 16:52:05,387 Example #1 2020-02-12 16:52:05,387 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 16:52:05,387 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'kpilighyol', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'doon', 'tsung', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 16:52:05,387 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 16:52:05,387 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 16:52:05,387 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u kpilighyol ne , man ka shighe u doon tsung je la ! — Rom . 2020-02-12 16:52:05,387 Example #2 2020-02-12 16:52:05,387 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 16:52:05,387 Raw hypothesis: ['Ken', 'anyom', 'pue', 'la', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 16:52:05,387 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 16:52:05,388 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 16:52:05,388 Hypothesis: Ken anyom pue la , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 16:52:05,388 Example #3 2020-02-12 16:52:05,388 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 16:52:05,388 Raw hypothesis: ['Ka', 'u', 'or', 'nana', 'fatyô', 'u', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'i', 'doo', 'u', 'nana', 'er', 'ga', 'yô', '.'] 2020-02-12 16:52:05,388 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 16:52:05,388 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 16:52:05,388 Hypothesis: Ka u or nana fatyô u eren kwagh sha gbenda u i doo u nana er ga yô . 2020-02-12 16:52:05,388 Validation result (greedy) at epoch 12, step 28000: bleu: 22.26, loss: 50354.1367, ppl: 5.4790, duration: 19.9025s 2020-02-12 16:52:15,423 Epoch 12 Step: 28100 Batch Loss: 1.539151 Tokens per Sec: 22240, Lr: 0.000300 2020-02-12 16:52:25,321 Epoch 12 Step: 28200 Batch Loss: 2.161488 Tokens per Sec: 22817, Lr: 0.000300 2020-02-12 16:52:35,323 Epoch 12 Step: 28300 Batch Loss: 1.646714 Tokens per Sec: 22131, Lr: 0.000300 2020-02-12 16:52:45,142 Epoch 12 Step: 28400 Batch Loss: 1.863586 Tokens per Sec: 22631, Lr: 0.000300 2020-02-12 16:52:55,061 Epoch 12 Step: 28500 Batch Loss: 1.740035 Tokens per Sec: 22251, Lr: 0.000300 2020-02-12 16:53:05,019 Epoch 12 Step: 28600 Batch Loss: 1.642973 Tokens per Sec: 22294, Lr: 0.000300 2020-02-12 16:53:15,136 Epoch 12 Step: 28700 Batch Loss: 1.612443 Tokens per Sec: 21869, Lr: 0.000300 2020-02-12 16:53:25,262 Epoch 12 Step: 28800 Batch Loss: 1.866432 Tokens per Sec: 21660, Lr: 0.000300 2020-02-12 16:53:35,381 Epoch 12 Step: 28900 Batch Loss: 1.835360 Tokens per Sec: 21702, Lr: 0.000300 2020-02-12 16:53:45,488 Epoch 12 Step: 29000 Batch Loss: 1.639821 Tokens per Sec: 22025, Lr: 0.000300 2020-02-12 16:54:04,513 Hooray! New best validation result [ppl]! 2020-02-12 16:54:04,514 Saving new checkpoint. 2020-02-12 16:54:04,704 Example #0 2020-02-12 16:54:04,705 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 16:54:04,705 Raw hypothesis: ['Er', 'ivaa', 'i', 'lu', 'kwagh', 'u', 'vesen', 'u', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'vesen', 'yô', ',', 'gba', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'sha', 'afatyô', 've', 'cii', 'vea', 'kura', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'sha', 'kwagh', 'u', 'dooshima', 'la', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'mi', 'ken', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 16:54:04,705 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 16:54:04,705 Reference: 10 : ​ 6 - 9 . 2020-02-12 16:54:04,705 Hypothesis: Er ivaa i lu kwagh u vesen u Yehova a ver la i lu kwagh u vesen yô , gba u noov man kasev vea nôngo sha afatyô ve cii vea kura dooshima u ve lu a mi sha kwagh u dooshima la shi vea za hemen u lun a mi ken dooshima u a lu hen atô ve la . — Marku 10 : 6 - 9 . 2020-02-12 16:54:04,705 Example #1 2020-02-12 16:54:04,705 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 16:54:04,705 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'kpilighyol', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'doon', 'tsung', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 16:54:04,705 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 16:54:04,705 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 16:54:04,705 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u kpilighyol ne , man ka shighe u doon tsung je la ! — Rom . 2020-02-12 16:54:04,705 Example #2 2020-02-12 16:54:04,705 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 16:54:04,705 Raw hypothesis: ['Anyom', 'nga', 'kar', 'pue', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 16:54:04,705 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 16:54:04,706 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 16:54:04,706 Hypothesis: Anyom nga kar pue yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 16:54:04,706 Example #3 2020-02-12 16:54:04,706 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 16:54:04,706 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'a', 'ian', 'i', 'eren', 'kwagh', 'u', 'vough', 'ga', 'la', 'nana', 'lu', 'a', 'mi', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 16:54:04,706 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 16:54:04,706 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 16:54:04,706 Hypothesis: Alaghga or u nan lu a ian i eren kwagh u vough ga la nana lu a mi sha gbenda u vough ga . 2020-02-12 16:54:04,706 Validation result (greedy) at epoch 12, step 29000: bleu: 21.92, loss: 49823.4375, ppl: 5.3817, duration: 19.2179s 2020-02-12 16:54:14,821 Epoch 12 Step: 29100 Batch Loss: 1.782477 Tokens per Sec: 21795, Lr: 0.000300 2020-02-12 16:54:25,031 Epoch 12 Step: 29200 Batch Loss: 1.604911 Tokens per Sec: 21501, Lr: 0.000300 2020-02-12 16:54:35,242 Epoch 12 Step: 29300 Batch Loss: 1.641777 Tokens per Sec: 21687, Lr: 0.000300 2020-02-12 16:54:45,437 Epoch 12 Step: 29400 Batch Loss: 1.831326 Tokens per Sec: 21611, Lr: 0.000300 2020-02-12 16:54:55,577 Epoch 12 Step: 29500 Batch Loss: 2.090666 Tokens per Sec: 21907, Lr: 0.000300 2020-02-12 16:54:56,888 Epoch 12: total training loss 4455.50 2020-02-12 16:54:56,888 EPOCH 13 2020-02-12 16:55:05,994 Epoch 13 Step: 29600 Batch Loss: 1.682260 Tokens per Sec: 20918, Lr: 0.000300 2020-02-12 16:55:16,075 Epoch 13 Step: 29700 Batch Loss: 1.913036 Tokens per Sec: 21744, Lr: 0.000300 2020-02-12 16:55:26,163 Epoch 13 Step: 29800 Batch Loss: 2.056014 Tokens per Sec: 22100, Lr: 0.000300 2020-02-12 16:55:36,158 Epoch 13 Step: 29900 Batch Loss: 1.697894 Tokens per Sec: 22117, Lr: 0.000300 2020-02-12 16:55:46,096 Epoch 13 Step: 30000 Batch Loss: 1.921973 Tokens per Sec: 22366, Lr: 0.000300 2020-02-12 16:56:05,226 Hooray! New best validation result [ppl]! 2020-02-12 16:56:05,227 Saving new checkpoint. 2020-02-12 16:56:05,424 Example #0 2020-02-12 16:56:05,424 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 16:56:05,424 Raw hypothesis: ['Er', 'ivese', 'i', 'lu', 'kwagh', 'môm', 'u', 'Yehova', 'a', 'ver', 'sha', 'u', 'kuren', 'awashima', 'na', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'sha', 'dooshima', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', 'kpaa', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 16:56:05,424 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 16:56:05,425 Reference: 10 : ​ 6 - 9 . 2020-02-12 16:56:05,425 Hypothesis: Er ivese i lu kwagh môm u Yehova a ver sha u kuren awashima na u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u ve lu a mi sha dooshima la , shi vea za hemen u lun a dooshima u a lu hen atô ve la kpaa . — Marku 10 : 6 - 9 . 2020-02-12 16:56:05,425 Example #1 2020-02-12 16:56:05,425 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 16:56:05,425 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'kpilighyol', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'doon', 'tsung', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 16:56:05,425 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 16:56:05,425 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 16:56:05,425 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u kpilighyol ne , man ka shighe u doon tsung je la ! — Rom . 2020-02-12 16:56:05,425 Example #2 2020-02-12 16:56:05,425 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 16:56:05,425 Raw hypothesis: ['Ken', 'masejime', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 16:56:05,425 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 16:56:05,425 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 16:56:05,425 Hypothesis: Ken masejime yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 16:56:05,425 Example #3 2020-02-12 16:56:05,426 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 16:56:05,426 Raw hypothesis: ['Ka', 'u', 'or', 'nana', 'fatyô', 'u', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 16:56:05,426 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 16:56:05,426 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 16:56:05,426 Hypothesis: Ka u or nana fatyô u eren kwagh sha gbenda u vough ga . 2020-02-12 16:56:05,426 Validation result (greedy) at epoch 13, step 30000: bleu: 22.66, loss: 49705.7539, ppl: 5.3603, duration: 19.3291s 2020-02-12 16:56:15,382 Epoch 13 Step: 30100 Batch Loss: 2.022979 Tokens per Sec: 22106, Lr: 0.000300 2020-02-12 16:56:25,292 Epoch 13 Step: 30200 Batch Loss: 2.112054 Tokens per Sec: 22570, Lr: 0.000300 2020-02-12 16:56:35,226 Epoch 13 Step: 30300 Batch Loss: 1.920949 Tokens per Sec: 22938, Lr: 0.000300 2020-02-12 16:56:45,222 Epoch 13 Step: 30400 Batch Loss: 2.101107 Tokens per Sec: 21670, Lr: 0.000300 2020-02-12 16:56:55,510 Epoch 13 Step: 30500 Batch Loss: 1.791649 Tokens per Sec: 21174, Lr: 0.000300 2020-02-12 16:57:05,892 Epoch 13 Step: 30600 Batch Loss: 1.932489 Tokens per Sec: 21307, Lr: 0.000300 2020-02-12 16:57:16,122 Epoch 13 Step: 30700 Batch Loss: 1.753716 Tokens per Sec: 21766, Lr: 0.000300 2020-02-12 16:57:26,376 Epoch 13 Step: 30800 Batch Loss: 1.856784 Tokens per Sec: 21614, Lr: 0.000300 2020-02-12 16:57:36,572 Epoch 13 Step: 30900 Batch Loss: 1.683047 Tokens per Sec: 21210, Lr: 0.000300 2020-02-12 16:57:46,697 Epoch 13 Step: 31000 Batch Loss: 1.871389 Tokens per Sec: 21758, Lr: 0.000300 2020-02-12 16:58:05,318 Hooray! New best validation result [ppl]! 2020-02-12 16:58:05,318 Saving new checkpoint. 2020-02-12 16:58:05,512 Example #0 2020-02-12 16:58:05,512 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 16:58:05,512 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'i', 'lu', 'kwagh', 'u', 'vesen', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'sha', 'afatyô', 've', 'cii', 'vea', 'lu', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'sha', 'dooshima', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'hen', 'atô', 've', 'la', 'kpaa', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 16:58:05,512 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 16:58:05,512 Reference: 10 : ​ 6 - 9 . 2020-02-12 16:58:05,512 Hypothesis: Er ivese i Yehova i lu kwagh u vesen yô , gba hange hange u noov man kasev vea nôngo sha afatyô ve cii vea lu a dooshima u ve lu a mi sha dooshima la , shi vea za hemen u lun a dooshima u hen atô ve la kpaa . — Marku 10 : 6 - 9 . 2020-02-12 16:58:05,513 Example #1 2020-02-12 16:58:05,513 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 16:58:05,513 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'kpilighyol', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'doon', 'tsung', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 16:58:05,513 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 16:58:05,513 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 16:58:05,513 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u kpilighyol ne , man ka shighe u doon tsung je la ! — Rom . 2020-02-12 16:58:05,513 Example #2 2020-02-12 16:58:05,513 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 16:58:05,513 Raw hypothesis: ['Anyom', 'nga', 'kar', 'pue', 'yô', ',', 'Paulu', 'lu', 'ken', 'tar', 'u', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', '.'] 2020-02-12 16:58:05,513 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 16:58:05,513 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 16:58:05,513 Hypothesis: Anyom nga kar pue yô , Paulu lu ken tar u Masedonia man Timoteu . 2020-02-12 16:58:05,513 Example #3 2020-02-12 16:58:05,513 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 16:58:05,513 Raw hypothesis: ['Alaghga', 'or', 'nana', 'fatyô', 'u', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 16:58:05,514 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 16:58:05,514 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 16:58:05,514 Hypothesis: Alaghga or nana fatyô u eren kwagh sha gbenda u vough ga . 2020-02-12 16:58:05,514 Validation result (greedy) at epoch 13, step 31000: bleu: 21.84, loss: 49343.9414, ppl: 5.2952, duration: 18.8164s 2020-02-12 16:58:15,541 Epoch 13 Step: 31100 Batch Loss: 1.357395 Tokens per Sec: 22289, Lr: 0.000300 2020-02-12 16:58:25,467 Epoch 13 Step: 31200 Batch Loss: 1.795151 Tokens per Sec: 22656, Lr: 0.000300 2020-02-12 16:58:35,370 Epoch 13 Step: 31300 Batch Loss: 1.561645 Tokens per Sec: 22346, Lr: 0.000300 2020-02-12 16:58:45,341 Epoch 13 Step: 31400 Batch Loss: 1.726090 Tokens per Sec: 22120, Lr: 0.000300 2020-02-12 16:58:55,484 Epoch 13 Step: 31500 Batch Loss: 1.642398 Tokens per Sec: 21676, Lr: 0.000300 2020-02-12 16:59:05,659 Epoch 13 Step: 31600 Batch Loss: 1.837268 Tokens per Sec: 21398, Lr: 0.000300 2020-02-12 16:59:15,825 Epoch 13 Step: 31700 Batch Loss: 2.092063 Tokens per Sec: 22196, Lr: 0.000300 2020-02-12 16:59:25,894 Epoch 13 Step: 31800 Batch Loss: 1.542736 Tokens per Sec: 21513, Lr: 0.000300 2020-02-12 16:59:35,842 Epoch 13 Step: 31900 Batch Loss: 1.935450 Tokens per Sec: 22193, Lr: 0.000300 2020-02-12 16:59:43,126 Epoch 13: total training loss 4387.53 2020-02-12 16:59:43,126 EPOCH 14 2020-02-12 16:59:46,126 Epoch 14 Step: 32000 Batch Loss: 2.012460 Tokens per Sec: 19688, Lr: 0.000300 2020-02-12 17:00:05,014 Hooray! New best validation result [ppl]! 2020-02-12 17:00:05,015 Saving new checkpoint. 2020-02-12 17:00:05,215 Example #0 2020-02-12 17:00:05,215 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 17:00:05,215 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'mimi', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'ken', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 17:00:05,215 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 17:00:05,215 Reference: 10 : ​ 6 - 9 . 2020-02-12 17:00:05,215 Hypothesis: Er ivese i Yehova i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea za hemen u lun a dooshima u mimi , shi vea za hemen u lun ken dooshima u a lu hen atô ve la . — Marku 10 : 6 - 9 . 2020-02-12 17:00:05,215 Example #1 2020-02-12 17:00:05,215 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 17:00:05,215 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'imba', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'doon', 'tsung', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 17:00:05,215 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 17:00:05,216 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 17:00:05,216 Hypothesis: Se kpa se fatyô u ‘ nengen ’ imba shighe u doon tsung ne , man ka shighe u doon tsung je la ! — Rom . 2020-02-12 17:00:05,216 Example #2 2020-02-12 17:00:05,216 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 17:00:05,216 Raw hypothesis: ['Anyom', 'nga', 'kar', 'pue', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 17:00:05,216 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 17:00:05,216 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 17:00:05,216 Hypothesis: Anyom nga kar pue yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 17:00:05,216 Example #3 2020-02-12 17:00:05,216 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 17:00:05,216 Raw hypothesis: ['Alaghga', 'or', 'a', 'lu', 'a', 'ian', 'i', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 17:00:05,216 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 17:00:05,216 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 17:00:05,216 Hypothesis: Alaghga or a lu a ian i eren kwagh sha gbenda u vough ga . 2020-02-12 17:00:05,216 Validation result (greedy) at epoch 14, step 32000: bleu: 22.68, loss: 49154.0352, ppl: 5.2613, duration: 19.0894s 2020-02-12 17:00:15,166 Epoch 14 Step: 32100 Batch Loss: 1.958156 Tokens per Sec: 22375, Lr: 0.000300 2020-02-12 17:00:25,369 Epoch 14 Step: 32200 Batch Loss: 1.898870 Tokens per Sec: 21695, Lr: 0.000300 2020-02-12 17:00:35,531 Epoch 14 Step: 32300 Batch Loss: 1.929601 Tokens per Sec: 21986, Lr: 0.000300 2020-02-12 17:00:45,606 Epoch 14 Step: 32400 Batch Loss: 1.698034 Tokens per Sec: 21782, Lr: 0.000300 2020-02-12 17:00:55,742 Epoch 14 Step: 32500 Batch Loss: 1.747295 Tokens per Sec: 21194, Lr: 0.000300 2020-02-12 17:01:05,768 Epoch 14 Step: 32600 Batch Loss: 1.761056 Tokens per Sec: 21731, Lr: 0.000300 2020-02-12 17:01:15,807 Epoch 14 Step: 32700 Batch Loss: 1.818480 Tokens per Sec: 22208, Lr: 0.000300 2020-02-12 17:01:25,893 Epoch 14 Step: 32800 Batch Loss: 1.177521 Tokens per Sec: 21313, Lr: 0.000300 2020-02-12 17:01:35,748 Epoch 14 Step: 32900 Batch Loss: 2.045574 Tokens per Sec: 22199, Lr: 0.000300 2020-02-12 17:01:45,657 Epoch 14 Step: 33000 Batch Loss: 1.637881 Tokens per Sec: 22397, Lr: 0.000300 2020-02-12 17:02:03,251 Hooray! New best validation result [ppl]! 2020-02-12 17:02:03,252 Saving new checkpoint. 2020-02-12 17:02:03,441 Example #0 2020-02-12 17:02:03,441 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 17:02:03,441 Raw hypothesis: ['Er', 'i', 'lu', 'Yehova', 'a', 'ver', 'ivese', 'i', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'sha', 'dooshima', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'ken', 'dooshima', 'u', 'a', 'lu', 'ken', 'dooshima', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 17:02:03,441 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 17:02:03,441 Reference: 10 : ​ 6 - 9 . 2020-02-12 17:02:03,441 Hypothesis: Er i lu Yehova a ver ivese i tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u ve lu a mi sha dooshima la , shi vea za hemen u lun ken dooshima u a lu ken dooshima la . — Marku 10 : 6 - 9 . 2020-02-12 17:02:03,442 Example #1 2020-02-12 17:02:03,442 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 17:02:03,442 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'doon', 'tsung', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 17:02:03,442 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 17:02:03,442 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 17:02:03,442 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u doon tsung ne , man ka shighe u doon tsung je la ! — Rom . 2020-02-12 17:02:03,442 Example #2 2020-02-12 17:02:03,442 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 17:02:03,442 Raw hypothesis: ['Anyom', 'nga', 'kar', 'pue', 'yô', ',', 'Paulu', 'lu', 'ken', 'tar', 'u', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', '.'] 2020-02-12 17:02:03,442 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 17:02:03,442 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 17:02:03,442 Hypothesis: Anyom nga kar pue yô , Paulu lu ken tar u Masedonia man Timoteu . 2020-02-12 17:02:03,442 Example #3 2020-02-12 17:02:03,442 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 17:02:03,442 Raw hypothesis: ['Alaghga', 'or', 'a', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 17:02:03,442 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 17:02:03,443 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 17:02:03,443 Hypothesis: Alaghga or a lu eren kwagh sha gbenda u vough ga . 2020-02-12 17:02:03,443 Validation result (greedy) at epoch 14, step 33000: bleu: 21.97, loss: 49051.1992, ppl: 5.2431, duration: 17.7851s 2020-02-12 17:02:13,338 Epoch 14 Step: 33100 Batch Loss: 1.847190 Tokens per Sec: 22116, Lr: 0.000300 2020-02-12 17:02:23,224 Epoch 14 Step: 33200 Batch Loss: 2.197025 Tokens per Sec: 22489, Lr: 0.000300 2020-02-12 17:02:33,111 Epoch 14 Step: 33300 Batch Loss: 2.133088 Tokens per Sec: 22731, Lr: 0.000300 2020-02-12 17:02:42,966 Epoch 14 Step: 33400 Batch Loss: 1.682475 Tokens per Sec: 22319, Lr: 0.000300 2020-02-12 17:02:52,914 Epoch 14 Step: 33500 Batch Loss: 2.010394 Tokens per Sec: 22212, Lr: 0.000300 2020-02-12 17:03:02,892 Epoch 14 Step: 33600 Batch Loss: 1.876231 Tokens per Sec: 22539, Lr: 0.000300 2020-02-12 17:03:12,801 Epoch 14 Step: 33700 Batch Loss: 1.957483 Tokens per Sec: 22220, Lr: 0.000300 2020-02-12 17:03:22,980 Epoch 14 Step: 33800 Batch Loss: 1.833876 Tokens per Sec: 22043, Lr: 0.000300 2020-02-12 17:03:32,956 Epoch 14 Step: 33900 Batch Loss: 1.734484 Tokens per Sec: 22048, Lr: 0.000300 2020-02-12 17:03:42,900 Epoch 14 Step: 34000 Batch Loss: 1.799194 Tokens per Sec: 22208, Lr: 0.000300 2020-02-12 17:04:02,319 Hooray! New best validation result [ppl]! 2020-02-12 17:04:02,319 Saving new checkpoint. 2020-02-12 17:04:02,510 Example #0 2020-02-12 17:04:02,510 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 17:04:02,510 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', ',', 'sha', 'er', 'vea', 'seer', 'doon', 'ayol', 'a', 've', 'yô', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 17:04:02,510 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 17:04:02,510 Reference: 10 : ​ 6 - 9 . 2020-02-12 17:04:02,510 Hypothesis: Er ivese i Yehova i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u ve lu a mi la , shi vea za hemen u lun a dooshima u a lu hen atô ve la , sha er vea seer doon ayol a ve yô . — Marku 10 : 6 - 9 . 2020-02-12 17:04:02,510 Example #1 2020-02-12 17:04:02,510 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 17:04:02,510 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'kpilighyol', 'ne', ',', 'man', 'ka', 'hen', 'shighe', 'la', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 17:04:02,510 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 17:04:02,510 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 17:04:02,511 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u kpilighyol ne , man ka hen shighe la je la ! — Rom . 2020-02-12 17:04:02,511 Example #2 2020-02-12 17:04:02,511 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 17:04:02,511 Raw hypothesis: ['Anyom', 'nga', 'kar', 'pue', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 17:04:02,511 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 17:04:02,511 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 17:04:02,511 Hypothesis: Anyom nga kar pue yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 17:04:02,511 Example #3 2020-02-12 17:04:02,511 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 17:04:02,511 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'a', 'ian', 'i', 'eren', 'kwagh', 'sha', 'inja', 'ga', '.'] 2020-02-12 17:04:02,511 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 17:04:02,511 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 17:04:02,511 Hypothesis: Alaghga or nana lu a ian i eren kwagh sha inja ga . 2020-02-12 17:04:02,511 Validation result (greedy) at epoch 14, step 34000: bleu: 22.95, loss: 48749.5977, ppl: 5.1899, duration: 19.6114s 2020-02-12 17:04:12,390 Epoch 14 Step: 34100 Batch Loss: 1.889835 Tokens per Sec: 22605, Lr: 0.000300 2020-02-12 17:04:22,256 Epoch 14 Step: 34200 Batch Loss: 1.840223 Tokens per Sec: 22792, Lr: 0.000300 2020-02-12 17:04:32,098 Epoch 14 Step: 34300 Batch Loss: 1.720049 Tokens per Sec: 22295, Lr: 0.000300 2020-02-12 17:04:41,945 Epoch 14 Step: 34400 Batch Loss: 1.546757 Tokens per Sec: 22565, Lr: 0.000300 2020-02-12 17:04:45,193 Epoch 14: total training loss 4325.08 2020-02-12 17:04:45,193 EPOCH 15 2020-02-12 17:04:52,155 Epoch 15 Step: 34500 Batch Loss: 1.768502 Tokens per Sec: 21324, Lr: 0.000300 2020-02-12 17:05:02,101 Epoch 15 Step: 34600 Batch Loss: 1.467681 Tokens per Sec: 22141, Lr: 0.000300 2020-02-12 17:05:12,021 Epoch 15 Step: 34700 Batch Loss: 1.651231 Tokens per Sec: 22103, Lr: 0.000300 2020-02-12 17:05:21,987 Epoch 15 Step: 34800 Batch Loss: 1.513118 Tokens per Sec: 22192, Lr: 0.000300 2020-02-12 17:05:31,949 Epoch 15 Step: 34900 Batch Loss: 1.697535 Tokens per Sec: 22015, Lr: 0.000300 2020-02-12 17:05:42,042 Epoch 15 Step: 35000 Batch Loss: 1.861297 Tokens per Sec: 21823, Lr: 0.000300 2020-02-12 17:06:01,337 Hooray! New best validation result [ppl]! 2020-02-12 17:06:01,337 Saving new checkpoint. 2020-02-12 17:06:01,525 Example #0 2020-02-12 17:06:01,525 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 17:06:01,525 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'vesen', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'tsung', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'sha', 'kwagh', 'u', 'dooshima', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'sha', 'kwagh', 'u', 'dooshima', 'la', 'kpaa', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 17:06:01,525 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 17:06:01,525 Reference: 10 : ​ 6 - 9 . 2020-02-12 17:06:01,525 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u vesen yô , gba hange hange u noov man kasev vea nôngo tsung vea za hemen u lun a dooshima u ve lu a mi sha kwagh u dooshima la , shi vea za hemen u lun a dooshima u a lu a mi sha kwagh u dooshima la kpaa . — Marku 10 : 6 - 9 . 2020-02-12 17:06:01,525 Example #1 2020-02-12 17:06:01,525 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 17:06:01,525 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'kwagh', 'u', 'a', 'lu', 'ikyua', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 17:06:01,526 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 17:06:01,526 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 17:06:01,526 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u doon tsung ne , man ka kwagh u a lu ikyua je la ! — Rom . 2020-02-12 17:06:01,526 Example #2 2020-02-12 17:06:01,526 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 17:06:01,526 Raw hypothesis: ['Ken', 'anyom', 'pue', 'kar', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 17:06:01,526 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 17:06:01,526 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 17:06:01,526 Hypothesis: Ken anyom pue kar yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 17:06:01,526 Example #3 2020-02-12 17:06:01,526 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 17:06:01,526 Raw hypothesis: ['(', '1', 'Mbakorinte', '15', ':', '1', ')', 'Alaghga', 'or', 'a', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 17:06:01,526 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 17:06:01,526 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 17:06:01,526 Hypothesis: ( 1 Mbakorinte 15 : 1 ) Alaghga or a lu eren kwagh sha gbenda u vough ga . 2020-02-12 17:06:01,526 Validation result (greedy) at epoch 15, step 35000: bleu: 23.56, loss: 48539.9727, ppl: 5.1533, duration: 19.4843s 2020-02-12 17:06:11,443 Epoch 15 Step: 35100 Batch Loss: 1.653404 Tokens per Sec: 22592, Lr: 0.000300 2020-02-12 17:06:21,509 Epoch 15 Step: 35200 Batch Loss: 1.863294 Tokens per Sec: 22177, Lr: 0.000300 2020-02-12 17:06:31,619 Epoch 15 Step: 35300 Batch Loss: 1.765835 Tokens per Sec: 21321, Lr: 0.000300 2020-02-12 17:06:41,787 Epoch 15 Step: 35400 Batch Loss: 1.810177 Tokens per Sec: 21681, Lr: 0.000300 2020-02-12 17:06:51,929 Epoch 15 Step: 35500 Batch Loss: 1.819806 Tokens per Sec: 21615, Lr: 0.000300 2020-02-12 17:07:02,028 Epoch 15 Step: 35600 Batch Loss: 1.702587 Tokens per Sec: 22054, Lr: 0.000300 2020-02-12 17:07:12,068 Epoch 15 Step: 35700 Batch Loss: 1.696817 Tokens per Sec: 22107, Lr: 0.000300 2020-02-12 17:07:21,987 Epoch 15 Step: 35800 Batch Loss: 1.837978 Tokens per Sec: 22963, Lr: 0.000300 2020-02-12 17:07:31,915 Epoch 15 Step: 35900 Batch Loss: 1.829086 Tokens per Sec: 22182, Lr: 0.000300 2020-02-12 17:07:41,853 Epoch 15 Step: 36000 Batch Loss: 1.701076 Tokens per Sec: 22653, Lr: 0.000300 2020-02-12 17:08:01,107 Hooray! New best validation result [ppl]! 2020-02-12 17:08:01,108 Saving new checkpoint. 2020-02-12 17:08:01,299 Example #0 2020-02-12 17:08:01,299 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 17:08:01,299 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'i', 'lu', 'kwagh', 'u', 'vesen', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'mimi', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', 'sha', 'er', 'dooshima', 'una', 'seer', 'taver', 'yô', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 17:08:01,299 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 17:08:01,299 Reference: 10 : ​ 6 - 9 . 2020-02-12 17:08:01,299 Hypothesis: Er ivese i Yehova i lu kwagh u vesen yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u mimi , shi vea za hemen u lun a dooshima u a lu hen atô ve la sha er dooshima una seer taver yô . — Marku 10 : 6 - 9 . 2020-02-12 17:08:01,299 Example #1 2020-02-12 17:08:01,299 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 17:08:01,299 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'kpilighyol', 'ne', ',', 'man', 'ka', 'kwagh', 'u', 'a', 'lu', 'ikyua', 'a', 'vese', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 17:08:01,299 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 17:08:01,300 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 17:08:01,300 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u kpilighyol ne , man ka kwagh u a lu ikyua a vese je la ! — Rom . 2020-02-12 17:08:01,300 Example #2 2020-02-12 17:08:01,300 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 17:08:01,300 Raw hypothesis: ['Anyom', 'nga', 'kar', 'pue', 'yô', ',', 'Paulu', 'ngu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 17:08:01,300 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 17:08:01,300 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 17:08:01,300 Hypothesis: Anyom nga kar pue yô , Paulu ngu ken Masedonia man Timoteu ken Efese . 2020-02-12 17:08:01,300 Example #3 2020-02-12 17:08:01,300 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 17:08:01,300 Raw hypothesis: ['Alaghga', 'or', 'a', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 17:08:01,300 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 17:08:01,301 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 17:08:01,301 Hypothesis: Alaghga or a lu eren kwagh sha gbenda u vough ga . 2020-02-12 17:08:01,301 Validation result (greedy) at epoch 15, step 36000: bleu: 23.03, loss: 48129.7148, ppl: 5.0824, duration: 19.4477s 2020-02-12 17:08:11,260 Epoch 15 Step: 36100 Batch Loss: 1.779255 Tokens per Sec: 22263, Lr: 0.000300 2020-02-12 17:08:21,156 Epoch 15 Step: 36200 Batch Loss: 1.572476 Tokens per Sec: 22725, Lr: 0.000300 2020-02-12 17:08:31,045 Epoch 15 Step: 36300 Batch Loss: 1.762110 Tokens per Sec: 22312, Lr: 0.000300 2020-02-12 17:08:40,981 Epoch 15 Step: 36400 Batch Loss: 1.536011 Tokens per Sec: 21977, Lr: 0.000300 2020-02-12 17:08:50,989 Epoch 15 Step: 36500 Batch Loss: 1.783622 Tokens per Sec: 22671, Lr: 0.000300 2020-02-12 17:09:01,013 Epoch 15 Step: 36600 Batch Loss: 1.688564 Tokens per Sec: 21703, Lr: 0.000300 2020-02-12 17:09:11,007 Epoch 15 Step: 36700 Batch Loss: 1.622414 Tokens per Sec: 22234, Lr: 0.000300 2020-02-12 17:09:20,959 Epoch 15 Step: 36800 Batch Loss: 1.792515 Tokens per Sec: 21189, Lr: 0.000300 2020-02-12 17:09:29,903 Epoch 15: total training loss 4265.62 2020-02-12 17:09:29,904 EPOCH 16 2020-02-12 17:09:31,058 Epoch 16 Step: 36900 Batch Loss: 1.520722 Tokens per Sec: 15740, Lr: 0.000300 2020-02-12 17:09:40,884 Epoch 16 Step: 37000 Batch Loss: 1.663118 Tokens per Sec: 22476, Lr: 0.000300 2020-02-12 17:10:00,117 Hooray! New best validation result [ppl]! 2020-02-12 17:10:00,117 Saving new checkpoint. 2020-02-12 17:10:00,317 Example #0 2020-02-12 17:10:00,318 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 17:10:00,318 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'doo', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'sha', 'kwagh', 'u', 'dooshima', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'seer', 'a', 'seer', 'la', 'kpaa', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 17:10:00,318 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 17:10:00,318 Reference: 10 : ​ 6 - 9 . 2020-02-12 17:10:00,318 Hypothesis: Er ivese i Yehova i lu kwagh u tsôron yô , doo u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u ve lu a mi sha kwagh u dooshima la , shi vea za hemen u lun a dooshima u a lu hen atô ve la , shi vea za hemen u lun a dooshima u a lu seer a seer la kpaa . — Marku 10 : 6 - 9 . 2020-02-12 17:10:00,318 Example #1 2020-02-12 17:10:00,318 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 17:10:00,318 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'kwagh', 'u', 'a', 'lu', 'ikyua', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 17:10:00,318 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 17:10:00,318 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 17:10:00,318 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u doon tsung ne , man ka kwagh u a lu ikyua je la ! — Rom . 2020-02-12 17:10:00,318 Example #2 2020-02-12 17:10:00,318 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 17:10:00,319 Raw hypothesis: ['Anyom', 'nga', 'kar', 'pue', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 17:10:00,319 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 17:10:00,319 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 17:10:00,319 Hypothesis: Anyom nga kar pue yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 17:10:00,319 Example #3 2020-02-12 17:10:00,319 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 17:10:00,319 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 17:10:00,319 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 17:10:00,319 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 17:10:00,319 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 17:10:00,319 Validation result (greedy) at epoch 16, step 37000: bleu: 23.29, loss: 47975.3398, ppl: 5.0560, duration: 19.4346s 2020-02-12 17:10:10,405 Epoch 16 Step: 37100 Batch Loss: 1.737724 Tokens per Sec: 21664, Lr: 0.000300 2020-02-12 17:10:20,527 Epoch 16 Step: 37200 Batch Loss: 1.642964 Tokens per Sec: 21560, Lr: 0.000300 2020-02-12 17:10:30,393 Epoch 16 Step: 37300 Batch Loss: 1.977675 Tokens per Sec: 22624, Lr: 0.000300 2020-02-12 17:10:40,264 Epoch 16 Step: 37400 Batch Loss: 1.522251 Tokens per Sec: 22981, Lr: 0.000300 2020-02-12 17:10:50,255 Epoch 16 Step: 37500 Batch Loss: 1.885353 Tokens per Sec: 22387, Lr: 0.000300 2020-02-12 17:11:00,200 Epoch 16 Step: 37600 Batch Loss: 1.610888 Tokens per Sec: 22536, Lr: 0.000300 2020-02-12 17:11:10,141 Epoch 16 Step: 37700 Batch Loss: 1.786730 Tokens per Sec: 21909, Lr: 0.000300 2020-02-12 17:11:20,169 Epoch 16 Step: 37800 Batch Loss: 1.689694 Tokens per Sec: 22281, Lr: 0.000300 2020-02-12 17:11:30,123 Epoch 16 Step: 37900 Batch Loss: 1.536706 Tokens per Sec: 22740, Lr: 0.000300 2020-02-12 17:11:40,232 Epoch 16 Step: 38000 Batch Loss: 1.822663 Tokens per Sec: 21498, Lr: 0.000300 2020-02-12 17:11:59,904 Hooray! New best validation result [ppl]! 2020-02-12 17:11:59,904 Saving new checkpoint. 2020-02-12 17:12:00,097 Example #0 2020-02-12 17:12:00,097 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 17:12:00,097 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'i', 'lu', 'kwagh', 'u', 'vesen', 'yô', ',', 'doo', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kwagh', 'tsung', 'sha', 'er', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'sha', 'kwagh', 'u', 'dooshima', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', 'kpaa', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 17:12:00,097 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 17:12:00,097 Reference: 10 : ​ 6 - 9 . 2020-02-12 17:12:00,097 Hypothesis: Er ivese i Yehova i lu kwagh u vesen yô , doo u noov man kasev vea nôngo kwagh tsung sha er vea za hemen u lun a dooshima u ve lu a mi sha kwagh u dooshima la , shi vea za hemen u lun a dooshima u a lu hen atô ve la kpaa . — Marku 10 : 6 - 9 . 2020-02-12 17:12:00,097 Example #1 2020-02-12 17:12:00,097 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 17:12:00,097 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'imba', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'kwagh', 'u', 'doon', 'tsung', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 17:12:00,097 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 17:12:00,097 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 17:12:00,097 Hypothesis: Se kpa se fatyô u ‘ nengen ’ imba shighe u doon tsung ne , man ka kwagh u doon tsung je la ! — Rom . 2020-02-12 17:12:00,097 Example #2 2020-02-12 17:12:00,098 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 17:12:00,098 Raw hypothesis: ['Anyom', 'nga', 'kar', 'pue', 'yô', ',', 'Paulu', 'ngu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 17:12:00,098 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 17:12:00,098 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 17:12:00,098 Hypothesis: Anyom nga kar pue yô , Paulu ngu ken Masedonia man Timoteu ken Efese . 2020-02-12 17:12:00,098 Example #3 2020-02-12 17:12:00,098 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 17:12:00,098 Raw hypothesis: ['Alaghga', 'or', 'a', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 17:12:00,098 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 17:12:00,098 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 17:12:00,098 Hypothesis: Alaghga or a lu eren kwagh sha gbenda u vough ga . 2020-02-12 17:12:00,098 Validation result (greedy) at epoch 16, step 38000: bleu: 23.63, loss: 47820.1016, ppl: 5.0295, duration: 19.8659s 2020-02-12 17:12:10,222 Epoch 16 Step: 38100 Batch Loss: 1.910449 Tokens per Sec: 21461, Lr: 0.000300 2020-02-12 17:12:20,452 Epoch 16 Step: 38200 Batch Loss: 1.938022 Tokens per Sec: 21975, Lr: 0.000300 2020-02-12 17:12:30,569 Epoch 16 Step: 38300 Batch Loss: 1.836311 Tokens per Sec: 22079, Lr: 0.000300 2020-02-12 17:12:40,484 Epoch 16 Step: 38400 Batch Loss: 1.524822 Tokens per Sec: 22238, Lr: 0.000300 2020-02-12 17:12:50,536 Epoch 16 Step: 38500 Batch Loss: 1.680078 Tokens per Sec: 22157, Lr: 0.000300 2020-02-12 17:13:00,623 Epoch 16 Step: 38600 Batch Loss: 1.915856 Tokens per Sec: 21643, Lr: 0.000300 2020-02-12 17:13:10,649 Epoch 16 Step: 38700 Batch Loss: 1.493190 Tokens per Sec: 21898, Lr: 0.000300 2020-02-12 17:13:20,652 Epoch 16 Step: 38800 Batch Loss: 1.532763 Tokens per Sec: 21932, Lr: 0.000300 2020-02-12 17:13:30,743 Epoch 16 Step: 38900 Batch Loss: 1.558014 Tokens per Sec: 22191, Lr: 0.000300 2020-02-12 17:13:40,645 Epoch 16 Step: 39000 Batch Loss: 1.608334 Tokens per Sec: 23022, Lr: 0.000300 2020-02-12 17:14:00,206 Hooray! New best validation result [ppl]! 2020-02-12 17:14:00,206 Saving new checkpoint. 2020-02-12 17:14:00,401 Example #0 2020-02-12 17:14:00,401 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 17:14:00,401 Raw hypothesis: ['Er', 'ivese', 'i', 'lu', 'kwagh', 'u', 'vesen', 'u', 'Yehova', 'a', 'ver', 'sha', 'ci', 'u', 'ivese', 'i', 'tsôron', 'yô', ',', 'doo', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'sha', 'afatyô', 've', 'cii', 'vea', 'lu', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'sha', 'kwagh', 'u', 'dooshima', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'ken', 'dooshima', 'u', 'a', 'lu', 'ken', 'dooshima', 'la', 'kpaa', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 17:14:00,401 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 17:14:00,402 Reference: 10 : ​ 6 - 9 . 2020-02-12 17:14:00,402 Hypothesis: Er ivese i lu kwagh u vesen u Yehova a ver sha ci u ivese i tsôron yô , doo u noov man kasev vea nôngo sha afatyô ve cii vea lu a dooshima u ve lu a mi sha kwagh u dooshima la , shi vea za hemen u lun ken dooshima u a lu ken dooshima la kpaa . — Marku 10 : 6 - 9 . 2020-02-12 17:14:00,402 Example #1 2020-02-12 17:14:00,402 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 17:14:00,402 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'imba', 'shighe', 'i', 'kpilighyol', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'a', 'mgb@@', 'ôghom', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 17:14:00,402 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 17:14:00,402 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 17:14:00,402 Hypothesis: Se kpa se fatyô u ‘ nengen ’ imba shighe i kpilighyol ne , man ka shighe u a mgbôghom je la ! — Rom . 2020-02-12 17:14:00,402 Example #2 2020-02-12 17:14:00,402 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 17:14:00,402 Raw hypothesis: ['Anyom', 'nga', 'kar', 'pue', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 17:14:00,402 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 17:14:00,403 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 17:14:00,403 Hypothesis: Anyom nga kar pue yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 17:14:00,403 Example #3 2020-02-12 17:14:00,403 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 17:14:00,403 Raw hypothesis: ['Alaghga', 'or', 'a', 'lu', 'a', 'ian', 'i', 'eren', 'kwagh', 'sha', 'inja', 'ga', '.'] 2020-02-12 17:14:00,403 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 17:14:00,403 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 17:14:00,403 Hypothesis: Alaghga or a lu a ian i eren kwagh sha inja ga . 2020-02-12 17:14:00,403 Validation result (greedy) at epoch 16, step 39000: bleu: 23.62, loss: 47529.8438, ppl: 4.9805, duration: 19.7577s 2020-02-12 17:14:10,393 Epoch 16 Step: 39100 Batch Loss: 1.682183 Tokens per Sec: 22638, Lr: 0.000300 2020-02-12 17:14:20,252 Epoch 16 Step: 39200 Batch Loss: 1.908387 Tokens per Sec: 22151, Lr: 0.000300 2020-02-12 17:14:30,090 Epoch 16 Step: 39300 Batch Loss: 1.897946 Tokens per Sec: 22309, Lr: 0.000300 2020-02-12 17:14:34,224 Epoch 16: total training loss 4200.92 2020-02-12 17:14:34,224 EPOCH 17 2020-02-12 17:14:40,212 Epoch 17 Step: 39400 Batch Loss: 1.457114 Tokens per Sec: 21492, Lr: 0.000300 2020-02-12 17:14:50,099 Epoch 17 Step: 39500 Batch Loss: 1.653721 Tokens per Sec: 22646, Lr: 0.000300 2020-02-12 17:14:59,998 Epoch 17 Step: 39600 Batch Loss: 1.386204 Tokens per Sec: 21991, Lr: 0.000300 2020-02-12 17:15:10,009 Epoch 17 Step: 39700 Batch Loss: 1.706997 Tokens per Sec: 22261, Lr: 0.000300 2020-02-12 17:15:20,049 Epoch 17 Step: 39800 Batch Loss: 1.692485 Tokens per Sec: 21817, Lr: 0.000300 2020-02-12 17:15:30,034 Epoch 17 Step: 39900 Batch Loss: 1.763175 Tokens per Sec: 22403, Lr: 0.000300 2020-02-12 17:15:39,957 Epoch 17 Step: 40000 Batch Loss: 1.762539 Tokens per Sec: 22200, Lr: 0.000300 2020-02-12 17:15:59,442 Hooray! New best validation result [ppl]! 2020-02-12 17:15:59,443 Saving new checkpoint. 2020-02-12 17:15:59,631 Example #0 2020-02-12 17:15:59,631 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 17:15:59,631 Raw hypothesis: ['Er', 'ivese', 'i', 'lu', 'kwagh', 'u', 'vesen', 'u', 'Yehova', 'a', 'ver', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'sha', 'kwagh', 'u', 'dooshima', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', 'kpaa', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 17:15:59,631 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 17:15:59,631 Reference: 10 : ​ 6 - 9 . 2020-02-12 17:15:59,631 Hypothesis: Er ivese i lu kwagh u vesen u Yehova a ver yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea za hemen u lun a dooshima u ve lu a mi sha kwagh u dooshima la , shi vea za hemen u lun a dooshima u a lu hen atô ve la kpaa . — Marku 10 : 6 - 9 . 2020-02-12 17:15:59,631 Example #1 2020-02-12 17:15:59,632 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 17:15:59,632 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'imba', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'mkur', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 17:15:59,632 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 17:15:59,632 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 17:15:59,632 Hypothesis: Se kpa se fatyô u ‘ nengen ’ imba shighe u doon tsung ne , man ka mkur je la ! — Rom . 2020-02-12 17:15:59,632 Example #2 2020-02-12 17:15:59,632 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 17:15:59,632 Raw hypothesis: ['Anyom', 'nga', 'kar', 'pue', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 17:15:59,632 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 17:15:59,632 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 17:15:59,632 Hypothesis: Anyom nga kar pue yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 17:15:59,632 Example #3 2020-02-12 17:15:59,632 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 17:15:59,633 Raw hypothesis: ['Alaghga', 'or', 'a', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 17:15:59,633 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 17:15:59,633 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 17:15:59,633 Hypothesis: Alaghga or a lu eren kwagh sha gbenda u vough ga . 2020-02-12 17:15:59,633 Validation result (greedy) at epoch 17, step 40000: bleu: 23.46, loss: 47423.7734, ppl: 4.9626, duration: 19.6749s 2020-02-12 17:16:09,575 Epoch 17 Step: 40100 Batch Loss: 1.694792 Tokens per Sec: 22712, Lr: 0.000300 2020-02-12 17:16:19,472 Epoch 17 Step: 40200 Batch Loss: 1.581131 Tokens per Sec: 21989, Lr: 0.000300 2020-02-12 17:16:29,379 Epoch 17 Step: 40300 Batch Loss: 1.775241 Tokens per Sec: 22446, Lr: 0.000300 2020-02-12 17:16:39,278 Epoch 17 Step: 40400 Batch Loss: 1.669336 Tokens per Sec: 23149, Lr: 0.000300 2020-02-12 17:16:49,265 Epoch 17 Step: 40500 Batch Loss: 1.902275 Tokens per Sec: 21824, Lr: 0.000300 2020-02-12 17:16:59,120 Epoch 17 Step: 40600 Batch Loss: 1.649417 Tokens per Sec: 22239, Lr: 0.000300 2020-02-12 17:17:09,064 Epoch 17 Step: 40700 Batch Loss: 1.507195 Tokens per Sec: 22644, Lr: 0.000300 2020-02-12 17:17:18,961 Epoch 17 Step: 40800 Batch Loss: 1.605355 Tokens per Sec: 22012, Lr: 0.000300 2020-02-12 17:17:28,912 Epoch 17 Step: 40900 Batch Loss: 1.902608 Tokens per Sec: 22445, Lr: 0.000300 2020-02-12 17:17:38,929 Epoch 17 Step: 41000 Batch Loss: 1.659574 Tokens per Sec: 22245, Lr: 0.000300 2020-02-12 17:17:58,303 Hooray! New best validation result [ppl]! 2020-02-12 17:17:58,303 Saving new checkpoint. 2020-02-12 17:17:58,491 Example #0 2020-02-12 17:17:58,491 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 17:17:58,491 Raw hypothesis: ['Er', 'ivaa', 'i', 'lu', 'kwagh', 'u', 'vesen', 'u', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'vesen', 'yô', ',', 'doo', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'kura', 'ayol', 'a', 've', 'sha', 'dooshima', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 17:17:58,491 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 17:17:58,491 Reference: 10 : ​ 6 - 9 . 2020-02-12 17:17:58,491 Hypothesis: Er ivaa i lu kwagh u vesen u Yehova a ver la i lu kwagh u vesen yô , doo u noov man kasev vea nôngo kpoghuloo vea kura ayol a ve sha dooshima shi vea za hemen u lun a dooshima u a lu hen atô ve la . — Marku 10 : 6 - 9 . 2020-02-12 17:17:58,491 Example #1 2020-02-12 17:17:58,492 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 17:17:58,492 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'imba', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'doon', 'tsung', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 17:17:58,492 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 17:17:58,492 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 17:17:58,492 Hypothesis: Se kpa se fatyô u ‘ nengen ’ imba shighe u doon tsung ne , man ka shighe u doon tsung je la ! — Rom . 2020-02-12 17:17:58,492 Example #2 2020-02-12 17:17:58,492 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 17:17:58,492 Raw hypothesis: ['Anyom', 'nga', 'kar', 'pue', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 17:17:58,492 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 17:17:58,492 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 17:17:58,492 Hypothesis: Anyom nga kar pue yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 17:17:58,492 Example #3 2020-02-12 17:17:58,492 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 17:17:58,492 Raw hypothesis: ['Alaghga', 'or', 'a', 'lu', 'a', 'ian', 'i', 'eren', 'kwagh', 'sha', 'inja', 'ga', '.'] 2020-02-12 17:17:58,492 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 17:17:58,492 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 17:17:58,493 Hypothesis: Alaghga or a lu a ian i eren kwagh sha inja ga . 2020-02-12 17:17:58,493 Validation result (greedy) at epoch 17, step 41000: bleu: 23.63, loss: 47236.0664, ppl: 4.9313, duration: 19.5636s 2020-02-12 17:18:08,415 Epoch 17 Step: 41100 Batch Loss: 1.695277 Tokens per Sec: 21111, Lr: 0.000300 2020-02-12 17:18:18,342 Epoch 17 Step: 41200 Batch Loss: 1.646064 Tokens per Sec: 22529, Lr: 0.000300 2020-02-12 17:18:28,316 Epoch 17 Step: 41300 Batch Loss: 1.509018 Tokens per Sec: 22127, Lr: 0.000300 2020-02-12 17:18:38,194 Epoch 17 Step: 41400 Batch Loss: 1.473838 Tokens per Sec: 22343, Lr: 0.000300 2020-02-12 17:18:48,118 Epoch 17 Step: 41500 Batch Loss: 1.726833 Tokens per Sec: 22445, Lr: 0.000300 2020-02-12 17:18:57,993 Epoch 17 Step: 41600 Batch Loss: 1.478948 Tokens per Sec: 21827, Lr: 0.000300 2020-02-12 17:19:07,935 Epoch 17 Step: 41700 Batch Loss: 1.902975 Tokens per Sec: 22290, Lr: 0.000300 2020-02-12 17:19:17,824 Epoch 17 Step: 41800 Batch Loss: 1.559707 Tokens per Sec: 22450, Lr: 0.000300 2020-02-12 17:19:17,832 Epoch 17: total training loss 4165.89 2020-02-12 17:19:17,832 EPOCH 18 2020-02-12 17:19:27,964 Epoch 18 Step: 41900 Batch Loss: 1.756436 Tokens per Sec: 21969, Lr: 0.000300 2020-02-12 17:19:38,184 Epoch 18 Step: 42000 Batch Loss: 1.338875 Tokens per Sec: 21369, Lr: 0.000300 2020-02-12 17:19:59,397 Example #0 2020-02-12 17:19:59,397 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 17:19:59,397 Raw hypothesis: ['Er', 'ivaa', 'i', 'Yehova', 'i', 'lu', 'kwagh', 'u', 'vesen', 'yô', ',', 'gba', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'eren', 'kwagh', 'sha', 'dooshima', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'mimi', 'shi', 'lun', 'a', 'mi', 'sha', 'dooshima', 'u', 'a', 'lu', 'seer', 'a', 'seer', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 17:19:59,397 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 17:19:59,397 Reference: 10 : ​ 6 - 9 . 2020-02-12 17:19:59,397 Hypothesis: Er ivaa i Yehova i lu kwagh u vesen yô , gba u noov man kasev vea nôngo kpoghuloo vea eren kwagh sha dooshima shi vea za hemen u lun a dooshima u mimi shi lun a mi sha dooshima u a lu seer a seer la . — Marku 10 : 6 - 9 . 2020-02-12 17:19:59,397 Example #1 2020-02-12 17:19:59,397 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 17:19:59,397 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'imba', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'doon', 'tsung', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 17:19:59,397 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 17:19:59,397 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 17:19:59,397 Hypothesis: Se kpa se fatyô u ‘ nengen ’ imba shighe u doon tsung ne , man ka shighe u doon tsung je la ! — Rom . 2020-02-12 17:19:59,398 Example #2 2020-02-12 17:19:59,398 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 17:19:59,398 Raw hypothesis: ['Ken', 'masejime', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 17:19:59,398 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 17:19:59,398 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 17:19:59,398 Hypothesis: Ken masejime yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 17:19:59,398 Example #3 2020-02-12 17:19:59,398 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 17:19:59,398 Raw hypothesis: ['Ka', 'kwagh', 'u', 'or', 'môm', 'kpa', 'nan', 'eren', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 17:19:59,398 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 17:19:59,398 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 17:19:59,398 Hypothesis: Ka kwagh u or môm kpa nan eren sha gbenda u vough ga . 2020-02-12 17:19:59,398 Validation result (greedy) at epoch 18, step 42000: bleu: 23.83, loss: 47692.0898, ppl: 5.0078, duration: 21.2137s 2020-02-12 17:20:09,537 Epoch 18 Step: 42100 Batch Loss: 1.574458 Tokens per Sec: 21613, Lr: 0.000300 2020-02-12 17:20:19,632 Epoch 18 Step: 42200 Batch Loss: 1.510411 Tokens per Sec: 21422, Lr: 0.000300 2020-02-12 17:20:29,560 Epoch 18 Step: 42300 Batch Loss: 1.649551 Tokens per Sec: 22014, Lr: 0.000300 2020-02-12 17:20:39,457 Epoch 18 Step: 42400 Batch Loss: 1.568916 Tokens per Sec: 21664, Lr: 0.000300 2020-02-12 17:20:49,422 Epoch 18 Step: 42500 Batch Loss: 1.411652 Tokens per Sec: 22146, Lr: 0.000300 2020-02-12 17:20:59,356 Epoch 18 Step: 42600 Batch Loss: 1.386474 Tokens per Sec: 22783, Lr: 0.000300 2020-02-12 17:21:09,354 Epoch 18 Step: 42700 Batch Loss: 1.341680 Tokens per Sec: 22421, Lr: 0.000300 2020-02-12 17:21:19,331 Epoch 18 Step: 42800 Batch Loss: 1.568339 Tokens per Sec: 22233, Lr: 0.000300 2020-02-12 17:21:29,473 Epoch 18 Step: 42900 Batch Loss: 1.789617 Tokens per Sec: 21805, Lr: 0.000300 2020-02-12 17:21:39,637 Epoch 18 Step: 43000 Batch Loss: 1.741903 Tokens per Sec: 21691, Lr: 0.000300 2020-02-12 17:21:59,782 Hooray! New best validation result [ppl]! 2020-02-12 17:21:59,783 Saving new checkpoint. 2020-02-12 17:21:59,974 Example #0 2020-02-12 17:21:59,974 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 17:21:59,974 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'i', 'lu', 'kwagh', 'u', 'vesen', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kwagh', 'kpoghuloo', 've', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'mimi', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', 'ye', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 17:21:59,974 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 17:21:59,974 Reference: 10 : ​ 6 - 9 . 2020-02-12 17:21:59,974 Hypothesis: Er ivese i Yehova i lu kwagh u vesen yô , gba hange hange u noov man kasev vea nôngo kwagh kpoghuloo ve vea za hemen u lun a dooshima u mimi , shi vea za hemen u lun a dooshima u a lu hen atô ve la ye . — Marku 10 : 6 - 9 . 2020-02-12 17:21:59,974 Example #1 2020-02-12 17:21:59,974 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 17:21:59,974 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'imba', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'kwagh', 'u', 'a', 'lu', 'ikyua', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 17:21:59,974 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 17:21:59,974 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 17:21:59,974 Hypothesis: Se kpa se fatyô u ‘ nengen ’ imba shighe u doon tsung ne , man ka kwagh u a lu ikyua je la ! — Rom . 2020-02-12 17:21:59,975 Example #2 2020-02-12 17:21:59,975 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 17:21:59,975 Raw hypothesis: ['Anyom', 'nga', 'kar', 'pue', 'yô', ',', 'Paulu', 'ngu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', ',', 'Timoteu', '.'] 2020-02-12 17:21:59,975 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 17:21:59,975 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 17:21:59,975 Hypothesis: Anyom nga kar pue yô , Paulu ngu ken Masedonia man Timoteu , Timoteu . 2020-02-12 17:21:59,975 Example #3 2020-02-12 17:21:59,975 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 17:21:59,975 Raw hypothesis: ['Alaghga', 'a', 'lu', 'or', 'u', 'nan', 'lu', 'a', 'inja', 'u', 'eren', 'kwagh', 'sha', 'inja', 'ga', 'yô', '.'] 2020-02-12 17:21:59,975 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 17:21:59,975 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 17:21:59,975 Hypothesis: Alaghga a lu or u nan lu a inja u eren kwagh sha inja ga yô . 2020-02-12 17:21:59,975 Validation result (greedy) at epoch 18, step 43000: bleu: 24.27, loss: 46881.6602, ppl: 4.8726, duration: 20.3381s 2020-02-12 17:22:09,952 Epoch 18 Step: 43100 Batch Loss: 1.719406 Tokens per Sec: 22462, Lr: 0.000300 2020-02-12 17:22:19,828 Epoch 18 Step: 43200 Batch Loss: 1.828850 Tokens per Sec: 22917, Lr: 0.000300 2020-02-12 17:22:29,803 Epoch 18 Step: 43300 Batch Loss: 1.869483 Tokens per Sec: 22392, Lr: 0.000300 2020-02-12 17:22:39,889 Epoch 18 Step: 43400 Batch Loss: 1.468729 Tokens per Sec: 21585, Lr: 0.000300 2020-02-12 17:22:49,860 Epoch 18 Step: 43500 Batch Loss: 1.788264 Tokens per Sec: 22357, Lr: 0.000300 2020-02-12 17:22:59,685 Epoch 18 Step: 43600 Batch Loss: 1.795012 Tokens per Sec: 22602, Lr: 0.000300 2020-02-12 17:23:09,544 Epoch 18 Step: 43700 Batch Loss: 1.944217 Tokens per Sec: 22824, Lr: 0.000300 2020-02-12 17:23:19,380 Epoch 18 Step: 43800 Batch Loss: 1.707191 Tokens per Sec: 22251, Lr: 0.000300 2020-02-12 17:23:29,289 Epoch 18 Step: 43900 Batch Loss: 1.899059 Tokens per Sec: 22764, Lr: 0.000300 2020-02-12 17:23:39,179 Epoch 18 Step: 44000 Batch Loss: 1.937513 Tokens per Sec: 22186, Lr: 0.000300 2020-02-12 17:23:58,677 Hooray! New best validation result [ppl]! 2020-02-12 17:23:58,677 Saving new checkpoint. 2020-02-12 17:23:58,865 Example #0 2020-02-12 17:23:58,865 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 17:23:58,865 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'vesen', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kwagh', 'kpoghuloo', 'sha', 'er', 'vea', 'kura', 'dooshima', 've', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'seer', 'a', 'seer', 'la', 'yô', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 17:23:58,865 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 17:23:58,866 Reference: 10 : ​ 6 - 9 . 2020-02-12 17:23:58,866 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u vesen yô , gba hange hange u noov man kasev vea nôngo kwagh kpoghuloo sha er vea kura dooshima ve u a lu hen atô ve la shi vea za hemen u lun a dooshima u a lu seer a seer la yô . — Marku 10 : 6 - 9 . 2020-02-12 17:23:58,866 Example #1 2020-02-12 17:23:58,866 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 17:23:58,866 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'imba', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'kwagh', 'u', 'a', 'lu', 'ikyua', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 17:23:58,866 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 17:23:58,866 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 17:23:58,866 Hypothesis: Se kpa se fatyô u ‘ nengen ’ imba shighe u doon tsung ne , man ka kwagh u a lu ikyua je la ! — Rom . 2020-02-12 17:23:58,866 Example #2 2020-02-12 17:23:58,866 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 17:23:58,866 Raw hypothesis: ['Anyom', 'nga', 'kar', 'pue', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 17:23:58,866 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 17:23:58,866 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 17:23:58,866 Hypothesis: Anyom nga kar pue yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 17:23:58,866 Example #3 2020-02-12 17:23:58,867 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 17:23:58,867 Raw hypothesis: ['Alaghga', 'a', 'lu', 'u', 'or', 'nana', 'er', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 17:23:58,867 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 17:23:58,867 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 17:23:58,867 Hypothesis: Alaghga a lu u or nana er kwagh sha gbenda u vough ga . 2020-02-12 17:23:58,867 Validation result (greedy) at epoch 18, step 44000: bleu: 23.78, loss: 46783.2617, ppl: 4.8564, duration: 19.6870s 2020-02-12 17:24:08,857 Epoch 18 Step: 44100 Batch Loss: 1.850072 Tokens per Sec: 22430, Lr: 0.000300 2020-02-12 17:24:18,787 Epoch 18 Step: 44200 Batch Loss: 1.684474 Tokens per Sec: 21987, Lr: 0.000300 2020-02-12 17:24:24,488 Epoch 18: total training loss 4123.80 2020-02-12 17:24:24,489 EPOCH 19 2020-02-12 17:24:29,005 Epoch 19 Step: 44300 Batch Loss: 2.051862 Tokens per Sec: 21713, Lr: 0.000300 2020-02-12 17:24:39,064 Epoch 19 Step: 44400 Batch Loss: 1.527221 Tokens per Sec: 22102, Lr: 0.000300 2020-02-12 17:24:49,197 Epoch 19 Step: 44500 Batch Loss: 1.698547 Tokens per Sec: 21756, Lr: 0.000300 2020-02-12 17:24:59,313 Epoch 19 Step: 44600 Batch Loss: 1.678486 Tokens per Sec: 22101, Lr: 0.000300 2020-02-12 17:25:09,400 Epoch 19 Step: 44700 Batch Loss: 1.522792 Tokens per Sec: 22018, Lr: 0.000300 2020-02-12 17:25:19,338 Epoch 19 Step: 44800 Batch Loss: 1.547367 Tokens per Sec: 22460, Lr: 0.000300 2020-02-12 17:25:29,252 Epoch 19 Step: 44900 Batch Loss: 2.023463 Tokens per Sec: 22413, Lr: 0.000300 2020-02-12 17:25:39,210 Epoch 19 Step: 45000 Batch Loss: 1.765261 Tokens per Sec: 22156, Lr: 0.000300 2020-02-12 17:25:57,565 Hooray! New best validation result [ppl]! 2020-02-12 17:25:57,565 Saving new checkpoint. 2020-02-12 17:25:57,764 Example #0 2020-02-12 17:25:57,764 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 17:25:57,764 Raw hypothesis: ['Er', 'Yehova', 'a', 'ver', 'ivese', 'i', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kwagh', 'kpoghuloo', 've', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'sha', 'kwagh', 'u', 'dooshima', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', 'kpaa', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 17:25:57,764 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 17:25:57,764 Reference: 10 : ​ 6 - 9 . 2020-02-12 17:25:57,764 Hypothesis: Er Yehova a ver ivese i tsôron yô , gba hange hange u noov man kasev vea nôngo kwagh kpoghuloo ve vea za hemen u lun a dooshima u ve lu a mi sha kwagh u dooshima la , shi vea za hemen u lun a dooshima u a lu hen atô ve la kpaa . — Marku 10 : 6 - 9 . 2020-02-12 17:25:57,764 Example #1 2020-02-12 17:25:57,764 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 17:25:57,764 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'imba', 'shighe', 'i', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'i', 'lu', 'ikyua', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 17:25:57,764 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 17:25:57,764 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 17:25:57,765 Hypothesis: Se kpa se fatyô u ‘ nengen ’ imba shighe i doon tsung ne , man ka i lu ikyua je la ! — Rom . 2020-02-12 17:25:57,765 Example #2 2020-02-12 17:25:57,765 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 17:25:57,765 Raw hypothesis: ['Anyom', 'nga', 'kar', 'pue', 'yô', ',', 'Paulu', 'ngu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 17:25:57,765 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 17:25:57,765 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 17:25:57,765 Hypothesis: Anyom nga kar pue yô , Paulu ngu ken Masedonia man Timoteu ken Efese . 2020-02-12 17:25:57,765 Example #3 2020-02-12 17:25:57,765 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 17:25:57,765 Raw hypothesis: ['Alaghga', 'a', 'lu', 'inja', 'er', 'or', 'ngu', 'eren', 'kwagh', 'sha', 'inja', 'ga', 'nahan', '.'] 2020-02-12 17:25:57,765 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 17:25:57,765 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 17:25:57,765 Hypothesis: Alaghga a lu inja er or ngu eren kwagh sha inja ga nahan . 2020-02-12 17:25:57,765 Validation result (greedy) at epoch 19, step 45000: bleu: 24.12, loss: 46635.3867, ppl: 4.8322, duration: 18.5550s 2020-02-12 17:26:07,696 Epoch 19 Step: 45100 Batch Loss: 1.836917 Tokens per Sec: 22059, Lr: 0.000300 2020-02-12 17:26:17,646 Epoch 19 Step: 45200 Batch Loss: 1.467316 Tokens per Sec: 22531, Lr: 0.000300 2020-02-12 17:26:27,623 Epoch 19 Step: 45300 Batch Loss: 1.681551 Tokens per Sec: 22316, Lr: 0.000300 2020-02-12 17:26:37,794 Epoch 19 Step: 45400 Batch Loss: 1.638225 Tokens per Sec: 22062, Lr: 0.000300 2020-02-12 17:26:47,800 Epoch 19 Step: 45500 Batch Loss: 1.648621 Tokens per Sec: 21838, Lr: 0.000300 2020-02-12 17:26:57,727 Epoch 19 Step: 45600 Batch Loss: 1.807967 Tokens per Sec: 21813, Lr: 0.000300 2020-02-12 17:27:07,666 Epoch 19 Step: 45700 Batch Loss: 1.725803 Tokens per Sec: 22564, Lr: 0.000300 2020-02-12 17:27:17,616 Epoch 19 Step: 45800 Batch Loss: 1.618219 Tokens per Sec: 22026, Lr: 0.000300 2020-02-12 17:27:27,727 Epoch 19 Step: 45900 Batch Loss: 1.445169 Tokens per Sec: 21406, Lr: 0.000300 2020-02-12 17:27:37,830 Epoch 19 Step: 46000 Batch Loss: 1.583930 Tokens per Sec: 22123, Lr: 0.000300 2020-02-12 17:27:56,600 Hooray! New best validation result [ppl]! 2020-02-12 17:27:56,600 Saving new checkpoint. 2020-02-12 17:27:56,790 Example #0 2020-02-12 17:27:56,790 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 17:27:56,791 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'doo', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'sha', 'dooshima', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'sha', 'dooshima', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 17:27:56,791 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 17:27:56,791 Reference: 10 : ​ 6 - 9 . 2020-02-12 17:27:56,791 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , doo u noov man kasev vea nôngo kpoghuloo vea za hemen u lun a dooshima u ve lu a mi sha dooshima la , shi vea za hemen u lun a dooshima u a lu a mi sha dooshima la . — Marku 10 : 6 - 9 . 2020-02-12 17:27:56,791 Example #1 2020-02-12 17:27:56,791 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 17:27:56,791 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'imba', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'kwagh', 'u', 'a', 'lu', 'ikyua', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 17:27:56,791 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 17:27:56,791 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 17:27:56,791 Hypothesis: Se kpa se fatyô u ‘ nengen ’ imba shighe u doon tsung ne , man ka kwagh u a lu ikyua je la ! — Rom . 2020-02-12 17:27:56,791 Example #2 2020-02-12 17:27:56,791 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 17:27:56,792 Raw hypothesis: ['Anyom', 'nga', 'kar', 'pue', 'yô', ',', 'Paulu', 'ngu', 'ken', 'gar', 'u', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 17:27:56,792 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 17:27:56,792 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 17:27:56,792 Hypothesis: Anyom nga kar pue yô , Paulu ngu ken gar u Masedonia man Timoteu ken Efese . 2020-02-12 17:27:56,792 Example #3 2020-02-12 17:27:56,792 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 17:27:56,792 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'a', 'ian', 'i', 'eren', 'kwagh', 'u', 'vough', 'ga', '.'] 2020-02-12 17:27:56,792 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 17:27:56,792 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 17:27:56,792 Hypothesis: Alaghga or nana lu a ian i eren kwagh u vough ga . 2020-02-12 17:27:56,792 Validation result (greedy) at epoch 19, step 46000: bleu: 24.22, loss: 46367.6172, ppl: 4.7887, duration: 18.9613s 2020-02-12 17:28:06,980 Epoch 19 Step: 46100 Batch Loss: 1.860646 Tokens per Sec: 21371, Lr: 0.000300 2020-02-12 17:28:16,979 Epoch 19 Step: 46200 Batch Loss: 1.519286 Tokens per Sec: 22297, Lr: 0.000300 2020-02-12 17:28:26,887 Epoch 19 Step: 46300 Batch Loss: 1.700382 Tokens per Sec: 22052, Lr: 0.000300 2020-02-12 17:28:36,815 Epoch 19 Step: 46400 Batch Loss: 1.723838 Tokens per Sec: 22140, Lr: 0.000300 2020-02-12 17:28:46,825 Epoch 19 Step: 46500 Batch Loss: 1.654854 Tokens per Sec: 22045, Lr: 0.000300 2020-02-12 17:28:56,752 Epoch 19 Step: 46600 Batch Loss: 1.664029 Tokens per Sec: 21984, Lr: 0.000300 2020-02-12 17:29:06,669 Epoch 19 Step: 46700 Batch Loss: 1.875921 Tokens per Sec: 22221, Lr: 0.000300 2020-02-12 17:29:08,354 Epoch 19: total training loss 4091.16 2020-02-12 17:29:08,355 EPOCH 20 2020-02-12 17:29:17,025 Epoch 20 Step: 46800 Batch Loss: 1.571827 Tokens per Sec: 21164, Lr: 0.000300 2020-02-12 17:29:27,061 Epoch 20 Step: 46900 Batch Loss: 1.725717 Tokens per Sec: 22454, Lr: 0.000300 2020-02-12 17:29:36,954 Epoch 20 Step: 47000 Batch Loss: 1.835449 Tokens per Sec: 22778, Lr: 0.000300 2020-02-12 17:29:58,035 Example #0 2020-02-12 17:29:58,035 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 17:29:58,035 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'i', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'sha', 'afatyô', 've', 'cii', 'vea', 'kura', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'sha', 'dooshima', 'la', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'sha', 'kwagh', 'u', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'sha', 'kwagh', 'u', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'ken', 'ivese', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 17:29:58,035 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 17:29:58,035 Reference: 10 : ​ 6 - 9 . 2020-02-12 17:29:58,035 Hypothesis: Er ivese i Yehova i ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo sha afatyô ve cii vea kura dooshima u ve lu a mi sha dooshima la shi vea za hemen u lun a dooshima u a lu a mi sha kwagh u dooshima u a lu a mi sha kwagh u dooshima u a lu a mi ken ivese la . — Marku 10 : 6 - 9 . 2020-02-12 17:29:58,035 Example #1 2020-02-12 17:29:58,036 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 17:29:58,036 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'imba', 'shighe', 'la', ',', 'man', 'ka', 'shighe', 'u', 'doon', 'tsung', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 17:29:58,036 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 17:29:58,036 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 17:29:58,036 Hypothesis: Se kpa se fatyô u ‘ nengen ’ imba shighe la , man ka shighe u doon tsung je la ! — Rom . 2020-02-12 17:29:58,036 Example #2 2020-02-12 17:29:58,036 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 17:29:58,036 Raw hypothesis: ['Anyom', 'nga', 'kar', 'pue', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 17:29:58,036 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 17:29:58,036 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 17:29:58,036 Hypothesis: Anyom nga kar pue yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 17:29:58,036 Example #3 2020-02-12 17:29:58,037 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 17:29:58,037 Raw hypothesis: ['Alaghga', 'or', 'a', 'lu', 'eren', 'kwagh', 'sha', 'inja', 'sha', 'inja', 'ga', '.'] 2020-02-12 17:29:58,037 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 17:29:58,037 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 17:29:58,037 Hypothesis: Alaghga or a lu eren kwagh sha inja sha inja ga . 2020-02-12 17:29:58,037 Validation result (greedy) at epoch 20, step 47000: bleu: 24.36, loss: 46688.4023, ppl: 4.8409, duration: 21.0828s 2020-02-12 17:30:08,136 Epoch 20 Step: 47100 Batch Loss: 1.716609 Tokens per Sec: 22047, Lr: 0.000300 2020-02-12 17:30:18,123 Epoch 20 Step: 47200 Batch Loss: 1.671044 Tokens per Sec: 22580, Lr: 0.000300 2020-02-12 17:30:28,133 Epoch 20 Step: 47300 Batch Loss: 1.445888 Tokens per Sec: 21388, Lr: 0.000300 2020-02-12 17:30:38,074 Epoch 20 Step: 47400 Batch Loss: 1.713128 Tokens per Sec: 22909, Lr: 0.000300 2020-02-12 17:30:48,172 Epoch 20 Step: 47500 Batch Loss: 1.737762 Tokens per Sec: 22282, Lr: 0.000300 2020-02-12 17:30:58,278 Epoch 20 Step: 47600 Batch Loss: 1.850294 Tokens per Sec: 21471, Lr: 0.000300 2020-02-12 17:31:08,414 Epoch 20 Step: 47700 Batch Loss: 1.669205 Tokens per Sec: 22107, Lr: 0.000300 2020-02-12 17:31:18,495 Epoch 20 Step: 47800 Batch Loss: 1.598820 Tokens per Sec: 21470, Lr: 0.000300 2020-02-12 17:31:28,394 Epoch 20 Step: 47900 Batch Loss: 1.994453 Tokens per Sec: 22286, Lr: 0.000300 2020-02-12 17:31:38,402 Epoch 20 Step: 48000 Batch Loss: 1.732325 Tokens per Sec: 21762, Lr: 0.000300 2020-02-12 17:31:58,057 Example #0 2020-02-12 17:31:58,057 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 17:31:58,057 Raw hypothesis: ['Er', 'ivaa', 'i', 'Yehova', 'i', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'vesen', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'sha', 'kwagh', 'u', 'dooshima', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'sha', 'kwagh', 'u', 'dooshima', 'la', 'kpaa', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 17:31:58,057 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 17:31:58,057 Reference: 10 : ​ 6 - 9 . 2020-02-12 17:31:58,057 Hypothesis: Er ivaa i Yehova i ver la i lu kwagh u vesen yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u ve lu a mi sha kwagh u dooshima la , shi vea za hemen u lun a dooshima u a lu a mi sha kwagh u dooshima la kpaa . — Marku 10 : 6 - 9 . 2020-02-12 17:31:58,057 Example #1 2020-02-12 17:31:58,057 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 17:31:58,057 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'imba', 'shighe', 'u', 'kpilighyol', 'ne', ',', 'man', 'ka', 'hen', 'shighe', 'la', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 17:31:58,058 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 17:31:58,058 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 17:31:58,058 Hypothesis: Se kpa se fatyô u ‘ nengen ’ imba shighe u kpilighyol ne , man ka hen shighe la je la ! — Rom . 2020-02-12 17:31:58,058 Example #2 2020-02-12 17:31:58,058 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 17:31:58,058 Raw hypothesis: ['Anyom', 'nga', 'kar', 'pue', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 17:31:58,058 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 17:31:58,058 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 17:31:58,058 Hypothesis: Anyom nga kar pue yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 17:31:58,058 Example #3 2020-02-12 17:31:58,058 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 17:31:58,058 Raw hypothesis: ['Alaghga', 'a', 'lu', 'inja', 'er', 'or', 'ngu', 'eren', 'kwagh', 'sha', 'inja', 'ga', 'nahan', '.'] 2020-02-12 17:31:58,058 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 17:31:58,058 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 17:31:58,058 Hypothesis: Alaghga a lu inja er or ngu eren kwagh sha inja ga nahan . 2020-02-12 17:31:58,058 Validation result (greedy) at epoch 20, step 48000: bleu: 23.99, loss: 46406.6641, ppl: 4.7950, duration: 19.6562s 2020-02-12 17:32:08,301 Epoch 20 Step: 48100 Batch Loss: 1.477505 Tokens per Sec: 21789, Lr: 0.000300 2020-02-12 17:32:18,438 Epoch 20 Step: 48200 Batch Loss: 1.651589 Tokens per Sec: 22049, Lr: 0.000300 2020-02-12 17:32:28,582 Epoch 20 Step: 48300 Batch Loss: 1.409362 Tokens per Sec: 21108, Lr: 0.000300 2020-02-12 17:32:38,646 Epoch 20 Step: 48400 Batch Loss: 1.752730 Tokens per Sec: 21695, Lr: 0.000300 2020-02-12 17:32:48,592 Epoch 20 Step: 48500 Batch Loss: 1.584036 Tokens per Sec: 22279, Lr: 0.000300 2020-02-12 17:32:58,525 Epoch 20 Step: 48600 Batch Loss: 1.677736 Tokens per Sec: 22177, Lr: 0.000300 2020-02-12 17:33:08,471 Epoch 20 Step: 48700 Batch Loss: 1.420959 Tokens per Sec: 22042, Lr: 0.000300 2020-02-12 17:33:18,378 Epoch 20 Step: 48800 Batch Loss: 1.488951 Tokens per Sec: 22343, Lr: 0.000300 2020-02-12 17:33:28,304 Epoch 20 Step: 48900 Batch Loss: 1.467913 Tokens per Sec: 21863, Lr: 0.000300 2020-02-12 17:33:38,148 Epoch 20 Step: 49000 Batch Loss: 1.854872 Tokens per Sec: 22362, Lr: 0.000300 2020-02-12 17:33:56,626 Hooray! New best validation result [ppl]! 2020-02-12 17:33:56,626 Saving new checkpoint. 2020-02-12 17:33:56,826 Example #0 2020-02-12 17:33:56,826 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 17:33:56,826 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'vesen', 'yô', ',', 'doo', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'kpaa', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 17:33:56,826 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 17:33:56,826 Reference: 10 : ​ 6 - 9 . 2020-02-12 17:33:56,826 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u vesen yô , doo u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u ve lu a mi la , shi vea za hemen u lun a dooshima u a lu a mi la kpaa . — Marku 10 : 6 - 9 . 2020-02-12 17:33:56,827 Example #1 2020-02-12 17:33:56,827 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 17:33:56,827 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'imba', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'ikyua', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 17:33:56,827 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 17:33:56,827 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 17:33:56,827 Hypothesis: Se kpa se fatyô u ‘ nengen ’ imba shighe u doon tsung ne , man ka ikyua je la ! — Rom . 2020-02-12 17:33:56,827 Example #2 2020-02-12 17:33:56,827 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 17:33:56,827 Raw hypothesis: ['Anyom', 'nga', 'kar', 'pue', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 17:33:56,827 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 17:33:56,827 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 17:33:56,827 Hypothesis: Anyom nga kar pue yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 17:33:56,827 Example #3 2020-02-12 17:33:56,827 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 17:33:56,827 Raw hypothesis: ['Alaghga', 'a', 'lu', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'inja', 'ga', 'la', 'nan', 'lu', 'a', 'ian', 'i', 'eren', 'kwagh', 'sha', 'inja', 'ga', 'ye', '.'] 2020-02-12 17:33:56,827 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 17:33:56,828 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 17:33:56,828 Hypothesis: Alaghga a lu or u nan lu eren kwagh sha inja ga la nan lu a ian i eren kwagh sha inja ga ye . 2020-02-12 17:33:56,828 Validation result (greedy) at epoch 20, step 49000: bleu: 24.59, loss: 45963.8438, ppl: 4.7238, duration: 18.6788s 2020-02-12 17:34:06,674 Epoch 20 Step: 49100 Batch Loss: 1.396744 Tokens per Sec: 22097, Lr: 0.000300 2020-02-12 17:34:14,500 Epoch 20: total training loss 4054.88 2020-02-12 17:34:14,500 EPOCH 21 2020-02-12 17:34:16,958 Epoch 21 Step: 49200 Batch Loss: 1.516344 Tokens per Sec: 20478, Lr: 0.000300 2020-02-12 17:34:27,015 Epoch 21 Step: 49300 Batch Loss: 1.696139 Tokens per Sec: 21517, Lr: 0.000300 2020-02-12 17:34:37,182 Epoch 21 Step: 49400 Batch Loss: 1.524421 Tokens per Sec: 22373, Lr: 0.000300 2020-02-12 17:34:47,319 Epoch 21 Step: 49500 Batch Loss: 1.402281 Tokens per Sec: 21991, Lr: 0.000300 2020-02-12 17:34:57,396 Epoch 21 Step: 49600 Batch Loss: 1.680406 Tokens per Sec: 22128, Lr: 0.000300 2020-02-12 17:35:07,298 Epoch 21 Step: 49700 Batch Loss: 1.793860 Tokens per Sec: 22715, Lr: 0.000300 2020-02-12 17:35:17,169 Epoch 21 Step: 49800 Batch Loss: 1.614372 Tokens per Sec: 22320, Lr: 0.000300 2020-02-12 17:35:27,037 Epoch 21 Step: 49900 Batch Loss: 1.717866 Tokens per Sec: 22468, Lr: 0.000300 2020-02-12 17:35:36,949 Epoch 21 Step: 50000 Batch Loss: 1.774976 Tokens per Sec: 22262, Lr: 0.000300 2020-02-12 17:35:56,752 Example #0 2020-02-12 17:35:56,752 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 17:35:56,752 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'i', 'lu', 'kwagh', 'u', 'vesen', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'kura', 'dooshima', 've', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'sha', 'kwagh', 'u', 'dooshima', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 17:35:56,752 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 17:35:56,752 Reference: 10 : ​ 6 - 9 . 2020-02-12 17:35:56,752 Hypothesis: Er ivese i Yehova i lu kwagh u vesen yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea kura dooshima ve shi vea za hemen u lun a dooshima u a lu a mi sha kwagh u dooshima la . — Marku 10 : 6 - 9 . 2020-02-12 17:35:56,752 Example #1 2020-02-12 17:35:56,752 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 17:35:56,752 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'hen', 'shighe', 'la', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 17:35:56,753 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 17:35:56,753 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 17:35:56,753 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u doon tsung ne , man ka hen shighe la je la ! — Rom . 2020-02-12 17:35:56,753 Example #2 2020-02-12 17:35:56,753 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 17:35:56,753 Raw hypothesis: ['Anyom', 'nga', 'kar', 'pue', 'yô', ',', 'Paulu', 'ngu', 'ken', 'tar', 'u', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 17:35:56,753 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 17:35:56,753 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 17:35:56,753 Hypothesis: Anyom nga kar pue yô , Paulu ngu ken tar u Masedonia man Timoteu ken Efese . 2020-02-12 17:35:56,753 Example #3 2020-02-12 17:35:56,753 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 17:35:56,753 Raw hypothesis: ['Alaghga', 'a', 'lu', 'sha', 'gbenda', 'u', 'or', 'nan', 'eren', 'kwagh', 'sha', 'inja', 'ga', 'yô', '.'] 2020-02-12 17:35:56,753 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 17:35:56,753 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 17:35:56,753 Hypothesis: Alaghga a lu sha gbenda u or nan eren kwagh sha inja ga yô . 2020-02-12 17:35:56,753 Validation result (greedy) at epoch 21, step 50000: bleu: 24.77, loss: 46006.5586, ppl: 4.7307, duration: 19.8037s 2020-02-12 17:36:06,617 Epoch 21 Step: 50100 Batch Loss: 1.655420 Tokens per Sec: 22164, Lr: 0.000300 2020-02-12 17:36:16,522 Epoch 21 Step: 50200 Batch Loss: 1.639711 Tokens per Sec: 22190, Lr: 0.000300 2020-02-12 17:36:26,537 Epoch 21 Step: 50300 Batch Loss: 1.775779 Tokens per Sec: 22033, Lr: 0.000300 2020-02-12 17:36:36,439 Epoch 21 Step: 50400 Batch Loss: 1.469706 Tokens per Sec: 22855, Lr: 0.000300 2020-02-12 17:36:46,393 Epoch 21 Step: 50500 Batch Loss: 1.781321 Tokens per Sec: 22853, Lr: 0.000300 2020-02-12 17:36:56,318 Epoch 21 Step: 50600 Batch Loss: 1.528186 Tokens per Sec: 21609, Lr: 0.000300 2020-02-12 17:37:06,258 Epoch 21 Step: 50700 Batch Loss: 1.691874 Tokens per Sec: 22093, Lr: 0.000300 2020-02-12 17:37:16,177 Epoch 21 Step: 50800 Batch Loss: 1.622573 Tokens per Sec: 22005, Lr: 0.000300 2020-02-12 17:37:26,109 Epoch 21 Step: 50900 Batch Loss: 1.594993 Tokens per Sec: 22278, Lr: 0.000300 2020-02-12 17:37:35,994 Epoch 21 Step: 51000 Batch Loss: 1.613080 Tokens per Sec: 21862, Lr: 0.000300 2020-02-12 17:37:54,656 Hooray! New best validation result [ppl]! 2020-02-12 17:37:54,656 Saving new checkpoint. 2020-02-12 17:37:54,844 Example #0 2020-02-12 17:37:54,844 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 17:37:54,844 Raw hypothesis: ['Er', 'Yehova', 'a', 'ver', 'ivese', 'i', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'tsung', 'vea', 'lu', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 17:37:54,844 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 17:37:54,844 Reference: 10 : ​ 6 - 9 . 2020-02-12 17:37:54,844 Hypothesis: Er Yehova a ver ivese i tsôron yô , gba hange hange u noov man kasev vea nôngo tsung vea lu a dooshima u ve lu a mi la , shi vea za hemen u lun a dooshima u a lu hen atô ve la . — Marku 10 : 6 - 9 . 2020-02-12 17:37:54,844 Example #1 2020-02-12 17:37:54,844 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 17:37:54,844 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'imba', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'hen', 'shighe', 'la', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 17:37:54,844 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 17:37:54,844 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 17:37:54,845 Hypothesis: Se kpa se fatyô u ‘ nengen ’ imba shighe u doon tsung ne , man ka hen shighe la je la ! — Rom . 2020-02-12 17:37:54,845 Example #2 2020-02-12 17:37:54,845 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 17:37:54,845 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', '.'] 2020-02-12 17:37:54,845 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 17:37:54,845 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 17:37:54,845 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu . 2020-02-12 17:37:54,845 Example #3 2020-02-12 17:37:54,845 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 17:37:54,845 Raw hypothesis: ['Alaghga', 'a', 'lu', 'u', 'or', 'nana', 'er', 'kwagh', 'sha', 'inja', 'ga', '.'] 2020-02-12 17:37:54,845 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 17:37:54,845 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 17:37:54,845 Hypothesis: Alaghga a lu u or nana er kwagh sha inja ga . 2020-02-12 17:37:54,845 Validation result (greedy) at epoch 21, step 51000: bleu: 24.90, loss: 45738.0195, ppl: 4.6879, duration: 18.8512s 2020-02-12 17:38:04,787 Epoch 21 Step: 51100 Batch Loss: 1.928896 Tokens per Sec: 22454, Lr: 0.000300 2020-02-12 17:38:14,723 Epoch 21 Step: 51200 Batch Loss: 1.500026 Tokens per Sec: 22642, Lr: 0.000300 2020-02-12 17:38:24,752 Epoch 21 Step: 51300 Batch Loss: 1.696017 Tokens per Sec: 22194, Lr: 0.000300 2020-02-12 17:38:34,639 Epoch 21 Step: 51400 Batch Loss: 1.668999 Tokens per Sec: 22089, Lr: 0.000300 2020-02-12 17:38:44,600 Epoch 21 Step: 51500 Batch Loss: 1.398925 Tokens per Sec: 22238, Lr: 0.000300 2020-02-12 17:38:54,623 Epoch 21 Step: 51600 Batch Loss: 1.552085 Tokens per Sec: 22608, Lr: 0.000300 2020-02-12 17:38:57,600 Epoch 21: total training loss 4001.43 2020-02-12 17:38:57,600 EPOCH 22 2020-02-12 17:39:04,843 Epoch 22 Step: 51700 Batch Loss: 1.772589 Tokens per Sec: 21140, Lr: 0.000300 2020-02-12 17:39:14,757 Epoch 22 Step: 51800 Batch Loss: 1.617656 Tokens per Sec: 22721, Lr: 0.000300 2020-02-12 17:39:24,745 Epoch 22 Step: 51900 Batch Loss: 1.723209 Tokens per Sec: 22303, Lr: 0.000300 2020-02-12 17:39:34,599 Epoch 22 Step: 52000 Batch Loss: 1.459682 Tokens per Sec: 22129, Lr: 0.000300 2020-02-12 17:39:52,655 Example #0 2020-02-12 17:39:52,655 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 17:39:52,655 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'doo', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'tsung', 'vea', 'lu', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'sha', 'dooshima', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 17:39:52,655 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 17:39:52,656 Reference: 10 : ​ 6 - 9 . 2020-02-12 17:39:52,656 Hypothesis: Er ivese i Yehova i lu kwagh u tsôron yô , doo u noov man kasev vea nôngo tsung vea lu a dooshima u ve lu a mi sha dooshima la , shi vea za hemen u lun a dooshima u a lu a mi la . — Marku 10 : 6 - 9 . 2020-02-12 17:39:52,656 Example #1 2020-02-12 17:39:52,656 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 17:39:52,656 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'kpilighyol', 'ne', ',', 'man', 'ka', 'hen', 'shighe', 'la', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 17:39:52,656 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 17:39:52,656 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 17:39:52,656 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u kpilighyol ne , man ka hen shighe la je la ! — Rom . 2020-02-12 17:39:52,656 Example #2 2020-02-12 17:39:52,656 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 17:39:52,656 Raw hypothesis: ['Anyom', 'nga', 'kar', 'pue', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 17:39:52,656 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 17:39:52,656 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 17:39:52,656 Hypothesis: Anyom nga kar pue yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 17:39:52,656 Example #3 2020-02-12 17:39:52,657 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 17:39:52,657 Raw hypothesis: ['Alaghga', 'a', 'lu', 'kwagh', 'u', 'or', 'nana', 'er', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 17:39:52,657 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 17:39:52,657 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 17:39:52,657 Hypothesis: Alaghga a lu kwagh u or nana er sha gbenda u vough ga yô . 2020-02-12 17:39:52,657 Validation result (greedy) at epoch 22, step 52000: bleu: 24.00, loss: 45752.3438, ppl: 4.6902, duration: 18.0572s 2020-02-12 17:40:02,579 Epoch 22 Step: 52100 Batch Loss: 1.620099 Tokens per Sec: 22036, Lr: 0.000300 2020-02-12 17:40:12,508 Epoch 22 Step: 52200 Batch Loss: 1.498319 Tokens per Sec: 23034, Lr: 0.000300 2020-02-12 17:40:22,392 Epoch 22 Step: 52300 Batch Loss: 1.437057 Tokens per Sec: 22007, Lr: 0.000300 2020-02-12 17:40:32,403 Epoch 22 Step: 52400 Batch Loss: 1.926183 Tokens per Sec: 22309, Lr: 0.000300 2020-02-12 17:40:42,282 Epoch 22 Step: 52500 Batch Loss: 1.597002 Tokens per Sec: 22219, Lr: 0.000300 2020-02-12 17:40:52,247 Epoch 22 Step: 52600 Batch Loss: 1.793759 Tokens per Sec: 22097, Lr: 0.000300 2020-02-12 17:41:02,173 Epoch 22 Step: 52700 Batch Loss: 1.272365 Tokens per Sec: 22586, Lr: 0.000300 2020-02-12 17:41:12,267 Epoch 22 Step: 52800 Batch Loss: 1.542842 Tokens per Sec: 22351, Lr: 0.000300 2020-02-12 17:41:22,402 Epoch 22 Step: 52900 Batch Loss: 1.864567 Tokens per Sec: 22087, Lr: 0.000300 2020-02-12 17:41:32,491 Epoch 22 Step: 53000 Batch Loss: 1.595312 Tokens per Sec: 21344, Lr: 0.000300 2020-02-12 17:41:50,893 Hooray! New best validation result [ppl]! 2020-02-12 17:41:50,893 Saving new checkpoint. 2020-02-12 17:41:51,098 Example #0 2020-02-12 17:41:51,098 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 17:41:51,098 Raw hypothesis: ['Er', 'Yehova', 'a', 'ver', 'ivese', 'i', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'eren', 'kwagh', 'sha', 'dooshima', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'mimi', 'sha', 'dooshima', 'u', 'a', 'lu', 'seer', 'a', 'seer', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 17:41:51,098 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 17:41:51,099 Reference: 10 : ​ 6 - 9 . 2020-02-12 17:41:51,099 Hypothesis: Er Yehova a ver ivese i tsôron yô , gba hange hange u noov man kasev vea eren kwagh sha dooshima shi vea za hemen u lun a dooshima u mimi sha dooshima u a lu seer a seer la . — Marku 10 : 6 - 9 . 2020-02-12 17:41:51,099 Example #1 2020-02-12 17:41:51,099 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 17:41:51,099 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'imba', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'kwagh', 'u', 'a', 'lu', 'ikyua', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 17:41:51,099 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 17:41:51,099 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 17:41:51,099 Hypothesis: Se kpa se fatyô u ‘ nengen ’ imba shighe u doon tsung ne , man ka kwagh u a lu ikyua je la ! — Rom . 2020-02-12 17:41:51,099 Example #2 2020-02-12 17:41:51,099 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 17:41:51,099 Raw hypothesis: ['Anyom', 'nga', 'kar', 'pue', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 17:41:51,099 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 17:41:51,099 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 17:41:51,099 Hypothesis: Anyom nga kar pue yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 17:41:51,100 Example #3 2020-02-12 17:41:51,100 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 17:41:51,100 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'inja', 'ga', '.'] 2020-02-12 17:41:51,100 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 17:41:51,100 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 17:41:51,100 Hypothesis: Alaghga or nana lu eren kwagh sha inja ga . 2020-02-12 17:41:51,100 Validation result (greedy) at epoch 22, step 53000: bleu: 24.75, loss: 45526.4297, ppl: 4.6546, duration: 18.6082s 2020-02-12 17:42:01,191 Epoch 22 Step: 53100 Batch Loss: 1.735585 Tokens per Sec: 22267, Lr: 0.000300 2020-02-12 17:42:11,271 Epoch 22 Step: 53200 Batch Loss: 1.616482 Tokens per Sec: 21461, Lr: 0.000300 2020-02-12 17:42:21,408 Epoch 22 Step: 53300 Batch Loss: 1.763771 Tokens per Sec: 21460, Lr: 0.000300 2020-02-12 17:42:31,417 Epoch 22 Step: 53400 Batch Loss: 1.682316 Tokens per Sec: 21922, Lr: 0.000300 2020-02-12 17:42:41,387 Epoch 22 Step: 53500 Batch Loss: 1.623947 Tokens per Sec: 22414, Lr: 0.000300 2020-02-12 17:42:51,340 Epoch 22 Step: 53600 Batch Loss: 1.663797 Tokens per Sec: 22639, Lr: 0.000300 2020-02-12 17:43:01,235 Epoch 22 Step: 53700 Batch Loss: 1.489120 Tokens per Sec: 22257, Lr: 0.000300 2020-02-12 17:43:11,193 Epoch 22 Step: 53800 Batch Loss: 1.619790 Tokens per Sec: 22105, Lr: 0.000300 2020-02-12 17:43:21,083 Epoch 22 Step: 53900 Batch Loss: 1.598196 Tokens per Sec: 22197, Lr: 0.000300 2020-02-12 17:43:30,936 Epoch 22 Step: 54000 Batch Loss: 1.607882 Tokens per Sec: 22312, Lr: 0.000300 2020-02-12 17:43:49,878 Hooray! New best validation result [ppl]! 2020-02-12 17:43:49,878 Saving new checkpoint. 2020-02-12 17:43:50,065 Example #0 2020-02-12 17:43:50,066 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 17:43:50,066 Raw hypothesis: ['Er', 'i', 'ver', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'eren', 'kwagh', 'sha', 'dooshima', 've', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'sha', 'kwagh', 'u', 'dooshima', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 17:43:50,066 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 17:43:50,066 Reference: 10 : ​ 6 - 9 . 2020-02-12 17:43:50,066 Hypothesis: Er i ver ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea eren kwagh sha dooshima ve , shi vea za hemen u lun a dooshima u a lu a mi sha kwagh u dooshima la . — Marku 10 : 6 - 9 . 2020-02-12 17:43:50,066 Example #1 2020-02-12 17:43:50,066 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 17:43:50,066 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'imba', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'doon', 'tsung', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 17:43:50,066 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 17:43:50,066 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 17:43:50,066 Hypothesis: Se kpa se fatyô u ‘ nengen ’ imba shighe u doon tsung ne , man ka shighe u doon tsung je la ! — Rom . 2020-02-12 17:43:50,066 Example #2 2020-02-12 17:43:50,066 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 17:43:50,066 Raw hypothesis: ['Anyom', 'nga', 'kar', 'pue', 'yô', ',', 'Paulu', 'lu', 'ken', 'tar', 'u', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 17:43:50,067 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 17:43:50,067 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 17:43:50,067 Hypothesis: Anyom nga kar pue yô , Paulu lu ken tar u Masedonia man Timoteu ken Efese . 2020-02-12 17:43:50,067 Example #3 2020-02-12 17:43:50,067 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 17:43:50,067 Raw hypothesis: ['Alaghga', 'a', 'lu', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'inja', 'ga', 'la', '.'] 2020-02-12 17:43:50,067 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 17:43:50,067 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 17:43:50,067 Hypothesis: Alaghga a lu or u nan lu eren kwagh sha inja ga la . 2020-02-12 17:43:50,067 Validation result (greedy) at epoch 22, step 54000: bleu: 24.68, loss: 45278.1523, ppl: 4.6157, duration: 19.1309s 2020-02-12 17:43:58,658 Epoch 22: total training loss 3981.50 2020-02-12 17:43:58,658 EPOCH 23 2020-02-12 17:44:00,213 Epoch 23 Step: 54100 Batch Loss: 1.778395 Tokens per Sec: 18414, Lr: 0.000300 2020-02-12 17:44:10,129 Epoch 23 Step: 54200 Batch Loss: 1.823727 Tokens per Sec: 22199, Lr: 0.000300 2020-02-12 17:44:20,124 Epoch 23 Step: 54300 Batch Loss: 1.714084 Tokens per Sec: 22124, Lr: 0.000300 2020-02-12 17:44:30,180 Epoch 23 Step: 54400 Batch Loss: 1.776259 Tokens per Sec: 21936, Lr: 0.000300 2020-02-12 17:44:40,212 Epoch 23 Step: 54500 Batch Loss: 1.771630 Tokens per Sec: 22107, Lr: 0.000300 2020-02-12 17:44:50,362 Epoch 23 Step: 54600 Batch Loss: 1.512814 Tokens per Sec: 21790, Lr: 0.000300 2020-02-12 17:45:00,211 Epoch 23 Step: 54700 Batch Loss: 1.489588 Tokens per Sec: 22399, Lr: 0.000300 2020-02-12 17:45:10,116 Epoch 23 Step: 54800 Batch Loss: 1.749939 Tokens per Sec: 22225, Lr: 0.000300 2020-02-12 17:45:20,170 Epoch 23 Step: 54900 Batch Loss: 1.765753 Tokens per Sec: 22497, Lr: 0.000300 2020-02-12 17:45:30,023 Epoch 23 Step: 55000 Batch Loss: 1.529017 Tokens per Sec: 22112, Lr: 0.000300 2020-02-12 17:45:49,033 Example #0 2020-02-12 17:45:49,033 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 17:45:49,033 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'tsung', 'vea', 'kura', 'dooshima', 've', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'sha', 'dooshima', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 17:45:49,033 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 17:45:49,033 Reference: 10 : ​ 6 - 9 . 2020-02-12 17:45:49,033 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo tsung vea kura dooshima ve u a lu hen atô ve la , shi vea za hemen u lun a dooshima u a lu a mi sha dooshima la . — Marku 10 : 6 - 9 . 2020-02-12 17:45:49,033 Example #1 2020-02-12 17:45:49,033 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 17:45:49,034 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'imba', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'hen', 'shighe', 'la', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 17:45:49,034 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 17:45:49,034 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 17:45:49,034 Hypothesis: Se kpa se fatyô u ‘ nengen ’ imba shighe u doon tsung ne , man ka hen shighe la je la ! — Rom . 2020-02-12 17:45:49,034 Example #2 2020-02-12 17:45:49,034 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 17:45:49,034 Raw hypothesis: ['Anyom', 'nga', 'kar', 'pue', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 17:45:49,034 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 17:45:49,034 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 17:45:49,034 Hypothesis: Anyom nga kar pue yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 17:45:49,034 Example #3 2020-02-12 17:45:49,034 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 17:45:49,034 Raw hypothesis: ['Alaghga', 'a', 'lu', 'inja', 'er', 'or', 'ngu', 'eren', 'kwagh', 'sha', 'inja', 'ga', 'nahan', '.'] 2020-02-12 17:45:49,035 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 17:45:49,035 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 17:45:49,035 Hypothesis: Alaghga a lu inja er or ngu eren kwagh sha inja ga nahan . 2020-02-12 17:45:49,035 Validation result (greedy) at epoch 23, step 55000: bleu: 24.65, loss: 45355.6992, ppl: 4.6278, duration: 19.0111s 2020-02-12 17:45:59,146 Epoch 23 Step: 55100 Batch Loss: 1.749363 Tokens per Sec: 21467, Lr: 0.000300 2020-02-12 17:46:09,273 Epoch 23 Step: 55200 Batch Loss: 1.484830 Tokens per Sec: 21644, Lr: 0.000300 2020-02-12 17:46:19,353 Epoch 23 Step: 55300 Batch Loss: 1.692046 Tokens per Sec: 21685, Lr: 0.000300 2020-02-12 17:46:29,446 Epoch 23 Step: 55400 Batch Loss: 1.548436 Tokens per Sec: 21393, Lr: 0.000300 2020-02-12 17:46:39,560 Epoch 23 Step: 55500 Batch Loss: 1.883074 Tokens per Sec: 21931, Lr: 0.000300 2020-02-12 17:46:49,711 Epoch 23 Step: 55600 Batch Loss: 1.489641 Tokens per Sec: 22161, Lr: 0.000300 2020-02-12 17:46:59,628 Epoch 23 Step: 55700 Batch Loss: 1.780797 Tokens per Sec: 21625, Lr: 0.000300 2020-02-12 17:47:09,668 Epoch 23 Step: 55800 Batch Loss: 1.770255 Tokens per Sec: 22375, Lr: 0.000300 2020-02-12 17:47:19,667 Epoch 23 Step: 55900 Batch Loss: 1.811267 Tokens per Sec: 23154, Lr: 0.000300 2020-02-12 17:47:29,807 Epoch 23 Step: 56000 Batch Loss: 1.493290 Tokens per Sec: 21064, Lr: 0.000300 2020-02-12 17:47:49,597 Example #0 2020-02-12 17:47:49,597 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 17:47:49,597 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'doo', 'u', 'noov', 'man', 'kasev', 'vea', 'eren', 'kwagh', 'sha', 'dooshima', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 17:47:49,597 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 17:47:49,597 Reference: 10 : ​ 6 - 9 . 2020-02-12 17:47:49,598 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , doo u noov man kasev vea eren kwagh sha dooshima , shi vea za hemen u lun a dooshima u a lu hen atô ve la . — Marku 10 : 6 - 9 . 2020-02-12 17:47:49,598 Example #1 2020-02-12 17:47:49,598 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 17:47:49,598 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'imba', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'a', 'lu', 'ikyua', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 17:47:49,598 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 17:47:49,598 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 17:47:49,598 Hypothesis: Se kpa se fatyô u ‘ nengen ’ imba shighe u doon tsung ne , man ka shighe u a lu ikyua je la ! — Rom . 2020-02-12 17:47:49,598 Example #2 2020-02-12 17:47:49,598 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 17:47:49,598 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'gar', 'u', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', '.'] 2020-02-12 17:47:49,598 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 17:47:49,598 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 17:47:49,599 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken gar u Masedonia man Timoteu . 2020-02-12 17:47:49,599 Example #3 2020-02-12 17:47:49,599 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 17:47:49,599 Raw hypothesis: ['Alaghga', 'a', 'lu', 'u', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 17:47:49,599 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 17:47:49,599 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 17:47:49,599 Hypothesis: Alaghga a lu u or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 17:47:49,599 Validation result (greedy) at epoch 23, step 56000: bleu: 25.10, loss: 45490.6133, ppl: 4.6489, duration: 19.7918s 2020-02-12 17:47:59,574 Epoch 23 Step: 56100 Batch Loss: 1.637856 Tokens per Sec: 22497, Lr: 0.000300 2020-02-12 17:48:09,625 Epoch 23 Step: 56200 Batch Loss: 1.865298 Tokens per Sec: 22097, Lr: 0.000300 2020-02-12 17:48:19,832 Epoch 23 Step: 56300 Batch Loss: 1.460898 Tokens per Sec: 21439, Lr: 0.000300 2020-02-12 17:48:30,046 Epoch 23 Step: 56400 Batch Loss: 1.146451 Tokens per Sec: 21982, Lr: 0.000300 2020-02-12 17:48:40,108 Epoch 23 Step: 56500 Batch Loss: 1.336150 Tokens per Sec: 21597, Lr: 0.000300 2020-02-12 17:48:44,957 Epoch 23: total training loss 3955.45 2020-02-12 17:48:44,957 EPOCH 24 2020-02-12 17:48:50,541 Epoch 24 Step: 56600 Batch Loss: 1.687715 Tokens per Sec: 21734, Lr: 0.000300 2020-02-12 17:49:00,481 Epoch 24 Step: 56700 Batch Loss: 1.656443 Tokens per Sec: 22469, Lr: 0.000300 2020-02-12 17:49:10,669 Epoch 24 Step: 56800 Batch Loss: 1.551410 Tokens per Sec: 22112, Lr: 0.000300 2020-02-12 17:49:20,801 Epoch 24 Step: 56900 Batch Loss: 1.403160 Tokens per Sec: 21329, Lr: 0.000300 2020-02-12 17:49:30,755 Epoch 24 Step: 57000 Batch Loss: 1.746896 Tokens per Sec: 21962, Lr: 0.000300 2020-02-12 17:49:49,871 Hooray! New best validation result [ppl]! 2020-02-12 17:49:49,871 Saving new checkpoint. 2020-02-12 17:49:50,073 Example #0 2020-02-12 17:49:50,073 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 17:49:50,073 Raw hypothesis: ['Er', 'Yehova', 'a', 'ver', 'ivese', 'i', 'tsôron', 'yô', ',', 'doo', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'sha', 'afatyô', 've', 'cii', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 17:49:50,073 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 17:49:50,073 Reference: 10 : ​ 6 - 9 . 2020-02-12 17:49:50,073 Hypothesis: Er Yehova a ver ivese i tsôron yô , doo u noov man kasev vea nôngo sha afatyô ve cii vea lu a dooshima u a lu hen atô ve la , shi vea za hemen u lun a dooshima u a lu hen atô ve la . — Marku 10 : 6 - 9 . 2020-02-12 17:49:50,073 Example #1 2020-02-12 17:49:50,073 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 17:49:50,073 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'imba', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'doon', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 17:49:50,073 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 17:49:50,073 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 17:49:50,074 Hypothesis: Se kpa se fatyô u ‘ nengen ’ imba shighe u doon tsung ne , man ka shighe u doon je la ! — Rom . 2020-02-12 17:49:50,074 Example #2 2020-02-12 17:49:50,074 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 17:49:50,074 Raw hypothesis: ['Anyom', 'nga', 'kar', 'pue', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 17:49:50,074 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 17:49:50,074 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 17:49:50,074 Hypothesis: Anyom nga kar pue yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 17:49:50,074 Example #3 2020-02-12 17:49:50,074 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 17:49:50,074 Raw hypothesis: ['Alaghga', 'a', 'lu', 'inja', 'er', 'or', 'ngu', 'eren', 'kwagh', 'sha', 'inja', 'ga', 'nahan', '.'] 2020-02-12 17:49:50,074 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 17:49:50,074 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 17:49:50,074 Hypothesis: Alaghga a lu inja er or ngu eren kwagh sha inja ga nahan . 2020-02-12 17:49:50,074 Validation result (greedy) at epoch 24, step 57000: bleu: 25.22, loss: 45200.4805, ppl: 4.6036, duration: 19.3191s 2020-02-12 17:50:00,028 Epoch 24 Step: 57100 Batch Loss: 1.525229 Tokens per Sec: 21687, Lr: 0.000300 2020-02-12 17:50:09,925 Epoch 24 Step: 57200 Batch Loss: 1.442598 Tokens per Sec: 22190, Lr: 0.000300 2020-02-12 17:50:19,865 Epoch 24 Step: 57300 Batch Loss: 1.288021 Tokens per Sec: 22060, Lr: 0.000300 2020-02-12 17:50:29,754 Epoch 24 Step: 57400 Batch Loss: 1.621453 Tokens per Sec: 22618, Lr: 0.000300 2020-02-12 17:50:39,613 Epoch 24 Step: 57500 Batch Loss: 1.562569 Tokens per Sec: 22025, Lr: 0.000300 2020-02-12 17:50:49,594 Epoch 24 Step: 57600 Batch Loss: 1.553372 Tokens per Sec: 22142, Lr: 0.000300 2020-02-12 17:50:59,615 Epoch 24 Step: 57700 Batch Loss: 1.674770 Tokens per Sec: 22229, Lr: 0.000300 2020-02-12 17:51:09,608 Epoch 24 Step: 57800 Batch Loss: 1.513857 Tokens per Sec: 22287, Lr: 0.000300 2020-02-12 17:51:19,660 Epoch 24 Step: 57900 Batch Loss: 1.618932 Tokens per Sec: 21626, Lr: 0.000300 2020-02-12 17:51:29,770 Epoch 24 Step: 58000 Batch Loss: 1.554007 Tokens per Sec: 21367, Lr: 0.000300 2020-02-12 17:51:49,129 Hooray! New best validation result [ppl]! 2020-02-12 17:51:49,129 Saving new checkpoint. 2020-02-12 17:51:49,320 Example #0 2020-02-12 17:51:49,320 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 17:51:49,320 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'i', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'sha', 'kwagh', 'u', 'dooshima', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'sha', 'kwagh', 'u', 'dooshima', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 17:51:49,320 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 17:51:49,320 Reference: 10 : ​ 6 - 9 . 2020-02-12 17:51:49,320 Hypothesis: Er ivese i Yehova i ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u ve lu a mi sha kwagh u dooshima la , shi vea za hemen u lun a dooshima u a lu a mi sha kwagh u dooshima la . — Marku 10 : 6 - 9 . 2020-02-12 17:51:49,320 Example #1 2020-02-12 17:51:49,320 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 17:51:49,320 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'imba', 'shighe', 'i', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'doon', 'tsung', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 17:51:49,320 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 17:51:49,321 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 17:51:49,321 Hypothesis: Se kpa se fatyô u ‘ nengen ’ imba shighe i doon tsung ne , man ka shighe u doon tsung je la ! — Rom . 2020-02-12 17:51:49,321 Example #2 2020-02-12 17:51:49,321 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 17:51:49,321 Raw hypothesis: ['Anyom', 'nga', 'kar', 'pue', 'yô', ',', 'Paulu', 'lu', 'ken', 'tar', 'u', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 17:51:49,321 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 17:51:49,321 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 17:51:49,321 Hypothesis: Anyom nga kar pue yô , Paulu lu ken tar u Masedonia man Timoteu ken Efese . 2020-02-12 17:51:49,321 Example #3 2020-02-12 17:51:49,321 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 17:51:49,321 Raw hypothesis: ['Alaghga', 'a', 'lu', 'sha', 'gbenda', 'u', 'or', 'nan', 'lu', 'a', 'inja', 'ga', 'yô', '.'] 2020-02-12 17:51:49,321 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 17:51:49,321 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 17:51:49,321 Hypothesis: Alaghga a lu sha gbenda u or nan lu a inja ga yô . 2020-02-12 17:51:49,321 Validation result (greedy) at epoch 24, step 58000: bleu: 25.30, loss: 44995.5547, ppl: 4.5718, duration: 19.5509s 2020-02-12 17:51:59,469 Epoch 24 Step: 58100 Batch Loss: 1.709372 Tokens per Sec: 21885, Lr: 0.000300 2020-02-12 17:52:09,586 Epoch 24 Step: 58200 Batch Loss: 1.485827 Tokens per Sec: 21601, Lr: 0.000300 2020-02-12 17:52:19,713 Epoch 24 Step: 58300 Batch Loss: 1.989177 Tokens per Sec: 21577, Lr: 0.000300 2020-02-12 17:52:29,856 Epoch 24 Step: 58400 Batch Loss: 1.345109 Tokens per Sec: 21960, Lr: 0.000300 2020-02-12 17:52:39,974 Epoch 24 Step: 58500 Batch Loss: 1.654352 Tokens per Sec: 22383, Lr: 0.000300 2020-02-12 17:52:50,157 Epoch 24 Step: 58600 Batch Loss: 1.736848 Tokens per Sec: 21951, Lr: 0.000300 2020-02-12 17:53:00,395 Epoch 24 Step: 58700 Batch Loss: 1.513085 Tokens per Sec: 20864, Lr: 0.000300 2020-02-12 17:53:10,402 Epoch 24 Step: 58800 Batch Loss: 1.369668 Tokens per Sec: 22031, Lr: 0.000300 2020-02-12 17:53:20,334 Epoch 24 Step: 58900 Batch Loss: 1.778354 Tokens per Sec: 22127, Lr: 0.000300 2020-02-12 17:53:30,307 Epoch 24 Step: 59000 Batch Loss: 1.571671 Tokens per Sec: 22080, Lr: 0.000300 2020-02-12 17:53:48,726 Hooray! New best validation result [ppl]! 2020-02-12 17:53:48,726 Saving new checkpoint. 2020-02-12 17:53:48,916 Example #0 2020-02-12 17:53:48,916 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 17:53:48,916 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'doo', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'kura', 'ayol', 'a', 've', 'sha', 'er', 'dooshima', 've', 'una', 'seer', 'taver', 'yô', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 17:53:48,916 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 17:53:48,916 Reference: 10 : ​ 6 - 9 . 2020-02-12 17:53:48,916 Hypothesis: Er ivese i Yehova i lu kwagh u tsôron yô , doo u noov man kasev vea nôngo kpoghuloo vea kura ayol a ve sha er dooshima ve una seer taver yô . — Marku 10 : 6 - 9 . 2020-02-12 17:53:48,916 Example #1 2020-02-12 17:53:48,916 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 17:53:48,916 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'hen', 'shighe', 'la', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 17:53:48,916 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 17:53:48,916 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 17:53:48,917 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u doon tsung ne , man ka hen shighe la je la ! — Rom . 2020-02-12 17:53:48,917 Example #2 2020-02-12 17:53:48,917 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 17:53:48,917 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 17:53:48,917 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 17:53:48,917 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 17:53:48,917 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 17:53:48,917 Example #3 2020-02-12 17:53:48,917 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 17:53:48,917 Raw hypothesis: ['Alaghga', 'a', 'lu', 'inja', 'er', 'or', 'ngu', 'eren', 'kwagh', 'sha', 'inja', 'ga', 'nahan', '.'] 2020-02-12 17:53:48,917 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 17:53:48,917 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 17:53:48,917 Hypothesis: Alaghga a lu inja er or ngu eren kwagh sha inja ga nahan . 2020-02-12 17:53:48,917 Validation result (greedy) at epoch 24, step 59000: bleu: 25.46, loss: 44955.9961, ppl: 4.5657, duration: 18.6104s 2020-02-12 17:53:50,207 Epoch 24: total training loss 3936.89 2020-02-12 17:53:50,207 EPOCH 25 2020-02-12 17:53:59,083 Epoch 25 Step: 59100 Batch Loss: 1.634622 Tokens per Sec: 22183, Lr: 0.000300 2020-02-12 17:54:09,165 Epoch 25 Step: 59200 Batch Loss: 1.739247 Tokens per Sec: 21693, Lr: 0.000300 2020-02-12 17:54:19,316 Epoch 25 Step: 59300 Batch Loss: 1.341596 Tokens per Sec: 21416, Lr: 0.000300 2020-02-12 17:54:29,324 Epoch 25 Step: 59400 Batch Loss: 1.790190 Tokens per Sec: 22408, Lr: 0.000300 2020-02-12 17:54:39,219 Epoch 25 Step: 59500 Batch Loss: 1.507016 Tokens per Sec: 22334, Lr: 0.000300 2020-02-12 17:54:49,189 Epoch 25 Step: 59600 Batch Loss: 1.599367 Tokens per Sec: 22329, Lr: 0.000300 2020-02-12 17:54:59,172 Epoch 25 Step: 59700 Batch Loss: 1.695844 Tokens per Sec: 22224, Lr: 0.000300 2020-02-12 17:55:09,456 Epoch 25 Step: 59800 Batch Loss: 1.547237 Tokens per Sec: 21382, Lr: 0.000300 2020-02-12 17:55:19,584 Epoch 25 Step: 59900 Batch Loss: 1.655974 Tokens per Sec: 21733, Lr: 0.000300 2020-02-12 17:55:29,671 Epoch 25 Step: 60000 Batch Loss: 1.740964 Tokens per Sec: 22243, Lr: 0.000300 2020-02-12 17:55:48,439 Hooray! New best validation result [ppl]! 2020-02-12 17:55:48,440 Saving new checkpoint. 2020-02-12 17:55:48,631 Example #0 2020-02-12 17:55:48,631 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 17:55:48,631 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'i', 'lu', 'kwagh', 'u', 'vesen', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'eren', 'kwagh', 'sha', 'inja', 'sha', 'inja', 'sha', 'u', 'tesen', 'dooshima', 've', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'ken', 'mzough', 'u', 'dooshima', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 17:55:48,631 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 17:55:48,631 Reference: 10 : ​ 6 - 9 . 2020-02-12 17:55:48,631 Hypothesis: Er ivese i Yehova i lu kwagh u vesen yô , gba hange hange u noov man kasev vea eren kwagh sha inja sha inja sha u tesen dooshima ve shi vea za hemen u lun ken mzough u dooshima la . — Marku 10 : 6 - 9 . 2020-02-12 17:55:48,631 Example #1 2020-02-12 17:55:48,631 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 17:55:48,632 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'doon', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 17:55:48,632 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 17:55:48,632 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 17:55:48,632 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u doon tsung ne , man ka shighe u doon je la ! — Rom . 2020-02-12 17:55:48,632 Example #2 2020-02-12 17:55:48,632 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 17:55:48,632 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'gar', 'u', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', '.'] 2020-02-12 17:55:48,632 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 17:55:48,632 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 17:55:48,632 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken gar u Masedonia man Timoteu . 2020-02-12 17:55:48,632 Example #3 2020-02-12 17:55:48,632 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 17:55:48,632 Raw hypothesis: ['Alaghga', 'or', 'a', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 17:55:48,632 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 17:55:48,632 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 17:55:48,632 Hypothesis: Alaghga or a lu eren kwagh sha gbenda u vough ga . 2020-02-12 17:55:48,633 Validation result (greedy) at epoch 25, step 60000: bleu: 25.21, loss: 44820.8516, ppl: 4.5449, duration: 18.9614s 2020-02-12 17:55:58,628 Epoch 25 Step: 60100 Batch Loss: 1.556117 Tokens per Sec: 22396, Lr: 0.000300 2020-02-12 17:56:08,549 Epoch 25 Step: 60200 Batch Loss: 1.435483 Tokens per Sec: 22393, Lr: 0.000300 2020-02-12 17:56:18,455 Epoch 25 Step: 60300 Batch Loss: 1.532294 Tokens per Sec: 22111, Lr: 0.000300 2020-02-12 17:56:28,341 Epoch 25 Step: 60400 Batch Loss: 1.790889 Tokens per Sec: 22252, Lr: 0.000300 2020-02-12 17:56:38,227 Epoch 25 Step: 60500 Batch Loss: 1.527169 Tokens per Sec: 22305, Lr: 0.000300 2020-02-12 17:56:48,170 Epoch 25 Step: 60600 Batch Loss: 1.493572 Tokens per Sec: 22785, Lr: 0.000300 2020-02-12 17:56:58,131 Epoch 25 Step: 60700 Batch Loss: 1.356093 Tokens per Sec: 22259, Lr: 0.000300 2020-02-12 17:57:08,096 Epoch 25 Step: 60800 Batch Loss: 1.618109 Tokens per Sec: 22001, Lr: 0.000300 2020-02-12 17:57:18,036 Epoch 25 Step: 60900 Batch Loss: 1.624931 Tokens per Sec: 22428, Lr: 0.000300 2020-02-12 17:57:28,191 Epoch 25 Step: 61000 Batch Loss: 1.683243 Tokens per Sec: 22334, Lr: 0.000300 2020-02-12 17:57:47,907 Hooray! New best validation result [ppl]! 2020-02-12 17:57:47,907 Saving new checkpoint. 2020-02-12 17:57:48,095 Example #0 2020-02-12 17:57:48,096 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 17:57:48,096 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'kuran', 'atindi', 'a', 've', 'a', 'dooshima', 'la', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'seer', 'a', 'seer', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 17:57:48,096 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 17:57:48,096 Reference: 10 : ​ 6 - 9 . 2020-02-12 17:57:48,096 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea kuran atindi a ve a dooshima la shi vea za hemen u lun a dooshima u a lu seer a seer la . — Marku 10 : 6 - 9 . 2020-02-12 17:57:48,096 Example #1 2020-02-12 17:57:48,096 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 17:57:48,096 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'a', 'lu', 'ikyua', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 17:57:48,096 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 17:57:48,096 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 17:57:48,096 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u doon tsung ne , man ka shighe u a lu ikyua je la ! — Rom . 2020-02-12 17:57:48,096 Example #2 2020-02-12 17:57:48,096 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 17:57:48,097 Raw hypothesis: ['Anyom', 'nga', 'kar', 'pue', 'yô', ',', 'Paulu', 'lu', 'ken', 'gar', 'u', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 17:57:48,097 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 17:57:48,097 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 17:57:48,097 Hypothesis: Anyom nga kar pue yô , Paulu lu ken gar u Masedonia man Timoteu ken Efese . 2020-02-12 17:57:48,097 Example #3 2020-02-12 17:57:48,097 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 17:57:48,097 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 17:57:48,097 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 17:57:48,097 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 17:57:48,097 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 17:57:48,097 Validation result (greedy) at epoch 25, step 61000: bleu: 25.55, loss: 44636.4297, ppl: 4.5167, duration: 19.9060s 2020-02-12 17:57:58,201 Epoch 25 Step: 61100 Batch Loss: 1.295469 Tokens per Sec: 21274, Lr: 0.000300 2020-02-12 17:58:08,331 Epoch 25 Step: 61200 Batch Loss: 1.570902 Tokens per Sec: 21674, Lr: 0.000300 2020-02-12 17:58:18,412 Epoch 25 Step: 61300 Batch Loss: 1.705322 Tokens per Sec: 21730, Lr: 0.000300 2020-02-12 17:58:28,336 Epoch 25 Step: 61400 Batch Loss: 1.815144 Tokens per Sec: 22169, Lr: 0.000300 2020-02-12 17:58:35,362 Epoch 25: total training loss 3896.86 2020-02-12 17:58:35,362 EPOCH 26 2020-02-12 17:58:38,517 Epoch 26 Step: 61500 Batch Loss: 1.476855 Tokens per Sec: 20573, Lr: 0.000300 2020-02-12 17:58:48,521 Epoch 26 Step: 61600 Batch Loss: 1.359429 Tokens per Sec: 22378, Lr: 0.000300 2020-02-12 17:58:58,475 Epoch 26 Step: 61700 Batch Loss: 1.735080 Tokens per Sec: 22423, Lr: 0.000300 2020-02-12 17:59:08,391 Epoch 26 Step: 61800 Batch Loss: 1.506324 Tokens per Sec: 21819, Lr: 0.000300 2020-02-12 17:59:18,404 Epoch 26 Step: 61900 Batch Loss: 1.664138 Tokens per Sec: 21684, Lr: 0.000300 2020-02-12 17:59:28,346 Epoch 26 Step: 62000 Batch Loss: 1.762046 Tokens per Sec: 22158, Lr: 0.000300 2020-02-12 17:59:47,553 Example #0 2020-02-12 17:59:47,553 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 17:59:47,553 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'i', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'seer', 'a', 'seer', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 17:59:47,554 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 17:59:47,554 Reference: 10 : ​ 6 - 9 . 2020-02-12 17:59:47,554 Hypothesis: Er ivese i Yehova i ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u ve lu a mi la , shi vea za hemen u lun a dooshima u a lu seer a seer la . — Marku 10 : 6 - 9 . 2020-02-12 17:59:47,554 Example #1 2020-02-12 17:59:47,554 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 17:59:47,554 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'doon', 'tsung', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 17:59:47,554 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 17:59:47,554 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 17:59:47,554 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u doon tsung ne , man ka shighe u doon tsung je la ! — Rom . 2020-02-12 17:59:47,554 Example #2 2020-02-12 17:59:47,554 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 17:59:47,554 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'gar', 'u', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 17:59:47,554 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 17:59:47,554 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 17:59:47,554 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken gar u Masedonia man Timoteu ken Efese . 2020-02-12 17:59:47,555 Example #3 2020-02-12 17:59:47,555 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 17:59:47,555 Raw hypothesis: ['Alaghga', 'or', 'a', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 17:59:47,555 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 17:59:47,555 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 17:59:47,555 Hypothesis: Alaghga or a lu eren kwagh sha gbenda u vough ga . 2020-02-12 17:59:47,555 Validation result (greedy) at epoch 26, step 62000: bleu: 25.27, loss: 44655.5625, ppl: 4.5196, duration: 19.2080s 2020-02-12 17:59:57,420 Epoch 26 Step: 62100 Batch Loss: 1.538173 Tokens per Sec: 22215, Lr: 0.000300 2020-02-12 18:00:07,278 Epoch 26 Step: 62200 Batch Loss: 1.745478 Tokens per Sec: 22920, Lr: 0.000300 2020-02-12 18:00:17,139 Epoch 26 Step: 62300 Batch Loss: 1.611246 Tokens per Sec: 22182, Lr: 0.000300 2020-02-12 18:00:27,120 Epoch 26 Step: 62400 Batch Loss: 1.708399 Tokens per Sec: 21687, Lr: 0.000300 2020-02-12 18:00:36,992 Epoch 26 Step: 62500 Batch Loss: 1.464080 Tokens per Sec: 22382, Lr: 0.000300 2020-02-12 18:00:46,971 Epoch 26 Step: 62600 Batch Loss: 1.664190 Tokens per Sec: 22094, Lr: 0.000300 2020-02-12 18:00:56,913 Epoch 26 Step: 62700 Batch Loss: 1.557987 Tokens per Sec: 22267, Lr: 0.000300 2020-02-12 18:01:06,841 Epoch 26 Step: 62800 Batch Loss: 1.668654 Tokens per Sec: 22139, Lr: 0.000300 2020-02-12 18:01:16,817 Epoch 26 Step: 62900 Batch Loss: 1.345859 Tokens per Sec: 22119, Lr: 0.000300 2020-02-12 18:01:26,785 Epoch 26 Step: 63000 Batch Loss: 1.626277 Tokens per Sec: 22379, Lr: 0.000300 2020-02-12 18:01:45,212 Hooray! New best validation result [ppl]! 2020-02-12 18:01:45,212 Saving new checkpoint. 2020-02-12 18:01:45,400 Example #0 2020-02-12 18:01:45,400 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 18:01:45,400 Raw hypothesis: ['Er', 'Yehova', 'a', 'ver', 'ivese', 'i', 'lun', 'gbem', 'sha', 'won', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'sha', 'afatyô', 've', 'cii', 'vea', 'lu', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'ken', 'dooshima', 'u', 'a', 'lu', 'seer', 'a', 'seer', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 18:01:45,400 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 18:01:45,400 Reference: 10 : ​ 6 - 9 . 2020-02-12 18:01:45,400 Hypothesis: Er Yehova a ver ivese i lun gbem sha won yô , gba hange hange u noov man kasev vea nôngo sha afatyô ve cii vea lu a dooshima u ve lu a mi la , shi vea za hemen u lun ken dooshima u a lu seer a seer la . — Marku 10 : 6 - 9 . 2020-02-12 18:01:45,400 Example #1 2020-02-12 18:01:45,400 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 18:01:45,400 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'doon', 'tsung', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 18:01:45,400 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 18:01:45,400 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 18:01:45,401 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u doon tsung ne , man ka shighe u doon tsung je la ! — Rom . 2020-02-12 18:01:45,401 Example #2 2020-02-12 18:01:45,401 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 18:01:45,401 Raw hypothesis: ['Anyom', 'nga', 'kar', 'pue', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 18:01:45,401 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 18:01:45,401 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 18:01:45,401 Hypothesis: Anyom nga kar pue yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 18:01:45,401 Example #3 2020-02-12 18:01:45,401 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 18:01:45,401 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 18:01:45,401 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 18:01:45,401 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 18:01:45,401 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-12 18:01:45,401 Validation result (greedy) at epoch 26, step 63000: bleu: 25.55, loss: 44544.3047, ppl: 4.5027, duration: 18.6162s 2020-02-12 18:01:55,586 Epoch 26 Step: 63100 Batch Loss: 1.724305 Tokens per Sec: 21599, Lr: 0.000300 2020-02-12 18:02:05,558 Epoch 26 Step: 63200 Batch Loss: 1.697779 Tokens per Sec: 22488, Lr: 0.000300 2020-02-12 18:02:15,444 Epoch 26 Step: 63300 Batch Loss: 1.665274 Tokens per Sec: 22424, Lr: 0.000300 2020-02-12 18:02:25,332 Epoch 26 Step: 63400 Batch Loss: 1.396727 Tokens per Sec: 22748, Lr: 0.000300 2020-02-12 18:02:35,187 Epoch 26 Step: 63500 Batch Loss: 1.763126 Tokens per Sec: 22528, Lr: 0.000300 2020-02-12 18:02:45,029 Epoch 26 Step: 63600 Batch Loss: 1.371752 Tokens per Sec: 22915, Lr: 0.000300 2020-02-12 18:02:54,919 Epoch 26 Step: 63700 Batch Loss: 1.700996 Tokens per Sec: 22140, Lr: 0.000300 2020-02-12 18:03:04,748 Epoch 26 Step: 63800 Batch Loss: 1.579794 Tokens per Sec: 22391, Lr: 0.000300 2020-02-12 18:03:14,602 Epoch 26 Step: 63900 Batch Loss: 1.330240 Tokens per Sec: 22577, Lr: 0.000300 2020-02-12 18:03:17,395 Epoch 26: total training loss 3869.74 2020-02-12 18:03:17,396 EPOCH 27 2020-02-12 18:03:25,037 Epoch 27 Step: 64000 Batch Loss: 1.833237 Tokens per Sec: 20909, Lr: 0.000300 2020-02-12 18:03:43,606 Hooray! New best validation result [ppl]! 2020-02-12 18:03:43,606 Saving new checkpoint. 2020-02-12 18:03:43,794 Example #0 2020-02-12 18:03:43,794 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 18:03:43,794 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'sha', 'dooshima', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 18:03:43,794 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 18:03:43,794 Reference: 10 : ​ 6 - 9 . 2020-02-12 18:03:43,794 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u ve lu a mi la , shi vea za hemen u lun a dooshima sha dooshima la . — Marku 10 : 6 - 9 . 2020-02-12 18:03:43,794 Example #1 2020-02-12 18:03:43,794 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 18:03:43,794 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'doon', 'tsung', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 18:03:43,795 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 18:03:43,795 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 18:03:43,795 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u doon tsung ne , man ka shighe u doon tsung je la ! — Rom . 2020-02-12 18:03:43,795 Example #2 2020-02-12 18:03:43,795 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 18:03:43,795 Raw hypothesis: ['Anyom', 'nga', 'kar', 'pue', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 18:03:43,795 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 18:03:43,795 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 18:03:43,795 Hypothesis: Anyom nga kar pue yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 18:03:43,795 Example #3 2020-02-12 18:03:43,795 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 18:03:43,795 Raw hypothesis: ['Ka', 'kwagh', 'u', 'or', 'nan', 'lu', 'eren', 'sha', 'gbenda', 'u', 'vough', 'ga', 'la', '.'] 2020-02-12 18:03:43,795 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 18:03:43,795 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 18:03:43,795 Hypothesis: Ka kwagh u or nan lu eren sha gbenda u vough ga la . 2020-02-12 18:03:43,795 Validation result (greedy) at epoch 27, step 64000: bleu: 25.26, loss: 44508.7266, ppl: 4.4973, duration: 18.7582s 2020-02-12 18:03:53,801 Epoch 27 Step: 64100 Batch Loss: 1.582990 Tokens per Sec: 22825, Lr: 0.000300 2020-02-12 18:04:03,704 Epoch 27 Step: 64200 Batch Loss: 1.733140 Tokens per Sec: 21853, Lr: 0.000300 2020-02-12 18:04:13,667 Epoch 27 Step: 64300 Batch Loss: 1.572004 Tokens per Sec: 22485, Lr: 0.000300 2020-02-12 18:04:23,619 Epoch 27 Step: 64400 Batch Loss: 1.562159 Tokens per Sec: 22166, Lr: 0.000300 2020-02-12 18:04:33,576 Epoch 27 Step: 64500 Batch Loss: 1.349850 Tokens per Sec: 22343, Lr: 0.000300 2020-02-12 18:04:43,441 Epoch 27 Step: 64600 Batch Loss: 1.555283 Tokens per Sec: 21489, Lr: 0.000300 2020-02-12 18:04:53,432 Epoch 27 Step: 64700 Batch Loss: 1.464450 Tokens per Sec: 22416, Lr: 0.000300 2020-02-12 18:05:03,349 Epoch 27 Step: 64800 Batch Loss: 1.556035 Tokens per Sec: 22205, Lr: 0.000300 2020-02-12 18:05:13,244 Epoch 27 Step: 64900 Batch Loss: 1.659218 Tokens per Sec: 22365, Lr: 0.000300 2020-02-12 18:05:23,181 Epoch 27 Step: 65000 Batch Loss: 1.738126 Tokens per Sec: 22776, Lr: 0.000300 2020-02-12 18:05:41,858 Hooray! New best validation result [ppl]! 2020-02-12 18:05:41,858 Saving new checkpoint. 2020-02-12 18:05:42,056 Example #0 2020-02-12 18:05:42,056 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 18:05:42,056 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'eren', 'kwagh', 'u', 'una', 'wase', 've', 'u', 'lun', 'a', 'dooshima', 'shi', 'lun', 'a', 'dooshima', 'hen', 'atô', 've', 'yô', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 18:05:42,056 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 18:05:42,057 Reference: 10 : ​ 6 - 9 . 2020-02-12 18:05:42,057 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea eren kwagh u una wase ve u lun a dooshima shi lun a dooshima hen atô ve yô . — Marku 10 : 6 - 9 . 2020-02-12 18:05:42,057 Example #1 2020-02-12 18:05:42,057 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 18:05:42,057 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'doon', 'tsung', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 18:05:42,057 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 18:05:42,057 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 18:05:42,057 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u doon tsung ne , man ka shighe u doon tsung je la ! — Rom . 2020-02-12 18:05:42,057 Example #2 2020-02-12 18:05:42,057 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 18:05:42,057 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 18:05:42,057 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 18:05:42,057 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 18:05:42,057 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 18:05:42,057 Example #3 2020-02-12 18:05:42,058 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 18:05:42,058 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 18:05:42,058 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 18:05:42,058 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 18:05:42,058 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 18:05:42,058 Validation result (greedy) at epoch 27, step 65000: bleu: 25.36, loss: 44498.6055, ppl: 4.4957, duration: 18.8766s 2020-02-12 18:05:52,022 Epoch 27 Step: 65100 Batch Loss: 1.622702 Tokens per Sec: 21996, Lr: 0.000300 2020-02-12 18:06:02,063 Epoch 27 Step: 65200 Batch Loss: 1.501931 Tokens per Sec: 22085, Lr: 0.000300 2020-02-12 18:06:12,178 Epoch 27 Step: 65300 Batch Loss: 1.629987 Tokens per Sec: 22224, Lr: 0.000300 2020-02-12 18:06:22,409 Epoch 27 Step: 65400 Batch Loss: 1.633025 Tokens per Sec: 21722, Lr: 0.000300 2020-02-12 18:06:32,502 Epoch 27 Step: 65500 Batch Loss: 1.733178 Tokens per Sec: 21072, Lr: 0.000300 2020-02-12 18:06:42,579 Epoch 27 Step: 65600 Batch Loss: 1.822144 Tokens per Sec: 21533, Lr: 0.000300 2020-02-12 18:06:52,713 Epoch 27 Step: 65700 Batch Loss: 1.648252 Tokens per Sec: 21597, Lr: 0.000300 2020-02-12 18:07:02,728 Epoch 27 Step: 65800 Batch Loss: 1.637809 Tokens per Sec: 22236, Lr: 0.000300 2020-02-12 18:07:12,681 Epoch 27 Step: 65900 Batch Loss: 1.693966 Tokens per Sec: 21935, Lr: 0.000300 2020-02-12 18:07:22,604 Epoch 27 Step: 66000 Batch Loss: 1.712889 Tokens per Sec: 22321, Lr: 0.000300 2020-02-12 18:07:41,763 Hooray! New best validation result [ppl]! 2020-02-12 18:07:41,763 Saving new checkpoint. 2020-02-12 18:07:41,951 Example #0 2020-02-12 18:07:41,951 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 18:07:41,951 Raw hypothesis: ['Er', 'Yehova', 'a', 'ver', 'ivese', 'i', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'sha', 'dooshima', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 18:07:41,952 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 18:07:41,952 Reference: 10 : ​ 6 - 9 . 2020-02-12 18:07:41,952 Hypothesis: Er Yehova a ver ivese i tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u ve lu a mi sha dooshima la , shi vea za hemen u lun a dooshima u a lu hen atô ve la . — Marku 10 : 6 - 9 . 2020-02-12 18:07:41,952 Example #1 2020-02-12 18:07:41,952 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 18:07:41,952 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'imba', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'kwagh', 'u', 'a', 'lu', 'ikyua', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 18:07:41,952 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 18:07:41,952 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 18:07:41,952 Hypothesis: Se kpa se fatyô u ‘ nengen ’ imba shighe u doon tsung ne , man ka kwagh u a lu ikyua je la ! — Rom . 2020-02-12 18:07:41,952 Example #2 2020-02-12 18:07:41,952 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 18:07:41,952 Raw hypothesis: ['Anyom', 'nga', 'kar', 'pue', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 18:07:41,952 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 18:07:41,952 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 18:07:41,953 Hypothesis: Anyom nga kar pue yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 18:07:41,953 Example #3 2020-02-12 18:07:41,953 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 18:07:41,953 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 18:07:41,953 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 18:07:41,953 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 18:07:41,953 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-12 18:07:41,953 Validation result (greedy) at epoch 27, step 66000: bleu: 25.86, loss: 44215.5117, ppl: 4.4529, duration: 19.3480s 2020-02-12 18:07:51,913 Epoch 27 Step: 66100 Batch Loss: 1.408067 Tokens per Sec: 22209, Lr: 0.000300 2020-02-12 18:08:02,042 Epoch 27 Step: 66200 Batch Loss: 1.625484 Tokens per Sec: 21420, Lr: 0.000300 2020-02-12 18:08:12,136 Epoch 27 Step: 66300 Batch Loss: 1.370028 Tokens per Sec: 21901, Lr: 0.000300 2020-02-12 18:08:21,353 Epoch 27: total training loss 3854.13 2020-02-12 18:08:21,354 EPOCH 28 2020-02-12 18:08:22,544 Epoch 28 Step: 66400 Batch Loss: 1.539567 Tokens per Sec: 17759, Lr: 0.000300 2020-02-12 18:08:32,613 Epoch 28 Step: 66500 Batch Loss: 1.510659 Tokens per Sec: 21864, Lr: 0.000300 2020-02-12 18:08:42,684 Epoch 28 Step: 66600 Batch Loss: 1.654991 Tokens per Sec: 21632, Lr: 0.000300 2020-02-12 18:08:52,839 Epoch 28 Step: 66700 Batch Loss: 1.649115 Tokens per Sec: 21274, Lr: 0.000300 2020-02-12 18:09:02,882 Epoch 28 Step: 66800 Batch Loss: 1.389189 Tokens per Sec: 21843, Lr: 0.000300 2020-02-12 18:09:12,920 Epoch 28 Step: 66900 Batch Loss: 1.546438 Tokens per Sec: 22272, Lr: 0.000300 2020-02-12 18:09:23,115 Epoch 28 Step: 67000 Batch Loss: 1.760377 Tokens per Sec: 22011, Lr: 0.000300 2020-02-12 18:09:42,858 Hooray! New best validation result [ppl]! 2020-02-12 18:09:42,858 Saving new checkpoint. 2020-02-12 18:09:43,060 Example #0 2020-02-12 18:09:43,060 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 18:09:43,060 Raw hypothesis: ['Er', 'Yehova', 'a', 'ver', 'ivese', 'i', 'lu', 'kwagh', 'u', 'tsan', 'gbem', 'sha', 'won', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'kpaa', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 18:09:43,061 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 18:09:43,061 Reference: 10 : ​ 6 - 9 . 2020-02-12 18:09:43,061 Hypothesis: Er Yehova a ver ivese i lu kwagh u tsan gbem sha won yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u ve lu a mi la , shi vea za hemen u lun a dooshima u a lu a mi la kpaa . — Marku 10 : 6 - 9 . 2020-02-12 18:09:43,061 Example #1 2020-02-12 18:09:43,061 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 18:09:43,061 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'doon', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 18:09:43,061 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 18:09:43,061 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 18:09:43,061 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u doon tsung ne , man ka shighe u doon je la ! — Rom . 2020-02-12 18:09:43,061 Example #2 2020-02-12 18:09:43,061 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 18:09:43,061 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 18:09:43,061 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 18:09:43,061 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 18:09:43,062 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 18:09:43,062 Example #3 2020-02-12 18:09:43,062 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 18:09:43,062 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 18:09:43,062 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 18:09:43,062 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 18:09:43,062 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 18:09:43,062 Validation result (greedy) at epoch 28, step 67000: bleu: 25.80, loss: 44074.8711, ppl: 4.4318, duration: 19.9463s 2020-02-12 18:09:53,204 Epoch 28 Step: 67100 Batch Loss: 1.568015 Tokens per Sec: 21580, Lr: 0.000300 2020-02-12 18:10:03,132 Epoch 28 Step: 67200 Batch Loss: 1.384739 Tokens per Sec: 22727, Lr: 0.000300 2020-02-12 18:10:13,021 Epoch 28 Step: 67300 Batch Loss: 1.160034 Tokens per Sec: 21951, Lr: 0.000300 2020-02-12 18:10:22,931 Epoch 28 Step: 67400 Batch Loss: 1.629328 Tokens per Sec: 22138, Lr: 0.000300 2020-02-12 18:10:32,936 Epoch 28 Step: 67500 Batch Loss: 1.374674 Tokens per Sec: 22129, Lr: 0.000300 2020-02-12 18:10:42,911 Epoch 28 Step: 67600 Batch Loss: 1.439200 Tokens per Sec: 22346, Lr: 0.000300 2020-02-12 18:10:52,844 Epoch 28 Step: 67700 Batch Loss: 1.333939 Tokens per Sec: 22083, Lr: 0.000300 2020-02-12 18:11:02,806 Epoch 28 Step: 67800 Batch Loss: 1.342506 Tokens per Sec: 21681, Lr: 0.000300 2020-02-12 18:11:12,759 Epoch 28 Step: 67900 Batch Loss: 1.573518 Tokens per Sec: 22740, Lr: 0.000300 2020-02-12 18:11:22,672 Epoch 28 Step: 68000 Batch Loss: 1.684764 Tokens per Sec: 22491, Lr: 0.000300 2020-02-12 18:11:40,595 Example #0 2020-02-12 18:11:40,596 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 18:11:40,596 Raw hypothesis: ['Er', 'Yehova', 'a', 'ver', 'ivese', 'i', 'tsôron', 'yô', ',', 'gba', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 've', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'ken', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', 'kpaa', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 18:11:40,596 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 18:11:40,596 Reference: 10 : ​ 6 - 9 . 2020-02-12 18:11:40,596 Hypothesis: Er Yehova a ver ivese i tsôron yô , gba u noov man kasev vea nôngo kpoghuloo vea lu a dooshima ve la , shi vea za hemen u lun ken dooshima u a lu hen atô ve la kpaa . — Marku 10 : 6 - 9 . 2020-02-12 18:11:40,596 Example #1 2020-02-12 18:11:40,596 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 18:11:40,596 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'sha', 'kpôô', 'yô', ',', 'a', 'lu', 'ikyua', 'a', 'vese', '!', '—', 'Rom', '.'] 2020-02-12 18:11:40,596 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 18:11:40,596 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 18:11:40,596 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u doon tsung ne , man ka sha kpôô yô , a lu ikyua a vese ! — Rom . 2020-02-12 18:11:40,597 Example #2 2020-02-12 18:11:40,597 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 18:11:40,597 Raw hypothesis: ['Anyom', 'nga', 'kar', 'pue', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 18:11:40,597 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 18:11:40,597 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 18:11:40,597 Hypothesis: Anyom nga kar pue yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 18:11:40,597 Example #3 2020-02-12 18:11:40,597 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 18:11:40,597 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 18:11:40,597 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 18:11:40,597 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 18:11:40,597 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga yô . 2020-02-12 18:11:40,597 Validation result (greedy) at epoch 28, step 68000: bleu: 25.78, loss: 44164.0938, ppl: 4.4452, duration: 17.9249s 2020-02-12 18:11:50,625 Epoch 28 Step: 68100 Batch Loss: 1.531227 Tokens per Sec: 21840, Lr: 0.000300 2020-02-12 18:12:00,501 Epoch 28 Step: 68200 Batch Loss: 1.345454 Tokens per Sec: 22238, Lr: 0.000300 2020-02-12 18:12:10,423 Epoch 28 Step: 68300 Batch Loss: 1.617265 Tokens per Sec: 22208, Lr: 0.000300 2020-02-12 18:12:20,465 Epoch 28 Step: 68400 Batch Loss: 1.731347 Tokens per Sec: 22151, Lr: 0.000300 2020-02-12 18:12:30,397 Epoch 28 Step: 68500 Batch Loss: 1.498353 Tokens per Sec: 22634, Lr: 0.000300 2020-02-12 18:12:40,264 Epoch 28 Step: 68600 Batch Loss: 1.360098 Tokens per Sec: 22784, Lr: 0.000300 2020-02-12 18:12:50,163 Epoch 28 Step: 68700 Batch Loss: 1.640384 Tokens per Sec: 22473, Lr: 0.000300 2020-02-12 18:13:00,026 Epoch 28 Step: 68800 Batch Loss: 1.543844 Tokens per Sec: 22450, Lr: 0.000300 2020-02-12 18:13:04,790 Epoch 28: total training loss 3821.29 2020-02-12 18:13:04,791 EPOCH 29 2020-02-12 18:13:10,432 Epoch 29 Step: 68900 Batch Loss: 1.648355 Tokens per Sec: 20021, Lr: 0.000300 2020-02-12 18:13:20,375 Epoch 29 Step: 69000 Batch Loss: 1.437651 Tokens per Sec: 22257, Lr: 0.000300 2020-02-12 18:13:39,366 Example #0 2020-02-12 18:13:39,366 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 18:13:39,366 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'gbem', 'sha', 'won', 'yô', ',', 'gba', 'u', 'noov', 'man', 'kasev', 'vea', 'eren', 'kwagh', 'sha', 'dooshima', 've', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', 'kpaa', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 18:13:39,366 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 18:13:39,366 Reference: 10 : ​ 6 - 9 . 2020-02-12 18:13:39,366 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u gbem sha won yô , gba u noov man kasev vea eren kwagh sha dooshima ve u a lu hen atô ve la shi vea za hemen u lun a dooshima u a lu hen atô ve la kpaa . — Marku 10 : 6 - 9 . 2020-02-12 18:13:39,366 Example #1 2020-02-12 18:13:39,366 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 18:13:39,366 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'kwagh', 'u', 'a', 'lu', 'ikyua', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 18:13:39,367 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 18:13:39,367 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 18:13:39,367 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u doon tsung ne , man ka kwagh u a lu ikyua je la ! — Rom . 2020-02-12 18:13:39,367 Example #2 2020-02-12 18:13:39,367 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 18:13:39,367 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'gar', 'u', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 18:13:39,367 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 18:13:39,367 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 18:13:39,367 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken gar u Masedonia man Timoteu ken Efese . 2020-02-12 18:13:39,367 Example #3 2020-02-12 18:13:39,367 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 18:13:39,367 Raw hypothesis: ['Alaghga', 'a', 'lu', 'inja', 'er', 'or', 'ngu', 'eren', 'kwagh', 'sha', 'inja', 'ga', 'nahan', '.'] 2020-02-12 18:13:39,367 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 18:13:39,367 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 18:13:39,367 Hypothesis: Alaghga a lu inja er or ngu eren kwagh sha inja ga nahan . 2020-02-12 18:13:39,367 Validation result (greedy) at epoch 29, step 69000: bleu: 25.70, loss: 44289.9883, ppl: 4.4642, duration: 18.9915s 2020-02-12 18:13:49,339 Epoch 29 Step: 69100 Batch Loss: 1.469833 Tokens per Sec: 21799, Lr: 0.000300 2020-02-12 18:13:59,188 Epoch 29 Step: 69200 Batch Loss: 1.497443 Tokens per Sec: 22571, Lr: 0.000300 2020-02-12 18:14:09,100 Epoch 29 Step: 69300 Batch Loss: 1.282275 Tokens per Sec: 21624, Lr: 0.000300 2020-02-12 18:14:18,972 Epoch 29 Step: 69400 Batch Loss: 1.235603 Tokens per Sec: 22249, Lr: 0.000300 2020-02-12 18:14:28,823 Epoch 29 Step: 69500 Batch Loss: 1.350500 Tokens per Sec: 22459, Lr: 0.000300 2020-02-12 18:14:38,775 Epoch 29 Step: 69600 Batch Loss: 1.457592 Tokens per Sec: 22476, Lr: 0.000300 2020-02-12 18:14:48,744 Epoch 29 Step: 69700 Batch Loss: 1.724861 Tokens per Sec: 22343, Lr: 0.000300 2020-02-12 18:14:58,652 Epoch 29 Step: 69800 Batch Loss: 1.633235 Tokens per Sec: 22909, Lr: 0.000300 2020-02-12 18:15:08,566 Epoch 29 Step: 69900 Batch Loss: 1.631249 Tokens per Sec: 22481, Lr: 0.000300 2020-02-12 18:15:18,479 Epoch 29 Step: 70000 Batch Loss: 1.569043 Tokens per Sec: 22623, Lr: 0.000300 2020-02-12 18:15:37,335 Hooray! New best validation result [ppl]! 2020-02-12 18:15:37,335 Saving new checkpoint. 2020-02-12 18:15:37,521 Example #0 2020-02-12 18:15:37,521 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 18:15:37,522 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 18:15:37,522 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 18:15:37,522 Reference: 10 : ​ 6 - 9 . 2020-02-12 18:15:37,522 Hypothesis: Er ivese i Yehova i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u ve lu a mi la , shi vea za hemen u lun a dooshima u a lu a mi la . — Marku 10 : 6 - 9 . 2020-02-12 18:15:37,522 Example #1 2020-02-12 18:15:37,522 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 18:15:37,522 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'a', 'mgb@@', 'ôghom', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 18:15:37,522 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 18:15:37,522 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 18:15:37,522 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u doon tsung ne , man ka shighe u a mgbôghom je la ! — Rom . 2020-02-12 18:15:37,522 Example #2 2020-02-12 18:15:37,522 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 18:15:37,522 Raw hypothesis: ['Anyom', 'nga', 'kar', 'pue', 'yô', ',', 'Paulu', 'lu', 'ken', 'gar', 'u', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 18:15:37,522 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 18:15:37,522 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 18:15:37,523 Hypothesis: Anyom nga kar pue yô , Paulu lu ken gar u Masedonia man Timoteu ken Efese . 2020-02-12 18:15:37,523 Example #3 2020-02-12 18:15:37,523 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 18:15:37,523 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 18:15:37,523 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 18:15:37,523 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 18:15:37,523 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga yô . 2020-02-12 18:15:37,523 Validation result (greedy) at epoch 29, step 70000: bleu: 25.51, loss: 44060.8906, ppl: 4.4297, duration: 19.0439s 2020-02-12 18:15:47,448 Epoch 29 Step: 70100 Batch Loss: 1.834248 Tokens per Sec: 22449, Lr: 0.000300 2020-02-12 18:15:57,462 Epoch 29 Step: 70200 Batch Loss: 1.374259 Tokens per Sec: 21797, Lr: 0.000300 2020-02-12 18:16:07,303 Epoch 29 Step: 70300 Batch Loss: 1.645397 Tokens per Sec: 22438, Lr: 0.000300 2020-02-12 18:16:17,184 Epoch 29 Step: 70400 Batch Loss: 1.347597 Tokens per Sec: 22111, Lr: 0.000300 2020-02-12 18:16:27,083 Epoch 29 Step: 70500 Batch Loss: 1.479826 Tokens per Sec: 21891, Lr: 0.000300 2020-02-12 18:16:37,026 Epoch 29 Step: 70600 Batch Loss: 1.441261 Tokens per Sec: 22206, Lr: 0.000300 2020-02-12 18:16:47,016 Epoch 29 Step: 70700 Batch Loss: 1.719359 Tokens per Sec: 22357, Lr: 0.000300 2020-02-12 18:16:56,973 Epoch 29 Step: 70800 Batch Loss: 1.678199 Tokens per Sec: 22320, Lr: 0.000300 2020-02-12 18:17:06,949 Epoch 29 Step: 70900 Batch Loss: 1.493182 Tokens per Sec: 22012, Lr: 0.000300 2020-02-12 18:17:16,960 Epoch 29 Step: 71000 Batch Loss: 1.365666 Tokens per Sec: 22477, Lr: 0.000300 2020-02-12 18:17:35,785 Hooray! New best validation result [ppl]! 2020-02-12 18:17:35,786 Saving new checkpoint. 2020-02-12 18:17:35,985 Example #0 2020-02-12 18:17:35,985 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 18:17:35,985 Raw hypothesis: ['Er', 'ivese', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'u', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'kpaa', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 18:17:35,985 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 18:17:35,985 Reference: 10 : ​ 6 - 9 . 2020-02-12 18:17:35,985 Hypothesis: Er ivese i lu kwagh u tsôron u Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea za hemen u lun a dooshima u ve lu a mi la , shi vea za hemen u lun a dooshima u a lu a mi la kpaa . — Marku 10 : 6 - 9 . 2020-02-12 18:17:35,985 Example #1 2020-02-12 18:17:35,986 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 18:17:35,986 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'kpilighyol', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'a', 'lu', 'ikyua', 'je', 'la', '.', '—', 'Rom', '.'] 2020-02-12 18:17:35,986 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 18:17:35,986 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 18:17:35,986 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u kpilighyol ne , man ka shighe u a lu ikyua je la . — Rom . 2020-02-12 18:17:35,986 Example #2 2020-02-12 18:17:35,986 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 18:17:35,986 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'gar', 'u', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 18:17:35,986 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 18:17:35,986 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 18:17:35,986 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken gar u Masedonia man Timoteu ken Efese . 2020-02-12 18:17:35,986 Example #3 2020-02-12 18:17:35,986 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 18:17:35,986 Raw hypothesis: ['Alaghga', 'or', 'a', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 18:17:35,986 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 18:17:35,986 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 18:17:35,986 Hypothesis: Alaghga or a lu eren kwagh sha gbenda u vough ga . 2020-02-12 18:17:35,987 Validation result (greedy) at epoch 29, step 71000: bleu: 25.96, loss: 43942.8281, ppl: 4.4121, duration: 19.0259s 2020-02-12 18:17:45,955 Epoch 29 Step: 71100 Batch Loss: 1.727092 Tokens per Sec: 22260, Lr: 0.000300 2020-02-12 18:17:55,968 Epoch 29 Step: 71200 Batch Loss: 1.106232 Tokens per Sec: 22144, Lr: 0.000300 2020-02-12 18:18:05,976 Epoch 29 Step: 71300 Batch Loss: 1.410406 Tokens per Sec: 22345, Lr: 0.000300 2020-02-12 18:18:06,381 Epoch 29: total training loss 3800.10 2020-02-12 18:18:06,381 EPOCH 30 2020-02-12 18:18:16,267 Epoch 30 Step: 71400 Batch Loss: 1.575879 Tokens per Sec: 22000, Lr: 0.000300 2020-02-12 18:18:26,311 Epoch 30 Step: 71500 Batch Loss: 1.388709 Tokens per Sec: 21468, Lr: 0.000300 2020-02-12 18:18:36,239 Epoch 30 Step: 71600 Batch Loss: 1.634655 Tokens per Sec: 22447, Lr: 0.000300 2020-02-12 18:18:46,171 Epoch 30 Step: 71700 Batch Loss: 1.814609 Tokens per Sec: 22184, Lr: 0.000300 2020-02-12 18:18:56,108 Epoch 30 Step: 71800 Batch Loss: 1.648347 Tokens per Sec: 22093, Lr: 0.000300 2020-02-12 18:19:06,113 Epoch 30 Step: 71900 Batch Loss: 1.598242 Tokens per Sec: 21608, Lr: 0.000300 2020-02-12 18:19:16,270 Epoch 30 Step: 72000 Batch Loss: 1.660041 Tokens per Sec: 22040, Lr: 0.000300 2020-02-12 18:19:35,913 Hooray! New best validation result [ppl]! 2020-02-12 18:19:35,913 Saving new checkpoint. 2020-02-12 18:19:36,104 Example #0 2020-02-12 18:19:36,104 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 18:19:36,104 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'sha', 'kwagh', 'u', 'dooshima', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 18:19:36,104 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 18:19:36,104 Reference: 10 : ​ 6 - 9 . 2020-02-12 18:19:36,104 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u ve lu a mi la , shi vea za hemen u lun a dooshima u a lu a mi sha kwagh u dooshima la . — Marku 10 : 6 - 9 . 2020-02-12 18:19:36,104 Example #1 2020-02-12 18:19:36,104 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 18:19:36,104 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'hen', 'shighe', 'la', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 18:19:36,104 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 18:19:36,104 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 18:19:36,104 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u doon tsung ne , man ka hen shighe la je la ! — Rom . 2020-02-12 18:19:36,104 Example #2 2020-02-12 18:19:36,105 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 18:19:36,105 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'gar', 'u', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', '.'] 2020-02-12 18:19:36,105 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 18:19:36,105 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 18:19:36,105 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken gar u Masedonia man Timoteu . 2020-02-12 18:19:36,105 Example #3 2020-02-12 18:19:36,105 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 18:19:36,105 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 18:19:36,105 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 18:19:36,105 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 18:19:36,105 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 18:19:36,105 Validation result (greedy) at epoch 30, step 72000: bleu: 25.94, loss: 43766.0938, ppl: 4.3859, duration: 19.8351s 2020-02-12 18:19:46,237 Epoch 30 Step: 72100 Batch Loss: 1.284048 Tokens per Sec: 21788, Lr: 0.000300 2020-02-12 18:19:56,332 Epoch 30 Step: 72200 Batch Loss: 1.351006 Tokens per Sec: 21049, Lr: 0.000300 2020-02-12 18:20:06,570 Epoch 30 Step: 72300 Batch Loss: 1.447757 Tokens per Sec: 21741, Lr: 0.000300 2020-02-12 18:20:16,552 Epoch 30 Step: 72400 Batch Loss: 1.532351 Tokens per Sec: 22417, Lr: 0.000300 2020-02-12 18:20:26,507 Epoch 30 Step: 72500 Batch Loss: 1.399491 Tokens per Sec: 22044, Lr: 0.000300 2020-02-12 18:20:36,386 Epoch 30 Step: 72600 Batch Loss: 1.533747 Tokens per Sec: 22574, Lr: 0.000300 2020-02-12 18:20:46,293 Epoch 30 Step: 72700 Batch Loss: 1.519976 Tokens per Sec: 21826, Lr: 0.000300 2020-02-12 18:20:56,257 Epoch 30 Step: 72800 Batch Loss: 1.339628 Tokens per Sec: 21806, Lr: 0.000300 2020-02-12 18:21:06,214 Epoch 30 Step: 72900 Batch Loss: 1.523295 Tokens per Sec: 22571, Lr: 0.000300 2020-02-12 18:21:16,106 Epoch 30 Step: 73000 Batch Loss: 1.588323 Tokens per Sec: 22249, Lr: 0.000300 2020-02-12 18:21:34,279 Hooray! New best validation result [ppl]! 2020-02-12 18:21:34,279 Saving new checkpoint. 2020-02-12 18:21:34,465 Example #0 2020-02-12 18:21:34,465 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 18:21:34,466 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'i', 'lu', 'kwagh', 'u', 'gbem', 'sha', 'won', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'kpaa', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 18:21:34,466 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 18:21:34,466 Reference: 10 : ​ 6 - 9 . 2020-02-12 18:21:34,466 Hypothesis: Er ivese i Yehova i lu kwagh u gbem sha won yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea za hemen u lun a dooshima u ve lu a mi la , shi vea za hemen u lun a dooshima u a lu a mi la kpaa . — Marku 10 : 6 - 9 . 2020-02-12 18:21:34,466 Example #1 2020-02-12 18:21:34,466 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 18:21:34,466 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'doon', 'tsung', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 18:21:34,466 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 18:21:34,466 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 18:21:34,466 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u doon tsung ne , man ka shighe u doon tsung je la ! — Rom . 2020-02-12 18:21:34,466 Example #2 2020-02-12 18:21:34,466 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 18:21:34,466 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', '.'] 2020-02-12 18:21:34,466 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 18:21:34,466 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 18:21:34,467 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu . 2020-02-12 18:21:34,467 Example #3 2020-02-12 18:21:34,467 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 18:21:34,467 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 18:21:34,467 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 18:21:34,467 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 18:21:34,467 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 18:21:34,467 Validation result (greedy) at epoch 30, step 73000: bleu: 25.87, loss: 43722.9219, ppl: 4.3795, duration: 18.3602s 2020-02-12 18:21:44,378 Epoch 30 Step: 73100 Batch Loss: 1.684008 Tokens per Sec: 22469, Lr: 0.000300 2020-02-12 18:21:54,308 Epoch 30 Step: 73200 Batch Loss: 1.655447 Tokens per Sec: 22391, Lr: 0.000300 2020-02-12 18:22:04,224 Epoch 30 Step: 73300 Batch Loss: 1.490946 Tokens per Sec: 22354, Lr: 0.000300 2020-02-12 18:22:14,233 Epoch 30 Step: 73400 Batch Loss: 1.862208 Tokens per Sec: 21817, Lr: 0.000300 2020-02-12 18:22:24,115 Epoch 30 Step: 73500 Batch Loss: 1.442103 Tokens per Sec: 22736, Lr: 0.000300 2020-02-12 18:22:34,015 Epoch 30 Step: 73600 Batch Loss: 1.604820 Tokens per Sec: 22256, Lr: 0.000300 2020-02-12 18:22:43,869 Epoch 30 Step: 73700 Batch Loss: 1.753312 Tokens per Sec: 22793, Lr: 0.000300 2020-02-12 18:22:50,307 Epoch 30: total training loss 3787.27 2020-02-12 18:22:50,308 EPOCH 31 2020-02-12 18:22:54,031 Epoch 31 Step: 73800 Batch Loss: 1.666189 Tokens per Sec: 21400, Lr: 0.000300 2020-02-12 18:23:03,896 Epoch 31 Step: 73900 Batch Loss: 1.142181 Tokens per Sec: 21842, Lr: 0.000300 2020-02-12 18:23:13,878 Epoch 31 Step: 74000 Batch Loss: 1.432969 Tokens per Sec: 22098, Lr: 0.000300 2020-02-12 18:23:32,871 Example #0 2020-02-12 18:23:32,872 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 18:23:32,872 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'sha', 'afatyô', 've', 'cii', 'vea', 'lu', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'sha', 'dooshima', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 18:23:32,872 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 18:23:32,872 Reference: 10 : ​ 6 - 9 . 2020-02-12 18:23:32,872 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo sha afatyô ve cii vea lu a dooshima u ve lu a mi la , shi vea za hemen u lun a dooshima u a lu a mi sha dooshima la . — Marku 10 : 6 - 9 . 2020-02-12 18:23:32,872 Example #1 2020-02-12 18:23:32,872 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 18:23:32,872 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'a', 'lu', 'ikyua', 'je', 'la', '.', '—', 'Rom', '.'] 2020-02-12 18:23:32,872 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 18:23:32,872 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 18:23:32,872 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u doon tsung ne , man ka shighe u a lu ikyua je la . — Rom . 2020-02-12 18:23:32,872 Example #2 2020-02-12 18:23:32,872 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 18:23:32,873 Raw hypothesis: ['Anyom', 'nga', 'kar', 'pue', 'yô', ',', 'Paulu', 'lu', 'ken', 'gar', 'u', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 18:23:32,873 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 18:23:32,873 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 18:23:32,873 Hypothesis: Anyom nga kar pue yô , Paulu lu ken gar u Masedonia man Timoteu ken Efese . 2020-02-12 18:23:32,873 Example #3 2020-02-12 18:23:32,873 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 18:23:32,873 Raw hypothesis: ['Alaghga', 'or', 'a', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 18:23:32,873 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 18:23:32,873 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 18:23:32,873 Hypothesis: Alaghga or a lu eren kwagh sha gbenda u vough ga . 2020-02-12 18:23:32,873 Validation result (greedy) at epoch 31, step 74000: bleu: 25.92, loss: 43771.9883, ppl: 4.3867, duration: 18.9946s 2020-02-12 18:23:42,801 Epoch 31 Step: 74100 Batch Loss: 1.850540 Tokens per Sec: 22383, Lr: 0.000300 2020-02-12 18:23:52,772 Epoch 31 Step: 74200 Batch Loss: 1.340409 Tokens per Sec: 21725, Lr: 0.000300 2020-02-12 18:24:02,717 Epoch 31 Step: 74300 Batch Loss: 1.613586 Tokens per Sec: 22693, Lr: 0.000300 2020-02-12 18:24:12,745 Epoch 31 Step: 74400 Batch Loss: 1.431599 Tokens per Sec: 22043, Lr: 0.000300 2020-02-12 18:24:22,853 Epoch 31 Step: 74500 Batch Loss: 1.414202 Tokens per Sec: 21912, Lr: 0.000300 2020-02-12 18:24:32,738 Epoch 31 Step: 74600 Batch Loss: 1.217502 Tokens per Sec: 22523, Lr: 0.000300 2020-02-12 18:24:42,666 Epoch 31 Step: 74700 Batch Loss: 1.619261 Tokens per Sec: 22375, Lr: 0.000300 2020-02-12 18:24:52,588 Epoch 31 Step: 74800 Batch Loss: 1.646559 Tokens per Sec: 21954, Lr: 0.000300 2020-02-12 18:25:02,471 Epoch 31 Step: 74900 Batch Loss: 1.634654 Tokens per Sec: 22155, Lr: 0.000300 2020-02-12 18:25:12,433 Epoch 31 Step: 75000 Batch Loss: 1.540734 Tokens per Sec: 22389, Lr: 0.000300 2020-02-12 18:25:31,773 Hooray! New best validation result [ppl]! 2020-02-12 18:25:31,773 Saving new checkpoint. 2020-02-12 18:25:31,960 Example #0 2020-02-12 18:25:31,961 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 18:25:31,961 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'sha', 'gbenda', 'u', 'dooshima', 'una', 'seer', 'taver', 'yô', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 18:25:31,961 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 18:25:31,961 Reference: 10 : ​ 6 - 9 . 2020-02-12 18:25:31,961 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea za hemen u lun a dooshima , shi vea za hemen u lun a dooshima sha gbenda u dooshima una seer taver yô . — Marku 10 : 6 - 9 . 2020-02-12 18:25:31,961 Example #1 2020-02-12 18:25:31,961 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 18:25:31,961 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'doon', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 18:25:31,961 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 18:25:31,961 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 18:25:31,961 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u doon tsung ne , man ka shighe u doon je la ! — Rom . 2020-02-12 18:25:31,961 Example #2 2020-02-12 18:25:31,961 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 18:25:31,961 Raw hypothesis: ['Anyom', 'nga', 'kar', 'pue', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 18:25:31,961 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 18:25:31,962 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 18:25:31,962 Hypothesis: Anyom nga kar pue yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 18:25:31,962 Example #3 2020-02-12 18:25:31,962 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 18:25:31,962 Raw hypothesis: ['Alaghga', 'or', 'a', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 18:25:31,962 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 18:25:31,962 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 18:25:31,962 Hypothesis: Alaghga or a lu eren kwagh sha gbenda u vough ga yô . 2020-02-12 18:25:31,962 Validation result (greedy) at epoch 31, step 75000: bleu: 25.98, loss: 43686.1836, ppl: 4.3740, duration: 19.5283s 2020-02-12 18:25:41,891 Epoch 31 Step: 75100 Batch Loss: 1.361539 Tokens per Sec: 22004, Lr: 0.000300 2020-02-12 18:25:51,874 Epoch 31 Step: 75200 Batch Loss: 1.518059 Tokens per Sec: 22261, Lr: 0.000300 2020-02-12 18:26:01,815 Epoch 31 Step: 75300 Batch Loss: 1.658811 Tokens per Sec: 21921, Lr: 0.000300 2020-02-12 18:26:11,794 Epoch 31 Step: 75400 Batch Loss: 1.503861 Tokens per Sec: 22355, Lr: 0.000300 2020-02-12 18:26:21,830 Epoch 31 Step: 75500 Batch Loss: 1.323623 Tokens per Sec: 21983, Lr: 0.000300 2020-02-12 18:26:31,729 Epoch 31 Step: 75600 Batch Loss: 1.500853 Tokens per Sec: 22542, Lr: 0.000300 2020-02-12 18:26:41,644 Epoch 31 Step: 75700 Batch Loss: 1.604675 Tokens per Sec: 22232, Lr: 0.000300 2020-02-12 18:26:51,608 Epoch 31 Step: 75800 Batch Loss: 1.717966 Tokens per Sec: 21591, Lr: 0.000300 2020-02-12 18:27:01,532 Epoch 31 Step: 75900 Batch Loss: 1.952161 Tokens per Sec: 22208, Lr: 0.000300 2020-02-12 18:27:11,650 Epoch 31 Step: 76000 Batch Loss: 1.442712 Tokens per Sec: 21630, Lr: 0.000300 2020-02-12 18:27:30,888 Hooray! New best validation result [ppl]! 2020-02-12 18:27:30,888 Saving new checkpoint. 2020-02-12 18:27:31,079 Example #0 2020-02-12 18:27:31,079 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 18:27:31,079 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'sha', 'gbenda', 'u', 'dooshima', 'una', 'seer', 'taver', 'yô', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 18:27:31,079 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 18:27:31,079 Reference: 10 : ​ 6 - 9 . 2020-02-12 18:27:31,079 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u ve lu a mi la , shi vea za hemen u lun a dooshima sha gbenda u dooshima una seer taver yô . — Marku 10 : 6 - 9 . 2020-02-12 18:27:31,079 Example #1 2020-02-12 18:27:31,079 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 18:27:31,079 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'kwagh', 'u', 'a', 'lu', 'van', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 18:27:31,079 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 18:27:31,079 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 18:27:31,080 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u doon tsung ne , man ka kwagh u a lu van je la ! — Rom . 2020-02-12 18:27:31,080 Example #2 2020-02-12 18:27:31,080 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 18:27:31,080 Raw hypothesis: ['Anyom', 'nga', 'kar', 'pue', 'yô', ',', 'Paulu', 'lu', 'ken', 'gar', 'u', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 18:27:31,080 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 18:27:31,080 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 18:27:31,080 Hypothesis: Anyom nga kar pue yô , Paulu lu ken gar u Masedonia man Timoteu ken Efese . 2020-02-12 18:27:31,080 Example #3 2020-02-12 18:27:31,080 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 18:27:31,080 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', ',', 'ka', 'nan', 'er', 'kwagh', 'sha', 'mi', '.'] 2020-02-12 18:27:31,080 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 18:27:31,080 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 18:27:31,080 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô , ka nan er kwagh sha mi . 2020-02-12 18:27:31,080 Validation result (greedy) at epoch 31, step 76000: bleu: 25.95, loss: 43600.2383, ppl: 4.3614, duration: 19.4296s 2020-02-12 18:27:40,977 Epoch 31 Step: 76100 Batch Loss: 1.627983 Tokens per Sec: 22289, Lr: 0.000300 2020-02-12 18:27:50,926 Epoch 31 Step: 76200 Batch Loss: 1.521014 Tokens per Sec: 22558, Lr: 0.000300 2020-02-12 18:27:53,710 Epoch 31: total training loss 3775.87 2020-02-12 18:27:53,711 EPOCH 32 2020-02-12 18:28:01,192 Epoch 32 Step: 76300 Batch Loss: 1.677837 Tokens per Sec: 21634, Lr: 0.000300 2020-02-12 18:28:11,217 Epoch 32 Step: 76400 Batch Loss: 1.572607 Tokens per Sec: 22008, Lr: 0.000300 2020-02-12 18:28:21,139 Epoch 32 Step: 76500 Batch Loss: 1.520137 Tokens per Sec: 22500, Lr: 0.000300 2020-02-12 18:28:30,997 Epoch 32 Step: 76600 Batch Loss: 1.271054 Tokens per Sec: 21725, Lr: 0.000300 2020-02-12 18:28:40,866 Epoch 32 Step: 76700 Batch Loss: 1.470936 Tokens per Sec: 22588, Lr: 0.000300 2020-02-12 18:28:50,855 Epoch 32 Step: 76800 Batch Loss: 1.748611 Tokens per Sec: 22968, Lr: 0.000300 2020-02-12 18:29:01,036 Epoch 32 Step: 76900 Batch Loss: 1.376566 Tokens per Sec: 21944, Lr: 0.000300 2020-02-12 18:29:11,191 Epoch 32 Step: 77000 Batch Loss: 1.751502 Tokens per Sec: 21655, Lr: 0.000300 2020-02-12 18:29:30,921 Hooray! New best validation result [ppl]! 2020-02-12 18:29:30,921 Saving new checkpoint. 2020-02-12 18:29:31,124 Example #0 2020-02-12 18:29:31,124 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 18:29:31,124 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'sha', 'gbenda', 'u', 'dooshima', 'una', 'fatyô', 'u', 'vesen', 'ken', 'ivese', 've', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 18:29:31,124 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 18:29:31,124 Reference: 10 : ​ 6 - 9 . 2020-02-12 18:29:31,124 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba u noov man kasev vea nôngo kpoghuloo vea za hemen u lun a dooshima u ve lu a mi la , shi vea za hemen u lun a dooshima sha gbenda u dooshima una fatyô u vesen ken ivese ve la . — Marku 10 : 6 - 9 . 2020-02-12 18:29:31,124 Example #1 2020-02-12 18:29:31,124 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 18:29:31,124 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'doon', 'tsung', ',', 'man', 'kwagh', 'ne', 'ngu', 'ikyua', '!', '—', 'Rom', '.'] 2020-02-12 18:29:31,124 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 18:29:31,124 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 18:29:31,124 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u doon tsung , man kwagh ne ngu ikyua ! — Rom . 2020-02-12 18:29:31,125 Example #2 2020-02-12 18:29:31,125 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 18:29:31,125 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'gar', 'u', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 18:29:31,125 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 18:29:31,125 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 18:29:31,125 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken gar u Masedonia man Timoteu ken Efese . 2020-02-12 18:29:31,125 Example #3 2020-02-12 18:29:31,125 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 18:29:31,125 Raw hypothesis: ['Alaghga', 'a', 'lu', 'inja', 'er', 'or', 'ngu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'nahan', '.'] 2020-02-12 18:29:31,125 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 18:29:31,125 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 18:29:31,125 Hypothesis: Alaghga a lu inja er or ngu eren kwagh sha gbenda u vough ga nahan . 2020-02-12 18:29:31,125 Validation result (greedy) at epoch 32, step 77000: bleu: 26.11, loss: 43480.3750, ppl: 4.3437, duration: 19.9340s 2020-02-12 18:29:41,264 Epoch 32 Step: 77100 Batch Loss: 1.431352 Tokens per Sec: 21870, Lr: 0.000300 2020-02-12 18:29:51,431 Epoch 32 Step: 77200 Batch Loss: 1.481824 Tokens per Sec: 21695, Lr: 0.000300 2020-02-12 18:30:01,563 Epoch 32 Step: 77300 Batch Loss: 1.449244 Tokens per Sec: 21693, Lr: 0.000300 2020-02-12 18:30:11,796 Epoch 32 Step: 77400 Batch Loss: 1.328031 Tokens per Sec: 21593, Lr: 0.000300 2020-02-12 18:30:21,974 Epoch 32 Step: 77500 Batch Loss: 1.414669 Tokens per Sec: 21019, Lr: 0.000300 2020-02-12 18:30:32,192 Epoch 32 Step: 77600 Batch Loss: 1.431015 Tokens per Sec: 21568, Lr: 0.000300 2020-02-12 18:30:42,060 Epoch 32 Step: 77700 Batch Loss: 1.631900 Tokens per Sec: 22283, Lr: 0.000300 2020-02-12 18:30:51,978 Epoch 32 Step: 77800 Batch Loss: 1.572927 Tokens per Sec: 22342, Lr: 0.000300 2020-02-12 18:31:01,905 Epoch 32 Step: 77900 Batch Loss: 1.567002 Tokens per Sec: 21714, Lr: 0.000300 2020-02-12 18:31:11,870 Epoch 32 Step: 78000 Batch Loss: 1.681954 Tokens per Sec: 22734, Lr: 0.000300 2020-02-12 18:31:30,302 Hooray! New best validation result [ppl]! 2020-02-12 18:31:30,302 Saving new checkpoint. 2020-02-12 18:31:30,490 Example #0 2020-02-12 18:31:30,490 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 18:31:30,490 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'i', 'lu', 'kwagh', 'u', 'gbem', 'sha', 'won', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'sha', 'er', 'vea', 'lu', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'hen', 'atô', 've', 'yô', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 18:31:30,490 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 18:31:30,490 Reference: 10 : ​ 6 - 9 . 2020-02-12 18:31:30,490 Hypothesis: Er ivese i Yehova i lu kwagh u gbem sha won yô , gba hange hange u noov man kasev vea nôngo sha er vea lu a dooshima u ve lu a mi la , shi vea za hemen u lun a dooshima hen atô ve yô . — Marku 10 : 6 - 9 . 2020-02-12 18:31:30,490 Example #1 2020-02-12 18:31:30,490 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 18:31:30,490 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'doon', 'tsung', ',', 'man', 'ka', 'shighe', 'u', 'doon', 'tsung', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 18:31:30,490 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 18:31:30,491 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 18:31:30,491 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u doon tsung , man ka shighe u doon tsung je la ! — Rom . 2020-02-12 18:31:30,491 Example #2 2020-02-12 18:31:30,491 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 18:31:30,491 Raw hypothesis: ['Anyom', 'nga', 'kar', 'pue', 'yô', ',', 'Paulu', 'lu', 'ken', 'gar', 'u', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 18:31:30,491 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 18:31:30,491 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 18:31:30,491 Hypothesis: Anyom nga kar pue yô , Paulu lu ken gar u Masedonia man Timoteu ken Efese . 2020-02-12 18:31:30,491 Example #3 2020-02-12 18:31:30,491 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 18:31:30,491 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 18:31:30,491 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 18:31:30,491 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 18:31:30,491 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 18:31:30,492 Validation result (greedy) at epoch 32, step 78000: bleu: 26.02, loss: 43437.3086, ppl: 4.3374, duration: 18.6212s 2020-02-12 18:31:40,441 Epoch 32 Step: 78100 Batch Loss: 1.516328 Tokens per Sec: 22470, Lr: 0.000300 2020-02-12 18:31:50,479 Epoch 32 Step: 78200 Batch Loss: 1.531434 Tokens per Sec: 22569, Lr: 0.000300 2020-02-12 18:32:00,458 Epoch 32 Step: 78300 Batch Loss: 1.639289 Tokens per Sec: 22007, Lr: 0.000300 2020-02-12 18:32:10,476 Epoch 32 Step: 78400 Batch Loss: 1.371441 Tokens per Sec: 21831, Lr: 0.000300 2020-02-12 18:32:20,385 Epoch 32 Step: 78500 Batch Loss: 1.644935 Tokens per Sec: 22897, Lr: 0.000300 2020-02-12 18:32:30,354 Epoch 32 Step: 78600 Batch Loss: 1.612067 Tokens per Sec: 22258, Lr: 0.000300 2020-02-12 18:32:38,850 Epoch 32: total training loss 3744.57 2020-02-12 18:32:38,850 EPOCH 33 2020-02-12 18:32:40,599 Epoch 33 Step: 78700 Batch Loss: 1.432572 Tokens per Sec: 18954, Lr: 0.000300 2020-02-12 18:32:50,561 Epoch 33 Step: 78800 Batch Loss: 1.585557 Tokens per Sec: 22028, Lr: 0.000300 2020-02-12 18:33:00,527 Epoch 33 Step: 78900 Batch Loss: 1.352350 Tokens per Sec: 22461, Lr: 0.000300 2020-02-12 18:33:10,441 Epoch 33 Step: 79000 Batch Loss: 1.670286 Tokens per Sec: 22820, Lr: 0.000300 2020-02-12 18:33:28,849 Hooray! New best validation result [ppl]! 2020-02-12 18:33:28,849 Saving new checkpoint. 2020-02-12 18:33:29,047 Example #0 2020-02-12 18:33:29,047 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 18:33:29,048 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'sha', 'dooshima', 'u', 'a', 'lu', 'seer', 'a', 'seer', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 18:33:29,048 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 18:33:29,048 Reference: 10 : ​ 6 - 9 . 2020-02-12 18:33:29,048 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea za hemen u lun a dooshima u ve lu a mi la , shi vea za hemen u lun a dooshima sha dooshima u a lu seer a seer la . — Marku 10 : 6 - 9 . 2020-02-12 18:33:29,048 Example #1 2020-02-12 18:33:29,048 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 18:33:29,048 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'doon', 'tsung', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 18:33:29,048 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 18:33:29,048 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 18:33:29,048 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u doon tsung ne , man ka shighe u doon tsung je la ! — Rom . 2020-02-12 18:33:29,048 Example #2 2020-02-12 18:33:29,048 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 18:33:29,048 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', '.'] 2020-02-12 18:33:29,048 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 18:33:29,048 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 18:33:29,048 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu . 2020-02-12 18:33:29,049 Example #3 2020-02-12 18:33:29,049 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 18:33:29,049 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 18:33:29,049 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 18:33:29,049 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 18:33:29,049 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-12 18:33:29,049 Validation result (greedy) at epoch 33, step 79000: bleu: 25.91, loss: 43381.6523, ppl: 4.3293, duration: 18.6070s 2020-02-12 18:33:38,988 Epoch 33 Step: 79100 Batch Loss: 1.485782 Tokens per Sec: 22114, Lr: 0.000300 2020-02-12 18:33:48,949 Epoch 33 Step: 79200 Batch Loss: 1.647398 Tokens per Sec: 22590, Lr: 0.000300 2020-02-12 18:33:58,897 Epoch 33 Step: 79300 Batch Loss: 1.591927 Tokens per Sec: 21917, Lr: 0.000300 2020-02-12 18:34:08,875 Epoch 33 Step: 79400 Batch Loss: 1.468979 Tokens per Sec: 21481, Lr: 0.000300 2020-02-12 18:34:18,834 Epoch 33 Step: 79500 Batch Loss: 1.671269 Tokens per Sec: 21957, Lr: 0.000300 2020-02-12 18:34:28,939 Epoch 33 Step: 79600 Batch Loss: 1.482982 Tokens per Sec: 22092, Lr: 0.000300 2020-02-12 18:34:39,153 Epoch 33 Step: 79700 Batch Loss: 1.376474 Tokens per Sec: 22101, Lr: 0.000300 2020-02-12 18:34:49,328 Epoch 33 Step: 79800 Batch Loss: 1.424147 Tokens per Sec: 21378, Lr: 0.000300 2020-02-12 18:34:59,370 Epoch 33 Step: 79900 Batch Loss: 1.489866 Tokens per Sec: 21821, Lr: 0.000300 2020-02-12 18:35:09,338 Epoch 33 Step: 80000 Batch Loss: 1.484129 Tokens per Sec: 22335, Lr: 0.000300 2020-02-12 18:35:28,519 Hooray! New best validation result [ppl]! 2020-02-12 18:35:28,519 Saving new checkpoint. 2020-02-12 18:35:28,706 Example #0 2020-02-12 18:35:28,706 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 18:35:28,706 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'sha', 'afatyô', 've', 'cii', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'kpaa', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 18:35:28,706 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 18:35:28,707 Reference: 10 : ​ 6 - 9 . 2020-02-12 18:35:28,707 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo sha afatyô ve cii vea za hemen u lun a dooshima u ve lu a mi la , shi vea za hemen u lun a dooshima u a lu a mi la kpaa . — Marku 10 : 6 - 9 . 2020-02-12 18:35:28,707 Example #1 2020-02-12 18:35:28,707 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 18:35:28,707 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'kpilighyol', 'u', 'a', 'lu', 'van', 'la', ',', 'man', 'ka', 'shighe', 'u', 'doon', 'tsung', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 18:35:28,707 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 18:35:28,707 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 18:35:28,707 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u kpilighyol u a lu van la , man ka shighe u doon tsung je la ! — Rom . 2020-02-12 18:35:28,707 Example #2 2020-02-12 18:35:28,707 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 18:35:28,707 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'gar', 'u', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 18:35:28,707 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 18:35:28,707 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 18:35:28,707 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken gar u Masedonia man Timoteu ken Efese . 2020-02-12 18:35:28,708 Example #3 2020-02-12 18:35:28,708 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 18:35:28,708 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', ',', 'nana', 'lu', 'eren', 'kwagh', 'u', 'vough', '.'] 2020-02-12 18:35:28,708 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 18:35:28,708 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 18:35:28,708 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô , nana lu eren kwagh u vough . 2020-02-12 18:35:28,708 Validation result (greedy) at epoch 33, step 80000: bleu: 26.72, loss: 43189.3750, ppl: 4.3012, duration: 19.3691s 2020-02-12 18:35:38,630 Epoch 33 Step: 80100 Batch Loss: 1.481780 Tokens per Sec: 22213, Lr: 0.000300 2020-02-12 18:35:48,594 Epoch 33 Step: 80200 Batch Loss: 1.577192 Tokens per Sec: 21733, Lr: 0.000300 2020-02-12 18:35:58,535 Epoch 33 Step: 80300 Batch Loss: 1.582227 Tokens per Sec: 21913, Lr: 0.000300 2020-02-12 18:36:08,474 Epoch 33 Step: 80400 Batch Loss: 1.559652 Tokens per Sec: 21997, Lr: 0.000300 2020-02-12 18:36:18,384 Epoch 33 Step: 80500 Batch Loss: 1.737085 Tokens per Sec: 22637, Lr: 0.000300 2020-02-12 18:36:28,538 Epoch 33 Step: 80600 Batch Loss: 1.466011 Tokens per Sec: 21947, Lr: 0.000300 2020-02-12 18:36:38,565 Epoch 33 Step: 80700 Batch Loss: 1.352051 Tokens per Sec: 21898, Lr: 0.000300 2020-02-12 18:36:48,801 Epoch 33 Step: 80800 Batch Loss: 1.576658 Tokens per Sec: 21514, Lr: 0.000300 2020-02-12 18:36:58,894 Epoch 33 Step: 80900 Batch Loss: 1.426946 Tokens per Sec: 22630, Lr: 0.000300 2020-02-12 18:37:08,874 Epoch 33 Step: 81000 Batch Loss: 1.722534 Tokens per Sec: 22082, Lr: 0.000300 2020-02-12 18:37:27,577 Example #0 2020-02-12 18:37:27,577 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 18:37:27,577 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'vesen', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'sha', 'afatyô', 've', 'cii', 'vea', 'lu', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'sha', 'dooshima', 'la', 'kpaa', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 18:37:27,577 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 18:37:27,578 Reference: 10 : ​ 6 - 9 . 2020-02-12 18:37:27,578 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u vesen yô , gba hange hange u noov man kasev vea nôngo sha afatyô ve cii vea lu a dooshima u ve lu a mi la , shi vea za hemen u lun a dooshima u a lu a mi sha dooshima la kpaa . — Marku 10 : 6 - 9 . 2020-02-12 18:37:27,578 Example #1 2020-02-12 18:37:27,578 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 18:37:27,578 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'a', 'lu', 'van', 'la', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 18:37:27,578 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 18:37:27,578 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 18:37:27,578 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u doon tsung ne , man ka shighe u a lu van la je la ! — Rom . 2020-02-12 18:37:27,578 Example #2 2020-02-12 18:37:27,578 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 18:37:27,578 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 18:37:27,578 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 18:37:27,578 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 18:37:27,578 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 18:37:27,579 Example #3 2020-02-12 18:37:27,579 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 18:37:27,579 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 18:37:27,579 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 18:37:27,579 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 18:37:27,579 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 18:37:27,579 Validation result (greedy) at epoch 33, step 81000: bleu: 26.59, loss: 43206.6523, ppl: 4.3038, duration: 18.7039s 2020-02-12 18:37:37,440 Epoch 33 Step: 81100 Batch Loss: 1.527473 Tokens per Sec: 21876, Lr: 0.000300 2020-02-12 18:37:42,101 Epoch 33: total training loss 3731.69 2020-02-12 18:37:42,101 EPOCH 34 2020-02-12 18:37:47,758 Epoch 34 Step: 81200 Batch Loss: 1.462878 Tokens per Sec: 20957, Lr: 0.000300 2020-02-12 18:37:57,853 Epoch 34 Step: 81300 Batch Loss: 1.601151 Tokens per Sec: 21998, Lr: 0.000300 2020-02-12 18:38:07,998 Epoch 34 Step: 81400 Batch Loss: 1.485654 Tokens per Sec: 21681, Lr: 0.000300 2020-02-12 18:38:17,972 Epoch 34 Step: 81500 Batch Loss: 1.589005 Tokens per Sec: 22488, Lr: 0.000300 2020-02-12 18:38:27,907 Epoch 34 Step: 81600 Batch Loss: 1.598463 Tokens per Sec: 22603, Lr: 0.000300 2020-02-12 18:38:37,814 Epoch 34 Step: 81700 Batch Loss: 1.311242 Tokens per Sec: 22009, Lr: 0.000300 2020-02-12 18:38:47,836 Epoch 34 Step: 81800 Batch Loss: 1.419813 Tokens per Sec: 21732, Lr: 0.000300 2020-02-12 18:38:57,789 Epoch 34 Step: 81900 Batch Loss: 1.688888 Tokens per Sec: 21235, Lr: 0.000300 2020-02-12 18:39:07,741 Epoch 34 Step: 82000 Batch Loss: 1.339236 Tokens per Sec: 22345, Lr: 0.000300 2020-02-12 18:39:26,341 Example #0 2020-02-12 18:39:26,341 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 18:39:26,341 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'vesen', 'yô', ',', 'gba', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'sha', 'afatyô', 've', 'cii', 'vea', 'lu', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', 'kpaa', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 18:39:26,341 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 18:39:26,341 Reference: 10 : ​ 6 - 9 . 2020-02-12 18:39:26,341 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u vesen yô , gba u noov man kasev vea nôngo sha afatyô ve cii vea lu a dooshima u ve lu a mi la , shi vea za hemen u lun a dooshima u a lu hen atô ve la kpaa . — Marku 10 : 6 - 9 . 2020-02-12 18:39:26,342 Example #1 2020-02-12 18:39:26,342 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 18:39:26,342 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'doon', 'tsung', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 18:39:26,342 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 18:39:26,342 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 18:39:26,342 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u doon tsung ne , man ka shighe u doon tsung je la ! — Rom . 2020-02-12 18:39:26,342 Example #2 2020-02-12 18:39:26,342 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 18:39:26,342 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 18:39:26,342 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 18:39:26,342 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 18:39:26,342 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 18:39:26,342 Example #3 2020-02-12 18:39:26,342 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 18:39:26,342 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 18:39:26,342 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 18:39:26,343 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 18:39:26,343 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 18:39:26,343 Validation result (greedy) at epoch 34, step 82000: bleu: 26.40, loss: 43276.7305, ppl: 4.3140, duration: 18.6016s 2020-02-12 18:39:36,191 Epoch 34 Step: 82100 Batch Loss: 1.481798 Tokens per Sec: 22698, Lr: 0.000300 2020-02-12 18:39:46,088 Epoch 34 Step: 82200 Batch Loss: 1.353601 Tokens per Sec: 22452, Lr: 0.000300 2020-02-12 18:39:56,006 Epoch 34 Step: 82300 Batch Loss: 1.304360 Tokens per Sec: 21730, Lr: 0.000300 2020-02-12 18:40:05,978 Epoch 34 Step: 82400 Batch Loss: 1.737311 Tokens per Sec: 21748, Lr: 0.000300 2020-02-12 18:40:15,900 Epoch 34 Step: 82500 Batch Loss: 1.591089 Tokens per Sec: 22673, Lr: 0.000300 2020-02-12 18:40:25,848 Epoch 34 Step: 82600 Batch Loss: 1.255904 Tokens per Sec: 22787, Lr: 0.000300 2020-02-12 18:40:35,755 Epoch 34 Step: 82700 Batch Loss: 1.470125 Tokens per Sec: 22542, Lr: 0.000300 2020-02-12 18:40:45,681 Epoch 34 Step: 82800 Batch Loss: 1.108021 Tokens per Sec: 21793, Lr: 0.000300 2020-02-12 18:40:55,720 Epoch 34 Step: 82900 Batch Loss: 1.466228 Tokens per Sec: 21924, Lr: 0.000300 2020-02-12 18:41:05,719 Epoch 34 Step: 83000 Batch Loss: 1.386630 Tokens per Sec: 22425, Lr: 0.000300 2020-02-12 18:41:25,026 Example #0 2020-02-12 18:41:25,026 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 18:41:25,026 Raw hypothesis: ['Er', 'Yehova', 'a', 'ver', 'ivese', 'i', 'tsôron', 'yô', ',', 'doo', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'tese', 'dooshima', 've', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'sha', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 18:41:25,026 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 18:41:25,026 Reference: 10 : ​ 6 - 9 . 2020-02-12 18:41:25,026 Hypothesis: Er Yehova a ver ivese i tsôron yô , doo u noov man kasev vea nôngo kpoghuloo vea tese dooshima ve shi vea za hemen u lun a dooshima sha dooshima u a lu hen atô ve la . — Marku 10 : 6 - 9 . 2020-02-12 18:41:25,026 Example #1 2020-02-12 18:41:25,026 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 18:41:25,026 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'a', 'lu', 'ikyua', 'ikyua', '!', '—', 'Rom', '.'] 2020-02-12 18:41:25,026 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 18:41:25,026 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 18:41:25,027 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u doon tsung ne , man a lu ikyua ikyua ! — Rom . 2020-02-12 18:41:25,027 Example #2 2020-02-12 18:41:25,027 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 18:41:25,027 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 18:41:25,027 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 18:41:25,027 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 18:41:25,027 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 18:41:25,027 Example #3 2020-02-12 18:41:25,027 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 18:41:25,027 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 18:41:25,027 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 18:41:25,027 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 18:41:25,027 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 18:41:25,027 Validation result (greedy) at epoch 34, step 83000: bleu: 27.06, loss: 43271.8711, ppl: 4.3132, duration: 19.3075s 2020-02-12 18:41:35,015 Epoch 34 Step: 83100 Batch Loss: 1.410264 Tokens per Sec: 22608, Lr: 0.000300 2020-02-12 18:41:44,965 Epoch 34 Step: 83200 Batch Loss: 1.317073 Tokens per Sec: 22137, Lr: 0.000300 2020-02-12 18:41:54,949 Epoch 34 Step: 83300 Batch Loss: 1.681472 Tokens per Sec: 22187, Lr: 0.000300 2020-02-12 18:42:04,841 Epoch 34 Step: 83400 Batch Loss: 1.573270 Tokens per Sec: 22155, Lr: 0.000300 2020-02-12 18:42:14,848 Epoch 34 Step: 83500 Batch Loss: 1.034131 Tokens per Sec: 22402, Lr: 0.000300 2020-02-12 18:42:24,840 Epoch 34 Step: 83600 Batch Loss: 1.488046 Tokens per Sec: 21919, Lr: 0.000300 2020-02-12 18:42:25,346 Epoch 34: total training loss 3708.17 2020-02-12 18:42:25,347 EPOCH 35 2020-02-12 18:42:35,051 Epoch 35 Step: 83700 Batch Loss: 1.693952 Tokens per Sec: 21837, Lr: 0.000300 2020-02-12 18:42:45,170 Epoch 35 Step: 83800 Batch Loss: 1.699639 Tokens per Sec: 21521, Lr: 0.000300 2020-02-12 18:42:55,353 Epoch 35 Step: 83900 Batch Loss: 1.460523 Tokens per Sec: 21808, Lr: 0.000300 2020-02-12 18:43:05,543 Epoch 35 Step: 84000 Batch Loss: 1.214787 Tokens per Sec: 22262, Lr: 0.000300 2020-02-12 18:43:24,255 Hooray! New best validation result [ppl]! 2020-02-12 18:43:24,256 Saving new checkpoint. 2020-02-12 18:43:24,456 Example #0 2020-02-12 18:43:24,456 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 18:43:24,456 Raw hypothesis: ['Er', 'Yehova', 'a', 'ver', 'ivese', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'sha', 'afatyô', 've', 'cii', 'vea', 'lu', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'sha', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'kpaa', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 18:43:24,456 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 18:43:24,456 Reference: 10 : ​ 6 - 9 . 2020-02-12 18:43:24,456 Hypothesis: Er Yehova a ver ivese i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo sha afatyô ve cii vea lu a dooshima u ve lu a mi la , shi vea za hemen u lun a dooshima sha dooshima u a lu a mi la kpaa . — Marku 10 : 6 - 9 . 2020-02-12 18:43:24,456 Example #1 2020-02-12 18:43:24,456 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 18:43:24,457 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'doon', 'tsung', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 18:43:24,457 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 18:43:24,457 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 18:43:24,457 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u doon tsung ne , man ka shighe u doon tsung je la ! — Rom . 2020-02-12 18:43:24,457 Example #2 2020-02-12 18:43:24,457 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 18:43:24,457 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 18:43:24,457 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 18:43:24,457 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 18:43:24,457 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 18:43:24,457 Example #3 2020-02-12 18:43:24,457 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 18:43:24,457 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 18:43:24,457 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 18:43:24,457 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 18:43:24,457 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga yô . 2020-02-12 18:43:24,458 Validation result (greedy) at epoch 35, step 84000: bleu: 26.34, loss: 43082.5039, ppl: 4.2857, duration: 18.9140s 2020-02-12 18:43:34,532 Epoch 35 Step: 84100 Batch Loss: 1.639282 Tokens per Sec: 21566, Lr: 0.000300 2020-02-12 18:43:44,646 Epoch 35 Step: 84200 Batch Loss: 1.561627 Tokens per Sec: 21959, Lr: 0.000300 2020-02-12 18:43:54,872 Epoch 35 Step: 84300 Batch Loss: 1.474816 Tokens per Sec: 21121, Lr: 0.000300 2020-02-12 18:44:04,913 Epoch 35 Step: 84400 Batch Loss: 1.469037 Tokens per Sec: 22209, Lr: 0.000300 2020-02-12 18:44:15,004 Epoch 35 Step: 84500 Batch Loss: 1.625333 Tokens per Sec: 21471, Lr: 0.000300 2020-02-12 18:44:25,110 Epoch 35 Step: 84600 Batch Loss: 1.541934 Tokens per Sec: 21504, Lr: 0.000300 2020-02-12 18:44:35,247 Epoch 35 Step: 84700 Batch Loss: 1.731332 Tokens per Sec: 21637, Lr: 0.000300 2020-02-12 18:44:45,422 Epoch 35 Step: 84800 Batch Loss: 1.472777 Tokens per Sec: 21988, Lr: 0.000300 2020-02-12 18:44:55,597 Epoch 35 Step: 84900 Batch Loss: 1.377725 Tokens per Sec: 22103, Lr: 0.000300 2020-02-12 18:45:05,820 Epoch 35 Step: 85000 Batch Loss: 1.328117 Tokens per Sec: 22208, Lr: 0.000300 2020-02-12 18:45:27,085 Example #0 2020-02-12 18:45:27,085 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 18:45:27,085 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'sha', 'afatyô', 've', 'cii', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'sha', 'dooshima', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 18:45:27,085 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 18:45:27,085 Reference: 10 : ​ 6 - 9 . 2020-02-12 18:45:27,085 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo sha afatyô ve cii vea lu a dooshima u a lu a mi la shi vea za hemen u lun a dooshima u a lu a mi sha dooshima la her . — Marku 10 : 6 - 9 . 2020-02-12 18:45:27,085 Example #1 2020-02-12 18:45:27,085 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 18:45:27,085 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'a', 'lu', 'ikyua', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 18:45:27,085 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 18:45:27,086 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 18:45:27,086 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u doon tsung ne , man ka shighe u a lu ikyua je la ! — Rom . 2020-02-12 18:45:27,086 Example #2 2020-02-12 18:45:27,086 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 18:45:27,086 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 18:45:27,086 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 18:45:27,086 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 18:45:27,086 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 18:45:27,086 Example #3 2020-02-12 18:45:27,086 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 18:45:27,086 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 18:45:27,086 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 18:45:27,086 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 18:45:27,086 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-12 18:45:27,086 Validation result (greedy) at epoch 35, step 85000: bleu: 26.34, loss: 43082.5703, ppl: 4.2857, duration: 21.2659s 2020-02-12 18:45:37,288 Epoch 35 Step: 85100 Batch Loss: 1.639804 Tokens per Sec: 21667, Lr: 0.000300 2020-02-12 18:45:47,465 Epoch 35 Step: 85200 Batch Loss: 1.620586 Tokens per Sec: 21637, Lr: 0.000300 2020-02-12 18:45:57,446 Epoch 35 Step: 85300 Batch Loss: 1.365478 Tokens per Sec: 22318, Lr: 0.000300 2020-02-12 18:46:07,421 Epoch 35 Step: 85400 Batch Loss: 1.524417 Tokens per Sec: 22109, Lr: 0.000300 2020-02-12 18:46:17,314 Epoch 35 Step: 85500 Batch Loss: 1.597857 Tokens per Sec: 22626, Lr: 0.000300 2020-02-12 18:46:27,241 Epoch 35 Step: 85600 Batch Loss: 1.524714 Tokens per Sec: 21516, Lr: 0.000300 2020-02-12 18:46:37,122 Epoch 35 Step: 85700 Batch Loss: 1.346553 Tokens per Sec: 22381, Lr: 0.000300 2020-02-12 18:46:47,119 Epoch 35 Step: 85800 Batch Loss: 1.310620 Tokens per Sec: 22618, Lr: 0.000300 2020-02-12 18:46:57,063 Epoch 35 Step: 85900 Batch Loss: 1.388763 Tokens per Sec: 21864, Lr: 0.000300 2020-02-12 18:47:07,103 Epoch 35 Step: 86000 Batch Loss: 1.801625 Tokens per Sec: 21782, Lr: 0.000300 2020-02-12 18:47:25,440 Example #0 2020-02-12 18:47:25,440 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 18:47:25,441 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'sha', 'afatyô', 've', 'cii', 'vea', 'lu', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'la', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'sha', 'dooshima', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 18:47:25,441 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 18:47:25,441 Reference: 10 : ​ 6 - 9 . 2020-02-12 18:47:25,441 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo sha afatyô ve cii vea lu a dooshima u ve lu a mi la shi vea za hemen u lun a dooshima u a lu a mi sha dooshima la . — Marku 10 : 6 - 9 . 2020-02-12 18:47:25,441 Example #1 2020-02-12 18:47:25,441 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 18:47:25,441 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'a', 'lu', 'van', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 18:47:25,441 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 18:47:25,441 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 18:47:25,441 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u doon tsung ne , man ka shighe u a lu van je la ! — Rom . 2020-02-12 18:47:25,441 Example #2 2020-02-12 18:47:25,441 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 18:47:25,441 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 18:47:25,441 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 18:47:25,441 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 18:47:25,442 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 18:47:25,442 Example #3 2020-02-12 18:47:25,442 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 18:47:25,442 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 18:47:25,442 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 18:47:25,442 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 18:47:25,442 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 18:47:25,442 Validation result (greedy) at epoch 35, step 86000: bleu: 26.08, loss: 43508.9648, ppl: 4.3479, duration: 18.3386s 2020-02-12 18:47:31,757 Epoch 35: total training loss 3702.39 2020-02-12 18:47:31,758 EPOCH 36 2020-02-12 18:47:35,612 Epoch 36 Step: 86100 Batch Loss: 1.471756 Tokens per Sec: 21372, Lr: 0.000300 2020-02-12 18:47:45,592 Epoch 36 Step: 86200 Batch Loss: 1.637571 Tokens per Sec: 22333, Lr: 0.000300 2020-02-12 18:47:55,571 Epoch 36 Step: 86300 Batch Loss: 1.488657 Tokens per Sec: 22761, Lr: 0.000300 2020-02-12 18:48:05,458 Epoch 36 Step: 86400 Batch Loss: 1.228675 Tokens per Sec: 22144, Lr: 0.000300 2020-02-12 18:48:15,389 Epoch 36 Step: 86500 Batch Loss: 1.424892 Tokens per Sec: 22181, Lr: 0.000300 2020-02-12 18:48:25,460 Epoch 36 Step: 86600 Batch Loss: 1.349387 Tokens per Sec: 21981, Lr: 0.000300 2020-02-12 18:48:35,341 Epoch 36 Step: 86700 Batch Loss: 1.596545 Tokens per Sec: 22082, Lr: 0.000300 2020-02-12 18:48:45,262 Epoch 36 Step: 86800 Batch Loss: 1.559382 Tokens per Sec: 22238, Lr: 0.000300 2020-02-12 18:48:55,304 Epoch 36 Step: 86900 Batch Loss: 1.540384 Tokens per Sec: 21606, Lr: 0.000300 2020-02-12 18:49:05,297 Epoch 36 Step: 87000 Batch Loss: 1.669402 Tokens per Sec: 22417, Lr: 0.000300 2020-02-12 18:49:23,826 Hooray! New best validation result [ppl]! 2020-02-12 18:49:23,826 Saving new checkpoint. 2020-02-12 18:49:24,012 Example #0 2020-02-12 18:49:24,012 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 18:49:24,013 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'sha', 'afatyô', 've', 'cii', 'vea', 'lu', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 18:49:24,013 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 18:49:24,013 Reference: 10 : ​ 6 - 9 . 2020-02-12 18:49:24,013 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo sha afatyô ve cii vea lu a dooshima u ve lu a mi la , shi vea za hemen u lun a dooshima u a lu hen atô ve la . — Marku 10 : 6 - 9 . 2020-02-12 18:49:24,013 Example #1 2020-02-12 18:49:24,013 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 18:49:24,013 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'doon', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 18:49:24,013 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 18:49:24,013 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 18:49:24,013 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u doon tsung ne , man ka shighe u doon je la ! — Rom . 2020-02-12 18:49:24,013 Example #2 2020-02-12 18:49:24,013 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 18:49:24,013 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'gar', 'u', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', '.'] 2020-02-12 18:49:24,014 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 18:49:24,014 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 18:49:24,014 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken gar u Masedonia man Timoteu . 2020-02-12 18:49:24,014 Example #3 2020-02-12 18:49:24,014 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 18:49:24,014 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 18:49:24,014 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 18:49:24,014 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 18:49:24,014 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-12 18:49:24,014 Validation result (greedy) at epoch 36, step 87000: bleu: 26.71, loss: 42968.9414, ppl: 4.2693, duration: 18.7169s 2020-02-12 18:49:33,951 Epoch 36 Step: 87100 Batch Loss: 1.685967 Tokens per Sec: 21880, Lr: 0.000300 2020-02-12 18:49:43,852 Epoch 36 Step: 87200 Batch Loss: 1.816586 Tokens per Sec: 22004, Lr: 0.000300 2020-02-12 18:49:53,858 Epoch 36 Step: 87300 Batch Loss: 1.724393 Tokens per Sec: 22361, Lr: 0.000300 2020-02-12 18:50:03,860 Epoch 36 Step: 87400 Batch Loss: 1.718344 Tokens per Sec: 21731, Lr: 0.000300 2020-02-12 18:50:13,870 Epoch 36 Step: 87500 Batch Loss: 1.519242 Tokens per Sec: 21916, Lr: 0.000300 2020-02-12 18:50:23,861 Epoch 36 Step: 87600 Batch Loss: 1.557260 Tokens per Sec: 22635, Lr: 0.000300 2020-02-12 18:50:33,802 Epoch 36 Step: 87700 Batch Loss: 1.665840 Tokens per Sec: 22828, Lr: 0.000300 2020-02-12 18:50:43,691 Epoch 36 Step: 87800 Batch Loss: 1.644379 Tokens per Sec: 21592, Lr: 0.000300 2020-02-12 18:50:53,730 Epoch 36 Step: 87900 Batch Loss: 1.404462 Tokens per Sec: 22407, Lr: 0.000300 2020-02-12 18:51:03,749 Epoch 36 Step: 88000 Batch Loss: 0.999603 Tokens per Sec: 21026, Lr: 0.000300 2020-02-12 18:51:22,495 Hooray! New best validation result [ppl]! 2020-02-12 18:51:22,495 Saving new checkpoint. 2020-02-12 18:51:22,694 Example #0 2020-02-12 18:51:22,694 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 18:51:22,694 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'sha', 'afatyô', 've', 'cii', 'vea', 'lu', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'la', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'sha', 'dooshima', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 18:51:22,695 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 18:51:22,695 Reference: 10 : ​ 6 - 9 . 2020-02-12 18:51:22,695 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo sha afatyô ve cii vea lu a dooshima u ve lu a mi la shi vea za hemen u lun a dooshima sha dooshima la . — Marku 10 : 6 - 9 . 2020-02-12 18:51:22,695 Example #1 2020-02-12 18:51:22,695 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 18:51:22,695 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'ngu', 'ikyua', 'ikyua', '!', '—', 'Rom', '.'] 2020-02-12 18:51:22,695 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 18:51:22,695 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 18:51:22,695 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u doon tsung ne , man kwagh ne ngu ikyua ikyua ! — Rom . 2020-02-12 18:51:22,695 Example #2 2020-02-12 18:51:22,695 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 18:51:22,695 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'gar', 'u', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 18:51:22,695 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 18:51:22,695 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 18:51:22,695 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken gar u Masedonia man Timoteu ken Efese . 2020-02-12 18:51:22,696 Example #3 2020-02-12 18:51:22,696 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 18:51:22,696 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 18:51:22,696 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 18:51:22,696 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 18:51:22,696 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 18:51:22,696 Validation result (greedy) at epoch 36, step 88000: bleu: 27.23, loss: 42866.5898, ppl: 4.2546, duration: 18.9462s 2020-02-12 18:51:32,711 Epoch 36 Step: 88100 Batch Loss: 1.623775 Tokens per Sec: 22676, Lr: 0.000300 2020-02-12 18:51:42,685 Epoch 36 Step: 88200 Batch Loss: 1.466692 Tokens per Sec: 21892, Lr: 0.000300 2020-02-12 18:51:52,790 Epoch 36 Step: 88300 Batch Loss: 1.538692 Tokens per Sec: 21730, Lr: 0.000300 2020-02-12 18:52:02,874 Epoch 36 Step: 88400 Batch Loss: 1.282837 Tokens per Sec: 21887, Lr: 0.000300 2020-02-12 18:52:12,988 Epoch 36 Step: 88500 Batch Loss: 1.411104 Tokens per Sec: 22359, Lr: 0.000300 2020-02-12 18:52:15,524 Epoch 36: total training loss 3687.16 2020-02-12 18:52:15,525 EPOCH 37 2020-02-12 18:52:23,372 Epoch 37 Step: 88600 Batch Loss: 1.578682 Tokens per Sec: 22195, Lr: 0.000300 2020-02-12 18:52:33,389 Epoch 37 Step: 88700 Batch Loss: 1.241001 Tokens per Sec: 21886, Lr: 0.000300 2020-02-12 18:52:43,361 Epoch 37 Step: 88800 Batch Loss: 1.201291 Tokens per Sec: 22383, Lr: 0.000300 2020-02-12 18:52:53,363 Epoch 37 Step: 88900 Batch Loss: 1.709435 Tokens per Sec: 22107, Lr: 0.000300 2020-02-12 18:53:03,367 Epoch 37 Step: 89000 Batch Loss: 1.589106 Tokens per Sec: 22184, Lr: 0.000300 2020-02-12 18:53:23,159 Example #0 2020-02-12 18:53:23,159 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 18:53:23,159 Raw hypothesis: ['Er', 'i', 'ver', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'sha', 'afatyô', 've', 'cii', 'vea', 'lu', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 18:53:23,159 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 18:53:23,159 Reference: 10 : ​ 6 - 9 . 2020-02-12 18:53:23,159 Hypothesis: Er i ver ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo sha afatyô ve cii vea lu a dooshima u ve lu a mi la , shi vea za hemen u lun a dooshima u a lu hen atô ve la her . — Marku 10 : 6 - 9 . 2020-02-12 18:53:23,159 Example #1 2020-02-12 18:53:23,160 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 18:53:23,160 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'imba', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'ngu', 'ikyua', 'ikyua', '!', '—', 'Rom', '.'] 2020-02-12 18:53:23,160 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 18:53:23,160 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 18:53:23,160 Hypothesis: Se kpa se fatyô u ‘ nengen ’ imba shighe u doon tsung ne , man kwagh ne ngu ikyua ikyua ! — Rom . 2020-02-12 18:53:23,160 Example #2 2020-02-12 18:53:23,160 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 18:53:23,160 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 18:53:23,160 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 18:53:23,160 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 18:53:23,160 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 18:53:23,160 Example #3 2020-02-12 18:53:23,160 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 18:53:23,160 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 18:53:23,160 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 18:53:23,160 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 18:53:23,161 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 18:53:23,161 Validation result (greedy) at epoch 37, step 89000: bleu: 27.21, loss: 42920.0195, ppl: 4.2623, duration: 19.7930s 2020-02-12 18:53:33,062 Epoch 37 Step: 89100 Batch Loss: 1.248026 Tokens per Sec: 22866, Lr: 0.000300 2020-02-12 18:53:42,932 Epoch 37 Step: 89200 Batch Loss: 1.314201 Tokens per Sec: 21853, Lr: 0.000300 2020-02-12 18:53:52,923 Epoch 37 Step: 89300 Batch Loss: 1.344919 Tokens per Sec: 22620, Lr: 0.000300 2020-02-12 18:54:02,826 Epoch 37 Step: 89400 Batch Loss: 1.736241 Tokens per Sec: 22344, Lr: 0.000300 2020-02-12 18:54:12,734 Epoch 37 Step: 89500 Batch Loss: 1.588313 Tokens per Sec: 22310, Lr: 0.000300 2020-02-12 18:54:22,693 Epoch 37 Step: 89600 Batch Loss: 1.478276 Tokens per Sec: 21175, Lr: 0.000300 2020-02-12 18:54:32,572 Epoch 37 Step: 89700 Batch Loss: 1.411070 Tokens per Sec: 22643, Lr: 0.000300 2020-02-12 18:54:42,474 Epoch 37 Step: 89800 Batch Loss: 1.473197 Tokens per Sec: 22565, Lr: 0.000300 2020-02-12 18:54:52,404 Epoch 37 Step: 89900 Batch Loss: 1.587320 Tokens per Sec: 22307, Lr: 0.000300 2020-02-12 18:55:02,299 Epoch 37 Step: 90000 Batch Loss: 1.508329 Tokens per Sec: 22363, Lr: 0.000300 2020-02-12 18:55:21,169 Hooray! New best validation result [ppl]! 2020-02-12 18:55:21,169 Saving new checkpoint. 2020-02-12 18:55:21,357 Example #0 2020-02-12 18:55:21,357 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 18:55:21,357 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 18:55:21,357 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 18:55:21,357 Reference: 10 : ​ 6 - 9 . 2020-02-12 18:55:21,357 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u ve lu a mi la , shi vea za hemen u lun a dooshima u a lu hen atô ve la her . — Marku 10 : 6 - 9 . 2020-02-12 18:55:21,358 Example #1 2020-02-12 18:55:21,358 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 18:55:21,358 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'doon', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 18:55:21,358 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 18:55:21,358 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 18:55:21,358 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u doon tsung ne , man ka shighe u doon je la ! — Rom . 2020-02-12 18:55:21,358 Example #2 2020-02-12 18:55:21,358 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 18:55:21,358 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 18:55:21,358 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 18:55:21,358 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 18:55:21,358 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 18:55:21,358 Example #3 2020-02-12 18:55:21,358 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 18:55:21,358 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 18:55:21,359 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 18:55:21,359 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 18:55:21,359 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga yô . 2020-02-12 18:55:21,359 Validation result (greedy) at epoch 37, step 90000: bleu: 26.99, loss: 42742.4453, ppl: 4.2368, duration: 19.0588s 2020-02-12 18:55:31,364 Epoch 37 Step: 90100 Batch Loss: 1.542992 Tokens per Sec: 22267, Lr: 0.000300 2020-02-12 18:55:41,219 Epoch 37 Step: 90200 Batch Loss: 1.301098 Tokens per Sec: 21948, Lr: 0.000300 2020-02-12 18:55:51,233 Epoch 37 Step: 90300 Batch Loss: 1.581165 Tokens per Sec: 22220, Lr: 0.000300 2020-02-12 18:56:01,320 Epoch 37 Step: 90400 Batch Loss: 1.298297 Tokens per Sec: 22246, Lr: 0.000300 2020-02-12 18:56:11,404 Epoch 37 Step: 90500 Batch Loss: 1.427120 Tokens per Sec: 21716, Lr: 0.000300 2020-02-12 18:56:21,501 Epoch 37 Step: 90600 Batch Loss: 1.588829 Tokens per Sec: 22171, Lr: 0.000300 2020-02-12 18:56:31,555 Epoch 37 Step: 90700 Batch Loss: 1.478509 Tokens per Sec: 21826, Lr: 0.000300 2020-02-12 18:56:41,506 Epoch 37 Step: 90800 Batch Loss: 1.479000 Tokens per Sec: 22165, Lr: 0.000300 2020-02-12 18:56:51,449 Epoch 37 Step: 90900 Batch Loss: 1.386248 Tokens per Sec: 22275, Lr: 0.000300 2020-02-12 18:56:59,251 Epoch 37: total training loss 3660.52 2020-02-12 18:56:59,251 EPOCH 38 2020-02-12 18:57:01,602 Epoch 38 Step: 91000 Batch Loss: 1.427308 Tokens per Sec: 19628, Lr: 0.000300 2020-02-12 18:57:20,587 Example #0 2020-02-12 18:57:20,587 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 18:57:20,587 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'doo', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'sha', 'dooshima', 'la', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 18:57:20,587 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 18:57:20,587 Reference: 10 : ​ 6 - 9 . 2020-02-12 18:57:20,587 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , doo u noov man kasev vea nôngo kpoghuloo vea za hemen u lun a dooshima u ve lu a mi sha dooshima la shi vea za hemen u lun a dooshima u a lu hen atô ve la . — Marku 10 : 6 - 9 . 2020-02-12 18:57:20,587 Example #1 2020-02-12 18:57:20,587 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 18:57:20,587 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'ngu', 'ikyua', '!', '—', 'Rom', '.'] 2020-02-12 18:57:20,587 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 18:57:20,587 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 18:57:20,588 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u doon tsung ne , man kwagh ne ngu ikyua ! — Rom . 2020-02-12 18:57:20,588 Example #2 2020-02-12 18:57:20,588 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 18:57:20,588 Raw hypothesis: ['Anyom', 'nga', 'kar', 'pue', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 18:57:20,588 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 18:57:20,588 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 18:57:20,588 Hypothesis: Anyom nga kar pue yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 18:57:20,588 Example #3 2020-02-12 18:57:20,588 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 18:57:20,588 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 18:57:20,588 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 18:57:20,588 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 18:57:20,588 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 18:57:20,588 Validation result (greedy) at epoch 38, step 91000: bleu: 26.99, loss: 42802.6641, ppl: 4.2454, duration: 18.9858s 2020-02-12 18:57:30,495 Epoch 38 Step: 91100 Batch Loss: 1.504720 Tokens per Sec: 21955, Lr: 0.000300 2020-02-12 18:57:40,481 Epoch 38 Step: 91200 Batch Loss: 1.241871 Tokens per Sec: 21879, Lr: 0.000300 2020-02-12 18:57:50,391 Epoch 38 Step: 91300 Batch Loss: 1.310850 Tokens per Sec: 22153, Lr: 0.000300 2020-02-12 18:58:00,264 Epoch 38 Step: 91400 Batch Loss: 1.494961 Tokens per Sec: 22312, Lr: 0.000300 2020-02-12 18:58:10,207 Epoch 38 Step: 91500 Batch Loss: 1.413595 Tokens per Sec: 21487, Lr: 0.000300 2020-02-12 18:58:20,261 Epoch 38 Step: 91600 Batch Loss: 1.347925 Tokens per Sec: 22396, Lr: 0.000300 2020-02-12 18:58:30,266 Epoch 38 Step: 91700 Batch Loss: 1.560416 Tokens per Sec: 22204, Lr: 0.000300 2020-02-12 18:58:40,174 Epoch 38 Step: 91800 Batch Loss: 1.107980 Tokens per Sec: 22358, Lr: 0.000300 2020-02-12 18:58:50,257 Epoch 38 Step: 91900 Batch Loss: 1.600115 Tokens per Sec: 22285, Lr: 0.000300 2020-02-12 18:59:00,192 Epoch 38 Step: 92000 Batch Loss: 1.616709 Tokens per Sec: 22131, Lr: 0.000300 2020-02-12 18:59:19,174 Hooray! New best validation result [ppl]! 2020-02-12 18:59:19,174 Saving new checkpoint. 2020-02-12 18:59:19,372 Example #0 2020-02-12 18:59:19,372 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 18:59:19,372 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'tsung', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 18:59:19,373 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 18:59:19,373 Reference: 10 : ​ 6 - 9 . 2020-02-12 18:59:19,373 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo tsung vea za hemen u lun a dooshima u ve lu a mi la , shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-12 18:59:19,373 Example #1 2020-02-12 18:59:19,373 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 18:59:19,373 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'imba', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'kwagh', 'u', 'a', 'lu', 'zan', 'hemen', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 18:59:19,373 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 18:59:19,373 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 18:59:19,373 Hypothesis: Se kpa se fatyô u ‘ nengen ’ imba shighe u doon tsung ne , man ka kwagh u a lu zan hemen je la ! — Rom . 2020-02-12 18:59:19,373 Example #2 2020-02-12 18:59:19,373 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 18:59:19,373 Raw hypothesis: ['Anyom', 'nga', 'kar', 'pue', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 18:59:19,373 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 18:59:19,373 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 18:59:19,373 Hypothesis: Anyom nga kar pue yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 18:59:19,373 Example #3 2020-02-12 18:59:19,374 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 18:59:19,374 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'u', 'vough', 'ga', '.'] 2020-02-12 18:59:19,374 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 18:59:19,374 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 18:59:19,374 Hypothesis: Alaghga or nana lu eren kwagh u vough ga . 2020-02-12 18:59:19,374 Validation result (greedy) at epoch 38, step 92000: bleu: 27.14, loss: 42720.5352, ppl: 4.2337, duration: 19.1813s 2020-02-12 18:59:29,376 Epoch 38 Step: 92100 Batch Loss: 1.624856 Tokens per Sec: 22536, Lr: 0.000300 2020-02-12 18:59:39,552 Epoch 38 Step: 92200 Batch Loss: 1.484140 Tokens per Sec: 22375, Lr: 0.000300 2020-02-12 18:59:49,594 Epoch 38 Step: 92300 Batch Loss: 1.423655 Tokens per Sec: 22174, Lr: 0.000300 2020-02-12 18:59:59,634 Epoch 38 Step: 92400 Batch Loss: 1.643185 Tokens per Sec: 21882, Lr: 0.000300 2020-02-12 19:00:09,586 Epoch 38 Step: 92500 Batch Loss: 1.697963 Tokens per Sec: 22515, Lr: 0.000300 2020-02-12 19:00:19,526 Epoch 38 Step: 92600 Batch Loss: 1.618335 Tokens per Sec: 22283, Lr: 0.000300 2020-02-12 19:00:29,418 Epoch 38 Step: 92700 Batch Loss: 1.590719 Tokens per Sec: 22767, Lr: 0.000300 2020-02-12 19:00:39,231 Epoch 38 Step: 92800 Batch Loss: 1.341234 Tokens per Sec: 22341, Lr: 0.000300 2020-02-12 19:00:49,136 Epoch 38 Step: 92900 Batch Loss: 1.442474 Tokens per Sec: 22161, Lr: 0.000300 2020-02-12 19:00:58,983 Epoch 38 Step: 93000 Batch Loss: 1.385193 Tokens per Sec: 22083, Lr: 0.000300 2020-02-12 19:01:17,420 Example #0 2020-02-12 19:01:17,420 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 19:01:17,420 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'vesen', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'sha', 'u', 've', 'kuran', 'dooshima', 've', 'shi', 've', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'hen', 'atô', 've', 'kpaa', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 19:01:17,420 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 19:01:17,420 Reference: 10 : ​ 6 - 9 . 2020-02-12 19:01:17,421 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u vesen yô , gba hange hange u noov man kasev vea nôngo sha u ve kuran dooshima ve shi ve za hemen u lun a dooshima hen atô ve kpaa . — Marku 10 : 6 - 9 . 2020-02-12 19:01:17,421 Example #1 2020-02-12 19:01:17,421 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 19:01:17,421 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'kwagh', 'u', 'a', 'lu', 'ikyua', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 19:01:17,421 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 19:01:17,421 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 19:01:17,421 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u doon tsung ne , man ka kwagh u a lu ikyua je la ! — Rom . 2020-02-12 19:01:17,421 Example #2 2020-02-12 19:01:17,421 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 19:01:17,421 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 19:01:17,421 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 19:01:17,421 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 19:01:17,421 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 19:01:17,421 Example #3 2020-02-12 19:01:17,421 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 19:01:17,421 Raw hypothesis: ['Alaghga', 'or', 'nana', 'fatyô', 'u', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 19:01:17,422 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 19:01:17,422 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 19:01:17,422 Hypothesis: Alaghga or nana fatyô u eren kwagh sha gbenda u vough ga yô . 2020-02-12 19:01:17,422 Validation result (greedy) at epoch 38, step 93000: bleu: 27.22, loss: 42736.4219, ppl: 4.2359, duration: 18.4380s 2020-02-12 19:01:27,290 Epoch 38 Step: 93100 Batch Loss: 1.433326 Tokens per Sec: 22260, Lr: 0.000300 2020-02-12 19:01:37,182 Epoch 38 Step: 93200 Batch Loss: 1.672109 Tokens per Sec: 21970, Lr: 0.000300 2020-02-12 19:01:47,233 Epoch 38 Step: 93300 Batch Loss: 1.434788 Tokens per Sec: 21869, Lr: 0.000300 2020-02-12 19:01:57,329 Epoch 38 Step: 93400 Batch Loss: 1.659827 Tokens per Sec: 21984, Lr: 0.000300 2020-02-12 19:02:01,148 Epoch 38: total training loss 3657.28 2020-02-12 19:02:01,148 EPOCH 39 2020-02-12 19:02:07,756 Epoch 39 Step: 93500 Batch Loss: 1.260407 Tokens per Sec: 20543, Lr: 0.000300 2020-02-12 19:02:17,650 Epoch 39 Step: 93600 Batch Loss: 1.352207 Tokens per Sec: 22298, Lr: 0.000300 2020-02-12 19:02:27,522 Epoch 39 Step: 93700 Batch Loss: 1.380288 Tokens per Sec: 22100, Lr: 0.000300 2020-02-12 19:02:37,410 Epoch 39 Step: 93800 Batch Loss: 1.637148 Tokens per Sec: 22327, Lr: 0.000300 2020-02-12 19:02:47,354 Epoch 39 Step: 93900 Batch Loss: 1.416775 Tokens per Sec: 22650, Lr: 0.000300 2020-02-12 19:02:57,272 Epoch 39 Step: 94000 Batch Loss: 1.225512 Tokens per Sec: 22569, Lr: 0.000300 2020-02-12 19:03:15,416 Example #0 2020-02-12 19:03:15,416 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 19:03:15,416 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'tsung', 'vea', 'kura', 'dooshima', 've', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'hen', 'atô', 've', 'kpaa', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 19:03:15,416 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 19:03:15,416 Reference: 10 : ​ 6 - 9 . 2020-02-12 19:03:15,417 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo tsung vea kura dooshima ve shi vea za hemen u lun a dooshima hen atô ve kpaa . — Marku 10 : 6 - 9 . 2020-02-12 19:03:15,417 Example #1 2020-02-12 19:03:15,417 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 19:03:15,417 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'imba', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'doon', 'tsung', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 19:03:15,417 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 19:03:15,417 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 19:03:15,417 Hypothesis: Se kpa se fatyô u ‘ nengen ’ imba shighe u doon tsung ne , man ka shighe u doon tsung je la ! — Rom . 2020-02-12 19:03:15,417 Example #2 2020-02-12 19:03:15,417 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 19:03:15,417 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'gar', 'u', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 19:03:15,417 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 19:03:15,417 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 19:03:15,417 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken gar u Masedonia man Timoteu ken Efese . 2020-02-12 19:03:15,417 Example #3 2020-02-12 19:03:15,417 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 19:03:15,417 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 19:03:15,418 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 19:03:15,418 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 19:03:15,418 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 19:03:15,418 Validation result (greedy) at epoch 39, step 94000: bleu: 27.10, loss: 42732.8672, ppl: 4.2354, duration: 18.1452s 2020-02-12 19:03:25,402 Epoch 39 Step: 94100 Batch Loss: 1.466648 Tokens per Sec: 21607, Lr: 0.000300 2020-02-12 19:03:35,408 Epoch 39 Step: 94200 Batch Loss: 1.360187 Tokens per Sec: 22301, Lr: 0.000300 2020-02-12 19:03:45,443 Epoch 39 Step: 94300 Batch Loss: 1.058477 Tokens per Sec: 22469, Lr: 0.000300 2020-02-12 19:03:55,501 Epoch 39 Step: 94400 Batch Loss: 1.371843 Tokens per Sec: 22309, Lr: 0.000300 2020-02-12 19:04:05,503 Epoch 39 Step: 94500 Batch Loss: 1.672807 Tokens per Sec: 22259, Lr: 0.000300 2020-02-12 19:04:15,393 Epoch 39 Step: 94600 Batch Loss: 1.603529 Tokens per Sec: 22273, Lr: 0.000300 2020-02-12 19:04:25,305 Epoch 39 Step: 94700 Batch Loss: 1.107766 Tokens per Sec: 21971, Lr: 0.000300 2020-02-12 19:04:35,217 Epoch 39 Step: 94800 Batch Loss: 1.465067 Tokens per Sec: 22501, Lr: 0.000300 2020-02-12 19:04:45,098 Epoch 39 Step: 94900 Batch Loss: 1.389929 Tokens per Sec: 21895, Lr: 0.000300 2020-02-12 19:04:55,043 Epoch 39 Step: 95000 Batch Loss: 1.555498 Tokens per Sec: 22024, Lr: 0.000300 2020-02-12 19:05:13,279 Hooray! New best validation result [ppl]! 2020-02-12 19:05:13,279 Saving new checkpoint. 2020-02-12 19:05:13,466 Example #0 2020-02-12 19:05:13,466 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 19:05:13,466 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'tsung', 'vea', 'lu', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'hen', 'atô', 've', 'kpaa', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 19:05:13,466 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 19:05:13,466 Reference: 10 : ​ 6 - 9 . 2020-02-12 19:05:13,466 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo tsung vea lu a dooshima u ve lu a mi la , shi vea za hemen u lun a dooshima hen atô ve kpaa . — Marku 10 : 6 - 9 . 2020-02-12 19:05:13,466 Example #1 2020-02-12 19:05:13,466 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 19:05:13,466 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'kwagh', 'u', 'a', 'lu', 'zan', 'hemen', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 19:05:13,466 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 19:05:13,467 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 19:05:13,467 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u doon tsung ne , man ka kwagh u a lu zan hemen je la ! — Rom . 2020-02-12 19:05:13,467 Example #2 2020-02-12 19:05:13,467 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 19:05:13,467 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'ngu', 'ken', 'gar', 'u', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 19:05:13,467 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 19:05:13,467 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 19:05:13,467 Hypothesis: Anyom nga kar er pue nahan yô , Paulu ngu ken gar u Masedonia man Timoteu ken Efese . 2020-02-12 19:05:13,467 Example #3 2020-02-12 19:05:13,467 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 19:05:13,467 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 19:05:13,467 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 19:05:13,467 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 19:05:13,467 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga yô . 2020-02-12 19:05:13,467 Validation result (greedy) at epoch 39, step 95000: bleu: 27.44, loss: 42683.0039, ppl: 4.2283, duration: 18.4242s 2020-02-12 19:05:23,364 Epoch 39 Step: 95100 Batch Loss: 1.421015 Tokens per Sec: 22775, Lr: 0.000300 2020-02-12 19:05:33,381 Epoch 39 Step: 95200 Batch Loss: 1.572883 Tokens per Sec: 21804, Lr: 0.000300 2020-02-12 19:05:43,344 Epoch 39 Step: 95300 Batch Loss: 1.596175 Tokens per Sec: 22673, Lr: 0.000300 2020-02-12 19:05:53,560 Epoch 39 Step: 95400 Batch Loss: 1.517899 Tokens per Sec: 21452, Lr: 0.000300 2020-02-12 19:06:03,664 Epoch 39 Step: 95500 Batch Loss: 1.659566 Tokens per Sec: 21523, Lr: 0.000300 2020-02-12 19:06:13,731 Epoch 39 Step: 95600 Batch Loss: 1.380299 Tokens per Sec: 21656, Lr: 0.000300 2020-02-12 19:06:23,891 Epoch 39 Step: 95700 Batch Loss: 1.439081 Tokens per Sec: 21991, Lr: 0.000300 2020-02-12 19:06:33,851 Epoch 39 Step: 95800 Batch Loss: 1.789518 Tokens per Sec: 22475, Lr: 0.000300 2020-02-12 19:06:43,257 Epoch 39: total training loss 3637.48 2020-02-12 19:06:43,258 EPOCH 40 2020-02-12 19:06:44,886 Epoch 40 Step: 95900 Batch Loss: 1.537510 Tokens per Sec: 8766, Lr: 0.000300 2020-02-12 19:06:54,845 Epoch 40 Step: 96000 Batch Loss: 1.456654 Tokens per Sec: 21420, Lr: 0.000300 2020-02-12 19:07:13,921 Example #0 2020-02-12 19:07:13,921 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 19:07:13,921 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'la', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'hen', 'atô', 've', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 19:07:13,921 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 19:07:13,921 Reference: 10 : ​ 6 - 9 . 2020-02-12 19:07:13,921 Hypothesis: Er ivese i Yehova i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u ve lu a mi la shi vea za hemen u lun a dooshima hen atô ve la . — Marku 10 : 6 - 9 . 2020-02-12 19:07:13,922 Example #1 2020-02-12 19:07:13,922 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 19:07:13,922 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'a', 'lu', 'ikyua', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 19:07:13,922 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 19:07:13,922 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 19:07:13,922 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u doon tsung ne , man ka shighe u a lu ikyua je la ! — Rom . 2020-02-12 19:07:13,922 Example #2 2020-02-12 19:07:13,922 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 19:07:13,922 Raw hypothesis: ['Anyom', 'nga', 'kar', 'pue', 'yô', ',', 'Paulu', 'ngu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 19:07:13,922 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 19:07:13,922 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 19:07:13,922 Hypothesis: Anyom nga kar pue yô , Paulu ngu ken Masedonia man Timoteu ken Efese . 2020-02-12 19:07:13,922 Example #3 2020-02-12 19:07:13,922 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 19:07:13,922 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'u', 'vough', 'ga', '.'] 2020-02-12 19:07:13,922 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 19:07:13,923 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 19:07:13,923 Hypothesis: Alaghga or nana lu eren kwagh u vough ga . 2020-02-12 19:07:13,923 Validation result (greedy) at epoch 40, step 96000: bleu: 26.76, loss: 42779.6797, ppl: 4.2421, duration: 19.0776s 2020-02-12 19:07:23,803 Epoch 40 Step: 96100 Batch Loss: 1.605883 Tokens per Sec: 22602, Lr: 0.000300 2020-02-12 19:07:33,751 Epoch 40 Step: 96200 Batch Loss: 1.541718 Tokens per Sec: 21907, Lr: 0.000300 2020-02-12 19:07:43,700 Epoch 40 Step: 96300 Batch Loss: 1.239610 Tokens per Sec: 22447, Lr: 0.000300 2020-02-12 19:07:53,674 Epoch 40 Step: 96400 Batch Loss: 1.475032 Tokens per Sec: 21701, Lr: 0.000300 2020-02-12 19:08:03,755 Epoch 40 Step: 96500 Batch Loss: 1.407906 Tokens per Sec: 21736, Lr: 0.000300 2020-02-12 19:08:13,874 Epoch 40 Step: 96600 Batch Loss: 1.153363 Tokens per Sec: 21929, Lr: 0.000300 2020-02-12 19:08:24,105 Epoch 40 Step: 96700 Batch Loss: 1.828637 Tokens per Sec: 21811, Lr: 0.000300 2020-02-12 19:08:34,192 Epoch 40 Step: 96800 Batch Loss: 1.473589 Tokens per Sec: 21971, Lr: 0.000300 2020-02-12 19:08:44,271 Epoch 40 Step: 96900 Batch Loss: 1.321732 Tokens per Sec: 21707, Lr: 0.000300 2020-02-12 19:08:54,436 Epoch 40 Step: 97000 Batch Loss: 1.635570 Tokens per Sec: 21166, Lr: 0.000300 2020-02-12 19:09:13,572 Example #0 2020-02-12 19:09:13,573 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 19:09:13,573 Raw hypothesis: ['Er', 'Yehova', 'a', 'ver', 'ivese', 'i', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'la', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'hen', 'atô', 've', 'kpaa', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 19:09:13,573 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 19:09:13,573 Reference: 10 : ​ 6 - 9 . 2020-02-12 19:09:13,573 Hypothesis: Er Yehova a ver ivese i tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u ve lu a mi la shi vea za hemen u lun a dooshima hen atô ve kpaa . — Marku 10 : 6 - 9 . 2020-02-12 19:09:13,573 Example #1 2020-02-12 19:09:13,573 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 19:09:13,573 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'doon', 'tsung', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 19:09:13,573 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 19:09:13,573 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 19:09:13,573 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u doon tsung ne , man ka shighe u doon tsung je la ! — Rom . 2020-02-12 19:09:13,573 Example #2 2020-02-12 19:09:13,574 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 19:09:13,574 Raw hypothesis: ['Anyom', 'nga', 'kar', 'pue', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 19:09:13,574 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 19:09:13,574 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 19:09:13,574 Hypothesis: Anyom nga kar pue yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 19:09:13,574 Example #3 2020-02-12 19:09:13,574 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 19:09:13,574 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 19:09:13,574 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 19:09:13,574 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 19:09:13,574 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 19:09:13,574 Validation result (greedy) at epoch 40, step 97000: bleu: 26.82, loss: 42734.2070, ppl: 4.2356, duration: 19.1373s 2020-02-12 19:09:23,861 Epoch 40 Step: 97100 Batch Loss: 1.438767 Tokens per Sec: 21506, Lr: 0.000300 2020-02-12 19:09:34,076 Epoch 40 Step: 97200 Batch Loss: 1.573959 Tokens per Sec: 21997, Lr: 0.000300 2020-02-12 19:09:44,047 Epoch 40 Step: 97300 Batch Loss: 1.417991 Tokens per Sec: 21994, Lr: 0.000300 2020-02-12 19:09:54,023 Epoch 40 Step: 97400 Batch Loss: 1.487690 Tokens per Sec: 22052, Lr: 0.000300 2020-02-12 19:10:04,046 Epoch 40 Step: 97500 Batch Loss: 1.772004 Tokens per Sec: 21938, Lr: 0.000300 2020-02-12 19:10:13,999 Epoch 40 Step: 97600 Batch Loss: 1.312956 Tokens per Sec: 21620, Lr: 0.000300 2020-02-12 19:10:23,925 Epoch 40 Step: 97700 Batch Loss: 1.559191 Tokens per Sec: 22376, Lr: 0.000300 2020-02-12 19:10:33,837 Epoch 40 Step: 97800 Batch Loss: 1.571149 Tokens per Sec: 22479, Lr: 0.000300 2020-02-12 19:10:43,750 Epoch 40 Step: 97900 Batch Loss: 1.446457 Tokens per Sec: 22731, Lr: 0.000300 2020-02-12 19:10:53,868 Epoch 40 Step: 98000 Batch Loss: 1.631741 Tokens per Sec: 22083, Lr: 0.000300 2020-02-12 19:11:12,761 Hooray! New best validation result [ppl]! 2020-02-12 19:11:12,761 Saving new checkpoint. 2020-02-12 19:11:12,959 Example #0 2020-02-12 19:11:12,959 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 19:11:12,960 Raw hypothesis: ['Er', 'Yehova', 'a', 'ver', 'ivese', 'i', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'tsung', 'vea', 'kura', 'dooshima', 've', 'la', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 19:11:12,960 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 19:11:12,960 Reference: 10 : ​ 6 - 9 . 2020-02-12 19:11:12,960 Hypothesis: Er Yehova a ver ivese i tsôron yô , gba hange hange u noov man kasev vea nôngo tsung vea kura dooshima ve la shi vea za hemen u lun a dooshima u a lu hen atô ve la . — Marku 10 : 6 - 9 . 2020-02-12 19:11:12,960 Example #1 2020-02-12 19:11:12,960 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 19:11:12,960 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'doon', 'tsung', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 19:11:12,960 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 19:11:12,960 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 19:11:12,960 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u doon tsung ne , man ka shighe u doon tsung je la ! — Rom . 2020-02-12 19:11:12,960 Example #2 2020-02-12 19:11:12,961 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 19:11:12,961 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 19:11:12,961 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 19:11:12,961 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 19:11:12,961 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 19:11:12,961 Example #3 2020-02-12 19:11:12,961 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 19:11:12,961 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 19:11:12,961 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 19:11:12,961 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 19:11:12,961 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-12 19:11:12,961 Validation result (greedy) at epoch 40, step 98000: bleu: 26.82, loss: 42487.8398, ppl: 4.2005, duration: 19.0924s 2020-02-12 19:11:22,899 Epoch 40 Step: 98100 Batch Loss: 1.432916 Tokens per Sec: 22632, Lr: 0.000300 2020-02-12 19:11:32,874 Epoch 40 Step: 98200 Batch Loss: 1.568846 Tokens per Sec: 22354, Lr: 0.000300 2020-02-12 19:11:42,821 Epoch 40 Step: 98300 Batch Loss: 1.597464 Tokens per Sec: 21759, Lr: 0.000300 2020-02-12 19:11:48,597 Epoch 40: total training loss 3638.42 2020-02-12 19:11:48,598 EPOCH 41 2020-02-12 19:11:53,011 Epoch 41 Step: 98400 Batch Loss: 1.513329 Tokens per Sec: 19997, Lr: 0.000300 2020-02-12 19:12:02,904 Epoch 41 Step: 98500 Batch Loss: 1.466146 Tokens per Sec: 23018, Lr: 0.000300 2020-02-12 19:12:12,879 Epoch 41 Step: 98600 Batch Loss: 1.089783 Tokens per Sec: 21961, Lr: 0.000300 2020-02-12 19:12:22,888 Epoch 41 Step: 98700 Batch Loss: 1.445934 Tokens per Sec: 21992, Lr: 0.000300 2020-02-12 19:12:32,805 Epoch 41 Step: 98800 Batch Loss: 1.283034 Tokens per Sec: 22434, Lr: 0.000300 2020-02-12 19:12:42,714 Epoch 41 Step: 98900 Batch Loss: 1.554645 Tokens per Sec: 22356, Lr: 0.000300 2020-02-12 19:12:52,714 Epoch 41 Step: 99000 Batch Loss: 1.265627 Tokens per Sec: 21973, Lr: 0.000300 2020-02-12 19:13:11,856 Example #0 2020-02-12 19:13:11,856 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 19:13:11,856 Raw hypothesis: ['Er', 'i', 'lu', 'Yehova', 'a', 'ver', 'ivese', 'i', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'hen', 'atô', 've', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 19:13:11,856 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 19:13:11,856 Reference: 10 : ​ 6 - 9 . 2020-02-12 19:13:11,856 Hypothesis: Er i lu Yehova a ver ivese i tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u ve lu a mi la , shi vea za hemen u lun a dooshima hen atô ve la her . — Marku 10 : 6 - 9 . 2020-02-12 19:13:11,856 Example #1 2020-02-12 19:13:11,856 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 19:13:11,857 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'doon', 'tsung', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 19:13:11,857 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 19:13:11,857 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 19:13:11,857 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u doon tsung ne , man ka shighe u doon tsung je la ! — Rom . 2020-02-12 19:13:11,857 Example #2 2020-02-12 19:13:11,857 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 19:13:11,857 Raw hypothesis: ['Anyom', 'nga', 'kar', 'pue', 'yô', ',', 'Paulu', 'ngu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 19:13:11,857 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 19:13:11,857 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 19:13:11,857 Hypothesis: Anyom nga kar pue yô , Paulu ngu ken Masedonia man Timoteu ken Efese . 2020-02-12 19:13:11,857 Example #3 2020-02-12 19:13:11,857 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 19:13:11,857 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 19:13:11,857 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 19:13:11,857 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 19:13:11,857 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-12 19:13:11,858 Validation result (greedy) at epoch 41, step 99000: bleu: 27.26, loss: 42561.0195, ppl: 4.2109, duration: 19.1435s 2020-02-12 19:13:21,826 Epoch 41 Step: 99100 Batch Loss: 1.508479 Tokens per Sec: 22314, Lr: 0.000300 2020-02-12 19:13:31,756 Epoch 41 Step: 99200 Batch Loss: 1.313427 Tokens per Sec: 21932, Lr: 0.000300 2020-02-12 19:13:41,836 Epoch 41 Step: 99300 Batch Loss: 1.510420 Tokens per Sec: 21983, Lr: 0.000300 2020-02-12 19:13:51,870 Epoch 41 Step: 99400 Batch Loss: 1.503596 Tokens per Sec: 21750, Lr: 0.000300 2020-02-12 19:14:01,770 Epoch 41 Step: 99500 Batch Loss: 1.417292 Tokens per Sec: 22565, Lr: 0.000300 2020-02-12 19:14:11,784 Epoch 41 Step: 99600 Batch Loss: 1.423728 Tokens per Sec: 21973, Lr: 0.000300 2020-02-12 19:14:21,812 Epoch 41 Step: 99700 Batch Loss: 1.564367 Tokens per Sec: 22007, Lr: 0.000300 2020-02-12 19:14:31,825 Epoch 41 Step: 99800 Batch Loss: 1.610996 Tokens per Sec: 22002, Lr: 0.000300 2020-02-12 19:14:41,898 Epoch 41 Step: 99900 Batch Loss: 1.385330 Tokens per Sec: 21567, Lr: 0.000300 2020-02-12 19:14:52,008 Epoch 41 Step: 100000 Batch Loss: 1.495299 Tokens per Sec: 21241, Lr: 0.000300 2020-02-12 19:15:11,283 Example #0 2020-02-12 19:15:11,284 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 19:15:11,284 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'tsung', 'vea', 'lu', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'la', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'sha', 'dooshima', 'u', 'una', 'fatyô', 'u', 'vesen', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 19:15:11,284 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 19:15:11,284 Reference: 10 : ​ 6 - 9 . 2020-02-12 19:15:11,284 Hypothesis: Er ivese i Yehova i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo tsung vea lu a dooshima u ve lu a mi la shi vea za hemen u lun a dooshima sha dooshima u una fatyô u vesen la . — Marku 10 : 6 - 9 . 2020-02-12 19:15:11,284 Example #1 2020-02-12 19:15:11,284 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 19:15:11,284 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'doon', 'tsung', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 19:15:11,284 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 19:15:11,284 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 19:15:11,284 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u doon tsung ne , man ka shighe u doon tsung je la ! — Rom . 2020-02-12 19:15:11,284 Example #2 2020-02-12 19:15:11,284 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 19:15:11,284 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'ngu', 'ken', 'gar', 'u', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', '.'] 2020-02-12 19:15:11,285 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 19:15:11,285 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 19:15:11,285 Hypothesis: Anyom nga kar er pue nahan yô , Paulu ngu ken gar u Masedonia man Timoteu . 2020-02-12 19:15:11,285 Example #3 2020-02-12 19:15:11,285 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 19:15:11,285 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 19:15:11,285 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 19:15:11,285 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 19:15:11,285 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 19:15:11,285 Validation result (greedy) at epoch 41, step 100000: bleu: 27.02, loss: 42515.5117, ppl: 4.2044, duration: 19.2771s 2020-02-12 19:15:21,469 Epoch 41 Step: 100100 Batch Loss: 1.507746 Tokens per Sec: 22562, Lr: 0.000300 2020-02-12 19:15:31,537 Epoch 41 Step: 100200 Batch Loss: 1.306457 Tokens per Sec: 21391, Lr: 0.000300 2020-02-12 19:15:41,576 Epoch 41 Step: 100300 Batch Loss: 1.616209 Tokens per Sec: 21566, Lr: 0.000300 2020-02-12 19:15:51,557 Epoch 41 Step: 100400 Batch Loss: 1.388582 Tokens per Sec: 22446, Lr: 0.000300 2020-02-12 19:16:01,503 Epoch 41 Step: 100500 Batch Loss: 1.521218 Tokens per Sec: 22322, Lr: 0.000300 2020-02-12 19:16:11,543 Epoch 41 Step: 100600 Batch Loss: 1.458920 Tokens per Sec: 21760, Lr: 0.000300 2020-02-12 19:16:21,546 Epoch 41 Step: 100700 Batch Loss: 1.448608 Tokens per Sec: 22449, Lr: 0.000300 2020-02-12 19:16:31,400 Epoch 41 Step: 100800 Batch Loss: 1.470143 Tokens per Sec: 22468, Lr: 0.000300 2020-02-12 19:16:33,473 Epoch 41: total training loss 3619.51 2020-02-12 19:16:33,473 EPOCH 42 2020-02-12 19:16:41,500 Epoch 42 Step: 100900 Batch Loss: 1.435033 Tokens per Sec: 21595, Lr: 0.000300 2020-02-12 19:16:51,393 Epoch 42 Step: 101000 Batch Loss: 1.575527 Tokens per Sec: 21642, Lr: 0.000300 2020-02-12 19:17:09,298 Example #0 2020-02-12 19:17:09,298 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 19:17:09,298 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'doo', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'sha', 'kwagh', 'u', 'dooshima', 'la', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'sha', 'dooshima', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 19:17:09,298 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 19:17:09,298 Reference: 10 : ​ 6 - 9 . 2020-02-12 19:17:09,298 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , doo u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u ve lu a mi sha kwagh u dooshima la shi vea za hemen u lun a dooshima sha dooshima . — Marku 10 : 6 - 9 . 2020-02-12 19:17:09,298 Example #1 2020-02-12 19:17:09,298 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 19:17:09,298 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'doon', 'tsung', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 19:17:09,298 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 19:17:09,298 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 19:17:09,298 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u doon tsung ne , man ka shighe u doon tsung je la ! — Rom . 2020-02-12 19:17:09,299 Example #2 2020-02-12 19:17:09,299 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 19:17:09,299 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 19:17:09,299 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 19:17:09,299 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 19:17:09,299 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 19:17:09,299 Example #3 2020-02-12 19:17:09,299 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 19:17:09,299 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 19:17:09,299 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 19:17:09,299 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 19:17:09,299 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 19:17:09,299 Validation result (greedy) at epoch 42, step 101000: bleu: 26.97, loss: 42570.8984, ppl: 4.2123, duration: 17.9058s 2020-02-12 19:17:19,316 Epoch 42 Step: 101100 Batch Loss: 1.553079 Tokens per Sec: 22482, Lr: 0.000300 2020-02-12 19:17:29,231 Epoch 42 Step: 101200 Batch Loss: 1.301014 Tokens per Sec: 22215, Lr: 0.000300 2020-02-12 19:17:39,116 Epoch 42 Step: 101300 Batch Loss: 1.449653 Tokens per Sec: 22617, Lr: 0.000300 2020-02-12 19:17:49,098 Epoch 42 Step: 101400 Batch Loss: 1.631011 Tokens per Sec: 22427, Lr: 0.000300 2020-02-12 19:17:59,010 Epoch 42 Step: 101500 Batch Loss: 1.750148 Tokens per Sec: 22446, Lr: 0.000300 2020-02-12 19:18:09,035 Epoch 42 Step: 101600 Batch Loss: 1.470835 Tokens per Sec: 21218, Lr: 0.000300 2020-02-12 19:18:19,178 Epoch 42 Step: 101700 Batch Loss: 1.481715 Tokens per Sec: 21707, Lr: 0.000300 2020-02-12 19:18:29,239 Epoch 42 Step: 101800 Batch Loss: 1.555187 Tokens per Sec: 22177, Lr: 0.000300 2020-02-12 19:18:39,196 Epoch 42 Step: 101900 Batch Loss: 1.532280 Tokens per Sec: 22090, Lr: 0.000300 2020-02-12 19:18:49,355 Epoch 42 Step: 102000 Batch Loss: 1.636755 Tokens per Sec: 21854, Lr: 0.000300 2020-02-12 19:19:08,755 Hooray! New best validation result [ppl]! 2020-02-12 19:19:08,755 Saving new checkpoint. 2020-02-12 19:19:08,942 Example #0 2020-02-12 19:19:08,943 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 19:19:08,943 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'tsung', 'vea', 'kura', 'dooshima', 've', 'la', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'una', 'fatyô', 'u', 'vesen', 'ken', 'dooshima', 'la', 'kpaa', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 19:19:08,943 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 19:19:08,943 Reference: 10 : ​ 6 - 9 . 2020-02-12 19:19:08,943 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo tsung vea kura dooshima ve la shi vea za hemen u lun a dooshima u una fatyô u vesen ken dooshima la kpaa . — Marku 10 : 6 - 9 . 2020-02-12 19:19:08,943 Example #1 2020-02-12 19:19:08,943 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 19:19:08,943 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'kwagh', 'u', 'a', 'lu', 'zan', 'hemen', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 19:19:08,943 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 19:19:08,943 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 19:19:08,943 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u doon tsung ne , man ka kwagh u a lu zan hemen je la ! — Rom . 2020-02-12 19:19:08,943 Example #2 2020-02-12 19:19:08,943 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 19:19:08,944 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 19:19:08,944 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 19:19:08,944 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 19:19:08,944 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 19:19:08,944 Example #3 2020-02-12 19:19:08,944 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 19:19:08,944 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 19:19:08,944 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 19:19:08,944 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 19:19:08,944 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga yô . 2020-02-12 19:19:08,944 Validation result (greedy) at epoch 42, step 102000: bleu: 26.98, loss: 42458.2344, ppl: 4.1963, duration: 19.5887s 2020-02-12 19:19:18,767 Epoch 42 Step: 102100 Batch Loss: 1.481674 Tokens per Sec: 22312, Lr: 0.000300 2020-02-12 19:19:28,873 Epoch 42 Step: 102200 Batch Loss: 1.595945 Tokens per Sec: 22070, Lr: 0.000300 2020-02-12 19:19:38,826 Epoch 42 Step: 102300 Batch Loss: 1.225494 Tokens per Sec: 21988, Lr: 0.000300 2020-02-12 19:19:48,745 Epoch 42 Step: 102400 Batch Loss: 1.390126 Tokens per Sec: 22497, Lr: 0.000300 2020-02-12 19:19:58,598 Epoch 42 Step: 102500 Batch Loss: 1.335515 Tokens per Sec: 22089, Lr: 0.000300 2020-02-12 19:20:08,579 Epoch 42 Step: 102600 Batch Loss: 1.337968 Tokens per Sec: 22312, Lr: 0.000300 2020-02-12 19:20:18,566 Epoch 42 Step: 102700 Batch Loss: 1.445141 Tokens per Sec: 22200, Lr: 0.000300 2020-02-12 19:20:28,565 Epoch 42 Step: 102800 Batch Loss: 1.646073 Tokens per Sec: 21426, Lr: 0.000300 2020-02-12 19:20:38,492 Epoch 42 Step: 102900 Batch Loss: 1.509813 Tokens per Sec: 23215, Lr: 0.000300 2020-02-12 19:20:48,430 Epoch 42 Step: 103000 Batch Loss: 1.385614 Tokens per Sec: 22245, Lr: 0.000300 2020-02-12 19:21:07,251 Hooray! New best validation result [ppl]! 2020-02-12 19:21:07,252 Saving new checkpoint. 2020-02-12 19:21:07,439 Example #0 2020-02-12 19:21:07,439 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 19:21:07,439 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'i', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'doo', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', 'kpaa', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 19:21:07,439 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 19:21:07,439 Reference: 10 : ​ 6 - 9 . 2020-02-12 19:21:07,439 Hypothesis: Er ivese i Yehova i ver la i lu kwagh u tsôron yô , doo u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu hen atô ve la shi vea za hemen u lun a dooshima u a lu hen atô ve la kpaa . — Marku 10 : 6 - 9 . 2020-02-12 19:21:07,439 Example #1 2020-02-12 19:21:07,439 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 19:21:07,439 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'imba', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'kwagh', 'u', 'a', 'lu', 'zan', 'hemen', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 19:21:07,439 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 19:21:07,439 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 19:21:07,439 Hypothesis: Se kpa se fatyô u ‘ nengen ’ imba shighe u doon tsung ne , man ka kwagh u a lu zan hemen je la ! — Rom . 2020-02-12 19:21:07,439 Example #2 2020-02-12 19:21:07,440 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 19:21:07,440 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'ngu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 19:21:07,440 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 19:21:07,440 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 19:21:07,440 Hypothesis: Anyom nga kar er pue nahan yô , Paulu ngu ken Masedonia man Timoteu ken Efese . 2020-02-12 19:21:07,440 Example #3 2020-02-12 19:21:07,440 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 19:21:07,440 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 19:21:07,440 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 19:21:07,440 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 19:21:07,440 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 19:21:07,440 Validation result (greedy) at epoch 42, step 103000: bleu: 27.01, loss: 42256.0586, ppl: 4.1678, duration: 19.0095s 2020-02-12 19:21:17,330 Epoch 42 Step: 103100 Batch Loss: 1.367376 Tokens per Sec: 22368, Lr: 0.000300 2020-02-12 19:21:27,317 Epoch 42 Step: 103200 Batch Loss: 1.284348 Tokens per Sec: 22370, Lr: 0.000300 2020-02-12 19:21:35,283 Epoch 42: total training loss 3602.32 2020-02-12 19:21:35,283 EPOCH 43 2020-02-12 19:21:37,552 Epoch 43 Step: 103300 Batch Loss: 1.199837 Tokens per Sec: 18944, Lr: 0.000300 2020-02-12 19:21:47,563 Epoch 43 Step: 103400 Batch Loss: 1.342023 Tokens per Sec: 22529, Lr: 0.000300 2020-02-12 19:21:57,578 Epoch 43 Step: 103500 Batch Loss: 1.599549 Tokens per Sec: 22017, Lr: 0.000300 2020-02-12 19:22:07,548 Epoch 43 Step: 103600 Batch Loss: 1.195239 Tokens per Sec: 22598, Lr: 0.000300 2020-02-12 19:22:17,478 Epoch 43 Step: 103700 Batch Loss: 1.632684 Tokens per Sec: 22153, Lr: 0.000300 2020-02-12 19:22:27,304 Epoch 43 Step: 103800 Batch Loss: 1.648339 Tokens per Sec: 22542, Lr: 0.000300 2020-02-12 19:22:37,262 Epoch 43 Step: 103900 Batch Loss: 1.418043 Tokens per Sec: 21870, Lr: 0.000300 2020-02-12 19:22:47,176 Epoch 43 Step: 104000 Batch Loss: 1.339333 Tokens per Sec: 22417, Lr: 0.000300 2020-02-12 19:23:05,799 Hooray! New best validation result [ppl]! 2020-02-12 19:23:05,799 Saving new checkpoint. 2020-02-12 19:23:05,987 Example #0 2020-02-12 19:23:05,987 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 19:23:05,987 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'sha', 'afatyô', 've', 'cii', 'vea', 'lu', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'kpaa', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 19:23:05,987 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 19:23:05,987 Reference: 10 : ​ 6 - 9 . 2020-02-12 19:23:05,987 Hypothesis: Er ivese i Yehova i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo sha afatyô ve cii vea lu a dooshima u ve lu a mi la , shi vea za hemen u lun a dooshima u a lu a mi la kpaa . — Marku 10 : 6 - 9 . 2020-02-12 19:23:05,987 Example #1 2020-02-12 19:23:05,987 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 19:23:05,987 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'kwagh', 'u', 'a', 'lu', 'zan', 'hemen', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 19:23:05,987 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 19:23:05,988 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 19:23:05,988 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u doon tsung ne , man ka kwagh u a lu zan hemen je la ! — Rom . 2020-02-12 19:23:05,988 Example #2 2020-02-12 19:23:05,988 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 19:23:05,988 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 19:23:05,988 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 19:23:05,988 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 19:23:05,988 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 19:23:05,988 Example #3 2020-02-12 19:23:05,988 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 19:23:05,988 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'inja', 'ga', '.'] 2020-02-12 19:23:05,988 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 19:23:05,988 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 19:23:05,988 Hypothesis: Alaghga or nana lu eren kwagh sha inja ga . 2020-02-12 19:23:05,988 Validation result (greedy) at epoch 43, step 104000: bleu: 26.97, loss: 42217.9531, ppl: 4.1624, duration: 18.8122s 2020-02-12 19:23:15,903 Epoch 43 Step: 104100 Batch Loss: 0.943873 Tokens per Sec: 21989, Lr: 0.000300 2020-02-12 19:23:25,810 Epoch 43 Step: 104200 Batch Loss: 1.263839 Tokens per Sec: 22828, Lr: 0.000300 2020-02-12 19:23:35,711 Epoch 43 Step: 104300 Batch Loss: 1.632320 Tokens per Sec: 22116, Lr: 0.000300 2020-02-12 19:23:45,656 Epoch 43 Step: 104400 Batch Loss: 1.261770 Tokens per Sec: 22468, Lr: 0.000300 2020-02-12 19:23:55,702 Epoch 43 Step: 104500 Batch Loss: 1.360483 Tokens per Sec: 22301, Lr: 0.000300 2020-02-12 19:24:05,630 Epoch 43 Step: 104600 Batch Loss: 1.457283 Tokens per Sec: 22019, Lr: 0.000300 2020-02-12 19:24:15,485 Epoch 43 Step: 104700 Batch Loss: 1.465027 Tokens per Sec: 22108, Lr: 0.000300 2020-02-12 19:24:25,615 Epoch 43 Step: 104800 Batch Loss: 1.505990 Tokens per Sec: 21596, Lr: 0.000300 2020-02-12 19:24:35,908 Epoch 43 Step: 104900 Batch Loss: 1.673941 Tokens per Sec: 22461, Lr: 0.000300 2020-02-12 19:24:45,991 Epoch 43 Step: 105000 Batch Loss: 1.291665 Tokens per Sec: 21414, Lr: 0.000300 2020-02-12 19:25:04,512 Example #0 2020-02-12 19:25:04,512 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 19:25:04,512 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'tsung', 've', 'vea', 'lu', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'la', 'shi', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'sha', 'dooshima', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 19:25:04,512 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 19:25:04,512 Reference: 10 : ​ 6 - 9 . 2020-02-12 19:25:04,512 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo tsung ve vea lu a dooshima u ve lu a mi la shi vea lu a dooshima u a lu a mi sha dooshima la her . — Marku 10 : 6 - 9 . 2020-02-12 19:25:04,512 Example #1 2020-02-12 19:25:04,512 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 19:25:04,512 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'kwagh', 'u', 'a', 'lu', 'ikyua', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 19:25:04,512 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 19:25:04,512 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 19:25:04,512 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u doon tsung ne , man ka kwagh u a lu ikyua je la ! — Rom . 2020-02-12 19:25:04,513 Example #2 2020-02-12 19:25:04,513 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 19:25:04,513 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 19:25:04,513 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 19:25:04,513 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 19:25:04,513 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 19:25:04,513 Example #3 2020-02-12 19:25:04,513 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 19:25:04,513 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 19:25:04,513 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 19:25:04,513 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 19:25:04,513 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga yô . 2020-02-12 19:25:04,513 Validation result (greedy) at epoch 43, step 105000: bleu: 27.16, loss: 42309.1602, ppl: 4.1752, duration: 18.5213s 2020-02-12 19:25:14,412 Epoch 43 Step: 105100 Batch Loss: 1.524856 Tokens per Sec: 21687, Lr: 0.000300 2020-02-12 19:25:24,343 Epoch 43 Step: 105200 Batch Loss: 1.692985 Tokens per Sec: 22488, Lr: 0.000300 2020-02-12 19:25:34,330 Epoch 43 Step: 105300 Batch Loss: 1.320625 Tokens per Sec: 22092, Lr: 0.000300 2020-02-12 19:25:44,227 Epoch 43 Step: 105400 Batch Loss: 1.628985 Tokens per Sec: 21923, Lr: 0.000300 2020-02-12 19:25:54,179 Epoch 43 Step: 105500 Batch Loss: 1.412692 Tokens per Sec: 22102, Lr: 0.000300 2020-02-12 19:26:04,208 Epoch 43 Step: 105600 Batch Loss: 1.712618 Tokens per Sec: 22229, Lr: 0.000300 2020-02-12 19:26:14,168 Epoch 43 Step: 105700 Batch Loss: 1.344894 Tokens per Sec: 21936, Lr: 0.000300 2020-02-12 19:26:18,274 Epoch 43: total training loss 3594.08 2020-02-12 19:26:18,274 EPOCH 44 2020-02-12 19:26:24,539 Epoch 44 Step: 105800 Batch Loss: 1.705497 Tokens per Sec: 21119, Lr: 0.000300 2020-02-12 19:26:34,723 Epoch 44 Step: 105900 Batch Loss: 1.551604 Tokens per Sec: 21415, Lr: 0.000300 2020-02-12 19:26:44,880 Epoch 44 Step: 106000 Batch Loss: 1.665979 Tokens per Sec: 21227, Lr: 0.000300 2020-02-12 19:27:04,342 Hooray! New best validation result [ppl]! 2020-02-12 19:27:04,342 Saving new checkpoint. 2020-02-12 19:27:04,543 Example #0 2020-02-12 19:27:04,543 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 19:27:04,543 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'sha', 'afatyô', 've', 'cii', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'una', 'seer', 'taver', 'yô', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 19:27:04,543 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 19:27:04,543 Reference: 10 : ​ 6 - 9 . 2020-02-12 19:27:04,543 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo sha afatyô ve cii vea lu a dooshima u a lu a mi la shi vea za hemen u lun a dooshima u una seer taver yô . — Marku 10 : 6 - 9 . 2020-02-12 19:27:04,543 Example #1 2020-02-12 19:27:04,543 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 19:27:04,543 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'doon', 'tsung', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 19:27:04,543 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 19:27:04,543 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 19:27:04,544 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u doon tsung ne , man ka shighe u doon tsung je la ! — Rom . 2020-02-12 19:27:04,544 Example #2 2020-02-12 19:27:04,544 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 19:27:04,544 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'ngu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 19:27:04,544 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 19:27:04,544 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 19:27:04,544 Hypothesis: Anyom nga kar er pue nahan yô , Paulu ngu ken Masedonia man Timoteu ken Efese . 2020-02-12 19:27:04,544 Example #3 2020-02-12 19:27:04,544 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 19:27:04,544 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'inja', 'ga', '.'] 2020-02-12 19:27:04,544 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 19:27:04,544 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 19:27:04,544 Hypothesis: Alaghga or nana lu eren kwagh sha inja ga . 2020-02-12 19:27:04,544 Validation result (greedy) at epoch 44, step 106000: bleu: 27.27, loss: 42175.6445, ppl: 4.1564, duration: 19.6633s 2020-02-12 19:27:14,583 Epoch 44 Step: 106100 Batch Loss: 1.459957 Tokens per Sec: 21971, Lr: 0.000300 2020-02-12 19:27:24,649 Epoch 44 Step: 106200 Batch Loss: 1.390532 Tokens per Sec: 22256, Lr: 0.000300 2020-02-12 19:27:34,745 Epoch 44 Step: 106300 Batch Loss: 1.452165 Tokens per Sec: 22047, Lr: 0.000300 2020-02-12 19:27:44,749 Epoch 44 Step: 106400 Batch Loss: 1.574034 Tokens per Sec: 22174, Lr: 0.000300 2020-02-12 19:27:54,690 Epoch 44 Step: 106500 Batch Loss: 1.435379 Tokens per Sec: 22638, Lr: 0.000300 2020-02-12 19:28:04,584 Epoch 44 Step: 106600 Batch Loss: 1.075854 Tokens per Sec: 22452, Lr: 0.000300 2020-02-12 19:28:14,506 Epoch 44 Step: 106700 Batch Loss: 1.195118 Tokens per Sec: 22541, Lr: 0.000300 2020-02-12 19:28:24,468 Epoch 44 Step: 106800 Batch Loss: 1.129620 Tokens per Sec: 21946, Lr: 0.000300 2020-02-12 19:28:34,354 Epoch 44 Step: 106900 Batch Loss: 1.409942 Tokens per Sec: 22647, Lr: 0.000300 2020-02-12 19:28:44,238 Epoch 44 Step: 107000 Batch Loss: 1.311540 Tokens per Sec: 21957, Lr: 0.000300 2020-02-12 19:29:03,752 Hooray! New best validation result [ppl]! 2020-02-12 19:29:03,753 Saving new checkpoint. 2020-02-12 19:29:03,940 Example #0 2020-02-12 19:29:03,940 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 19:29:03,940 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'doo', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'sha', 'afatyô', 've', 'cii', 'vea', 'lu', 'a', 'dooshima', 've', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 19:29:03,940 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 19:29:03,940 Reference: 10 : ​ 6 - 9 . 2020-02-12 19:29:03,940 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , doo u noov man kasev vea nôngo sha afatyô ve cii vea lu a dooshima ve la , shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-12 19:29:03,941 Example #1 2020-02-12 19:29:03,941 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 19:29:03,941 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kape', 'i', 'lu', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 19:29:03,941 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 19:29:03,941 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 19:29:03,941 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u doon tsung ne , man kape i lu je la ! — Rom . 2020-02-12 19:29:03,941 Example #2 2020-02-12 19:29:03,941 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 19:29:03,941 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'gar', 'u', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', '.'] 2020-02-12 19:29:03,941 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 19:29:03,941 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 19:29:03,941 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken gar u Masedonia man Timoteu . 2020-02-12 19:29:03,941 Example #3 2020-02-12 19:29:03,942 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 19:29:03,942 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 19:29:03,942 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 19:29:03,942 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 19:29:03,942 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga yô . 2020-02-12 19:29:03,942 Validation result (greedy) at epoch 44, step 107000: bleu: 27.41, loss: 42117.4727, ppl: 4.1483, duration: 19.7028s 2020-02-12 19:29:14,072 Epoch 44 Step: 107100 Batch Loss: 1.106459 Tokens per Sec: 21823, Lr: 0.000300 2020-02-12 19:29:24,189 Epoch 44 Step: 107200 Batch Loss: 1.509903 Tokens per Sec: 22073, Lr: 0.000300 2020-02-12 19:29:34,005 Epoch 44 Step: 107300 Batch Loss: 1.476545 Tokens per Sec: 21910, Lr: 0.000300 2020-02-12 19:29:43,916 Epoch 44 Step: 107400 Batch Loss: 1.237285 Tokens per Sec: 22220, Lr: 0.000300 2020-02-12 19:29:53,857 Epoch 44 Step: 107500 Batch Loss: 1.467686 Tokens per Sec: 21615, Lr: 0.000300 2020-02-12 19:30:03,784 Epoch 44 Step: 107600 Batch Loss: 1.560723 Tokens per Sec: 22814, Lr: 0.000300 2020-02-12 19:30:13,699 Epoch 44 Step: 107700 Batch Loss: 1.529112 Tokens per Sec: 22171, Lr: 0.000300 2020-02-12 19:30:23,879 Epoch 44 Step: 107800 Batch Loss: 1.568987 Tokens per Sec: 21570, Lr: 0.000300 2020-02-12 19:30:33,930 Epoch 44 Step: 107900 Batch Loss: 1.435261 Tokens per Sec: 22466, Lr: 0.000300 2020-02-12 19:30:43,919 Epoch 44 Step: 108000 Batch Loss: 1.381786 Tokens per Sec: 22249, Lr: 0.000300 2020-02-12 19:31:02,740 Example #0 2020-02-12 19:31:02,740 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 19:31:02,740 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'una', 'fatyô', 'u', 'vesen', 'ken', 'a', 've', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 19:31:02,740 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 19:31:02,740 Reference: 10 : ​ 6 - 9 . 2020-02-12 19:31:02,740 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u ve lu a mi la , shi vea za hemen u lun a dooshima u una fatyô u vesen ken a ve la . — Marku 10 : 6 - 9 . 2020-02-12 19:31:02,740 Example #1 2020-02-12 19:31:02,741 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 19:31:02,741 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'doon', 'tsung', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 19:31:02,741 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 19:31:02,741 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 19:31:02,741 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u doon tsung ne , man ka shighe u doon tsung je la ! — Rom . 2020-02-12 19:31:02,741 Example #2 2020-02-12 19:31:02,741 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 19:31:02,741 Raw hypothesis: ['Anyom', 'nga', 'kar', 'pue', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 19:31:02,741 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 19:31:02,741 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 19:31:02,741 Hypothesis: Anyom nga kar pue yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 19:31:02,741 Example #3 2020-02-12 19:31:02,741 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 19:31:02,741 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'inja', 'sha', 'inja', 'ga', '.'] 2020-02-12 19:31:02,741 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 19:31:02,741 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 19:31:02,742 Hypothesis: Alaghga or nana lu eren kwagh sha inja sha inja ga . 2020-02-12 19:31:02,742 Validation result (greedy) at epoch 44, step 108000: bleu: 27.14, loss: 42154.3320, ppl: 4.1535, duration: 18.8224s 2020-02-12 19:31:12,644 Epoch 44 Step: 108100 Batch Loss: 1.539698 Tokens per Sec: 21970, Lr: 0.000300 2020-02-12 19:31:22,479 Epoch 44 Step: 108200 Batch Loss: 1.642173 Tokens per Sec: 22619, Lr: 0.000300 2020-02-12 19:31:22,486 Epoch 44: total training loss 3575.40 2020-02-12 19:31:22,486 EPOCH 45 2020-02-12 19:31:32,623 Epoch 45 Step: 108300 Batch Loss: 1.506706 Tokens per Sec: 22282, Lr: 0.000300 2020-02-12 19:31:42,574 Epoch 45 Step: 108400 Batch Loss: 1.175273 Tokens per Sec: 21756, Lr: 0.000300 2020-02-12 19:31:52,819 Epoch 45 Step: 108500 Batch Loss: 1.540100 Tokens per Sec: 21348, Lr: 0.000300 2020-02-12 19:32:03,000 Epoch 45 Step: 108600 Batch Loss: 1.325571 Tokens per Sec: 21600, Lr: 0.000300 2020-02-12 19:32:13,240 Epoch 45 Step: 108700 Batch Loss: 1.323452 Tokens per Sec: 21713, Lr: 0.000300 2020-02-12 19:32:23,183 Epoch 45 Step: 108800 Batch Loss: 1.484329 Tokens per Sec: 22263, Lr: 0.000300 2020-02-12 19:32:33,119 Epoch 45 Step: 108900 Batch Loss: 1.366459 Tokens per Sec: 22303, Lr: 0.000300 2020-02-12 19:32:43,201 Epoch 45 Step: 109000 Batch Loss: 1.268322 Tokens per Sec: 21943, Lr: 0.000300 2020-02-12 19:33:02,265 Example #0 2020-02-12 19:33:02,266 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 19:33:02,266 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'tsung', 'vea', 'lu', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'seer', 'a', 'seer', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 19:33:02,266 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 19:33:02,266 Reference: 10 : ​ 6 - 9 . 2020-02-12 19:33:02,266 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo tsung vea lu a dooshima u ve lu a mi la , shi vea za hemen u lun a dooshima u a lu seer a seer la . — Marku 10 : 6 - 9 . 2020-02-12 19:33:02,266 Example #1 2020-02-12 19:33:02,266 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 19:33:02,266 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'doon', 'tsung', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 19:33:02,266 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 19:33:02,267 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 19:33:02,267 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u doon tsung ne , man ka shighe u doon tsung je la ! — Rom . 2020-02-12 19:33:02,267 Example #2 2020-02-12 19:33:02,267 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 19:33:02,267 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 19:33:02,267 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 19:33:02,267 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 19:33:02,267 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 19:33:02,267 Example #3 2020-02-12 19:33:02,267 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 19:33:02,267 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 19:33:02,267 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 19:33:02,268 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 19:33:02,268 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga yô . 2020-02-12 19:33:02,268 Validation result (greedy) at epoch 45, step 109000: bleu: 27.51, loss: 42130.8633, ppl: 4.1502, duration: 19.0665s 2020-02-12 19:33:12,397 Epoch 45 Step: 109100 Batch Loss: 1.518509 Tokens per Sec: 21721, Lr: 0.000300 2020-02-12 19:33:22,622 Epoch 45 Step: 109200 Batch Loss: 1.450124 Tokens per Sec: 21465, Lr: 0.000300 2020-02-12 19:33:32,603 Epoch 45 Step: 109300 Batch Loss: 1.572572 Tokens per Sec: 22133, Lr: 0.000300 2020-02-12 19:33:42,543 Epoch 45 Step: 109400 Batch Loss: 1.488430 Tokens per Sec: 21762, Lr: 0.000300 2020-02-12 19:33:52,483 Epoch 45 Step: 109500 Batch Loss: 1.471986 Tokens per Sec: 21720, Lr: 0.000300 2020-02-12 19:34:02,505 Epoch 45 Step: 109600 Batch Loss: 1.418806 Tokens per Sec: 22505, Lr: 0.000300 2020-02-12 19:34:12,491 Epoch 45 Step: 109700 Batch Loss: 1.428793 Tokens per Sec: 21911, Lr: 0.000300 2020-02-12 19:34:22,610 Epoch 45 Step: 109800 Batch Loss: 1.448463 Tokens per Sec: 22463, Lr: 0.000300 2020-02-12 19:34:32,748 Epoch 45 Step: 109900 Batch Loss: 1.353182 Tokens per Sec: 21402, Lr: 0.000300 2020-02-12 19:34:42,809 Epoch 45 Step: 110000 Batch Loss: 1.557616 Tokens per Sec: 22442, Lr: 0.000300 2020-02-12 19:35:01,331 Hooray! New best validation result [ppl]! 2020-02-12 19:35:01,332 Saving new checkpoint. 2020-02-12 19:35:01,532 Example #0 2020-02-12 19:35:01,533 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 19:35:01,533 Raw hypothesis: ['Er', 'i', 'ver', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'kpaa', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 19:35:01,533 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 19:35:01,533 Reference: 10 : ​ 6 - 9 . 2020-02-12 19:35:01,533 Hypothesis: Er i ver ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la , shi vea za hemen u lun a dooshima u a lu a mi la kpaa . — Marku 10 : 6 - 9 . 2020-02-12 19:35:01,533 Example #1 2020-02-12 19:35:01,533 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 19:35:01,533 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'sha', 'kpôô', 'yô', ',', 'a', 'va', 'kar', 'a', 'mi', 'kera', '!', '—', 'Rom', '.'] 2020-02-12 19:35:01,533 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 19:35:01,533 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 19:35:01,533 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u doon tsung ne , man sha kpôô yô , a va kar a mi kera ! — Rom . 2020-02-12 19:35:01,533 Example #2 2020-02-12 19:35:01,534 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 19:35:01,534 Raw hypothesis: ['Anyom', 'nga', 'kar', 'pue', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 19:35:01,534 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 19:35:01,534 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 19:35:01,534 Hypothesis: Anyom nga kar pue yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 19:35:01,534 Example #3 2020-02-12 19:35:01,534 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 19:35:01,534 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 19:35:01,534 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 19:35:01,534 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 19:35:01,534 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 19:35:01,534 Validation result (greedy) at epoch 45, step 110000: bleu: 27.50, loss: 42108.8359, ppl: 4.1471, duration: 18.7250s 2020-02-12 19:35:11,438 Epoch 45 Step: 110100 Batch Loss: 1.599678 Tokens per Sec: 22055, Lr: 0.000300 2020-02-12 19:35:21,437 Epoch 45 Step: 110200 Batch Loss: 1.343269 Tokens per Sec: 22290, Lr: 0.000300 2020-02-12 19:35:31,314 Epoch 45 Step: 110300 Batch Loss: 1.462385 Tokens per Sec: 22594, Lr: 0.000300 2020-02-12 19:35:41,172 Epoch 45 Step: 110400 Batch Loss: 1.511566 Tokens per Sec: 22328, Lr: 0.000300 2020-02-12 19:35:51,123 Epoch 45 Step: 110500 Batch Loss: 1.360962 Tokens per Sec: 21712, Lr: 0.000300 2020-02-12 19:36:01,046 Epoch 45 Step: 110600 Batch Loss: 1.302726 Tokens per Sec: 22586, Lr: 0.000300 2020-02-12 19:36:07,128 Epoch 45: total training loss 3571.25 2020-02-12 19:36:07,128 EPOCH 46 2020-02-12 19:36:11,303 Epoch 46 Step: 110700 Batch Loss: 1.439586 Tokens per Sec: 20098, Lr: 0.000300 2020-02-12 19:36:21,433 Epoch 46 Step: 110800 Batch Loss: 1.434741 Tokens per Sec: 21106, Lr: 0.000300 2020-02-12 19:36:31,402 Epoch 46 Step: 110900 Batch Loss: 1.425235 Tokens per Sec: 22151, Lr: 0.000300 2020-02-12 19:36:41,261 Epoch 46 Step: 111000 Batch Loss: 1.368882 Tokens per Sec: 22730, Lr: 0.000300 2020-02-12 19:36:59,431 Hooray! New best validation result [ppl]! 2020-02-12 19:36:59,432 Saving new checkpoint. 2020-02-12 19:36:59,620 Example #0 2020-02-12 19:36:59,620 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 19:36:59,620 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'doo', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', 'kpaa', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 19:36:59,621 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 19:36:59,621 Reference: 10 : ​ 6 - 9 . 2020-02-12 19:36:59,621 Hypothesis: Er ivese i Yehova i lu kwagh u tsôron yô , doo u noov man kasev vea nôngo kpoghuloo vea za hemen u lun a dooshima u a lu hen atô ve la shi vea za hemen u lun a dooshima u a lu hen atô ve la kpaa . — Marku 10 : 6 - 9 . 2020-02-12 19:36:59,621 Example #1 2020-02-12 19:36:59,621 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 19:36:59,621 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'doon', 'tsung', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 19:36:59,621 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 19:36:59,621 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 19:36:59,621 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u doon tsung ne , man ka shighe u doon tsung je la ! — Rom . 2020-02-12 19:36:59,621 Example #2 2020-02-12 19:36:59,621 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 19:36:59,621 Raw hypothesis: ['Anyom', 'nga', 'kar', 'pue', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 19:36:59,621 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 19:36:59,621 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 19:36:59,621 Hypothesis: Anyom nga kar pue yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 19:36:59,622 Example #3 2020-02-12 19:36:59,622 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 19:36:59,622 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 19:36:59,622 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 19:36:59,622 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 19:36:59,622 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 19:36:59,622 Validation result (greedy) at epoch 46, step 111000: bleu: 27.54, loss: 42005.9531, ppl: 4.1327, duration: 18.3601s 2020-02-12 19:37:09,603 Epoch 46 Step: 111100 Batch Loss: 1.430688 Tokens per Sec: 21974, Lr: 0.000300 2020-02-12 19:37:19,661 Epoch 46 Step: 111200 Batch Loss: 1.507207 Tokens per Sec: 22296, Lr: 0.000300 2020-02-12 19:37:29,750 Epoch 46 Step: 111300 Batch Loss: 1.362659 Tokens per Sec: 21805, Lr: 0.000300 2020-02-12 19:37:39,729 Epoch 46 Step: 111400 Batch Loss: 1.513517 Tokens per Sec: 21933, Lr: 0.000300 2020-02-12 19:37:49,717 Epoch 46 Step: 111500 Batch Loss: 1.436857 Tokens per Sec: 21977, Lr: 0.000300 2020-02-12 19:37:59,727 Epoch 46 Step: 111600 Batch Loss: 1.335256 Tokens per Sec: 22156, Lr: 0.000300 2020-02-12 19:38:09,813 Epoch 46 Step: 111700 Batch Loss: 1.013449 Tokens per Sec: 22084, Lr: 0.000300 2020-02-12 19:38:19,777 Epoch 46 Step: 111800 Batch Loss: 1.459274 Tokens per Sec: 21757, Lr: 0.000300 2020-02-12 19:38:29,650 Epoch 46 Step: 111900 Batch Loss: 1.391167 Tokens per Sec: 22311, Lr: 0.000300 2020-02-12 19:38:39,584 Epoch 46 Step: 112000 Batch Loss: 1.699031 Tokens per Sec: 22216, Lr: 0.000300 2020-02-12 19:38:58,825 Example #0 2020-02-12 19:38:58,825 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 19:38:58,825 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'sha', 'dooshima', 'la', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 19:38:58,825 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 19:38:58,825 Reference: 10 : ​ 6 - 9 . 2020-02-12 19:38:58,826 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u ve lu a mi sha dooshima la shi vea za hemen u lun a dooshima u a lu a mi la . — Marku 10 : 6 - 9 . 2020-02-12 19:38:58,826 Example #1 2020-02-12 19:38:58,826 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 19:38:58,826 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'a', 'mgb@@', 'ôghom', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 19:38:58,826 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 19:38:58,826 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 19:38:58,826 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u doon tsung ne , man ka shighe u a mgbôghom je la ! — Rom . 2020-02-12 19:38:58,826 Example #2 2020-02-12 19:38:58,826 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 19:38:58,826 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 19:38:58,826 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 19:38:58,826 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 19:38:58,826 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 19:38:58,827 Example #3 2020-02-12 19:38:58,827 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 19:38:58,827 Raw hypothesis: ['Alaghga', 'or', 'nana', 'fatyô', 'u', 'eren', 'kwagh', 'u', 'vough', 'ga', '.'] 2020-02-12 19:38:58,827 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 19:38:58,827 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 19:38:58,827 Hypothesis: Alaghga or nana fatyô u eren kwagh u vough ga . 2020-02-12 19:38:58,827 Validation result (greedy) at epoch 46, step 112000: bleu: 27.68, loss: 42125.1523, ppl: 4.1494, duration: 19.2432s 2020-02-12 19:39:09,029 Epoch 46 Step: 112100 Batch Loss: 1.437263 Tokens per Sec: 21712, Lr: 0.000300 2020-02-12 19:39:19,270 Epoch 46 Step: 112200 Batch Loss: 1.330777 Tokens per Sec: 21096, Lr: 0.000300 2020-02-12 19:39:29,331 Epoch 46 Step: 112300 Batch Loss: 1.400185 Tokens per Sec: 22467, Lr: 0.000300 2020-02-12 19:39:39,471 Epoch 46 Step: 112400 Batch Loss: 1.442747 Tokens per Sec: 22210, Lr: 0.000300 2020-02-12 19:39:49,712 Epoch 46 Step: 112500 Batch Loss: 1.484000 Tokens per Sec: 21703, Lr: 0.000300 2020-02-12 19:39:59,768 Epoch 46 Step: 112600 Batch Loss: 1.508049 Tokens per Sec: 21997, Lr: 0.000300 2020-02-12 19:40:09,901 Epoch 46 Step: 112700 Batch Loss: 1.466018 Tokens per Sec: 21283, Lr: 0.000300 2020-02-12 19:40:20,028 Epoch 46 Step: 112800 Batch Loss: 1.563816 Tokens per Sec: 21706, Lr: 0.000300 2020-02-12 19:40:30,057 Epoch 46 Step: 112900 Batch Loss: 1.513106 Tokens per Sec: 22177, Lr: 0.000300 2020-02-12 19:40:40,011 Epoch 46 Step: 113000 Batch Loss: 1.288380 Tokens per Sec: 23073, Lr: 0.000300 2020-02-12 19:40:58,898 Hooray! New best validation result [ppl]! 2020-02-12 19:40:58,898 Saving new checkpoint. 2020-02-12 19:40:59,095 Example #0 2020-02-12 19:40:59,095 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 19:40:59,095 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'doo', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'sha', 'afatyô', 've', 'cii', 'vea', 'lu', 'a', 'dooshima', 've', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'sha', 'gbenda', 'u', 'dooshima', 'una', 'seer', 'taver', 'yô', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 19:40:59,095 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 19:40:59,095 Reference: 10 : ​ 6 - 9 . 2020-02-12 19:40:59,096 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , doo u noov man kasev vea nôngo sha afatyô ve cii vea lu a dooshima ve la , shi vea za hemen u lun a dooshima sha gbenda u dooshima una seer taver yô . — Marku 10 : 6 - 9 . 2020-02-12 19:40:59,096 Example #1 2020-02-12 19:40:59,096 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 19:40:59,096 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'kpilighyol', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'a', 'lu', 'mgb@@', 'ôghom', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 19:40:59,096 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 19:40:59,096 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 19:40:59,096 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u kpilighyol ne , man ka shighe u a lu mgbôghom je la ! — Rom . 2020-02-12 19:40:59,096 Example #2 2020-02-12 19:40:59,096 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 19:40:59,096 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 19:40:59,096 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 19:40:59,096 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 19:40:59,096 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 19:40:59,096 Example #3 2020-02-12 19:40:59,096 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 19:40:59,096 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'u', 'vough', 'ga', '.'] 2020-02-12 19:40:59,097 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 19:40:59,097 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 19:40:59,097 Hypothesis: Alaghga or nana lu eren kwagh u vough ga . 2020-02-12 19:40:59,097 Validation result (greedy) at epoch 46, step 113000: bleu: 26.89, loss: 41784.3984, ppl: 4.1019, duration: 19.0856s 2020-02-12 19:41:09,004 Epoch 46 Step: 113100 Batch Loss: 1.695273 Tokens per Sec: 22618, Lr: 0.000300 2020-02-12 19:41:10,977 Epoch 46: total training loss 3558.05 2020-02-12 19:41:10,977 EPOCH 47 2020-02-12 19:41:19,232 Epoch 47 Step: 113200 Batch Loss: 1.448503 Tokens per Sec: 21776, Lr: 0.000300 2020-02-12 19:41:29,163 Epoch 47 Step: 113300 Batch Loss: 1.611304 Tokens per Sec: 22486, Lr: 0.000300 2020-02-12 19:41:39,181 Epoch 47 Step: 113400 Batch Loss: 1.299292 Tokens per Sec: 22298, Lr: 0.000300 2020-02-12 19:41:49,283 Epoch 47 Step: 113500 Batch Loss: 1.392048 Tokens per Sec: 21993, Lr: 0.000300 2020-02-12 19:41:59,185 Epoch 47 Step: 113600 Batch Loss: 1.504616 Tokens per Sec: 22090, Lr: 0.000300 2020-02-12 19:42:09,140 Epoch 47 Step: 113700 Batch Loss: 1.337536 Tokens per Sec: 22219, Lr: 0.000300 2020-02-12 19:42:19,138 Epoch 47 Step: 113800 Batch Loss: 1.405690 Tokens per Sec: 22150, Lr: 0.000300 2020-02-12 19:42:29,111 Epoch 47 Step: 113900 Batch Loss: 1.274987 Tokens per Sec: 22098, Lr: 0.000300 2020-02-12 19:42:39,032 Epoch 47 Step: 114000 Batch Loss: 1.574323 Tokens per Sec: 22370, Lr: 0.000300 2020-02-12 19:42:57,475 Example #0 2020-02-12 19:42:57,475 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 19:42:57,475 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'i', 'lu', 'kwagh', 'u', 'tsan', 'gbem', 'sha', 'won', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'dooshima', 'la', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 19:42:57,475 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 19:42:57,475 Reference: 10 : ​ 6 - 9 . 2020-02-12 19:42:57,475 Hypothesis: Er ivese i Yehova i lu kwagh u tsan gbem sha won yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu dooshima la shi vea za hemen u lun a dooshima u a lu a mi la . — Marku 10 : 6 - 9 . 2020-02-12 19:42:57,475 Example #1 2020-02-12 19:42:57,475 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 19:42:57,475 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'imba', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'doon', 'tsung', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 19:42:57,475 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 19:42:57,475 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 19:42:57,475 Hypothesis: Se kpa se fatyô u ‘ nengen ’ imba shighe u doon tsung ne , man ka shighe u doon tsung je la ! — Rom . 2020-02-12 19:42:57,475 Example #2 2020-02-12 19:42:57,476 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 19:42:57,476 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'ngu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 19:42:57,476 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 19:42:57,476 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 19:42:57,476 Hypothesis: Anyom nga kar er pue nahan yô , Paulu ngu ken Masedonia man Timoteu ken Efese . 2020-02-12 19:42:57,476 Example #3 2020-02-12 19:42:57,476 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 19:42:57,476 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'u', 'vough', 'ga', 'yô', ',', 'nana', 'lu', 'eren', 'kwagh', 'u', 'vough', '.'] 2020-02-12 19:42:57,476 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 19:42:57,476 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 19:42:57,476 Hypothesis: Alaghga or u nan lu eren kwagh u vough ga yô , nana lu eren kwagh u vough . 2020-02-12 19:42:57,476 Validation result (greedy) at epoch 47, step 114000: bleu: 27.87, loss: 41840.8945, ppl: 4.1097, duration: 18.4433s 2020-02-12 19:43:07,479 Epoch 47 Step: 114100 Batch Loss: 1.514122 Tokens per Sec: 22413, Lr: 0.000300 2020-02-12 19:43:17,455 Epoch 47 Step: 114200 Batch Loss: 1.426713 Tokens per Sec: 22018, Lr: 0.000300 2020-02-12 19:43:27,646 Epoch 47 Step: 114300 Batch Loss: 1.535274 Tokens per Sec: 21861, Lr: 0.000300 2020-02-12 19:43:37,758 Epoch 47 Step: 114400 Batch Loss: 1.191541 Tokens per Sec: 22219, Lr: 0.000300 2020-02-12 19:43:47,800 Epoch 47 Step: 114500 Batch Loss: 1.474129 Tokens per Sec: 21864, Lr: 0.000300 2020-02-12 19:43:57,673 Epoch 47 Step: 114600 Batch Loss: 1.520699 Tokens per Sec: 21576, Lr: 0.000300 2020-02-12 19:44:07,568 Epoch 47 Step: 114700 Batch Loss: 1.566214 Tokens per Sec: 22522, Lr: 0.000300 2020-02-12 19:44:17,533 Epoch 47 Step: 114800 Batch Loss: 1.560108 Tokens per Sec: 22656, Lr: 0.000300 2020-02-12 19:44:27,396 Epoch 47 Step: 114900 Batch Loss: 1.497138 Tokens per Sec: 22129, Lr: 0.000300 2020-02-12 19:44:37,259 Epoch 47 Step: 115000 Batch Loss: 1.421960 Tokens per Sec: 22243, Lr: 0.000300 2020-02-12 19:44:55,721 Hooray! New best validation result [ppl]! 2020-02-12 19:44:55,721 Saving new checkpoint. 2020-02-12 19:44:55,908 Example #0 2020-02-12 19:44:55,908 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 19:44:55,908 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'i', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'mimi', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 19:44:55,908 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 19:44:55,908 Reference: 10 : ​ 6 - 9 . 2020-02-12 19:44:55,908 Hypothesis: Er ivese i Yehova i ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u mimi shi vea za hemen u lun a dooshima u a lu hen atô ve la . — Marku 10 : 6 - 9 . 2020-02-12 19:44:55,908 Example #1 2020-02-12 19:44:55,909 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 19:44:55,909 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'doon', 'tsung', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 19:44:55,909 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 19:44:55,909 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 19:44:55,909 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man ka shighe u doon tsung je la ! — Rom . 2020-02-12 19:44:55,909 Example #2 2020-02-12 19:44:55,909 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 19:44:55,909 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 19:44:55,909 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 19:44:55,909 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 19:44:55,909 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 19:44:55,909 Example #3 2020-02-12 19:44:55,909 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 19:44:55,909 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'u', 'vough', 'ga', '.'] 2020-02-12 19:44:55,909 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 19:44:55,909 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 19:44:55,910 Hypothesis: Alaghga or nana lu eren kwagh u vough ga . 2020-02-12 19:44:55,910 Validation result (greedy) at epoch 47, step 115000: bleu: 27.89, loss: 41749.2227, ppl: 4.0970, duration: 18.6504s 2020-02-12 19:45:05,812 Epoch 47 Step: 115100 Batch Loss: 1.491982 Tokens per Sec: 21823, Lr: 0.000300 2020-02-12 19:45:15,713 Epoch 47 Step: 115200 Batch Loss: 1.198917 Tokens per Sec: 22116, Lr: 0.000300 2020-02-12 19:45:25,753 Epoch 47 Step: 115300 Batch Loss: 1.453321 Tokens per Sec: 21902, Lr: 0.000300 2020-02-12 19:45:35,761 Epoch 47 Step: 115400 Batch Loss: 1.511252 Tokens per Sec: 22499, Lr: 0.000300 2020-02-12 19:45:45,845 Epoch 47 Step: 115500 Batch Loss: 1.346421 Tokens per Sec: 22208, Lr: 0.000300 2020-02-12 19:45:53,588 Epoch 47: total training loss 3538.44 2020-02-12 19:45:53,588 EPOCH 48 2020-02-12 19:45:56,297 Epoch 48 Step: 115600 Batch Loss: 1.644892 Tokens per Sec: 20401, Lr: 0.000300 2020-02-12 19:46:06,401 Epoch 48 Step: 115700 Batch Loss: 1.511914 Tokens per Sec: 21888, Lr: 0.000300 2020-02-12 19:46:16,494 Epoch 48 Step: 115800 Batch Loss: 1.626291 Tokens per Sec: 21965, Lr: 0.000300 2020-02-12 19:46:26,509 Epoch 48 Step: 115900 Batch Loss: 1.426806 Tokens per Sec: 22163, Lr: 0.000300 2020-02-12 19:46:36,371 Epoch 48 Step: 116000 Batch Loss: 1.281797 Tokens per Sec: 21999, Lr: 0.000300 2020-02-12 19:46:55,113 Example #0 2020-02-12 19:46:55,113 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 19:46:55,113 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'i', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'sha', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'kpaa', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 19:46:55,113 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 19:46:55,113 Reference: 10 : ​ 6 - 9 . 2020-02-12 19:46:55,113 Hypothesis: Er ivese i Yehova i ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u ve lu a mi la , shi vea za hemen u lun a dooshima sha dooshima u a lu a mi la kpaa . — Marku 10 : 6 - 9 . 2020-02-12 19:46:55,113 Example #1 2020-02-12 19:46:55,113 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 19:46:55,113 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'imba', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'doon', 'tsung', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 19:46:55,113 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 19:46:55,114 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 19:46:55,114 Hypothesis: Se kpa se fatyô u ‘ nengen ’ imba shighe u doon tsung ne , man ka shighe u doon tsung je la ! — Rom . 2020-02-12 19:46:55,114 Example #2 2020-02-12 19:46:55,114 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 19:46:55,114 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 19:46:55,114 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 19:46:55,114 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 19:46:55,114 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 19:46:55,114 Example #3 2020-02-12 19:46:55,114 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 19:46:55,114 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 19:46:55,114 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 19:46:55,114 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 19:46:55,115 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-12 19:46:55,115 Validation result (greedy) at epoch 48, step 116000: bleu: 27.40, loss: 41770.0156, ppl: 4.0999, duration: 18.7432s 2020-02-12 19:47:05,019 Epoch 48 Step: 116100 Batch Loss: 1.190393 Tokens per Sec: 21997, Lr: 0.000300 2020-02-12 19:47:15,029 Epoch 48 Step: 116200 Batch Loss: 1.359880 Tokens per Sec: 22569, Lr: 0.000300 2020-02-12 19:47:25,084 Epoch 48 Step: 116300 Batch Loss: 1.483494 Tokens per Sec: 21722, Lr: 0.000300 2020-02-12 19:47:35,257 Epoch 48 Step: 116400 Batch Loss: 1.495674 Tokens per Sec: 21822, Lr: 0.000300 2020-02-12 19:47:45,109 Epoch 48 Step: 116500 Batch Loss: 1.721295 Tokens per Sec: 22331, Lr: 0.000300 2020-02-12 19:47:55,012 Epoch 48 Step: 116600 Batch Loss: 1.669105 Tokens per Sec: 22133, Lr: 0.000300 2020-02-12 19:48:04,920 Epoch 48 Step: 116700 Batch Loss: 1.402427 Tokens per Sec: 21974, Lr: 0.000300 2020-02-12 19:48:14,844 Epoch 48 Step: 116800 Batch Loss: 1.566111 Tokens per Sec: 22232, Lr: 0.000300 2020-02-12 19:48:24,857 Epoch 48 Step: 116900 Batch Loss: 1.596632 Tokens per Sec: 22380, Lr: 0.000300 2020-02-12 19:48:34,663 Epoch 48 Step: 117000 Batch Loss: 1.736362 Tokens per Sec: 22164, Lr: 0.000300 2020-02-12 19:48:52,950 Example #0 2020-02-12 19:48:52,950 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 19:48:52,950 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'vesen', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'tsung', 'sha', 'er', 'dooshima', 've', 'una', 'seer', 'taver', 'yô', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 19:48:52,950 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 19:48:52,950 Reference: 10 : ​ 6 - 9 . 2020-02-12 19:48:52,950 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u vesen yô , gba hange hange u noov man kasev vea nôngo tsung sha er dooshima ve una seer taver yô . — Marku 10 : 6 - 9 . 2020-02-12 19:48:52,950 Example #1 2020-02-12 19:48:52,950 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 19:48:52,950 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'a', 'lu', 'mgb@@', 'ôghom', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 19:48:52,950 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 19:48:52,950 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 19:48:52,950 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u doon tsung ne , man ka shighe u a lu mgbôghom je la ! — Rom . 2020-02-12 19:48:52,951 Example #2 2020-02-12 19:48:52,951 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 19:48:52,951 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 19:48:52,951 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 19:48:52,951 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 19:48:52,951 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 19:48:52,951 Example #3 2020-02-12 19:48:52,951 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 19:48:52,951 Raw hypothesis: ['Alaghga', 'or', 'nan', 'ngu', 'eren', 'kwagh', 'sha', 'inja', 'ga', '.'] 2020-02-12 19:48:52,951 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 19:48:52,951 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 19:48:52,951 Hypothesis: Alaghga or nan ngu eren kwagh sha inja ga . 2020-02-12 19:48:52,951 Validation result (greedy) at epoch 48, step 117000: bleu: 27.55, loss: 41847.3477, ppl: 4.1106, duration: 18.2882s 2020-02-12 19:49:02,884 Epoch 48 Step: 117100 Batch Loss: 1.479277 Tokens per Sec: 22526, Lr: 0.000300 2020-02-12 19:49:12,808 Epoch 48 Step: 117200 Batch Loss: 1.385575 Tokens per Sec: 22107, Lr: 0.000300 2020-02-12 19:49:22,820 Epoch 48 Step: 117300 Batch Loss: 1.464625 Tokens per Sec: 21538, Lr: 0.000300 2020-02-12 19:49:32,875 Epoch 48 Step: 117400 Batch Loss: 1.458551 Tokens per Sec: 22031, Lr: 0.000300 2020-02-12 19:49:43,064 Epoch 48 Step: 117500 Batch Loss: 1.501891 Tokens per Sec: 21888, Lr: 0.000300 2020-02-12 19:49:53,250 Epoch 48 Step: 117600 Batch Loss: 1.483814 Tokens per Sec: 22234, Lr: 0.000300 2020-02-12 19:50:03,428 Epoch 48 Step: 117700 Batch Loss: 1.387494 Tokens per Sec: 21588, Lr: 0.000300 2020-02-12 19:50:13,574 Epoch 48 Step: 117800 Batch Loss: 1.352471 Tokens per Sec: 22260, Lr: 0.000300 2020-02-12 19:50:23,698 Epoch 48 Step: 117900 Batch Loss: 1.394577 Tokens per Sec: 22047, Lr: 0.000300 2020-02-12 19:50:33,894 Epoch 48 Step: 118000 Batch Loss: 1.531109 Tokens per Sec: 22333, Lr: 0.000300 2020-02-12 19:50:52,663 Example #0 2020-02-12 19:50:52,663 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 19:50:52,663 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsan', 'gbem', 'yô', ',', 'doo', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'sha', 'afatyô', 've', 'cii', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'kpaa', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 19:50:52,663 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 19:50:52,663 Reference: 10 : ​ 6 - 9 . 2020-02-12 19:50:52,663 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsan gbem yô , doo u noov man kasev vea nôngo sha afatyô ve cii vea lu a dooshima u a lu a mi la , shi vea za hemen u lun a dooshima u a lu a mi la kpaa . — Marku 10 : 6 - 9 . 2020-02-12 19:50:52,664 Example #1 2020-02-12 19:50:52,664 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 19:50:52,664 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'imba', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'doon', 'tsung', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 19:50:52,664 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 19:50:52,664 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 19:50:52,664 Hypothesis: Se kpa se fatyô u ‘ nengen ’ imba shighe u doon tsung ne , man ka shighe u doon tsung je la ! — Rom . 2020-02-12 19:50:52,664 Example #2 2020-02-12 19:50:52,664 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 19:50:52,664 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 19:50:52,664 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 19:50:52,664 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 19:50:52,664 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 19:50:52,664 Example #3 2020-02-12 19:50:52,664 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 19:50:52,664 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 19:50:52,664 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 19:50:52,665 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 19:50:52,665 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-12 19:50:52,665 Validation result (greedy) at epoch 48, step 118000: bleu: 27.57, loss: 41751.4414, ppl: 4.0973, duration: 18.7698s 2020-02-12 19:50:55,976 Epoch 48: total training loss 3532.63 2020-02-12 19:50:55,976 EPOCH 49 2020-02-12 19:51:02,984 Epoch 49 Step: 118100 Batch Loss: 1.467236 Tokens per Sec: 20237, Lr: 0.000300 2020-02-12 19:51:13,064 Epoch 49 Step: 118200 Batch Loss: 1.343927 Tokens per Sec: 21994, Lr: 0.000300 2020-02-12 19:51:23,197 Epoch 49 Step: 118300 Batch Loss: 1.511168 Tokens per Sec: 21975, Lr: 0.000300 2020-02-12 19:51:33,133 Epoch 49 Step: 118400 Batch Loss: 1.323924 Tokens per Sec: 22068, Lr: 0.000300 2020-02-12 19:51:43,126 Epoch 49 Step: 118500 Batch Loss: 1.283161 Tokens per Sec: 21575, Lr: 0.000300 2020-02-12 19:51:53,160 Epoch 49 Step: 118600 Batch Loss: 1.372875 Tokens per Sec: 20992, Lr: 0.000300 2020-02-12 19:52:03,286 Epoch 49 Step: 118700 Batch Loss: 1.371924 Tokens per Sec: 21759, Lr: 0.000300 2020-02-12 19:52:13,432 Epoch 49 Step: 118800 Batch Loss: 1.391858 Tokens per Sec: 21667, Lr: 0.000300 2020-02-12 19:52:23,559 Epoch 49 Step: 118900 Batch Loss: 1.389974 Tokens per Sec: 22621, Lr: 0.000300 2020-02-12 19:52:33,632 Epoch 49 Step: 119000 Batch Loss: 1.535931 Tokens per Sec: 21617, Lr: 0.000300 2020-02-12 19:52:53,328 Hooray! New best validation result [ppl]! 2020-02-12 19:52:53,328 Saving new checkpoint. 2020-02-12 19:52:53,520 Example #0 2020-02-12 19:52:53,520 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 19:52:53,520 Raw hypothesis: ['Er', 'i', 'lu', 'Yehova', 'a', 'ver', 'ivese', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'doo', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'sha', 'afatyô', 've', 'cii', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 19:52:53,520 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 19:52:53,521 Reference: 10 : ​ 6 - 9 . 2020-02-12 19:52:53,521 Hypothesis: Er i lu Yehova a ver ivese i lu kwagh u tsôron yô , doo u noov man kasev vea nôngo sha afatyô ve cii vea lu a dooshima u a lu a mi la , shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-12 19:52:53,521 Example #1 2020-02-12 19:52:53,521 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 19:52:53,521 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kape', 'i', 'lu', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 19:52:53,521 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 19:52:53,521 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 19:52:53,521 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kape i lu je la ! — Rom . 2020-02-12 19:52:53,521 Example #2 2020-02-12 19:52:53,521 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 19:52:53,521 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 19:52:53,521 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 19:52:53,521 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 19:52:53,521 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 19:52:53,521 Example #3 2020-02-12 19:52:53,522 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 19:52:53,522 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 19:52:53,522 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 19:52:53,522 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 19:52:53,522 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-12 19:52:53,522 Validation result (greedy) at epoch 49, step 119000: bleu: 27.59, loss: 41646.8008, ppl: 4.0829, duration: 19.8892s 2020-02-12 19:53:03,597 Epoch 49 Step: 119100 Batch Loss: 1.473184 Tokens per Sec: 21726, Lr: 0.000300 2020-02-12 19:53:13,461 Epoch 49 Step: 119200 Batch Loss: 1.560020 Tokens per Sec: 22571, Lr: 0.000300 2020-02-12 19:53:23,376 Epoch 49 Step: 119300 Batch Loss: 1.720937 Tokens per Sec: 22797, Lr: 0.000300 2020-02-12 19:53:33,246 Epoch 49 Step: 119400 Batch Loss: 1.362972 Tokens per Sec: 22592, Lr: 0.000300 2020-02-12 19:53:43,108 Epoch 49 Step: 119500 Batch Loss: 1.443679 Tokens per Sec: 22243, Lr: 0.000300 2020-02-12 19:53:53,073 Epoch 49 Step: 119600 Batch Loss: 1.303438 Tokens per Sec: 22036, Lr: 0.000300 2020-02-12 19:54:02,976 Epoch 49 Step: 119700 Batch Loss: 1.667526 Tokens per Sec: 22109, Lr: 0.000300 2020-02-12 19:54:12,935 Epoch 49 Step: 119800 Batch Loss: 1.530715 Tokens per Sec: 23090, Lr: 0.000300 2020-02-12 19:54:22,935 Epoch 49 Step: 119900 Batch Loss: 1.666129 Tokens per Sec: 22076, Lr: 0.000300 2020-02-12 19:54:32,880 Epoch 49 Step: 120000 Batch Loss: 1.262596 Tokens per Sec: 22027, Lr: 0.000300 2020-02-12 19:54:51,879 Example #0 2020-02-12 19:54:51,879 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 19:54:51,879 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'doo', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'una', 'fatyô', 'u', 'vesen', 'la', 'kpaa', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 19:54:51,880 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 19:54:51,880 Reference: 10 : ​ 6 - 9 . 2020-02-12 19:54:51,880 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , doo u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la , shi vea za hemen u lun a dooshima u una fatyô u vesen la kpaa . — Marku 10 : 6 - 9 . 2020-02-12 19:54:51,880 Example #1 2020-02-12 19:54:51,880 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 19:54:51,880 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kape', 'i', 'lu', 'zan', 'hemen', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 19:54:51,880 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 19:54:51,880 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 19:54:51,880 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u doon tsung ne , man kape i lu zan hemen je la ! — Rom . 2020-02-12 19:54:51,880 Example #2 2020-02-12 19:54:51,880 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 19:54:51,880 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', '.'] 2020-02-12 19:54:51,880 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 19:54:51,880 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 19:54:51,880 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu . 2020-02-12 19:54:51,881 Example #3 2020-02-12 19:54:51,881 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 19:54:51,881 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'inja', 'ga', '.'] 2020-02-12 19:54:51,881 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 19:54:51,881 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 19:54:51,881 Hypothesis: Alaghga or nana lu eren kwagh sha inja ga . 2020-02-12 19:54:51,881 Validation result (greedy) at epoch 49, step 120000: bleu: 27.52, loss: 41766.1055, ppl: 4.0993, duration: 19.0000s 2020-02-12 19:55:01,839 Epoch 49 Step: 120100 Batch Loss: 1.509957 Tokens per Sec: 23041, Lr: 0.000300 2020-02-12 19:55:11,842 Epoch 49 Step: 120200 Batch Loss: 1.268345 Tokens per Sec: 23013, Lr: 0.000300 2020-02-12 19:55:21,697 Epoch 49 Step: 120300 Batch Loss: 1.632760 Tokens per Sec: 22274, Lr: 0.000300 2020-02-12 19:55:31,590 Epoch 49 Step: 120400 Batch Loss: 1.493055 Tokens per Sec: 22325, Lr: 0.000300 2020-02-12 19:55:40,275 Epoch 49: total training loss 3521.86 2020-02-12 19:55:40,275 EPOCH 50 2020-02-12 19:55:42,450 Epoch 50 Step: 120500 Batch Loss: 1.551069 Tokens per Sec: 11732, Lr: 0.000300 2020-02-12 19:55:52,472 Epoch 50 Step: 120600 Batch Loss: 1.458403 Tokens per Sec: 22223, Lr: 0.000300 2020-02-12 19:56:02,539 Epoch 50 Step: 120700 Batch Loss: 1.363353 Tokens per Sec: 22037, Lr: 0.000300 2020-02-12 19:56:12,633 Epoch 50 Step: 120800 Batch Loss: 1.504203 Tokens per Sec: 22318, Lr: 0.000300 2020-02-12 19:56:22,708 Epoch 50 Step: 120900 Batch Loss: 1.304228 Tokens per Sec: 21574, Lr: 0.000300 2020-02-12 19:56:32,809 Epoch 50 Step: 121000 Batch Loss: 1.459908 Tokens per Sec: 21769, Lr: 0.000300 2020-02-12 19:56:51,280 Example #0 2020-02-12 19:56:51,280 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 19:56:51,280 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'sha', 'afatyô', 've', 'cii', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 19:56:51,280 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 19:56:51,280 Reference: 10 : ​ 6 - 9 . 2020-02-12 19:56:51,280 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo sha afatyô ve cii vea lu a dooshima u a lu a mi la , shi vea za hemen u lun a dooshima u a lu a mi la . — Marku 10 : 6 - 9 . 2020-02-12 19:56:51,281 Example #1 2020-02-12 19:56:51,281 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 19:56:51,281 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'a', 'mgb@@', 'ôghom', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 19:56:51,281 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 19:56:51,281 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 19:56:51,281 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u doon tsung ne , man ka shighe u a mgbôghom je la ! — Rom . 2020-02-12 19:56:51,281 Example #2 2020-02-12 19:56:51,281 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 19:56:51,281 Raw hypothesis: ['Anyom', 'nga', 'kar', 'pue', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 19:56:51,281 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 19:56:51,281 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 19:56:51,281 Hypothesis: Anyom nga kar pue yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 19:56:51,281 Example #3 2020-02-12 19:56:51,281 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 19:56:51,281 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 19:56:51,281 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 19:56:51,282 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 19:56:51,282 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-12 19:56:51,282 Validation result (greedy) at epoch 50, step 121000: bleu: 27.22, loss: 41909.5469, ppl: 4.1193, duration: 18.4721s 2020-02-12 19:57:01,374 Epoch 50 Step: 121100 Batch Loss: 1.526670 Tokens per Sec: 21848, Lr: 0.000300 2020-02-12 19:57:11,304 Epoch 50 Step: 121200 Batch Loss: 1.216072 Tokens per Sec: 22043, Lr: 0.000300 2020-02-12 19:57:21,328 Epoch 50 Step: 121300 Batch Loss: 1.229383 Tokens per Sec: 21916, Lr: 0.000300 2020-02-12 19:57:31,207 Epoch 50 Step: 121400 Batch Loss: 1.452085 Tokens per Sec: 22583, Lr: 0.000300 2020-02-12 19:57:41,109 Epoch 50 Step: 121500 Batch Loss: 1.485880 Tokens per Sec: 21838, Lr: 0.000300 2020-02-12 19:57:51,076 Epoch 50 Step: 121600 Batch Loss: 1.539876 Tokens per Sec: 22367, Lr: 0.000300 2020-02-12 19:58:01,068 Epoch 50 Step: 121700 Batch Loss: 1.422288 Tokens per Sec: 21987, Lr: 0.000300 2020-02-12 19:58:11,018 Epoch 50 Step: 121800 Batch Loss: 1.528397 Tokens per Sec: 22434, Lr: 0.000300 2020-02-12 19:58:20,868 Epoch 50 Step: 121900 Batch Loss: 1.373360 Tokens per Sec: 22173, Lr: 0.000300 2020-02-12 19:58:30,739 Epoch 50 Step: 122000 Batch Loss: 1.386560 Tokens per Sec: 22462, Lr: 0.000300 2020-02-12 19:58:49,510 Example #0 2020-02-12 19:58:49,511 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 19:58:49,511 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'sha', 'er', 'dooshima', 've', 'una', 'lu', 'a', 'mi', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'yô', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 19:58:49,511 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 19:58:49,511 Reference: 10 : ​ 6 - 9 . 2020-02-12 19:58:49,511 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo sha er dooshima ve una lu a mi shi vea za hemen u lun a dooshima yô . — Marku 10 : 6 - 9 . 2020-02-12 19:58:49,511 Example #1 2020-02-12 19:58:49,511 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 19:58:49,511 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'imba', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'doon', 'tsung', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 19:58:49,511 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 19:58:49,511 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 19:58:49,511 Hypothesis: Se kpa se fatyô u ‘ nengen ’ imba shighe u doon tsung ne , man ka shighe u doon tsung je la ! — Rom . 2020-02-12 19:58:49,511 Example #2 2020-02-12 19:58:49,512 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 19:58:49,512 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'gar', 'u', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 19:58:49,512 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 19:58:49,512 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 19:58:49,512 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken gar u Masedonia man Timoteu ken Efese . 2020-02-12 19:58:49,512 Example #3 2020-02-12 19:58:49,512 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 19:58:49,512 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 19:58:49,512 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 19:58:49,512 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 19:58:49,512 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga yô . 2020-02-12 19:58:49,512 Validation result (greedy) at epoch 50, step 122000: bleu: 27.72, loss: 41763.1562, ppl: 4.0989, duration: 18.7725s 2020-02-12 19:58:59,461 Epoch 50 Step: 122100 Batch Loss: 1.540695 Tokens per Sec: 22136, Lr: 0.000300 2020-02-12 19:59:09,403 Epoch 50 Step: 122200 Batch Loss: 1.456550 Tokens per Sec: 22738, Lr: 0.000300 2020-02-12 19:59:19,308 Epoch 50 Step: 122300 Batch Loss: 1.440537 Tokens per Sec: 22028, Lr: 0.000300 2020-02-12 19:59:29,288 Epoch 50 Step: 122400 Batch Loss: 1.356866 Tokens per Sec: 22144, Lr: 0.000300 2020-02-12 19:59:39,209 Epoch 50 Step: 122500 Batch Loss: 1.312044 Tokens per Sec: 22566, Lr: 0.000300 2020-02-12 19:59:49,233 Epoch 50 Step: 122600 Batch Loss: 1.319804 Tokens per Sec: 22092, Lr: 0.000300 2020-02-12 19:59:59,395 Epoch 50 Step: 122700 Batch Loss: 1.798413 Tokens per Sec: 21795, Lr: 0.000300 2020-02-12 20:00:09,594 Epoch 50 Step: 122800 Batch Loss: 1.625809 Tokens per Sec: 21924, Lr: 0.000300 2020-02-12 20:00:19,803 Epoch 50 Step: 122900 Batch Loss: 1.503899 Tokens per Sec: 21901, Lr: 0.000300 2020-02-12 20:00:24,536 Epoch 50: total training loss 3514.65 2020-02-12 20:00:24,536 EPOCH 51 2020-02-12 20:00:30,175 Epoch 51 Step: 123000 Batch Loss: 1.526558 Tokens per Sec: 20993, Lr: 0.000300 2020-02-12 20:00:49,242 Example #0 2020-02-12 20:00:49,242 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 20:00:49,242 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'tsung', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'imôngo', 'ken', 'dooshima', 'u', 'una', 'fatyô', 'u', 'vesen', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 20:00:49,242 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 20:00:49,242 Reference: 10 : ​ 6 - 9 . 2020-02-12 20:00:49,242 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo tsung vea lu a dooshima u a lu a mi la , shi vea za hemen u lun imôngo ken dooshima u una fatyô u vesen la . — Marku 10 : 6 - 9 . 2020-02-12 20:00:49,242 Example #1 2020-02-12 20:00:49,242 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 20:00:49,242 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'imba', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'a', 'lu', 'van', 'la', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 20:00:49,242 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 20:00:49,243 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 20:00:49,243 Hypothesis: Se kpa se fatyô u ‘ nengen ’ imba shighe u doon tsung ne , man ka shighe u a lu van la je la ! — Rom . 2020-02-12 20:00:49,243 Example #2 2020-02-12 20:00:49,243 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 20:00:49,243 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 20:00:49,243 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 20:00:49,243 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 20:00:49,243 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 20:00:49,243 Example #3 2020-02-12 20:00:49,243 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 20:00:49,243 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 20:00:49,243 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 20:00:49,243 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 20:00:49,243 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga yô . 2020-02-12 20:00:49,243 Validation result (greedy) at epoch 51, step 123000: bleu: 27.27, loss: 41713.4492, ppl: 4.0921, duration: 19.0678s 2020-02-12 20:00:59,242 Epoch 51 Step: 123100 Batch Loss: 1.541325 Tokens per Sec: 22091, Lr: 0.000300 2020-02-12 20:01:09,199 Epoch 51 Step: 123200 Batch Loss: 1.344236 Tokens per Sec: 22528, Lr: 0.000300 2020-02-12 20:01:19,115 Epoch 51 Step: 123300 Batch Loss: 1.344728 Tokens per Sec: 21546, Lr: 0.000300 2020-02-12 20:01:28,985 Epoch 51 Step: 123400 Batch Loss: 1.478138 Tokens per Sec: 22788, Lr: 0.000300 2020-02-12 20:01:38,945 Epoch 51 Step: 123500 Batch Loss: 1.534281 Tokens per Sec: 22723, Lr: 0.000300 2020-02-12 20:01:48,964 Epoch 51 Step: 123600 Batch Loss: 1.552602 Tokens per Sec: 22728, Lr: 0.000300 2020-02-12 20:01:58,934 Epoch 51 Step: 123700 Batch Loss: 1.598335 Tokens per Sec: 21830, Lr: 0.000300 2020-02-12 20:02:08,993 Epoch 51 Step: 123800 Batch Loss: 1.248720 Tokens per Sec: 22436, Lr: 0.000300 2020-02-12 20:02:18,884 Epoch 51 Step: 123900 Batch Loss: 1.374439 Tokens per Sec: 22519, Lr: 0.000300 2020-02-12 20:02:28,785 Epoch 51 Step: 124000 Batch Loss: 1.515948 Tokens per Sec: 22302, Lr: 0.000300 2020-02-12 20:02:46,571 Example #0 2020-02-12 20:02:46,571 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 20:02:46,571 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsan', 'gbem', 'yô', ',', 'doo', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'sha', 'er', 'dooshima', 've', 'una', 'seer', 'taver', 'yô', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 20:02:46,571 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 20:02:46,572 Reference: 10 : ​ 6 - 9 . 2020-02-12 20:02:46,572 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsan gbem yô , doo u noov man kasev vea nôngo kpoghuloo sha er dooshima ve una seer taver yô . — Marku 10 : 6 - 9 . 2020-02-12 20:02:46,572 Example #1 2020-02-12 20:02:46,572 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 20:02:46,572 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'a', 'lu', 'van', 'la', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 20:02:46,572 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 20:02:46,572 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 20:02:46,572 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u doon tsung ne , man ka shighe u a lu van la je la ! — Rom . 2020-02-12 20:02:46,572 Example #2 2020-02-12 20:02:46,572 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 20:02:46,572 Raw hypothesis: ['Anyom', 'nga', 'kar', 'pue', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', '.'] 2020-02-12 20:02:46,572 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 20:02:46,572 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 20:02:46,572 Hypothesis: Anyom nga kar pue yô , Paulu lu ken Masedonia man Timoteu . 2020-02-12 20:02:46,573 Example #3 2020-02-12 20:02:46,573 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 20:02:46,573 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 20:02:46,573 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 20:02:46,573 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 20:02:46,573 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga yô . 2020-02-12 20:02:46,573 Validation result (greedy) at epoch 51, step 124000: bleu: 27.44, loss: 41700.3750, ppl: 4.0903, duration: 17.7873s 2020-02-12 20:02:56,523 Epoch 51 Step: 124100 Batch Loss: 1.284755 Tokens per Sec: 22297, Lr: 0.000300 2020-02-12 20:03:06,580 Epoch 51 Step: 124200 Batch Loss: 1.573390 Tokens per Sec: 21850, Lr: 0.000300 2020-02-12 20:03:16,672 Epoch 51 Step: 124300 Batch Loss: 1.530623 Tokens per Sec: 21271, Lr: 0.000300 2020-02-12 20:03:26,790 Epoch 51 Step: 124400 Batch Loss: 1.527290 Tokens per Sec: 21904, Lr: 0.000300 2020-02-12 20:03:36,761 Epoch 51 Step: 124500 Batch Loss: 1.633081 Tokens per Sec: 22238, Lr: 0.000300 2020-02-12 20:03:46,673 Epoch 51 Step: 124600 Batch Loss: 1.138406 Tokens per Sec: 21949, Lr: 0.000300 2020-02-12 20:03:56,587 Epoch 51 Step: 124700 Batch Loss: 1.433948 Tokens per Sec: 22624, Lr: 0.000300 2020-02-12 20:04:06,521 Epoch 51 Step: 124800 Batch Loss: 1.560304 Tokens per Sec: 22080, Lr: 0.000300 2020-02-12 20:04:16,532 Epoch 51 Step: 124900 Batch Loss: 1.126002 Tokens per Sec: 21993, Lr: 0.000300 2020-02-12 20:04:26,441 Epoch 51 Step: 125000 Batch Loss: 1.038579 Tokens per Sec: 22054, Lr: 0.000300 2020-02-12 20:04:44,646 Hooray! New best validation result [ppl]! 2020-02-12 20:04:44,646 Saving new checkpoint. 2020-02-12 20:04:44,845 Example #0 2020-02-12 20:04:44,846 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 20:04:44,846 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'sha', 'afatyô', 've', 'cii', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 20:04:44,846 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 20:04:44,846 Reference: 10 : ​ 6 - 9 . 2020-02-12 20:04:44,846 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo sha afatyô ve cii vea lu a dooshima u a lu hen atô ve la , shi vea za hemen u lun a dooshima u a lu hen atô ve la . — Marku 10 : 6 - 9 . 2020-02-12 20:04:44,846 Example #1 2020-02-12 20:04:44,846 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 20:04:44,846 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'a', 'lu', 'van', 'la', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 20:04:44,846 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 20:04:44,846 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 20:04:44,846 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u doon tsung ne , man ka shighe u a lu van la je la ! — Rom . 2020-02-12 20:04:44,846 Example #2 2020-02-12 20:04:44,846 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 20:04:44,847 Raw hypothesis: ['Anyom', 'nga', 'kar', 'pue', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 20:04:44,847 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 20:04:44,847 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 20:04:44,847 Hypothesis: Anyom nga kar pue yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 20:04:44,847 Example #3 2020-02-12 20:04:44,847 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 20:04:44,847 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'inja', 'ga', 'yô', ',', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'inja', '.'] 2020-02-12 20:04:44,847 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 20:04:44,847 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 20:04:44,847 Hypothesis: Alaghga or u nan lu eren kwagh sha inja ga yô , nana lu eren kwagh sha inja . 2020-02-12 20:04:44,847 Validation result (greedy) at epoch 51, step 125000: bleu: 27.22, loss: 41533.0039, ppl: 4.0672, duration: 18.4055s 2020-02-12 20:04:54,833 Epoch 51 Step: 125100 Batch Loss: 1.413849 Tokens per Sec: 22145, Lr: 0.000300 2020-02-12 20:05:04,834 Epoch 51 Step: 125200 Batch Loss: 1.386142 Tokens per Sec: 22136, Lr: 0.000300 2020-02-12 20:05:15,000 Epoch 51 Step: 125300 Batch Loss: 1.547791 Tokens per Sec: 21515, Lr: 0.000300 2020-02-12 20:05:25,183 Epoch 51 Step: 125400 Batch Loss: 1.374463 Tokens per Sec: 21393, Lr: 0.000300 2020-02-12 20:05:25,791 Epoch 51: total training loss 3506.18 2020-02-12 20:05:25,791 EPOCH 52 2020-02-12 20:05:35,518 Epoch 52 Step: 125500 Batch Loss: 1.287037 Tokens per Sec: 20694, Lr: 0.000300 2020-02-12 20:05:45,617 Epoch 52 Step: 125600 Batch Loss: 1.274035 Tokens per Sec: 22363, Lr: 0.000300 2020-02-12 20:05:55,560 Epoch 52 Step: 125700 Batch Loss: 1.442700 Tokens per Sec: 22489, Lr: 0.000300 2020-02-12 20:06:05,476 Epoch 52 Step: 125800 Batch Loss: 1.641110 Tokens per Sec: 22189, Lr: 0.000300 2020-02-12 20:06:15,476 Epoch 52 Step: 125900 Batch Loss: 1.687459 Tokens per Sec: 21789, Lr: 0.000300 2020-02-12 20:06:25,684 Epoch 52 Step: 126000 Batch Loss: 1.177242 Tokens per Sec: 22111, Lr: 0.000300 2020-02-12 20:06:44,159 Example #0 2020-02-12 20:06:44,159 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 20:06:44,160 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'sha', 'afatyô', 've', 'cii', 'vea', 'lu', 'a', 'dooshima', 'u', 'mimi', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'seer', 'a', 'seer', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 20:06:44,160 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 20:06:44,160 Reference: 10 : ​ 6 - 9 . 2020-02-12 20:06:44,160 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo sha afatyô ve cii vea lu a dooshima u mimi shi vea za hemen u lun a dooshima u a lu seer a seer la . — Marku 10 : 6 - 9 . 2020-02-12 20:06:44,160 Example #1 2020-02-12 20:06:44,160 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 20:06:44,160 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'ngu', 'zan', 'hemen', '!', '—', 'Rom', '.'] 2020-02-12 20:06:44,160 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 20:06:44,160 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 20:06:44,160 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u doon tsung ne , man kwagh ne ngu zan hemen ! — Rom . 2020-02-12 20:06:44,160 Example #2 2020-02-12 20:06:44,160 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 20:06:44,160 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 20:06:44,160 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 20:06:44,160 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 20:06:44,161 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 20:06:44,161 Example #3 2020-02-12 20:06:44,161 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 20:06:44,161 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 20:06:44,161 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 20:06:44,161 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 20:06:44,161 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-12 20:06:44,161 Validation result (greedy) at epoch 52, step 126000: bleu: 27.49, loss: 41666.3516, ppl: 4.0856, duration: 18.4760s 2020-02-12 20:06:54,335 Epoch 52 Step: 126100 Batch Loss: 1.278337 Tokens per Sec: 21772, Lr: 0.000300 2020-02-12 20:07:04,441 Epoch 52 Step: 126200 Batch Loss: 1.377132 Tokens per Sec: 21330, Lr: 0.000300 2020-02-12 20:07:14,535 Epoch 52 Step: 126300 Batch Loss: 1.350808 Tokens per Sec: 22745, Lr: 0.000300 2020-02-12 20:07:24,503 Epoch 52 Step: 126400 Batch Loss: 1.441688 Tokens per Sec: 22415, Lr: 0.000300 2020-02-12 20:07:34,392 Epoch 52 Step: 126500 Batch Loss: 1.270605 Tokens per Sec: 22207, Lr: 0.000300 2020-02-12 20:07:44,298 Epoch 52 Step: 126600 Batch Loss: 1.295722 Tokens per Sec: 22204, Lr: 0.000300 2020-02-12 20:07:54,228 Epoch 52 Step: 126700 Batch Loss: 1.452606 Tokens per Sec: 21821, Lr: 0.000300 2020-02-12 20:08:04,177 Epoch 52 Step: 126800 Batch Loss: 1.027616 Tokens per Sec: 21958, Lr: 0.000300 2020-02-12 20:08:14,159 Epoch 52 Step: 126900 Batch Loss: 1.478990 Tokens per Sec: 22413, Lr: 0.000300 2020-02-12 20:08:24,282 Epoch 52 Step: 127000 Batch Loss: 1.278045 Tokens per Sec: 22138, Lr: 0.000300 2020-02-12 20:08:43,334 Example #0 2020-02-12 20:08:43,335 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 20:08:43,335 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'vesen', 'yô', ',', 'doo', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 've', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', '.', '—', 'M@@', 'ar', '.', '10', ':', '6', '-', '9', '.'] 2020-02-12 20:08:43,335 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 20:08:43,335 Reference: 10 : ​ 6 - 9 . 2020-02-12 20:08:43,335 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u vesen yô , doo u noov man kasev vea nôngo kpoghuloo vea lu a dooshima ve la , shi vea za hemen u lun a dooshima u a lu a mi la . — Mar . 10 : 6 - 9 . 2020-02-12 20:08:43,335 Example #1 2020-02-12 20:08:43,335 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 20:08:43,335 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'imba', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 20:08:43,335 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 20:08:43,335 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 20:08:43,335 Hypothesis: Se kpa se fatyô u ‘ nengen ’ imba shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-12 20:08:43,335 Example #2 2020-02-12 20:08:43,336 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 20:08:43,336 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 20:08:43,336 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 20:08:43,336 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 20:08:43,336 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 20:08:43,336 Example #3 2020-02-12 20:08:43,336 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 20:08:43,336 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'inja', 'ga', '.'] 2020-02-12 20:08:43,336 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 20:08:43,336 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 20:08:43,336 Hypothesis: Alaghga or nana lu eren kwagh sha inja ga . 2020-02-12 20:08:43,336 Validation result (greedy) at epoch 52, step 127000: bleu: 27.60, loss: 41536.2773, ppl: 4.0676, duration: 19.0535s 2020-02-12 20:08:53,477 Epoch 52 Step: 127100 Batch Loss: 1.295180 Tokens per Sec: 21927, Lr: 0.000300 2020-02-12 20:09:03,553 Epoch 52 Step: 127200 Batch Loss: 1.516671 Tokens per Sec: 22007, Lr: 0.000300 2020-02-12 20:09:13,393 Epoch 52 Step: 127300 Batch Loss: 1.425522 Tokens per Sec: 22133, Lr: 0.000300 2020-02-12 20:09:23,343 Epoch 52 Step: 127400 Batch Loss: 1.526255 Tokens per Sec: 22305, Lr: 0.000300 2020-02-12 20:09:33,233 Epoch 52 Step: 127500 Batch Loss: 1.447029 Tokens per Sec: 21777, Lr: 0.000300 2020-02-12 20:09:43,143 Epoch 52 Step: 127600 Batch Loss: 1.330468 Tokens per Sec: 22178, Lr: 0.000300 2020-02-12 20:09:53,118 Epoch 52 Step: 127700 Batch Loss: 1.557477 Tokens per Sec: 22252, Lr: 0.000300 2020-02-12 20:10:03,046 Epoch 52 Step: 127800 Batch Loss: 1.325013 Tokens per Sec: 22566, Lr: 0.000300 2020-02-12 20:10:09,559 Epoch 52: total training loss 3500.10 2020-02-12 20:10:09,560 EPOCH 53 2020-02-12 20:10:13,158 Epoch 53 Step: 127900 Batch Loss: 0.945306 Tokens per Sec: 20493, Lr: 0.000300 2020-02-12 20:10:23,013 Epoch 53 Step: 128000 Batch Loss: 1.341978 Tokens per Sec: 22696, Lr: 0.000300 2020-02-12 20:10:41,334 Example #0 2020-02-12 20:10:41,334 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 20:10:41,335 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'una', 'fatyô', 'u', 'vesen', 'yô', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 20:10:41,335 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 20:10:41,335 Reference: 10 : ​ 6 - 9 . 2020-02-12 20:10:41,335 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu hen atô ve la shi vea za hemen u lun a dooshima u una fatyô u vesen yô . — Marku 10 : 6 - 9 . 2020-02-12 20:10:41,335 Example #1 2020-02-12 20:10:41,335 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 20:10:41,335 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'imba', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'a', 'mgb@@', 'ôghom', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 20:10:41,335 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 20:10:41,335 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 20:10:41,335 Hypothesis: Se kpa se fatyô u ‘ nengen ’ imba shighe u doon tsung ne , man ka shighe u a mgbôghom je la ! — Rom . 2020-02-12 20:10:41,335 Example #2 2020-02-12 20:10:41,335 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 20:10:41,335 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 20:10:41,335 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 20:10:41,335 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 20:10:41,336 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 20:10:41,336 Example #3 2020-02-12 20:10:41,336 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 20:10:41,336 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'inja', 'ga', 'yô', ',', 'nan', 'ngu', 'eren', 'kwagh', 'sha', 'inja', 'ga', '.'] 2020-02-12 20:10:41,336 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 20:10:41,336 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 20:10:41,336 Hypothesis: Alaghga or u nan lu eren kwagh sha inja ga yô , nan ngu eren kwagh sha inja ga . 2020-02-12 20:10:41,336 Validation result (greedy) at epoch 53, step 128000: bleu: 27.87, loss: 41669.6719, ppl: 4.0860, duration: 18.3222s 2020-02-12 20:10:51,270 Epoch 53 Step: 128100 Batch Loss: 1.332810 Tokens per Sec: 22219, Lr: 0.000300 2020-02-12 20:11:01,168 Epoch 53 Step: 128200 Batch Loss: 1.281466 Tokens per Sec: 22161, Lr: 0.000300 2020-02-12 20:11:11,091 Epoch 53 Step: 128300 Batch Loss: 1.276392 Tokens per Sec: 22132, Lr: 0.000300 2020-02-12 20:11:21,133 Epoch 53 Step: 128400 Batch Loss: 1.100881 Tokens per Sec: 22261, Lr: 0.000300 2020-02-12 20:11:31,354 Epoch 53 Step: 128500 Batch Loss: 1.560199 Tokens per Sec: 21511, Lr: 0.000300 2020-02-12 20:11:41,472 Epoch 53 Step: 128600 Batch Loss: 1.377666 Tokens per Sec: 22271, Lr: 0.000300 2020-02-12 20:11:51,413 Epoch 53 Step: 128700 Batch Loss: 1.352183 Tokens per Sec: 22047, Lr: 0.000300 2020-02-12 20:12:01,352 Epoch 53 Step: 128800 Batch Loss: 1.135714 Tokens per Sec: 21911, Lr: 0.000300 2020-02-12 20:12:11,281 Epoch 53 Step: 128900 Batch Loss: 1.188131 Tokens per Sec: 22978, Lr: 0.000300 2020-02-12 20:12:21,339 Epoch 53 Step: 129000 Batch Loss: 1.305238 Tokens per Sec: 22182, Lr: 0.000300 2020-02-12 20:12:39,698 Example #0 2020-02-12 20:12:39,699 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 20:12:39,699 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'una', 'fatyô', 'u', 'vesen', 'la', 'kpaa', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 20:12:39,699 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 20:12:39,699 Reference: 10 : ​ 6 - 9 . 2020-02-12 20:12:39,699 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la , shi vea za hemen u lun a dooshima u una fatyô u vesen la kpaa . — Marku 10 : 6 - 9 . 2020-02-12 20:12:39,699 Example #1 2020-02-12 20:12:39,699 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 20:12:39,699 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'imba', 'shighe', 'u', 'kpilighyol', 'ne', ',', 'man', 'kape', 'i', 'lu', 'mgb@@', 'ôghom', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 20:12:39,699 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 20:12:39,699 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 20:12:39,699 Hypothesis: Se kpa se fatyô u ‘ nengen ’ imba shighe u kpilighyol ne , man kape i lu mgbôghom je la ! — Rom . 2020-02-12 20:12:39,699 Example #2 2020-02-12 20:12:39,699 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 20:12:39,699 Raw hypothesis: ['Anyom', 'nga', 'kar', 'pue', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 20:12:39,700 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 20:12:39,700 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 20:12:39,700 Hypothesis: Anyom nga kar pue yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 20:12:39,700 Example #3 2020-02-12 20:12:39,700 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 20:12:39,700 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 20:12:39,700 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 20:12:39,700 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 20:12:39,700 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-12 20:12:39,700 Validation result (greedy) at epoch 53, step 129000: bleu: 28.03, loss: 41558.9766, ppl: 4.0708, duration: 18.3603s 2020-02-12 20:12:49,706 Epoch 53 Step: 129100 Batch Loss: 1.318610 Tokens per Sec: 21675, Lr: 0.000300 2020-02-12 20:12:59,804 Epoch 53 Step: 129200 Batch Loss: 1.519895 Tokens per Sec: 22134, Lr: 0.000300 2020-02-12 20:13:09,745 Epoch 53 Step: 129300 Batch Loss: 1.312949 Tokens per Sec: 22482, Lr: 0.000300 2020-02-12 20:13:19,695 Epoch 53 Step: 129400 Batch Loss: 1.351246 Tokens per Sec: 22125, Lr: 0.000300 2020-02-12 20:13:29,615 Epoch 53 Step: 129500 Batch Loss: 1.574879 Tokens per Sec: 22432, Lr: 0.000300 2020-02-12 20:13:39,505 Epoch 53 Step: 129600 Batch Loss: 1.358454 Tokens per Sec: 21763, Lr: 0.000300 2020-02-12 20:13:49,435 Epoch 53 Step: 129700 Batch Loss: 1.582680 Tokens per Sec: 22184, Lr: 0.000300 2020-02-12 20:13:59,366 Epoch 53 Step: 129800 Batch Loss: 1.465101 Tokens per Sec: 22964, Lr: 0.000300 2020-02-12 20:14:09,303 Epoch 53 Step: 129900 Batch Loss: 1.335306 Tokens per Sec: 22037, Lr: 0.000300 2020-02-12 20:14:19,215 Epoch 53 Step: 130000 Batch Loss: 1.569615 Tokens per Sec: 21847, Lr: 0.000300 2020-02-12 20:14:37,397 Hooray! New best validation result [ppl]! 2020-02-12 20:14:37,397 Saving new checkpoint. 2020-02-12 20:14:37,585 Example #0 2020-02-12 20:14:37,585 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 20:14:37,585 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'tese', 'dooshima', 've', 'la', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 20:14:37,586 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 20:14:37,586 Reference: 10 : ​ 6 - 9 . 2020-02-12 20:14:37,586 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea tese dooshima ve la shi vea za hemen u lun a dooshima u a lu a mi la . — Marku 10 : 6 - 9 . 2020-02-12 20:14:37,586 Example #1 2020-02-12 20:14:37,586 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 20:14:37,586 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'imba', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 20:14:37,586 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 20:14:37,586 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 20:14:37,586 Hypothesis: Se kpa se fatyô u ‘ nengen ’ imba shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-12 20:14:37,586 Example #2 2020-02-12 20:14:37,586 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 20:14:37,586 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 20:14:37,586 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 20:14:37,586 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 20:14:37,586 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 20:14:37,587 Example #3 2020-02-12 20:14:37,587 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 20:14:37,587 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 20:14:37,587 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 20:14:37,587 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 20:14:37,587 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga yô . 2020-02-12 20:14:37,587 Validation result (greedy) at epoch 53, step 130000: bleu: 27.81, loss: 41450.2852, ppl: 4.0558, duration: 18.3712s 2020-02-12 20:14:47,555 Epoch 53 Step: 130100 Batch Loss: 1.393136 Tokens per Sec: 22425, Lr: 0.000300 2020-02-12 20:14:57,450 Epoch 53 Step: 130200 Batch Loss: 1.281018 Tokens per Sec: 22196, Lr: 0.000300 2020-02-12 20:15:07,330 Epoch 53 Step: 130300 Batch Loss: 1.307081 Tokens per Sec: 22171, Lr: 0.000300 2020-02-12 20:15:09,704 Epoch 53: total training loss 3487.54 2020-02-12 20:15:09,705 EPOCH 54 2020-02-12 20:15:17,477 Epoch 54 Step: 130400 Batch Loss: 1.504532 Tokens per Sec: 21109, Lr: 0.000300 2020-02-12 20:15:27,531 Epoch 54 Step: 130500 Batch Loss: 1.180577 Tokens per Sec: 22095, Lr: 0.000300 2020-02-12 20:15:37,583 Epoch 54 Step: 130600 Batch Loss: 1.493508 Tokens per Sec: 21575, Lr: 0.000300 2020-02-12 20:15:47,665 Epoch 54 Step: 130700 Batch Loss: 1.417111 Tokens per Sec: 22017, Lr: 0.000300 2020-02-12 20:15:57,772 Epoch 54 Step: 130800 Batch Loss: 1.499153 Tokens per Sec: 22323, Lr: 0.000300 2020-02-12 20:16:07,861 Epoch 54 Step: 130900 Batch Loss: 1.354934 Tokens per Sec: 21250, Lr: 0.000300 2020-02-12 20:16:17,961 Epoch 54 Step: 131000 Batch Loss: 1.358140 Tokens per Sec: 22129, Lr: 0.000300 2020-02-12 20:16:36,347 Hooray! New best validation result [ppl]! 2020-02-12 20:16:36,347 Saving new checkpoint. 2020-02-12 20:16:36,534 Example #0 2020-02-12 20:16:36,534 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 20:16:36,534 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 've', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'kpaa', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 20:16:36,534 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 20:16:36,534 Reference: 10 : ​ 6 - 9 . 2020-02-12 20:16:36,534 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima ve la , shi vea za hemen u lun a dooshima u a lu a mi la kpaa . — Marku 10 : 6 - 9 . 2020-02-12 20:16:36,534 Example #1 2020-02-12 20:16:36,534 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 20:16:36,534 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'a', 'lu', 'van', 'la', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 20:16:36,534 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 20:16:36,534 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 20:16:36,535 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u doon tsung ne , man ka shighe u a lu van la je la ! — Rom . 2020-02-12 20:16:36,535 Example #2 2020-02-12 20:16:36,535 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 20:16:36,535 Raw hypothesis: ['Anyom', 'nga', 'kar', 'pue', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 20:16:36,535 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 20:16:36,535 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 20:16:36,535 Hypothesis: Anyom nga kar pue yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 20:16:36,535 Example #3 2020-02-12 20:16:36,535 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 20:16:36,535 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 20:16:36,535 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 20:16:36,535 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 20:16:36,535 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 20:16:36,535 Validation result (greedy) at epoch 54, step 131000: bleu: 27.90, loss: 41441.7539, ppl: 4.0547, duration: 18.5742s 2020-02-12 20:16:46,520 Epoch 54 Step: 131100 Batch Loss: 1.061822 Tokens per Sec: 22103, Lr: 0.000300 2020-02-12 20:16:56,382 Epoch 54 Step: 131200 Batch Loss: 1.463370 Tokens per Sec: 22620, Lr: 0.000300 2020-02-12 20:17:06,336 Epoch 54 Step: 131300 Batch Loss: 1.290340 Tokens per Sec: 22428, Lr: 0.000300 2020-02-12 20:17:16,248 Epoch 54 Step: 131400 Batch Loss: 1.403015 Tokens per Sec: 22249, Lr: 0.000300 2020-02-12 20:17:26,142 Epoch 54 Step: 131500 Batch Loss: 1.594449 Tokens per Sec: 22502, Lr: 0.000300 2020-02-12 20:17:36,075 Epoch 54 Step: 131600 Batch Loss: 1.197053 Tokens per Sec: 21904, Lr: 0.000300 2020-02-12 20:17:45,937 Epoch 54 Step: 131700 Batch Loss: 1.201219 Tokens per Sec: 22014, Lr: 0.000300 2020-02-12 20:17:55,822 Epoch 54 Step: 131800 Batch Loss: 1.388245 Tokens per Sec: 23045, Lr: 0.000300 2020-02-12 20:18:05,902 Epoch 54 Step: 131900 Batch Loss: 1.250306 Tokens per Sec: 22547, Lr: 0.000300 2020-02-12 20:18:16,091 Epoch 54 Step: 132000 Batch Loss: 1.533586 Tokens per Sec: 21463, Lr: 0.000300 2020-02-12 20:18:35,819 Example #0 2020-02-12 20:18:35,819 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 20:18:35,819 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'kpaa', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 20:18:35,819 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 20:18:35,820 Reference: 10 : ​ 6 - 9 . 2020-02-12 20:18:35,820 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la , shi vea za hemen u lun a dooshima u a lu a mi la kpaa . — Marku 10 : 6 - 9 . 2020-02-12 20:18:35,820 Example #1 2020-02-12 20:18:35,820 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 20:18:35,820 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'kpilighyol', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'a', 'lu', 'van', 'la', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 20:18:35,820 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 20:18:35,820 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 20:18:35,820 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u kpilighyol ne , man ka shighe u a lu van la je la ! — Rom . 2020-02-12 20:18:35,820 Example #2 2020-02-12 20:18:35,820 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 20:18:35,820 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 20:18:35,820 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 20:18:35,820 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 20:18:35,820 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 20:18:35,820 Example #3 2020-02-12 20:18:35,821 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 20:18:35,821 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 20:18:35,821 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 20:18:35,821 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 20:18:35,821 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga yô . 2020-02-12 20:18:35,821 Validation result (greedy) at epoch 54, step 132000: bleu: 27.84, loss: 41601.0469, ppl: 4.0765, duration: 19.7291s 2020-02-12 20:18:45,777 Epoch 54 Step: 132100 Batch Loss: 1.710445 Tokens per Sec: 21530, Lr: 0.000300 2020-02-12 20:18:55,902 Epoch 54 Step: 132200 Batch Loss: 1.404967 Tokens per Sec: 22346, Lr: 0.000300 2020-02-12 20:19:06,022 Epoch 54 Step: 132300 Batch Loss: 1.256445 Tokens per Sec: 22151, Lr: 0.000300 2020-02-12 20:19:16,146 Epoch 54 Step: 132400 Batch Loss: 1.471997 Tokens per Sec: 21686, Lr: 0.000300 2020-02-12 20:19:26,246 Epoch 54 Step: 132500 Batch Loss: 1.468938 Tokens per Sec: 21430, Lr: 0.000300 2020-02-12 20:19:36,130 Epoch 54 Step: 132600 Batch Loss: 1.402084 Tokens per Sec: 22316, Lr: 0.000300 2020-02-12 20:19:46,006 Epoch 54 Step: 132700 Batch Loss: 1.525298 Tokens per Sec: 22597, Lr: 0.000300 2020-02-12 20:19:54,423 Epoch 54: total training loss 3482.67 2020-02-12 20:19:54,423 EPOCH 55 2020-02-12 20:19:56,179 Epoch 55 Step: 132800 Batch Loss: 1.312444 Tokens per Sec: 18569, Lr: 0.000300 2020-02-12 20:20:06,294 Epoch 55 Step: 132900 Batch Loss: 1.309515 Tokens per Sec: 21923, Lr: 0.000300 2020-02-12 20:20:16,337 Epoch 55 Step: 133000 Batch Loss: 1.406046 Tokens per Sec: 21868, Lr: 0.000300 2020-02-12 20:20:35,222 Example #0 2020-02-12 20:20:35,222 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 20:20:35,222 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'sha', 'er', 'dooshima', 've', 'una', 'seer', 'taver', 'yô', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 20:20:35,222 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 20:20:35,222 Reference: 10 : ​ 6 - 9 . 2020-02-12 20:20:35,222 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo sha er dooshima ve una seer taver yô . — Marku 10 : 6 - 9 . 2020-02-12 20:20:35,222 Example #1 2020-02-12 20:20:35,223 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 20:20:35,223 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'imba', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 20:20:35,223 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 20:20:35,223 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 20:20:35,223 Hypothesis: Se kpa se fatyô u ‘ nengen ’ imba shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-12 20:20:35,223 Example #2 2020-02-12 20:20:35,223 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 20:20:35,223 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 20:20:35,223 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 20:20:35,223 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 20:20:35,223 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 20:20:35,223 Example #3 2020-02-12 20:20:35,223 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 20:20:35,224 Raw hypothesis: ['Alaghga', 'or', 'ngu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 20:20:35,224 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 20:20:35,224 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 20:20:35,224 Hypothesis: Alaghga or ngu eren kwagh sha gbenda u vough ga . 2020-02-12 20:20:35,224 Validation result (greedy) at epoch 55, step 133000: bleu: 27.65, loss: 41597.4414, ppl: 4.0761, duration: 18.8866s 2020-02-12 20:20:45,162 Epoch 55 Step: 133100 Batch Loss: 1.631006 Tokens per Sec: 22060, Lr: 0.000300 2020-02-12 20:20:55,214 Epoch 55 Step: 133200 Batch Loss: 1.561041 Tokens per Sec: 22260, Lr: 0.000300 2020-02-12 20:21:05,114 Epoch 55 Step: 133300 Batch Loss: 1.576266 Tokens per Sec: 21858, Lr: 0.000300 2020-02-12 20:21:15,044 Epoch 55 Step: 133400 Batch Loss: 1.196723 Tokens per Sec: 22158, Lr: 0.000300 2020-02-12 20:21:25,021 Epoch 55 Step: 133500 Batch Loss: 1.511015 Tokens per Sec: 22694, Lr: 0.000300 2020-02-12 20:21:34,888 Epoch 55 Step: 133600 Batch Loss: 1.476158 Tokens per Sec: 22146, Lr: 0.000300 2020-02-12 20:21:44,783 Epoch 55 Step: 133700 Batch Loss: 1.489661 Tokens per Sec: 22524, Lr: 0.000300 2020-02-12 20:21:54,743 Epoch 55 Step: 133800 Batch Loss: 1.500761 Tokens per Sec: 22306, Lr: 0.000300 2020-02-12 20:22:04,663 Epoch 55 Step: 133900 Batch Loss: 1.296494 Tokens per Sec: 22032, Lr: 0.000300 2020-02-12 20:22:14,591 Epoch 55 Step: 134000 Batch Loss: 1.385032 Tokens per Sec: 22111, Lr: 0.000300 2020-02-12 20:22:32,842 Hooray! New best validation result [ppl]! 2020-02-12 20:22:32,842 Saving new checkpoint. 2020-02-12 20:22:33,029 Example #0 2020-02-12 20:22:33,030 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 20:22:33,030 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsan', 'gbem', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'sha', 'er', 'dooshima', 've', 'una', 'seer', 'taver', 'yô', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 20:22:33,030 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 20:22:33,030 Reference: 10 : ​ 6 - 9 . 2020-02-12 20:22:33,030 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsan gbem yô , gba hange hange u noov man kasev vea nôngo sha er dooshima ve una seer taver yô . — Marku 10 : 6 - 9 . 2020-02-12 20:22:33,030 Example #1 2020-02-12 20:22:33,030 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 20:22:33,030 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'imba', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kape', 'i', 'lu', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 20:22:33,030 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 20:22:33,030 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 20:22:33,030 Hypothesis: Se kpa se fatyô u ‘ nengen ’ imba shighe u doon tsung ne , man kape i lu je la ! — Rom . 2020-02-12 20:22:33,030 Example #2 2020-02-12 20:22:33,030 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 20:22:33,030 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 20:22:33,030 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 20:22:33,031 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 20:22:33,031 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 20:22:33,031 Example #3 2020-02-12 20:22:33,031 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 20:22:33,031 Raw hypothesis: ['Alaghga', 'or', 'nan', 'ngu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 20:22:33,031 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 20:22:33,031 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 20:22:33,031 Hypothesis: Alaghga or nan ngu eren kwagh sha gbenda u vough ga . 2020-02-12 20:22:33,031 Validation result (greedy) at epoch 55, step 134000: bleu: 28.10, loss: 41431.3789, ppl: 4.0533, duration: 18.4398s 2020-02-12 20:22:42,980 Epoch 55 Step: 134100 Batch Loss: 1.304861 Tokens per Sec: 22461, Lr: 0.000300 2020-02-12 20:22:52,943 Epoch 55 Step: 134200 Batch Loss: 1.381374 Tokens per Sec: 22168, Lr: 0.000300 2020-02-12 20:23:02,961 Epoch 55 Step: 134300 Batch Loss: 1.418826 Tokens per Sec: 21905, Lr: 0.000300 2020-02-12 20:23:12,876 Epoch 55 Step: 134400 Batch Loss: 1.537426 Tokens per Sec: 21736, Lr: 0.000300 2020-02-12 20:23:22,849 Epoch 55 Step: 134500 Batch Loss: 1.561071 Tokens per Sec: 22503, Lr: 0.000300 2020-02-12 20:23:32,813 Epoch 55 Step: 134600 Batch Loss: 1.399846 Tokens per Sec: 22606, Lr: 0.000300 2020-02-12 20:23:42,698 Epoch 55 Step: 134700 Batch Loss: 1.606130 Tokens per Sec: 22438, Lr: 0.000300 2020-02-12 20:23:52,672 Epoch 55 Step: 134800 Batch Loss: 1.044886 Tokens per Sec: 22367, Lr: 0.000300 2020-02-12 20:24:02,559 Epoch 55 Step: 134900 Batch Loss: 1.292325 Tokens per Sec: 22132, Lr: 0.000300 2020-02-12 20:24:12,483 Epoch 55 Step: 135000 Batch Loss: 1.458226 Tokens per Sec: 22588, Lr: 0.000300 2020-02-12 20:24:30,833 Hooray! New best validation result [ppl]! 2020-02-12 20:24:30,833 Saving new checkpoint. 2020-02-12 20:24:31,021 Example #0 2020-02-12 20:24:31,021 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 20:24:31,021 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'sha', 'afatyô', 've', 'cii', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'una', 'fatyô', 'u', 'vesen', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 20:24:31,021 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 20:24:31,021 Reference: 10 : ​ 6 - 9 . 2020-02-12 20:24:31,021 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo sha afatyô ve cii vea lu a dooshima u a lu a mi la , shi vea za hemen u lun a dooshima u una fatyô u vesen la . — Marku 10 : 6 - 9 . 2020-02-12 20:24:31,022 Example #1 2020-02-12 20:24:31,022 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 20:24:31,022 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'imba', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 20:24:31,022 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 20:24:31,022 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 20:24:31,022 Hypothesis: Se kpa se fatyô u ‘ nengen ’ imba shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-12 20:24:31,022 Example #2 2020-02-12 20:24:31,022 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 20:24:31,022 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 20:24:31,022 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 20:24:31,022 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 20:24:31,022 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 20:24:31,022 Example #3 2020-02-12 20:24:31,022 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 20:24:31,022 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 20:24:31,022 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 20:24:31,023 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 20:24:31,023 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-12 20:24:31,023 Validation result (greedy) at epoch 55, step 135000: bleu: 28.31, loss: 41287.8906, ppl: 4.0337, duration: 18.5395s 2020-02-12 20:24:40,930 Epoch 55 Step: 135100 Batch Loss: 1.506314 Tokens per Sec: 21973, Lr: 0.000300 2020-02-12 20:24:50,880 Epoch 55 Step: 135200 Batch Loss: 1.429518 Tokens per Sec: 22269, Lr: 0.000300 2020-02-12 20:24:55,244 Epoch 55: total training loss 3472.93 2020-02-12 20:24:55,244 EPOCH 56 2020-02-12 20:25:01,244 Epoch 56 Step: 135300 Batch Loss: 1.572820 Tokens per Sec: 20826, Lr: 0.000300 2020-02-12 20:25:11,483 Epoch 56 Step: 135400 Batch Loss: 1.540724 Tokens per Sec: 21375, Lr: 0.000300 2020-02-12 20:25:21,717 Epoch 56 Step: 135500 Batch Loss: 1.579501 Tokens per Sec: 21858, Lr: 0.000300 2020-02-12 20:25:31,717 Epoch 56 Step: 135600 Batch Loss: 1.549641 Tokens per Sec: 22371, Lr: 0.000300 2020-02-12 20:25:41,584 Epoch 56 Step: 135700 Batch Loss: 1.529646 Tokens per Sec: 21627, Lr: 0.000300 2020-02-12 20:25:51,550 Epoch 56 Step: 135800 Batch Loss: 1.475770 Tokens per Sec: 22321, Lr: 0.000300 2020-02-12 20:26:01,450 Epoch 56 Step: 135900 Batch Loss: 1.449519 Tokens per Sec: 22522, Lr: 0.000300 2020-02-12 20:26:11,580 Epoch 56 Step: 136000 Batch Loss: 1.323681 Tokens per Sec: 21546, Lr: 0.000300 2020-02-12 20:26:30,013 Example #0 2020-02-12 20:26:30,013 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 20:26:30,013 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'doo', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'sha', 'er', 'dooshima', 've', 'una', 'seer', 'taver', 'yô', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 20:26:30,013 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 20:26:30,013 Reference: 10 : ​ 6 - 9 . 2020-02-12 20:26:30,013 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , doo u noov man kasev vea nôngo sha er dooshima ve una seer taver yô . — Marku 10 : 6 - 9 . 2020-02-12 20:26:30,013 Example #1 2020-02-12 20:26:30,013 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 20:26:30,013 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'imba', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kape', 'i', 'lu', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 20:26:30,013 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 20:26:30,013 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 20:26:30,013 Hypothesis: Se kpa se fatyô u ‘ nengen ’ imba shighe u doon tsung ne , man kape i lu je la ! — Rom . 2020-02-12 20:26:30,013 Example #2 2020-02-12 20:26:30,014 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 20:26:30,014 Raw hypothesis: ['Anyom', 'nga', 'kar', 'pue', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 20:26:30,014 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 20:26:30,014 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 20:26:30,014 Hypothesis: Anyom nga kar pue yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 20:26:30,014 Example #3 2020-02-12 20:26:30,014 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 20:26:30,014 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 20:26:30,014 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 20:26:30,014 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 20:26:30,014 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga yô . 2020-02-12 20:26:30,014 Validation result (greedy) at epoch 56, step 136000: bleu: 28.03, loss: 41520.4688, ppl: 4.0655, duration: 18.4335s 2020-02-12 20:26:39,980 Epoch 56 Step: 136100 Batch Loss: 1.441526 Tokens per Sec: 22118, Lr: 0.000300 2020-02-12 20:26:49,981 Epoch 56 Step: 136200 Batch Loss: 1.281855 Tokens per Sec: 22711, Lr: 0.000300 2020-02-12 20:26:59,924 Epoch 56 Step: 136300 Batch Loss: 1.430946 Tokens per Sec: 22392, Lr: 0.000300 2020-02-12 20:27:10,169 Epoch 56 Step: 136400 Batch Loss: 1.361922 Tokens per Sec: 20923, Lr: 0.000300 2020-02-12 20:27:20,451 Epoch 56 Step: 136500 Batch Loss: 1.445235 Tokens per Sec: 21225, Lr: 0.000300 2020-02-12 20:27:30,420 Epoch 56 Step: 136600 Batch Loss: 1.158029 Tokens per Sec: 22217, Lr: 0.000300 2020-02-12 20:27:40,339 Epoch 56 Step: 136700 Batch Loss: 1.396138 Tokens per Sec: 21873, Lr: 0.000300 2020-02-12 20:27:50,288 Epoch 56 Step: 136800 Batch Loss: 1.549796 Tokens per Sec: 22276, Lr: 0.000300 2020-02-12 20:28:00,385 Epoch 56 Step: 136900 Batch Loss: 1.701921 Tokens per Sec: 21940, Lr: 0.000300 2020-02-12 20:28:10,383 Epoch 56 Step: 137000 Batch Loss: 1.408317 Tokens per Sec: 22848, Lr: 0.000300 2020-02-12 20:28:28,891 Hooray! New best validation result [ppl]! 2020-02-12 20:28:28,891 Saving new checkpoint. 2020-02-12 20:28:29,078 Example #0 2020-02-12 20:28:29,078 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 20:28:29,078 Raw hypothesis: ['Er', 'i', 'ver', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsan', 'gbem', 'sha', 'won', 'yô', ',', 'doo', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'sha', 'er', 'dooshima', 've', 'una', 'seer', 'taver', 'yô', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'kpaa', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 20:28:29,078 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 20:28:29,079 Reference: 10 : ​ 6 - 9 . 2020-02-12 20:28:29,079 Hypothesis: Er i ver ivese i Yehova a ver la i lu kwagh u tsan gbem sha won yô , doo u noov man kasev vea nôngo sha er dooshima ve una seer taver yô , shi vea za hemen u lun a dooshima u a lu a mi la kpaa . — Marku 10 : 6 - 9 . 2020-02-12 20:28:29,079 Example #1 2020-02-12 20:28:29,079 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 20:28:29,079 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kape', 'i', 'lu', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 20:28:29,079 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 20:28:29,079 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 20:28:29,079 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u doon tsung ne , man kape i lu je la ! — Rom . 2020-02-12 20:28:29,079 Example #2 2020-02-12 20:28:29,079 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 20:28:29,079 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 20:28:29,079 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 20:28:29,079 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 20:28:29,079 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 20:28:29,079 Example #3 2020-02-12 20:28:29,080 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 20:28:29,080 Raw hypothesis: ['Alaghga', 'or', 'nana', 'fatyô', 'u', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 20:28:29,080 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 20:28:29,080 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 20:28:29,080 Hypothesis: Alaghga or nana fatyô u eren kwagh sha gbenda u vough ga yô . 2020-02-12 20:28:29,080 Validation result (greedy) at epoch 56, step 137000: bleu: 28.14, loss: 41284.6562, ppl: 4.0332, duration: 18.6962s 2020-02-12 20:28:38,945 Epoch 56 Step: 137100 Batch Loss: 1.204792 Tokens per Sec: 22271, Lr: 0.000300 2020-02-12 20:28:48,873 Epoch 56 Step: 137200 Batch Loss: 1.439944 Tokens per Sec: 21970, Lr: 0.000300 2020-02-12 20:28:58,797 Epoch 56 Step: 137300 Batch Loss: 1.372061 Tokens per Sec: 22176, Lr: 0.000300 2020-02-12 20:29:08,748 Epoch 56 Step: 137400 Batch Loss: 1.481259 Tokens per Sec: 21844, Lr: 0.000300 2020-02-12 20:29:18,877 Epoch 56 Step: 137500 Batch Loss: 1.639699 Tokens per Sec: 21915, Lr: 0.000300 2020-02-12 20:29:28,994 Epoch 56 Step: 137600 Batch Loss: 1.328825 Tokens per Sec: 22852, Lr: 0.000300 2020-02-12 20:29:39,075 Epoch 56 Step: 137700 Batch Loss: 1.068393 Tokens per Sec: 21951, Lr: 0.000300 2020-02-12 20:29:39,286 Epoch 56: total training loss 3460.48 2020-02-12 20:29:39,286 EPOCH 57 2020-02-12 20:29:49,616 Epoch 57 Step: 137800 Batch Loss: 1.409064 Tokens per Sec: 21133, Lr: 0.000300 2020-02-12 20:29:59,693 Epoch 57 Step: 137900 Batch Loss: 1.535509 Tokens per Sec: 22247, Lr: 0.000300 2020-02-12 20:30:09,756 Epoch 57 Step: 138000 Batch Loss: 1.389508 Tokens per Sec: 21185, Lr: 0.000300 2020-02-12 20:30:28,918 Hooray! New best validation result [ppl]! 2020-02-12 20:30:28,919 Saving new checkpoint. 2020-02-12 20:30:29,117 Example #0 2020-02-12 20:30:29,117 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 20:30:29,117 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsan', 'gbem', 'sha', 'won', 'yô', ',', 'doo', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'sha', 'afatyô', 've', 'cii', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'una', 'fatyô', 'u', 'vesen', 'yô', '.', '—', 'M@@', 'ar', '.', '10', ':', '6', '-', '9', '.'] 2020-02-12 20:30:29,117 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 20:30:29,117 Reference: 10 : ​ 6 - 9 . 2020-02-12 20:30:29,117 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsan gbem sha won yô , doo u noov man kasev vea nôngo sha afatyô ve cii vea lu a dooshima u a lu a mi la , shi vea za hemen u lun a dooshima u una fatyô u vesen yô . — Mar . 10 : 6 - 9 . 2020-02-12 20:30:29,117 Example #1 2020-02-12 20:30:29,117 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 20:30:29,117 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'doon', 'tsung', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 20:30:29,118 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 20:30:29,118 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 20:30:29,118 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u doon tsung ne , man ka shighe u doon tsung je la ! — Rom . 2020-02-12 20:30:29,118 Example #2 2020-02-12 20:30:29,118 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 20:30:29,118 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 20:30:29,118 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 20:30:29,118 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 20:30:29,118 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 20:30:29,118 Example #3 2020-02-12 20:30:29,118 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 20:30:29,118 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 20:30:29,118 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 20:30:29,118 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 20:30:29,118 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 20:30:29,118 Validation result (greedy) at epoch 57, step 138000: bleu: 28.39, loss: 41269.4883, ppl: 4.0311, duration: 19.3620s 2020-02-12 20:30:39,028 Epoch 57 Step: 138100 Batch Loss: 1.386223 Tokens per Sec: 22622, Lr: 0.000300 2020-02-12 20:30:48,980 Epoch 57 Step: 138200 Batch Loss: 1.396016 Tokens per Sec: 22136, Lr: 0.000300 2020-02-12 20:30:58,913 Epoch 57 Step: 138300 Batch Loss: 1.405759 Tokens per Sec: 22564, Lr: 0.000300 2020-02-12 20:31:08,879 Epoch 57 Step: 138400 Batch Loss: 1.336322 Tokens per Sec: 21974, Lr: 0.000300 2020-02-12 20:31:19,163 Epoch 57 Step: 138500 Batch Loss: 1.414866 Tokens per Sec: 21517, Lr: 0.000300 2020-02-12 20:31:29,391 Epoch 57 Step: 138600 Batch Loss: 1.645918 Tokens per Sec: 21313, Lr: 0.000300 2020-02-12 20:31:39,514 Epoch 57 Step: 138700 Batch Loss: 1.200104 Tokens per Sec: 22077, Lr: 0.000300 2020-02-12 20:31:49,588 Epoch 57 Step: 138800 Batch Loss: 1.267649 Tokens per Sec: 22339, Lr: 0.000300 2020-02-12 20:31:59,514 Epoch 57 Step: 138900 Batch Loss: 1.227153 Tokens per Sec: 22215, Lr: 0.000300 2020-02-12 20:32:09,491 Epoch 57 Step: 139000 Batch Loss: 1.514324 Tokens per Sec: 22232, Lr: 0.000300 2020-02-12 20:32:27,650 Hooray! New best validation result [ppl]! 2020-02-12 20:32:27,651 Saving new checkpoint. 2020-02-12 20:32:27,841 Example #0 2020-02-12 20:32:27,841 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 20:32:27,842 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsan', 'gbem', 'sha', 'won', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'sha', 'er', 'dooshima', 've', 'una', 'seer', 'taver', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'yô', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 20:32:27,842 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 20:32:27,842 Reference: 10 : ​ 6 - 9 . 2020-02-12 20:32:27,842 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsan gbem sha won yô , gba hange hange u noov man kasev vea nôngo sha er dooshima ve una seer taver shi vea za hemen u lun a dooshima u a lu a mi la yô . — Marku 10 : 6 - 9 . 2020-02-12 20:32:27,842 Example #1 2020-02-12 20:32:27,842 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 20:32:27,842 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'imba', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kape', 'i', 'lu', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 20:32:27,842 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 20:32:27,842 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 20:32:27,842 Hypothesis: Se kpa se fatyô u ‘ nengen ’ imba shighe u doon tsung ne , man kape i lu je la ! — Rom . 2020-02-12 20:32:27,842 Example #2 2020-02-12 20:32:27,842 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 20:32:27,842 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 20:32:27,842 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 20:32:27,842 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 20:32:27,843 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 20:32:27,843 Example #3 2020-02-12 20:32:27,843 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 20:32:27,843 Raw hypothesis: ['Alaghga', 'or', 'nana', 'fatyô', 'u', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 20:32:27,843 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 20:32:27,843 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 20:32:27,843 Hypothesis: Alaghga or nana fatyô u eren kwagh sha gbenda u vough ga . 2020-02-12 20:32:27,843 Validation result (greedy) at epoch 57, step 139000: bleu: 27.60, loss: 41243.7695, ppl: 4.0276, duration: 18.3510s 2020-02-12 20:32:37,921 Epoch 57 Step: 139100 Batch Loss: 1.107726 Tokens per Sec: 21669, Lr: 0.000300 2020-02-12 20:32:48,099 Epoch 57 Step: 139200 Batch Loss: 1.511175 Tokens per Sec: 22441, Lr: 0.000300 2020-02-12 20:32:58,199 Epoch 57 Step: 139300 Batch Loss: 1.286040 Tokens per Sec: 21329, Lr: 0.000300 2020-02-12 20:33:08,245 Epoch 57 Step: 139400 Batch Loss: 1.264378 Tokens per Sec: 22008, Lr: 0.000300 2020-02-12 20:33:18,300 Epoch 57 Step: 139500 Batch Loss: 1.395441 Tokens per Sec: 22342, Lr: 0.000300 2020-02-12 20:33:28,650 Epoch 57 Step: 139600 Batch Loss: 1.556007 Tokens per Sec: 21738, Lr: 0.000300 2020-02-12 20:33:38,698 Epoch 57 Step: 139700 Batch Loss: 1.583088 Tokens per Sec: 22020, Lr: 0.000300 2020-02-12 20:33:48,826 Epoch 57 Step: 139800 Batch Loss: 1.647110 Tokens per Sec: 21363, Lr: 0.000300 2020-02-12 20:33:58,900 Epoch 57 Step: 139900 Batch Loss: 1.436999 Tokens per Sec: 21876, Lr: 0.000300 2020-02-12 20:34:09,024 Epoch 57 Step: 140000 Batch Loss: 1.308260 Tokens per Sec: 21784, Lr: 0.000300 2020-02-12 20:34:27,936 Hooray! New best validation result [ppl]! 2020-02-12 20:34:27,936 Saving new checkpoint. 2020-02-12 20:34:28,130 Example #0 2020-02-12 20:34:28,130 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 20:34:28,130 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'sha', 'afatyô', 've', 'cii', 'vea', 'lu', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'una', 'fatyô', 'u', 'vesen', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 20:34:28,131 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 20:34:28,131 Reference: 10 : ​ 6 - 9 . 2020-02-12 20:34:28,131 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo sha afatyô ve cii vea lu a dooshima u ve lu a mi la , shi vea za hemen u lun a dooshima u una fatyô u vesen la . — Marku 10 : 6 - 9 . 2020-02-12 20:34:28,131 Example #1 2020-02-12 20:34:28,131 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 20:34:28,131 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kape', 'a', 'lu', 'mgb@@', 'ôghom', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 20:34:28,131 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 20:34:28,131 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 20:34:28,131 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u doon tsung ne , man kape a lu mgbôghom je la ! — Rom . 2020-02-12 20:34:28,131 Example #2 2020-02-12 20:34:28,131 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 20:34:28,131 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 20:34:28,131 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 20:34:28,131 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 20:34:28,132 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 20:34:28,132 Example #3 2020-02-12 20:34:28,132 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 20:34:28,132 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 20:34:28,132 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 20:34:28,132 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 20:34:28,132 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 20:34:28,132 Validation result (greedy) at epoch 57, step 140000: bleu: 27.79, loss: 41236.4414, ppl: 4.0266, duration: 19.1071s 2020-02-12 20:34:38,251 Epoch 57 Step: 140100 Batch Loss: 1.484604 Tokens per Sec: 21520, Lr: 0.000300 2020-02-12 20:34:44,404 Epoch 57: total training loss 3456.85 2020-02-12 20:34:44,404 EPOCH 58 2020-02-12 20:34:48,818 Epoch 58 Step: 140200 Batch Loss: 1.496705 Tokens per Sec: 20449, Lr: 0.000300 2020-02-12 20:34:59,034 Epoch 58 Step: 140300 Batch Loss: 1.397625 Tokens per Sec: 21103, Lr: 0.000300 2020-02-12 20:35:09,142 Epoch 58 Step: 140400 Batch Loss: 1.359809 Tokens per Sec: 21895, Lr: 0.000300 2020-02-12 20:35:19,108 Epoch 58 Step: 140500 Batch Loss: 1.587685 Tokens per Sec: 22261, Lr: 0.000300 2020-02-12 20:35:29,110 Epoch 58 Step: 140600 Batch Loss: 1.402586 Tokens per Sec: 21536, Lr: 0.000300 2020-02-12 20:35:39,019 Epoch 58 Step: 140700 Batch Loss: 1.270545 Tokens per Sec: 22728, Lr: 0.000300 2020-02-12 20:35:48,950 Epoch 58 Step: 140800 Batch Loss: 1.422465 Tokens per Sec: 22125, Lr: 0.000300 2020-02-12 20:35:58,861 Epoch 58 Step: 140900 Batch Loss: 1.271873 Tokens per Sec: 22397, Lr: 0.000300 2020-02-12 20:36:08,791 Epoch 58 Step: 141000 Batch Loss: 1.284646 Tokens per Sec: 22238, Lr: 0.000300 2020-02-12 20:36:27,139 Example #0 2020-02-12 20:36:27,139 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 20:36:27,139 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsan', 'gbem', 'sha', 'won', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'sha', 'er', 'dooshima', 've', 'una', 'seer', 'taver', 'yô', '.', '—', 'M@@', 'ar', '.', '10', ':', '6', '-', '9', '.'] 2020-02-12 20:36:27,139 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 20:36:27,140 Reference: 10 : ​ 6 - 9 . 2020-02-12 20:36:27,140 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsan gbem sha won yô , gba hange hange u noov man kasev vea nôngo sha er dooshima ve una seer taver yô . — Mar . 10 : 6 - 9 . 2020-02-12 20:36:27,140 Example #1 2020-02-12 20:36:27,140 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 20:36:27,140 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'ngu', 'ikyua', '!', '—', 'Rom', '.'] 2020-02-12 20:36:27,140 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 20:36:27,140 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 20:36:27,140 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne ngu ikyua ! — Rom . 2020-02-12 20:36:27,140 Example #2 2020-02-12 20:36:27,140 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 20:36:27,140 Raw hypothesis: ['Anyom', 'nga', 'kar', 'pue', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 20:36:27,140 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 20:36:27,140 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 20:36:27,140 Hypothesis: Anyom nga kar pue yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 20:36:27,140 Example #3 2020-02-12 20:36:27,141 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 20:36:27,141 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 20:36:27,141 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 20:36:27,141 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 20:36:27,141 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-12 20:36:27,141 Validation result (greedy) at epoch 58, step 141000: bleu: 28.29, loss: 41259.1445, ppl: 4.0297, duration: 18.3493s 2020-02-12 20:36:37,080 Epoch 58 Step: 141100 Batch Loss: 1.388197 Tokens per Sec: 22184, Lr: 0.000300 2020-02-12 20:36:47,109 Epoch 58 Step: 141200 Batch Loss: 1.569209 Tokens per Sec: 22124, Lr: 0.000300 2020-02-12 20:36:57,041 Epoch 58 Step: 141300 Batch Loss: 1.191875 Tokens per Sec: 22460, Lr: 0.000300 2020-02-12 20:37:06,983 Epoch 58 Step: 141400 Batch Loss: 1.572339 Tokens per Sec: 22293, Lr: 0.000300 2020-02-12 20:37:16,931 Epoch 58 Step: 141500 Batch Loss: 1.424611 Tokens per Sec: 22998, Lr: 0.000300 2020-02-12 20:37:26,821 Epoch 58 Step: 141600 Batch Loss: 1.462508 Tokens per Sec: 22273, Lr: 0.000300 2020-02-12 20:37:36,837 Epoch 58 Step: 141700 Batch Loss: 1.243656 Tokens per Sec: 22018, Lr: 0.000300 2020-02-12 20:37:46,812 Epoch 58 Step: 141800 Batch Loss: 1.328304 Tokens per Sec: 21628, Lr: 0.000300 2020-02-12 20:37:56,891 Epoch 58 Step: 141900 Batch Loss: 1.553291 Tokens per Sec: 21987, Lr: 0.000300 2020-02-12 20:38:06,989 Epoch 58 Step: 142000 Batch Loss: 1.649239 Tokens per Sec: 21882, Lr: 0.000300 2020-02-12 20:38:26,303 Example #0 2020-02-12 20:38:26,303 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 20:38:26,303 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'sha', 'er', 'dooshima', 've', 'una', 'seer', 'taver', 'yô', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 20:38:26,304 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 20:38:26,304 Reference: 10 : ​ 6 - 9 . 2020-02-12 20:38:26,304 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo sha er dooshima ve una seer taver yô . — Marku 10 : 6 - 9 . 2020-02-12 20:38:26,304 Example #1 2020-02-12 20:38:26,304 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 20:38:26,304 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'imba', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 20:38:26,304 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 20:38:26,304 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 20:38:26,304 Hypothesis: Se kpa se fatyô u ‘ nengen ’ imba shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-12 20:38:26,304 Example #2 2020-02-12 20:38:26,304 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 20:38:26,304 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 20:38:26,304 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 20:38:26,305 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 20:38:26,305 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 20:38:26,305 Example #3 2020-02-12 20:38:26,305 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 20:38:26,305 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 20:38:26,305 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 20:38:26,305 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 20:38:26,305 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-12 20:38:26,305 Validation result (greedy) at epoch 58, step 142000: bleu: 28.14, loss: 41258.6484, ppl: 4.0297, duration: 19.3153s 2020-02-12 20:38:36,396 Epoch 58 Step: 142100 Batch Loss: 1.189728 Tokens per Sec: 21759, Lr: 0.000300 2020-02-12 20:38:46,575 Epoch 58 Step: 142200 Batch Loss: 1.555159 Tokens per Sec: 21747, Lr: 0.000300 2020-02-12 20:38:56,673 Epoch 58 Step: 142300 Batch Loss: 1.462615 Tokens per Sec: 22033, Lr: 0.000300 2020-02-12 20:39:06,679 Epoch 58 Step: 142400 Batch Loss: 1.330904 Tokens per Sec: 22019, Lr: 0.000300 2020-02-12 20:39:16,673 Epoch 58 Step: 142500 Batch Loss: 1.320575 Tokens per Sec: 22309, Lr: 0.000300 2020-02-12 20:39:26,777 Epoch 58 Step: 142600 Batch Loss: 1.345322 Tokens per Sec: 22151, Lr: 0.000300 2020-02-12 20:39:28,365 Epoch 58: total training loss 3443.92 2020-02-12 20:39:28,365 EPOCH 59 2020-02-12 20:39:37,128 Epoch 59 Step: 142700 Batch Loss: 1.680768 Tokens per Sec: 21219, Lr: 0.000300 2020-02-12 20:39:47,103 Epoch 59 Step: 142800 Batch Loss: 1.409805 Tokens per Sec: 21886, Lr: 0.000300 2020-02-12 20:39:57,097 Epoch 59 Step: 142900 Batch Loss: 1.261157 Tokens per Sec: 22112, Lr: 0.000300 2020-02-12 20:40:07,101 Epoch 59 Step: 143000 Batch Loss: 1.508628 Tokens per Sec: 22201, Lr: 0.000300 2020-02-12 20:40:25,593 Hooray! New best validation result [ppl]! 2020-02-12 20:40:25,593 Saving new checkpoint. 2020-02-12 20:40:25,782 Example #0 2020-02-12 20:40:25,782 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 20:40:25,782 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsan', 'gbem', 'sha', 'won', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'mimi', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'seer', 'a', 'seer', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 20:40:25,782 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 20:40:25,782 Reference: 10 : ​ 6 - 9 . 2020-02-12 20:40:25,782 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsan gbem sha won yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u mimi shi vea za hemen u lun a dooshima u a lu seer a seer la . — Marku 10 : 6 - 9 . 2020-02-12 20:40:25,782 Example #1 2020-02-12 20:40:25,783 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 20:40:25,783 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 20:40:25,783 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 20:40:25,783 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 20:40:25,783 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-12 20:40:25,783 Example #2 2020-02-12 20:40:25,783 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 20:40:25,783 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 20:40:25,783 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 20:40:25,783 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 20:40:25,783 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 20:40:25,783 Example #3 2020-02-12 20:40:25,783 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 20:40:25,783 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 20:40:25,783 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 20:40:25,784 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 20:40:25,784 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-12 20:40:25,784 Validation result (greedy) at epoch 59, step 143000: bleu: 28.19, loss: 41192.2695, ppl: 4.0206, duration: 18.6818s 2020-02-12 20:40:35,739 Epoch 59 Step: 143100 Batch Loss: 1.655330 Tokens per Sec: 21997, Lr: 0.000300 2020-02-12 20:40:45,861 Epoch 59 Step: 143200 Batch Loss: 1.374167 Tokens per Sec: 21439, Lr: 0.000300 2020-02-12 20:40:55,964 Epoch 59 Step: 143300 Batch Loss: 1.405934 Tokens per Sec: 22054, Lr: 0.000300 2020-02-12 20:41:05,941 Epoch 59 Step: 143400 Batch Loss: 1.371737 Tokens per Sec: 22278, Lr: 0.000300 2020-02-12 20:41:15,827 Epoch 59 Step: 143500 Batch Loss: 1.304805 Tokens per Sec: 22822, Lr: 0.000300 2020-02-12 20:41:25,682 Epoch 59 Step: 143600 Batch Loss: 1.395527 Tokens per Sec: 22346, Lr: 0.000300 2020-02-12 20:41:35,595 Epoch 59 Step: 143700 Batch Loss: 1.518479 Tokens per Sec: 22494, Lr: 0.000300 2020-02-12 20:41:45,622 Epoch 59 Step: 143800 Batch Loss: 1.373104 Tokens per Sec: 21925, Lr: 0.000300 2020-02-12 20:41:55,535 Epoch 59 Step: 143900 Batch Loss: 1.451918 Tokens per Sec: 22685, Lr: 0.000300 2020-02-12 20:42:05,464 Epoch 59 Step: 144000 Batch Loss: 1.513248 Tokens per Sec: 22161, Lr: 0.000300 2020-02-12 20:42:24,346 Hooray! New best validation result [ppl]! 2020-02-12 20:42:24,346 Saving new checkpoint. 2020-02-12 20:42:24,544 Example #0 2020-02-12 20:42:24,545 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 20:42:24,545 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 've', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'seer', 'a', 'seer', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 20:42:24,545 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 20:42:24,545 Reference: 10 : ​ 6 - 9 . 2020-02-12 20:42:24,545 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima ve la , shi vea za hemen u lun a dooshima u a lu seer a seer la . — Marku 10 : 6 - 9 . 2020-02-12 20:42:24,545 Example #1 2020-02-12 20:42:24,545 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 20:42:24,545 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'imba', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 20:42:24,545 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 20:42:24,545 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 20:42:24,545 Hypothesis: Se kpa se fatyô u ‘ nengen ’ imba shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-12 20:42:24,545 Example #2 2020-02-12 20:42:24,545 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 20:42:24,546 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 20:42:24,546 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 20:42:24,546 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 20:42:24,546 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 20:42:24,546 Example #3 2020-02-12 20:42:24,546 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 20:42:24,546 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 20:42:24,546 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 20:42:24,546 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 20:42:24,546 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-12 20:42:24,546 Validation result (greedy) at epoch 59, step 144000: bleu: 28.03, loss: 41174.0195, ppl: 4.0182, duration: 19.0813s 2020-02-12 20:42:34,504 Epoch 59 Step: 144100 Batch Loss: 1.442042 Tokens per Sec: 22134, Lr: 0.000300 2020-02-12 20:42:44,452 Epoch 59 Step: 144200 Batch Loss: 1.586396 Tokens per Sec: 22378, Lr: 0.000300 2020-02-12 20:42:54,387 Epoch 59 Step: 144300 Batch Loss: 1.750405 Tokens per Sec: 21873, Lr: 0.000300 2020-02-12 20:43:04,335 Epoch 59 Step: 144400 Batch Loss: 1.335457 Tokens per Sec: 22193, Lr: 0.000300 2020-02-12 20:43:14,285 Epoch 59 Step: 144500 Batch Loss: 1.366822 Tokens per Sec: 22546, Lr: 0.000300 2020-02-12 20:43:24,223 Epoch 59 Step: 144600 Batch Loss: 1.430219 Tokens per Sec: 22720, Lr: 0.000300 2020-02-12 20:43:34,267 Epoch 59 Step: 144700 Batch Loss: 1.255848 Tokens per Sec: 22050, Lr: 0.000300 2020-02-12 20:43:44,418 Epoch 59 Step: 144800 Batch Loss: 1.433099 Tokens per Sec: 22049, Lr: 0.000300 2020-02-12 20:43:54,633 Epoch 59 Step: 144900 Batch Loss: 1.580696 Tokens per Sec: 22078, Lr: 0.000300 2020-02-12 20:44:04,776 Epoch 59 Step: 145000 Batch Loss: 1.564681 Tokens per Sec: 21270, Lr: 0.000300 2020-02-12 20:44:24,708 Hooray! New best validation result [ppl]! 2020-02-12 20:44:24,709 Saving new checkpoint. 2020-02-12 20:44:24,899 Example #0 2020-02-12 20:44:24,899 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 20:44:24,899 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'sha', 'afatyô', 've', 'cii', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'una', 'fatyô', 'u', 'vesen', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 20:44:24,899 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 20:44:24,899 Reference: 10 : ​ 6 - 9 . 2020-02-12 20:44:24,900 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo sha afatyô ve cii vea lu a dooshima u a lu a mi la , shi vea za hemen u lun a dooshima u una fatyô u vesen la . — Marku 10 : 6 - 9 . 2020-02-12 20:44:24,900 Example #1 2020-02-12 20:44:24,900 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 20:44:24,900 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'imba', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 20:44:24,900 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 20:44:24,900 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 20:44:24,900 Hypothesis: Se kpa se fatyô u ‘ nengen ’ imba shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-12 20:44:24,900 Example #2 2020-02-12 20:44:24,900 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 20:44:24,900 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 20:44:24,900 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 20:44:24,900 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 20:44:24,900 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 20:44:24,901 Example #3 2020-02-12 20:44:24,901 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 20:44:24,901 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 20:44:24,901 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 20:44:24,901 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 20:44:24,901 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga yô . 2020-02-12 20:44:24,901 Validation result (greedy) at epoch 59, step 145000: bleu: 28.48, loss: 41079.0156, ppl: 4.0053, duration: 20.1248s 2020-02-12 20:44:31,869 Epoch 59: total training loss 3429.87 2020-02-12 20:44:31,870 EPOCH 60 2020-02-12 20:44:35,280 Epoch 60 Step: 145100 Batch Loss: 1.214325 Tokens per Sec: 20652, Lr: 0.000300 2020-02-12 20:44:45,321 Epoch 60 Step: 145200 Batch Loss: 1.116316 Tokens per Sec: 21821, Lr: 0.000300 2020-02-12 20:44:55,212 Epoch 60 Step: 145300 Batch Loss: 1.525003 Tokens per Sec: 22632, Lr: 0.000300 2020-02-12 20:45:05,130 Epoch 60 Step: 145400 Batch Loss: 1.480217 Tokens per Sec: 22628, Lr: 0.000300 2020-02-12 20:45:15,176 Epoch 60 Step: 145500 Batch Loss: 1.371782 Tokens per Sec: 21804, Lr: 0.000300 2020-02-12 20:45:25,329 Epoch 60 Step: 145600 Batch Loss: 1.311836 Tokens per Sec: 21782, Lr: 0.000300 2020-02-12 20:45:35,380 Epoch 60 Step: 145700 Batch Loss: 1.487752 Tokens per Sec: 21159, Lr: 0.000300 2020-02-12 20:45:45,438 Epoch 60 Step: 145800 Batch Loss: 1.526056 Tokens per Sec: 22168, Lr: 0.000300 2020-02-12 20:45:55,487 Epoch 60 Step: 145900 Batch Loss: 1.605019 Tokens per Sec: 21551, Lr: 0.000300 2020-02-12 20:46:05,477 Epoch 60 Step: 146000 Batch Loss: 1.284405 Tokens per Sec: 21967, Lr: 0.000300 2020-02-12 20:46:24,191 Example #0 2020-02-12 20:46:24,191 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 20:46:24,191 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'doo', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'sha', 'er', 'dooshima', 've', 'una', 'seer', 'taver', 'yô', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 20:46:24,191 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 20:46:24,191 Reference: 10 : ​ 6 - 9 . 2020-02-12 20:46:24,192 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , doo u noov man kasev vea nôngo kpoghuloo sha er dooshima ve una seer taver yô . — Marku 10 : 6 - 9 . 2020-02-12 20:46:24,192 Example #1 2020-02-12 20:46:24,192 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 20:46:24,192 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'a', 'lu', 'van', 'la', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 20:46:24,192 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 20:46:24,192 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 20:46:24,192 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u doon tsung ne , man ka shighe u a lu van la je la ! — Rom . 2020-02-12 20:46:24,192 Example #2 2020-02-12 20:46:24,192 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 20:46:24,192 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'gar', 'u', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 20:46:24,192 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 20:46:24,192 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 20:46:24,192 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken gar u Masedonia man Timoteu ken Efese . 2020-02-12 20:46:24,192 Example #3 2020-02-12 20:46:24,192 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 20:46:24,192 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 20:46:24,193 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 20:46:24,193 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 20:46:24,193 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-12 20:46:24,193 Validation result (greedy) at epoch 60, step 146000: bleu: 28.29, loss: 41082.6055, ppl: 4.0058, duration: 18.7152s 2020-02-12 20:46:34,109 Epoch 60 Step: 146100 Batch Loss: 1.409818 Tokens per Sec: 22663, Lr: 0.000300 2020-02-12 20:46:43,994 Epoch 60 Step: 146200 Batch Loss: 1.582477 Tokens per Sec: 22008, Lr: 0.000300 2020-02-12 20:46:54,001 Epoch 60 Step: 146300 Batch Loss: 1.423970 Tokens per Sec: 21738, Lr: 0.000300 2020-02-12 20:47:04,026 Epoch 60 Step: 146400 Batch Loss: 1.432156 Tokens per Sec: 22273, Lr: 0.000300 2020-02-12 20:47:14,184 Epoch 60 Step: 146500 Batch Loss: 1.406879 Tokens per Sec: 21858, Lr: 0.000300 2020-02-12 20:47:24,299 Epoch 60 Step: 146600 Batch Loss: 1.477002 Tokens per Sec: 21966, Lr: 0.000300 2020-02-12 20:47:34,425 Epoch 60 Step: 146700 Batch Loss: 1.466704 Tokens per Sec: 22221, Lr: 0.000300 2020-02-12 20:47:44,529 Epoch 60 Step: 146800 Batch Loss: 1.531728 Tokens per Sec: 22174, Lr: 0.000300 2020-02-12 20:47:54,756 Epoch 60 Step: 146900 Batch Loss: 1.330328 Tokens per Sec: 21745, Lr: 0.000300 2020-02-12 20:48:04,848 Epoch 60 Step: 147000 Batch Loss: 1.371225 Tokens per Sec: 21815, Lr: 0.000300 2020-02-12 20:48:23,007 Example #0 2020-02-12 20:48:23,007 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 20:48:23,007 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'sha', 'er', 'dooshima', 've', 'una', 'seer', 'taver', 'yô', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 20:48:23,008 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 20:48:23,008 Reference: 10 : ​ 6 - 9 . 2020-02-12 20:48:23,008 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo sha er dooshima ve una seer taver yô . — Marku 10 : 6 - 9 . 2020-02-12 20:48:23,008 Example #1 2020-02-12 20:48:23,008 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 20:48:23,008 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'imba', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'a', 'mgb@@', 'ôghom', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 20:48:23,008 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 20:48:23,008 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 20:48:23,008 Hypothesis: Se kpa se fatyô u ‘ nengen ’ imba shighe u doon tsung ne , man ka shighe u a mgbôghom je la ! — Rom . 2020-02-12 20:48:23,008 Example #2 2020-02-12 20:48:23,008 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 20:48:23,008 Raw hypothesis: ['Anyom', 'nga', 'kar', 'pue', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 20:48:23,008 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 20:48:23,008 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 20:48:23,008 Hypothesis: Anyom nga kar pue yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 20:48:23,008 Example #3 2020-02-12 20:48:23,009 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 20:48:23,009 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 20:48:23,009 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 20:48:23,009 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 20:48:23,009 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-12 20:48:23,009 Validation result (greedy) at epoch 60, step 147000: bleu: 27.90, loss: 41109.3867, ppl: 4.0094, duration: 18.1600s 2020-02-12 20:48:32,849 Epoch 60 Step: 147100 Batch Loss: 1.518140 Tokens per Sec: 22258, Lr: 0.000300 2020-02-12 20:48:42,700 Epoch 60 Step: 147200 Batch Loss: 1.556091 Tokens per Sec: 22913, Lr: 0.000300 2020-02-12 20:48:52,647 Epoch 60 Step: 147300 Batch Loss: 1.265665 Tokens per Sec: 22190, Lr: 0.000300 2020-02-12 20:49:02,571 Epoch 60 Step: 147400 Batch Loss: 1.290607 Tokens per Sec: 22142, Lr: 0.000300 2020-02-12 20:49:12,409 Epoch 60 Step: 147500 Batch Loss: 1.525233 Tokens per Sec: 22600, Lr: 0.000300 2020-02-12 20:49:14,961 Epoch 60: total training loss 3426.66 2020-02-12 20:49:14,961 EPOCH 61 2020-02-12 20:49:22,504 Epoch 61 Step: 147600 Batch Loss: 1.378971 Tokens per Sec: 21721, Lr: 0.000300 2020-02-12 20:49:32,359 Epoch 61 Step: 147700 Batch Loss: 1.672227 Tokens per Sec: 22312, Lr: 0.000300 2020-02-12 20:49:42,227 Epoch 61 Step: 147800 Batch Loss: 1.321020 Tokens per Sec: 22710, Lr: 0.000300 2020-02-12 20:49:52,150 Epoch 61 Step: 147900 Batch Loss: 1.464232 Tokens per Sec: 22211, Lr: 0.000300 2020-02-12 20:50:02,302 Epoch 61 Step: 148000 Batch Loss: 1.264526 Tokens per Sec: 21572, Lr: 0.000300 2020-02-12 20:50:22,504 Example #0 2020-02-12 20:50:22,504 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 20:50:22,504 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', 'shi', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 20:50:22,505 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 20:50:22,505 Reference: 10 : ​ 6 - 9 . 2020-02-12 20:50:22,505 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu hen atô ve la shi vea lu a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-12 20:50:22,505 Example #1 2020-02-12 20:50:22,505 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 20:50:22,505 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'imba', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'a', 'lu', 'van', 'la', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 20:50:22,505 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 20:50:22,505 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 20:50:22,505 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a imba shighe u doon tsung ne , man ka shighe u a lu van la je la ! — Rom . 2020-02-12 20:50:22,505 Example #2 2020-02-12 20:50:22,505 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 20:50:22,505 Raw hypothesis: ['Anyom', 'nga', 'kar', 'pue', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 20:50:22,505 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 20:50:22,505 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 20:50:22,506 Hypothesis: Anyom nga kar pue yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 20:50:22,506 Example #3 2020-02-12 20:50:22,506 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 20:50:22,506 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 20:50:22,506 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 20:50:22,506 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 20:50:22,506 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 20:50:22,506 Validation result (greedy) at epoch 61, step 148000: bleu: 27.85, loss: 41156.0664, ppl: 4.0157, duration: 20.2031s 2020-02-12 20:50:32,685 Epoch 61 Step: 148100 Batch Loss: 1.448269 Tokens per Sec: 21696, Lr: 0.000300 2020-02-12 20:50:42,906 Epoch 61 Step: 148200 Batch Loss: 1.584460 Tokens per Sec: 22074, Lr: 0.000300 2020-02-12 20:50:53,074 Epoch 61 Step: 148300 Batch Loss: 1.728064 Tokens per Sec: 22181, Lr: 0.000300 2020-02-12 20:51:03,161 Epoch 61 Step: 148400 Batch Loss: 1.250297 Tokens per Sec: 21566, Lr: 0.000300 2020-02-12 20:51:13,267 Epoch 61 Step: 148500 Batch Loss: 1.240981 Tokens per Sec: 21921, Lr: 0.000300 2020-02-12 20:51:23,416 Epoch 61 Step: 148600 Batch Loss: 1.278483 Tokens per Sec: 21912, Lr: 0.000300 2020-02-12 20:51:33,326 Epoch 61 Step: 148700 Batch Loss: 1.544158 Tokens per Sec: 22556, Lr: 0.000300 2020-02-12 20:51:43,220 Epoch 61 Step: 148800 Batch Loss: 1.419829 Tokens per Sec: 22130, Lr: 0.000300 2020-02-12 20:51:53,168 Epoch 61 Step: 148900 Batch Loss: 1.257829 Tokens per Sec: 22179, Lr: 0.000300 2020-02-12 20:52:03,094 Epoch 61 Step: 149000 Batch Loss: 1.153634 Tokens per Sec: 21443, Lr: 0.000300 2020-02-12 20:52:21,575 Hooray! New best validation result [ppl]! 2020-02-12 20:52:21,576 Saving new checkpoint. 2020-02-12 20:52:21,773 Example #0 2020-02-12 20:52:21,773 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 20:52:21,773 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', 'shi', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 20:52:21,773 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 20:52:21,773 Reference: 10 : ​ 6 - 9 . 2020-02-12 20:52:21,773 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu hen atô ve la shi vea lu a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-12 20:52:21,774 Example #1 2020-02-12 20:52:21,774 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 20:52:21,774 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'imba', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'a', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 20:52:21,774 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 20:52:21,774 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 20:52:21,774 Hypothesis: Se kpa se fatyô u ‘ nengen ’ imba shighe u doon tsung ne , man a mgbôghom ! — Rom . 2020-02-12 20:52:21,774 Example #2 2020-02-12 20:52:21,774 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 20:52:21,774 Raw hypothesis: ['Anyom', 'nga', 'kar', 'pue', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 20:52:21,774 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 20:52:21,774 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 20:52:21,774 Hypothesis: Anyom nga kar pue yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 20:52:21,774 Example #3 2020-02-12 20:52:21,774 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 20:52:21,774 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 20:52:21,774 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 20:52:21,775 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 20:52:21,775 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-12 20:52:21,775 Validation result (greedy) at epoch 61, step 149000: bleu: 28.14, loss: 40998.1211, ppl: 3.9944, duration: 18.6799s 2020-02-12 20:52:31,621 Epoch 61 Step: 149100 Batch Loss: 1.441156 Tokens per Sec: 22866, Lr: 0.000300 2020-02-12 20:52:41,491 Epoch 61 Step: 149200 Batch Loss: 1.400879 Tokens per Sec: 22117, Lr: 0.000300 2020-02-12 20:52:51,454 Epoch 61 Step: 149300 Batch Loss: 1.300657 Tokens per Sec: 22400, Lr: 0.000300 2020-02-12 20:53:01,391 Epoch 61 Step: 149400 Batch Loss: 1.552772 Tokens per Sec: 21856, Lr: 0.000300 2020-02-12 20:53:11,395 Epoch 61 Step: 149500 Batch Loss: 1.522980 Tokens per Sec: 21900, Lr: 0.000300 2020-02-12 20:53:21,480 Epoch 61 Step: 149600 Batch Loss: 1.515286 Tokens per Sec: 21542, Lr: 0.000300 2020-02-12 20:53:31,543 Epoch 61 Step: 149700 Batch Loss: 1.347546 Tokens per Sec: 22254, Lr: 0.000300 2020-02-12 20:53:41,618 Epoch 61 Step: 149800 Batch Loss: 1.403254 Tokens per Sec: 22236, Lr: 0.000300 2020-02-12 20:53:51,674 Epoch 61 Step: 149900 Batch Loss: 1.528272 Tokens per Sec: 21792, Lr: 0.000300 2020-02-12 20:54:00,293 Epoch 61: total training loss 3427.88 2020-02-12 20:54:00,294 EPOCH 62 2020-02-12 20:54:01,994 Epoch 62 Step: 150000 Batch Loss: 1.459719 Tokens per Sec: 18242, Lr: 0.000300 2020-02-12 20:54:20,810 Hooray! New best validation result [ppl]! 2020-02-12 20:54:20,811 Saving new checkpoint. 2020-02-12 20:54:20,997 Example #0 2020-02-12 20:54:20,997 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 20:54:20,997 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'vesen', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 20:54:20,997 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 20:54:20,997 Reference: 10 : ​ 6 - 9 . 2020-02-12 20:54:20,998 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u vesen yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la , shi vea za hemen u lun a dooshima u a lu a mi la . — Marku 10 : 6 - 9 . 2020-02-12 20:54:20,998 Example #1 2020-02-12 20:54:20,998 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 20:54:20,998 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 20:54:20,998 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 20:54:20,998 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 20:54:20,998 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-12 20:54:20,998 Example #2 2020-02-12 20:54:20,998 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 20:54:20,998 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 20:54:20,998 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 20:54:20,998 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 20:54:20,998 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 20:54:20,998 Example #3 2020-02-12 20:54:20,998 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 20:54:20,998 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'u', 'vough', 'ga', '.'] 2020-02-12 20:54:20,998 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 20:54:20,999 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 20:54:20,999 Hypothesis: Alaghga or nana lu eren kwagh u vough ga . 2020-02-12 20:54:20,999 Validation result (greedy) at epoch 62, step 150000: bleu: 27.91, loss: 40995.7305, ppl: 3.9940, duration: 19.0037s 2020-02-12 20:54:30,856 Epoch 62 Step: 150100 Batch Loss: 1.141374 Tokens per Sec: 22198, Lr: 0.000300 2020-02-12 20:54:40,720 Epoch 62 Step: 150200 Batch Loss: 1.360491 Tokens per Sec: 22391, Lr: 0.000300 2020-02-12 20:54:50,792 Epoch 62 Step: 150300 Batch Loss: 1.500698 Tokens per Sec: 21524, Lr: 0.000300 2020-02-12 20:55:00,955 Epoch 62 Step: 150400 Batch Loss: 1.158732 Tokens per Sec: 22040, Lr: 0.000300 2020-02-12 20:55:11,097 Epoch 62 Step: 150500 Batch Loss: 1.405347 Tokens per Sec: 21578, Lr: 0.000300 2020-02-12 20:55:21,243 Epoch 62 Step: 150600 Batch Loss: 1.268173 Tokens per Sec: 21782, Lr: 0.000300 2020-02-12 20:55:31,396 Epoch 62 Step: 150700 Batch Loss: 1.367640 Tokens per Sec: 21504, Lr: 0.000300 2020-02-12 20:55:41,577 Epoch 62 Step: 150800 Batch Loss: 1.221848 Tokens per Sec: 21900, Lr: 0.000300 2020-02-12 20:55:51,705 Epoch 62 Step: 150900 Batch Loss: 1.442880 Tokens per Sec: 22148, Lr: 0.000300 2020-02-12 20:56:01,678 Epoch 62 Step: 151000 Batch Loss: 1.450268 Tokens per Sec: 21682, Lr: 0.000300 2020-02-12 20:56:20,320 Example #0 2020-02-12 20:56:20,320 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 20:56:20,320 Raw hypothesis: ['Er', 'Yehova', 'a', 'ver', 'ivese', 'i', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 've', 'la', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 20:56:20,320 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 20:56:20,320 Reference: 10 : ​ 6 - 9 . 2020-02-12 20:56:20,320 Hypothesis: Er Yehova a ver ivese i tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima ve la shi vea za hemen u lun a dooshima u a lu a mi la . — Marku 10 : 6 - 9 . 2020-02-12 20:56:20,320 Example #1 2020-02-12 20:56:20,320 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 20:56:20,320 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'imba', 'shighe', 'u', 'kpilighyol', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 20:56:20,320 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 20:56:20,320 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 20:56:20,320 Hypothesis: Se kpa se fatyô u ‘ nengen ’ imba shighe u kpilighyol ne , man kwagh ne mgbôghom ! — Rom . 2020-02-12 20:56:20,320 Example #2 2020-02-12 20:56:20,321 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 20:56:20,321 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 20:56:20,321 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 20:56:20,321 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 20:56:20,321 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 20:56:20,321 Example #3 2020-02-12 20:56:20,321 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 20:56:20,321 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 20:56:20,321 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 20:56:20,321 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 20:56:20,321 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-12 20:56:20,321 Validation result (greedy) at epoch 62, step 151000: bleu: 28.08, loss: 41003.5430, ppl: 3.9951, duration: 18.6427s 2020-02-12 20:56:30,227 Epoch 62 Step: 151100 Batch Loss: 1.490563 Tokens per Sec: 22839, Lr: 0.000300 2020-02-12 20:56:40,100 Epoch 62 Step: 151200 Batch Loss: 1.310824 Tokens per Sec: 22447, Lr: 0.000300 2020-02-12 20:56:50,056 Epoch 62 Step: 151300 Batch Loss: 1.531437 Tokens per Sec: 22189, Lr: 0.000300 2020-02-12 20:56:59,952 Epoch 62 Step: 151400 Batch Loss: 1.529835 Tokens per Sec: 22204, Lr: 0.000300 2020-02-12 20:57:09,894 Epoch 62 Step: 151500 Batch Loss: 1.161585 Tokens per Sec: 22171, Lr: 0.000300 2020-02-12 20:57:19,922 Epoch 62 Step: 151600 Batch Loss: 1.279486 Tokens per Sec: 22087, Lr: 0.000300 2020-02-12 20:57:29,814 Epoch 62 Step: 151700 Batch Loss: 1.544322 Tokens per Sec: 22731, Lr: 0.000300 2020-02-12 20:57:39,724 Epoch 62 Step: 151800 Batch Loss: 1.487324 Tokens per Sec: 22343, Lr: 0.000300 2020-02-12 20:57:49,674 Epoch 62 Step: 151900 Batch Loss: 1.487652 Tokens per Sec: 22125, Lr: 0.000300 2020-02-12 20:57:59,549 Epoch 62 Step: 152000 Batch Loss: 1.435196 Tokens per Sec: 22413, Lr: 0.000300 2020-02-12 20:58:18,101 Example #0 2020-02-12 20:58:18,101 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 20:58:18,101 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsan', 'gbem', 'sha', 'won', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'sha', 'afatyô', 've', 'cii', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'vesen', 'la', 'kpaa', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 20:58:18,101 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 20:58:18,101 Reference: 10 : ​ 6 - 9 . 2020-02-12 20:58:18,101 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsan gbem sha won yô , gba hange hange u noov man kasev vea nôngo sha afatyô ve cii vea lu a dooshima u a lu a mi la , shi vea lu a dooshima u a lu vesen la kpaa . — Marku 10 : 6 - 9 . 2020-02-12 20:58:18,101 Example #1 2020-02-12 20:58:18,101 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 20:58:18,101 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'imba', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 20:58:18,101 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 20:58:18,102 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 20:58:18,102 Hypothesis: Se kpa se fatyô u ‘ nengen ’ imba shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-12 20:58:18,102 Example #2 2020-02-12 20:58:18,102 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 20:58:18,102 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'gar', 'u', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 20:58:18,102 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 20:58:18,102 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 20:58:18,102 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken gar u Masedonia man Timoteu ken Efese . 2020-02-12 20:58:18,102 Example #3 2020-02-12 20:58:18,102 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 20:58:18,102 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'u', 'vough', 'ga', '.'] 2020-02-12 20:58:18,102 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 20:58:18,102 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 20:58:18,102 Hypothesis: Alaghga or nana lu eren kwagh u vough ga . 2020-02-12 20:58:18,102 Validation result (greedy) at epoch 62, step 152000: bleu: 27.93, loss: 40997.4297, ppl: 3.9943, duration: 18.5529s 2020-02-12 20:58:28,091 Epoch 62 Step: 152100 Batch Loss: 1.605337 Tokens per Sec: 22337, Lr: 0.000300 2020-02-12 20:58:38,061 Epoch 62 Step: 152200 Batch Loss: 1.457781 Tokens per Sec: 22304, Lr: 0.000300 2020-02-12 20:58:48,192 Epoch 62 Step: 152300 Batch Loss: 1.252030 Tokens per Sec: 21782, Lr: 0.000300 2020-02-12 20:58:58,216 Epoch 62 Step: 152400 Batch Loss: 1.487466 Tokens per Sec: 22369, Lr: 0.000300 2020-02-12 20:59:02,297 Epoch 62: total training loss 3407.62 2020-02-12 20:59:02,298 EPOCH 63 2020-02-12 20:59:08,413 Epoch 63 Step: 152500 Batch Loss: 0.917715 Tokens per Sec: 20793, Lr: 0.000300 2020-02-12 20:59:18,263 Epoch 63 Step: 152600 Batch Loss: 1.154300 Tokens per Sec: 22631, Lr: 0.000300 2020-02-12 20:59:28,117 Epoch 63 Step: 152700 Batch Loss: 0.896696 Tokens per Sec: 21794, Lr: 0.000300 2020-02-12 20:59:37,994 Epoch 63 Step: 152800 Batch Loss: 1.533581 Tokens per Sec: 22516, Lr: 0.000300 2020-02-12 20:59:47,914 Epoch 63 Step: 152900 Batch Loss: 1.351405 Tokens per Sec: 22496, Lr: 0.000300 2020-02-12 20:59:57,949 Epoch 63 Step: 153000 Batch Loss: 1.559299 Tokens per Sec: 21684, Lr: 0.000300 2020-02-12 21:00:16,846 Hooray! New best validation result [ppl]! 2020-02-12 21:00:16,847 Saving new checkpoint. 2020-02-12 21:00:17,047 Example #0 2020-02-12 21:00:17,048 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 21:00:17,048 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 21:00:17,048 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 21:00:17,048 Reference: 10 : ​ 6 - 9 . 2020-02-12 21:00:17,048 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la , shi vea lu a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-12 21:00:17,048 Example #1 2020-02-12 21:00:17,048 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 21:00:17,048 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'imba', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 21:00:17,048 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 21:00:17,048 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 21:00:17,048 Hypothesis: Se kpa se fatyô u ‘ nengen ’ imba shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-12 21:00:17,048 Example #2 2020-02-12 21:00:17,049 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 21:00:17,049 Raw hypothesis: ['Anyom', 'nga', 'kar', 'pue', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 21:00:17,049 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 21:00:17,049 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 21:00:17,049 Hypothesis: Anyom nga kar pue yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 21:00:17,049 Example #3 2020-02-12 21:00:17,049 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 21:00:17,049 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 21:00:17,049 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 21:00:17,049 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 21:00:17,049 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 21:00:17,049 Validation result (greedy) at epoch 63, step 153000: bleu: 28.02, loss: 40971.5273, ppl: 3.9908, duration: 19.1001s 2020-02-12 21:00:27,332 Epoch 63 Step: 153100 Batch Loss: 1.392670 Tokens per Sec: 21835, Lr: 0.000300 2020-02-12 21:00:37,412 Epoch 63 Step: 153200 Batch Loss: 1.463651 Tokens per Sec: 22296, Lr: 0.000300 2020-02-12 21:00:47,501 Epoch 63 Step: 153300 Batch Loss: 1.382484 Tokens per Sec: 22122, Lr: 0.000300 2020-02-12 21:00:57,605 Epoch 63 Step: 153400 Batch Loss: 1.327636 Tokens per Sec: 21560, Lr: 0.000300 2020-02-12 21:01:07,735 Epoch 63 Step: 153500 Batch Loss: 1.469077 Tokens per Sec: 22450, Lr: 0.000300 2020-02-12 21:01:17,799 Epoch 63 Step: 153600 Batch Loss: 1.399526 Tokens per Sec: 21692, Lr: 0.000300 2020-02-12 21:01:27,812 Epoch 63 Step: 153700 Batch Loss: 1.211877 Tokens per Sec: 22177, Lr: 0.000300 2020-02-12 21:01:37,692 Epoch 63 Step: 153800 Batch Loss: 1.342598 Tokens per Sec: 22431, Lr: 0.000300 2020-02-12 21:01:47,640 Epoch 63 Step: 153900 Batch Loss: 1.259464 Tokens per Sec: 22478, Lr: 0.000300 2020-02-12 21:01:57,534 Epoch 63 Step: 154000 Batch Loss: 1.611214 Tokens per Sec: 22478, Lr: 0.000300 2020-02-12 21:02:16,004 Hooray! New best validation result [ppl]! 2020-02-12 21:02:16,004 Saving new checkpoint. 2020-02-12 21:02:16,196 Example #0 2020-02-12 21:02:16,196 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 21:02:16,196 Raw hypothesis: ['Er', 'm@@', 'ser@@', 'akaa', 'u', 'Yehova', 'a', 'ver', 'la', 'a', 'lu', 'kwagh', 'u', 'tsan', 'gbem', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'tsung', 'vea', 'lu', 'a', 'dooshima', 've', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 21:02:16,196 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 21:02:16,196 Reference: 10 : ​ 6 - 9 . 2020-02-12 21:02:16,196 Hypothesis: Er mserakaa u Yehova a ver la a lu kwagh u tsan gbem yô , gba hange hange u noov man kasev vea nôngo tsung vea lu a dooshima ve la , shi vea za hemen u lun a dooshima u a lu a mi la . — Marku 10 : 6 - 9 . 2020-02-12 21:02:16,197 Example #1 2020-02-12 21:02:16,197 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 21:02:16,197 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'imba', 'shighe', 'u', 'kpilighyol', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 21:02:16,197 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 21:02:16,197 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 21:02:16,197 Hypothesis: Se kpa se fatyô u ‘ nengen ’ imba shighe u kpilighyol ne , man kwagh ne mgbôghom ! — Rom . 2020-02-12 21:02:16,197 Example #2 2020-02-12 21:02:16,197 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 21:02:16,197 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 21:02:16,197 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 21:02:16,197 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 21:02:16,197 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 21:02:16,197 Example #3 2020-02-12 21:02:16,197 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 21:02:16,197 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'u', 'vough', 'ga', '.'] 2020-02-12 21:02:16,197 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 21:02:16,198 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 21:02:16,198 Hypothesis: Alaghga or nana lu eren kwagh u vough ga . 2020-02-12 21:02:16,198 Validation result (greedy) at epoch 63, step 154000: bleu: 28.04, loss: 40796.3867, ppl: 3.9672, duration: 18.6636s 2020-02-12 21:02:26,105 Epoch 63 Step: 154100 Batch Loss: 1.318587 Tokens per Sec: 22005, Lr: 0.000300 2020-02-12 21:02:36,261 Epoch 63 Step: 154200 Batch Loss: 1.436596 Tokens per Sec: 21237, Lr: 0.000300 2020-02-12 21:02:46,541 Epoch 63 Step: 154300 Batch Loss: 1.437757 Tokens per Sec: 21601, Lr: 0.000300 2020-02-12 21:02:56,775 Epoch 63 Step: 154400 Batch Loss: 1.295896 Tokens per Sec: 21555, Lr: 0.000300 2020-02-12 21:03:06,958 Epoch 63 Step: 154500 Batch Loss: 1.450823 Tokens per Sec: 21843, Lr: 0.000300 2020-02-12 21:03:16,960 Epoch 63 Step: 154600 Batch Loss: 1.444382 Tokens per Sec: 21928, Lr: 0.000300 2020-02-12 21:03:27,276 Epoch 63 Step: 154700 Batch Loss: 1.487446 Tokens per Sec: 21794, Lr: 0.000300 2020-02-12 21:03:37,425 Epoch 63 Step: 154800 Batch Loss: 1.332296 Tokens per Sec: 21668, Lr: 0.000300 2020-02-12 21:03:47,476 Epoch 63: total training loss 3407.00 2020-02-12 21:03:47,476 EPOCH 64 2020-02-12 21:03:47,971 Epoch 64 Step: 154900 Batch Loss: 1.261513 Tokens per Sec: 8422, Lr: 0.000300 2020-02-12 21:03:58,058 Epoch 64 Step: 155000 Batch Loss: 1.408279 Tokens per Sec: 22280, Lr: 0.000300 2020-02-12 21:04:17,159 Example #0 2020-02-12 21:04:17,159 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 21:04:17,159 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 21:04:17,159 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 21:04:17,159 Reference: 10 : ​ 6 - 9 . 2020-02-12 21:04:17,159 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la , shi vea lu a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-12 21:04:17,159 Example #1 2020-02-12 21:04:17,159 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 21:04:17,159 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'imba', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 21:04:17,159 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 21:04:17,159 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 21:04:17,159 Hypothesis: Se kpa se fatyô u ‘ nengen ’ imba shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-12 21:04:17,160 Example #2 2020-02-12 21:04:17,160 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 21:04:17,160 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 21:04:17,160 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 21:04:17,160 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 21:04:17,160 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 21:04:17,160 Example #3 2020-02-12 21:04:17,160 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 21:04:17,160 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 21:04:17,160 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 21:04:17,160 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 21:04:17,160 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 21:04:17,160 Validation result (greedy) at epoch 64, step 155000: bleu: 27.87, loss: 41038.8828, ppl: 3.9999, duration: 19.1018s 2020-02-12 21:04:27,225 Epoch 64 Step: 155100 Batch Loss: 1.198730 Tokens per Sec: 21476, Lr: 0.000300 2020-02-12 21:04:37,239 Epoch 64 Step: 155200 Batch Loss: 1.229787 Tokens per Sec: 22335, Lr: 0.000300 2020-02-12 21:04:47,198 Epoch 64 Step: 155300 Batch Loss: 1.316694 Tokens per Sec: 21947, Lr: 0.000300 2020-02-12 21:04:57,130 Epoch 64 Step: 155400 Batch Loss: 1.465723 Tokens per Sec: 22158, Lr: 0.000300 2020-02-12 21:05:07,238 Epoch 64 Step: 155500 Batch Loss: 1.254294 Tokens per Sec: 21631, Lr: 0.000300 2020-02-12 21:05:17,387 Epoch 64 Step: 155600 Batch Loss: 1.200530 Tokens per Sec: 21566, Lr: 0.000300 2020-02-12 21:05:27,401 Epoch 64 Step: 155700 Batch Loss: 1.324548 Tokens per Sec: 21785, Lr: 0.000300 2020-02-12 21:05:37,339 Epoch 64 Step: 155800 Batch Loss: 1.348824 Tokens per Sec: 22419, Lr: 0.000300 2020-02-12 21:05:47,241 Epoch 64 Step: 155900 Batch Loss: 1.429127 Tokens per Sec: 22846, Lr: 0.000300 2020-02-12 21:05:57,108 Epoch 64 Step: 156000 Batch Loss: 1.327122 Tokens per Sec: 22629, Lr: 0.000300 2020-02-12 21:06:16,339 Example #0 2020-02-12 21:06:16,339 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 21:06:16,339 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'sha', 'afatyô', 've', 'cii', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 21:06:16,339 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 21:06:16,339 Reference: 10 : ​ 6 - 9 . 2020-02-12 21:06:16,339 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo sha afatyô ve cii vea lu a dooshima u a lu a mi la , shi vea za hemen u lun a dooshima u a lu a mi la . — Marku 10 : 6 - 9 . 2020-02-12 21:06:16,339 Example #1 2020-02-12 21:06:16,339 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 21:06:16,339 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'sha', 'kpôô', 'yô', ',', 'ngu', 'ikyua', '!', '—', 'Rom', '.'] 2020-02-12 21:06:16,339 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 21:06:16,339 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 21:06:16,339 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man sha kpôô yô , ngu ikyua ! — Rom . 2020-02-12 21:06:16,339 Example #2 2020-02-12 21:06:16,340 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 21:06:16,340 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 21:06:16,340 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 21:06:16,340 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 21:06:16,340 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 21:06:16,340 Example #3 2020-02-12 21:06:16,340 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 21:06:16,340 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 21:06:16,340 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 21:06:16,340 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 21:06:16,340 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 21:06:16,340 Validation result (greedy) at epoch 64, step 156000: bleu: 28.26, loss: 40912.4258, ppl: 3.9828, duration: 19.2313s 2020-02-12 21:06:26,434 Epoch 64 Step: 156100 Batch Loss: 1.532151 Tokens per Sec: 22016, Lr: 0.000300 2020-02-12 21:06:36,523 Epoch 64 Step: 156200 Batch Loss: 1.332851 Tokens per Sec: 22256, Lr: 0.000300 2020-02-12 21:06:46,697 Epoch 64 Step: 156300 Batch Loss: 1.391154 Tokens per Sec: 21155, Lr: 0.000300 2020-02-12 21:06:56,802 Epoch 64 Step: 156400 Batch Loss: 1.274338 Tokens per Sec: 22371, Lr: 0.000300 2020-02-12 21:07:06,936 Epoch 64 Step: 156500 Batch Loss: 1.368083 Tokens per Sec: 21824, Lr: 0.000300 2020-02-12 21:07:17,012 Epoch 64 Step: 156600 Batch Loss: 1.492815 Tokens per Sec: 21529, Lr: 0.000300 2020-02-12 21:07:27,010 Epoch 64 Step: 156700 Batch Loss: 1.218047 Tokens per Sec: 21941, Lr: 0.000300 2020-02-12 21:07:36,953 Epoch 64 Step: 156800 Batch Loss: 1.309190 Tokens per Sec: 21922, Lr: 0.000300 2020-02-12 21:07:46,903 Epoch 64 Step: 156900 Batch Loss: 1.275940 Tokens per Sec: 21968, Lr: 0.000300 2020-02-12 21:07:57,071 Epoch 64 Step: 157000 Batch Loss: 1.631502 Tokens per Sec: 21923, Lr: 0.000300 2020-02-12 21:08:16,694 Example #0 2020-02-12 21:08:16,694 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 21:08:16,695 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsan', 'gbem', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 21:08:16,695 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 21:08:16,695 Reference: 10 : ​ 6 - 9 . 2020-02-12 21:08:16,695 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsan gbem yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la , shi vea lu a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-12 21:08:16,695 Example #1 2020-02-12 21:08:16,695 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 21:08:16,695 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'imba', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 21:08:16,695 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 21:08:16,695 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 21:08:16,695 Hypothesis: Se kpa se fatyô u ‘ nengen ’ imba shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-12 21:08:16,695 Example #2 2020-02-12 21:08:16,695 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 21:08:16,695 Raw hypothesis: ['Anyom', 'nga', 'kar', 'pue', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 21:08:16,695 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 21:08:16,696 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 21:08:16,696 Hypothesis: Anyom nga kar pue yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 21:08:16,696 Example #3 2020-02-12 21:08:16,696 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 21:08:16,696 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 21:08:16,696 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 21:08:16,696 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 21:08:16,696 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-12 21:08:16,696 Validation result (greedy) at epoch 64, step 157000: bleu: 28.19, loss: 40818.1602, ppl: 3.9702, duration: 19.6246s 2020-02-12 21:08:26,755 Epoch 64 Step: 157100 Batch Loss: 1.587333 Tokens per Sec: 22398, Lr: 0.000300 2020-02-12 21:08:36,816 Epoch 64 Step: 157200 Batch Loss: 1.306947 Tokens per Sec: 22021, Lr: 0.000300 2020-02-12 21:08:46,998 Epoch 64 Step: 157300 Batch Loss: 1.558973 Tokens per Sec: 21941, Lr: 0.000300 2020-02-12 21:08:52,508 Epoch 64: total training loss 3400.82 2020-02-12 21:08:52,509 EPOCH 65 2020-02-12 21:08:57,252 Epoch 65 Step: 157400 Batch Loss: 1.531459 Tokens per Sec: 20856, Lr: 0.000300 2020-02-12 21:09:07,177 Epoch 65 Step: 157500 Batch Loss: 1.326440 Tokens per Sec: 22359, Lr: 0.000300 2020-02-12 21:09:17,110 Epoch 65 Step: 157600 Batch Loss: 1.187809 Tokens per Sec: 22168, Lr: 0.000300 2020-02-12 21:09:27,104 Epoch 65 Step: 157700 Batch Loss: 1.356242 Tokens per Sec: 21862, Lr: 0.000300 2020-02-12 21:09:37,038 Epoch 65 Step: 157800 Batch Loss: 1.101056 Tokens per Sec: 22262, Lr: 0.000300 2020-02-12 21:09:47,041 Epoch 65 Step: 157900 Batch Loss: 1.418730 Tokens per Sec: 22052, Lr: 0.000300 2020-02-12 21:09:57,061 Epoch 65 Step: 158000 Batch Loss: 1.318812 Tokens per Sec: 21784, Lr: 0.000300 2020-02-12 21:10:15,923 Example #0 2020-02-12 21:10:15,923 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 21:10:15,923 Raw hypothesis: ['Er', 'Yehova', 'a', 'ver', 'ivese', 'i', 'lu', 'kwagh', 'u', 'tsan', 'gbem', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'vesen', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 21:10:15,923 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 21:10:15,924 Reference: 10 : ​ 6 - 9 . 2020-02-12 21:10:15,924 Hypothesis: Er Yehova a ver ivese i lu kwagh u tsan gbem yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u ve lu a mi la , shi vea za hemen u lun a dooshima u a lu vesen la . — Marku 10 : 6 - 9 . 2020-02-12 21:10:15,924 Example #1 2020-02-12 21:10:15,924 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 21:10:15,924 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 21:10:15,924 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 21:10:15,924 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 21:10:15,924 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-12 21:10:15,924 Example #2 2020-02-12 21:10:15,924 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 21:10:15,924 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 21:10:15,924 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 21:10:15,924 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 21:10:15,924 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 21:10:15,924 Example #3 2020-02-12 21:10:15,925 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 21:10:15,925 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 21:10:15,925 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 21:10:15,925 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 21:10:15,925 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-12 21:10:15,925 Validation result (greedy) at epoch 65, step 158000: bleu: 28.04, loss: 40989.2656, ppl: 3.9932, duration: 18.8636s 2020-02-12 21:10:25,797 Epoch 65 Step: 158100 Batch Loss: 1.485911 Tokens per Sec: 23178, Lr: 0.000300 2020-02-12 21:10:35,757 Epoch 65 Step: 158200 Batch Loss: 1.432350 Tokens per Sec: 22102, Lr: 0.000300 2020-02-12 21:10:45,728 Epoch 65 Step: 158300 Batch Loss: 1.526295 Tokens per Sec: 22660, Lr: 0.000300 2020-02-12 21:10:55,886 Epoch 65 Step: 158400 Batch Loss: 1.449861 Tokens per Sec: 21815, Lr: 0.000300 2020-02-12 21:11:06,038 Epoch 65 Step: 158500 Batch Loss: 1.459987 Tokens per Sec: 21674, Lr: 0.000300 2020-02-12 21:11:15,960 Epoch 65 Step: 158600 Batch Loss: 1.538805 Tokens per Sec: 22077, Lr: 0.000300 2020-02-12 21:11:25,910 Epoch 65 Step: 158700 Batch Loss: 1.522396 Tokens per Sec: 22325, Lr: 0.000300 2020-02-12 21:11:35,885 Epoch 65 Step: 158800 Batch Loss: 1.183915 Tokens per Sec: 22091, Lr: 0.000300 2020-02-12 21:11:45,882 Epoch 65 Step: 158900 Batch Loss: 1.379419 Tokens per Sec: 21577, Lr: 0.000300 2020-02-12 21:11:55,829 Epoch 65 Step: 159000 Batch Loss: 1.420055 Tokens per Sec: 21829, Lr: 0.000300 2020-02-12 21:12:14,515 Hooray! New best validation result [ppl]! 2020-02-12 21:12:14,515 Saving new checkpoint. 2020-02-12 21:12:14,702 Example #0 2020-02-12 21:12:14,703 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 21:12:14,703 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'sha', 'dooshima', 'la', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'sha', 'dooshima', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 21:12:14,703 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 21:12:14,703 Reference: 10 : ​ 6 - 9 . 2020-02-12 21:12:14,703 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu sha dooshima la shi vea za hemen u lun a dooshima sha dooshima la . — Marku 10 : 6 - 9 . 2020-02-12 21:12:14,703 Example #1 2020-02-12 21:12:14,703 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 21:12:14,703 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kape', 'i', 'lu', 'mgb@@', 'ôghom', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 21:12:14,703 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 21:12:14,703 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 21:12:14,703 Hypothesis: Se kpa se fatyô u ‘ nengen ’ shighe u doon tsung ne , man kape i lu mgbôghom je la ! — Rom . 2020-02-12 21:12:14,703 Example #2 2020-02-12 21:12:14,704 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 21:12:14,704 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 21:12:14,704 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 21:12:14,704 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 21:12:14,704 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 21:12:14,704 Example #3 2020-02-12 21:12:14,704 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 21:12:14,704 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 21:12:14,704 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 21:12:14,704 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 21:12:14,704 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga yô . 2020-02-12 21:12:14,704 Validation result (greedy) at epoch 65, step 159000: bleu: 28.25, loss: 40661.4102, ppl: 3.9492, duration: 18.8745s 2020-02-12 21:12:24,664 Epoch 65 Step: 159100 Batch Loss: 1.310821 Tokens per Sec: 21999, Lr: 0.000300 2020-02-12 21:12:34,568 Epoch 65 Step: 159200 Batch Loss: 1.425569 Tokens per Sec: 22115, Lr: 0.000300 2020-02-12 21:12:44,547 Epoch 65 Step: 159300 Batch Loss: 1.488229 Tokens per Sec: 22357, Lr: 0.000300 2020-02-12 21:12:54,600 Epoch 65 Step: 159400 Batch Loss: 1.180263 Tokens per Sec: 21914, Lr: 0.000300 2020-02-12 21:13:04,479 Epoch 65 Step: 159500 Batch Loss: 1.516739 Tokens per Sec: 22250, Lr: 0.000300 2020-02-12 21:13:14,404 Epoch 65 Step: 159600 Batch Loss: 1.351622 Tokens per Sec: 22450, Lr: 0.000300 2020-02-12 21:13:24,322 Epoch 65 Step: 159700 Batch Loss: 1.363642 Tokens per Sec: 22469, Lr: 0.000300 2020-02-12 21:13:34,218 Epoch 65 Step: 159800 Batch Loss: 1.448468 Tokens per Sec: 22385, Lr: 0.000300 2020-02-12 21:13:35,807 Epoch 65: total training loss 3397.49 2020-02-12 21:13:35,808 EPOCH 66 2020-02-12 21:13:44,426 Epoch 66 Step: 159900 Batch Loss: 1.479743 Tokens per Sec: 21724, Lr: 0.000300 2020-02-12 21:13:54,522 Epoch 66 Step: 160000 Batch Loss: 1.443213 Tokens per Sec: 22317, Lr: 0.000300 2020-02-12 21:14:13,762 Example #0 2020-02-12 21:14:13,762 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 21:14:13,762 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'sha', 'afatyô', 've', 'cii', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 21:14:13,762 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 21:14:13,762 Reference: 10 : ​ 6 - 9 . 2020-02-12 21:14:13,762 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo sha afatyô ve cii vea lu a dooshima u a lu a mi la , shi vea za hemen u lun a dooshima u a lu a mi la . — Marku 10 : 6 - 9 . 2020-02-12 21:14:13,762 Example #1 2020-02-12 21:14:13,762 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 21:14:13,763 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 21:14:13,763 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 21:14:13,763 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 21:14:13,763 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-12 21:14:13,763 Example #2 2020-02-12 21:14:13,763 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 21:14:13,763 Raw hypothesis: ['Anyom', 'nga', 'kar', 'pue', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 21:14:13,763 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 21:14:13,763 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 21:14:13,763 Hypothesis: Anyom nga kar pue yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 21:14:13,763 Example #3 2020-02-12 21:14:13,763 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 21:14:13,763 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 21:14:13,763 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 21:14:13,763 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 21:14:13,764 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 21:14:13,764 Validation result (greedy) at epoch 66, step 160000: bleu: 28.60, loss: 40752.8086, ppl: 3.9614, duration: 19.2415s 2020-02-12 21:14:23,952 Epoch 66 Step: 160100 Batch Loss: 1.227053 Tokens per Sec: 21764, Lr: 0.000300 2020-02-12 21:14:34,124 Epoch 66 Step: 160200 Batch Loss: 1.307204 Tokens per Sec: 21533, Lr: 0.000300 2020-02-12 21:14:44,324 Epoch 66 Step: 160300 Batch Loss: 1.475765 Tokens per Sec: 22031, Lr: 0.000300 2020-02-12 21:14:54,344 Epoch 66 Step: 160400 Batch Loss: 1.298973 Tokens per Sec: 22187, Lr: 0.000300 2020-02-12 21:15:04,404 Epoch 66 Step: 160500 Batch Loss: 1.446144 Tokens per Sec: 21634, Lr: 0.000300 2020-02-12 21:15:14,300 Epoch 66 Step: 160600 Batch Loss: 1.567499 Tokens per Sec: 22486, Lr: 0.000300 2020-02-12 21:15:24,298 Epoch 66 Step: 160700 Batch Loss: 1.417793 Tokens per Sec: 22325, Lr: 0.000300 2020-02-12 21:15:34,227 Epoch 66 Step: 160800 Batch Loss: 1.486055 Tokens per Sec: 22341, Lr: 0.000300 2020-02-12 21:15:44,219 Epoch 66 Step: 160900 Batch Loss: 1.145403 Tokens per Sec: 22093, Lr: 0.000300 2020-02-12 21:15:54,338 Epoch 66 Step: 161000 Batch Loss: 1.518003 Tokens per Sec: 22066, Lr: 0.000300 2020-02-12 21:16:13,449 Hooray! New best validation result [ppl]! 2020-02-12 21:16:13,450 Saving new checkpoint. 2020-02-12 21:16:13,641 Example #0 2020-02-12 21:16:13,641 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 21:16:13,641 Raw hypothesis: ['Er', 'i', 'ver', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'doo', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'sha', 'dooshima', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'sha', 'dooshima', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 21:16:13,641 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 21:16:13,641 Reference: 10 : ​ 6 - 9 . 2020-02-12 21:16:13,641 Hypothesis: Er i ver ivese i Yehova a ver la i lu kwagh u tsôron yô , doo u noov man kasev vea nôngo kpoghuloo vea lu a dooshima sha dooshima shi vea za hemen u lun a dooshima sha dooshima . — Marku 10 : 6 - 9 . 2020-02-12 21:16:13,641 Example #1 2020-02-12 21:16:13,641 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 21:16:13,642 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kape', 'i', 'lu', 'mgb@@', 'ôghom', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 21:16:13,642 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 21:16:13,642 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 21:16:13,642 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kape i lu mgbôghom je la ! — Rom . 2020-02-12 21:16:13,642 Example #2 2020-02-12 21:16:13,642 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 21:16:13,642 Raw hypothesis: ['Anyom', 'nga', 'kar', 'pue', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 21:16:13,642 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 21:16:13,642 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 21:16:13,642 Hypothesis: Anyom nga kar pue yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 21:16:13,642 Example #3 2020-02-12 21:16:13,642 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 21:16:13,642 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 21:16:13,642 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 21:16:13,642 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 21:16:13,643 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 21:16:13,643 Validation result (greedy) at epoch 66, step 161000: bleu: 28.57, loss: 40616.0977, ppl: 3.9432, duration: 19.3035s 2020-02-12 21:16:23,644 Epoch 66 Step: 161100 Batch Loss: 1.236913 Tokens per Sec: 22313, Lr: 0.000300 2020-02-12 21:16:33,592 Epoch 66 Step: 161200 Batch Loss: 1.328223 Tokens per Sec: 22132, Lr: 0.000300 2020-02-12 21:16:43,592 Epoch 66 Step: 161300 Batch Loss: 1.279949 Tokens per Sec: 21972, Lr: 0.000300 2020-02-12 21:16:53,629 Epoch 66 Step: 161400 Batch Loss: 1.409196 Tokens per Sec: 22547, Lr: 0.000300 2020-02-12 21:17:03,665 Epoch 66 Step: 161500 Batch Loss: 1.367484 Tokens per Sec: 21781, Lr: 0.000300 2020-02-12 21:17:13,651 Epoch 66 Step: 161600 Batch Loss: 1.233068 Tokens per Sec: 22163, Lr: 0.000300 2020-02-12 21:17:23,613 Epoch 66 Step: 161700 Batch Loss: 1.384800 Tokens per Sec: 21532, Lr: 0.000300 2020-02-12 21:17:33,728 Epoch 66 Step: 161800 Batch Loss: 1.413949 Tokens per Sec: 21887, Lr: 0.000300 2020-02-12 21:17:43,738 Epoch 66 Step: 161900 Batch Loss: 1.314624 Tokens per Sec: 21447, Lr: 0.000300 2020-02-12 21:17:53,751 Epoch 66 Step: 162000 Batch Loss: 1.467237 Tokens per Sec: 22285, Lr: 0.000300 2020-02-12 21:18:12,524 Example #0 2020-02-12 21:18:12,525 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 21:18:12,525 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'tsung', 'vea', 'lu', 'a', 'dooshima', 've', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 21:18:12,525 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 21:18:12,525 Reference: 10 : ​ 6 - 9 . 2020-02-12 21:18:12,525 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo tsung vea lu a dooshima ve her shi vea za hemen u lun a dooshima her . — Marku 10 : 6 - 9 . 2020-02-12 21:18:12,525 Example #1 2020-02-12 21:18:12,525 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 21:18:12,525 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'imba', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'sha', 'kpôô', 'yô', ',', 'a', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 21:18:12,525 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 21:18:12,525 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 21:18:12,525 Hypothesis: Se kpa se fatyô u ‘ nengen ’ imba shighe u doon tsung ne , man sha kpôô yô , a mgbôghom ! — Rom . 2020-02-12 21:18:12,525 Example #2 2020-02-12 21:18:12,525 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 21:18:12,525 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 21:18:12,525 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 21:18:12,525 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 21:18:12,526 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 21:18:12,526 Example #3 2020-02-12 21:18:12,526 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 21:18:12,526 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 21:18:12,526 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 21:18:12,526 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 21:18:12,526 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 21:18:12,526 Validation result (greedy) at epoch 66, step 162000: bleu: 28.84, loss: 40671.1641, ppl: 3.9505, duration: 18.7739s 2020-02-12 21:18:22,717 Epoch 66 Step: 162100 Batch Loss: 1.276497 Tokens per Sec: 21295, Lr: 0.000300 2020-02-12 21:18:32,938 Epoch 66 Step: 162200 Batch Loss: 1.624056 Tokens per Sec: 21758, Lr: 0.000300 2020-02-12 21:18:40,503 Epoch 66: total training loss 3389.93 2020-02-12 21:18:40,503 EPOCH 67 2020-02-12 21:18:43,478 Epoch 67 Step: 162300 Batch Loss: 1.098501 Tokens per Sec: 18142, Lr: 0.000300 2020-02-12 21:18:53,714 Epoch 67 Step: 162400 Batch Loss: 1.166796 Tokens per Sec: 22235, Lr: 0.000300 2020-02-12 21:19:03,827 Epoch 67 Step: 162500 Batch Loss: 1.155450 Tokens per Sec: 20764, Lr: 0.000300 2020-02-12 21:19:13,907 Epoch 67 Step: 162600 Batch Loss: 1.451800 Tokens per Sec: 21917, Lr: 0.000300 2020-02-12 21:19:23,792 Epoch 67 Step: 162700 Batch Loss: 1.516924 Tokens per Sec: 22630, Lr: 0.000300 2020-02-12 21:19:33,834 Epoch 67 Step: 162800 Batch Loss: 0.973673 Tokens per Sec: 21947, Lr: 0.000300 2020-02-12 21:19:43,937 Epoch 67 Step: 162900 Batch Loss: 1.156549 Tokens per Sec: 21871, Lr: 0.000300 2020-02-12 21:19:54,150 Epoch 67 Step: 163000 Batch Loss: 1.393015 Tokens per Sec: 21804, Lr: 0.000300 2020-02-12 21:20:13,318 Example #0 2020-02-12 21:20:13,318 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 21:20:13,318 Raw hypothesis: ['Er', 'm@@', 'ser@@', 'akaa', 'u', 'Yehova', 'a', 'ver', 'la', 'a', 'lu', 'u', 'tsôron', 'yô', ',', 'doo', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'kura', 'dooshima', 've', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'kpaa', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 21:20:13,318 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 21:20:13,318 Reference: 10 : ​ 6 - 9 . 2020-02-12 21:20:13,318 Hypothesis: Er mserakaa u Yehova a ver la a lu u tsôron yô , doo u noov man kasev vea nôngo kpoghuloo vea kura dooshima ve la , shi vea za hemen u lun a dooshima u a lu a mi la kpaa . — Marku 10 : 6 - 9 . 2020-02-12 21:20:13,318 Example #1 2020-02-12 21:20:13,318 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 21:20:13,318 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 21:20:13,319 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 21:20:13,319 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 21:20:13,319 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-12 21:20:13,319 Example #2 2020-02-12 21:20:13,319 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 21:20:13,319 Raw hypothesis: ['Anyom', 'nga', 'kar', 'pue', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 21:20:13,319 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 21:20:13,319 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 21:20:13,319 Hypothesis: Anyom nga kar pue yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 21:20:13,319 Example #3 2020-02-12 21:20:13,319 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 21:20:13,319 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 21:20:13,319 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 21:20:13,319 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 21:20:13,320 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-12 21:20:13,320 Validation result (greedy) at epoch 67, step 163000: bleu: 28.42, loss: 40756.3789, ppl: 3.9619, duration: 19.1695s 2020-02-12 21:20:23,396 Epoch 67 Step: 163100 Batch Loss: 1.459340 Tokens per Sec: 22207, Lr: 0.000300 2020-02-12 21:20:33,411 Epoch 67 Step: 163200 Batch Loss: 1.518558 Tokens per Sec: 22136, Lr: 0.000300 2020-02-12 21:20:43,370 Epoch 67 Step: 163300 Batch Loss: 1.452899 Tokens per Sec: 22196, Lr: 0.000300 2020-02-12 21:20:53,363 Epoch 67 Step: 163400 Batch Loss: 1.435752 Tokens per Sec: 22106, Lr: 0.000300 2020-02-12 21:21:03,267 Epoch 67 Step: 163500 Batch Loss: 1.382020 Tokens per Sec: 22135, Lr: 0.000300 2020-02-12 21:21:13,211 Epoch 67 Step: 163600 Batch Loss: 1.319530 Tokens per Sec: 22748, Lr: 0.000300 2020-02-12 21:21:23,243 Epoch 67 Step: 163700 Batch Loss: 1.488702 Tokens per Sec: 22444, Lr: 0.000300 2020-02-12 21:21:33,103 Epoch 67 Step: 163800 Batch Loss: 1.421444 Tokens per Sec: 22712, Lr: 0.000300 2020-02-12 21:21:42,963 Epoch 67 Step: 163900 Batch Loss: 1.558003 Tokens per Sec: 22545, Lr: 0.000300 2020-02-12 21:21:52,854 Epoch 67 Step: 164000 Batch Loss: 1.308094 Tokens per Sec: 22296, Lr: 0.000300 2020-02-12 21:22:11,259 Hooray! New best validation result [ppl]! 2020-02-12 21:22:11,260 Saving new checkpoint. 2020-02-12 21:22:11,449 Example #0 2020-02-12 21:22:11,449 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 21:22:11,449 Raw hypothesis: ['Er', 'm@@', 'ser@@', 'akaa', 'u', 'Yehova', 'a', 'ver', 'la', 'a', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'mimi', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'sha', 'dooshima', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 21:22:11,449 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 21:22:11,449 Reference: 10 : ​ 6 - 9 . 2020-02-12 21:22:11,449 Hypothesis: Er mserakaa u Yehova a ver la a lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea za hemen u lun a dooshima u mimi shi vea za hemen u lun a dooshima sha dooshima . — Marku 10 : 6 - 9 . 2020-02-12 21:22:11,449 Example #1 2020-02-12 21:22:11,449 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 21:22:11,449 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 21:22:11,449 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 21:22:11,449 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 21:22:11,450 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-12 21:22:11,450 Example #2 2020-02-12 21:22:11,450 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 21:22:11,450 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 21:22:11,450 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 21:22:11,450 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 21:22:11,450 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 21:22:11,450 Example #3 2020-02-12 21:22:11,450 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 21:22:11,450 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 21:22:11,450 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 21:22:11,450 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 21:22:11,450 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga yô . 2020-02-12 21:22:11,450 Validation result (greedy) at epoch 67, step 164000: bleu: 28.61, loss: 40605.3984, ppl: 3.9417, duration: 18.5963s 2020-02-12 21:22:21,448 Epoch 67 Step: 164100 Batch Loss: 1.479446 Tokens per Sec: 22097, Lr: 0.000300 2020-02-12 21:22:31,338 Epoch 67 Step: 164200 Batch Loss: 1.453567 Tokens per Sec: 22385, Lr: 0.000300 2020-02-12 21:22:41,451 Epoch 67 Step: 164300 Batch Loss: 1.358651 Tokens per Sec: 21795, Lr: 0.000300 2020-02-12 21:22:51,718 Epoch 67 Step: 164400 Batch Loss: 1.157368 Tokens per Sec: 21548, Lr: 0.000300 2020-02-12 21:23:01,888 Epoch 67 Step: 164500 Batch Loss: 1.052091 Tokens per Sec: 21355, Lr: 0.000300 2020-02-12 21:23:11,869 Epoch 67 Step: 164600 Batch Loss: 1.465715 Tokens per Sec: 22545, Lr: 0.000300 2020-02-12 21:23:21,879 Epoch 67 Step: 164700 Batch Loss: 1.388363 Tokens per Sec: 21592, Lr: 0.000300 2020-02-12 21:23:24,985 Epoch 67: total training loss 3381.95 2020-02-12 21:23:24,985 EPOCH 68 2020-02-12 21:23:32,104 Epoch 68 Step: 164800 Batch Loss: 1.100460 Tokens per Sec: 21014, Lr: 0.000300 2020-02-12 21:23:42,042 Epoch 68 Step: 164900 Batch Loss: 1.189202 Tokens per Sec: 22189, Lr: 0.000300 2020-02-12 21:23:51,988 Epoch 68 Step: 165000 Batch Loss: 1.570109 Tokens per Sec: 22576, Lr: 0.000300 2020-02-12 21:24:10,967 Example #0 2020-02-12 21:24:10,967 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 21:24:10,967 Raw hypothesis: ['Er', 'm@@', 'ser@@', 'akaa', 'u', 'iv@@', 'es@@', 'egh', 'u', 'Yehova', 'a', 'ver', 'la', 'a', 'lu', 'u', 'tsan', 'gbem', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'sha', 'afatyô', 've', 'cii', 'vea', 'lu', 'a', 'dooshima', 've', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'seer', 'a', 'seer', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 21:24:10,968 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 21:24:10,968 Reference: 10 : ​ 6 - 9 . 2020-02-12 21:24:10,968 Hypothesis: Er mserakaa u ivesegh u Yehova a ver la a lu u tsan gbem yô , gba hange hange u noov man kasev vea nôngo sha afatyô ve cii vea lu a dooshima ve her shi vea za hemen u lun a dooshima u a lu seer a seer la . — Marku 10 : 6 - 9 . 2020-02-12 21:24:10,968 Example #1 2020-02-12 21:24:10,968 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 21:24:10,968 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'a', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 21:24:10,968 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 21:24:10,968 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 21:24:10,968 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man a mgbôghom ! — Rom . 2020-02-12 21:24:10,968 Example #2 2020-02-12 21:24:10,968 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 21:24:10,968 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 21:24:10,968 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 21:24:10,968 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 21:24:10,968 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 21:24:10,968 Example #3 2020-02-12 21:24:10,969 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 21:24:10,969 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 21:24:10,969 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 21:24:10,969 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 21:24:10,969 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 21:24:10,969 Validation result (greedy) at epoch 68, step 165000: bleu: 28.36, loss: 40696.5312, ppl: 3.9539, duration: 18.9807s 2020-02-12 21:24:21,042 Epoch 68 Step: 165100 Batch Loss: 1.531411 Tokens per Sec: 21828, Lr: 0.000300 2020-02-12 21:24:31,002 Epoch 68 Step: 165200 Batch Loss: 1.362218 Tokens per Sec: 22641, Lr: 0.000300 2020-02-12 21:24:40,904 Epoch 68 Step: 165300 Batch Loss: 1.406649 Tokens per Sec: 22367, Lr: 0.000300 2020-02-12 21:24:50,822 Epoch 68 Step: 165400 Batch Loss: 1.510821 Tokens per Sec: 22328, Lr: 0.000300 2020-02-12 21:25:00,698 Epoch 68 Step: 165500 Batch Loss: 1.466789 Tokens per Sec: 21804, Lr: 0.000300 2020-02-12 21:25:10,606 Epoch 68 Step: 165600 Batch Loss: 1.211068 Tokens per Sec: 21851, Lr: 0.000300 2020-02-12 21:25:20,640 Epoch 68 Step: 165700 Batch Loss: 1.582863 Tokens per Sec: 21871, Lr: 0.000300 2020-02-12 21:25:30,889 Epoch 68 Step: 165800 Batch Loss: 1.334930 Tokens per Sec: 21670, Lr: 0.000300 2020-02-12 21:25:40,892 Epoch 68 Step: 165900 Batch Loss: 1.591504 Tokens per Sec: 22002, Lr: 0.000300 2020-02-12 21:25:50,895 Epoch 68 Step: 166000 Batch Loss: 1.348272 Tokens per Sec: 22290, Lr: 0.000300 2020-02-12 21:26:09,744 Example #0 2020-02-12 21:26:09,744 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 21:26:09,744 Raw hypothesis: ['Er', 'm@@', 'ser@@', 'akaa', 'u', 'Yehova', 'a', 'ver', 'la', 'a', 'lu', 'u', 'tsan', 'gbem', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'sha', 'afatyô', 've', 'cii', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'kpaa', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 21:26:09,744 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 21:26:09,744 Reference: 10 : ​ 6 - 9 . 2020-02-12 21:26:09,744 Hypothesis: Er mserakaa u Yehova a ver la a lu u tsan gbem yô , gba hange hange u noov man kasev vea nôngo sha afatyô ve cii vea lu a dooshima u a lu a mi la , shi vea lu a dooshima u a lu a mi la kpaa . — Marku 10 : 6 - 9 . 2020-02-12 21:26:09,744 Example #1 2020-02-12 21:26:09,744 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 21:26:09,744 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'sha', 'kpôô', 'yô', ',', 'ngu', 'ikyua', '!', '—', 'Rom', '.'] 2020-02-12 21:26:09,744 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 21:26:09,744 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 21:26:09,744 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man sha kpôô yô , ngu ikyua ! — Rom . 2020-02-12 21:26:09,744 Example #2 2020-02-12 21:26:09,745 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 21:26:09,745 Raw hypothesis: ['Anyom', 'nga', 'kar', 'pue', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 21:26:09,745 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 21:26:09,745 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 21:26:09,745 Hypothesis: Anyom nga kar pue yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 21:26:09,745 Example #3 2020-02-12 21:26:09,745 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 21:26:09,745 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 21:26:09,745 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 21:26:09,745 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 21:26:09,745 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 21:26:09,745 Validation result (greedy) at epoch 68, step 166000: bleu: 28.40, loss: 40709.0000, ppl: 3.9555, duration: 18.8493s 2020-02-12 21:26:19,657 Epoch 68 Step: 166100 Batch Loss: 1.542606 Tokens per Sec: 22114, Lr: 0.000300 2020-02-12 21:26:29,520 Epoch 68 Step: 166200 Batch Loss: 1.171417 Tokens per Sec: 22602, Lr: 0.000300 2020-02-12 21:26:39,423 Epoch 68 Step: 166300 Batch Loss: 1.482436 Tokens per Sec: 22155, Lr: 0.000300 2020-02-12 21:26:49,407 Epoch 68 Step: 166400 Batch Loss: 1.185074 Tokens per Sec: 21844, Lr: 0.000300 2020-02-12 21:26:59,370 Epoch 68 Step: 166500 Batch Loss: 1.324131 Tokens per Sec: 21946, Lr: 0.000300 2020-02-12 21:27:09,478 Epoch 68 Step: 166600 Batch Loss: 1.267979 Tokens per Sec: 22332, Lr: 0.000300 2020-02-12 21:27:19,561 Epoch 68 Step: 166700 Batch Loss: 1.482439 Tokens per Sec: 21716, Lr: 0.000300 2020-02-12 21:27:29,771 Epoch 68 Step: 166800 Batch Loss: 1.574959 Tokens per Sec: 21460, Lr: 0.000300 2020-02-12 21:27:39,901 Epoch 68 Step: 166900 Batch Loss: 1.184707 Tokens per Sec: 21924, Lr: 0.000300 2020-02-12 21:27:50,070 Epoch 68 Step: 167000 Batch Loss: 1.327590 Tokens per Sec: 22552, Lr: 0.000300 2020-02-12 21:28:09,927 Example #0 2020-02-12 21:28:09,928 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 21:28:09,928 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'her', 'dông', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 21:28:09,928 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 21:28:09,928 Reference: 10 : ​ 6 - 9 . 2020-02-12 21:28:09,928 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la , shi vea za hemen u lun a dooshima her dông . — Marku 10 : 6 - 9 . 2020-02-12 21:28:09,928 Example #1 2020-02-12 21:28:09,928 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 21:28:09,928 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'kpilighyol', 'ne', ',', 'man', 'kwagh', 'ne', 'ngu', 'ikyua', 'ikyua', '!', '—', 'Rom', '.'] 2020-02-12 21:28:09,928 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 21:28:09,928 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 21:28:09,928 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u kpilighyol ne , man kwagh ne ngu ikyua ikyua ! — Rom . 2020-02-12 21:28:09,928 Example #2 2020-02-12 21:28:09,928 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 21:28:09,928 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 21:28:09,928 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 21:28:09,929 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 21:28:09,929 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 21:28:09,929 Example #3 2020-02-12 21:28:09,929 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 21:28:09,929 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 21:28:09,929 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 21:28:09,929 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 21:28:09,929 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 21:28:09,929 Validation result (greedy) at epoch 68, step 167000: bleu: 28.46, loss: 40678.6406, ppl: 3.9515, duration: 19.8590s 2020-02-12 21:28:19,756 Epoch 68 Step: 167100 Batch Loss: 1.320471 Tokens per Sec: 22520, Lr: 0.000300 2020-02-12 21:28:28,596 Epoch 68: total training loss 3378.79 2020-02-12 21:28:28,597 EPOCH 69 2020-02-12 21:28:29,860 Epoch 69 Step: 167200 Batch Loss: 1.252517 Tokens per Sec: 19149, Lr: 0.000300 2020-02-12 21:28:39,683 Epoch 69 Step: 167300 Batch Loss: 0.909732 Tokens per Sec: 22025, Lr: 0.000300 2020-02-12 21:28:49,603 Epoch 69 Step: 167400 Batch Loss: 1.272224 Tokens per Sec: 21858, Lr: 0.000300 2020-02-12 21:28:59,517 Epoch 69 Step: 167500 Batch Loss: 1.142943 Tokens per Sec: 21971, Lr: 0.000300 2020-02-12 21:29:09,505 Epoch 69 Step: 167600 Batch Loss: 1.449285 Tokens per Sec: 22401, Lr: 0.000300 2020-02-12 21:29:19,519 Epoch 69 Step: 167700 Batch Loss: 1.524561 Tokens per Sec: 21455, Lr: 0.000300 2020-02-12 21:29:29,495 Epoch 69 Step: 167800 Batch Loss: 1.219512 Tokens per Sec: 22015, Lr: 0.000300 2020-02-12 21:29:39,606 Epoch 69 Step: 167900 Batch Loss: 1.298621 Tokens per Sec: 21992, Lr: 0.000300 2020-02-12 21:29:49,831 Epoch 69 Step: 168000 Batch Loss: 1.412660 Tokens per Sec: 21519, Lr: 0.000300 2020-02-12 21:30:09,305 Example #0 2020-02-12 21:30:09,305 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 21:30:09,305 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 21:30:09,305 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 21:30:09,305 Reference: 10 : ​ 6 - 9 . 2020-02-12 21:30:09,305 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la , shi vea za hemen u lun a dooshima her . — Marku 10 : 6 - 9 . 2020-02-12 21:30:09,305 Example #1 2020-02-12 21:30:09,305 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 21:30:09,305 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 21:30:09,305 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 21:30:09,305 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 21:30:09,306 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-12 21:30:09,306 Example #2 2020-02-12 21:30:09,306 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 21:30:09,306 Raw hypothesis: ['Anyom', 'nga', 'kar', 'pue', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 21:30:09,306 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 21:30:09,306 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 21:30:09,306 Hypothesis: Anyom nga kar pue yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 21:30:09,306 Example #3 2020-02-12 21:30:09,306 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 21:30:09,306 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 21:30:09,306 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 21:30:09,306 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 21:30:09,306 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 21:30:09,306 Validation result (greedy) at epoch 69, step 168000: bleu: 28.71, loss: 40764.4219, ppl: 3.9630, duration: 19.4748s 2020-02-12 21:30:19,537 Epoch 69 Step: 168100 Batch Loss: 1.460573 Tokens per Sec: 21243, Lr: 0.000300 2020-02-12 21:30:29,645 Epoch 69 Step: 168200 Batch Loss: 1.524707 Tokens per Sec: 21518, Lr: 0.000300 2020-02-12 21:30:39,756 Epoch 69 Step: 168300 Batch Loss: 1.495079 Tokens per Sec: 21501, Lr: 0.000300 2020-02-12 21:30:49,913 Epoch 69 Step: 168400 Batch Loss: 1.492542 Tokens per Sec: 22284, Lr: 0.000300 2020-02-12 21:30:59,872 Epoch 69 Step: 168500 Batch Loss: 1.407108 Tokens per Sec: 22497, Lr: 0.000300 2020-02-12 21:31:09,729 Epoch 69 Step: 168600 Batch Loss: 1.392927 Tokens per Sec: 22555, Lr: 0.000300 2020-02-12 21:31:19,609 Epoch 69 Step: 168700 Batch Loss: 1.501685 Tokens per Sec: 22699, Lr: 0.000300 2020-02-12 21:31:29,534 Epoch 69 Step: 168800 Batch Loss: 1.412920 Tokens per Sec: 22659, Lr: 0.000300 2020-02-12 21:31:39,495 Epoch 69 Step: 168900 Batch Loss: 0.937086 Tokens per Sec: 22502, Lr: 0.000300 2020-02-12 21:31:49,543 Epoch 69 Step: 169000 Batch Loss: 1.586249 Tokens per Sec: 21540, Lr: 0.000300 2020-02-12 21:32:08,817 Example #0 2020-02-12 21:32:08,817 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 21:32:08,817 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsan', 'gbem', 'sha', 'won', 'yô', ',', 'doo', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'sha', 'afatyô', 've', 'cii', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'vesen', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 21:32:08,817 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 21:32:08,818 Reference: 10 : ​ 6 - 9 . 2020-02-12 21:32:08,818 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsan gbem sha won yô , doo u noov man kasev vea nôngo sha afatyô ve cii vea lu a dooshima u a lu a mi la , shi vea za hemen u lun a dooshima u a lu vesen la . — Marku 10 : 6 - 9 . 2020-02-12 21:32:08,818 Example #1 2020-02-12 21:32:08,818 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 21:32:08,818 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'ngu', 'ikyua', '!', '—', 'Rom', '.'] 2020-02-12 21:32:08,818 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 21:32:08,818 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 21:32:08,818 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne ngu ikyua ! — Rom . 2020-02-12 21:32:08,818 Example #2 2020-02-12 21:32:08,818 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 21:32:08,818 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'ngu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 21:32:08,818 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 21:32:08,818 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 21:32:08,818 Hypothesis: Anyom nga kar er pue nahan yô , Paulu ngu ken Masedonia man Timoteu ken Efese . 2020-02-12 21:32:08,818 Example #3 2020-02-12 21:32:08,818 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 21:32:08,819 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'inja', 'ga', 'yô', ',', 'nana', 'lu', 'eren', 'kwagh', 'u', 'vough', '.'] 2020-02-12 21:32:08,819 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 21:32:08,819 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 21:32:08,819 Hypothesis: Alaghga or u nan lu eren kwagh sha inja ga yô , nana lu eren kwagh u vough . 2020-02-12 21:32:08,819 Validation result (greedy) at epoch 69, step 169000: bleu: 29.16, loss: 40690.5859, ppl: 3.9531, duration: 19.2749s 2020-02-12 21:32:18,751 Epoch 69 Step: 169100 Batch Loss: 1.425263 Tokens per Sec: 22242, Lr: 0.000300 2020-02-12 21:32:28,633 Epoch 69 Step: 169200 Batch Loss: 1.347558 Tokens per Sec: 22792, Lr: 0.000300 2020-02-12 21:32:38,602 Epoch 69 Step: 169300 Batch Loss: 1.265322 Tokens per Sec: 22441, Lr: 0.000300 2020-02-12 21:32:48,753 Epoch 69 Step: 169400 Batch Loss: 1.470473 Tokens per Sec: 21936, Lr: 0.000300 2020-02-12 21:32:58,666 Epoch 69 Step: 169500 Batch Loss: 1.598056 Tokens per Sec: 22383, Lr: 0.000300 2020-02-12 21:33:08,609 Epoch 69 Step: 169600 Batch Loss: 1.198459 Tokens per Sec: 22573, Lr: 0.000300 2020-02-12 21:33:13,319 Epoch 69: total training loss 3371.32 2020-02-12 21:33:13,319 EPOCH 70 2020-02-12 21:33:18,848 Epoch 70 Step: 169700 Batch Loss: 1.480597 Tokens per Sec: 20277, Lr: 0.000300 2020-02-12 21:33:28,848 Epoch 70 Step: 169800 Batch Loss: 1.431355 Tokens per Sec: 22720, Lr: 0.000300 2020-02-12 21:33:38,740 Epoch 70 Step: 169900 Batch Loss: 1.516980 Tokens per Sec: 22351, Lr: 0.000300 2020-02-12 21:33:48,774 Epoch 70 Step: 170000 Batch Loss: 1.378151 Tokens per Sec: 22478, Lr: 0.000300 2020-02-12 21:34:06,979 Example #0 2020-02-12 21:34:06,979 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 21:34:06,979 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsan', 'gbem', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 've', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'vesen', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 21:34:06,980 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 21:34:06,980 Reference: 10 : ​ 6 - 9 . 2020-02-12 21:34:06,980 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsan gbem yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima ve la , shi vea za hemen u lun a dooshima u a lu vesen la . — Marku 10 : 6 - 9 . 2020-02-12 21:34:06,980 Example #1 2020-02-12 21:34:06,980 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 21:34:06,980 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 21:34:06,980 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 21:34:06,980 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 21:34:06,980 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-12 21:34:06,980 Example #2 2020-02-12 21:34:06,980 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 21:34:06,980 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 21:34:06,980 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 21:34:06,980 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 21:34:06,980 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 21:34:06,981 Example #3 2020-02-12 21:34:06,981 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 21:34:06,981 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 21:34:06,981 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 21:34:06,981 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 21:34:06,981 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 21:34:06,981 Validation result (greedy) at epoch 70, step 170000: bleu: 28.13, loss: 40766.2070, ppl: 3.9632, duration: 18.2060s 2020-02-12 21:34:16,872 Epoch 70 Step: 170100 Batch Loss: 1.500207 Tokens per Sec: 21710, Lr: 0.000210 2020-02-12 21:34:26,790 Epoch 70 Step: 170200 Batch Loss: 1.456264 Tokens per Sec: 22478, Lr: 0.000210 2020-02-12 21:34:36,775 Epoch 70 Step: 170300 Batch Loss: 1.225434 Tokens per Sec: 22160, Lr: 0.000210 2020-02-12 21:34:46,674 Epoch 70 Step: 170400 Batch Loss: 1.147439 Tokens per Sec: 22633, Lr: 0.000210 2020-02-12 21:34:56,574 Epoch 70 Step: 170500 Batch Loss: 1.492128 Tokens per Sec: 21642, Lr: 0.000210 2020-02-12 21:35:06,698 Epoch 70 Step: 170600 Batch Loss: 1.142891 Tokens per Sec: 21335, Lr: 0.000210 2020-02-12 21:35:16,806 Epoch 70 Step: 170700 Batch Loss: 1.164842 Tokens per Sec: 21830, Lr: 0.000210 2020-02-12 21:35:26,878 Epoch 70 Step: 170800 Batch Loss: 1.104715 Tokens per Sec: 22225, Lr: 0.000210 2020-02-12 21:35:37,001 Epoch 70 Step: 170900 Batch Loss: 1.374452 Tokens per Sec: 21498, Lr: 0.000210 2020-02-12 21:35:46,975 Epoch 70 Step: 171000 Batch Loss: 1.248356 Tokens per Sec: 22564, Lr: 0.000210 2020-02-12 21:36:05,576 Hooray! New best validation result [ppl]! 2020-02-12 21:36:05,576 Saving new checkpoint. 2020-02-12 21:36:05,765 Example #0 2020-02-12 21:36:05,765 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 21:36:05,765 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsan', 'gbem', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 've', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'seer', 'a', 'seer', 'la', '.', '—', 'M@@', 'ar', '.', '10', ':', '6', '-', '9', '.'] 2020-02-12 21:36:05,765 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 21:36:05,765 Reference: 10 : ​ 6 - 9 . 2020-02-12 21:36:05,765 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsan gbem yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima ve her shi vea za hemen u lun a dooshima u a lu seer a seer la . — Mar . 10 : 6 - 9 . 2020-02-12 21:36:05,765 Example #1 2020-02-12 21:36:05,765 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 21:36:05,765 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 21:36:05,765 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 21:36:05,765 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 21:36:05,766 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-12 21:36:05,766 Example #2 2020-02-12 21:36:05,766 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 21:36:05,766 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 21:36:05,766 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 21:36:05,766 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 21:36:05,766 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 21:36:05,766 Example #3 2020-02-12 21:36:05,766 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 21:36:05,766 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 21:36:05,766 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 21:36:05,766 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 21:36:05,766 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 21:36:05,766 Validation result (greedy) at epoch 70, step 171000: bleu: 28.70, loss: 40408.3711, ppl: 3.9156, duration: 18.7912s 2020-02-12 21:36:15,736 Epoch 70 Step: 171100 Batch Loss: 1.453360 Tokens per Sec: 22331, Lr: 0.000210 2020-02-12 21:36:25,862 Epoch 70 Step: 171200 Batch Loss: 1.255177 Tokens per Sec: 21728, Lr: 0.000210 2020-02-12 21:36:36,096 Epoch 70 Step: 171300 Batch Loss: 1.478583 Tokens per Sec: 21594, Lr: 0.000210 2020-02-12 21:36:46,228 Epoch 70 Step: 171400 Batch Loss: 1.453074 Tokens per Sec: 21447, Lr: 0.000210 2020-02-12 21:36:56,243 Epoch 70 Step: 171500 Batch Loss: 1.361747 Tokens per Sec: 22216, Lr: 0.000210 2020-02-12 21:37:06,194 Epoch 70 Step: 171600 Batch Loss: 1.390606 Tokens per Sec: 22607, Lr: 0.000210 2020-02-12 21:37:16,141 Epoch 70 Step: 171700 Batch Loss: 1.289407 Tokens per Sec: 22233, Lr: 0.000210 2020-02-12 21:37:26,056 Epoch 70 Step: 171800 Batch Loss: 1.517298 Tokens per Sec: 22360, Lr: 0.000210 2020-02-12 21:37:35,929 Epoch 70 Step: 171900 Batch Loss: 1.117063 Tokens per Sec: 22192, Lr: 0.000210 2020-02-12 21:37:45,910 Epoch 70 Step: 172000 Batch Loss: 1.226853 Tokens per Sec: 22136, Lr: 0.000210 2020-02-12 21:38:04,465 Hooray! New best validation result [ppl]! 2020-02-12 21:38:04,465 Saving new checkpoint. 2020-02-12 21:38:04,652 Example #0 2020-02-12 21:38:04,652 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 21:38:04,652 Raw hypothesis: ['Er', 'm@@', 'ser@@', 'akaa', 'u', 'Yehova', 'a', 'ver', 'la', 'a', 'lu', 'u', 'tsan', 'gbem', 'sha', 'won', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'vesen', 'seer', 'a', 'seer', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 21:38:04,653 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 21:38:04,653 Reference: 10 : ​ 6 - 9 . 2020-02-12 21:38:04,653 Hypothesis: Er mserakaa u Yehova a ver la a lu u tsan gbem sha won yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la , shi vea za hemen u lun a dooshima u a lu vesen seer a seer la . — Marku 10 : 6 - 9 . 2020-02-12 21:38:04,653 Example #1 2020-02-12 21:38:04,653 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 21:38:04,653 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 21:38:04,653 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 21:38:04,653 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 21:38:04,653 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-12 21:38:04,653 Example #2 2020-02-12 21:38:04,653 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 21:38:04,653 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 21:38:04,653 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 21:38:04,653 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 21:38:04,653 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 21:38:04,654 Example #3 2020-02-12 21:38:04,654 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 21:38:04,654 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 21:38:04,654 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 21:38:04,654 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 21:38:04,654 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 21:38:04,654 Validation result (greedy) at epoch 70, step 172000: bleu: 28.21, loss: 40373.5430, ppl: 3.9110, duration: 18.7433s 2020-02-12 21:38:14,603 Epoch 70 Step: 172100 Batch Loss: 1.398068 Tokens per Sec: 21901, Lr: 0.000210 2020-02-12 21:38:15,500 Epoch 70: total training loss 3335.88 2020-02-12 21:38:15,501 EPOCH 71 2020-02-12 21:38:24,834 Epoch 71 Step: 172200 Batch Loss: 1.417088 Tokens per Sec: 21670, Lr: 0.000210 2020-02-12 21:38:34,720 Epoch 71 Step: 172300 Batch Loss: 1.470526 Tokens per Sec: 22203, Lr: 0.000210 2020-02-12 21:38:44,617 Epoch 71 Step: 172400 Batch Loss: 1.138673 Tokens per Sec: 22724, Lr: 0.000210 2020-02-12 21:38:54,544 Epoch 71 Step: 172500 Batch Loss: 1.186428 Tokens per Sec: 22289, Lr: 0.000210 2020-02-12 21:39:04,443 Epoch 71 Step: 172600 Batch Loss: 1.258686 Tokens per Sec: 22818, Lr: 0.000210 2020-02-12 21:39:14,387 Epoch 71 Step: 172700 Batch Loss: 1.423118 Tokens per Sec: 22370, Lr: 0.000210 2020-02-12 21:39:24,414 Epoch 71 Step: 172800 Batch Loss: 1.401284 Tokens per Sec: 22209, Lr: 0.000210 2020-02-12 21:39:34,317 Epoch 71 Step: 172900 Batch Loss: 1.374153 Tokens per Sec: 22307, Lr: 0.000210 2020-02-12 21:39:44,285 Epoch 71 Step: 173000 Batch Loss: 1.007435 Tokens per Sec: 22367, Lr: 0.000210 2020-02-12 21:40:02,477 Example #0 2020-02-12 21:40:02,477 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 21:40:02,477 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsan', 'gbem', 'yô', ',', 'doo', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 've', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'vesen', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 21:40:02,477 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 21:40:02,478 Reference: 10 : ​ 6 - 9 . 2020-02-12 21:40:02,478 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsan gbem yô , doo u noov man kasev vea nôngo kpoghuloo vea lu a dooshima ve her shi vea za hemen u lun a dooshima u a lu vesen la . — Marku 10 : 6 - 9 . 2020-02-12 21:40:02,478 Example #1 2020-02-12 21:40:02,478 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 21:40:02,478 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'ka', 'shighe', 'u', 'a', 'mgb@@', 'ôghom', 'je', 'la', '!', '—', 'Rom', '.'] 2020-02-12 21:40:02,478 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 21:40:02,478 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 21:40:02,478 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man ka shighe u a mgbôghom je la ! — Rom . 2020-02-12 21:40:02,478 Example #2 2020-02-12 21:40:02,478 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 21:40:02,478 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 21:40:02,478 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 21:40:02,478 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 21:40:02,478 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 21:40:02,478 Example #3 2020-02-12 21:40:02,478 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 21:40:02,479 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 21:40:02,479 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 21:40:02,479 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 21:40:02,479 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 21:40:02,479 Validation result (greedy) at epoch 71, step 173000: bleu: 28.49, loss: 40381.0352, ppl: 3.9120, duration: 18.1928s 2020-02-12 21:40:12,345 Epoch 71 Step: 173100 Batch Loss: 1.539012 Tokens per Sec: 21999, Lr: 0.000210 2020-02-12 21:40:22,200 Epoch 71 Step: 173200 Batch Loss: 1.469249 Tokens per Sec: 22888, Lr: 0.000210 2020-02-12 21:40:32,063 Epoch 71 Step: 173300 Batch Loss: 1.316316 Tokens per Sec: 22537, Lr: 0.000210 2020-02-12 21:40:41,952 Epoch 71 Step: 173400 Batch Loss: 1.058633 Tokens per Sec: 21707, Lr: 0.000210 2020-02-12 21:40:51,943 Epoch 71 Step: 173500 Batch Loss: 1.452735 Tokens per Sec: 22243, Lr: 0.000210 2020-02-12 21:41:01,866 Epoch 71 Step: 173600 Batch Loss: 1.478271 Tokens per Sec: 22119, Lr: 0.000210 2020-02-12 21:41:11,714 Epoch 71 Step: 173700 Batch Loss: 1.305297 Tokens per Sec: 21938, Lr: 0.000210 2020-02-12 21:41:21,573 Epoch 71 Step: 173800 Batch Loss: 1.453498 Tokens per Sec: 22531, Lr: 0.000210 2020-02-12 21:41:31,473 Epoch 71 Step: 173900 Batch Loss: 1.310819 Tokens per Sec: 22287, Lr: 0.000210 2020-02-12 21:41:41,381 Epoch 71 Step: 174000 Batch Loss: 1.476677 Tokens per Sec: 22879, Lr: 0.000210 2020-02-12 21:42:00,421 Hooray! New best validation result [ppl]! 2020-02-12 21:42:00,421 Saving new checkpoint. 2020-02-12 21:42:00,620 Example #0 2020-02-12 21:42:00,620 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 21:42:00,620 Raw hypothesis: ['Er', 'm@@', 'ser@@', 'akaa', 'u', 'Yehova', 'a', 'ver', 'la', 'a', 'lu', 'u', 'tsan', 'gbem', 'sha', 'won', 'yô', ',', 'doo', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'vesen', 'seer', 'a', 'seer', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 21:42:00,620 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 21:42:00,620 Reference: 10 : ​ 6 - 9 . 2020-02-12 21:42:00,620 Hypothesis: Er mserakaa u Yehova a ver la a lu u tsan gbem sha won yô , doo u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la , shi vea za hemen u lun a dooshima u a lu vesen seer a seer la . — Marku 10 : 6 - 9 . 2020-02-12 21:42:00,620 Example #1 2020-02-12 21:42:00,620 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 21:42:00,620 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 21:42:00,620 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 21:42:00,620 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 21:42:00,621 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-12 21:42:00,621 Example #2 2020-02-12 21:42:00,621 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 21:42:00,621 Raw hypothesis: ['Anyom', 'nga', 'kar', 'pue', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 21:42:00,621 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 21:42:00,621 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 21:42:00,621 Hypothesis: Anyom nga kar pue yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 21:42:00,621 Example #3 2020-02-12 21:42:00,621 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 21:42:00,621 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 21:42:00,621 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 21:42:00,621 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 21:42:00,621 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 21:42:00,621 Validation result (greedy) at epoch 71, step 174000: bleu: 28.97, loss: 40309.5039, ppl: 3.9025, duration: 19.2404s 2020-02-12 21:42:10,694 Epoch 71 Step: 174100 Batch Loss: 1.381948 Tokens per Sec: 22018, Lr: 0.000210 2020-02-12 21:42:20,684 Epoch 71 Step: 174200 Batch Loss: 1.502970 Tokens per Sec: 21835, Lr: 0.000210 2020-02-12 21:42:30,802 Epoch 71 Step: 174300 Batch Loss: 1.162560 Tokens per Sec: 22363, Lr: 0.000210 2020-02-12 21:42:40,801 Epoch 71 Step: 174400 Batch Loss: 1.131786 Tokens per Sec: 22201, Lr: 0.000210 2020-02-12 21:42:50,770 Epoch 71 Step: 174500 Batch Loss: 1.192420 Tokens per Sec: 22214, Lr: 0.000210 2020-02-12 21:42:56,954 Epoch 71: total training loss 3297.80 2020-02-12 21:42:56,954 EPOCH 72 2020-02-12 21:43:01,049 Epoch 72 Step: 174600 Batch Loss: 1.326846 Tokens per Sec: 21358, Lr: 0.000210 2020-02-12 21:43:11,000 Epoch 72 Step: 174700 Batch Loss: 1.642390 Tokens per Sec: 22619, Lr: 0.000210 2020-02-12 21:43:21,045 Epoch 72 Step: 174800 Batch Loss: 1.298363 Tokens per Sec: 21769, Lr: 0.000210 2020-02-12 21:43:31,130 Epoch 72 Step: 174900 Batch Loss: 1.373066 Tokens per Sec: 21830, Lr: 0.000210 2020-02-12 21:43:41,315 Epoch 72 Step: 175000 Batch Loss: 1.351639 Tokens per Sec: 22527, Lr: 0.000210 2020-02-12 21:44:00,909 Example #0 2020-02-12 21:44:00,909 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 21:44:00,909 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsan', 'gbem', 'sha', 'won', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'una', 'fatyô', 'u', 'vesen', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 21:44:00,909 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 21:44:00,909 Reference: 10 : ​ 6 - 9 . 2020-02-12 21:44:00,909 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsan gbem sha won yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la , shi vea za hemen u lun a dooshima u una fatyô u vesen la . — Marku 10 : 6 - 9 . 2020-02-12 21:44:00,909 Example #1 2020-02-12 21:44:00,909 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 21:44:00,909 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'sha', 'kpôô', 'yô', ',', 'ngu', 'ikyua', '!', '—', 'Rom', '.'] 2020-02-12 21:44:00,910 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 21:44:00,910 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 21:44:00,910 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man sha kpôô yô , ngu ikyua ! — Rom . 2020-02-12 21:44:00,910 Example #2 2020-02-12 21:44:00,910 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 21:44:00,910 Raw hypothesis: ['Anyom', 'nga', 'kar', 'pue', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 21:44:00,910 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 21:44:00,910 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 21:44:00,910 Hypothesis: Anyom nga kar pue yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 21:44:00,910 Example #3 2020-02-12 21:44:00,910 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 21:44:00,910 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 21:44:00,910 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 21:44:00,910 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 21:44:00,910 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 21:44:00,910 Validation result (greedy) at epoch 72, step 175000: bleu: 28.55, loss: 40399.0703, ppl: 3.9143, duration: 19.5949s 2020-02-12 21:44:11,070 Epoch 72 Step: 175100 Batch Loss: 1.495386 Tokens per Sec: 21784, Lr: 0.000210 2020-02-12 21:44:21,192 Epoch 72 Step: 175200 Batch Loss: 1.402765 Tokens per Sec: 21802, Lr: 0.000210 2020-02-12 21:44:31,226 Epoch 72 Step: 175300 Batch Loss: 1.395334 Tokens per Sec: 22162, Lr: 0.000210 2020-02-12 21:44:41,101 Epoch 72 Step: 175400 Batch Loss: 1.064630 Tokens per Sec: 22288, Lr: 0.000210 2020-02-12 21:44:51,030 Epoch 72 Step: 175500 Batch Loss: 1.288134 Tokens per Sec: 22433, Lr: 0.000210 2020-02-12 21:45:00,873 Epoch 72 Step: 175600 Batch Loss: 0.982788 Tokens per Sec: 22172, Lr: 0.000210 2020-02-12 21:45:10,765 Epoch 72 Step: 175700 Batch Loss: 1.539751 Tokens per Sec: 22442, Lr: 0.000210 2020-02-12 21:45:20,755 Epoch 72 Step: 175800 Batch Loss: 1.439170 Tokens per Sec: 22132, Lr: 0.000210 2020-02-12 21:45:30,833 Epoch 72 Step: 175900 Batch Loss: 1.477820 Tokens per Sec: 21847, Lr: 0.000210 2020-02-12 21:45:40,920 Epoch 72 Step: 176000 Batch Loss: 1.483829 Tokens per Sec: 21566, Lr: 0.000210 2020-02-12 21:46:00,476 Hooray! New best validation result [ppl]! 2020-02-12 21:46:00,476 Saving new checkpoint. 2020-02-12 21:46:00,667 Example #0 2020-02-12 21:46:00,667 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 21:46:00,667 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsan', 'gbem', 'yô', ',', 'doo', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 21:46:00,668 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 21:46:00,668 Reference: 10 : ​ 6 - 9 . 2020-02-12 21:46:00,668 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsan gbem yô , doo u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la , shi vea za hemen u lun a dooshima u a lu a mi la . — Marku 10 : 6 - 9 . 2020-02-12 21:46:00,668 Example #1 2020-02-12 21:46:00,668 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 21:46:00,668 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 21:46:00,668 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 21:46:00,668 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 21:46:00,668 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung , man kwagh ne mgbôghom ! — Rom . 2020-02-12 21:46:00,668 Example #2 2020-02-12 21:46:00,668 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 21:46:00,668 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 21:46:00,668 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 21:46:00,668 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 21:46:00,669 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 21:46:00,669 Example #3 2020-02-12 21:46:00,669 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 21:46:00,669 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 21:46:00,669 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 21:46:00,669 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 21:46:00,669 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 21:46:00,669 Validation result (greedy) at epoch 72, step 176000: bleu: 28.60, loss: 40274.0742, ppl: 3.8979, duration: 19.7486s 2020-02-12 21:46:10,788 Epoch 72 Step: 176100 Batch Loss: 1.370144 Tokens per Sec: 21528, Lr: 0.000210 2020-02-12 21:46:20,968 Epoch 72 Step: 176200 Batch Loss: 1.523032 Tokens per Sec: 21737, Lr: 0.000210 2020-02-12 21:46:31,047 Epoch 72 Step: 176300 Batch Loss: 1.417220 Tokens per Sec: 22094, Lr: 0.000210 2020-02-12 21:46:41,183 Epoch 72 Step: 176400 Batch Loss: 1.277543 Tokens per Sec: 21559, Lr: 0.000210 2020-02-12 21:46:51,324 Epoch 72 Step: 176500 Batch Loss: 1.470421 Tokens per Sec: 22296, Lr: 0.000210 2020-02-12 21:47:01,446 Epoch 72 Step: 176600 Batch Loss: 1.248100 Tokens per Sec: 21573, Lr: 0.000210 2020-02-12 21:47:11,592 Epoch 72 Step: 176700 Batch Loss: 1.569009 Tokens per Sec: 21779, Lr: 0.000210 2020-02-12 21:47:21,729 Epoch 72 Step: 176800 Batch Loss: 1.354142 Tokens per Sec: 22039, Lr: 0.000210 2020-02-12 21:47:31,711 Epoch 72 Step: 176900 Batch Loss: 1.424743 Tokens per Sec: 22050, Lr: 0.000210 2020-02-12 21:47:41,576 Epoch 72 Step: 177000 Batch Loss: 1.579418 Tokens per Sec: 22359, Lr: 0.000210 2020-02-12 21:48:00,149 Example #0 2020-02-12 21:48:00,150 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 21:48:00,150 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsan', 'gbem', 'sha', 'won', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'sha', 'afatyô', 've', 'cii', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'una', 'fatyô', 'u', 'vesen', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 21:48:00,150 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 21:48:00,150 Reference: 10 : ​ 6 - 9 . 2020-02-12 21:48:00,150 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsan gbem sha won yô , gba hange hange u noov man kasev vea nôngo sha afatyô ve cii vea lu a dooshima u a lu hen atô ve la shi vea za hemen u lun a dooshima u una fatyô u vesen la . — Marku 10 : 6 - 9 . 2020-02-12 21:48:00,150 Example #1 2020-02-12 21:48:00,150 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 21:48:00,150 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 21:48:00,150 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 21:48:00,150 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 21:48:00,150 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-12 21:48:00,150 Example #2 2020-02-12 21:48:00,150 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 21:48:00,151 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 21:48:00,151 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 21:48:00,151 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 21:48:00,151 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 21:48:00,151 Example #3 2020-02-12 21:48:00,151 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 21:48:00,151 Raw hypothesis: ['Alaghga', 'or', 'nan', 'ngu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 21:48:00,151 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 21:48:00,151 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 21:48:00,151 Hypothesis: Alaghga or nan ngu eren kwagh sha gbenda u vough ga . 2020-02-12 21:48:00,151 Validation result (greedy) at epoch 72, step 177000: bleu: 28.58, loss: 40310.0273, ppl: 3.9026, duration: 18.5750s 2020-02-12 21:48:01,964 Epoch 72: total training loss 3291.06 2020-02-12 21:48:01,964 EPOCH 73 2020-02-12 21:48:10,331 Epoch 73 Step: 177100 Batch Loss: 1.290804 Tokens per Sec: 21388, Lr: 0.000210 2020-02-12 21:48:20,409 Epoch 73 Step: 177200 Batch Loss: 1.096773 Tokens per Sec: 22028, Lr: 0.000210 2020-02-12 21:48:30,322 Epoch 73 Step: 177300 Batch Loss: 1.186997 Tokens per Sec: 21622, Lr: 0.000210 2020-02-12 21:48:40,133 Epoch 73 Step: 177400 Batch Loss: 1.131629 Tokens per Sec: 22216, Lr: 0.000210 2020-02-12 21:48:50,179 Epoch 73 Step: 177500 Batch Loss: 1.326504 Tokens per Sec: 22182, Lr: 0.000210 2020-02-12 21:49:00,285 Epoch 73 Step: 177600 Batch Loss: 1.112508 Tokens per Sec: 22474, Lr: 0.000210 2020-02-12 21:49:10,319 Epoch 73 Step: 177700 Batch Loss: 1.171866 Tokens per Sec: 22167, Lr: 0.000210 2020-02-12 21:49:20,330 Epoch 73 Step: 177800 Batch Loss: 1.391367 Tokens per Sec: 21581, Lr: 0.000210 2020-02-12 21:49:30,321 Epoch 73 Step: 177900 Batch Loss: 1.417612 Tokens per Sec: 23150, Lr: 0.000210 2020-02-12 21:49:40,222 Epoch 73 Step: 178000 Batch Loss: 1.408883 Tokens per Sec: 22373, Lr: 0.000210 2020-02-12 21:49:58,824 Hooray! New best validation result [ppl]! 2020-02-12 21:49:58,824 Saving new checkpoint. 2020-02-12 21:49:59,024 Example #0 2020-02-12 21:49:59,024 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 21:49:59,024 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsan', 'gbem', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 21:49:59,024 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 21:49:59,024 Reference: 10 : ​ 6 - 9 . 2020-02-12 21:49:59,024 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsan gbem yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu hen atô ve la , shi vea za hemen u lun a dooshima u a lu a mi la . — Marku 10 : 6 - 9 . 2020-02-12 21:49:59,024 Example #1 2020-02-12 21:49:59,024 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 21:49:59,024 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 21:49:59,025 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 21:49:59,025 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 21:49:59,025 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-12 21:49:59,025 Example #2 2020-02-12 21:49:59,025 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 21:49:59,025 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 21:49:59,025 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 21:49:59,025 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 21:49:59,025 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 21:49:59,025 Example #3 2020-02-12 21:49:59,025 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 21:49:59,025 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 21:49:59,025 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 21:49:59,025 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 21:49:59,025 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 21:49:59,026 Validation result (greedy) at epoch 73, step 178000: bleu: 28.53, loss: 40242.0703, ppl: 3.8936, duration: 18.8034s 2020-02-12 21:50:09,005 Epoch 73 Step: 178100 Batch Loss: 0.970445 Tokens per Sec: 22666, Lr: 0.000210 2020-02-12 21:50:18,985 Epoch 73 Step: 178200 Batch Loss: 0.875879 Tokens per Sec: 22210, Lr: 0.000210 2020-02-12 21:50:28,996 Epoch 73 Step: 178300 Batch Loss: 1.448688 Tokens per Sec: 22541, Lr: 0.000210 2020-02-12 21:50:38,955 Epoch 73 Step: 178400 Batch Loss: 1.257188 Tokens per Sec: 22356, Lr: 0.000210 2020-02-12 21:50:48,910 Epoch 73 Step: 178500 Batch Loss: 1.307566 Tokens per Sec: 22314, Lr: 0.000210 2020-02-12 21:50:58,841 Epoch 73 Step: 178600 Batch Loss: 1.420029 Tokens per Sec: 21793, Lr: 0.000210 2020-02-12 21:51:08,896 Epoch 73 Step: 178700 Batch Loss: 1.284478 Tokens per Sec: 21921, Lr: 0.000210 2020-02-12 21:51:18,795 Epoch 73 Step: 178800 Batch Loss: 1.367725 Tokens per Sec: 22523, Lr: 0.000210 2020-02-12 21:51:28,793 Epoch 73 Step: 178900 Batch Loss: 1.329619 Tokens per Sec: 21648, Lr: 0.000210 2020-02-12 21:51:38,692 Epoch 73 Step: 179000 Batch Loss: 1.241212 Tokens per Sec: 22451, Lr: 0.000210 2020-02-12 21:51:57,187 Example #0 2020-02-12 21:51:57,187 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 21:51:57,187 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsan', 'gbem', 'sha', 'won', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'sha', 'afatyô', 've', 'cii', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'kpaa', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 21:51:57,187 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 21:51:57,187 Reference: 10 : ​ 6 - 9 . 2020-02-12 21:51:57,187 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsan gbem sha won yô , gba hange hange u noov man kasev vea nôngo sha afatyô ve cii vea lu a dooshima u a lu a mi la , shi vea za hemen u lun a dooshima u a lu a mi la kpaa . — Marku 10 : 6 - 9 . 2020-02-12 21:51:57,187 Example #1 2020-02-12 21:51:57,187 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 21:51:57,187 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 21:51:57,188 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 21:51:57,188 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 21:51:57,188 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-12 21:51:57,188 Example #2 2020-02-12 21:51:57,188 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 21:51:57,188 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 21:51:57,188 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 21:51:57,188 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 21:51:57,188 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 21:51:57,188 Example #3 2020-02-12 21:51:57,188 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 21:51:57,188 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 21:51:57,188 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 21:51:57,188 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 21:51:57,188 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 21:51:57,188 Validation result (greedy) at epoch 73, step 179000: bleu: 28.74, loss: 40261.3438, ppl: 3.8962, duration: 18.4959s 2020-02-12 21:52:07,039 Epoch 73 Step: 179100 Batch Loss: 1.370140 Tokens per Sec: 22740, Lr: 0.000210 2020-02-12 21:52:16,839 Epoch 73 Step: 179200 Batch Loss: 1.509214 Tokens per Sec: 22189, Lr: 0.000210 2020-02-12 21:52:26,711 Epoch 73 Step: 179300 Batch Loss: 1.336111 Tokens per Sec: 22128, Lr: 0.000210 2020-02-12 21:52:36,703 Epoch 73 Step: 179400 Batch Loss: 0.997120 Tokens per Sec: 22254, Lr: 0.000210 2020-02-12 21:52:43,888 Epoch 73: total training loss 3283.55 2020-02-12 21:52:43,888 EPOCH 74 2020-02-12 21:52:46,886 Epoch 74 Step: 179500 Batch Loss: 1.443465 Tokens per Sec: 19709, Lr: 0.000210 2020-02-12 21:52:56,981 Epoch 74 Step: 179600 Batch Loss: 1.356739 Tokens per Sec: 21911, Lr: 0.000210 2020-02-12 21:53:07,121 Epoch 74 Step: 179700 Batch Loss: 1.229699 Tokens per Sec: 21599, Lr: 0.000210 2020-02-12 21:53:17,222 Epoch 74 Step: 179800 Batch Loss: 1.248243 Tokens per Sec: 22042, Lr: 0.000210 2020-02-12 21:53:27,263 Epoch 74 Step: 179900 Batch Loss: 1.394512 Tokens per Sec: 21767, Lr: 0.000210 2020-02-12 21:53:37,378 Epoch 74 Step: 180000 Batch Loss: 1.438210 Tokens per Sec: 22130, Lr: 0.000210 2020-02-12 21:53:56,431 Example #0 2020-02-12 21:53:56,431 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 21:53:56,431 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsan', 'gbem', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'sha', 'afatyô', 've', 'cii', 'vea', 'lu', 'a', 'dooshima', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 21:53:56,431 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 21:53:56,431 Reference: 10 : ​ 6 - 9 . 2020-02-12 21:53:56,432 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsan gbem yô , gba hange hange u noov man kasev vea nôngo sha afatyô ve cii vea lu a dooshima shi vea za hemen u lun a dooshima u a lu a mi la . — Marku 10 : 6 - 9 . 2020-02-12 21:53:56,432 Example #1 2020-02-12 21:53:56,432 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 21:53:56,432 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'sha', 'kpôô', 'yô', ',', 'ngu', 'ikyua', '!', '—', 'Rom', '.'] 2020-02-12 21:53:56,432 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 21:53:56,432 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 21:53:56,432 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man sha kpôô yô , ngu ikyua ! — Rom . 2020-02-12 21:53:56,432 Example #2 2020-02-12 21:53:56,432 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 21:53:56,432 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 21:53:56,432 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 21:53:56,432 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 21:53:56,432 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 21:53:56,432 Example #3 2020-02-12 21:53:56,432 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 21:53:56,432 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 21:53:56,433 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 21:53:56,433 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 21:53:56,433 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 21:53:56,433 Validation result (greedy) at epoch 74, step 180000: bleu: 28.84, loss: 40359.4180, ppl: 3.9091, duration: 19.0545s 2020-02-12 21:54:06,290 Epoch 74 Step: 180100 Batch Loss: 1.348423 Tokens per Sec: 22673, Lr: 0.000210 2020-02-12 21:54:16,156 Epoch 74 Step: 180200 Batch Loss: 1.313825 Tokens per Sec: 22633, Lr: 0.000210 2020-02-12 21:54:26,134 Epoch 74 Step: 180300 Batch Loss: 1.403449 Tokens per Sec: 22332, Lr: 0.000210 2020-02-12 21:54:36,154 Epoch 74 Step: 180400 Batch Loss: 1.371209 Tokens per Sec: 21709, Lr: 0.000210 2020-02-12 21:54:46,207 Epoch 74 Step: 180500 Batch Loss: 1.296051 Tokens per Sec: 22144, Lr: 0.000210 2020-02-12 21:54:56,228 Epoch 74 Step: 180600 Batch Loss: 1.409720 Tokens per Sec: 22466, Lr: 0.000210 2020-02-12 21:55:06,136 Epoch 74 Step: 180700 Batch Loss: 1.411106 Tokens per Sec: 21767, Lr: 0.000210 2020-02-12 21:55:16,016 Epoch 74 Step: 180800 Batch Loss: 1.147705 Tokens per Sec: 22434, Lr: 0.000210 2020-02-12 21:55:25,951 Epoch 74 Step: 180900 Batch Loss: 1.230298 Tokens per Sec: 22051, Lr: 0.000210 2020-02-12 21:55:35,917 Epoch 74 Step: 181000 Batch Loss: 1.403406 Tokens per Sec: 22307, Lr: 0.000210 2020-02-12 21:55:54,681 Hooray! New best validation result [ppl]! 2020-02-12 21:55:54,681 Saving new checkpoint. 2020-02-12 21:55:54,870 Example #0 2020-02-12 21:55:54,871 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 21:55:54,871 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 've', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 21:55:54,871 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 21:55:54,871 Reference: 10 : ​ 6 - 9 . 2020-02-12 21:55:54,871 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima ve la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-12 21:55:54,871 Example #1 2020-02-12 21:55:54,871 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 21:55:54,871 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 21:55:54,871 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 21:55:54,871 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 21:55:54,871 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-12 21:55:54,871 Example #2 2020-02-12 21:55:54,871 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 21:55:54,871 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 21:55:54,872 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 21:55:54,872 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 21:55:54,872 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 21:55:54,872 Example #3 2020-02-12 21:55:54,872 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 21:55:54,872 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 21:55:54,872 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 21:55:54,872 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 21:55:54,872 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 21:55:54,872 Validation result (greedy) at epoch 74, step 181000: bleu: 28.94, loss: 40174.2930, ppl: 3.8847, duration: 18.9544s 2020-02-12 21:56:04,796 Epoch 74 Step: 181100 Batch Loss: 1.310659 Tokens per Sec: 22470, Lr: 0.000210 2020-02-12 21:56:14,671 Epoch 74 Step: 181200 Batch Loss: 1.433760 Tokens per Sec: 22555, Lr: 0.000210 2020-02-12 21:56:24,615 Epoch 74 Step: 181300 Batch Loss: 1.478117 Tokens per Sec: 22196, Lr: 0.000210 2020-02-12 21:56:34,589 Epoch 74 Step: 181400 Batch Loss: 1.358089 Tokens per Sec: 21987, Lr: 0.000210 2020-02-12 21:56:44,644 Epoch 74 Step: 181500 Batch Loss: 1.335381 Tokens per Sec: 21830, Lr: 0.000210 2020-02-12 21:56:54,604 Epoch 74 Step: 181600 Batch Loss: 1.050572 Tokens per Sec: 21909, Lr: 0.000210 2020-02-12 21:57:04,521 Epoch 74 Step: 181700 Batch Loss: 1.450635 Tokens per Sec: 22199, Lr: 0.000210 2020-02-12 21:57:14,421 Epoch 74 Step: 181800 Batch Loss: 1.270636 Tokens per Sec: 22446, Lr: 0.000210 2020-02-12 21:57:24,514 Epoch 74 Step: 181900 Batch Loss: 1.329844 Tokens per Sec: 21140, Lr: 0.000210 2020-02-12 21:57:28,129 Epoch 74: total training loss 3288.40 2020-02-12 21:57:28,130 EPOCH 75 2020-02-12 21:57:34,859 Epoch 75 Step: 182000 Batch Loss: 1.068082 Tokens per Sec: 21965, Lr: 0.000210 2020-02-12 21:57:54,208 Example #0 2020-02-12 21:57:54,208 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 21:57:54,208 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'doo', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 21:57:54,208 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 21:57:54,208 Reference: 10 : ​ 6 - 9 . 2020-02-12 21:57:54,208 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , doo u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la , shi vea za hemen u lun a dooshima u a lu a mi la . — Marku 10 : 6 - 9 . 2020-02-12 21:57:54,208 Example #1 2020-02-12 21:57:54,208 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 21:57:54,208 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 21:57:54,208 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 21:57:54,209 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 21:57:54,209 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-12 21:57:54,209 Example #2 2020-02-12 21:57:54,209 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 21:57:54,209 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 21:57:54,209 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 21:57:54,209 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 21:57:54,209 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 21:57:54,209 Example #3 2020-02-12 21:57:54,209 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 21:57:54,209 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 21:57:54,209 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 21:57:54,209 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 21:57:54,209 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 21:57:54,209 Validation result (greedy) at epoch 75, step 182000: bleu: 28.79, loss: 40188.2930, ppl: 3.8866, duration: 19.3496s 2020-02-12 21:58:04,245 Epoch 75 Step: 182100 Batch Loss: 1.564196 Tokens per Sec: 21964, Lr: 0.000210 2020-02-12 21:58:14,118 Epoch 75 Step: 182200 Batch Loss: 1.243045 Tokens per Sec: 21577, Lr: 0.000210 2020-02-12 21:58:24,021 Epoch 75 Step: 182300 Batch Loss: 1.285904 Tokens per Sec: 22162, Lr: 0.000210 2020-02-12 21:58:33,905 Epoch 75 Step: 182400 Batch Loss: 1.388557 Tokens per Sec: 22112, Lr: 0.000210 2020-02-12 21:58:43,898 Epoch 75 Step: 182500 Batch Loss: 1.431651 Tokens per Sec: 22171, Lr: 0.000210 2020-02-12 21:58:53,927 Epoch 75 Step: 182600 Batch Loss: 1.324148 Tokens per Sec: 21885, Lr: 0.000210 2020-02-12 21:59:03,870 Epoch 75 Step: 182700 Batch Loss: 1.367236 Tokens per Sec: 22284, Lr: 0.000210 2020-02-12 21:59:13,926 Epoch 75 Step: 182800 Batch Loss: 1.419717 Tokens per Sec: 22347, Lr: 0.000210 2020-02-12 21:59:23,774 Epoch 75 Step: 182900 Batch Loss: 1.262545 Tokens per Sec: 22142, Lr: 0.000210 2020-02-12 21:59:33,647 Epoch 75 Step: 183000 Batch Loss: 1.173699 Tokens per Sec: 21856, Lr: 0.000210 2020-02-12 21:59:52,744 Example #0 2020-02-12 21:59:52,744 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 21:59:52,744 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'doo', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 've', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'kpaa', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 21:59:52,744 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 21:59:52,745 Reference: 10 : ​ 6 - 9 . 2020-02-12 21:59:52,745 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , doo u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u ve lu a mi la , shi vea za hemen u lun a dooshima u a lu a mi la kpaa . — Marku 10 : 6 - 9 . 2020-02-12 21:59:52,745 Example #1 2020-02-12 21:59:52,745 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 21:59:52,745 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 21:59:52,745 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 21:59:52,745 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 21:59:52,745 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-12 21:59:52,745 Example #2 2020-02-12 21:59:52,745 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 21:59:52,745 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 21:59:52,745 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 21:59:52,745 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 21:59:52,746 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 21:59:52,746 Example #3 2020-02-12 21:59:52,746 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 21:59:52,746 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 21:59:52,746 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 21:59:52,746 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 21:59:52,746 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 21:59:52,746 Validation result (greedy) at epoch 75, step 183000: bleu: 28.89, loss: 40179.2227, ppl: 3.8854, duration: 19.0983s 2020-02-12 22:00:02,680 Epoch 75 Step: 183100 Batch Loss: 1.301357 Tokens per Sec: 21978, Lr: 0.000210 2020-02-12 22:00:12,608 Epoch 75 Step: 183200 Batch Loss: 1.467333 Tokens per Sec: 22964, Lr: 0.000210 2020-02-12 22:00:22,595 Epoch 75 Step: 183300 Batch Loss: 1.248253 Tokens per Sec: 21540, Lr: 0.000210 2020-02-12 22:00:32,474 Epoch 75 Step: 183400 Batch Loss: 1.418509 Tokens per Sec: 22775, Lr: 0.000210 2020-02-12 22:00:42,382 Epoch 75 Step: 183500 Batch Loss: 1.276913 Tokens per Sec: 22617, Lr: 0.000210 2020-02-12 22:00:52,580 Epoch 75 Step: 183600 Batch Loss: 1.249991 Tokens per Sec: 22177, Lr: 0.000210 2020-02-12 22:01:02,671 Epoch 75 Step: 183700 Batch Loss: 1.468914 Tokens per Sec: 21903, Lr: 0.000210 2020-02-12 22:01:12,685 Epoch 75 Step: 183800 Batch Loss: 1.209389 Tokens per Sec: 22106, Lr: 0.000210 2020-02-12 22:01:22,587 Epoch 75 Step: 183900 Batch Loss: 1.277516 Tokens per Sec: 22512, Lr: 0.000210 2020-02-12 22:01:32,471 Epoch 75 Step: 184000 Batch Loss: 1.267258 Tokens per Sec: 21911, Lr: 0.000210 2020-02-12 22:01:51,370 Hooray! New best validation result [ppl]! 2020-02-12 22:01:51,370 Saving new checkpoint. 2020-02-12 22:01:51,558 Example #0 2020-02-12 22:01:51,558 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 22:01:51,558 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'vesen', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'sha', 'afatyô', 've', 'cii', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 22:01:51,558 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 22:01:51,558 Reference: 10 : ​ 6 - 9 . 2020-02-12 22:01:51,558 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u vesen yô , gba hange hange u noov man kasev vea nôngo sha afatyô ve cii vea lu a dooshima u a lu a mi la , shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-12 22:01:51,558 Example #1 2020-02-12 22:01:51,559 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 22:01:51,559 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 22:01:51,559 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 22:01:51,559 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 22:01:51,559 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-12 22:01:51,559 Example #2 2020-02-12 22:01:51,559 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 22:01:51,559 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 22:01:51,559 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 22:01:51,559 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 22:01:51,559 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 22:01:51,559 Example #3 2020-02-12 22:01:51,559 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 22:01:51,559 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 22:01:51,559 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 22:01:51,559 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 22:01:51,560 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 22:01:51,560 Validation result (greedy) at epoch 75, step 184000: bleu: 29.11, loss: 40014.6367, ppl: 3.8638, duration: 19.0883s 2020-02-12 22:02:01,409 Epoch 75 Step: 184100 Batch Loss: 0.832209 Tokens per Sec: 22438, Lr: 0.000210 2020-02-12 22:02:11,362 Epoch 75 Step: 184200 Batch Loss: 1.098936 Tokens per Sec: 22460, Lr: 0.000210 2020-02-12 22:02:21,218 Epoch 75 Step: 184300 Batch Loss: 1.274939 Tokens per Sec: 22656, Lr: 0.000210 2020-02-12 22:02:30,483 Epoch 75: total training loss 3277.38 2020-02-12 22:02:30,484 EPOCH 76 2020-02-12 22:02:31,351 Epoch 76 Step: 184400 Batch Loss: 1.064154 Tokens per Sec: 14428, Lr: 0.000210 2020-02-12 22:02:41,188 Epoch 76 Step: 184500 Batch Loss: 1.304384 Tokens per Sec: 22313, Lr: 0.000210 2020-02-12 22:02:51,105 Epoch 76 Step: 184600 Batch Loss: 1.430300 Tokens per Sec: 22332, Lr: 0.000210 2020-02-12 22:03:01,072 Epoch 76 Step: 184700 Batch Loss: 1.465067 Tokens per Sec: 21449, Lr: 0.000210 2020-02-12 22:03:10,957 Epoch 76 Step: 184800 Batch Loss: 1.296826 Tokens per Sec: 22183, Lr: 0.000210 2020-02-12 22:03:20,947 Epoch 76 Step: 184900 Batch Loss: 1.470949 Tokens per Sec: 22153, Lr: 0.000210 2020-02-12 22:03:31,076 Epoch 76 Step: 185000 Batch Loss: 1.365831 Tokens per Sec: 21810, Lr: 0.000210 2020-02-12 22:03:49,808 Example #0 2020-02-12 22:03:49,808 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 22:03:49,808 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'tsung', 'vea', 'lu', 'a', 'dooshima', 'u', 'mimi', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 22:03:49,808 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 22:03:49,808 Reference: 10 : ​ 6 - 9 . 2020-02-12 22:03:49,808 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo tsung vea lu a dooshima u mimi shi vea za hemen u lun a dooshima u a lu a mi la . — Marku 10 : 6 - 9 . 2020-02-12 22:03:49,808 Example #1 2020-02-12 22:03:49,808 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 22:03:49,808 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'a', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 22:03:49,808 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 22:03:49,808 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 22:03:49,808 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man a mgbôghom ! — Rom . 2020-02-12 22:03:49,808 Example #2 2020-02-12 22:03:49,808 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 22:03:49,809 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 22:03:49,809 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 22:03:49,809 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 22:03:49,809 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 22:03:49,809 Example #3 2020-02-12 22:03:49,809 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 22:03:49,809 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 22:03:49,809 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 22:03:49,809 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 22:03:49,809 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 22:03:49,809 Validation result (greedy) at epoch 76, step 185000: bleu: 29.14, loss: 40172.4766, ppl: 3.8845, duration: 18.7328s 2020-02-12 22:03:59,668 Epoch 76 Step: 185100 Batch Loss: 1.475938 Tokens per Sec: 22710, Lr: 0.000210 2020-02-12 22:04:09,559 Epoch 76 Step: 185200 Batch Loss: 1.414277 Tokens per Sec: 21785, Lr: 0.000210 2020-02-12 22:04:19,525 Epoch 76 Step: 185300 Batch Loss: 1.234390 Tokens per Sec: 21864, Lr: 0.000210 2020-02-12 22:04:29,667 Epoch 76 Step: 185400 Batch Loss: 0.951648 Tokens per Sec: 21566, Lr: 0.000210 2020-02-12 22:04:39,907 Epoch 76 Step: 185500 Batch Loss: 1.135920 Tokens per Sec: 22160, Lr: 0.000210 2020-02-12 22:04:50,075 Epoch 76 Step: 185600 Batch Loss: 1.225176 Tokens per Sec: 22122, Lr: 0.000210 2020-02-12 22:05:00,248 Epoch 76 Step: 185700 Batch Loss: 1.441816 Tokens per Sec: 21982, Lr: 0.000210 2020-02-12 22:05:10,213 Epoch 76 Step: 185800 Batch Loss: 1.533041 Tokens per Sec: 21492, Lr: 0.000210 2020-02-12 22:05:20,151 Epoch 76 Step: 185900 Batch Loss: 1.325668 Tokens per Sec: 22588, Lr: 0.000210 2020-02-12 22:05:30,092 Epoch 76 Step: 186000 Batch Loss: 1.440320 Tokens per Sec: 22201, Lr: 0.000210 2020-02-12 22:05:49,440 Hooray! New best validation result [ppl]! 2020-02-12 22:05:49,440 Saving new checkpoint. 2020-02-12 22:05:49,632 Example #0 2020-02-12 22:05:49,632 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 22:05:49,632 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 22:05:49,632 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 22:05:49,632 Reference: 10 : ​ 6 - 9 . 2020-02-12 22:05:49,632 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la , shi vea za hemen u lun a dooshima u a lu a mi la . — Marku 10 : 6 - 9 . 2020-02-12 22:05:49,632 Example #1 2020-02-12 22:05:49,632 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 22:05:49,632 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 22:05:49,632 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 22:05:49,632 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 22:05:49,632 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-12 22:05:49,632 Example #2 2020-02-12 22:05:49,633 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 22:05:49,633 Raw hypothesis: ['Anyom', 'nga', 'kar', 'pue', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 22:05:49,633 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 22:05:49,633 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 22:05:49,633 Hypothesis: Anyom nga kar pue yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 22:05:49,633 Example #3 2020-02-12 22:05:49,633 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 22:05:49,633 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 22:05:49,633 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 22:05:49,633 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 22:05:49,633 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 22:05:49,633 Validation result (greedy) at epoch 76, step 186000: bleu: 29.34, loss: 40009.5938, ppl: 3.8632, duration: 19.5403s 2020-02-12 22:05:59,789 Epoch 76 Step: 186100 Batch Loss: 1.205059 Tokens per Sec: 22256, Lr: 0.000210 2020-02-12 22:06:09,896 Epoch 76 Step: 186200 Batch Loss: 1.312337 Tokens per Sec: 21246, Lr: 0.000210 2020-02-12 22:06:19,969 Epoch 76 Step: 186300 Batch Loss: 1.315791 Tokens per Sec: 22498, Lr: 0.000210 2020-02-12 22:06:29,871 Epoch 76 Step: 186400 Batch Loss: 1.365342 Tokens per Sec: 22193, Lr: 0.000210 2020-02-12 22:06:39,798 Epoch 76 Step: 186500 Batch Loss: 1.381277 Tokens per Sec: 21900, Lr: 0.000210 2020-02-12 22:06:49,765 Epoch 76 Step: 186600 Batch Loss: 1.380144 Tokens per Sec: 22228, Lr: 0.000210 2020-02-12 22:06:59,685 Epoch 76 Step: 186700 Batch Loss: 1.482137 Tokens per Sec: 23002, Lr: 0.000210 2020-02-12 22:07:09,835 Epoch 76 Step: 186800 Batch Loss: 1.371845 Tokens per Sec: 21509, Lr: 0.000210 2020-02-12 22:07:15,470 Epoch 76: total training loss 3275.13 2020-02-12 22:07:15,471 EPOCH 77 2020-02-12 22:07:20,099 Epoch 77 Step: 186900 Batch Loss: 1.142691 Tokens per Sec: 20599, Lr: 0.000210 2020-02-12 22:07:29,948 Epoch 77 Step: 187000 Batch Loss: 1.318364 Tokens per Sec: 22361, Lr: 0.000210 2020-02-12 22:07:48,736 Example #0 2020-02-12 22:07:48,736 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 22:07:48,736 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'sha', 'afatyô', 've', 'cii', 'vea', 'lu', 'a', 'dooshima', 'u', 'mimi', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'sha', 'gbenda', 'u', 'dooshima', 'una', 'seer', 'taver', 'yô', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 22:07:48,737 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 22:07:48,737 Reference: 10 : ​ 6 - 9 . 2020-02-12 22:07:48,737 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo sha afatyô ve cii vea lu a dooshima u mimi shi vea za hemen u lun a dooshima sha gbenda u dooshima una seer taver yô . — Marku 10 : 6 - 9 . 2020-02-12 22:07:48,737 Example #1 2020-02-12 22:07:48,737 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 22:07:48,737 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 22:07:48,737 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 22:07:48,737 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 22:07:48,737 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-12 22:07:48,737 Example #2 2020-02-12 22:07:48,737 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 22:07:48,737 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 22:07:48,737 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 22:07:48,738 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 22:07:48,738 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 22:07:48,738 Example #3 2020-02-12 22:07:48,738 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 22:07:48,738 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 22:07:48,738 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 22:07:48,738 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 22:07:48,738 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga yô . 2020-02-12 22:07:48,738 Validation result (greedy) at epoch 77, step 187000: bleu: 29.27, loss: 40115.8477, ppl: 3.8771, duration: 18.7895s 2020-02-12 22:07:58,673 Epoch 77 Step: 187100 Batch Loss: 1.245976 Tokens per Sec: 22697, Lr: 0.000210 2020-02-12 22:08:08,568 Epoch 77 Step: 187200 Batch Loss: 0.939971 Tokens per Sec: 21675, Lr: 0.000210 2020-02-12 22:08:18,494 Epoch 77 Step: 187300 Batch Loss: 1.310515 Tokens per Sec: 22299, Lr: 0.000210 2020-02-12 22:08:28,577 Epoch 77 Step: 187400 Batch Loss: 1.265900 Tokens per Sec: 22486, Lr: 0.000210 2020-02-12 22:08:38,667 Epoch 77 Step: 187500 Batch Loss: 1.422466 Tokens per Sec: 21872, Lr: 0.000210 2020-02-12 22:08:48,811 Epoch 77 Step: 187600 Batch Loss: 1.188255 Tokens per Sec: 21410, Lr: 0.000210 2020-02-12 22:08:58,922 Epoch 77 Step: 187700 Batch Loss: 1.419114 Tokens per Sec: 21631, Lr: 0.000210 2020-02-12 22:09:08,943 Epoch 77 Step: 187800 Batch Loss: 1.392533 Tokens per Sec: 21861, Lr: 0.000210 2020-02-12 22:09:19,001 Epoch 77 Step: 187900 Batch Loss: 1.301873 Tokens per Sec: 22313, Lr: 0.000210 2020-02-12 22:09:29,147 Epoch 77 Step: 188000 Batch Loss: 1.437781 Tokens per Sec: 21704, Lr: 0.000210 2020-02-12 22:09:48,924 Example #0 2020-02-12 22:09:48,924 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 22:09:48,924 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'sha', 'afatyô', 've', 'cii', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'vesen', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 22:09:48,924 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 22:09:48,924 Reference: 10 : ​ 6 - 9 . 2020-02-12 22:09:48,924 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo sha afatyô ve cii vea lu a dooshima u a lu a mi la , shi vea za hemen u lun a dooshima u a lu vesen la . — Marku 10 : 6 - 9 . 2020-02-12 22:09:48,924 Example #1 2020-02-12 22:09:48,924 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 22:09:48,924 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 22:09:48,925 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 22:09:48,925 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 22:09:48,925 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-12 22:09:48,925 Example #2 2020-02-12 22:09:48,925 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 22:09:48,925 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 22:09:48,925 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 22:09:48,925 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 22:09:48,925 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 22:09:48,925 Example #3 2020-02-12 22:09:48,925 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 22:09:48,925 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 22:09:48,925 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 22:09:48,925 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 22:09:48,925 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 22:09:48,926 Validation result (greedy) at epoch 77, step 188000: bleu: 29.10, loss: 40050.4180, ppl: 3.8685, duration: 19.7781s 2020-02-12 22:09:58,980 Epoch 77 Step: 188100 Batch Loss: 1.425758 Tokens per Sec: 21821, Lr: 0.000210 2020-02-12 22:10:09,119 Epoch 77 Step: 188200 Batch Loss: 1.320297 Tokens per Sec: 22229, Lr: 0.000210 2020-02-12 22:10:19,188 Epoch 77 Step: 188300 Batch Loss: 1.356252 Tokens per Sec: 22582, Lr: 0.000210 2020-02-12 22:10:29,263 Epoch 77 Step: 188400 Batch Loss: 1.439954 Tokens per Sec: 22244, Lr: 0.000210 2020-02-12 22:10:39,187 Epoch 77 Step: 188500 Batch Loss: 1.390052 Tokens per Sec: 22935, Lr: 0.000210 2020-02-12 22:10:49,245 Epoch 77 Step: 188600 Batch Loss: 1.329103 Tokens per Sec: 21903, Lr: 0.000210 2020-02-12 22:10:59,319 Epoch 77 Step: 188700 Batch Loss: 1.414356 Tokens per Sec: 21691, Lr: 0.000210 2020-02-12 22:11:09,205 Epoch 77 Step: 188800 Batch Loss: 1.190009 Tokens per Sec: 22300, Lr: 0.000210 2020-02-12 22:11:19,228 Epoch 77 Step: 188900 Batch Loss: 1.319229 Tokens per Sec: 22395, Lr: 0.000210 2020-02-12 22:11:29,153 Epoch 77 Step: 189000 Batch Loss: 1.467926 Tokens per Sec: 21982, Lr: 0.000210 2020-02-12 22:11:47,817 Example #0 2020-02-12 22:11:47,818 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 22:11:47,818 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 22:11:47,818 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 22:11:47,818 Reference: 10 : ​ 6 - 9 . 2020-02-12 22:11:47,818 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la , shi vea za hemen u lun a dooshima u a lu a mi la . — Marku 10 : 6 - 9 . 2020-02-12 22:11:47,818 Example #1 2020-02-12 22:11:47,818 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 22:11:47,818 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 22:11:47,818 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 22:11:47,818 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 22:11:47,818 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-12 22:11:47,818 Example #2 2020-02-12 22:11:47,818 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 22:11:47,818 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'gar', 'u', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', '.'] 2020-02-12 22:11:47,819 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 22:11:47,819 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 22:11:47,819 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken gar u Masedonia man Timoteu . 2020-02-12 22:11:47,819 Example #3 2020-02-12 22:11:47,819 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 22:11:47,819 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', ',', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'inja', '.'] 2020-02-12 22:11:47,819 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 22:11:47,819 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 22:11:47,819 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô , nana lu eren kwagh sha inja . 2020-02-12 22:11:47,819 Validation result (greedy) at epoch 77, step 189000: bleu: 28.98, loss: 40070.1016, ppl: 3.8711, duration: 18.6659s 2020-02-12 22:11:57,733 Epoch 77 Step: 189100 Batch Loss: 1.436391 Tokens per Sec: 21776, Lr: 0.000210 2020-02-12 22:12:07,635 Epoch 77 Step: 189200 Batch Loss: 1.365894 Tokens per Sec: 22447, Lr: 0.000210 2020-02-12 22:12:17,618 Epoch 77 Step: 189300 Batch Loss: 1.220534 Tokens per Sec: 22289, Lr: 0.000210 2020-02-12 22:12:18,735 Epoch 77: total training loss 3261.57 2020-02-12 22:12:18,735 EPOCH 78 2020-02-12 22:12:28,063 Epoch 78 Step: 189400 Batch Loss: 1.516106 Tokens per Sec: 21442, Lr: 0.000210 2020-02-12 22:12:38,159 Epoch 78 Step: 189500 Batch Loss: 1.371355 Tokens per Sec: 22217, Lr: 0.000210 2020-02-12 22:12:48,293 Epoch 78 Step: 189600 Batch Loss: 1.368938 Tokens per Sec: 21963, Lr: 0.000210 2020-02-12 22:12:58,366 Epoch 78 Step: 189700 Batch Loss: 1.120776 Tokens per Sec: 21837, Lr: 0.000210 2020-02-12 22:13:08,503 Epoch 78 Step: 189800 Batch Loss: 1.444989 Tokens per Sec: 21421, Lr: 0.000210 2020-02-12 22:13:18,595 Epoch 78 Step: 189900 Batch Loss: 1.399216 Tokens per Sec: 22155, Lr: 0.000210 2020-02-12 22:13:28,778 Epoch 78 Step: 190000 Batch Loss: 1.479170 Tokens per Sec: 21330, Lr: 0.000210 2020-02-12 22:13:47,969 Hooray! New best validation result [ppl]! 2020-02-12 22:13:47,969 Saving new checkpoint. 2020-02-12 22:13:48,158 Example #0 2020-02-12 22:13:48,158 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 22:13:48,159 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'sha', 'afatyô', 've', 'cii', 'vea', 'lu', 'a', 'dooshima', 've', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'vesen', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 22:13:48,159 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 22:13:48,159 Reference: 10 : ​ 6 - 9 . 2020-02-12 22:13:48,159 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo sha afatyô ve cii vea lu a dooshima ve shi vea za hemen u lun a dooshima u a lu vesen la . — Marku 10 : 6 - 9 . 2020-02-12 22:13:48,159 Example #1 2020-02-12 22:13:48,159 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 22:13:48,159 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 22:13:48,159 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 22:13:48,159 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 22:13:48,159 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-12 22:13:48,159 Example #2 2020-02-12 22:13:48,159 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 22:13:48,159 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'gar', 'u', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', '.'] 2020-02-12 22:13:48,160 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 22:13:48,160 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 22:13:48,160 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken gar u Masedonia man Timoteu . 2020-02-12 22:13:48,160 Example #3 2020-02-12 22:13:48,160 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 22:13:48,160 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 22:13:48,160 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 22:13:48,160 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 22:13:48,160 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 22:13:48,160 Validation result (greedy) at epoch 78, step 190000: bleu: 29.05, loss: 40000.0547, ppl: 3.8619, duration: 19.3812s 2020-02-12 22:13:58,188 Epoch 78 Step: 190100 Batch Loss: 1.312605 Tokens per Sec: 21937, Lr: 0.000210 2020-02-12 22:14:08,108 Epoch 78 Step: 190200 Batch Loss: 1.068762 Tokens per Sec: 22042, Lr: 0.000210 2020-02-12 22:14:18,031 Epoch 78 Step: 190300 Batch Loss: 1.340532 Tokens per Sec: 22237, Lr: 0.000210 2020-02-12 22:14:27,934 Epoch 78 Step: 190400 Batch Loss: 1.688103 Tokens per Sec: 22146, Lr: 0.000210 2020-02-12 22:14:37,795 Epoch 78 Step: 190500 Batch Loss: 1.666166 Tokens per Sec: 21870, Lr: 0.000210 2020-02-12 22:14:47,718 Epoch 78 Step: 190600 Batch Loss: 1.521236 Tokens per Sec: 22148, Lr: 0.000210 2020-02-12 22:14:57,662 Epoch 78 Step: 190700 Batch Loss: 1.310222 Tokens per Sec: 22069, Lr: 0.000210 2020-02-12 22:15:07,799 Epoch 78 Step: 190800 Batch Loss: 1.501189 Tokens per Sec: 21818, Lr: 0.000210 2020-02-12 22:15:17,890 Epoch 78 Step: 190900 Batch Loss: 1.039064 Tokens per Sec: 22130, Lr: 0.000210 2020-02-12 22:15:28,013 Epoch 78 Step: 191000 Batch Loss: 1.443325 Tokens per Sec: 22781, Lr: 0.000210 2020-02-12 22:15:47,852 Example #0 2020-02-12 22:15:47,852 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 22:15:47,853 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'vesen', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'sha', 'afatyô', 've', 'cii', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'vesen', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 22:15:47,853 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 22:15:47,853 Reference: 10 : ​ 6 - 9 . 2020-02-12 22:15:47,853 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u vesen yô , gba hange hange u noov man kasev vea nôngo sha afatyô ve cii vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu vesen la . — Marku 10 : 6 - 9 . 2020-02-12 22:15:47,853 Example #1 2020-02-12 22:15:47,853 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 22:15:47,853 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'imba', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 22:15:47,853 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 22:15:47,853 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 22:15:47,853 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a imba shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-12 22:15:47,853 Example #2 2020-02-12 22:15:47,854 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 22:15:47,854 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 22:15:47,854 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 22:15:47,854 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 22:15:47,854 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 22:15:47,854 Example #3 2020-02-12 22:15:47,854 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 22:15:47,854 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 22:15:47,854 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 22:15:47,854 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 22:15:47,854 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 22:15:47,854 Validation result (greedy) at epoch 78, step 191000: bleu: 29.10, loss: 40065.0039, ppl: 3.8704, duration: 19.8408s 2020-02-12 22:15:57,766 Epoch 78 Step: 191100 Batch Loss: 1.439474 Tokens per Sec: 22099, Lr: 0.000210 2020-02-12 22:16:07,715 Epoch 78 Step: 191200 Batch Loss: 1.411106 Tokens per Sec: 22171, Lr: 0.000210 2020-02-12 22:16:17,570 Epoch 78 Step: 191300 Batch Loss: 1.237044 Tokens per Sec: 22387, Lr: 0.000210 2020-02-12 22:16:27,440 Epoch 78 Step: 191400 Batch Loss: 1.249317 Tokens per Sec: 22054, Lr: 0.000210 2020-02-12 22:16:37,304 Epoch 78 Step: 191500 Batch Loss: 1.344835 Tokens per Sec: 22678, Lr: 0.000210 2020-02-12 22:16:47,210 Epoch 78 Step: 191600 Batch Loss: 1.570621 Tokens per Sec: 21480, Lr: 0.000210 2020-02-12 22:16:57,126 Epoch 78 Step: 191700 Batch Loss: 1.440137 Tokens per Sec: 22409, Lr: 0.000210 2020-02-12 22:17:04,501 Epoch 78: total training loss 3267.91 2020-02-12 22:17:04,502 EPOCH 79 2020-02-12 22:17:07,399 Epoch 79 Step: 191800 Batch Loss: 0.922952 Tokens per Sec: 20063, Lr: 0.000210 2020-02-12 22:17:17,300 Epoch 79 Step: 191900 Batch Loss: 1.119173 Tokens per Sec: 22621, Lr: 0.000210 2020-02-12 22:17:27,183 Epoch 79 Step: 192000 Batch Loss: 1.267792 Tokens per Sec: 22532, Lr: 0.000210 2020-02-12 22:17:46,219 Example #0 2020-02-12 22:17:46,219 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 22:17:46,219 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsan', 'gbem', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 22:17:46,219 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 22:17:46,219 Reference: 10 : ​ 6 - 9 . 2020-02-12 22:17:46,219 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsan gbem yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la , shi vea za hemen u lun a dooshima u a lu a mi la . — Marku 10 : 6 - 9 . 2020-02-12 22:17:46,219 Example #1 2020-02-12 22:17:46,220 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 22:17:46,220 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'sha', 'kpôô', 'yô', ',', 'a', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 22:17:46,220 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 22:17:46,220 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 22:17:46,220 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man sha kpôô yô , a mgbôghom ! — Rom . 2020-02-12 22:17:46,220 Example #2 2020-02-12 22:17:46,220 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 22:17:46,220 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 22:17:46,220 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 22:17:46,220 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 22:17:46,220 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 22:17:46,220 Example #3 2020-02-12 22:17:46,220 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 22:17:46,220 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 22:17:46,220 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 22:17:46,221 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 22:17:46,221 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 22:17:46,221 Validation result (greedy) at epoch 79, step 192000: bleu: 29.32, loss: 40046.8164, ppl: 3.8680, duration: 19.0369s 2020-02-12 22:17:56,139 Epoch 79 Step: 192100 Batch Loss: 1.345381 Tokens per Sec: 22214, Lr: 0.000210 2020-02-12 22:18:06,029 Epoch 79 Step: 192200 Batch Loss: 1.358271 Tokens per Sec: 22148, Lr: 0.000210 2020-02-12 22:18:15,955 Epoch 79 Step: 192300 Batch Loss: 1.248698 Tokens per Sec: 22610, Lr: 0.000210 2020-02-12 22:18:26,047 Epoch 79 Step: 192400 Batch Loss: 1.362171 Tokens per Sec: 21846, Lr: 0.000210 2020-02-12 22:18:36,052 Epoch 79 Step: 192500 Batch Loss: 1.170787 Tokens per Sec: 22069, Lr: 0.000210 2020-02-12 22:18:46,032 Epoch 79 Step: 192600 Batch Loss: 1.458166 Tokens per Sec: 22488, Lr: 0.000210 2020-02-12 22:18:56,044 Epoch 79 Step: 192700 Batch Loss: 1.392718 Tokens per Sec: 22239, Lr: 0.000210 2020-02-12 22:19:06,135 Epoch 79 Step: 192800 Batch Loss: 1.379237 Tokens per Sec: 21922, Lr: 0.000210 2020-02-12 22:19:16,061 Epoch 79 Step: 192900 Batch Loss: 1.471044 Tokens per Sec: 22437, Lr: 0.000210 2020-02-12 22:19:26,114 Epoch 79 Step: 193000 Batch Loss: 1.360763 Tokens per Sec: 22297, Lr: 0.000210 2020-02-12 22:19:46,166 Example #0 2020-02-12 22:19:46,167 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 22:19:46,167 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'vesen', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'sha', 'afatyô', 've', 'cii', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 22:19:46,167 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 22:19:46,167 Reference: 10 : ​ 6 - 9 . 2020-02-12 22:19:46,167 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u vesen yô , gba hange hange u noov man kasev vea nôngo sha afatyô ve cii vea lu a dooshima u a lu a mi la , shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-12 22:19:46,167 Example #1 2020-02-12 22:19:46,167 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 22:19:46,167 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 22:19:46,167 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 22:19:46,167 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 22:19:46,167 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-12 22:19:46,167 Example #2 2020-02-12 22:19:46,167 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 22:19:46,168 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 22:19:46,168 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 22:19:46,168 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 22:19:46,168 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 22:19:46,168 Example #3 2020-02-12 22:19:46,168 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 22:19:46,168 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 22:19:46,168 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 22:19:46,168 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 22:19:46,168 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 22:19:46,168 Validation result (greedy) at epoch 79, step 193000: bleu: 28.73, loss: 40107.0156, ppl: 3.8759, duration: 20.0532s 2020-02-12 22:19:56,295 Epoch 79 Step: 193100 Batch Loss: 1.235852 Tokens per Sec: 21613, Lr: 0.000210 2020-02-12 22:20:06,444 Epoch 79 Step: 193200 Batch Loss: 1.318078 Tokens per Sec: 21779, Lr: 0.000210 2020-02-12 22:20:16,627 Epoch 79 Step: 193300 Batch Loss: 1.238468 Tokens per Sec: 21634, Lr: 0.000210 2020-02-12 22:20:26,799 Epoch 79 Step: 193400 Batch Loss: 1.661313 Tokens per Sec: 21998, Lr: 0.000210 2020-02-12 22:20:36,688 Epoch 79 Step: 193500 Batch Loss: 1.368488 Tokens per Sec: 22265, Lr: 0.000210 2020-02-12 22:20:46,640 Epoch 79 Step: 193600 Batch Loss: 1.398058 Tokens per Sec: 22370, Lr: 0.000210 2020-02-12 22:20:56,553 Epoch 79 Step: 193700 Batch Loss: 1.361625 Tokens per Sec: 22755, Lr: 0.000210 2020-02-12 22:21:06,461 Epoch 79 Step: 193800 Batch Loss: 1.448281 Tokens per Sec: 21930, Lr: 0.000210 2020-02-12 22:21:16,369 Epoch 79 Step: 193900 Batch Loss: 1.529916 Tokens per Sec: 21546, Lr: 0.000210 2020-02-12 22:21:26,354 Epoch 79 Step: 194000 Batch Loss: 1.090727 Tokens per Sec: 21654, Lr: 0.000210 2020-02-12 22:21:45,519 Hooray! New best validation result [ppl]! 2020-02-12 22:21:45,519 Saving new checkpoint. 2020-02-12 22:21:45,721 Example #0 2020-02-12 22:21:45,722 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 22:21:45,722 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsan', 'gbem', 'yô', ',', 'doo', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'sha', 'afatyô', 've', 'cii', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'una', 'fatyô', 'u', 'vesen', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 22:21:45,722 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 22:21:45,722 Reference: 10 : ​ 6 - 9 . 2020-02-12 22:21:45,722 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsan gbem yô , doo u noov man kasev vea nôngo sha afatyô ve cii vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u una fatyô u vesen la . — Marku 10 : 6 - 9 . 2020-02-12 22:21:45,722 Example #1 2020-02-12 22:21:45,722 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 22:21:45,722 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 22:21:45,722 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 22:21:45,722 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 22:21:45,723 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-12 22:21:45,723 Example #2 2020-02-12 22:21:45,723 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 22:21:45,723 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 22:21:45,723 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 22:21:45,723 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 22:21:45,723 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 22:21:45,723 Example #3 2020-02-12 22:21:45,723 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 22:21:45,723 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 22:21:45,723 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 22:21:45,723 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 22:21:45,724 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 22:21:45,724 Validation result (greedy) at epoch 79, step 194000: bleu: 28.78, loss: 39939.7734, ppl: 3.8541, duration: 19.3688s 2020-02-12 22:21:55,623 Epoch 79 Step: 194100 Batch Loss: 1.128032 Tokens per Sec: 22107, Lr: 0.000210 2020-02-12 22:22:05,514 Epoch 79 Step: 194200 Batch Loss: 1.383375 Tokens per Sec: 22192, Lr: 0.000210 2020-02-12 22:22:08,689 Epoch 79: total training loss 3256.37 2020-02-12 22:22:08,690 EPOCH 80 2020-02-12 22:22:15,737 Epoch 80 Step: 194300 Batch Loss: 1.352210 Tokens per Sec: 21360, Lr: 0.000210 2020-02-12 22:22:25,678 Epoch 80 Step: 194400 Batch Loss: 1.051553 Tokens per Sec: 22157, Lr: 0.000210 2020-02-12 22:22:35,486 Epoch 80 Step: 194500 Batch Loss: 1.411880 Tokens per Sec: 22311, Lr: 0.000210 2020-02-12 22:22:45,360 Epoch 80 Step: 194600 Batch Loss: 1.440366 Tokens per Sec: 22364, Lr: 0.000210 2020-02-12 22:22:55,349 Epoch 80 Step: 194700 Batch Loss: 1.436578 Tokens per Sec: 22501, Lr: 0.000210 2020-02-12 22:23:05,287 Epoch 80 Step: 194800 Batch Loss: 1.599869 Tokens per Sec: 22158, Lr: 0.000210 2020-02-12 22:23:15,203 Epoch 80 Step: 194900 Batch Loss: 1.237875 Tokens per Sec: 21514, Lr: 0.000210 2020-02-12 22:23:25,100 Epoch 80 Step: 195000 Batch Loss: 1.422842 Tokens per Sec: 22687, Lr: 0.000210 2020-02-12 22:23:43,919 Example #0 2020-02-12 22:23:43,919 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 22:23:43,919 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsan', 'gbem', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'kura', 'dooshima', 've', 'la', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'her', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 22:23:43,919 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 22:23:43,919 Reference: 10 : ​ 6 - 9 . 2020-02-12 22:23:43,919 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsan gbem yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea kura dooshima ve la shi vea za hemen u lun a dooshima u a lu her la . — Marku 10 : 6 - 9 . 2020-02-12 22:23:43,919 Example #1 2020-02-12 22:23:43,919 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 22:23:43,920 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 22:23:43,920 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 22:23:43,920 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 22:23:43,920 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-12 22:23:43,920 Example #2 2020-02-12 22:23:43,920 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 22:23:43,920 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', '.'] 2020-02-12 22:23:43,920 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 22:23:43,920 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 22:23:43,920 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu . 2020-02-12 22:23:43,920 Example #3 2020-02-12 22:23:43,920 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 22:23:43,920 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 22:23:43,920 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 22:23:43,920 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 22:23:43,920 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-12 22:23:43,921 Validation result (greedy) at epoch 80, step 195000: bleu: 29.19, loss: 39999.3555, ppl: 3.8619, duration: 18.8201s 2020-02-12 22:23:53,863 Epoch 80 Step: 195100 Batch Loss: 1.332553 Tokens per Sec: 22101, Lr: 0.000210 2020-02-12 22:24:03,831 Epoch 80 Step: 195200 Batch Loss: 1.419907 Tokens per Sec: 22993, Lr: 0.000210 2020-02-12 22:24:13,662 Epoch 80 Step: 195300 Batch Loss: 1.287257 Tokens per Sec: 22330, Lr: 0.000210 2020-02-12 22:24:23,604 Epoch 80 Step: 195400 Batch Loss: 1.471703 Tokens per Sec: 21863, Lr: 0.000210 2020-02-12 22:24:33,470 Epoch 80 Step: 195500 Batch Loss: 1.211527 Tokens per Sec: 22232, Lr: 0.000210 2020-02-12 22:24:43,363 Epoch 80 Step: 195600 Batch Loss: 1.104228 Tokens per Sec: 21883, Lr: 0.000210 2020-02-12 22:24:53,321 Epoch 80 Step: 195700 Batch Loss: 1.441295 Tokens per Sec: 22562, Lr: 0.000210 2020-02-12 22:25:03,312 Epoch 80 Step: 195800 Batch Loss: 1.078169 Tokens per Sec: 22535, Lr: 0.000210 2020-02-12 22:25:13,357 Epoch 80 Step: 195900 Batch Loss: 1.466154 Tokens per Sec: 22103, Lr: 0.000210 2020-02-12 22:25:23,385 Epoch 80 Step: 196000 Batch Loss: 1.250882 Tokens per Sec: 22093, Lr: 0.000210 2020-02-12 22:25:43,105 Example #0 2020-02-12 22:25:43,105 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 22:25:43,105 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'tsung', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'una', 'fatyô', 'u', 'vesen', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 22:25:43,105 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 22:25:43,105 Reference: 10 : ​ 6 - 9 . 2020-02-12 22:25:43,105 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo tsung vea lu a dooshima u a lu a mi la , shi vea za hemen u lun a dooshima u una fatyô u vesen la . — Marku 10 : 6 - 9 . 2020-02-12 22:25:43,105 Example #1 2020-02-12 22:25:43,105 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 22:25:43,105 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', ',', 'u', 'a', 'lu', 'mgb@@', 'ôghom', 'ne', '!', '—', 'Rom', '.'] 2020-02-12 22:25:43,105 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 22:25:43,105 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 22:25:43,106 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung , u a lu mgbôghom ne ! — Rom . 2020-02-12 22:25:43,106 Example #2 2020-02-12 22:25:43,106 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 22:25:43,106 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', '.'] 2020-02-12 22:25:43,106 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 22:25:43,106 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 22:25:43,106 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu . 2020-02-12 22:25:43,106 Example #3 2020-02-12 22:25:43,106 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 22:25:43,106 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'u', 'vough', 'ga', '.'] 2020-02-12 22:25:43,106 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 22:25:43,106 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 22:25:43,106 Hypothesis: Alaghga or nana lu eren kwagh u vough ga . 2020-02-12 22:25:43,106 Validation result (greedy) at epoch 80, step 196000: bleu: 28.98, loss: 40041.5938, ppl: 3.8674, duration: 19.7205s 2020-02-12 22:25:53,144 Epoch 80 Step: 196100 Batch Loss: 1.397226 Tokens per Sec: 21519, Lr: 0.000210 2020-02-12 22:26:03,114 Epoch 80 Step: 196200 Batch Loss: 1.350308 Tokens per Sec: 21458, Lr: 0.000210 2020-02-12 22:26:13,219 Epoch 80 Step: 196300 Batch Loss: 1.292623 Tokens per Sec: 21863, Lr: 0.000210 2020-02-12 22:26:23,297 Epoch 80 Step: 196400 Batch Loss: 1.452254 Tokens per Sec: 22332, Lr: 0.000210 2020-02-12 22:26:33,409 Epoch 80 Step: 196500 Batch Loss: 1.159741 Tokens per Sec: 21598, Lr: 0.000210 2020-02-12 22:26:43,459 Epoch 80 Step: 196600 Batch Loss: 1.269593 Tokens per Sec: 22629, Lr: 0.000210 2020-02-12 22:26:53,003 Epoch 80: total training loss 3256.90 2020-02-12 22:26:53,003 EPOCH 81 2020-02-12 22:26:54,016 Epoch 81 Step: 196700 Batch Loss: 1.358043 Tokens per Sec: 17051, Lr: 0.000210 2020-02-12 22:27:04,122 Epoch 81 Step: 196800 Batch Loss: 1.109608 Tokens per Sec: 21638, Lr: 0.000210 2020-02-12 22:27:14,153 Epoch 81 Step: 196900 Batch Loss: 1.486377 Tokens per Sec: 22068, Lr: 0.000210 2020-02-12 22:27:24,213 Epoch 81 Step: 197000 Batch Loss: 1.319877 Tokens per Sec: 22107, Lr: 0.000210 2020-02-12 22:27:42,857 Example #0 2020-02-12 22:27:42,857 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 22:27:42,857 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'kura', 'm@@', 'doo', 'u', 'dooshima', 've', 'a', 'lu', 'a', 'mi', 'la', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'her', 'dông', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 22:27:42,857 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 22:27:42,857 Reference: 10 : ​ 6 - 9 . 2020-02-12 22:27:42,857 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea kura mdoo u dooshima ve a lu a mi la shi vea za hemen u lun a dooshima her dông . — Marku 10 : 6 - 9 . 2020-02-12 22:27:42,857 Example #1 2020-02-12 22:27:42,857 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 22:27:42,858 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'zan', 'zan', 'hegen', 'je', 'kpaa', '!', '—', 'Rom', '.'] 2020-02-12 22:27:42,858 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 22:27:42,858 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 22:27:42,858 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man zan zan hegen je kpaa ! — Rom . 2020-02-12 22:27:42,858 Example #2 2020-02-12 22:27:42,858 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 22:27:42,858 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'gar', 'u', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', '.'] 2020-02-12 22:27:42,858 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 22:27:42,858 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 22:27:42,858 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken gar u Masedonia man Timoteu . 2020-02-12 22:27:42,858 Example #3 2020-02-12 22:27:42,858 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 22:27:42,858 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 22:27:42,858 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 22:27:42,858 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 22:27:42,858 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 22:27:42,859 Validation result (greedy) at epoch 81, step 197000: bleu: 29.11, loss: 40091.5859, ppl: 3.8739, duration: 18.6453s 2020-02-12 22:27:52,818 Epoch 81 Step: 197100 Batch Loss: 1.349809 Tokens per Sec: 21992, Lr: 0.000210 2020-02-12 22:28:02,784 Epoch 81 Step: 197200 Batch Loss: 1.299026 Tokens per Sec: 22278, Lr: 0.000210 2020-02-12 22:28:12,662 Epoch 81 Step: 197300 Batch Loss: 1.174235 Tokens per Sec: 21827, Lr: 0.000210 2020-02-12 22:28:22,529 Epoch 81 Step: 197400 Batch Loss: 1.418869 Tokens per Sec: 22322, Lr: 0.000210 2020-02-12 22:28:32,406 Epoch 81 Step: 197500 Batch Loss: 1.396526 Tokens per Sec: 22655, Lr: 0.000210 2020-02-12 22:28:42,278 Epoch 81 Step: 197600 Batch Loss: 1.316120 Tokens per Sec: 22103, Lr: 0.000210 2020-02-12 22:28:52,308 Epoch 81 Step: 197700 Batch Loss: 1.325949 Tokens per Sec: 22112, Lr: 0.000210 2020-02-12 22:29:02,195 Epoch 81 Step: 197800 Batch Loss: 1.348390 Tokens per Sec: 22132, Lr: 0.000210 2020-02-12 22:29:12,091 Epoch 81 Step: 197900 Batch Loss: 1.391584 Tokens per Sec: 22548, Lr: 0.000210 2020-02-12 22:29:21,936 Epoch 81 Step: 198000 Batch Loss: 1.393786 Tokens per Sec: 22280, Lr: 0.000210 2020-02-12 22:29:40,839 Example #0 2020-02-12 22:29:40,839 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 22:29:40,839 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 've', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 22:29:40,840 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 22:29:40,840 Reference: 10 : ​ 6 - 9 . 2020-02-12 22:29:40,840 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima ve la her shi vea za hemen u lun a dooshima u a lu a mi la . — Marku 10 : 6 - 9 . 2020-02-12 22:29:40,840 Example #1 2020-02-12 22:29:40,840 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 22:29:40,840 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 22:29:40,840 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 22:29:40,840 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 22:29:40,840 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-12 22:29:40,840 Example #2 2020-02-12 22:29:40,840 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 22:29:40,840 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 22:29:40,840 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 22:29:40,840 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 22:29:40,840 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 22:29:40,841 Example #3 2020-02-12 22:29:40,841 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 22:29:40,841 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 22:29:40,841 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 22:29:40,841 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 22:29:40,841 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 22:29:40,841 Validation result (greedy) at epoch 81, step 198000: bleu: 28.69, loss: 40072.0195, ppl: 3.8713, duration: 18.9048s 2020-02-12 22:29:50,884 Epoch 81 Step: 198100 Batch Loss: 1.436496 Tokens per Sec: 22161, Lr: 0.000210 2020-02-12 22:30:00,984 Epoch 81 Step: 198200 Batch Loss: 1.383164 Tokens per Sec: 21797, Lr: 0.000210 2020-02-12 22:30:10,983 Epoch 81 Step: 198300 Batch Loss: 1.234682 Tokens per Sec: 22454, Lr: 0.000210 2020-02-12 22:30:20,974 Epoch 81 Step: 198400 Batch Loss: 1.552770 Tokens per Sec: 22043, Lr: 0.000210 2020-02-12 22:30:30,914 Epoch 81 Step: 198500 Batch Loss: 1.340827 Tokens per Sec: 22207, Lr: 0.000210 2020-02-12 22:30:40,847 Epoch 81 Step: 198600 Batch Loss: 1.242848 Tokens per Sec: 22308, Lr: 0.000210 2020-02-12 22:30:50,847 Epoch 81 Step: 198700 Batch Loss: 1.092364 Tokens per Sec: 22405, Lr: 0.000210 2020-02-12 22:31:00,810 Epoch 81 Step: 198800 Batch Loss: 1.341076 Tokens per Sec: 22077, Lr: 0.000210 2020-02-12 22:31:10,920 Epoch 81 Step: 198900 Batch Loss: 1.121915 Tokens per Sec: 21588, Lr: 0.000210 2020-02-12 22:31:20,884 Epoch 81 Step: 199000 Batch Loss: 1.280749 Tokens per Sec: 22768, Lr: 0.000210 2020-02-12 22:31:40,333 Example #0 2020-02-12 22:31:40,334 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 22:31:40,334 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'vesen', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'her', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 22:31:40,334 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 22:31:40,334 Reference: 10 : ​ 6 - 9 . 2020-02-12 22:31:40,334 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u vesen yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu hen atô ve la , shi vea za hemen u lun a dooshima u a lu her la . — Marku 10 : 6 - 9 . 2020-02-12 22:31:40,334 Example #1 2020-02-12 22:31:40,334 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 22:31:40,334 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 22:31:40,334 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 22:31:40,334 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 22:31:40,334 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung , man kwagh ne mgbôghom ! — Rom . 2020-02-12 22:31:40,334 Example #2 2020-02-12 22:31:40,334 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 22:31:40,334 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 22:31:40,335 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 22:31:40,335 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 22:31:40,335 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 22:31:40,335 Example #3 2020-02-12 22:31:40,335 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 22:31:40,335 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 22:31:40,335 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 22:31:40,335 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 22:31:40,335 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 22:31:40,335 Validation result (greedy) at epoch 81, step 199000: bleu: 28.89, loss: 39961.1836, ppl: 3.8569, duration: 19.4503s 2020-02-12 22:31:50,356 Epoch 81 Step: 199100 Batch Loss: 1.398231 Tokens per Sec: 21947, Lr: 0.000210 2020-02-12 22:31:55,415 Epoch 81: total training loss 3248.64 2020-02-12 22:31:55,415 EPOCH 82 2020-02-12 22:32:00,634 Epoch 82 Step: 199200 Batch Loss: 1.083010 Tokens per Sec: 21372, Lr: 0.000210 2020-02-12 22:32:10,865 Epoch 82 Step: 199300 Batch Loss: 1.574348 Tokens per Sec: 22257, Lr: 0.000210 2020-02-12 22:32:20,960 Epoch 82 Step: 199400 Batch Loss: 1.605416 Tokens per Sec: 22028, Lr: 0.000210 2020-02-12 22:32:31,009 Epoch 82 Step: 199500 Batch Loss: 1.400529 Tokens per Sec: 21764, Lr: 0.000210 2020-02-12 22:32:41,033 Epoch 82 Step: 199600 Batch Loss: 1.448166 Tokens per Sec: 22675, Lr: 0.000210 2020-02-12 22:32:50,961 Epoch 82 Step: 199700 Batch Loss: 1.236252 Tokens per Sec: 22193, Lr: 0.000210 2020-02-12 22:33:00,784 Epoch 82 Step: 199800 Batch Loss: 1.359672 Tokens per Sec: 22292, Lr: 0.000210 2020-02-12 22:33:10,696 Epoch 82 Step: 199900 Batch Loss: 1.104980 Tokens per Sec: 22538, Lr: 0.000210 2020-02-12 22:33:20,658 Epoch 82 Step: 200000 Batch Loss: 1.051884 Tokens per Sec: 22321, Lr: 0.000210 2020-02-12 22:33:39,816 Example #0 2020-02-12 22:33:39,816 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 22:33:39,816 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsan', 'gbem', 'sha', 'won', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 22:33:39,816 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 22:33:39,816 Reference: 10 : ​ 6 - 9 . 2020-02-12 22:33:39,816 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsan gbem sha won yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la , shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-12 22:33:39,816 Example #1 2020-02-12 22:33:39,817 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 22:33:39,817 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 22:33:39,817 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 22:33:39,817 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 22:33:39,817 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-12 22:33:39,817 Example #2 2020-02-12 22:33:39,817 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 22:33:39,817 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 22:33:39,817 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 22:33:39,817 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 22:33:39,817 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 22:33:39,817 Example #3 2020-02-12 22:33:39,817 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 22:33:39,817 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 22:33:39,817 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 22:33:39,817 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 22:33:39,818 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 22:33:39,818 Validation result (greedy) at epoch 82, step 200000: bleu: 28.70, loss: 39941.5742, ppl: 3.8543, duration: 19.1593s 2020-02-12 22:33:49,832 Epoch 82 Step: 200100 Batch Loss: 1.297920 Tokens per Sec: 22338, Lr: 0.000147 2020-02-12 22:33:59,812 Epoch 82 Step: 200200 Batch Loss: 1.544762 Tokens per Sec: 21329, Lr: 0.000147 2020-02-12 22:34:09,855 Epoch 82 Step: 200300 Batch Loss: 1.332825 Tokens per Sec: 22122, Lr: 0.000147 2020-02-12 22:34:19,865 Epoch 82 Step: 200400 Batch Loss: 1.424885 Tokens per Sec: 22035, Lr: 0.000147 2020-02-12 22:34:29,776 Epoch 82 Step: 200500 Batch Loss: 1.389484 Tokens per Sec: 22111, Lr: 0.000147 2020-02-12 22:34:39,767 Epoch 82 Step: 200600 Batch Loss: 1.268950 Tokens per Sec: 22141, Lr: 0.000147 2020-02-12 22:34:49,768 Epoch 82 Step: 200700 Batch Loss: 1.367259 Tokens per Sec: 22479, Lr: 0.000147 2020-02-12 22:34:59,692 Epoch 82 Step: 200800 Batch Loss: 1.097648 Tokens per Sec: 22467, Lr: 0.000147 2020-02-12 22:35:09,661 Epoch 82 Step: 200900 Batch Loss: 1.222341 Tokens per Sec: 21460, Lr: 0.000147 2020-02-12 22:35:19,608 Epoch 82 Step: 201000 Batch Loss: 1.088863 Tokens per Sec: 22158, Lr: 0.000147 2020-02-12 22:35:38,865 Hooray! New best validation result [ppl]! 2020-02-12 22:35:38,866 Saving new checkpoint. 2020-02-12 22:35:39,066 Example #0 2020-02-12 22:35:39,066 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 22:35:39,067 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 22:35:39,067 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 22:35:39,067 Reference: 10 : ​ 6 - 9 . 2020-02-12 22:35:39,067 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu hen atô ve la her shi vea za hemen u lun a dooshima u a lu a mi la . — Marku 10 : 6 - 9 . 2020-02-12 22:35:39,067 Example #1 2020-02-12 22:35:39,067 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 22:35:39,067 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 22:35:39,067 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 22:35:39,067 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 22:35:39,067 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung , man kwagh ne mgbôghom ! — Rom . 2020-02-12 22:35:39,067 Example #2 2020-02-12 22:35:39,068 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 22:35:39,068 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 22:35:39,068 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 22:35:39,068 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 22:35:39,068 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 22:35:39,068 Example #3 2020-02-12 22:35:39,068 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 22:35:39,068 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'u', 'vough', 'ga', '.'] 2020-02-12 22:35:39,068 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 22:35:39,068 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 22:35:39,068 Hypothesis: Alaghga or nana lu eren kwagh u vough ga . 2020-02-12 22:35:39,068 Validation result (greedy) at epoch 82, step 201000: bleu: 29.07, loss: 39719.3906, ppl: 3.8255, duration: 19.4599s 2020-02-12 22:35:49,018 Epoch 82 Step: 201100 Batch Loss: 1.369400 Tokens per Sec: 22259, Lr: 0.000147 2020-02-12 22:35:58,927 Epoch 82 Step: 201200 Batch Loss: 1.313312 Tokens per Sec: 22459, Lr: 0.000147 2020-02-12 22:36:08,869 Epoch 82 Step: 201300 Batch Loss: 1.336513 Tokens per Sec: 22176, Lr: 0.000147 2020-02-12 22:36:19,101 Epoch 82 Step: 201400 Batch Loss: 1.225829 Tokens per Sec: 21785, Lr: 0.000147 2020-02-12 22:36:29,116 Epoch 82 Step: 201500 Batch Loss: 1.335333 Tokens per Sec: 22182, Lr: 0.000147 2020-02-12 22:36:39,057 Epoch 82 Step: 201600 Batch Loss: 1.542142 Tokens per Sec: 22268, Lr: 0.000147 2020-02-12 22:36:39,464 Epoch 82: total training loss 3221.55 2020-02-12 22:36:39,465 EPOCH 83 2020-02-12 22:36:49,434 Epoch 83 Step: 201700 Batch Loss: 1.179136 Tokens per Sec: 21722, Lr: 0.000147 2020-02-12 22:36:59,337 Epoch 83 Step: 201800 Batch Loss: 1.141792 Tokens per Sec: 22170, Lr: 0.000147 2020-02-12 22:37:09,277 Epoch 83 Step: 201900 Batch Loss: 1.315131 Tokens per Sec: 21653, Lr: 0.000147 2020-02-12 22:37:19,188 Epoch 83 Step: 202000 Batch Loss: 1.285479 Tokens per Sec: 22456, Lr: 0.000147 2020-02-12 22:37:38,088 Example #0 2020-02-12 22:37:38,088 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 22:37:38,088 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'her', 'kpaa', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 22:37:38,088 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 22:37:38,088 Reference: 10 : ​ 6 - 9 . 2020-02-12 22:37:38,088 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima her kpaa . — Marku 10 : 6 - 9 . 2020-02-12 22:37:38,088 Example #1 2020-02-12 22:37:38,088 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 22:37:38,088 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 22:37:38,088 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 22:37:38,089 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 22:37:38,089 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-12 22:37:38,089 Example #2 2020-02-12 22:37:38,089 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 22:37:38,089 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 22:37:38,089 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 22:37:38,089 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 22:37:38,089 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 22:37:38,089 Example #3 2020-02-12 22:37:38,089 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 22:37:38,089 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 22:37:38,089 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 22:37:38,089 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 22:37:38,089 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 22:37:38,089 Validation result (greedy) at epoch 83, step 202000: bleu: 29.30, loss: 39728.5898, ppl: 3.8267, duration: 18.9004s 2020-02-12 22:37:48,026 Epoch 83 Step: 202100 Batch Loss: 1.323892 Tokens per Sec: 22605, Lr: 0.000147 2020-02-12 22:37:57,934 Epoch 83 Step: 202200 Batch Loss: 1.389494 Tokens per Sec: 22561, Lr: 0.000147 2020-02-12 22:38:07,878 Epoch 83 Step: 202300 Batch Loss: 1.334775 Tokens per Sec: 22765, Lr: 0.000147 2020-02-12 22:38:17,805 Epoch 83 Step: 202400 Batch Loss: 1.355595 Tokens per Sec: 22295, Lr: 0.000147 2020-02-12 22:38:27,839 Epoch 83 Step: 202500 Batch Loss: 1.333981 Tokens per Sec: 21298, Lr: 0.000147 2020-02-12 22:38:37,761 Epoch 83 Step: 202600 Batch Loss: 1.274209 Tokens per Sec: 22547, Lr: 0.000147 2020-02-12 22:38:47,706 Epoch 83 Step: 202700 Batch Loss: 1.216862 Tokens per Sec: 21889, Lr: 0.000147 2020-02-12 22:38:57,601 Epoch 83 Step: 202800 Batch Loss: 1.518354 Tokens per Sec: 22219, Lr: 0.000147 2020-02-12 22:39:07,490 Epoch 83 Step: 202900 Batch Loss: 1.527613 Tokens per Sec: 22302, Lr: 0.000147 2020-02-12 22:39:17,533 Epoch 83 Step: 203000 Batch Loss: 1.293005 Tokens per Sec: 22015, Lr: 0.000147 2020-02-12 22:39:37,073 Example #0 2020-02-12 22:39:37,073 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 22:39:37,073 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'her', 'dông', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 22:39:37,073 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 22:39:37,073 Reference: 10 : ​ 6 - 9 . 2020-02-12 22:39:37,073 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la shi vea za hemen u lun a dooshima her dông . — Marku 10 : 6 - 9 . 2020-02-12 22:39:37,073 Example #1 2020-02-12 22:39:37,073 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 22:39:37,073 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 22:39:37,073 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 22:39:37,074 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 22:39:37,074 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung , man kwagh ne mgbôghom ! — Rom . 2020-02-12 22:39:37,074 Example #2 2020-02-12 22:39:37,074 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 22:39:37,074 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 22:39:37,074 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 22:39:37,074 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 22:39:37,074 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 22:39:37,074 Example #3 2020-02-12 22:39:37,074 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 22:39:37,074 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 22:39:37,074 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 22:39:37,074 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 22:39:37,074 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 22:39:37,074 Validation result (greedy) at epoch 83, step 203000: bleu: 29.24, loss: 39766.3789, ppl: 3.8316, duration: 19.5405s 2020-02-12 22:39:47,304 Epoch 83 Step: 203100 Batch Loss: 1.294662 Tokens per Sec: 21644, Lr: 0.000147 2020-02-12 22:39:57,542 Epoch 83 Step: 203200 Batch Loss: 1.089852 Tokens per Sec: 21767, Lr: 0.000147 2020-02-12 22:40:07,765 Epoch 83 Step: 203300 Batch Loss: 1.282965 Tokens per Sec: 22118, Lr: 0.000147 2020-02-12 22:40:17,917 Epoch 83 Step: 203400 Batch Loss: 1.405214 Tokens per Sec: 21868, Lr: 0.000147 2020-02-12 22:40:28,090 Epoch 83 Step: 203500 Batch Loss: 1.073985 Tokens per Sec: 21670, Lr: 0.000147 2020-02-12 22:40:38,169 Epoch 83 Step: 203600 Batch Loss: 1.198616 Tokens per Sec: 21961, Lr: 0.000147 2020-02-12 22:40:48,146 Epoch 83 Step: 203700 Batch Loss: 1.252622 Tokens per Sec: 21371, Lr: 0.000147 2020-02-12 22:40:58,075 Epoch 83 Step: 203800 Batch Loss: 1.497331 Tokens per Sec: 22553, Lr: 0.000147 2020-02-12 22:41:08,129 Epoch 83 Step: 203900 Batch Loss: 1.498321 Tokens per Sec: 22145, Lr: 0.000147 2020-02-12 22:41:18,142 Epoch 83 Step: 204000 Batch Loss: 1.394949 Tokens per Sec: 21746, Lr: 0.000147 2020-02-12 22:41:36,838 Example #0 2020-02-12 22:41:36,838 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 22:41:36,838 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'sha', 'afatyô', 've', 'cii', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'sha', 'gbenda', 'u', 'dooshima', 'una', 'seer', 'taver', 'yô', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 22:41:36,838 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 22:41:36,838 Reference: 10 : ​ 6 - 9 . 2020-02-12 22:41:36,838 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo sha afatyô ve cii vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima sha gbenda u dooshima una seer taver yô . — Marku 10 : 6 - 9 . 2020-02-12 22:41:36,838 Example #1 2020-02-12 22:41:36,838 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 22:41:36,839 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 22:41:36,839 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 22:41:36,839 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 22:41:36,839 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung , man kwagh ne mgbôghom ! — Rom . 2020-02-12 22:41:36,839 Example #2 2020-02-12 22:41:36,839 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 22:41:36,839 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 22:41:36,839 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 22:41:36,839 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 22:41:36,839 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 22:41:36,839 Example #3 2020-02-12 22:41:36,839 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 22:41:36,839 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 22:41:36,839 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 22:41:36,839 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 22:41:36,839 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 22:41:36,840 Validation result (greedy) at epoch 83, step 204000: bleu: 28.98, loss: 39757.5352, ppl: 3.8304, duration: 18.6967s 2020-02-12 22:41:43,053 Epoch 83: total training loss 3203.84 2020-02-12 22:41:43,053 EPOCH 84 2020-02-12 22:41:47,159 Epoch 84 Step: 204100 Batch Loss: 1.397490 Tokens per Sec: 19816, Lr: 0.000147 2020-02-12 22:41:57,197 Epoch 84 Step: 204200 Batch Loss: 1.402131 Tokens per Sec: 22121, Lr: 0.000147 2020-02-12 22:42:07,238 Epoch 84 Step: 204300 Batch Loss: 1.138376 Tokens per Sec: 21824, Lr: 0.000147 2020-02-12 22:42:17,248 Epoch 84 Step: 204400 Batch Loss: 1.475207 Tokens per Sec: 21628, Lr: 0.000147 2020-02-12 22:42:27,419 Epoch 84 Step: 204500 Batch Loss: 1.437604 Tokens per Sec: 21656, Lr: 0.000147 2020-02-12 22:42:37,587 Epoch 84 Step: 204600 Batch Loss: 1.381959 Tokens per Sec: 22176, Lr: 0.000147 2020-02-12 22:42:47,728 Epoch 84 Step: 204700 Batch Loss: 1.243653 Tokens per Sec: 21705, Lr: 0.000147 2020-02-12 22:42:57,828 Epoch 84 Step: 204800 Batch Loss: 1.319078 Tokens per Sec: 22025, Lr: 0.000147 2020-02-12 22:43:07,968 Epoch 84 Step: 204900 Batch Loss: 1.340142 Tokens per Sec: 21911, Lr: 0.000147 2020-02-12 22:43:18,117 Epoch 84 Step: 205000 Batch Loss: 1.365434 Tokens per Sec: 21530, Lr: 0.000147 2020-02-12 22:43:37,346 Example #0 2020-02-12 22:43:37,346 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 22:43:37,346 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsan', 'gbem', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 've', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'una', 'fatyô', 'u', 'vesen', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 22:43:37,346 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 22:43:37,346 Reference: 10 : ​ 6 - 9 . 2020-02-12 22:43:37,346 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsan gbem yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima ve la her shi vea za hemen u lun a dooshima u una fatyô u vesen la her . — Marku 10 : 6 - 9 . 2020-02-12 22:43:37,347 Example #1 2020-02-12 22:43:37,347 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 22:43:37,347 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 22:43:37,347 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 22:43:37,347 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 22:43:37,347 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung , man kwagh ne mgbôghom ! — Rom . 2020-02-12 22:43:37,347 Example #2 2020-02-12 22:43:37,347 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 22:43:37,347 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 22:43:37,347 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 22:43:37,347 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 22:43:37,347 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 22:43:37,347 Example #3 2020-02-12 22:43:37,347 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 22:43:37,347 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 22:43:37,348 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 22:43:37,348 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 22:43:37,348 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 22:43:37,348 Validation result (greedy) at epoch 84, step 205000: bleu: 29.44, loss: 39756.6211, ppl: 3.8303, duration: 19.2303s 2020-02-12 22:43:47,519 Epoch 84 Step: 205100 Batch Loss: 1.232536 Tokens per Sec: 22600, Lr: 0.000147 2020-02-12 22:43:57,448 Epoch 84 Step: 205200 Batch Loss: 1.336163 Tokens per Sec: 22162, Lr: 0.000147 2020-02-12 22:44:07,529 Epoch 84 Step: 205300 Batch Loss: 1.412025 Tokens per Sec: 21788, Lr: 0.000147 2020-02-12 22:44:17,569 Epoch 84 Step: 205400 Batch Loss: 1.211719 Tokens per Sec: 22036, Lr: 0.000147 2020-02-12 22:44:27,557 Epoch 84 Step: 205500 Batch Loss: 1.366648 Tokens per Sec: 21750, Lr: 0.000147 2020-02-12 22:44:37,763 Epoch 84 Step: 205600 Batch Loss: 1.385936 Tokens per Sec: 21710, Lr: 0.000147 2020-02-12 22:44:47,931 Epoch 84 Step: 205700 Batch Loss: 1.484532 Tokens per Sec: 21757, Lr: 0.000147 2020-02-12 22:44:58,014 Epoch 84 Step: 205800 Batch Loss: 1.232638 Tokens per Sec: 21606, Lr: 0.000147 2020-02-12 22:45:08,198 Epoch 84 Step: 205900 Batch Loss: 1.389674 Tokens per Sec: 21666, Lr: 0.000147 2020-02-12 22:45:18,411 Epoch 84 Step: 206000 Batch Loss: 1.273307 Tokens per Sec: 21949, Lr: 0.000147 2020-02-12 22:45:37,595 Example #0 2020-02-12 22:45:37,595 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 22:45:37,595 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 22:45:37,595 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 22:45:37,595 Reference: 10 : ​ 6 - 9 . 2020-02-12 22:45:37,595 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-12 22:45:37,595 Example #1 2020-02-12 22:45:37,596 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 22:45:37,596 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 22:45:37,596 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 22:45:37,596 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 22:45:37,596 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-12 22:45:37,596 Example #2 2020-02-12 22:45:37,596 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 22:45:37,596 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 22:45:37,596 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 22:45:37,596 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 22:45:37,596 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 22:45:37,596 Example #3 2020-02-12 22:45:37,596 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 22:45:37,596 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 22:45:37,596 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 22:45:37,597 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 22:45:37,597 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 22:45:37,597 Validation result (greedy) at epoch 84, step 206000: bleu: 29.32, loss: 39728.8750, ppl: 3.8267, duration: 19.1853s 2020-02-12 22:45:47,713 Epoch 84 Step: 206100 Batch Loss: 1.279273 Tokens per Sec: 21805, Lr: 0.000147 2020-02-12 22:45:57,568 Epoch 84 Step: 206200 Batch Loss: 1.307368 Tokens per Sec: 22381, Lr: 0.000147 2020-02-12 22:46:07,450 Epoch 84 Step: 206300 Batch Loss: 1.169760 Tokens per Sec: 23033, Lr: 0.000147 2020-02-12 22:46:17,444 Epoch 84 Step: 206400 Batch Loss: 0.994240 Tokens per Sec: 21643, Lr: 0.000147 2020-02-12 22:46:27,575 Epoch 84 Step: 206500 Batch Loss: 1.401392 Tokens per Sec: 22065, Lr: 0.000147 2020-02-12 22:46:29,685 Epoch 84: total training loss 3199.05 2020-02-12 22:46:29,686 EPOCH 85 2020-02-12 22:46:37,968 Epoch 85 Step: 206600 Batch Loss: 1.324352 Tokens per Sec: 21050, Lr: 0.000147 2020-02-12 22:46:48,238 Epoch 85 Step: 206700 Batch Loss: 1.509637 Tokens per Sec: 21733, Lr: 0.000147 2020-02-12 22:46:58,314 Epoch 85 Step: 206800 Batch Loss: 1.054729 Tokens per Sec: 21126, Lr: 0.000147 2020-02-12 22:47:08,314 Epoch 85 Step: 206900 Batch Loss: 1.410829 Tokens per Sec: 22352, Lr: 0.000147 2020-02-12 22:47:18,153 Epoch 85 Step: 207000 Batch Loss: 1.380293 Tokens per Sec: 22321, Lr: 0.000147 2020-02-12 22:47:37,005 Example #0 2020-02-12 22:47:37,005 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 22:47:37,006 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 've', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'her', 'dông', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 22:47:37,006 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 22:47:37,006 Reference: 10 : ​ 6 - 9 . 2020-02-12 22:47:37,006 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima ve her shi vea za hemen u lun a dooshima her dông . — Marku 10 : 6 - 9 . 2020-02-12 22:47:37,006 Example #1 2020-02-12 22:47:37,006 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 22:47:37,006 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'imba', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 22:47:37,006 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 22:47:37,006 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 22:47:37,006 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a imba shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-12 22:47:37,006 Example #2 2020-02-12 22:47:37,006 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 22:47:37,006 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 22:47:37,006 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 22:47:37,006 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 22:47:37,007 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 22:47:37,007 Example #3 2020-02-12 22:47:37,007 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 22:47:37,007 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 22:47:37,007 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 22:47:37,007 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 22:47:37,007 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 22:47:37,007 Validation result (greedy) at epoch 85, step 207000: bleu: 29.11, loss: 39804.1953, ppl: 3.8365, duration: 18.8534s 2020-02-12 22:47:46,889 Epoch 85 Step: 207100 Batch Loss: 1.342482 Tokens per Sec: 22696, Lr: 0.000103 2020-02-12 22:47:56,781 Epoch 85 Step: 207200 Batch Loss: 1.252913 Tokens per Sec: 22514, Lr: 0.000103 2020-02-12 22:48:06,599 Epoch 85 Step: 207300 Batch Loss: 1.422992 Tokens per Sec: 22214, Lr: 0.000103 2020-02-12 22:48:16,544 Epoch 85 Step: 207400 Batch Loss: 1.194090 Tokens per Sec: 22501, Lr: 0.000103 2020-02-12 22:48:26,547 Epoch 85 Step: 207500 Batch Loss: 1.149812 Tokens per Sec: 22027, Lr: 0.000103 2020-02-12 22:48:36,432 Epoch 85 Step: 207600 Batch Loss: 1.362383 Tokens per Sec: 22434, Lr: 0.000103 2020-02-12 22:48:46,501 Epoch 85 Step: 207700 Batch Loss: 1.405640 Tokens per Sec: 22479, Lr: 0.000103 2020-02-12 22:48:56,486 Epoch 85 Step: 207800 Batch Loss: 1.179875 Tokens per Sec: 22059, Lr: 0.000103 2020-02-12 22:49:06,418 Epoch 85 Step: 207900 Batch Loss: 1.280342 Tokens per Sec: 22113, Lr: 0.000103 2020-02-12 22:49:16,427 Epoch 85 Step: 208000 Batch Loss: 1.248392 Tokens per Sec: 22328, Lr: 0.000103 2020-02-12 22:49:35,458 Hooray! New best validation result [ppl]! 2020-02-12 22:49:35,459 Saving new checkpoint. 2020-02-12 22:49:35,659 Example #0 2020-02-12 22:49:35,659 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 22:49:35,659 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 've', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 22:49:35,659 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 22:49:35,659 Reference: 10 : ​ 6 - 9 . 2020-02-12 22:49:35,659 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima ve la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-12 22:49:35,659 Example #1 2020-02-12 22:49:35,659 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 22:49:35,659 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'imba', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 22:49:35,659 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 22:49:35,660 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 22:49:35,660 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a imba shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-12 22:49:35,660 Example #2 2020-02-12 22:49:35,660 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 22:49:35,660 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 22:49:35,660 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 22:49:35,660 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 22:49:35,660 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 22:49:35,660 Example #3 2020-02-12 22:49:35,660 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 22:49:35,660 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 22:49:35,660 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 22:49:35,660 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 22:49:35,661 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 22:49:35,661 Validation result (greedy) at epoch 85, step 208000: bleu: 29.56, loss: 39632.5312, ppl: 3.8143, duration: 19.2332s 2020-02-12 22:49:45,567 Epoch 85 Step: 208100 Batch Loss: 1.260196 Tokens per Sec: 21984, Lr: 0.000103 2020-02-12 22:49:55,548 Epoch 85 Step: 208200 Batch Loss: 1.553760 Tokens per Sec: 22882, Lr: 0.000103 2020-02-12 22:50:05,422 Epoch 85 Step: 208300 Batch Loss: 1.272045 Tokens per Sec: 22361, Lr: 0.000103 2020-02-12 22:50:15,356 Epoch 85 Step: 208400 Batch Loss: 1.380754 Tokens per Sec: 22116, Lr: 0.000103 2020-02-12 22:50:25,298 Epoch 85 Step: 208500 Batch Loss: 1.349675 Tokens per Sec: 22381, Lr: 0.000103 2020-02-12 22:50:35,170 Epoch 85 Step: 208600 Batch Loss: 1.240827 Tokens per Sec: 21278, Lr: 0.000103 2020-02-12 22:50:45,067 Epoch 85 Step: 208700 Batch Loss: 1.345891 Tokens per Sec: 22837, Lr: 0.000103 2020-02-12 22:50:55,123 Epoch 85 Step: 208800 Batch Loss: 1.392841 Tokens per Sec: 21528, Lr: 0.000103 2020-02-12 22:51:05,059 Epoch 85 Step: 208900 Batch Loss: 1.358953 Tokens per Sec: 22442, Lr: 0.000103 2020-02-12 22:51:12,799 Epoch 85: total training loss 3179.61 2020-02-12 22:51:12,799 EPOCH 86 2020-02-12 22:51:15,247 Epoch 86 Step: 209000 Batch Loss: 1.203496 Tokens per Sec: 19477, Lr: 0.000103 2020-02-12 22:51:34,022 Hooray! New best validation result [ppl]! 2020-02-12 22:51:34,022 Saving new checkpoint. 2020-02-12 22:51:34,214 Example #0 2020-02-12 22:51:34,214 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 22:51:34,214 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'kura', 'dooshima', 've', 'la', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 22:51:34,214 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 22:51:34,214 Reference: 10 : ​ 6 - 9 . 2020-02-12 22:51:34,214 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea kura dooshima ve la shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-12 22:51:34,214 Example #1 2020-02-12 22:51:34,214 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 22:51:34,214 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 22:51:34,215 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 22:51:34,215 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 22:51:34,215 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-12 22:51:34,215 Example #2 2020-02-12 22:51:34,215 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 22:51:34,215 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 22:51:34,215 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 22:51:34,215 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 22:51:34,215 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 22:51:34,215 Example #3 2020-02-12 22:51:34,215 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 22:51:34,215 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 22:51:34,215 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 22:51:34,215 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 22:51:34,215 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 22:51:34,216 Validation result (greedy) at epoch 86, step 209000: bleu: 29.23, loss: 39577.4727, ppl: 3.8072, duration: 18.9684s 2020-02-12 22:51:44,322 Epoch 86 Step: 209100 Batch Loss: 1.390279 Tokens per Sec: 22137, Lr: 0.000103 2020-02-12 22:51:54,566 Epoch 86 Step: 209200 Batch Loss: 1.507880 Tokens per Sec: 22291, Lr: 0.000103 2020-02-12 22:52:04,809 Epoch 86 Step: 209300 Batch Loss: 1.450864 Tokens per Sec: 21617, Lr: 0.000103 2020-02-12 22:52:14,884 Epoch 86 Step: 209400 Batch Loss: 1.240270 Tokens per Sec: 21405, Lr: 0.000103 2020-02-12 22:52:24,880 Epoch 86 Step: 209500 Batch Loss: 1.420550 Tokens per Sec: 21661, Lr: 0.000103 2020-02-12 22:52:35,008 Epoch 86 Step: 209600 Batch Loss: 1.459025 Tokens per Sec: 21895, Lr: 0.000103 2020-02-12 22:52:45,124 Epoch 86 Step: 209700 Batch Loss: 1.416412 Tokens per Sec: 22109, Lr: 0.000103 2020-02-12 22:52:55,305 Epoch 86 Step: 209800 Batch Loss: 1.141683 Tokens per Sec: 21556, Lr: 0.000103 2020-02-12 22:53:05,504 Epoch 86 Step: 209900 Batch Loss: 1.438105 Tokens per Sec: 21544, Lr: 0.000103 2020-02-12 22:53:15,589 Epoch 86 Step: 210000 Batch Loss: 1.277638 Tokens per Sec: 21795, Lr: 0.000103 2020-02-12 22:53:35,031 Hooray! New best validation result [ppl]! 2020-02-12 22:53:35,031 Saving new checkpoint. 2020-02-12 22:53:35,221 Example #0 2020-02-12 22:53:35,221 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 22:53:35,221 Raw hypothesis: ['Er', 'm@@', 'ser@@', 'akaa', 'u', 'Yehova', 'a', 'ver', 'la', 'a', 'lu', 'u', 'tsan', 'gbem', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 22:53:35,221 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 22:53:35,221 Reference: 10 : ​ 6 - 9 . 2020-02-12 22:53:35,221 Hypothesis: Er mserakaa u Yehova a ver la a lu u tsan gbem yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la , shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-12 22:53:35,221 Example #1 2020-02-12 22:53:35,221 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 22:53:35,222 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 22:53:35,222 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 22:53:35,222 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 22:53:35,222 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-12 22:53:35,222 Example #2 2020-02-12 22:53:35,222 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 22:53:35,222 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 22:53:35,222 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 22:53:35,222 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 22:53:35,222 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 22:53:35,222 Example #3 2020-02-12 22:53:35,222 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 22:53:35,222 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'u', 'vough', 'ga', '.'] 2020-02-12 22:53:35,222 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 22:53:35,222 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 22:53:35,222 Hypothesis: Alaghga or nana lu eren kwagh u vough ga . 2020-02-12 22:53:35,223 Validation result (greedy) at epoch 86, step 210000: bleu: 29.43, loss: 39549.5117, ppl: 3.8036, duration: 19.6330s 2020-02-12 22:53:45,252 Epoch 86 Step: 210100 Batch Loss: 1.298950 Tokens per Sec: 22386, Lr: 0.000103 2020-02-12 22:53:55,191 Epoch 86 Step: 210200 Batch Loss: 1.261765 Tokens per Sec: 22366, Lr: 0.000103 2020-02-12 22:54:05,205 Epoch 86 Step: 210300 Batch Loss: 1.092652 Tokens per Sec: 21751, Lr: 0.000103 2020-02-12 22:54:15,183 Epoch 86 Step: 210400 Batch Loss: 1.181383 Tokens per Sec: 21847, Lr: 0.000103 2020-02-12 22:54:25,225 Epoch 86 Step: 210500 Batch Loss: 1.331336 Tokens per Sec: 21999, Lr: 0.000103 2020-02-12 22:54:35,091 Epoch 86 Step: 210600 Batch Loss: 1.166448 Tokens per Sec: 22691, Lr: 0.000103 2020-02-12 22:54:44,973 Epoch 86 Step: 210700 Batch Loss: 1.401404 Tokens per Sec: 22931, Lr: 0.000103 2020-02-12 22:54:54,920 Epoch 86 Step: 210800 Batch Loss: 1.619714 Tokens per Sec: 22349, Lr: 0.000103 2020-02-12 22:55:05,100 Epoch 86 Step: 210900 Batch Loss: 1.517558 Tokens per Sec: 21496, Lr: 0.000103 2020-02-12 22:55:15,164 Epoch 86 Step: 211000 Batch Loss: 1.323604 Tokens per Sec: 22169, Lr: 0.000103 2020-02-12 22:55:34,017 Example #0 2020-02-12 22:55:34,018 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 22:55:34,018 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 22:55:34,018 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 22:55:34,018 Reference: 10 : ​ 6 - 9 . 2020-02-12 22:55:34,018 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea za hemen u lun a dooshima u a lu a mi la , shi vea za hemen u lun a dooshima u a lu a mi la . — Marku 10 : 6 - 9 . 2020-02-12 22:55:34,018 Example #1 2020-02-12 22:55:34,018 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 22:55:34,018 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 22:55:34,018 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 22:55:34,018 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 22:55:34,018 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-12 22:55:34,018 Example #2 2020-02-12 22:55:34,019 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 22:55:34,019 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 22:55:34,019 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 22:55:34,019 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 22:55:34,019 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 22:55:34,019 Example #3 2020-02-12 22:55:34,019 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 22:55:34,019 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 22:55:34,019 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 22:55:34,019 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 22:55:34,019 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 22:55:34,019 Validation result (greedy) at epoch 86, step 211000: bleu: 29.46, loss: 39553.6211, ppl: 3.8041, duration: 18.8553s 2020-02-12 22:55:44,044 Epoch 86 Step: 211100 Batch Loss: 1.359267 Tokens per Sec: 21913, Lr: 0.000103 2020-02-12 22:55:54,030 Epoch 86 Step: 211200 Batch Loss: 1.382512 Tokens per Sec: 22013, Lr: 0.000103 2020-02-12 22:56:03,901 Epoch 86 Step: 211300 Batch Loss: 1.402342 Tokens per Sec: 22439, Lr: 0.000103 2020-02-12 22:56:13,787 Epoch 86 Step: 211400 Batch Loss: 1.460414 Tokens per Sec: 22649, Lr: 0.000103 2020-02-12 22:56:17,195 Epoch 86: total training loss 3162.03 2020-02-12 22:56:17,195 EPOCH 87 2020-02-12 22:56:24,166 Epoch 87 Step: 211500 Batch Loss: 1.175317 Tokens per Sec: 21446, Lr: 0.000103 2020-02-12 22:56:34,275 Epoch 87 Step: 211600 Batch Loss: 1.286226 Tokens per Sec: 22218, Lr: 0.000103 2020-02-12 22:56:44,318 Epoch 87 Step: 211700 Batch Loss: 1.217762 Tokens per Sec: 21991, Lr: 0.000103 2020-02-12 22:56:54,264 Epoch 87 Step: 211800 Batch Loss: 1.324904 Tokens per Sec: 21660, Lr: 0.000103 2020-02-12 22:57:04,300 Epoch 87 Step: 211900 Batch Loss: 1.094889 Tokens per Sec: 22295, Lr: 0.000103 2020-02-12 22:57:14,388 Epoch 87 Step: 212000 Batch Loss: 1.339270 Tokens per Sec: 21969, Lr: 0.000103 2020-02-12 22:57:33,238 Example #0 2020-02-12 22:57:33,238 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 22:57:33,238 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 've', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 22:57:33,238 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 22:57:33,238 Reference: 10 : ​ 6 - 9 . 2020-02-12 22:57:33,238 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima ve la , shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-12 22:57:33,238 Example #1 2020-02-12 22:57:33,239 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 22:57:33,239 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'sha', 'kpôô', 'yô', ',', 'a', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 22:57:33,239 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 22:57:33,239 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 22:57:33,239 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man sha kpôô yô , a mgbôghom ! — Rom . 2020-02-12 22:57:33,239 Example #2 2020-02-12 22:57:33,239 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 22:57:33,239 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 22:57:33,239 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 22:57:33,239 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 22:57:33,239 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 22:57:33,239 Example #3 2020-02-12 22:57:33,239 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 22:57:33,239 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 22:57:33,240 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 22:57:33,240 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 22:57:33,240 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 22:57:33,240 Validation result (greedy) at epoch 87, step 212000: bleu: 29.12, loss: 39641.3633, ppl: 3.8154, duration: 18.8515s 2020-02-12 22:57:43,223 Epoch 87 Step: 212100 Batch Loss: 1.453709 Tokens per Sec: 22617, Lr: 0.000103 2020-02-12 22:57:53,185 Epoch 87 Step: 212200 Batch Loss: 1.416278 Tokens per Sec: 22727, Lr: 0.000103 2020-02-12 22:58:03,048 Epoch 87 Step: 212300 Batch Loss: 1.095561 Tokens per Sec: 22416, Lr: 0.000103 2020-02-12 22:58:12,984 Epoch 87 Step: 212400 Batch Loss: 1.149526 Tokens per Sec: 22603, Lr: 0.000103 2020-02-12 22:58:22,896 Epoch 87 Step: 212500 Batch Loss: 0.888803 Tokens per Sec: 22293, Lr: 0.000103 2020-02-12 22:58:32,909 Epoch 87 Step: 212600 Batch Loss: 1.261353 Tokens per Sec: 22271, Lr: 0.000103 2020-02-12 22:58:42,936 Epoch 87 Step: 212700 Batch Loss: 1.477476 Tokens per Sec: 21939, Lr: 0.000103 2020-02-12 22:58:52,896 Epoch 87 Step: 212800 Batch Loss: 1.173187 Tokens per Sec: 21747, Lr: 0.000103 2020-02-12 22:59:02,795 Epoch 87 Step: 212900 Batch Loss: 1.270694 Tokens per Sec: 22541, Lr: 0.000103 2020-02-12 22:59:12,734 Epoch 87 Step: 213000 Batch Loss: 1.307757 Tokens per Sec: 22126, Lr: 0.000103 2020-02-12 22:59:31,405 Example #0 2020-02-12 22:59:31,405 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 22:59:31,405 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 've', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 22:59:31,405 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 22:59:31,405 Reference: 10 : ​ 6 - 9 . 2020-02-12 22:59:31,405 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima ve la , shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-12 22:59:31,405 Example #1 2020-02-12 22:59:31,405 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 22:59:31,405 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', ',', 'man', 'a', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 22:59:31,405 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 22:59:31,406 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 22:59:31,406 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung , man a mgbôghom ! — Rom . 2020-02-12 22:59:31,406 Example #2 2020-02-12 22:59:31,406 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 22:59:31,406 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 22:59:31,406 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 22:59:31,406 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 22:59:31,406 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 22:59:31,406 Example #3 2020-02-12 22:59:31,406 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 22:59:31,406 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 22:59:31,406 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 22:59:31,406 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 22:59:31,406 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 22:59:31,406 Validation result (greedy) at epoch 87, step 213000: bleu: 29.57, loss: 39588.5664, ppl: 3.8086, duration: 18.6721s 2020-02-12 22:59:41,310 Epoch 87 Step: 213100 Batch Loss: 1.119268 Tokens per Sec: 22139, Lr: 0.000103 2020-02-12 22:59:51,304 Epoch 87 Step: 213200 Batch Loss: 1.152141 Tokens per Sec: 21754, Lr: 0.000103 2020-02-12 23:00:01,179 Epoch 87 Step: 213300 Batch Loss: 1.302482 Tokens per Sec: 21776, Lr: 0.000103 2020-02-12 23:00:11,072 Epoch 87 Step: 213400 Batch Loss: 1.145281 Tokens per Sec: 22741, Lr: 0.000103 2020-02-12 23:00:21,019 Epoch 87 Step: 213500 Batch Loss: 1.326186 Tokens per Sec: 21756, Lr: 0.000103 2020-02-12 23:00:30,853 Epoch 87 Step: 213600 Batch Loss: 1.385772 Tokens per Sec: 22248, Lr: 0.000103 2020-02-12 23:00:40,733 Epoch 87 Step: 213700 Batch Loss: 1.370764 Tokens per Sec: 22217, Lr: 0.000103 2020-02-12 23:00:50,682 Epoch 87 Step: 213800 Batch Loss: 1.434734 Tokens per Sec: 21747, Lr: 0.000103 2020-02-12 23:00:59,928 Epoch 87: total training loss 3159.87 2020-02-12 23:00:59,928 EPOCH 88 2020-02-12 23:01:00,917 Epoch 88 Step: 213900 Batch Loss: 1.274835 Tokens per Sec: 15602, Lr: 0.000103 2020-02-12 23:01:10,945 Epoch 88 Step: 214000 Batch Loss: 1.310252 Tokens per Sec: 21456, Lr: 0.000103 2020-02-12 23:01:30,344 Example #0 2020-02-12 23:01:30,344 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 23:01:30,344 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 23:01:30,344 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 23:01:30,345 Reference: 10 : ​ 6 - 9 . 2020-02-12 23:01:30,345 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la , shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-12 23:01:30,345 Example #1 2020-02-12 23:01:30,345 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 23:01:30,345 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 23:01:30,345 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 23:01:30,345 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 23:01:30,345 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung , man kwagh ne mgbôghom ! — Rom . 2020-02-12 23:01:30,345 Example #2 2020-02-12 23:01:30,345 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 23:01:30,345 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 23:01:30,345 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 23:01:30,345 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 23:01:30,345 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 23:01:30,345 Example #3 2020-02-12 23:01:30,346 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 23:01:30,346 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 23:01:30,346 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 23:01:30,346 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 23:01:30,346 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 23:01:30,346 Validation result (greedy) at epoch 88, step 214000: bleu: 29.42, loss: 39608.9844, ppl: 3.8113, duration: 19.4004s 2020-02-12 23:01:40,279 Epoch 88 Step: 214100 Batch Loss: 1.367873 Tokens per Sec: 22242, Lr: 0.000103 2020-02-12 23:01:50,275 Epoch 88 Step: 214200 Batch Loss: 1.236583 Tokens per Sec: 22683, Lr: 0.000103 2020-02-12 23:02:00,208 Epoch 88 Step: 214300 Batch Loss: 1.163847 Tokens per Sec: 22577, Lr: 0.000103 2020-02-12 23:02:10,189 Epoch 88 Step: 214400 Batch Loss: 1.183205 Tokens per Sec: 22095, Lr: 0.000103 2020-02-12 23:02:20,182 Epoch 88 Step: 214500 Batch Loss: 1.403986 Tokens per Sec: 21800, Lr: 0.000103 2020-02-12 23:02:30,182 Epoch 88 Step: 214600 Batch Loss: 1.092327 Tokens per Sec: 21875, Lr: 0.000103 2020-02-12 23:02:40,071 Epoch 88 Step: 214700 Batch Loss: 1.038892 Tokens per Sec: 22137, Lr: 0.000103 2020-02-12 23:02:50,043 Epoch 88 Step: 214800 Batch Loss: 1.086157 Tokens per Sec: 22025, Lr: 0.000103 2020-02-12 23:03:00,014 Epoch 88 Step: 214900 Batch Loss: 1.301939 Tokens per Sec: 22439, Lr: 0.000103 2020-02-12 23:03:09,916 Epoch 88 Step: 215000 Batch Loss: 1.496245 Tokens per Sec: 22281, Lr: 0.000103 2020-02-12 23:03:28,852 Example #0 2020-02-12 23:03:28,853 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 23:03:28,853 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 23:03:28,853 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 23:03:28,853 Reference: 10 : ​ 6 - 9 . 2020-02-12 23:03:28,853 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la , shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-12 23:03:28,853 Example #1 2020-02-12 23:03:28,853 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 23:03:28,853 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'imba', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 23:03:28,853 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 23:03:28,853 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 23:03:28,853 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a imba shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-12 23:03:28,853 Example #2 2020-02-12 23:03:28,853 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 23:03:28,853 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 23:03:28,853 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 23:03:28,854 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 23:03:28,854 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 23:03:28,854 Example #3 2020-02-12 23:03:28,854 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 23:03:28,854 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 23:03:28,854 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 23:03:28,854 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 23:03:28,854 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 23:03:28,854 Validation result (greedy) at epoch 88, step 215000: bleu: 29.39, loss: 39584.8984, ppl: 3.8082, duration: 18.9373s 2020-02-12 23:03:38,710 Epoch 88 Step: 215100 Batch Loss: 0.940588 Tokens per Sec: 22237, Lr: 0.000103 2020-02-12 23:03:48,628 Epoch 88 Step: 215200 Batch Loss: 1.416263 Tokens per Sec: 22077, Lr: 0.000103 2020-02-12 23:03:58,502 Epoch 88 Step: 215300 Batch Loss: 1.334874 Tokens per Sec: 22177, Lr: 0.000103 2020-02-12 23:04:08,416 Epoch 88 Step: 215400 Batch Loss: 1.526115 Tokens per Sec: 22344, Lr: 0.000103 2020-02-12 23:04:18,434 Epoch 88 Step: 215500 Batch Loss: 1.437591 Tokens per Sec: 22031, Lr: 0.000103 2020-02-12 23:04:28,488 Epoch 88 Step: 215600 Batch Loss: 1.069366 Tokens per Sec: 21324, Lr: 0.000103 2020-02-12 23:04:38,546 Epoch 88 Step: 215700 Batch Loss: 1.330892 Tokens per Sec: 22354, Lr: 0.000103 2020-02-12 23:04:48,686 Epoch 88 Step: 215800 Batch Loss: 1.399746 Tokens per Sec: 21506, Lr: 0.000103 2020-02-12 23:04:58,749 Epoch 88 Step: 215900 Batch Loss: 1.227049 Tokens per Sec: 22737, Lr: 0.000103 2020-02-12 23:05:08,623 Epoch 88 Step: 216000 Batch Loss: 1.294156 Tokens per Sec: 22593, Lr: 0.000103 2020-02-12 23:05:27,033 Hooray! New best validation result [ppl]! 2020-02-12 23:05:27,034 Saving new checkpoint. 2020-02-12 23:05:27,220 Example #0 2020-02-12 23:05:27,220 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 23:05:27,220 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'her', 'dông', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 23:05:27,220 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 23:05:27,220 Reference: 10 : ​ 6 - 9 . 2020-02-12 23:05:27,221 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima her dông . — Marku 10 : 6 - 9 . 2020-02-12 23:05:27,221 Example #1 2020-02-12 23:05:27,221 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 23:05:27,221 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 23:05:27,221 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 23:05:27,221 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 23:05:27,221 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung , man kwagh ne mgbôghom ! — Rom . 2020-02-12 23:05:27,221 Example #2 2020-02-12 23:05:27,221 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 23:05:27,221 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 23:05:27,221 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 23:05:27,221 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 23:05:27,221 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 23:05:27,221 Example #3 2020-02-12 23:05:27,221 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 23:05:27,222 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 23:05:27,222 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 23:05:27,222 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 23:05:27,222 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 23:05:27,222 Validation result (greedy) at epoch 88, step 216000: bleu: 29.68, loss: 39467.8125, ppl: 3.7931, duration: 18.5979s 2020-02-12 23:05:37,105 Epoch 88 Step: 216100 Batch Loss: 1.286166 Tokens per Sec: 22745, Lr: 0.000103 2020-02-12 23:05:47,066 Epoch 88 Step: 216200 Batch Loss: 1.398020 Tokens per Sec: 21900, Lr: 0.000103 2020-02-12 23:05:56,983 Epoch 88 Step: 216300 Batch Loss: 1.415460 Tokens per Sec: 22593, Lr: 0.000103 2020-02-12 23:06:02,314 Epoch 88: total training loss 3157.41 2020-02-12 23:06:02,314 EPOCH 89 2020-02-12 23:06:07,205 Epoch 89 Step: 216400 Batch Loss: 1.442538 Tokens per Sec: 20314, Lr: 0.000103 2020-02-12 23:06:17,209 Epoch 89 Step: 216500 Batch Loss: 1.123962 Tokens per Sec: 21406, Lr: 0.000103 2020-02-12 23:06:27,274 Epoch 89 Step: 216600 Batch Loss: 1.331632 Tokens per Sec: 21856, Lr: 0.000103 2020-02-12 23:06:37,241 Epoch 89 Step: 216700 Batch Loss: 1.513521 Tokens per Sec: 22547, Lr: 0.000103 2020-02-12 23:06:47,201 Epoch 89 Step: 216800 Batch Loss: 1.367651 Tokens per Sec: 22442, Lr: 0.000103 2020-02-12 23:06:57,121 Epoch 89 Step: 216900 Batch Loss: 1.221874 Tokens per Sec: 22636, Lr: 0.000103 2020-02-12 23:07:06,998 Epoch 89 Step: 217000 Batch Loss: 1.104744 Tokens per Sec: 22265, Lr: 0.000103 2020-02-12 23:07:25,827 Example #0 2020-02-12 23:07:25,827 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 23:07:25,827 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'sha', 'gbenda', 'u', 'dooshima', 'una', 'fatyô', 'u', 'vesen', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 23:07:25,827 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 23:07:25,827 Reference: 10 : ​ 6 - 9 . 2020-02-12 23:07:25,827 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea za hemen u lun a dooshima u a lu a mi la , shi vea za hemen u lun a dooshima sha gbenda u dooshima una fatyô u vesen la . — Marku 10 : 6 - 9 . 2020-02-12 23:07:25,827 Example #1 2020-02-12 23:07:25,827 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 23:07:25,827 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 23:07:25,828 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 23:07:25,828 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 23:07:25,828 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung , man kwagh ne mgbôghom ! — Rom . 2020-02-12 23:07:25,828 Example #2 2020-02-12 23:07:25,828 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 23:07:25,828 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 23:07:25,828 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 23:07:25,828 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 23:07:25,828 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 23:07:25,828 Example #3 2020-02-12 23:07:25,828 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 23:07:25,828 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 23:07:25,828 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 23:07:25,828 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 23:07:25,828 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 23:07:25,828 Validation result (greedy) at epoch 89, step 217000: bleu: 29.51, loss: 39499.1797, ppl: 3.7972, duration: 18.8299s 2020-02-12 23:07:35,759 Epoch 89 Step: 217100 Batch Loss: 1.134571 Tokens per Sec: 22441, Lr: 0.000103 2020-02-12 23:07:45,565 Epoch 89 Step: 217200 Batch Loss: 1.350183 Tokens per Sec: 22393, Lr: 0.000103 2020-02-12 23:07:55,418 Epoch 89 Step: 217300 Batch Loss: 1.438214 Tokens per Sec: 21812, Lr: 0.000103 2020-02-12 23:08:05,282 Epoch 89 Step: 217400 Batch Loss: 0.900873 Tokens per Sec: 21858, Lr: 0.000103 2020-02-12 23:08:15,182 Epoch 89 Step: 217500 Batch Loss: 1.351045 Tokens per Sec: 23141, Lr: 0.000103 2020-02-12 23:08:25,061 Epoch 89 Step: 217600 Batch Loss: 1.256639 Tokens per Sec: 22109, Lr: 0.000103 2020-02-12 23:08:34,932 Epoch 89 Step: 217700 Batch Loss: 1.282933 Tokens per Sec: 23038, Lr: 0.000103 2020-02-12 23:08:44,835 Epoch 89 Step: 217800 Batch Loss: 1.267339 Tokens per Sec: 22469, Lr: 0.000103 2020-02-12 23:08:54,780 Epoch 89 Step: 217900 Batch Loss: 1.213416 Tokens per Sec: 22433, Lr: 0.000103 2020-02-12 23:09:04,690 Epoch 89 Step: 218000 Batch Loss: 1.218480 Tokens per Sec: 22910, Lr: 0.000103 2020-02-12 23:09:23,138 Hooray! New best validation result [ppl]! 2020-02-12 23:09:23,138 Saving new checkpoint. 2020-02-12 23:09:23,336 Example #0 2020-02-12 23:09:23,336 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 23:09:23,336 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'sha', 'afatyô', 've', 'cii', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 23:09:23,336 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 23:09:23,336 Reference: 10 : ​ 6 - 9 . 2020-02-12 23:09:23,337 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo sha afatyô ve cii vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-12 23:09:23,337 Example #1 2020-02-12 23:09:23,337 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 23:09:23,337 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'imba', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 23:09:23,337 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 23:09:23,337 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 23:09:23,337 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a imba shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-12 23:09:23,337 Example #2 2020-02-12 23:09:23,337 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 23:09:23,337 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 23:09:23,337 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 23:09:23,337 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 23:09:23,337 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 23:09:23,337 Example #3 2020-02-12 23:09:23,338 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 23:09:23,338 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 23:09:23,338 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 23:09:23,338 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 23:09:23,338 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 23:09:23,338 Validation result (greedy) at epoch 89, step 218000: bleu: 29.87, loss: 39446.5742, ppl: 3.7904, duration: 18.6478s 2020-02-12 23:09:33,447 Epoch 89 Step: 218100 Batch Loss: 1.370324 Tokens per Sec: 21458, Lr: 0.000103 2020-02-12 23:09:43,577 Epoch 89 Step: 218200 Batch Loss: 1.429103 Tokens per Sec: 21755, Lr: 0.000103 2020-02-12 23:09:53,479 Epoch 89 Step: 218300 Batch Loss: 1.327301 Tokens per Sec: 22242, Lr: 0.000103 2020-02-12 23:10:03,417 Epoch 89 Step: 218400 Batch Loss: 1.245061 Tokens per Sec: 22234, Lr: 0.000103 2020-02-12 23:10:13,329 Epoch 89 Step: 218500 Batch Loss: 1.261814 Tokens per Sec: 21683, Lr: 0.000103 2020-02-12 23:10:23,281 Epoch 89 Step: 218600 Batch Loss: 1.223626 Tokens per Sec: 22632, Lr: 0.000103 2020-02-12 23:10:33,390 Epoch 89 Step: 218700 Batch Loss: 1.402444 Tokens per Sec: 22249, Lr: 0.000103 2020-02-12 23:10:43,307 Epoch 89 Step: 218800 Batch Loss: 1.226146 Tokens per Sec: 22143, Lr: 0.000103 2020-02-12 23:10:44,393 Epoch 89: total training loss 3148.98 2020-02-12 23:10:44,393 EPOCH 90 2020-02-12 23:10:53,497 Epoch 90 Step: 218900 Batch Loss: 1.287873 Tokens per Sec: 21568, Lr: 0.000103 2020-02-12 23:11:03,352 Epoch 90 Step: 219000 Batch Loss: 1.228327 Tokens per Sec: 21739, Lr: 0.000103 2020-02-12 23:11:21,897 Example #0 2020-02-12 23:11:21,897 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 23:11:21,897 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 23:11:21,897 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 23:11:21,897 Reference: 10 : ​ 6 - 9 . 2020-02-12 23:11:21,897 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu hen atô ve la , shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-12 23:11:21,897 Example #1 2020-02-12 23:11:21,897 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 23:11:21,897 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'imba', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 23:11:21,897 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 23:11:21,897 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 23:11:21,897 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a imba shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-12 23:11:21,897 Example #2 2020-02-12 23:11:21,898 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 23:11:21,898 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 23:11:21,898 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 23:11:21,898 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 23:11:21,898 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 23:11:21,898 Example #3 2020-02-12 23:11:21,898 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 23:11:21,898 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 23:11:21,898 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 23:11:21,898 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 23:11:21,898 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-12 23:11:21,898 Validation result (greedy) at epoch 90, step 219000: bleu: 29.53, loss: 39518.9922, ppl: 3.7997, duration: 18.5458s 2020-02-12 23:11:31,762 Epoch 90 Step: 219100 Batch Loss: 1.241865 Tokens per Sec: 22361, Lr: 0.000103 2020-02-12 23:11:41,884 Epoch 90 Step: 219200 Batch Loss: 1.466341 Tokens per Sec: 21730, Lr: 0.000103 2020-02-12 23:11:52,039 Epoch 90 Step: 219300 Batch Loss: 1.098769 Tokens per Sec: 21972, Lr: 0.000103 2020-02-12 23:12:02,270 Epoch 90 Step: 219400 Batch Loss: 1.322962 Tokens per Sec: 21984, Lr: 0.000103 2020-02-12 23:12:12,492 Epoch 90 Step: 219500 Batch Loss: 1.358932 Tokens per Sec: 21720, Lr: 0.000103 2020-02-12 23:12:22,637 Epoch 90 Step: 219600 Batch Loss: 1.097305 Tokens per Sec: 21781, Lr: 0.000103 2020-02-12 23:12:32,502 Epoch 90 Step: 219700 Batch Loss: 1.087092 Tokens per Sec: 21783, Lr: 0.000103 2020-02-12 23:12:42,403 Epoch 90 Step: 219800 Batch Loss: 1.198030 Tokens per Sec: 22185, Lr: 0.000103 2020-02-12 23:12:52,338 Epoch 90 Step: 219900 Batch Loss: 1.401107 Tokens per Sec: 21619, Lr: 0.000103 2020-02-12 23:13:02,283 Epoch 90 Step: 220000 Batch Loss: 1.305738 Tokens per Sec: 22550, Lr: 0.000103 2020-02-12 23:13:21,783 Example #0 2020-02-12 23:13:21,783 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 23:13:21,783 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsan', 'gbem', 'sha', 'won', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 23:13:21,783 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 23:13:21,783 Reference: 10 : ​ 6 - 9 . 2020-02-12 23:13:21,783 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsan gbem sha won yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la , shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-12 23:13:21,783 Example #1 2020-02-12 23:13:21,784 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 23:13:21,784 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'imba', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 23:13:21,784 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 23:13:21,784 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 23:13:21,784 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a imba shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-12 23:13:21,784 Example #2 2020-02-12 23:13:21,784 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 23:13:21,784 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 23:13:21,784 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 23:13:21,784 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 23:13:21,784 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 23:13:21,784 Example #3 2020-02-12 23:13:21,784 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 23:13:21,784 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 23:13:21,784 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 23:13:21,784 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 23:13:21,785 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-12 23:13:21,785 Validation result (greedy) at epoch 90, step 220000: bleu: 29.58, loss: 39496.8516, ppl: 3.7969, duration: 19.5014s 2020-02-12 23:13:31,704 Epoch 90 Step: 220100 Batch Loss: 1.299061 Tokens per Sec: 22335, Lr: 0.000103 2020-02-12 23:13:41,698 Epoch 90 Step: 220200 Batch Loss: 1.329442 Tokens per Sec: 22091, Lr: 0.000103 2020-02-12 23:13:51,815 Epoch 90 Step: 220300 Batch Loss: 1.368086 Tokens per Sec: 21693, Lr: 0.000103 2020-02-12 23:14:01,915 Epoch 90 Step: 220400 Batch Loss: 1.332660 Tokens per Sec: 22303, Lr: 0.000103 2020-02-12 23:14:11,993 Epoch 90 Step: 220500 Batch Loss: 1.322164 Tokens per Sec: 21910, Lr: 0.000103 2020-02-12 23:14:22,063 Epoch 90 Step: 220600 Batch Loss: 1.436734 Tokens per Sec: 22088, Lr: 0.000103 2020-02-12 23:14:32,126 Epoch 90 Step: 220700 Batch Loss: 1.105280 Tokens per Sec: 21673, Lr: 0.000103 2020-02-12 23:14:42,229 Epoch 90 Step: 220800 Batch Loss: 1.323520 Tokens per Sec: 21805, Lr: 0.000103 2020-02-12 23:14:52,378 Epoch 90 Step: 220900 Batch Loss: 1.354424 Tokens per Sec: 22104, Lr: 0.000103 2020-02-12 23:15:02,490 Epoch 90 Step: 221000 Batch Loss: 1.285015 Tokens per Sec: 21677, Lr: 0.000103 2020-02-12 23:15:21,493 Example #0 2020-02-12 23:15:21,493 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 23:15:21,493 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 23:15:21,493 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 23:15:21,493 Reference: 10 : ​ 6 - 9 . 2020-02-12 23:15:21,493 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-12 23:15:21,494 Example #1 2020-02-12 23:15:21,494 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 23:15:21,494 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'imba', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 23:15:21,494 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 23:15:21,494 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 23:15:21,494 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a imba shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-12 23:15:21,494 Example #2 2020-02-12 23:15:21,494 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 23:15:21,494 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 23:15:21,494 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 23:15:21,494 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 23:15:21,494 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 23:15:21,494 Example #3 2020-02-12 23:15:21,494 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 23:15:21,494 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 23:15:21,495 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 23:15:21,495 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 23:15:21,495 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-12 23:15:21,495 Validation result (greedy) at epoch 90, step 221000: bleu: 29.23, loss: 39549.5391, ppl: 3.8036, duration: 19.0043s 2020-02-12 23:15:31,578 Epoch 90 Step: 221100 Batch Loss: 1.426591 Tokens per Sec: 21591, Lr: 0.000103 2020-02-12 23:15:41,488 Epoch 90 Step: 221200 Batch Loss: 1.290277 Tokens per Sec: 22407, Lr: 0.000103 2020-02-12 23:15:49,116 Epoch 90: total training loss 3154.01 2020-02-12 23:15:49,116 EPOCH 91 2020-02-12 23:15:51,961 Epoch 91 Step: 221300 Batch Loss: 1.112750 Tokens per Sec: 19287, Lr: 0.000103 2020-02-12 23:16:02,071 Epoch 91 Step: 221400 Batch Loss: 1.192372 Tokens per Sec: 21518, Lr: 0.000103 2020-02-12 23:16:12,190 Epoch 91 Step: 221500 Batch Loss: 1.175463 Tokens per Sec: 22539, Lr: 0.000103 2020-02-12 23:16:22,076 Epoch 91 Step: 221600 Batch Loss: 1.136321 Tokens per Sec: 22081, Lr: 0.000103 2020-02-12 23:16:31,971 Epoch 91 Step: 221700 Batch Loss: 1.270300 Tokens per Sec: 22181, Lr: 0.000103 2020-02-12 23:16:41,889 Epoch 91 Step: 221800 Batch Loss: 1.286737 Tokens per Sec: 22426, Lr: 0.000103 2020-02-12 23:16:51,819 Epoch 91 Step: 221900 Batch Loss: 1.205855 Tokens per Sec: 22880, Lr: 0.000103 2020-02-12 23:17:01,698 Epoch 91 Step: 222000 Batch Loss: 1.133239 Tokens per Sec: 21852, Lr: 0.000103 2020-02-12 23:17:20,384 Example #0 2020-02-12 23:17:20,384 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 23:17:20,384 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'her', 'dông', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 23:17:20,384 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 23:17:20,385 Reference: 10 : ​ 6 - 9 . 2020-02-12 23:17:20,385 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima her dông . — Marku 10 : 6 - 9 . 2020-02-12 23:17:20,385 Example #1 2020-02-12 23:17:20,385 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 23:17:20,385 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'imba', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 23:17:20,385 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 23:17:20,385 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 23:17:20,385 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a imba shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-12 23:17:20,385 Example #2 2020-02-12 23:17:20,385 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 23:17:20,385 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 23:17:20,385 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 23:17:20,385 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 23:17:20,385 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 23:17:20,385 Example #3 2020-02-12 23:17:20,386 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 23:17:20,386 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 23:17:20,386 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 23:17:20,386 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 23:17:20,386 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-12 23:17:20,386 Validation result (greedy) at epoch 91, step 222000: bleu: 29.38, loss: 39497.5547, ppl: 3.7969, duration: 18.6874s 2020-02-12 23:17:30,270 Epoch 91 Step: 222100 Batch Loss: 1.408313 Tokens per Sec: 22813, Lr: 0.000103 2020-02-12 23:17:40,151 Epoch 91 Step: 222200 Batch Loss: 1.410067 Tokens per Sec: 22309, Lr: 0.000103 2020-02-12 23:17:50,088 Epoch 91 Step: 222300 Batch Loss: 1.470792 Tokens per Sec: 22055, Lr: 0.000103 2020-02-12 23:18:00,071 Epoch 91 Step: 222400 Batch Loss: 1.411335 Tokens per Sec: 22412, Lr: 0.000103 2020-02-12 23:18:10,048 Epoch 91 Step: 222500 Batch Loss: 1.068195 Tokens per Sec: 22216, Lr: 0.000103 2020-02-12 23:18:20,078 Epoch 91 Step: 222600 Batch Loss: 1.160723 Tokens per Sec: 21928, Lr: 0.000103 2020-02-12 23:18:30,069 Epoch 91 Step: 222700 Batch Loss: 1.317621 Tokens per Sec: 21941, Lr: 0.000103 2020-02-12 23:18:40,037 Epoch 91 Step: 222800 Batch Loss: 0.915604 Tokens per Sec: 22409, Lr: 0.000103 2020-02-12 23:18:50,128 Epoch 91 Step: 222900 Batch Loss: 1.467255 Tokens per Sec: 21679, Lr: 0.000103 2020-02-12 23:19:00,358 Epoch 91 Step: 223000 Batch Loss: 1.202667 Tokens per Sec: 22223, Lr: 0.000103 2020-02-12 23:19:19,442 Hooray! New best validation result [ppl]! 2020-02-12 23:19:19,442 Saving new checkpoint. 2020-02-12 23:19:19,642 Example #0 2020-02-12 23:19:19,642 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 23:19:19,642 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 23:19:19,642 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 23:19:19,642 Reference: 10 : ​ 6 - 9 . 2020-02-12 23:19:19,643 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la , shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-12 23:19:19,643 Example #1 2020-02-12 23:19:19,643 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 23:19:19,643 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 23:19:19,643 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 23:19:19,643 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 23:19:19,643 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung , man kwagh ne mgbôghom ! — Rom . 2020-02-12 23:19:19,643 Example #2 2020-02-12 23:19:19,643 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 23:19:19,643 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 23:19:19,643 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 23:19:19,643 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 23:19:19,643 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 23:19:19,643 Example #3 2020-02-12 23:19:19,643 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 23:19:19,643 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 23:19:19,644 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 23:19:19,644 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 23:19:19,644 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-12 23:19:19,644 Validation result (greedy) at epoch 91, step 223000: bleu: 29.59, loss: 39435.6875, ppl: 3.7890, duration: 19.2855s 2020-02-12 23:19:29,579 Epoch 91 Step: 223100 Batch Loss: 1.351202 Tokens per Sec: 22254, Lr: 0.000103 2020-02-12 23:19:39,478 Epoch 91 Step: 223200 Batch Loss: 1.270554 Tokens per Sec: 21834, Lr: 0.000103 2020-02-12 23:19:49,404 Epoch 91 Step: 223300 Batch Loss: 1.132722 Tokens per Sec: 22760, Lr: 0.000103 2020-02-12 23:19:59,348 Epoch 91 Step: 223400 Batch Loss: 1.352542 Tokens per Sec: 22281, Lr: 0.000103 2020-02-12 23:20:09,334 Epoch 91 Step: 223500 Batch Loss: 1.305934 Tokens per Sec: 21891, Lr: 0.000103 2020-02-12 23:20:19,214 Epoch 91 Step: 223600 Batch Loss: 1.355568 Tokens per Sec: 22274, Lr: 0.000103 2020-02-12 23:20:29,103 Epoch 91 Step: 223700 Batch Loss: 1.122683 Tokens per Sec: 21928, Lr: 0.000103 2020-02-12 23:20:32,503 Epoch 91: total training loss 3145.88 2020-02-12 23:20:32,503 EPOCH 92 2020-02-12 23:20:39,450 Epoch 92 Step: 223800 Batch Loss: 1.219225 Tokens per Sec: 21285, Lr: 0.000103 2020-02-12 23:20:49,503 Epoch 92 Step: 223900 Batch Loss: 1.359434 Tokens per Sec: 21822, Lr: 0.000103 2020-02-12 23:20:59,512 Epoch 92 Step: 224000 Batch Loss: 1.318579 Tokens per Sec: 21431, Lr: 0.000103 2020-02-12 23:21:18,767 Example #0 2020-02-12 23:21:18,767 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 23:21:18,767 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'her', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 23:21:18,767 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 23:21:18,768 Reference: 10 : ​ 6 - 9 . 2020-02-12 23:21:18,768 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu hen atô ve la , shi vea za hemen u lun a dooshima u a lu her la her . — Marku 10 : 6 - 9 . 2020-02-12 23:21:18,768 Example #1 2020-02-12 23:21:18,768 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 23:21:18,768 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 23:21:18,768 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 23:21:18,768 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 23:21:18,768 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung , man kwagh ne mgbôghom ! — Rom . 2020-02-12 23:21:18,768 Example #2 2020-02-12 23:21:18,768 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 23:21:18,768 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 23:21:18,768 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 23:21:18,768 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 23:21:18,768 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 23:21:18,768 Example #3 2020-02-12 23:21:18,769 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 23:21:18,769 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 23:21:18,769 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 23:21:18,769 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 23:21:18,769 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-12 23:21:18,769 Validation result (greedy) at epoch 92, step 224000: bleu: 29.58, loss: 39519.3008, ppl: 3.7997, duration: 19.2563s 2020-02-12 23:21:28,994 Epoch 92 Step: 224100 Batch Loss: 1.449481 Tokens per Sec: 22206, Lr: 0.000103 2020-02-12 23:21:39,149 Epoch 92 Step: 224200 Batch Loss: 1.425157 Tokens per Sec: 21459, Lr: 0.000103 2020-02-12 23:21:49,317 Epoch 92 Step: 224300 Batch Loss: 0.955275 Tokens per Sec: 21506, Lr: 0.000103 2020-02-12 23:21:59,454 Epoch 92 Step: 224400 Batch Loss: 1.317077 Tokens per Sec: 22418, Lr: 0.000103 2020-02-12 23:22:09,722 Epoch 92 Step: 224500 Batch Loss: 1.332977 Tokens per Sec: 21598, Lr: 0.000103 2020-02-12 23:22:19,834 Epoch 92 Step: 224600 Batch Loss: 1.347670 Tokens per Sec: 21795, Lr: 0.000103 2020-02-12 23:22:30,002 Epoch 92 Step: 224700 Batch Loss: 1.435881 Tokens per Sec: 21831, Lr: 0.000103 2020-02-12 23:22:40,021 Epoch 92 Step: 224800 Batch Loss: 1.236097 Tokens per Sec: 22064, Lr: 0.000103 2020-02-12 23:22:49,956 Epoch 92 Step: 224900 Batch Loss: 1.283874 Tokens per Sec: 22484, Lr: 0.000103 2020-02-12 23:22:59,878 Epoch 92 Step: 225000 Batch Loss: 1.055462 Tokens per Sec: 22362, Lr: 0.000103 2020-02-12 23:23:18,580 Example #0 2020-02-12 23:23:18,580 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 23:23:18,580 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'her', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 23:23:18,580 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 23:23:18,580 Reference: 10 : ​ 6 - 9 . 2020-02-12 23:23:18,580 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu hen atô ve la , shi vea za hemen u lun a dooshima u a lu her la her . — Marku 10 : 6 - 9 . 2020-02-12 23:23:18,580 Example #1 2020-02-12 23:23:18,580 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 23:23:18,580 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 23:23:18,580 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 23:23:18,580 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 23:23:18,580 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung , man kwagh ne mgbôghom ! — Rom . 2020-02-12 23:23:18,581 Example #2 2020-02-12 23:23:18,581 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 23:23:18,581 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 23:23:18,581 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 23:23:18,581 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 23:23:18,581 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 23:23:18,581 Example #3 2020-02-12 23:23:18,581 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 23:23:18,581 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 23:23:18,581 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 23:23:18,581 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 23:23:18,581 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-12 23:23:18,581 Validation result (greedy) at epoch 92, step 225000: bleu: 29.45, loss: 39526.1836, ppl: 3.8006, duration: 18.7027s 2020-02-12 23:23:28,582 Epoch 92 Step: 225100 Batch Loss: 1.336806 Tokens per Sec: 22267, Lr: 0.000103 2020-02-12 23:23:38,570 Epoch 92 Step: 225200 Batch Loss: 1.139258 Tokens per Sec: 21613, Lr: 0.000103 2020-02-12 23:23:48,592 Epoch 92 Step: 225300 Batch Loss: 1.363706 Tokens per Sec: 22802, Lr: 0.000103 2020-02-12 23:23:58,522 Epoch 92 Step: 225400 Batch Loss: 1.431599 Tokens per Sec: 21821, Lr: 0.000103 2020-02-12 23:24:08,475 Epoch 92 Step: 225500 Batch Loss: 1.508884 Tokens per Sec: 21925, Lr: 0.000103 2020-02-12 23:24:18,492 Epoch 92 Step: 225600 Batch Loss: 1.314240 Tokens per Sec: 22205, Lr: 0.000103 2020-02-12 23:24:28,496 Epoch 92 Step: 225700 Batch Loss: 1.275360 Tokens per Sec: 22045, Lr: 0.000103 2020-02-12 23:24:38,396 Epoch 92 Step: 225800 Batch Loss: 1.248255 Tokens per Sec: 22166, Lr: 0.000103 2020-02-12 23:24:48,336 Epoch 92 Step: 225900 Batch Loss: 1.521246 Tokens per Sec: 22589, Lr: 0.000103 2020-02-12 23:24:58,213 Epoch 92 Step: 226000 Batch Loss: 1.182468 Tokens per Sec: 22580, Lr: 0.000103 2020-02-12 23:25:17,160 Hooray! New best validation result [ppl]! 2020-02-12 23:25:17,160 Saving new checkpoint. 2020-02-12 23:25:17,348 Example #0 2020-02-12 23:25:17,348 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 23:25:17,348 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 23:25:17,348 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 23:25:17,348 Reference: 10 : ​ 6 - 9 . 2020-02-12 23:25:17,348 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la , shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-12 23:25:17,348 Example #1 2020-02-12 23:25:17,348 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 23:25:17,348 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 23:25:17,348 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 23:25:17,349 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 23:25:17,349 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung , man kwagh ne mgbôghom ! — Rom . 2020-02-12 23:25:17,349 Example #2 2020-02-12 23:25:17,349 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 23:25:17,349 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 23:25:17,349 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 23:25:17,349 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 23:25:17,349 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 23:25:17,349 Example #3 2020-02-12 23:25:17,349 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 23:25:17,349 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 23:25:17,349 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 23:25:17,349 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 23:25:17,349 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-12 23:25:17,350 Validation result (greedy) at epoch 92, step 226000: bleu: 29.29, loss: 39384.3594, ppl: 3.7825, duration: 19.1359s 2020-02-12 23:25:27,279 Epoch 92 Step: 226100 Batch Loss: 1.421101 Tokens per Sec: 22346, Lr: 0.000103 2020-02-12 23:25:36,059 Epoch 92: total training loss 3134.55 2020-02-12 23:25:36,059 EPOCH 93 2020-02-12 23:25:37,425 Epoch 93 Step: 226200 Batch Loss: 1.347747 Tokens per Sec: 19513, Lr: 0.000103 2020-02-12 23:25:47,481 Epoch 93 Step: 226300 Batch Loss: 1.178352 Tokens per Sec: 21791, Lr: 0.000103 2020-02-12 23:25:57,412 Epoch 93 Step: 226400 Batch Loss: 1.328430 Tokens per Sec: 22107, Lr: 0.000103 2020-02-12 23:26:07,379 Epoch 93 Step: 226500 Batch Loss: 1.203349 Tokens per Sec: 22488, Lr: 0.000103 2020-02-12 23:26:17,416 Epoch 93 Step: 226600 Batch Loss: 1.450434 Tokens per Sec: 22531, Lr: 0.000103 2020-02-12 23:26:27,437 Epoch 93 Step: 226700 Batch Loss: 1.209847 Tokens per Sec: 21765, Lr: 0.000103 2020-02-12 23:26:37,345 Epoch 93 Step: 226800 Batch Loss: 1.353227 Tokens per Sec: 22547, Lr: 0.000103 2020-02-12 23:26:47,452 Epoch 93 Step: 226900 Batch Loss: 1.396100 Tokens per Sec: 21553, Lr: 0.000103 2020-02-12 23:26:57,518 Epoch 93 Step: 227000 Batch Loss: 1.174239 Tokens per Sec: 21942, Lr: 0.000103 2020-02-12 23:27:17,165 Example #0 2020-02-12 23:27:17,165 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 23:27:17,165 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 23:27:17,165 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 23:27:17,165 Reference: 10 : ​ 6 - 9 . 2020-02-12 23:27:17,165 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la , shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-12 23:27:17,165 Example #1 2020-02-12 23:27:17,165 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 23:27:17,165 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 23:27:17,165 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 23:27:17,165 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 23:27:17,165 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-12 23:27:17,166 Example #2 2020-02-12 23:27:17,166 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 23:27:17,166 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 23:27:17,166 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 23:27:17,166 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 23:27:17,166 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 23:27:17,166 Example #3 2020-02-12 23:27:17,166 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 23:27:17,166 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'u', 'vough', 'ga', '.'] 2020-02-12 23:27:17,166 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 23:27:17,166 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 23:27:17,166 Hypothesis: Alaghga or nana lu eren kwagh u vough ga . 2020-02-12 23:27:17,166 Validation result (greedy) at epoch 93, step 227000: bleu: 29.58, loss: 39556.0234, ppl: 3.8045, duration: 19.6476s 2020-02-12 23:27:27,271 Epoch 93 Step: 227100 Batch Loss: 1.228763 Tokens per Sec: 21756, Lr: 0.000103 2020-02-12 23:27:37,173 Epoch 93 Step: 227200 Batch Loss: 1.346804 Tokens per Sec: 21737, Lr: 0.000103 2020-02-12 23:27:47,133 Epoch 93 Step: 227300 Batch Loss: 1.363766 Tokens per Sec: 22532, Lr: 0.000103 2020-02-12 23:27:57,055 Epoch 93 Step: 227400 Batch Loss: 1.403643 Tokens per Sec: 22331, Lr: 0.000103 2020-02-12 23:28:07,002 Epoch 93 Step: 227500 Batch Loss: 1.233686 Tokens per Sec: 22423, Lr: 0.000103 2020-02-12 23:28:16,908 Epoch 93 Step: 227600 Batch Loss: 1.225462 Tokens per Sec: 22349, Lr: 0.000103 2020-02-12 23:28:26,886 Epoch 93 Step: 227700 Batch Loss: 1.286699 Tokens per Sec: 22044, Lr: 0.000103 2020-02-12 23:28:36,833 Epoch 93 Step: 227800 Batch Loss: 1.231485 Tokens per Sec: 22122, Lr: 0.000103 2020-02-12 23:28:46,861 Epoch 93 Step: 227900 Batch Loss: 1.323736 Tokens per Sec: 22217, Lr: 0.000103 2020-02-12 23:28:56,782 Epoch 93 Step: 228000 Batch Loss: 1.588903 Tokens per Sec: 22135, Lr: 0.000103 2020-02-12 23:29:15,414 Example #0 2020-02-12 23:29:15,414 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 23:29:15,414 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 23:29:15,414 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 23:29:15,414 Reference: 10 : ​ 6 - 9 . 2020-02-12 23:29:15,414 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu hen atô ve la , shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-12 23:29:15,415 Example #1 2020-02-12 23:29:15,415 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 23:29:15,415 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 23:29:15,415 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 23:29:15,415 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 23:29:15,415 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-12 23:29:15,415 Example #2 2020-02-12 23:29:15,415 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 23:29:15,415 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 23:29:15,415 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 23:29:15,415 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 23:29:15,415 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 23:29:15,415 Example #3 2020-02-12 23:29:15,415 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 23:29:15,415 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 23:29:15,416 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 23:29:15,416 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 23:29:15,416 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-12 23:29:15,416 Validation result (greedy) at epoch 93, step 228000: bleu: 29.53, loss: 39437.6836, ppl: 3.7893, duration: 18.6336s 2020-02-12 23:29:25,419 Epoch 93 Step: 228100 Batch Loss: 1.302343 Tokens per Sec: 22580, Lr: 0.000103 2020-02-12 23:29:35,480 Epoch 93 Step: 228200 Batch Loss: 1.264326 Tokens per Sec: 22070, Lr: 0.000103 2020-02-12 23:29:45,559 Epoch 93 Step: 228300 Batch Loss: 1.496655 Tokens per Sec: 22064, Lr: 0.000103 2020-02-12 23:29:55,688 Epoch 93 Step: 228400 Batch Loss: 1.262476 Tokens per Sec: 21438, Lr: 0.000103 2020-02-12 23:30:05,800 Epoch 93 Step: 228500 Batch Loss: 1.368951 Tokens per Sec: 21600, Lr: 0.000103 2020-02-12 23:30:15,898 Epoch 93 Step: 228600 Batch Loss: 1.359663 Tokens per Sec: 21469, Lr: 0.000103 2020-02-12 23:30:20,985 Epoch 93: total training loss 3138.93 2020-02-12 23:30:20,986 EPOCH 94 2020-02-12 23:30:26,507 Epoch 94 Step: 228700 Batch Loss: 1.584251 Tokens per Sec: 20598, Lr: 0.000103 2020-02-12 23:30:36,665 Epoch 94 Step: 228800 Batch Loss: 1.323829 Tokens per Sec: 21917, Lr: 0.000103 2020-02-12 23:30:46,686 Epoch 94 Step: 228900 Batch Loss: 1.384954 Tokens per Sec: 21541, Lr: 0.000103 2020-02-12 23:30:56,594 Epoch 94 Step: 229000 Batch Loss: 1.068537 Tokens per Sec: 22620, Lr: 0.000103 2020-02-12 23:31:15,387 Example #0 2020-02-12 23:31:15,388 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 23:31:15,388 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 23:31:15,388 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 23:31:15,388 Reference: 10 : ​ 6 - 9 . 2020-02-12 23:31:15,388 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu hen atô ve la , shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-12 23:31:15,388 Example #1 2020-02-12 23:31:15,388 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 23:31:15,388 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'sha', 'kpôô', 'yô', ',', 'ngu', 'ikyua', '!', '—', 'Rom', '.'] 2020-02-12 23:31:15,388 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 23:31:15,388 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 23:31:15,388 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man sha kpôô yô , ngu ikyua ! — Rom . 2020-02-12 23:31:15,388 Example #2 2020-02-12 23:31:15,388 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 23:31:15,388 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 23:31:15,388 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 23:31:15,389 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 23:31:15,389 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 23:31:15,389 Example #3 2020-02-12 23:31:15,389 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 23:31:15,389 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 23:31:15,389 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 23:31:15,389 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 23:31:15,389 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-12 23:31:15,389 Validation result (greedy) at epoch 94, step 229000: bleu: 29.57, loss: 39496.6016, ppl: 3.7968, duration: 18.7943s 2020-02-12 23:31:25,315 Epoch 94 Step: 229100 Batch Loss: 0.952601 Tokens per Sec: 21880, Lr: 0.000103 2020-02-12 23:31:35,194 Epoch 94 Step: 229200 Batch Loss: 1.308291 Tokens per Sec: 22556, Lr: 0.000103 2020-02-12 23:31:45,076 Epoch 94 Step: 229300 Batch Loss: 1.264194 Tokens per Sec: 22783, Lr: 0.000103 2020-02-12 23:31:55,001 Epoch 94 Step: 229400 Batch Loss: 1.302657 Tokens per Sec: 22784, Lr: 0.000103 2020-02-12 23:32:04,877 Epoch 94 Step: 229500 Batch Loss: 1.278199 Tokens per Sec: 22420, Lr: 0.000103 2020-02-12 23:32:14,717 Epoch 94 Step: 229600 Batch Loss: 1.293654 Tokens per Sec: 22171, Lr: 0.000103 2020-02-12 23:32:24,660 Epoch 94 Step: 229700 Batch Loss: 1.202136 Tokens per Sec: 22543, Lr: 0.000103 2020-02-12 23:32:34,784 Epoch 94 Step: 229800 Batch Loss: 1.308164 Tokens per Sec: 22163, Lr: 0.000103 2020-02-12 23:32:44,777 Epoch 94 Step: 229900 Batch Loss: 1.193974 Tokens per Sec: 22024, Lr: 0.000103 2020-02-12 23:32:54,860 Epoch 94 Step: 230000 Batch Loss: 1.297089 Tokens per Sec: 21940, Lr: 0.000103 2020-02-12 23:33:13,337 Example #0 2020-02-12 23:33:13,338 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 23:33:13,338 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 23:33:13,338 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 23:33:13,338 Reference: 10 : ​ 6 - 9 . 2020-02-12 23:33:13,338 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu hen atô ve la , shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-12 23:33:13,338 Example #1 2020-02-12 23:33:13,338 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 23:33:13,338 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'sha', 'kpôô', 'yô', ',', 'ngu', 'ikyua', '!', '—', 'Rom', '.'] 2020-02-12 23:33:13,338 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 23:33:13,338 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 23:33:13,338 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man sha kpôô yô , ngu ikyua ! — Rom . 2020-02-12 23:33:13,339 Example #2 2020-02-12 23:33:13,339 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 23:33:13,339 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 23:33:13,339 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 23:33:13,339 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 23:33:13,339 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 23:33:13,339 Example #3 2020-02-12 23:33:13,339 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 23:33:13,339 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 23:33:13,339 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 23:33:13,339 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 23:33:13,339 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-12 23:33:13,339 Validation result (greedy) at epoch 94, step 230000: bleu: 29.45, loss: 39400.9492, ppl: 3.7846, duration: 18.4790s 2020-02-12 23:33:23,331 Epoch 94 Step: 230100 Batch Loss: 1.284069 Tokens per Sec: 22386, Lr: 0.000103 2020-02-12 23:33:33,126 Epoch 94 Step: 230200 Batch Loss: 1.280942 Tokens per Sec: 21520, Lr: 0.000103 2020-02-12 23:33:42,970 Epoch 94 Step: 230300 Batch Loss: 1.245737 Tokens per Sec: 22135, Lr: 0.000103 2020-02-12 23:33:52,916 Epoch 94 Step: 230400 Batch Loss: 1.127697 Tokens per Sec: 22079, Lr: 0.000103 2020-02-12 23:34:02,861 Epoch 94 Step: 230500 Batch Loss: 1.136296 Tokens per Sec: 22468, Lr: 0.000103 2020-02-12 23:34:12,789 Epoch 94 Step: 230600 Batch Loss: 1.399842 Tokens per Sec: 21924, Lr: 0.000103 2020-02-12 23:34:22,713 Epoch 94 Step: 230700 Batch Loss: 0.957921 Tokens per Sec: 22566, Lr: 0.000103 2020-02-12 23:34:32,744 Epoch 94 Step: 230800 Batch Loss: 1.054194 Tokens per Sec: 22111, Lr: 0.000103 2020-02-12 23:34:42,906 Epoch 94 Step: 230900 Batch Loss: 1.104918 Tokens per Sec: 21240, Lr: 0.000103 2020-02-12 23:34:52,924 Epoch 94 Step: 231000 Batch Loss: 1.182128 Tokens per Sec: 22416, Lr: 0.000103 2020-02-12 23:35:11,219 Example #0 2020-02-12 23:35:11,219 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 23:35:11,219 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'doo', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 23:35:11,219 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 23:35:11,219 Reference: 10 : ​ 6 - 9 . 2020-02-12 23:35:11,219 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , doo u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la , shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-12 23:35:11,219 Example #1 2020-02-12 23:35:11,219 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 23:35:11,219 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 23:35:11,219 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 23:35:11,219 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 23:35:11,219 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-12 23:35:11,220 Example #2 2020-02-12 23:35:11,220 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 23:35:11,220 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 23:35:11,220 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 23:35:11,220 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 23:35:11,220 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 23:35:11,220 Example #3 2020-02-12 23:35:11,220 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 23:35:11,220 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 23:35:11,220 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 23:35:11,220 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 23:35:11,220 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 23:35:11,220 Validation result (greedy) at epoch 94, step 231000: bleu: 29.72, loss: 39428.5859, ppl: 3.7881, duration: 18.2960s 2020-02-12 23:35:21,186 Epoch 94 Step: 231100 Batch Loss: 1.421989 Tokens per Sec: 21925, Lr: 0.000103 2020-02-12 23:35:22,074 Epoch 94: total training loss 3137.03 2020-02-12 23:35:22,074 EPOCH 95 2020-02-12 23:35:31,512 Epoch 95 Step: 231200 Batch Loss: 1.312455 Tokens per Sec: 21232, Lr: 0.000103 2020-02-12 23:35:41,589 Epoch 95 Step: 231300 Batch Loss: 1.464313 Tokens per Sec: 21826, Lr: 0.000103 2020-02-12 23:35:51,723 Epoch 95 Step: 231400 Batch Loss: 1.088715 Tokens per Sec: 21594, Lr: 0.000103 2020-02-12 23:36:01,838 Epoch 95 Step: 231500 Batch Loss: 1.198211 Tokens per Sec: 22108, Lr: 0.000103 2020-02-12 23:36:12,026 Epoch 95 Step: 231600 Batch Loss: 1.220525 Tokens per Sec: 21123, Lr: 0.000103 2020-02-12 23:36:22,262 Epoch 95 Step: 231700 Batch Loss: 1.063209 Tokens per Sec: 21966, Lr: 0.000103 2020-02-12 23:36:32,256 Epoch 95 Step: 231800 Batch Loss: 1.324443 Tokens per Sec: 22602, Lr: 0.000103 2020-02-12 23:36:42,325 Epoch 95 Step: 231900 Batch Loss: 1.408743 Tokens per Sec: 22012, Lr: 0.000103 2020-02-12 23:36:52,552 Epoch 95 Step: 232000 Batch Loss: 1.321494 Tokens per Sec: 21729, Lr: 0.000103 2020-02-12 23:37:12,161 Example #0 2020-02-12 23:37:12,161 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 23:37:12,161 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'sha', 'afatyô', 've', 'cii', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 23:37:12,161 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 23:37:12,161 Reference: 10 : ​ 6 - 9 . 2020-02-12 23:37:12,161 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo sha afatyô ve cii vea lu a dooshima u a lu a mi la , shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-12 23:37:12,161 Example #1 2020-02-12 23:37:12,162 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 23:37:12,162 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'sha', 'kpôô', 'yô', ',', 'ngu', 'ikyua', '!', '—', 'Rom', '.'] 2020-02-12 23:37:12,162 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 23:37:12,162 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 23:37:12,162 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man sha kpôô yô , ngu ikyua ! — Rom . 2020-02-12 23:37:12,162 Example #2 2020-02-12 23:37:12,162 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 23:37:12,162 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 23:37:12,162 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 23:37:12,162 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 23:37:12,162 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 23:37:12,162 Example #3 2020-02-12 23:37:12,162 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 23:37:12,162 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 23:37:12,162 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 23:37:12,163 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 23:37:12,163 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-12 23:37:12,163 Validation result (greedy) at epoch 95, step 232000: bleu: 29.60, loss: 39418.9453, ppl: 3.7869, duration: 19.6100s 2020-02-12 23:37:22,247 Epoch 95 Step: 232100 Batch Loss: 1.116282 Tokens per Sec: 21633, Lr: 0.000072 2020-02-12 23:37:32,364 Epoch 95 Step: 232200 Batch Loss: 1.202228 Tokens per Sec: 21650, Lr: 0.000072 2020-02-12 23:37:42,431 Epoch 95 Step: 232300 Batch Loss: 1.376546 Tokens per Sec: 21434, Lr: 0.000072 2020-02-12 23:37:52,569 Epoch 95 Step: 232400 Batch Loss: 1.149508 Tokens per Sec: 21688, Lr: 0.000072 2020-02-12 23:38:02,615 Epoch 95 Step: 232500 Batch Loss: 1.176171 Tokens per Sec: 22042, Lr: 0.000072 2020-02-12 23:38:12,702 Epoch 95 Step: 232600 Batch Loss: 1.278229 Tokens per Sec: 22009, Lr: 0.000072 2020-02-12 23:38:22,806 Epoch 95 Step: 232700 Batch Loss: 1.562546 Tokens per Sec: 21839, Lr: 0.000072 2020-02-12 23:38:32,660 Epoch 95 Step: 232800 Batch Loss: 1.314792 Tokens per Sec: 22490, Lr: 0.000072 2020-02-12 23:38:42,533 Epoch 95 Step: 232900 Batch Loss: 1.080912 Tokens per Sec: 22447, Lr: 0.000072 2020-02-12 23:38:52,510 Epoch 95 Step: 233000 Batch Loss: 1.215713 Tokens per Sec: 22018, Lr: 0.000072 2020-02-12 23:39:11,648 Hooray! New best validation result [ppl]! 2020-02-12 23:39:11,649 Saving new checkpoint. 2020-02-12 23:39:11,837 Example #0 2020-02-12 23:39:11,837 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 23:39:11,837 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 23:39:11,837 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 23:39:11,837 Reference: 10 : ​ 6 - 9 . 2020-02-12 23:39:11,837 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la , shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-12 23:39:11,837 Example #1 2020-02-12 23:39:11,837 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 23:39:11,837 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 23:39:11,838 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 23:39:11,838 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 23:39:11,838 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-12 23:39:11,838 Example #2 2020-02-12 23:39:11,838 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 23:39:11,838 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 23:39:11,838 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 23:39:11,838 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 23:39:11,838 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 23:39:11,838 Example #3 2020-02-12 23:39:11,838 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 23:39:11,838 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 23:39:11,838 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 23:39:11,838 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 23:39:11,838 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 23:39:11,839 Validation result (greedy) at epoch 95, step 233000: bleu: 29.71, loss: 39356.2617, ppl: 3.7789, duration: 19.3278s 2020-02-12 23:39:22,030 Epoch 95 Step: 233100 Batch Loss: 1.031694 Tokens per Sec: 21545, Lr: 0.000072 2020-02-12 23:39:32,085 Epoch 95 Step: 233200 Batch Loss: 1.229030 Tokens per Sec: 22089, Lr: 0.000072 2020-02-12 23:39:42,160 Epoch 95 Step: 233300 Batch Loss: 1.400246 Tokens per Sec: 22046, Lr: 0.000072 2020-02-12 23:39:52,342 Epoch 95 Step: 233400 Batch Loss: 1.253532 Tokens per Sec: 21676, Lr: 0.000072 2020-02-12 23:40:02,434 Epoch 95 Step: 233500 Batch Loss: 1.360700 Tokens per Sec: 21626, Lr: 0.000072 2020-02-12 23:40:09,714 Epoch 95: total training loss 3129.18 2020-02-12 23:40:09,715 EPOCH 96 2020-02-12 23:40:12,807 Epoch 96 Step: 233600 Batch Loss: 1.293998 Tokens per Sec: 20597, Lr: 0.000072 2020-02-12 23:40:22,937 Epoch 96 Step: 233700 Batch Loss: 1.163538 Tokens per Sec: 21652, Lr: 0.000072 2020-02-12 23:40:33,027 Epoch 96 Step: 233800 Batch Loss: 1.186013 Tokens per Sec: 22125, Lr: 0.000072 2020-02-12 23:40:43,115 Epoch 96 Step: 233900 Batch Loss: 1.275811 Tokens per Sec: 21551, Lr: 0.000072 2020-02-12 23:40:53,345 Epoch 96 Step: 234000 Batch Loss: 1.307304 Tokens per Sec: 21819, Lr: 0.000072 2020-02-12 23:41:12,516 Example #0 2020-02-12 23:41:12,516 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 23:41:12,516 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 23:41:12,516 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 23:41:12,516 Reference: 10 : ​ 6 - 9 . 2020-02-12 23:41:12,516 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu hen atô ve la shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-12 23:41:12,516 Example #1 2020-02-12 23:41:12,516 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 23:41:12,516 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'sha', 'kpôô', 'yô', ',', 'ngu', 'ikyua', '!', '—', 'Rom', '.'] 2020-02-12 23:41:12,516 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 23:41:12,516 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 23:41:12,516 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man sha kpôô yô , ngu ikyua ! — Rom . 2020-02-12 23:41:12,517 Example #2 2020-02-12 23:41:12,517 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 23:41:12,517 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 23:41:12,517 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 23:41:12,517 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 23:41:12,517 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 23:41:12,517 Example #3 2020-02-12 23:41:12,517 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 23:41:12,517 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 23:41:12,517 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 23:41:12,517 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 23:41:12,517 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-12 23:41:12,517 Validation result (greedy) at epoch 96, step 234000: bleu: 29.85, loss: 39363.2773, ppl: 3.7798, duration: 19.1716s 2020-02-12 23:41:22,618 Epoch 96 Step: 234100 Batch Loss: 1.248992 Tokens per Sec: 22015, Lr: 0.000072 2020-02-12 23:41:32,581 Epoch 96 Step: 234200 Batch Loss: 1.375512 Tokens per Sec: 23276, Lr: 0.000072 2020-02-12 23:41:42,505 Epoch 96 Step: 234300 Batch Loss: 1.109025 Tokens per Sec: 22736, Lr: 0.000072 2020-02-12 23:41:52,583 Epoch 96 Step: 234400 Batch Loss: 1.468333 Tokens per Sec: 21670, Lr: 0.000072 2020-02-12 23:42:02,687 Epoch 96 Step: 234500 Batch Loss: 1.250643 Tokens per Sec: 21855, Lr: 0.000072 2020-02-12 23:42:12,664 Epoch 96 Step: 234600 Batch Loss: 1.409800 Tokens per Sec: 22213, Lr: 0.000072 2020-02-12 23:42:22,784 Epoch 96 Step: 234700 Batch Loss: 1.311290 Tokens per Sec: 21595, Lr: 0.000072 2020-02-12 23:42:32,922 Epoch 96 Step: 234800 Batch Loss: 1.264698 Tokens per Sec: 21688, Lr: 0.000072 2020-02-12 23:42:43,023 Epoch 96 Step: 234900 Batch Loss: 1.108672 Tokens per Sec: 22639, Lr: 0.000072 2020-02-12 23:42:52,984 Epoch 96 Step: 235000 Batch Loss: 1.141643 Tokens per Sec: 21969, Lr: 0.000072 2020-02-12 23:43:12,032 Hooray! New best validation result [ppl]! 2020-02-12 23:43:12,032 Saving new checkpoint. 2020-02-12 23:43:12,232 Example #0 2020-02-12 23:43:12,232 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 23:43:12,232 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 23:43:12,232 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 23:43:12,232 Reference: 10 : ​ 6 - 9 . 2020-02-12 23:43:12,232 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la , shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-12 23:43:12,232 Example #1 2020-02-12 23:43:12,233 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 23:43:12,233 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'sha', 'kpôô', 'yô', ',', 'ngu', 'ikyua', '!', '—', 'Rom', '.'] 2020-02-12 23:43:12,233 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 23:43:12,233 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 23:43:12,233 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man sha kpôô yô , ngu ikyua ! — Rom . 2020-02-12 23:43:12,233 Example #2 2020-02-12 23:43:12,233 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 23:43:12,233 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 23:43:12,233 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 23:43:12,233 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 23:43:12,233 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 23:43:12,233 Example #3 2020-02-12 23:43:12,233 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 23:43:12,233 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 23:43:12,233 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 23:43:12,233 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 23:43:12,234 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-12 23:43:12,234 Validation result (greedy) at epoch 96, step 235000: bleu: 29.51, loss: 39316.3984, ppl: 3.7738, duration: 19.2493s 2020-02-12 23:43:22,229 Epoch 96 Step: 235100 Batch Loss: 1.354789 Tokens per Sec: 22253, Lr: 0.000072 2020-02-12 23:43:32,445 Epoch 96 Step: 235200 Batch Loss: 1.498012 Tokens per Sec: 21487, Lr: 0.000072 2020-02-12 23:43:42,546 Epoch 96 Step: 235300 Batch Loss: 1.275623 Tokens per Sec: 21137, Lr: 0.000072 2020-02-12 23:43:52,734 Epoch 96 Step: 235400 Batch Loss: 0.953145 Tokens per Sec: 21268, Lr: 0.000072 2020-02-12 23:44:02,808 Epoch 96 Step: 235500 Batch Loss: 1.012503 Tokens per Sec: 21823, Lr: 0.000072 2020-02-12 23:44:12,769 Epoch 96 Step: 235600 Batch Loss: 1.187854 Tokens per Sec: 22221, Lr: 0.000072 2020-02-12 23:44:22,701 Epoch 96 Step: 235700 Batch Loss: 1.149285 Tokens per Sec: 22396, Lr: 0.000072 2020-02-12 23:44:32,535 Epoch 96 Step: 235800 Batch Loss: 1.280720 Tokens per Sec: 22338, Lr: 0.000072 2020-02-12 23:44:42,454 Epoch 96 Step: 235900 Batch Loss: 1.221339 Tokens per Sec: 22345, Lr: 0.000072 2020-02-12 23:44:52,406 Epoch 96 Step: 236000 Batch Loss: 1.242048 Tokens per Sec: 22310, Lr: 0.000072 2020-02-12 23:45:11,171 Example #0 2020-02-12 23:45:11,171 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 23:45:11,171 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 23:45:11,171 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 23:45:11,171 Reference: 10 : ​ 6 - 9 . 2020-02-12 23:45:11,171 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-12 23:45:11,171 Example #1 2020-02-12 23:45:11,171 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 23:45:11,171 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'sha', 'kpôô', 'yô', ',', 'ngu', 'ikyua', '!', '—', 'Rom', '.'] 2020-02-12 23:45:11,171 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 23:45:11,171 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 23:45:11,171 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man sha kpôô yô , ngu ikyua ! — Rom . 2020-02-12 23:45:11,172 Example #2 2020-02-12 23:45:11,172 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 23:45:11,172 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 23:45:11,172 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 23:45:11,172 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 23:45:11,172 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 23:45:11,172 Example #3 2020-02-12 23:45:11,172 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 23:45:11,172 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-12 23:45:11,172 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 23:45:11,172 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 23:45:11,172 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-12 23:45:11,172 Validation result (greedy) at epoch 96, step 236000: bleu: 29.73, loss: 39352.7617, ppl: 3.7784, duration: 18.7659s 2020-02-12 23:45:14,175 Epoch 96: total training loss 3113.88 2020-02-12 23:45:14,175 EPOCH 97 2020-02-12 23:45:21,655 Epoch 97 Step: 236100 Batch Loss: 1.211922 Tokens per Sec: 20838, Lr: 0.000072 2020-02-12 23:45:31,724 Epoch 97 Step: 236200 Batch Loss: 1.436269 Tokens per Sec: 21920, Lr: 0.000072 2020-02-12 23:45:41,815 Epoch 97 Step: 236300 Batch Loss: 1.418131 Tokens per Sec: 21465, Lr: 0.000072 2020-02-12 23:45:51,986 Epoch 97 Step: 236400 Batch Loss: 1.241720 Tokens per Sec: 22113, Lr: 0.000072 2020-02-12 23:46:02,142 Epoch 97 Step: 236500 Batch Loss: 1.322419 Tokens per Sec: 21713, Lr: 0.000072 2020-02-12 23:46:12,233 Epoch 97 Step: 236600 Batch Loss: 1.526960 Tokens per Sec: 21586, Lr: 0.000072 2020-02-12 23:46:22,346 Epoch 97 Step: 236700 Batch Loss: 1.383562 Tokens per Sec: 22143, Lr: 0.000072 2020-02-12 23:46:32,470 Epoch 97 Step: 236800 Batch Loss: 1.259700 Tokens per Sec: 22016, Lr: 0.000072 2020-02-12 23:46:42,567 Epoch 97 Step: 236900 Batch Loss: 1.405046 Tokens per Sec: 21974, Lr: 0.000072 2020-02-12 23:46:52,756 Epoch 97 Step: 237000 Batch Loss: 1.114024 Tokens per Sec: 21625, Lr: 0.000072 2020-02-12 23:47:11,928 Example #0 2020-02-12 23:47:11,928 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 23:47:11,928 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'her', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 23:47:11,928 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 23:47:11,928 Reference: 10 : ​ 6 - 9 . 2020-02-12 23:47:11,928 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu hen atô ve la , shi vea za hemen u lun a dooshima u a lu her la her . — Marku 10 : 6 - 9 . 2020-02-12 23:47:11,928 Example #1 2020-02-12 23:47:11,928 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 23:47:11,928 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'sha', 'kpôô', 'yô', ',', 'ngu', 'ikyua', '!', '—', 'Rom', '.'] 2020-02-12 23:47:11,928 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 23:47:11,928 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 23:47:11,928 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man sha kpôô yô , ngu ikyua ! — Rom . 2020-02-12 23:47:11,928 Example #2 2020-02-12 23:47:11,929 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 23:47:11,929 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 23:47:11,929 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 23:47:11,929 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 23:47:11,929 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 23:47:11,929 Example #3 2020-02-12 23:47:11,929 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 23:47:11,929 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 23:47:11,929 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 23:47:11,929 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 23:47:11,929 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-12 23:47:11,929 Validation result (greedy) at epoch 97, step 237000: bleu: 29.61, loss: 39366.6719, ppl: 3.7802, duration: 19.1726s 2020-02-12 23:47:21,862 Epoch 97 Step: 237100 Batch Loss: 1.290469 Tokens per Sec: 22360, Lr: 0.000072 2020-02-12 23:47:31,736 Epoch 97 Step: 237200 Batch Loss: 1.475515 Tokens per Sec: 22181, Lr: 0.000072 2020-02-12 23:47:41,652 Epoch 97 Step: 237300 Batch Loss: 1.030770 Tokens per Sec: 22931, Lr: 0.000072 2020-02-12 23:47:51,558 Epoch 97 Step: 237400 Batch Loss: 1.243261 Tokens per Sec: 22160, Lr: 0.000072 2020-02-12 23:48:01,430 Epoch 97 Step: 237500 Batch Loss: 1.183983 Tokens per Sec: 22025, Lr: 0.000072 2020-02-12 23:48:11,284 Epoch 97 Step: 237600 Batch Loss: 1.306978 Tokens per Sec: 22737, Lr: 0.000072 2020-02-12 23:48:21,224 Epoch 97 Step: 237700 Batch Loss: 1.314831 Tokens per Sec: 22338, Lr: 0.000072 2020-02-12 23:48:31,094 Epoch 97 Step: 237800 Batch Loss: 1.310863 Tokens per Sec: 21925, Lr: 0.000072 2020-02-12 23:48:41,072 Epoch 97 Step: 237900 Batch Loss: 1.085309 Tokens per Sec: 22418, Lr: 0.000072 2020-02-12 23:48:51,040 Epoch 97 Step: 238000 Batch Loss: 1.331563 Tokens per Sec: 22301, Lr: 0.000072 2020-02-12 23:49:09,620 Example #0 2020-02-12 23:49:09,621 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 23:49:09,621 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'her', 'dông', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 23:49:09,621 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 23:49:09,621 Reference: 10 : ​ 6 - 9 . 2020-02-12 23:49:09,621 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima her dông . — Marku 10 : 6 - 9 . 2020-02-12 23:49:09,621 Example #1 2020-02-12 23:49:09,621 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 23:49:09,621 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'sha', 'kpôô', 'yô', ',', 'ngu', 'ikyua', '!', '—', 'Rom', '.'] 2020-02-12 23:49:09,621 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 23:49:09,621 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 23:49:09,621 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man sha kpôô yô , ngu ikyua ! — Rom . 2020-02-12 23:49:09,621 Example #2 2020-02-12 23:49:09,621 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 23:49:09,621 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 23:49:09,622 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 23:49:09,622 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 23:49:09,622 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 23:49:09,622 Example #3 2020-02-12 23:49:09,622 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 23:49:09,622 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 23:49:09,622 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 23:49:09,622 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 23:49:09,622 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-12 23:49:09,622 Validation result (greedy) at epoch 97, step 238000: bleu: 29.52, loss: 39324.5156, ppl: 3.7748, duration: 18.5817s 2020-02-12 23:49:19,682 Epoch 97 Step: 238100 Batch Loss: 1.211874 Tokens per Sec: 21706, Lr: 0.000072 2020-02-12 23:49:29,731 Epoch 97 Step: 238200 Batch Loss: 1.321998 Tokens per Sec: 22341, Lr: 0.000072 2020-02-12 23:49:39,625 Epoch 97 Step: 238300 Batch Loss: 1.063067 Tokens per Sec: 22267, Lr: 0.000072 2020-02-12 23:49:49,688 Epoch 97 Step: 238400 Batch Loss: 1.200217 Tokens per Sec: 21358, Lr: 0.000072 2020-02-12 23:49:58,614 Epoch 97: total training loss 3113.23 2020-02-12 23:49:58,614 EPOCH 98 2020-02-12 23:49:59,895 Epoch 98 Step: 238500 Batch Loss: 1.240752 Tokens per Sec: 16932, Lr: 0.000072 2020-02-12 23:50:09,760 Epoch 98 Step: 238600 Batch Loss: 1.262265 Tokens per Sec: 22053, Lr: 0.000072 2020-02-12 23:50:19,683 Epoch 98 Step: 238700 Batch Loss: 1.238088 Tokens per Sec: 22290, Lr: 0.000072 2020-02-12 23:50:29,627 Epoch 98 Step: 238800 Batch Loss: 1.326244 Tokens per Sec: 22035, Lr: 0.000072 2020-02-12 23:50:39,532 Epoch 98 Step: 238900 Batch Loss: 1.272256 Tokens per Sec: 22251, Lr: 0.000072 2020-02-12 23:50:49,688 Epoch 98 Step: 239000 Batch Loss: 1.373327 Tokens per Sec: 21630, Lr: 0.000072 2020-02-12 23:51:09,626 Example #0 2020-02-12 23:51:09,627 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 23:51:09,627 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsan', 'gbem', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 23:51:09,627 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 23:51:09,627 Reference: 10 : ​ 6 - 9 . 2020-02-12 23:51:09,627 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsan gbem yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-12 23:51:09,627 Example #1 2020-02-12 23:51:09,627 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 23:51:09,627 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'sha', 'kpôô', 'yô', ',', 'ngu', 'ikyua', '!', '—', 'Rom', '.'] 2020-02-12 23:51:09,627 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 23:51:09,627 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 23:51:09,627 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man sha kpôô yô , ngu ikyua ! — Rom . 2020-02-12 23:51:09,627 Example #2 2020-02-12 23:51:09,628 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 23:51:09,628 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 23:51:09,628 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 23:51:09,628 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 23:51:09,628 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 23:51:09,628 Example #3 2020-02-12 23:51:09,628 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 23:51:09,628 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 23:51:09,628 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 23:51:09,628 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 23:51:09,628 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-12 23:51:09,628 Validation result (greedy) at epoch 98, step 239000: bleu: 29.73, loss: 39349.1055, ppl: 3.7780, duration: 19.9395s 2020-02-12 23:51:19,892 Epoch 98 Step: 239100 Batch Loss: 1.347682 Tokens per Sec: 21260, Lr: 0.000072 2020-02-12 23:51:29,736 Epoch 98 Step: 239200 Batch Loss: 1.299047 Tokens per Sec: 22991, Lr: 0.000072 2020-02-12 23:51:39,540 Epoch 98 Step: 239300 Batch Loss: 1.328351 Tokens per Sec: 22372, Lr: 0.000072 2020-02-12 23:51:49,416 Epoch 98 Step: 239400 Batch Loss: 1.301820 Tokens per Sec: 22654, Lr: 0.000072 2020-02-12 23:51:59,240 Epoch 98 Step: 239500 Batch Loss: 1.096144 Tokens per Sec: 22785, Lr: 0.000072 2020-02-12 23:52:09,111 Epoch 98 Step: 239600 Batch Loss: 1.457373 Tokens per Sec: 22693, Lr: 0.000072 2020-02-12 23:52:19,006 Epoch 98 Step: 239700 Batch Loss: 1.312059 Tokens per Sec: 22699, Lr: 0.000072 2020-02-12 23:52:28,865 Epoch 98 Step: 239800 Batch Loss: 1.156311 Tokens per Sec: 21671, Lr: 0.000072 2020-02-12 23:52:38,748 Epoch 98 Step: 239900 Batch Loss: 1.351632 Tokens per Sec: 22565, Lr: 0.000072 2020-02-12 23:52:48,672 Epoch 98 Step: 240000 Batch Loss: 1.365202 Tokens per Sec: 22310, Lr: 0.000072 2020-02-12 23:53:07,884 Example #0 2020-02-12 23:53:07,884 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 23:53:07,884 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 23:53:07,884 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 23:53:07,884 Reference: 10 : ​ 6 - 9 . 2020-02-12 23:53:07,884 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-12 23:53:07,884 Example #1 2020-02-12 23:53:07,884 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 23:53:07,884 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', ',', 'man', 'a', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 23:53:07,884 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 23:53:07,884 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 23:53:07,885 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung , man a mgbôghom ! — Rom . 2020-02-12 23:53:07,885 Example #2 2020-02-12 23:53:07,885 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 23:53:07,885 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 23:53:07,885 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 23:53:07,885 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 23:53:07,885 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 23:53:07,885 Example #3 2020-02-12 23:53:07,885 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 23:53:07,885 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 23:53:07,885 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 23:53:07,885 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 23:53:07,885 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-12 23:53:07,885 Validation result (greedy) at epoch 98, step 240000: bleu: 29.85, loss: 39358.9961, ppl: 3.7792, duration: 19.2129s 2020-02-12 23:53:17,988 Epoch 98 Step: 240100 Batch Loss: 1.382056 Tokens per Sec: 21734, Lr: 0.000072 2020-02-12 23:53:28,180 Epoch 98 Step: 240200 Batch Loss: 1.213484 Tokens per Sec: 21338, Lr: 0.000072 2020-02-12 23:53:38,304 Epoch 98 Step: 240300 Batch Loss: 1.379910 Tokens per Sec: 22009, Lr: 0.000072 2020-02-12 23:53:48,454 Epoch 98 Step: 240400 Batch Loss: 1.303765 Tokens per Sec: 22383, Lr: 0.000072 2020-02-12 23:53:58,586 Epoch 98 Step: 240500 Batch Loss: 1.391914 Tokens per Sec: 22019, Lr: 0.000072 2020-02-12 23:54:08,503 Epoch 98 Step: 240600 Batch Loss: 1.028374 Tokens per Sec: 22209, Lr: 0.000072 2020-02-12 23:54:18,427 Epoch 98 Step: 240700 Batch Loss: 1.025118 Tokens per Sec: 22645, Lr: 0.000072 2020-02-12 23:54:28,471 Epoch 98 Step: 240800 Batch Loss: 1.240506 Tokens per Sec: 21600, Lr: 0.000072 2020-02-12 23:54:38,362 Epoch 98 Step: 240900 Batch Loss: 1.125607 Tokens per Sec: 22615, Lr: 0.000072 2020-02-12 23:54:43,032 Epoch 98: total training loss 3107.00 2020-02-12 23:54:43,032 EPOCH 99 2020-02-12 23:54:48,622 Epoch 99 Step: 241000 Batch Loss: 1.283115 Tokens per Sec: 20474, Lr: 0.000072 2020-02-12 23:55:08,482 Hooray! New best validation result [ppl]! 2020-02-12 23:55:08,482 Saving new checkpoint. 2020-02-12 23:55:08,671 Example #0 2020-02-12 23:55:08,671 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 23:55:08,671 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 23:55:08,671 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 23:55:08,671 Reference: 10 : ​ 6 - 9 . 2020-02-12 23:55:08,671 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu hen atô ve la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-12 23:55:08,671 Example #1 2020-02-12 23:55:08,671 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 23:55:08,672 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'sha', 'kpôô', 'yô', ',', 'a', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 23:55:08,672 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 23:55:08,672 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 23:55:08,672 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man sha kpôô yô , a mgbôghom ! — Rom . 2020-02-12 23:55:08,672 Example #2 2020-02-12 23:55:08,672 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 23:55:08,672 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 23:55:08,672 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 23:55:08,672 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 23:55:08,672 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 23:55:08,672 Example #3 2020-02-12 23:55:08,672 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 23:55:08,673 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 23:55:08,673 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 23:55:08,673 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 23:55:08,673 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-12 23:55:08,673 Validation result (greedy) at epoch 99, step 241000: bleu: 29.71, loss: 39282.7227, ppl: 3.7695, duration: 20.0501s 2020-02-12 23:55:18,663 Epoch 99 Step: 241100 Batch Loss: 1.276472 Tokens per Sec: 22786, Lr: 0.000072 2020-02-12 23:55:28,834 Epoch 99 Step: 241200 Batch Loss: 1.247771 Tokens per Sec: 21618, Lr: 0.000072 2020-02-12 23:55:38,902 Epoch 99 Step: 241300 Batch Loss: 1.235860 Tokens per Sec: 22187, Lr: 0.000072 2020-02-12 23:55:48,997 Epoch 99 Step: 241400 Batch Loss: 1.127346 Tokens per Sec: 21651, Lr: 0.000072 2020-02-12 23:55:58,958 Epoch 99 Step: 241500 Batch Loss: 1.286091 Tokens per Sec: 22023, Lr: 0.000072 2020-02-12 23:56:08,879 Epoch 99 Step: 241600 Batch Loss: 1.287697 Tokens per Sec: 22598, Lr: 0.000072 2020-02-12 23:56:18,758 Epoch 99 Step: 241700 Batch Loss: 1.264967 Tokens per Sec: 22350, Lr: 0.000072 2020-02-12 23:56:28,573 Epoch 99 Step: 241800 Batch Loss: 1.175803 Tokens per Sec: 22111, Lr: 0.000072 2020-02-12 23:56:38,449 Epoch 99 Step: 241900 Batch Loss: 1.345479 Tokens per Sec: 22153, Lr: 0.000072 2020-02-12 23:56:48,411 Epoch 99 Step: 242000 Batch Loss: 1.254746 Tokens per Sec: 21886, Lr: 0.000072 2020-02-12 23:57:07,915 Example #0 2020-02-12 23:57:07,916 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 23:57:07,916 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 23:57:07,916 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 23:57:07,916 Reference: 10 : ​ 6 - 9 . 2020-02-12 23:57:07,916 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-12 23:57:07,916 Example #1 2020-02-12 23:57:07,916 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 23:57:07,916 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'sha', 'kpôô', 'yô', ',', 'a', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-12 23:57:07,916 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 23:57:07,916 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 23:57:07,916 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man sha kpôô yô , a mgbôghom ! — Rom . 2020-02-12 23:57:07,916 Example #2 2020-02-12 23:57:07,916 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 23:57:07,917 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 23:57:07,917 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 23:57:07,917 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 23:57:07,917 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 23:57:07,917 Example #3 2020-02-12 23:57:07,917 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 23:57:07,917 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 23:57:07,917 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 23:57:07,917 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 23:57:07,917 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-12 23:57:07,917 Validation result (greedy) at epoch 99, step 242000: bleu: 29.61, loss: 39312.3008, ppl: 3.7733, duration: 19.5061s 2020-02-12 23:57:17,921 Epoch 99 Step: 242100 Batch Loss: 1.105009 Tokens per Sec: 22271, Lr: 0.000072 2020-02-12 23:57:27,952 Epoch 99 Step: 242200 Batch Loss: 1.247306 Tokens per Sec: 21440, Lr: 0.000072 2020-02-12 23:57:37,957 Epoch 99 Step: 242300 Batch Loss: 1.315927 Tokens per Sec: 22322, Lr: 0.000072 2020-02-12 23:57:47,887 Epoch 99 Step: 242400 Batch Loss: 1.228223 Tokens per Sec: 22382, Lr: 0.000072 2020-02-12 23:57:57,777 Epoch 99 Step: 242500 Batch Loss: 1.418007 Tokens per Sec: 22703, Lr: 0.000072 2020-02-12 23:58:07,679 Epoch 99 Step: 242600 Batch Loss: 1.088568 Tokens per Sec: 21727, Lr: 0.000072 2020-02-12 23:58:17,640 Epoch 99 Step: 242700 Batch Loss: 1.134545 Tokens per Sec: 22688, Lr: 0.000072 2020-02-12 23:58:27,511 Epoch 99 Step: 242800 Batch Loss: 1.065167 Tokens per Sec: 22464, Lr: 0.000072 2020-02-12 23:58:37,404 Epoch 99 Step: 242900 Batch Loss: 1.370567 Tokens per Sec: 22417, Lr: 0.000072 2020-02-12 23:58:47,318 Epoch 99 Step: 243000 Batch Loss: 1.259923 Tokens per Sec: 22108, Lr: 0.000072 2020-02-12 23:59:06,278 Example #0 2020-02-12 23:59:06,278 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-12 23:59:06,279 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-12 23:59:06,279 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-12 23:59:06,279 Reference: 10 : ​ 6 - 9 . 2020-02-12 23:59:06,279 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea za hemen u lun a dooshima u a lu a mi la , shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-12 23:59:06,279 Example #1 2020-02-12 23:59:06,279 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-12 23:59:06,279 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'sha', 'kpôô', 'yô', ',', 'ngu', 'ikyua', '!', '—', 'Rom', '.'] 2020-02-12 23:59:06,279 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-12 23:59:06,279 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-12 23:59:06,279 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man sha kpôô yô , ngu ikyua ! — Rom . 2020-02-12 23:59:06,279 Example #2 2020-02-12 23:59:06,279 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-12 23:59:06,279 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-12 23:59:06,280 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-12 23:59:06,280 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-12 23:59:06,280 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-12 23:59:06,280 Example #3 2020-02-12 23:59:06,280 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-12 23:59:06,280 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-12 23:59:06,280 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-12 23:59:06,280 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-12 23:59:06,280 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-12 23:59:06,280 Validation result (greedy) at epoch 99, step 243000: bleu: 29.95, loss: 39287.1172, ppl: 3.7700, duration: 18.9619s 2020-02-12 23:59:16,168 Epoch 99 Step: 243100 Batch Loss: 1.272500 Tokens per Sec: 22264, Lr: 0.000072 2020-02-12 23:59:26,049 Epoch 99 Step: 243200 Batch Loss: 1.230612 Tokens per Sec: 21901, Lr: 0.000072 2020-02-12 23:59:35,994 Epoch 99 Step: 243300 Batch Loss: 1.309051 Tokens per Sec: 22657, Lr: 0.000072 2020-02-12 23:59:45,917 Epoch 99 Step: 243400 Batch Loss: 1.303270 Tokens per Sec: 22328, Lr: 0.000072 2020-02-12 23:59:46,735 Epoch 99: total training loss 3107.59 2020-02-12 23:59:46,735 EPOCH 100 2020-02-12 23:59:56,358 Epoch 100 Step: 243500 Batch Loss: 1.066405 Tokens per Sec: 21149, Lr: 0.000072 2020-02-13 00:00:06,522 Epoch 100 Step: 243600 Batch Loss: 1.129660 Tokens per Sec: 21654, Lr: 0.000072 2020-02-13 00:00:16,792 Epoch 100 Step: 243700 Batch Loss: 1.101330 Tokens per Sec: 21435, Lr: 0.000072 2020-02-13 00:00:26,941 Epoch 100 Step: 243800 Batch Loss: 1.208258 Tokens per Sec: 21567, Lr: 0.000072 2020-02-13 00:00:37,146 Epoch 100 Step: 243900 Batch Loss: 1.315772 Tokens per Sec: 21749, Lr: 0.000072 2020-02-13 00:00:47,271 Epoch 100 Step: 244000 Batch Loss: 1.294427 Tokens per Sec: 21538, Lr: 0.000072 2020-02-13 00:01:06,135 Example #0 2020-02-13 00:01:06,136 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 00:01:06,136 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'vesen', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 00:01:06,136 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 00:01:06,136 Reference: 10 : ​ 6 - 9 . 2020-02-13 00:01:06,136 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu vesen la her . — Marku 10 : 6 - 9 . 2020-02-13 00:01:06,136 Example #1 2020-02-13 00:01:06,136 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 00:01:06,136 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'sha', 'kpôô', 'yô', ',', 'ngu', 'ikyua', '!', '—', 'Rom', '.'] 2020-02-13 00:01:06,136 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 00:01:06,136 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 00:01:06,136 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man sha kpôô yô , ngu ikyua ! — Rom . 2020-02-13 00:01:06,136 Example #2 2020-02-13 00:01:06,136 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 00:01:06,137 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 00:01:06,137 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 00:01:06,137 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 00:01:06,137 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 00:01:06,137 Example #3 2020-02-13 00:01:06,137 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 00:01:06,137 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-13 00:01:06,137 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 00:01:06,137 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 00:01:06,137 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-13 00:01:06,137 Validation result (greedy) at epoch 100, step 244000: bleu: 29.81, loss: 39349.0820, ppl: 3.7779, duration: 18.8657s 2020-02-13 00:01:16,057 Epoch 100 Step: 244100 Batch Loss: 1.129989 Tokens per Sec: 22626, Lr: 0.000072 2020-02-13 00:01:25,994 Epoch 100 Step: 244200 Batch Loss: 1.323885 Tokens per Sec: 22389, Lr: 0.000072 2020-02-13 00:01:36,056 Epoch 100 Step: 244300 Batch Loss: 1.396739 Tokens per Sec: 21235, Lr: 0.000072 2020-02-13 00:01:46,273 Epoch 100 Step: 244400 Batch Loss: 1.426928 Tokens per Sec: 21879, Lr: 0.000072 2020-02-13 00:01:56,314 Epoch 100 Step: 244500 Batch Loss: 1.187701 Tokens per Sec: 21706, Lr: 0.000072 2020-02-13 00:02:06,274 Epoch 100 Step: 244600 Batch Loss: 1.384095 Tokens per Sec: 22569, Lr: 0.000072 2020-02-13 00:02:16,205 Epoch 100 Step: 244700 Batch Loss: 1.431471 Tokens per Sec: 21927, Lr: 0.000072 2020-02-13 00:02:26,077 Epoch 100 Step: 244800 Batch Loss: 1.231864 Tokens per Sec: 22387, Lr: 0.000072 2020-02-13 00:02:35,943 Epoch 100 Step: 244900 Batch Loss: 1.362563 Tokens per Sec: 22164, Lr: 0.000072 2020-02-13 00:02:45,875 Epoch 100 Step: 245000 Batch Loss: 1.302435 Tokens per Sec: 22051, Lr: 0.000072 2020-02-13 00:03:04,883 Example #0 2020-02-13 00:03:04,883 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 00:03:04,883 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'vesen', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 00:03:04,883 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 00:03:04,883 Reference: 10 : ​ 6 - 9 . 2020-02-13 00:03:04,883 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu vesen la her . — Marku 10 : 6 - 9 . 2020-02-13 00:03:04,883 Example #1 2020-02-13 00:03:04,883 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 00:03:04,883 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'sha', 'kpôô', 'yô', ',', 'ngu', 'ikyua', '!', '—', 'Rom', '.'] 2020-02-13 00:03:04,883 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 00:03:04,883 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 00:03:04,883 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man sha kpôô yô , ngu ikyua ! — Rom . 2020-02-13 00:03:04,884 Example #2 2020-02-13 00:03:04,884 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 00:03:04,884 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 00:03:04,884 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 00:03:04,884 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 00:03:04,884 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 00:03:04,884 Example #3 2020-02-13 00:03:04,884 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 00:03:04,884 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-13 00:03:04,884 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 00:03:04,884 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 00:03:04,884 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-13 00:03:04,884 Validation result (greedy) at epoch 100, step 245000: bleu: 29.81, loss: 39303.0312, ppl: 3.7721, duration: 19.0088s 2020-02-13 00:03:14,826 Epoch 100 Step: 245100 Batch Loss: 1.318350 Tokens per Sec: 22150, Lr: 0.000072 2020-02-13 00:03:24,835 Epoch 100 Step: 245200 Batch Loss: 1.170072 Tokens per Sec: 22085, Lr: 0.000072 2020-02-13 00:03:34,864 Epoch 100 Step: 245300 Batch Loss: 1.383932 Tokens per Sec: 22125, Lr: 0.000072 2020-02-13 00:03:44,821 Epoch 100 Step: 245400 Batch Loss: 1.472838 Tokens per Sec: 22148, Lr: 0.000072 2020-02-13 00:03:54,801 Epoch 100 Step: 245500 Batch Loss: 1.217506 Tokens per Sec: 22897, Lr: 0.000072 2020-02-13 00:04:04,735 Epoch 100 Step: 245600 Batch Loss: 1.279783 Tokens per Sec: 21825, Lr: 0.000072 2020-02-13 00:04:14,682 Epoch 100 Step: 245700 Batch Loss: 1.093495 Tokens per Sec: 22164, Lr: 0.000072 2020-02-13 00:04:24,649 Epoch 100 Step: 245800 Batch Loss: 1.270488 Tokens per Sec: 22878, Lr: 0.000072 2020-02-13 00:04:31,440 Epoch 100: total training loss 3104.65 2020-02-13 00:04:31,441 EPOCH 101 2020-02-13 00:04:34,915 Epoch 101 Step: 245900 Batch Loss: 1.204702 Tokens per Sec: 20026, Lr: 0.000072 2020-02-13 00:04:44,933 Epoch 101 Step: 246000 Batch Loss: 1.079620 Tokens per Sec: 21751, Lr: 0.000072 2020-02-13 00:05:03,781 Example #0 2020-02-13 00:05:03,781 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 00:05:03,781 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 00:05:03,781 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 00:05:03,781 Reference: 10 : ​ 6 - 9 . 2020-02-13 00:05:03,781 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la , shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 00:05:03,781 Example #1 2020-02-13 00:05:03,781 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 00:05:03,781 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'sha', 'kpôô', 'yô', ',', 'a', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 00:05:03,782 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 00:05:03,782 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 00:05:03,782 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man sha kpôô yô , a mgbôghom ! — Rom . 2020-02-13 00:05:03,782 Example #2 2020-02-13 00:05:03,782 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 00:05:03,782 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 00:05:03,782 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 00:05:03,782 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 00:05:03,782 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 00:05:03,782 Example #3 2020-02-13 00:05:03,782 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 00:05:03,782 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-13 00:05:03,782 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 00:05:03,782 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 00:05:03,782 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-13 00:05:03,782 Validation result (greedy) at epoch 101, step 246000: bleu: 29.63, loss: 39357.0352, ppl: 3.7790, duration: 18.8486s 2020-02-13 00:05:13,799 Epoch 101 Step: 246100 Batch Loss: 1.427979 Tokens per Sec: 21474, Lr: 0.000072 2020-02-13 00:05:23,724 Epoch 101 Step: 246200 Batch Loss: 1.098887 Tokens per Sec: 22628, Lr: 0.000072 2020-02-13 00:05:33,602 Epoch 101 Step: 246300 Batch Loss: 1.261189 Tokens per Sec: 22265, Lr: 0.000072 2020-02-13 00:05:43,496 Epoch 101 Step: 246400 Batch Loss: 1.325263 Tokens per Sec: 22176, Lr: 0.000072 2020-02-13 00:05:53,515 Epoch 101 Step: 246500 Batch Loss: 1.209648 Tokens per Sec: 22387, Lr: 0.000072 2020-02-13 00:06:03,502 Epoch 101 Step: 246600 Batch Loss: 1.203905 Tokens per Sec: 22055, Lr: 0.000072 2020-02-13 00:06:13,595 Epoch 101 Step: 246700 Batch Loss: 1.308463 Tokens per Sec: 22149, Lr: 0.000072 2020-02-13 00:06:23,594 Epoch 101 Step: 246800 Batch Loss: 0.981336 Tokens per Sec: 22204, Lr: 0.000072 2020-02-13 00:06:33,509 Epoch 101 Step: 246900 Batch Loss: 1.322691 Tokens per Sec: 22561, Lr: 0.000072 2020-02-13 00:06:43,396 Epoch 101 Step: 247000 Batch Loss: 1.238862 Tokens per Sec: 22163, Lr: 0.000072 2020-02-13 00:07:02,302 Hooray! New best validation result [ppl]! 2020-02-13 00:07:02,302 Saving new checkpoint. 2020-02-13 00:07:02,495 Example #0 2020-02-13 00:07:02,496 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 00:07:02,496 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 00:07:02,496 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 00:07:02,496 Reference: 10 : ​ 6 - 9 . 2020-02-13 00:07:02,496 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la , shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 00:07:02,496 Example #1 2020-02-13 00:07:02,496 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 00:07:02,496 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', ',', 'u', 'a', 'mgb@@', 'ôghom', 'ne', '!', '—', 'Rom', '.'] 2020-02-13 00:07:02,496 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 00:07:02,496 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 00:07:02,496 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung , u a mgbôghom ne ! — Rom . 2020-02-13 00:07:02,496 Example #2 2020-02-13 00:07:02,497 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 00:07:02,497 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 00:07:02,497 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 00:07:02,497 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 00:07:02,497 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 00:07:02,497 Example #3 2020-02-13 00:07:02,497 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 00:07:02,497 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-13 00:07:02,497 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 00:07:02,497 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 00:07:02,497 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-13 00:07:02,497 Validation result (greedy) at epoch 101, step 247000: bleu: 29.81, loss: 39245.7227, ppl: 3.7648, duration: 19.1009s 2020-02-13 00:07:12,399 Epoch 101 Step: 247100 Batch Loss: 1.269259 Tokens per Sec: 22461, Lr: 0.000072 2020-02-13 00:07:22,332 Epoch 101 Step: 247200 Batch Loss: 1.238273 Tokens per Sec: 22544, Lr: 0.000072 2020-02-13 00:07:32,284 Epoch 101 Step: 247300 Batch Loss: 1.336751 Tokens per Sec: 22020, Lr: 0.000072 2020-02-13 00:07:42,199 Epoch 101 Step: 247400 Batch Loss: 1.255631 Tokens per Sec: 22663, Lr: 0.000072 2020-02-13 00:07:52,218 Epoch 101 Step: 247500 Batch Loss: 1.304409 Tokens per Sec: 21987, Lr: 0.000072 2020-02-13 00:08:02,261 Epoch 101 Step: 247600 Batch Loss: 1.218846 Tokens per Sec: 21934, Lr: 0.000072 2020-02-13 00:08:12,148 Epoch 101 Step: 247700 Batch Loss: 1.314448 Tokens per Sec: 22490, Lr: 0.000072 2020-02-13 00:08:22,217 Epoch 101 Step: 247800 Batch Loss: 1.355471 Tokens per Sec: 22633, Lr: 0.000072 2020-02-13 00:08:32,314 Epoch 101 Step: 247900 Batch Loss: 1.342432 Tokens per Sec: 21595, Lr: 0.000072 2020-02-13 00:08:42,503 Epoch 101 Step: 248000 Batch Loss: 1.289636 Tokens per Sec: 22023, Lr: 0.000072 2020-02-13 00:09:02,086 Example #0 2020-02-13 00:09:02,086 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 00:09:02,086 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 00:09:02,086 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 00:09:02,086 Reference: 10 : ​ 6 - 9 . 2020-02-13 00:09:02,086 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la , shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 00:09:02,086 Example #1 2020-02-13 00:09:02,086 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 00:09:02,087 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'sha', 'kpôô', 'yô', ',', 'ngu', 'ikyua', '!', '—', 'Rom', '.'] 2020-02-13 00:09:02,087 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 00:09:02,087 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 00:09:02,087 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man sha kpôô yô , ngu ikyua ! — Rom . 2020-02-13 00:09:02,087 Example #2 2020-02-13 00:09:02,087 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 00:09:02,087 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 00:09:02,087 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 00:09:02,087 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 00:09:02,087 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 00:09:02,087 Example #3 2020-02-13 00:09:02,087 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 00:09:02,087 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-13 00:09:02,087 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 00:09:02,087 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 00:09:02,088 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-13 00:09:02,088 Validation result (greedy) at epoch 101, step 248000: bleu: 29.81, loss: 39282.5977, ppl: 3.7695, duration: 19.5841s 2020-02-13 00:09:12,191 Epoch 101 Step: 248100 Batch Loss: 1.306581 Tokens per Sec: 22403, Lr: 0.000072 2020-02-13 00:09:22,299 Epoch 101 Step: 248200 Batch Loss: 1.376634 Tokens per Sec: 21655, Lr: 0.000072 2020-02-13 00:09:32,169 Epoch 101 Step: 248300 Batch Loss: 1.129470 Tokens per Sec: 22267, Lr: 0.000072 2020-02-13 00:09:34,236 Epoch 101: total training loss 3091.83 2020-02-13 00:09:34,236 EPOCH 102 2020-02-13 00:09:42,294 Epoch 102 Step: 248400 Batch Loss: 1.199232 Tokens per Sec: 21299, Lr: 0.000072 2020-02-13 00:09:52,191 Epoch 102 Step: 248500 Batch Loss: 1.022796 Tokens per Sec: 22372, Lr: 0.000072 2020-02-13 00:10:02,145 Epoch 102 Step: 248600 Batch Loss: 1.351269 Tokens per Sec: 22094, Lr: 0.000072 2020-02-13 00:10:12,105 Epoch 102 Step: 248700 Batch Loss: 1.146953 Tokens per Sec: 22301, Lr: 0.000072 2020-02-13 00:10:22,233 Epoch 102 Step: 248800 Batch Loss: 1.181991 Tokens per Sec: 22394, Lr: 0.000072 2020-02-13 00:10:32,319 Epoch 102 Step: 248900 Batch Loss: 1.422933 Tokens per Sec: 21891, Lr: 0.000072 2020-02-13 00:10:42,397 Epoch 102 Step: 249000 Batch Loss: 1.338325 Tokens per Sec: 21413, Lr: 0.000072 2020-02-13 00:11:01,759 Example #0 2020-02-13 00:11:01,759 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 00:11:01,759 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 00:11:01,759 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 00:11:01,759 Reference: 10 : ​ 6 - 9 . 2020-02-13 00:11:01,760 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu hen atô ve la , shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 00:11:01,760 Example #1 2020-02-13 00:11:01,760 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 00:11:01,760 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'sha', 'kpôô', 'yô', ',', 'ngu', 'ikyua', '!', '—', 'Rom', '.'] 2020-02-13 00:11:01,760 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 00:11:01,760 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 00:11:01,760 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man sha kpôô yô , ngu ikyua ! — Rom . 2020-02-13 00:11:01,760 Example #2 2020-02-13 00:11:01,760 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 00:11:01,760 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 00:11:01,760 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 00:11:01,760 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 00:11:01,760 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 00:11:01,760 Example #3 2020-02-13 00:11:01,760 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 00:11:01,761 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-13 00:11:01,761 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 00:11:01,761 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 00:11:01,761 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-13 00:11:01,761 Validation result (greedy) at epoch 102, step 249000: bleu: 29.63, loss: 39322.3281, ppl: 3.7745, duration: 19.3628s 2020-02-13 00:11:11,795 Epoch 102 Step: 249100 Batch Loss: 1.456753 Tokens per Sec: 22135, Lr: 0.000072 2020-02-13 00:11:21,707 Epoch 102 Step: 249200 Batch Loss: 1.197391 Tokens per Sec: 22554, Lr: 0.000072 2020-02-13 00:11:31,652 Epoch 102 Step: 249300 Batch Loss: 1.351852 Tokens per Sec: 22410, Lr: 0.000072 2020-02-13 00:11:41,549 Epoch 102 Step: 249400 Batch Loss: 1.504294 Tokens per Sec: 22301, Lr: 0.000072 2020-02-13 00:11:51,495 Epoch 102 Step: 249500 Batch Loss: 1.284914 Tokens per Sec: 22148, Lr: 0.000072 2020-02-13 00:12:01,369 Epoch 102 Step: 249600 Batch Loss: 1.161253 Tokens per Sec: 22062, Lr: 0.000072 2020-02-13 00:12:11,424 Epoch 102 Step: 249700 Batch Loss: 1.411788 Tokens per Sec: 21944, Lr: 0.000072 2020-02-13 00:12:21,362 Epoch 102 Step: 249800 Batch Loss: 1.311733 Tokens per Sec: 22189, Lr: 0.000072 2020-02-13 00:12:31,247 Epoch 102 Step: 249900 Batch Loss: 1.248537 Tokens per Sec: 22258, Lr: 0.000072 2020-02-13 00:12:41,204 Epoch 102 Step: 250000 Batch Loss: 0.940852 Tokens per Sec: 22096, Lr: 0.000072 2020-02-13 00:13:00,394 Example #0 2020-02-13 00:13:00,395 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 00:13:00,395 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 00:13:00,395 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 00:13:00,395 Reference: 10 : ​ 6 - 9 . 2020-02-13 00:13:00,395 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 00:13:00,395 Example #1 2020-02-13 00:13:00,395 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 00:13:00,395 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 00:13:00,395 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 00:13:00,395 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 00:13:00,395 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung , man kwagh ne mgbôghom ! — Rom . 2020-02-13 00:13:00,395 Example #2 2020-02-13 00:13:00,395 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 00:13:00,396 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 00:13:00,396 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 00:13:00,396 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 00:13:00,396 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 00:13:00,396 Example #3 2020-02-13 00:13:00,396 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 00:13:00,396 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-13 00:13:00,396 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 00:13:00,396 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 00:13:00,396 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-13 00:13:00,396 Validation result (greedy) at epoch 102, step 250000: bleu: 29.54, loss: 39273.9531, ppl: 3.7684, duration: 19.1920s 2020-02-13 00:13:10,291 Epoch 102 Step: 250100 Batch Loss: 1.329824 Tokens per Sec: 22074, Lr: 0.000072 2020-02-13 00:13:20,153 Epoch 102 Step: 250200 Batch Loss: 1.120950 Tokens per Sec: 22371, Lr: 0.000072 2020-02-13 00:13:29,975 Epoch 102 Step: 250300 Batch Loss: 1.324463 Tokens per Sec: 22184, Lr: 0.000072 2020-02-13 00:13:39,849 Epoch 102 Step: 250400 Batch Loss: 1.405595 Tokens per Sec: 22459, Lr: 0.000072 2020-02-13 00:13:49,740 Epoch 102 Step: 250500 Batch Loss: 1.423947 Tokens per Sec: 22547, Lr: 0.000072 2020-02-13 00:13:59,571 Epoch 102 Step: 250600 Batch Loss: 1.257553 Tokens per Sec: 21923, Lr: 0.000072 2020-02-13 00:14:09,542 Epoch 102 Step: 250700 Batch Loss: 1.360205 Tokens per Sec: 22071, Lr: 0.000072 2020-02-13 00:14:18,123 Epoch 102: total training loss 3106.11 2020-02-13 00:14:18,124 EPOCH 103 2020-02-13 00:14:19,769 Epoch 103 Step: 250800 Batch Loss: 1.102113 Tokens per Sec: 18796, Lr: 0.000072 2020-02-13 00:14:29,705 Epoch 103 Step: 250900 Batch Loss: 1.271396 Tokens per Sec: 22548, Lr: 0.000072 2020-02-13 00:14:39,548 Epoch 103 Step: 251000 Batch Loss: 1.485217 Tokens per Sec: 22604, Lr: 0.000072 2020-02-13 00:14:58,747 Example #0 2020-02-13 00:14:58,747 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 00:14:58,747 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 00:14:58,747 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 00:14:58,747 Reference: 10 : ​ 6 - 9 . 2020-02-13 00:14:58,747 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 00:14:58,747 Example #1 2020-02-13 00:14:58,747 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 00:14:58,747 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'sha', 'kpôô', 'yô', ',', 'ngu', 'ikyua', '!', '—', 'Rom', '.'] 2020-02-13 00:14:58,747 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 00:14:58,748 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 00:14:58,748 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man sha kpôô yô , ngu ikyua ! — Rom . 2020-02-13 00:14:58,748 Example #2 2020-02-13 00:14:58,748 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 00:14:58,748 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 00:14:58,748 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 00:14:58,748 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 00:14:58,748 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 00:14:58,748 Example #3 2020-02-13 00:14:58,748 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 00:14:58,748 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-13 00:14:58,748 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 00:14:58,748 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 00:14:58,748 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-13 00:14:58,748 Validation result (greedy) at epoch 103, step 251000: bleu: 29.88, loss: 39319.1328, ppl: 3.7741, duration: 19.1995s 2020-02-13 00:15:08,682 Epoch 103 Step: 251100 Batch Loss: 1.177403 Tokens per Sec: 22575, Lr: 0.000072 2020-02-13 00:15:18,526 Epoch 103 Step: 251200 Batch Loss: 1.364777 Tokens per Sec: 22512, Lr: 0.000072 2020-02-13 00:15:28,510 Epoch 103 Step: 251300 Batch Loss: 1.019717 Tokens per Sec: 22235, Lr: 0.000072 2020-02-13 00:15:38,378 Epoch 103 Step: 251400 Batch Loss: 1.145826 Tokens per Sec: 22315, Lr: 0.000072 2020-02-13 00:15:48,427 Epoch 103 Step: 251500 Batch Loss: 1.357684 Tokens per Sec: 21980, Lr: 0.000072 2020-02-13 00:15:58,550 Epoch 103 Step: 251600 Batch Loss: 1.238061 Tokens per Sec: 21880, Lr: 0.000072 2020-02-13 00:16:08,664 Epoch 103 Step: 251700 Batch Loss: 1.251675 Tokens per Sec: 22121, Lr: 0.000072 2020-02-13 00:16:18,834 Epoch 103 Step: 251800 Batch Loss: 1.223890 Tokens per Sec: 21606, Lr: 0.000072 2020-02-13 00:16:28,830 Epoch 103 Step: 251900 Batch Loss: 1.264098 Tokens per Sec: 22274, Lr: 0.000072 2020-02-13 00:16:38,680 Epoch 103 Step: 252000 Batch Loss: 1.474248 Tokens per Sec: 21855, Lr: 0.000072 2020-02-13 00:16:58,357 Example #0 2020-02-13 00:16:58,357 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 00:16:58,358 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 00:16:58,358 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 00:16:58,358 Reference: 10 : ​ 6 - 9 . 2020-02-13 00:16:58,358 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 00:16:58,358 Example #1 2020-02-13 00:16:58,358 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 00:16:58,358 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'sha', 'kpôô', 'yô', ',', 'ngu', 'ikyua', '!', '—', 'Rom', '.'] 2020-02-13 00:16:58,358 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 00:16:58,358 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 00:16:58,358 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man sha kpôô yô , ngu ikyua ! — Rom . 2020-02-13 00:16:58,358 Example #2 2020-02-13 00:16:58,358 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 00:16:58,358 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 00:16:58,358 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 00:16:58,358 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 00:16:58,359 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 00:16:58,359 Example #3 2020-02-13 00:16:58,359 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 00:16:58,359 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-13 00:16:58,359 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 00:16:58,359 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 00:16:58,359 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-13 00:16:58,359 Validation result (greedy) at epoch 103, step 252000: bleu: 29.65, loss: 39307.8555, ppl: 3.7727, duration: 19.6781s 2020-02-13 00:17:08,279 Epoch 103 Step: 252100 Batch Loss: 1.214186 Tokens per Sec: 22310, Lr: 0.000072 2020-02-13 00:17:18,126 Epoch 103 Step: 252200 Batch Loss: 1.057369 Tokens per Sec: 22871, Lr: 0.000072 2020-02-13 00:17:27,984 Epoch 103 Step: 252300 Batch Loss: 1.354779 Tokens per Sec: 21760, Lr: 0.000072 2020-02-13 00:17:37,891 Epoch 103 Step: 252400 Batch Loss: 1.214249 Tokens per Sec: 22077, Lr: 0.000072 2020-02-13 00:17:47,798 Epoch 103 Step: 252500 Batch Loss: 1.266892 Tokens per Sec: 22519, Lr: 0.000072 2020-02-13 00:17:57,700 Epoch 103 Step: 252600 Batch Loss: 1.206955 Tokens per Sec: 22213, Lr: 0.000072 2020-02-13 00:18:07,598 Epoch 103 Step: 252700 Batch Loss: 1.376165 Tokens per Sec: 23209, Lr: 0.000072 2020-02-13 00:18:17,475 Epoch 103 Step: 252800 Batch Loss: 1.384547 Tokens per Sec: 22668, Lr: 0.000072 2020-02-13 00:18:27,515 Epoch 103 Step: 252900 Batch Loss: 1.057367 Tokens per Sec: 22009, Lr: 0.000072 2020-02-13 00:18:37,358 Epoch 103 Step: 253000 Batch Loss: 1.312064 Tokens per Sec: 22966, Lr: 0.000072 2020-02-13 00:18:56,256 Hooray! New best validation result [ppl]! 2020-02-13 00:18:56,256 Saving new checkpoint. 2020-02-13 00:18:56,446 Example #0 2020-02-13 00:18:56,446 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 00:18:56,446 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 00:18:56,446 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 00:18:56,446 Reference: 10 : ​ 6 - 9 . 2020-02-13 00:18:56,446 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu hen atô ve la shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 00:18:56,446 Example #1 2020-02-13 00:18:56,446 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 00:18:56,446 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'sha', 'kpôô', 'yô', ',', 'ngu', 'ikyua', '!', '—', 'Rom', '.'] 2020-02-13 00:18:56,446 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 00:18:56,446 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 00:18:56,446 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man sha kpôô yô , ngu ikyua ! — Rom . 2020-02-13 00:18:56,446 Example #2 2020-02-13 00:18:56,447 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 00:18:56,447 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 00:18:56,447 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 00:18:56,447 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 00:18:56,447 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 00:18:56,447 Example #3 2020-02-13 00:18:56,447 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 00:18:56,447 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-13 00:18:56,447 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 00:18:56,447 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 00:18:56,447 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-13 00:18:56,447 Validation result (greedy) at epoch 103, step 253000: bleu: 29.64, loss: 39240.5391, ppl: 3.7641, duration: 19.0892s 2020-02-13 00:19:06,332 Epoch 103 Step: 253100 Batch Loss: 1.330240 Tokens per Sec: 22286, Lr: 0.000072 2020-02-13 00:19:16,207 Epoch 103 Step: 253200 Batch Loss: 1.209846 Tokens per Sec: 22022, Lr: 0.000072 2020-02-13 00:19:20,052 Epoch 103: total training loss 3089.27 2020-02-13 00:19:20,052 EPOCH 104 2020-02-13 00:19:26,413 Epoch 104 Step: 253300 Batch Loss: 0.842440 Tokens per Sec: 22157, Lr: 0.000072 2020-02-13 00:19:36,579 Epoch 104 Step: 253400 Batch Loss: 1.313846 Tokens per Sec: 22161, Lr: 0.000072 2020-02-13 00:19:46,619 Epoch 104 Step: 253500 Batch Loss: 1.240900 Tokens per Sec: 22224, Lr: 0.000072 2020-02-13 00:19:56,518 Epoch 104 Step: 253600 Batch Loss: 1.359891 Tokens per Sec: 22639, Lr: 0.000072 2020-02-13 00:20:06,566 Epoch 104 Step: 253700 Batch Loss: 1.332469 Tokens per Sec: 22258, Lr: 0.000072 2020-02-13 00:20:16,696 Epoch 104 Step: 253800 Batch Loss: 1.409941 Tokens per Sec: 21508, Lr: 0.000072 2020-02-13 00:20:26,877 Epoch 104 Step: 253900 Batch Loss: 1.232206 Tokens per Sec: 21469, Lr: 0.000072 2020-02-13 00:20:37,012 Epoch 104 Step: 254000 Batch Loss: 1.165349 Tokens per Sec: 21941, Lr: 0.000072 2020-02-13 00:20:56,289 Hooray! New best validation result [ppl]! 2020-02-13 00:20:56,289 Saving new checkpoint. 2020-02-13 00:20:56,479 Example #0 2020-02-13 00:20:56,479 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 00:20:56,479 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'una', 'fatyô', 'u', 'vesen', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 00:20:56,479 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 00:20:56,479 Reference: 10 : ​ 6 - 9 . 2020-02-13 00:20:56,479 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u una fatyô u vesen la . — Marku 10 : 6 - 9 . 2020-02-13 00:20:56,479 Example #1 2020-02-13 00:20:56,479 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 00:20:56,480 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'sha', 'kpôô', 'yô', ',', 'ngu', 'ikyua', '!', '—', 'Rom', '.'] 2020-02-13 00:20:56,480 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 00:20:56,480 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 00:20:56,480 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man sha kpôô yô , ngu ikyua ! — Rom . 2020-02-13 00:20:56,480 Example #2 2020-02-13 00:20:56,480 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 00:20:56,480 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 00:20:56,480 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 00:20:56,480 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 00:20:56,480 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 00:20:56,480 Example #3 2020-02-13 00:20:56,480 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 00:20:56,480 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-13 00:20:56,480 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 00:20:56,480 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 00:20:56,480 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-13 00:20:56,481 Validation result (greedy) at epoch 104, step 254000: bleu: 29.67, loss: 39213.7773, ppl: 3.7607, duration: 19.4682s 2020-02-13 00:21:06,614 Epoch 104 Step: 254100 Batch Loss: 1.381058 Tokens per Sec: 22265, Lr: 0.000072 2020-02-13 00:21:16,733 Epoch 104 Step: 254200 Batch Loss: 1.083645 Tokens per Sec: 21448, Lr: 0.000072 2020-02-13 00:21:26,822 Epoch 104 Step: 254300 Batch Loss: 1.147162 Tokens per Sec: 21842, Lr: 0.000072 2020-02-13 00:21:36,706 Epoch 104 Step: 254400 Batch Loss: 1.193909 Tokens per Sec: 21393, Lr: 0.000072 2020-02-13 00:21:46,814 Epoch 104 Step: 254500 Batch Loss: 1.370407 Tokens per Sec: 22236, Lr: 0.000072 2020-02-13 00:21:56,899 Epoch 104 Step: 254600 Batch Loss: 1.385314 Tokens per Sec: 21160, Lr: 0.000072 2020-02-13 00:22:07,057 Epoch 104 Step: 254700 Batch Loss: 1.217458 Tokens per Sec: 21389, Lr: 0.000072 2020-02-13 00:22:17,255 Epoch 104 Step: 254800 Batch Loss: 1.254284 Tokens per Sec: 21695, Lr: 0.000072 2020-02-13 00:22:27,324 Epoch 104 Step: 254900 Batch Loss: 1.188282 Tokens per Sec: 22002, Lr: 0.000072 2020-02-13 00:22:37,326 Epoch 104 Step: 255000 Batch Loss: 1.048781 Tokens per Sec: 22177, Lr: 0.000072 2020-02-13 00:22:56,418 Hooray! New best validation result [ppl]! 2020-02-13 00:22:56,418 Saving new checkpoint. 2020-02-13 00:22:56,606 Example #0 2020-02-13 00:22:56,606 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 00:22:56,606 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 00:22:56,606 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 00:22:56,607 Reference: 10 : ​ 6 - 9 . 2020-02-13 00:22:56,607 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 00:22:56,607 Example #1 2020-02-13 00:22:56,607 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 00:22:56,607 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', ',', 'u', 'a', 'lu', 'mgb@@', 'ôghom', 'ne', '!', '—', 'Rom', '.'] 2020-02-13 00:22:56,607 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 00:22:56,607 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 00:22:56,607 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung , u a lu mgbôghom ne ! — Rom . 2020-02-13 00:22:56,607 Example #2 2020-02-13 00:22:56,607 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 00:22:56,607 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 00:22:56,607 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 00:22:56,607 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 00:22:56,607 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 00:22:56,608 Example #3 2020-02-13 00:22:56,608 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 00:22:56,608 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-13 00:22:56,608 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 00:22:56,608 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 00:22:56,608 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-13 00:22:56,608 Validation result (greedy) at epoch 104, step 255000: bleu: 29.49, loss: 39209.0234, ppl: 3.7601, duration: 19.2814s 2020-02-13 00:23:06,553 Epoch 104 Step: 255100 Batch Loss: 1.368749 Tokens per Sec: 22232, Lr: 0.000072 2020-02-13 00:23:16,462 Epoch 104 Step: 255200 Batch Loss: 1.071058 Tokens per Sec: 21364, Lr: 0.000072 2020-02-13 00:23:26,382 Epoch 104 Step: 255300 Batch Loss: 1.147667 Tokens per Sec: 21975, Lr: 0.000072 2020-02-13 00:23:36,324 Epoch 104 Step: 255400 Batch Loss: 1.260493 Tokens per Sec: 22800, Lr: 0.000072 2020-02-13 00:23:46,264 Epoch 104 Step: 255500 Batch Loss: 1.247657 Tokens per Sec: 22228, Lr: 0.000072 2020-02-13 00:23:56,239 Epoch 104 Step: 255600 Batch Loss: 1.197148 Tokens per Sec: 22403, Lr: 0.000072 2020-02-13 00:24:06,073 Epoch 104: total training loss 3097.82 2020-02-13 00:24:06,073 EPOCH 105 2020-02-13 00:24:06,455 Epoch 105 Step: 255700 Batch Loss: 1.343504 Tokens per Sec: 6511, Lr: 0.000072 2020-02-13 00:24:16,358 Epoch 105 Step: 255800 Batch Loss: 1.370999 Tokens per Sec: 22499, Lr: 0.000072 2020-02-13 00:24:26,342 Epoch 105 Step: 255900 Batch Loss: 1.308010 Tokens per Sec: 22861, Lr: 0.000072 2020-02-13 00:24:36,276 Epoch 105 Step: 256000 Batch Loss: 1.223086 Tokens per Sec: 21974, Lr: 0.000072 2020-02-13 00:24:55,031 Example #0 2020-02-13 00:24:55,031 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 00:24:55,031 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'vesen', 'seer', 'a', 'seer', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 00:24:55,031 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 00:24:55,031 Reference: 10 : ​ 6 - 9 . 2020-02-13 00:24:55,031 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu hen atô ve la , shi vea za hemen u lun a dooshima u a lu vesen seer a seer la . — Marku 10 : 6 - 9 . 2020-02-13 00:24:55,031 Example #1 2020-02-13 00:24:55,031 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 00:24:55,031 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 00:24:55,031 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 00:24:55,032 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 00:24:55,032 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 00:24:55,032 Example #2 2020-02-13 00:24:55,032 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 00:24:55,032 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 00:24:55,032 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 00:24:55,032 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 00:24:55,032 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 00:24:55,032 Example #3 2020-02-13 00:24:55,032 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 00:24:55,032 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-13 00:24:55,032 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 00:24:55,032 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 00:24:55,032 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-13 00:24:55,032 Validation result (greedy) at epoch 105, step 256000: bleu: 29.78, loss: 39281.6914, ppl: 3.7694, duration: 18.7557s 2020-02-13 00:25:04,961 Epoch 105 Step: 256100 Batch Loss: 1.420710 Tokens per Sec: 22224, Lr: 0.000072 2020-02-13 00:25:14,828 Epoch 105 Step: 256200 Batch Loss: 1.228551 Tokens per Sec: 22416, Lr: 0.000072 2020-02-13 00:25:24,697 Epoch 105 Step: 256300 Batch Loss: 1.128120 Tokens per Sec: 22673, Lr: 0.000072 2020-02-13 00:25:34,575 Epoch 105 Step: 256400 Batch Loss: 1.247263 Tokens per Sec: 22354, Lr: 0.000072 2020-02-13 00:25:44,478 Epoch 105 Step: 256500 Batch Loss: 1.326268 Tokens per Sec: 21657, Lr: 0.000072 2020-02-13 00:25:54,559 Epoch 105 Step: 256600 Batch Loss: 1.289921 Tokens per Sec: 21509, Lr: 0.000072 2020-02-13 00:26:04,498 Epoch 105 Step: 256700 Batch Loss: 1.221764 Tokens per Sec: 22122, Lr: 0.000072 2020-02-13 00:26:14,416 Epoch 105 Step: 256800 Batch Loss: 1.384741 Tokens per Sec: 22848, Lr: 0.000072 2020-02-13 00:26:24,291 Epoch 105 Step: 256900 Batch Loss: 1.027079 Tokens per Sec: 21740, Lr: 0.000072 2020-02-13 00:26:34,161 Epoch 105 Step: 257000 Batch Loss: 1.002331 Tokens per Sec: 22957, Lr: 0.000072 2020-02-13 00:26:52,810 Example #0 2020-02-13 00:26:52,810 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 00:26:52,810 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'vesen', 'seer', 'a', 'seer', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 00:26:52,810 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 00:26:52,810 Reference: 10 : ​ 6 - 9 . 2020-02-13 00:26:52,810 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu vesen seer a seer la . — Marku 10 : 6 - 9 . 2020-02-13 00:26:52,811 Example #1 2020-02-13 00:26:52,811 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 00:26:52,811 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 00:26:52,811 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 00:26:52,811 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 00:26:52,811 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 00:26:52,811 Example #2 2020-02-13 00:26:52,811 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 00:26:52,811 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 00:26:52,811 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 00:26:52,811 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 00:26:52,811 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 00:26:52,811 Example #3 2020-02-13 00:26:52,811 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 00:26:52,811 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-13 00:26:52,811 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 00:26:52,812 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 00:26:52,812 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-13 00:26:52,812 Validation result (greedy) at epoch 105, step 257000: bleu: 29.74, loss: 39316.3398, ppl: 3.7738, duration: 18.6503s 2020-02-13 00:27:02,684 Epoch 105 Step: 257100 Batch Loss: 1.213356 Tokens per Sec: 22106, Lr: 0.000072 2020-02-13 00:27:12,643 Epoch 105 Step: 257200 Batch Loss: 1.383278 Tokens per Sec: 22541, Lr: 0.000072 2020-02-13 00:27:22,713 Epoch 105 Step: 257300 Batch Loss: 1.178418 Tokens per Sec: 21592, Lr: 0.000072 2020-02-13 00:27:32,637 Epoch 105 Step: 257400 Batch Loss: 1.020035 Tokens per Sec: 22097, Lr: 0.000072 2020-02-13 00:27:42,591 Epoch 105 Step: 257500 Batch Loss: 1.398194 Tokens per Sec: 22356, Lr: 0.000072 2020-02-13 00:27:52,537 Epoch 105 Step: 257600 Batch Loss: 1.229598 Tokens per Sec: 21822, Lr: 0.000072 2020-02-13 00:28:02,601 Epoch 105 Step: 257700 Batch Loss: 1.294568 Tokens per Sec: 21909, Lr: 0.000072 2020-02-13 00:28:12,517 Epoch 105 Step: 257800 Batch Loss: 1.183481 Tokens per Sec: 22398, Lr: 0.000072 2020-02-13 00:28:22,391 Epoch 105 Step: 257900 Batch Loss: 1.237831 Tokens per Sec: 22371, Lr: 0.000072 2020-02-13 00:28:32,203 Epoch 105 Step: 258000 Batch Loss: 1.305856 Tokens per Sec: 22021, Lr: 0.000072 2020-02-13 00:28:51,340 Example #0 2020-02-13 00:28:51,340 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 00:28:51,340 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 've', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 00:28:51,340 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 00:28:51,340 Reference: 10 : ​ 6 - 9 . 2020-02-13 00:28:51,340 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima ve la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 00:28:51,341 Example #1 2020-02-13 00:28:51,341 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 00:28:51,341 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'ngu', 'ikyua', 'ikyua', '!', '—', 'Rom', '.'] 2020-02-13 00:28:51,341 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 00:28:51,341 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 00:28:51,341 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne ngu ikyua ikyua ! — Rom . 2020-02-13 00:28:51,341 Example #2 2020-02-13 00:28:51,341 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 00:28:51,341 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 00:28:51,341 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 00:28:51,341 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 00:28:51,341 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 00:28:51,341 Example #3 2020-02-13 00:28:51,341 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 00:28:51,341 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-13 00:28:51,342 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 00:28:51,342 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 00:28:51,342 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-13 00:28:51,342 Validation result (greedy) at epoch 105, step 258000: bleu: 29.97, loss: 39247.8047, ppl: 3.7650, duration: 19.1378s 2020-02-13 00:29:01,345 Epoch 105 Step: 258100 Batch Loss: 1.367967 Tokens per Sec: 21899, Lr: 0.000072 2020-02-13 00:29:07,687 Epoch 105: total training loss 3098.77 2020-02-13 00:29:07,687 EPOCH 106 2020-02-13 00:29:11,522 Epoch 106 Step: 258200 Batch Loss: 1.079117 Tokens per Sec: 20502, Lr: 0.000072 2020-02-13 00:29:21,388 Epoch 106 Step: 258300 Batch Loss: 1.262608 Tokens per Sec: 22612, Lr: 0.000072 2020-02-13 00:29:31,227 Epoch 106 Step: 258400 Batch Loss: 1.417173 Tokens per Sec: 22610, Lr: 0.000072 2020-02-13 00:29:41,122 Epoch 106 Step: 258500 Batch Loss: 1.118338 Tokens per Sec: 22270, Lr: 0.000072 2020-02-13 00:29:51,105 Epoch 106 Step: 258600 Batch Loss: 1.455571 Tokens per Sec: 22014, Lr: 0.000072 2020-02-13 00:30:01,020 Epoch 106 Step: 258700 Batch Loss: 1.428265 Tokens per Sec: 21992, Lr: 0.000072 2020-02-13 00:30:11,025 Epoch 106 Step: 258800 Batch Loss: 1.244021 Tokens per Sec: 22042, Lr: 0.000072 2020-02-13 00:30:21,075 Epoch 106 Step: 258900 Batch Loss: 1.362209 Tokens per Sec: 21970, Lr: 0.000072 2020-02-13 00:30:31,053 Epoch 106 Step: 259000 Batch Loss: 1.133992 Tokens per Sec: 21375, Lr: 0.000072 2020-02-13 00:30:49,998 Example #0 2020-02-13 00:30:49,999 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 00:30:49,999 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 00:30:49,999 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 00:30:49,999 Reference: 10 : ​ 6 - 9 . 2020-02-13 00:30:49,999 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la , shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 00:30:49,999 Example #1 2020-02-13 00:30:49,999 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 00:30:49,999 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 00:30:49,999 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 00:30:49,999 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 00:30:49,999 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 00:30:49,999 Example #2 2020-02-13 00:30:49,999 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 00:30:49,999 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 00:30:49,999 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 00:30:50,000 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 00:30:50,000 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 00:30:50,000 Example #3 2020-02-13 00:30:50,000 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 00:30:50,000 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-13 00:30:50,000 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 00:30:50,000 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 00:30:50,000 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-13 00:30:50,000 Validation result (greedy) at epoch 106, step 259000: bleu: 29.64, loss: 39272.7539, ppl: 3.7682, duration: 18.9466s 2020-02-13 00:30:59,971 Epoch 106 Step: 259100 Batch Loss: 1.318569 Tokens per Sec: 22303, Lr: 0.000072 2020-02-13 00:31:09,831 Epoch 106 Step: 259200 Batch Loss: 1.413016 Tokens per Sec: 21757, Lr: 0.000072 2020-02-13 00:31:19,833 Epoch 106 Step: 259300 Batch Loss: 1.264669 Tokens per Sec: 22855, Lr: 0.000072 2020-02-13 00:31:29,726 Epoch 106 Step: 259400 Batch Loss: 0.960195 Tokens per Sec: 22101, Lr: 0.000072 2020-02-13 00:31:39,580 Epoch 106 Step: 259500 Batch Loss: 1.390335 Tokens per Sec: 22420, Lr: 0.000072 2020-02-13 00:31:49,513 Epoch 106 Step: 259600 Batch Loss: 1.103143 Tokens per Sec: 22639, Lr: 0.000072 2020-02-13 00:31:59,393 Epoch 106 Step: 259700 Batch Loss: 1.111465 Tokens per Sec: 22660, Lr: 0.000072 2020-02-13 00:32:09,377 Epoch 106 Step: 259800 Batch Loss: 1.074378 Tokens per Sec: 21535, Lr: 0.000072 2020-02-13 00:32:19,233 Epoch 106 Step: 259900 Batch Loss: 1.419953 Tokens per Sec: 22487, Lr: 0.000072 2020-02-13 00:32:29,111 Epoch 106 Step: 260000 Batch Loss: 1.389098 Tokens per Sec: 22762, Lr: 0.000072 2020-02-13 00:32:48,135 Hooray! New best validation result [ppl]! 2020-02-13 00:32:48,135 Saving new checkpoint. 2020-02-13 00:32:48,333 Example #0 2020-02-13 00:32:48,333 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 00:32:48,333 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'vesen', 'seer', 'a', 'seer', 'la', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 00:32:48,333 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 00:32:48,333 Reference: 10 : ​ 6 - 9 . 2020-02-13 00:32:48,333 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu hen atô ve la , shi vea za hemen u lun a dooshima u a lu vesen seer a seer la . — Marku 10 : 6 - 9 . 2020-02-13 00:32:48,333 Example #1 2020-02-13 00:32:48,333 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 00:32:48,334 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'sha', 'kpôô', 'yô', ',', 'ngu', 'ikyua', '!', '—', 'Rom', '.'] 2020-02-13 00:32:48,334 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 00:32:48,334 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 00:32:48,334 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man sha kpôô yô , ngu ikyua ! — Rom . 2020-02-13 00:32:48,334 Example #2 2020-02-13 00:32:48,334 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 00:32:48,334 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 00:32:48,334 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 00:32:48,334 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 00:32:48,334 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 00:32:48,334 Example #3 2020-02-13 00:32:48,334 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 00:32:48,334 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-13 00:32:48,334 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 00:32:48,334 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 00:32:48,334 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-13 00:32:48,335 Validation result (greedy) at epoch 106, step 260000: bleu: 29.81, loss: 39201.0781, ppl: 3.7591, duration: 19.2234s 2020-02-13 00:32:58,313 Epoch 106 Step: 260100 Batch Loss: 1.341702 Tokens per Sec: 22256, Lr: 0.000072 2020-02-13 00:33:08,217 Epoch 106 Step: 260200 Batch Loss: 1.592748 Tokens per Sec: 22725, Lr: 0.000072 2020-02-13 00:33:18,146 Epoch 106 Step: 260300 Batch Loss: 1.124105 Tokens per Sec: 21603, Lr: 0.000072 2020-02-13 00:33:28,152 Epoch 106 Step: 260400 Batch Loss: 1.252782 Tokens per Sec: 22037, Lr: 0.000072 2020-02-13 00:33:37,999 Epoch 106 Step: 260500 Batch Loss: 1.283265 Tokens per Sec: 23256, Lr: 0.000072 2020-02-13 00:33:47,889 Epoch 106 Step: 260600 Batch Loss: 1.318260 Tokens per Sec: 22066, Lr: 0.000072 2020-02-13 00:33:50,163 Epoch 106: total training loss 3092.48 2020-02-13 00:33:50,163 EPOCH 107 2020-02-13 00:33:58,022 Epoch 107 Step: 260700 Batch Loss: 1.347417 Tokens per Sec: 21578, Lr: 0.000072 2020-02-13 00:34:07,954 Epoch 107 Step: 260800 Batch Loss: 1.288881 Tokens per Sec: 22382, Lr: 0.000072 2020-02-13 00:34:17,913 Epoch 107 Step: 260900 Batch Loss: 1.360177 Tokens per Sec: 22109, Lr: 0.000072 2020-02-13 00:34:27,963 Epoch 107 Step: 261000 Batch Loss: 1.385285 Tokens per Sec: 22368, Lr: 0.000072 2020-02-13 00:34:46,901 Example #0 2020-02-13 00:34:46,901 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 00:34:46,901 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 00:34:46,901 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 00:34:46,901 Reference: 10 : ​ 6 - 9 . 2020-02-13 00:34:46,902 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu hen atô ve la , shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 00:34:46,902 Example #1 2020-02-13 00:34:46,902 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 00:34:46,902 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'ngu', 'ikyua', 'ikyua', '!', '—', 'Rom', '.'] 2020-02-13 00:34:46,902 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 00:34:46,902 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 00:34:46,902 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne ngu ikyua ikyua ! — Rom . 2020-02-13 00:34:46,902 Example #2 2020-02-13 00:34:46,902 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 00:34:46,902 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 00:34:46,902 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 00:34:46,902 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 00:34:46,902 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 00:34:46,902 Example #3 2020-02-13 00:34:46,902 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 00:34:46,902 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-13 00:34:46,903 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 00:34:46,903 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 00:34:46,903 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-13 00:34:46,903 Validation result (greedy) at epoch 107, step 261000: bleu: 29.77, loss: 39299.8242, ppl: 3.7717, duration: 18.9387s 2020-02-13 00:34:56,765 Epoch 107 Step: 261100 Batch Loss: 1.261043 Tokens per Sec: 22262, Lr: 0.000072 2020-02-13 00:35:06,763 Epoch 107 Step: 261200 Batch Loss: 1.202742 Tokens per Sec: 21906, Lr: 0.000072 2020-02-13 00:35:16,694 Epoch 107 Step: 261300 Batch Loss: 1.223609 Tokens per Sec: 21802, Lr: 0.000072 2020-02-13 00:35:26,637 Epoch 107 Step: 261400 Batch Loss: 1.482618 Tokens per Sec: 22491, Lr: 0.000072 2020-02-13 00:35:36,547 Epoch 107 Step: 261500 Batch Loss: 1.137016 Tokens per Sec: 22713, Lr: 0.000072 2020-02-13 00:35:46,497 Epoch 107 Step: 261600 Batch Loss: 1.045258 Tokens per Sec: 22251, Lr: 0.000072 2020-02-13 00:35:56,477 Epoch 107 Step: 261700 Batch Loss: 1.108188 Tokens per Sec: 21986, Lr: 0.000072 2020-02-13 00:36:06,526 Epoch 107 Step: 261800 Batch Loss: 0.883211 Tokens per Sec: 21866, Lr: 0.000072 2020-02-13 00:36:16,434 Epoch 107 Step: 261900 Batch Loss: 1.184630 Tokens per Sec: 22687, Lr: 0.000072 2020-02-13 00:36:26,556 Epoch 107 Step: 262000 Batch Loss: 1.150467 Tokens per Sec: 21613, Lr: 0.000072 2020-02-13 00:36:45,039 Example #0 2020-02-13 00:36:45,040 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 00:36:45,040 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 00:36:45,040 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 00:36:45,040 Reference: 10 : ​ 6 - 9 . 2020-02-13 00:36:45,040 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu hen atô ve la , shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 00:36:45,040 Example #1 2020-02-13 00:36:45,040 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 00:36:45,040 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 00:36:45,040 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 00:36:45,040 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 00:36:45,040 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 00:36:45,040 Example #2 2020-02-13 00:36:45,040 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 00:36:45,040 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 00:36:45,041 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 00:36:45,041 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 00:36:45,041 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 00:36:45,041 Example #3 2020-02-13 00:36:45,041 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 00:36:45,041 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-13 00:36:45,041 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 00:36:45,041 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 00:36:45,041 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-13 00:36:45,041 Validation result (greedy) at epoch 107, step 262000: bleu: 29.58, loss: 39219.6289, ppl: 3.7615, duration: 18.4844s 2020-02-13 00:36:55,018 Epoch 107 Step: 262100 Batch Loss: 1.337429 Tokens per Sec: 22492, Lr: 0.000072 2020-02-13 00:37:05,041 Epoch 107 Step: 262200 Batch Loss: 1.224099 Tokens per Sec: 21897, Lr: 0.000072 2020-02-13 00:37:15,017 Epoch 107 Step: 262300 Batch Loss: 1.228237 Tokens per Sec: 21976, Lr: 0.000072 2020-02-13 00:37:24,984 Epoch 107 Step: 262400 Batch Loss: 1.308779 Tokens per Sec: 22143, Lr: 0.000072 2020-02-13 00:37:34,891 Epoch 107 Step: 262500 Batch Loss: 1.341813 Tokens per Sec: 22401, Lr: 0.000072 2020-02-13 00:37:44,779 Epoch 107 Step: 262600 Batch Loss: 1.130546 Tokens per Sec: 21975, Lr: 0.000072 2020-02-13 00:37:54,768 Epoch 107 Step: 262700 Batch Loss: 1.207699 Tokens per Sec: 21661, Lr: 0.000072 2020-02-13 00:38:04,651 Epoch 107 Step: 262800 Batch Loss: 1.315492 Tokens per Sec: 22279, Lr: 0.000072 2020-02-13 00:38:14,616 Epoch 107 Step: 262900 Batch Loss: 1.444463 Tokens per Sec: 21688, Lr: 0.000072 2020-02-13 00:38:24,506 Epoch 107 Step: 263000 Batch Loss: 1.390822 Tokens per Sec: 22184, Lr: 0.000072 2020-02-13 00:38:44,062 Hooray! New best validation result [ppl]! 2020-02-13 00:38:44,063 Saving new checkpoint. 2020-02-13 00:38:44,251 Example #0 2020-02-13 00:38:44,251 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 00:38:44,251 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'her', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 00:38:44,252 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 00:38:44,252 Reference: 10 : ​ 6 - 9 . 2020-02-13 00:38:44,252 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu hen atô ve la her shi vea za hemen u lun a dooshima u a lu her la her . — Marku 10 : 6 - 9 . 2020-02-13 00:38:44,252 Example #1 2020-02-13 00:38:44,252 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 00:38:44,252 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 00:38:44,252 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 00:38:44,252 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 00:38:44,252 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 00:38:44,252 Example #2 2020-02-13 00:38:44,252 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 00:38:44,252 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 00:38:44,252 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 00:38:44,252 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 00:38:44,252 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 00:38:44,253 Example #3 2020-02-13 00:38:44,253 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 00:38:44,253 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-13 00:38:44,253 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 00:38:44,253 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 00:38:44,253 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-13 00:38:44,253 Validation result (greedy) at epoch 107, step 263000: bleu: 29.73, loss: 39180.1914, ppl: 3.7565, duration: 19.7465s 2020-02-13 00:38:52,996 Epoch 107: total training loss 3098.01 2020-02-13 00:38:52,996 EPOCH 108 2020-02-13 00:38:54,459 Epoch 108 Step: 263100 Batch Loss: 1.156346 Tokens per Sec: 19699, Lr: 0.000072 2020-02-13 00:39:04,540 Epoch 108 Step: 263200 Batch Loss: 1.036815 Tokens per Sec: 22021, Lr: 0.000072 2020-02-13 00:39:14,671 Epoch 108 Step: 263300 Batch Loss: 0.827295 Tokens per Sec: 22165, Lr: 0.000072 2020-02-13 00:39:24,647 Epoch 108 Step: 263400 Batch Loss: 1.062231 Tokens per Sec: 21541, Lr: 0.000072 2020-02-13 00:39:34,533 Epoch 108 Step: 263500 Batch Loss: 1.127934 Tokens per Sec: 22486, Lr: 0.000072 2020-02-13 00:39:44,381 Epoch 108 Step: 263600 Batch Loss: 1.056101 Tokens per Sec: 22474, Lr: 0.000072 2020-02-13 00:39:54,294 Epoch 108 Step: 263700 Batch Loss: 1.137177 Tokens per Sec: 22465, Lr: 0.000072 2020-02-13 00:40:04,188 Epoch 108 Step: 263800 Batch Loss: 1.447917 Tokens per Sec: 22747, Lr: 0.000072 2020-02-13 00:40:14,004 Epoch 108 Step: 263900 Batch Loss: 1.090875 Tokens per Sec: 21748, Lr: 0.000072 2020-02-13 00:40:23,847 Epoch 108 Step: 264000 Batch Loss: 1.339331 Tokens per Sec: 22299, Lr: 0.000072 2020-02-13 00:40:42,711 Example #0 2020-02-13 00:40:42,711 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 00:40:42,711 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 00:40:42,711 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 00:40:42,711 Reference: 10 : ​ 6 - 9 . 2020-02-13 00:40:42,711 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu hen atô ve la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 00:40:42,712 Example #1 2020-02-13 00:40:42,712 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 00:40:42,712 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 00:40:42,712 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 00:40:42,712 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 00:40:42,712 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 00:40:42,712 Example #2 2020-02-13 00:40:42,712 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 00:40:42,712 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 00:40:42,712 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 00:40:42,712 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 00:40:42,712 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 00:40:42,712 Example #3 2020-02-13 00:40:42,712 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 00:40:42,712 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-13 00:40:42,712 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 00:40:42,713 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 00:40:42,713 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-13 00:40:42,713 Validation result (greedy) at epoch 108, step 264000: bleu: 29.84, loss: 39222.6484, ppl: 3.7618, duration: 18.8653s 2020-02-13 00:40:52,726 Epoch 108 Step: 264100 Batch Loss: 1.324310 Tokens per Sec: 22032, Lr: 0.000072 2020-02-13 00:41:02,726 Epoch 108 Step: 264200 Batch Loss: 1.145500 Tokens per Sec: 21514, Lr: 0.000072 2020-02-13 00:41:12,578 Epoch 108 Step: 264300 Batch Loss: 1.162995 Tokens per Sec: 21941, Lr: 0.000072 2020-02-13 00:41:22,581 Epoch 108 Step: 264400 Batch Loss: 1.207520 Tokens per Sec: 21840, Lr: 0.000072 2020-02-13 00:41:32,512 Epoch 108 Step: 264500 Batch Loss: 1.344856 Tokens per Sec: 22138, Lr: 0.000072 2020-02-13 00:41:42,383 Epoch 108 Step: 264600 Batch Loss: 1.459048 Tokens per Sec: 22861, Lr: 0.000072 2020-02-13 00:41:52,312 Epoch 108 Step: 264700 Batch Loss: 1.254363 Tokens per Sec: 22326, Lr: 0.000072 2020-02-13 00:42:02,340 Epoch 108 Step: 264800 Batch Loss: 0.928287 Tokens per Sec: 21827, Lr: 0.000072 2020-02-13 00:42:12,310 Epoch 108 Step: 264900 Batch Loss: 1.443236 Tokens per Sec: 22622, Lr: 0.000072 2020-02-13 00:42:22,355 Epoch 108 Step: 265000 Batch Loss: 1.290373 Tokens per Sec: 21790, Lr: 0.000072 2020-02-13 00:42:40,962 Example #0 2020-02-13 00:42:40,962 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 00:42:40,962 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 00:42:40,963 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 00:42:40,963 Reference: 10 : ​ 6 - 9 . 2020-02-13 00:42:40,963 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu hen atô ve la , shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 00:42:40,963 Example #1 2020-02-13 00:42:40,963 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 00:42:40,963 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'sha', 'kpôô', 'yô', ',', 'ngu', 'ikyua', '!', '—', 'Rom', '.'] 2020-02-13 00:42:40,963 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 00:42:40,963 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 00:42:40,963 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man sha kpôô yô , ngu ikyua ! — Rom . 2020-02-13 00:42:40,963 Example #2 2020-02-13 00:42:40,963 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 00:42:40,963 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 00:42:40,963 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 00:42:40,963 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 00:42:40,963 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 00:42:40,964 Example #3 2020-02-13 00:42:40,964 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 00:42:40,964 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-13 00:42:40,964 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 00:42:40,964 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 00:42:40,964 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-13 00:42:40,964 Validation result (greedy) at epoch 108, step 265000: bleu: 29.71, loss: 39203.9336, ppl: 3.7595, duration: 18.6080s 2020-02-13 00:42:50,902 Epoch 108 Step: 265100 Batch Loss: 1.221853 Tokens per Sec: 22092, Lr: 0.000072 2020-02-13 00:43:00,765 Epoch 108 Step: 265200 Batch Loss: 1.162241 Tokens per Sec: 22045, Lr: 0.000072 2020-02-13 00:43:10,717 Epoch 108 Step: 265300 Batch Loss: 1.452795 Tokens per Sec: 22271, Lr: 0.000072 2020-02-13 00:43:20,646 Epoch 108 Step: 265400 Batch Loss: 1.290536 Tokens per Sec: 22592, Lr: 0.000072 2020-02-13 00:43:30,611 Epoch 108 Step: 265500 Batch Loss: 0.734834 Tokens per Sec: 22055, Lr: 0.000072 2020-02-13 00:43:35,762 Epoch 108: total training loss 3093.24 2020-02-13 00:43:35,763 EPOCH 109 2020-02-13 00:43:40,801 Epoch 109 Step: 265600 Batch Loss: 1.362849 Tokens per Sec: 21813, Lr: 0.000072 2020-02-13 00:43:50,907 Epoch 109 Step: 265700 Batch Loss: 1.539136 Tokens per Sec: 21590, Lr: 0.000072 2020-02-13 00:44:00,844 Epoch 109 Step: 265800 Batch Loss: 1.305268 Tokens per Sec: 22468, Lr: 0.000072 2020-02-13 00:44:10,803 Epoch 109 Step: 265900 Batch Loss: 1.206843 Tokens per Sec: 22404, Lr: 0.000072 2020-02-13 00:44:20,724 Epoch 109 Step: 266000 Batch Loss: 1.325701 Tokens per Sec: 22078, Lr: 0.000072 2020-02-13 00:44:39,367 Example #0 2020-02-13 00:44:39,367 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 00:44:39,367 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'vesen', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 00:44:39,367 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 00:44:39,367 Reference: 10 : ​ 6 - 9 . 2020-02-13 00:44:39,367 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu hen atô ve la her shi vea za hemen u lun a dooshima u a lu vesen la her . — Marku 10 : 6 - 9 . 2020-02-13 00:44:39,367 Example #1 2020-02-13 00:44:39,367 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 00:44:39,367 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 00:44:39,367 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 00:44:39,367 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 00:44:39,367 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 00:44:39,368 Example #2 2020-02-13 00:44:39,368 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 00:44:39,368 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 00:44:39,368 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 00:44:39,368 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 00:44:39,368 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 00:44:39,368 Example #3 2020-02-13 00:44:39,368 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 00:44:39,368 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-13 00:44:39,368 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 00:44:39,368 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 00:44:39,368 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-13 00:44:39,368 Validation result (greedy) at epoch 109, step 266000: bleu: 29.69, loss: 39210.3398, ppl: 3.7603, duration: 18.6434s 2020-02-13 00:44:49,361 Epoch 109 Step: 266100 Batch Loss: 1.347969 Tokens per Sec: 22453, Lr: 0.000072 2020-02-13 00:44:59,344 Epoch 109 Step: 266200 Batch Loss: 1.265077 Tokens per Sec: 22661, Lr: 0.000072 2020-02-13 00:45:09,427 Epoch 109 Step: 266300 Batch Loss: 1.436891 Tokens per Sec: 21763, Lr: 0.000072 2020-02-13 00:45:19,580 Epoch 109 Step: 266400 Batch Loss: 1.267833 Tokens per Sec: 21990, Lr: 0.000072 2020-02-13 00:45:29,780 Epoch 109 Step: 266500 Batch Loss: 1.163313 Tokens per Sec: 21531, Lr: 0.000072 2020-02-13 00:45:39,843 Epoch 109 Step: 266600 Batch Loss: 1.131064 Tokens per Sec: 22018, Lr: 0.000072 2020-02-13 00:45:50,030 Epoch 109 Step: 266700 Batch Loss: 1.356123 Tokens per Sec: 21737, Lr: 0.000072 2020-02-13 00:46:00,116 Epoch 109 Step: 266800 Batch Loss: 1.491369 Tokens per Sec: 21981, Lr: 0.000072 2020-02-13 00:46:10,259 Epoch 109 Step: 266900 Batch Loss: 1.252364 Tokens per Sec: 21602, Lr: 0.000072 2020-02-13 00:46:20,206 Epoch 109 Step: 267000 Batch Loss: 1.256625 Tokens per Sec: 21979, Lr: 0.000072 2020-02-13 00:46:38,497 Example #0 2020-02-13 00:46:38,497 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 00:46:38,497 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'vesen', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 00:46:38,497 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 00:46:38,497 Reference: 10 : ​ 6 - 9 . 2020-02-13 00:46:38,497 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu vesen la her . — Marku 10 : 6 - 9 . 2020-02-13 00:46:38,497 Example #1 2020-02-13 00:46:38,497 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 00:46:38,497 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'imba', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'zan', 'zan', 'hegen', 'je', 'kpaa', '!', '—', 'Rom', '.'] 2020-02-13 00:46:38,497 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 00:46:38,498 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 00:46:38,498 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a imba shighe u doon tsung ne , man zan zan hegen je kpaa ! — Rom . 2020-02-13 00:46:38,498 Example #2 2020-02-13 00:46:38,498 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 00:46:38,498 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 00:46:38,498 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 00:46:38,498 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 00:46:38,498 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 00:46:38,498 Example #3 2020-02-13 00:46:38,498 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 00:46:38,498 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-13 00:46:38,498 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 00:46:38,498 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 00:46:38,498 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-13 00:46:38,498 Validation result (greedy) at epoch 109, step 267000: bleu: 29.53, loss: 39301.1094, ppl: 3.7718, duration: 18.2919s 2020-02-13 00:46:48,454 Epoch 109 Step: 267100 Batch Loss: 1.152020 Tokens per Sec: 22345, Lr: 0.000072 2020-02-13 00:46:58,326 Epoch 109 Step: 267200 Batch Loss: 1.364757 Tokens per Sec: 22156, Lr: 0.000072 2020-02-13 00:47:08,262 Epoch 109 Step: 267300 Batch Loss: 1.558336 Tokens per Sec: 22195, Lr: 0.000072 2020-02-13 00:47:18,129 Epoch 109 Step: 267400 Batch Loss: 1.276172 Tokens per Sec: 22173, Lr: 0.000072 2020-02-13 00:47:28,025 Epoch 109 Step: 267500 Batch Loss: 1.110446 Tokens per Sec: 22669, Lr: 0.000072 2020-02-13 00:47:38,042 Epoch 109 Step: 267600 Batch Loss: 1.140563 Tokens per Sec: 21525, Lr: 0.000072 2020-02-13 00:47:48,060 Epoch 109 Step: 267700 Batch Loss: 1.291323 Tokens per Sec: 21808, Lr: 0.000072 2020-02-13 00:47:58,125 Epoch 109 Step: 267800 Batch Loss: 1.057094 Tokens per Sec: 22511, Lr: 0.000072 2020-02-13 00:48:08,207 Epoch 109 Step: 267900 Batch Loss: 1.444819 Tokens per Sec: 22186, Lr: 0.000072 2020-02-13 00:48:18,145 Epoch 109 Step: 268000 Batch Loss: 1.194963 Tokens per Sec: 21998, Lr: 0.000072 2020-02-13 00:48:37,226 Example #0 2020-02-13 00:48:37,227 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 00:48:37,227 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 00:48:37,227 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 00:48:37,227 Reference: 10 : ​ 6 - 9 . 2020-02-13 00:48:37,227 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 00:48:37,227 Example #1 2020-02-13 00:48:37,227 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 00:48:37,227 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 00:48:37,227 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 00:48:37,227 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 00:48:37,227 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung , man kwagh ne mgbôghom ! — Rom . 2020-02-13 00:48:37,227 Example #2 2020-02-13 00:48:37,227 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 00:48:37,228 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 00:48:37,228 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 00:48:37,228 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 00:48:37,228 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 00:48:37,228 Example #3 2020-02-13 00:48:37,228 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 00:48:37,228 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-13 00:48:37,228 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 00:48:37,228 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 00:48:37,228 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-13 00:48:37,228 Validation result (greedy) at epoch 109, step 268000: bleu: 29.48, loss: 39208.1797, ppl: 3.7600, duration: 19.0825s 2020-02-13 00:48:38,037 Epoch 109: total training loss 3082.36 2020-02-13 00:48:38,037 EPOCH 110 2020-02-13 00:48:47,483 Epoch 110 Step: 268100 Batch Loss: 1.388200 Tokens per Sec: 21890, Lr: 0.000072 2020-02-13 00:48:57,411 Epoch 110 Step: 268200 Batch Loss: 1.219690 Tokens per Sec: 22165, Lr: 0.000072 2020-02-13 00:49:07,392 Epoch 110 Step: 268300 Batch Loss: 1.300857 Tokens per Sec: 22078, Lr: 0.000072 2020-02-13 00:49:17,347 Epoch 110 Step: 268400 Batch Loss: 1.294703 Tokens per Sec: 22615, Lr: 0.000072 2020-02-13 00:49:27,452 Epoch 110 Step: 268500 Batch Loss: 1.247168 Tokens per Sec: 21530, Lr: 0.000072 2020-02-13 00:49:37,630 Epoch 110 Step: 268600 Batch Loss: 1.174521 Tokens per Sec: 22250, Lr: 0.000072 2020-02-13 00:49:47,801 Epoch 110 Step: 268700 Batch Loss: 1.011950 Tokens per Sec: 21581, Lr: 0.000072 2020-02-13 00:49:57,938 Epoch 110 Step: 268800 Batch Loss: 1.269603 Tokens per Sec: 22116, Lr: 0.000072 2020-02-13 00:50:08,058 Epoch 110 Step: 268900 Batch Loss: 1.356562 Tokens per Sec: 21567, Lr: 0.000072 2020-02-13 00:50:18,145 Epoch 110 Step: 269000 Batch Loss: 1.350865 Tokens per Sec: 22032, Lr: 0.000072 2020-02-13 00:50:37,620 Example #0 2020-02-13 00:50:37,620 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 00:50:37,620 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 00:50:37,620 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 00:50:37,620 Reference: 10 : ​ 6 - 9 . 2020-02-13 00:50:37,621 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 00:50:37,621 Example #1 2020-02-13 00:50:37,621 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 00:50:37,621 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'sha', 'kpôô', 'yô', ',', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 00:50:37,621 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 00:50:37,621 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 00:50:37,621 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man sha kpôô yô , mgbôghom ! — Rom . 2020-02-13 00:50:37,621 Example #2 2020-02-13 00:50:37,621 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 00:50:37,621 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 00:50:37,621 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 00:50:37,621 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 00:50:37,621 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 00:50:37,621 Example #3 2020-02-13 00:50:37,621 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 00:50:37,621 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-13 00:50:37,622 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 00:50:37,622 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 00:50:37,622 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-13 00:50:37,622 Validation result (greedy) at epoch 110, step 269000: bleu: 29.27, loss: 39204.6914, ppl: 3.7596, duration: 19.4764s 2020-02-13 00:50:47,730 Epoch 110 Step: 269100 Batch Loss: 1.206247 Tokens per Sec: 21461, Lr: 0.000050 2020-02-13 00:50:57,637 Epoch 110 Step: 269200 Batch Loss: 1.363356 Tokens per Sec: 21782, Lr: 0.000050 2020-02-13 00:51:07,682 Epoch 110 Step: 269300 Batch Loss: 1.140164 Tokens per Sec: 22054, Lr: 0.000050 2020-02-13 00:51:17,886 Epoch 110 Step: 269400 Batch Loss: 1.172232 Tokens per Sec: 22347, Lr: 0.000050 2020-02-13 00:51:28,188 Epoch 110 Step: 269500 Batch Loss: 1.257564 Tokens per Sec: 21665, Lr: 0.000050 2020-02-13 00:51:38,294 Epoch 110 Step: 269600 Batch Loss: 1.163283 Tokens per Sec: 21356, Lr: 0.000050 2020-02-13 00:51:48,546 Epoch 110 Step: 269700 Batch Loss: 1.139550 Tokens per Sec: 21855, Lr: 0.000050 2020-02-13 00:51:58,645 Epoch 110 Step: 269800 Batch Loss: 1.074078 Tokens per Sec: 21942, Lr: 0.000050 2020-02-13 00:52:08,693 Epoch 110 Step: 269900 Batch Loss: 1.212767 Tokens per Sec: 21663, Lr: 0.000050 2020-02-13 00:52:18,718 Epoch 110 Step: 270000 Batch Loss: 1.209676 Tokens per Sec: 22981, Lr: 0.000050 2020-02-13 00:52:37,777 Hooray! New best validation result [ppl]! 2020-02-13 00:52:37,777 Saving new checkpoint. 2020-02-13 00:52:37,970 Example #0 2020-02-13 00:52:37,970 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 00:52:37,970 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 00:52:37,970 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 00:52:37,970 Reference: 10 : ​ 6 - 9 . 2020-02-13 00:52:37,970 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 00:52:37,971 Example #1 2020-02-13 00:52:37,971 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 00:52:37,971 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'sha', 'kpôô', 'yô', ',', 'ngu', 'ikyua', '!', '—', 'Rom', '.'] 2020-02-13 00:52:37,971 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 00:52:37,971 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 00:52:37,971 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man sha kpôô yô , ngu ikyua ! — Rom . 2020-02-13 00:52:37,971 Example #2 2020-02-13 00:52:37,971 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 00:52:37,971 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 00:52:37,971 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 00:52:37,971 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 00:52:37,971 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 00:52:37,971 Example #3 2020-02-13 00:52:37,971 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 00:52:37,972 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-13 00:52:37,972 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 00:52:37,972 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 00:52:37,972 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-13 00:52:37,972 Validation result (greedy) at epoch 110, step 270000: bleu: 29.62, loss: 39144.9453, ppl: 3.7520, duration: 19.2537s 2020-02-13 00:52:47,953 Epoch 110 Step: 270100 Batch Loss: 1.448698 Tokens per Sec: 22235, Lr: 0.000050 2020-02-13 00:52:57,901 Epoch 110 Step: 270200 Batch Loss: 1.182219 Tokens per Sec: 22700, Lr: 0.000050 2020-02-13 00:53:07,862 Epoch 110 Step: 270300 Batch Loss: 1.370716 Tokens per Sec: 22544, Lr: 0.000050 2020-02-13 00:53:17,693 Epoch 110 Step: 270400 Batch Loss: 1.242134 Tokens per Sec: 21948, Lr: 0.000050 2020-02-13 00:53:23,508 Epoch 110: total training loss 3068.33 2020-02-13 00:53:23,508 EPOCH 111 2020-02-13 00:53:27,819 Epoch 111 Step: 270500 Batch Loss: 0.903553 Tokens per Sec: 20205, Lr: 0.000050 2020-02-13 00:53:37,684 Epoch 111 Step: 270600 Batch Loss: 1.324145 Tokens per Sec: 22533, Lr: 0.000050 2020-02-13 00:53:47,656 Epoch 111 Step: 270700 Batch Loss: 1.263094 Tokens per Sec: 22308, Lr: 0.000050 2020-02-13 00:53:57,482 Epoch 111 Step: 270800 Batch Loss: 1.246515 Tokens per Sec: 22622, Lr: 0.000050 2020-02-13 00:54:07,322 Epoch 111 Step: 270900 Batch Loss: 1.273393 Tokens per Sec: 22596, Lr: 0.000050 2020-02-13 00:54:17,130 Epoch 111 Step: 271000 Batch Loss: 1.167992 Tokens per Sec: 22643, Lr: 0.000050 2020-02-13 00:54:36,766 Example #0 2020-02-13 00:54:36,767 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 00:54:36,767 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 00:54:36,767 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 00:54:36,767 Reference: 10 : ​ 6 - 9 . 2020-02-13 00:54:36,767 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu hen atô ve la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 00:54:36,767 Example #1 2020-02-13 00:54:36,767 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 00:54:36,767 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 00:54:36,767 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 00:54:36,767 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 00:54:36,767 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 00:54:36,767 Example #2 2020-02-13 00:54:36,767 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 00:54:36,768 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 00:54:36,768 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 00:54:36,768 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 00:54:36,768 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 00:54:36,768 Example #3 2020-02-13 00:54:36,768 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 00:54:36,768 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-13 00:54:36,768 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 00:54:36,768 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 00:54:36,768 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-13 00:54:36,768 Validation result (greedy) at epoch 111, step 271000: bleu: 29.69, loss: 39216.9336, ppl: 3.7611, duration: 19.6374s 2020-02-13 00:54:46,629 Epoch 111 Step: 271100 Batch Loss: 1.470224 Tokens per Sec: 22155, Lr: 0.000050 2020-02-13 00:54:56,531 Epoch 111 Step: 271200 Batch Loss: 1.381191 Tokens per Sec: 22565, Lr: 0.000050 2020-02-13 00:55:06,667 Epoch 111 Step: 271300 Batch Loss: 1.344299 Tokens per Sec: 21591, Lr: 0.000050 2020-02-13 00:55:16,750 Epoch 111 Step: 271400 Batch Loss: 1.189072 Tokens per Sec: 22262, Lr: 0.000050 2020-02-13 00:55:26,897 Epoch 111 Step: 271500 Batch Loss: 1.180191 Tokens per Sec: 22373, Lr: 0.000050 2020-02-13 00:55:37,085 Epoch 111 Step: 271600 Batch Loss: 1.048867 Tokens per Sec: 21291, Lr: 0.000050 2020-02-13 00:55:47,344 Epoch 111 Step: 271700 Batch Loss: 1.195499 Tokens per Sec: 20787, Lr: 0.000050 2020-02-13 00:55:57,323 Epoch 111 Step: 271800 Batch Loss: 1.112380 Tokens per Sec: 22077, Lr: 0.000050 2020-02-13 00:56:07,267 Epoch 111 Step: 271900 Batch Loss: 1.069875 Tokens per Sec: 22256, Lr: 0.000050 2020-02-13 00:56:17,274 Epoch 111 Step: 272000 Batch Loss: 1.290163 Tokens per Sec: 22281, Lr: 0.000050 2020-02-13 00:56:36,349 Example #0 2020-02-13 00:56:36,349 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 00:56:36,350 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 00:56:36,350 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 00:56:36,350 Reference: 10 : ​ 6 - 9 . 2020-02-13 00:56:36,350 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 00:56:36,350 Example #1 2020-02-13 00:56:36,350 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 00:56:36,350 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'sha', 'kpôô', 'yô', ',', 'ngu', 'ikyua', '!', '—', 'Rom', '.'] 2020-02-13 00:56:36,350 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 00:56:36,350 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 00:56:36,350 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man sha kpôô yô , ngu ikyua ! — Rom . 2020-02-13 00:56:36,350 Example #2 2020-02-13 00:56:36,350 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 00:56:36,350 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 00:56:36,350 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 00:56:36,350 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 00:56:36,350 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 00:56:36,351 Example #3 2020-02-13 00:56:36,351 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 00:56:36,351 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-13 00:56:36,351 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 00:56:36,351 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 00:56:36,351 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-13 00:56:36,351 Validation result (greedy) at epoch 111, step 272000: bleu: 29.93, loss: 39148.7109, ppl: 3.7525, duration: 19.0762s 2020-02-13 00:56:46,318 Epoch 111 Step: 272100 Batch Loss: 1.254196 Tokens per Sec: 22233, Lr: 0.000050 2020-02-13 00:56:56,234 Epoch 111 Step: 272200 Batch Loss: 1.308479 Tokens per Sec: 21630, Lr: 0.000050 2020-02-13 00:57:06,195 Epoch 111 Step: 272300 Batch Loss: 1.322196 Tokens per Sec: 22392, Lr: 0.000050 2020-02-13 00:57:16,160 Epoch 111 Step: 272400 Batch Loss: 1.426411 Tokens per Sec: 22220, Lr: 0.000050 2020-02-13 00:57:26,200 Epoch 111 Step: 272500 Batch Loss: 1.201928 Tokens per Sec: 22297, Lr: 0.000050 2020-02-13 00:57:36,089 Epoch 111 Step: 272600 Batch Loss: 1.454687 Tokens per Sec: 22604, Lr: 0.000050 2020-02-13 00:57:45,982 Epoch 111 Step: 272700 Batch Loss: 1.298155 Tokens per Sec: 22900, Lr: 0.000050 2020-02-13 00:57:55,980 Epoch 111 Step: 272800 Batch Loss: 1.294007 Tokens per Sec: 21730, Lr: 0.000050 2020-02-13 00:58:05,889 Epoch 111 Step: 272900 Batch Loss: 1.279588 Tokens per Sec: 22349, Lr: 0.000050 2020-02-13 00:58:07,564 Epoch 111: total training loss 3070.00 2020-02-13 00:58:07,564 EPOCH 112 2020-02-13 00:58:16,043 Epoch 112 Step: 273000 Batch Loss: 1.183680 Tokens per Sec: 21868, Lr: 0.000050 2020-02-13 00:58:35,487 Hooray! New best validation result [ppl]! 2020-02-13 00:58:35,488 Saving new checkpoint. 2020-02-13 00:58:35,688 Example #0 2020-02-13 00:58:35,688 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 00:58:35,689 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'vesen', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 00:58:35,689 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 00:58:35,689 Reference: 10 : ​ 6 - 9 . 2020-02-13 00:58:35,689 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu vesen la her . — Marku 10 : 6 - 9 . 2020-02-13 00:58:35,689 Example #1 2020-02-13 00:58:35,689 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 00:58:35,689 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'zan', 'zan', 'hegen', 'je', 'kpaa', '!', '—', 'Rom', '.'] 2020-02-13 00:58:35,689 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 00:58:35,689 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 00:58:35,689 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man zan zan hegen je kpaa ! — Rom . 2020-02-13 00:58:35,689 Example #2 2020-02-13 00:58:35,689 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 00:58:35,689 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 00:58:35,689 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 00:58:35,689 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 00:58:35,689 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 00:58:35,690 Example #3 2020-02-13 00:58:35,690 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 00:58:35,690 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-13 00:58:35,690 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 00:58:35,690 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 00:58:35,690 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-13 00:58:35,690 Validation result (greedy) at epoch 112, step 273000: bleu: 29.69, loss: 39139.0742, ppl: 3.7512, duration: 19.6462s 2020-02-13 00:58:45,597 Epoch 112 Step: 273100 Batch Loss: 1.284662 Tokens per Sec: 22327, Lr: 0.000050 2020-02-13 00:58:55,551 Epoch 112 Step: 273200 Batch Loss: 1.304289 Tokens per Sec: 21842, Lr: 0.000050 2020-02-13 00:59:05,652 Epoch 112 Step: 273300 Batch Loss: 1.215265 Tokens per Sec: 22128, Lr: 0.000050 2020-02-13 00:59:15,714 Epoch 112 Step: 273400 Batch Loss: 0.996722 Tokens per Sec: 21831, Lr: 0.000050 2020-02-13 00:59:25,796 Epoch 112 Step: 273500 Batch Loss: 1.398646 Tokens per Sec: 22493, Lr: 0.000050 2020-02-13 00:59:35,730 Epoch 112 Step: 273600 Batch Loss: 1.189324 Tokens per Sec: 22897, Lr: 0.000050 2020-02-13 00:59:45,628 Epoch 112 Step: 273700 Batch Loss: 1.084917 Tokens per Sec: 22160, Lr: 0.000050 2020-02-13 00:59:55,660 Epoch 112 Step: 273800 Batch Loss: 1.332346 Tokens per Sec: 22290, Lr: 0.000050 2020-02-13 01:00:05,716 Epoch 112 Step: 273900 Batch Loss: 1.073579 Tokens per Sec: 21704, Lr: 0.000050 2020-02-13 01:00:15,599 Epoch 112 Step: 274000 Batch Loss: 1.311541 Tokens per Sec: 22257, Lr: 0.000050 2020-02-13 01:00:34,372 Example #0 2020-02-13 01:00:34,372 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 01:00:34,372 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'vesen', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 01:00:34,372 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 01:00:34,372 Reference: 10 : ​ 6 - 9 . 2020-02-13 01:00:34,372 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu vesen la her . — Marku 10 : 6 - 9 . 2020-02-13 01:00:34,372 Example #1 2020-02-13 01:00:34,372 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 01:00:34,372 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'zan', 'zan', 'hegen', 'je', 'kpaa', '!', '—', 'Rom', '.'] 2020-02-13 01:00:34,372 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 01:00:34,373 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 01:00:34,373 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man zan zan hegen je kpaa ! — Rom . 2020-02-13 01:00:34,373 Example #2 2020-02-13 01:00:34,373 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 01:00:34,373 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 01:00:34,373 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 01:00:34,373 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 01:00:34,373 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 01:00:34,373 Example #3 2020-02-13 01:00:34,373 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 01:00:34,373 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-13 01:00:34,373 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 01:00:34,373 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 01:00:34,373 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-13 01:00:34,373 Validation result (greedy) at epoch 112, step 274000: bleu: 29.77, loss: 39146.0352, ppl: 3.7521, duration: 18.7743s 2020-02-13 01:00:44,257 Epoch 112 Step: 274100 Batch Loss: 1.406155 Tokens per Sec: 22465, Lr: 0.000050 2020-02-13 01:00:54,236 Epoch 112 Step: 274200 Batch Loss: 1.227169 Tokens per Sec: 21781, Lr: 0.000050 2020-02-13 01:01:04,182 Epoch 112 Step: 274300 Batch Loss: 1.156142 Tokens per Sec: 22576, Lr: 0.000050 2020-02-13 01:01:14,117 Epoch 112 Step: 274400 Batch Loss: 1.244033 Tokens per Sec: 21853, Lr: 0.000050 2020-02-13 01:01:24,031 Epoch 112 Step: 274500 Batch Loss: 1.212819 Tokens per Sec: 21878, Lr: 0.000050 2020-02-13 01:01:34,135 Epoch 112 Step: 274600 Batch Loss: 1.335339 Tokens per Sec: 21730, Lr: 0.000050 2020-02-13 01:01:44,212 Epoch 112 Step: 274700 Batch Loss: 1.261451 Tokens per Sec: 21867, Lr: 0.000050 2020-02-13 01:01:54,333 Epoch 112 Step: 274800 Batch Loss: 1.058561 Tokens per Sec: 21816, Lr: 0.000050 2020-02-13 01:02:04,482 Epoch 112 Step: 274900 Batch Loss: 1.164878 Tokens per Sec: 21882, Lr: 0.000050 2020-02-13 01:02:14,516 Epoch 112 Step: 275000 Batch Loss: 1.145782 Tokens per Sec: 21247, Lr: 0.000050 2020-02-13 01:02:33,643 Example #0 2020-02-13 01:02:33,643 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 01:02:33,643 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'vesen', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 01:02:33,643 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 01:02:33,644 Reference: 10 : ​ 6 - 9 . 2020-02-13 01:02:33,644 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu hen atô ve la , shi vea za hemen u lun a dooshima u a lu vesen la her . — Marku 10 : 6 - 9 . 2020-02-13 01:02:33,644 Example #1 2020-02-13 01:02:33,644 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 01:02:33,644 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 01:02:33,644 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 01:02:33,644 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 01:02:33,644 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 01:02:33,644 Example #2 2020-02-13 01:02:33,644 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 01:02:33,644 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 01:02:33,644 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 01:02:33,644 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 01:02:33,644 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 01:02:33,644 Example #3 2020-02-13 01:02:33,645 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 01:02:33,645 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-13 01:02:33,645 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 01:02:33,645 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 01:02:33,645 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-13 01:02:33,645 Validation result (greedy) at epoch 112, step 275000: bleu: 29.93, loss: 39160.2969, ppl: 3.7539, duration: 19.1284s 2020-02-13 01:02:43,607 Epoch 112 Step: 275100 Batch Loss: 1.260339 Tokens per Sec: 22048, Lr: 0.000050 2020-02-13 01:02:53,535 Epoch 112 Step: 275200 Batch Loss: 1.425954 Tokens per Sec: 22268, Lr: 0.000050 2020-02-13 01:03:03,481 Epoch 112 Step: 275300 Batch Loss: 1.379721 Tokens per Sec: 21645, Lr: 0.000050 2020-02-13 01:03:11,816 Epoch 112: total training loss 3077.98 2020-02-13 01:03:11,816 EPOCH 113 2020-02-13 01:03:13,758 Epoch 113 Step: 275400 Batch Loss: 1.303066 Tokens per Sec: 17133, Lr: 0.000050 2020-02-13 01:03:23,892 Epoch 113 Step: 275500 Batch Loss: 1.344263 Tokens per Sec: 22674, Lr: 0.000050 2020-02-13 01:03:33,920 Epoch 113 Step: 275600 Batch Loss: 1.076894 Tokens per Sec: 22139, Lr: 0.000050 2020-02-13 01:03:44,011 Epoch 113 Step: 275700 Batch Loss: 1.168981 Tokens per Sec: 22081, Lr: 0.000050 2020-02-13 01:03:54,014 Epoch 113 Step: 275800 Batch Loss: 1.261064 Tokens per Sec: 21867, Lr: 0.000050 2020-02-13 01:04:03,956 Epoch 113 Step: 275900 Batch Loss: 1.117207 Tokens per Sec: 22186, Lr: 0.000050 2020-02-13 01:04:14,006 Epoch 113 Step: 276000 Batch Loss: 1.452344 Tokens per Sec: 21445, Lr: 0.000050 2020-02-13 01:04:32,920 Hooray! New best validation result [ppl]! 2020-02-13 01:04:32,920 Saving new checkpoint. 2020-02-13 01:04:33,107 Example #0 2020-02-13 01:04:33,107 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 01:04:33,107 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 01:04:33,107 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 01:04:33,107 Reference: 10 : ​ 6 - 9 . 2020-02-13 01:04:33,107 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu hen atô ve la , shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 01:04:33,107 Example #1 2020-02-13 01:04:33,107 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 01:04:33,107 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 01:04:33,107 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 01:04:33,107 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 01:04:33,107 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 01:04:33,108 Example #2 2020-02-13 01:04:33,108 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 01:04:33,108 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 01:04:33,108 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 01:04:33,108 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 01:04:33,108 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 01:04:33,108 Example #3 2020-02-13 01:04:33,108 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 01:04:33,108 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-13 01:04:33,108 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 01:04:33,108 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 01:04:33,108 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-13 01:04:33,108 Validation result (greedy) at epoch 113, step 276000: bleu: 29.70, loss: 39120.8359, ppl: 3.7489, duration: 19.1019s 2020-02-13 01:04:42,984 Epoch 113 Step: 276100 Batch Loss: 1.356757 Tokens per Sec: 22571, Lr: 0.000050 2020-02-13 01:04:52,941 Epoch 113 Step: 276200 Batch Loss: 1.178919 Tokens per Sec: 22361, Lr: 0.000050 2020-02-13 01:05:02,892 Epoch 113 Step: 276300 Batch Loss: 1.339090 Tokens per Sec: 22322, Lr: 0.000050 2020-02-13 01:05:12,988 Epoch 113 Step: 276400 Batch Loss: 1.255141 Tokens per Sec: 21406, Lr: 0.000050 2020-02-13 01:05:23,104 Epoch 113 Step: 276500 Batch Loss: 1.160551 Tokens per Sec: 21814, Lr: 0.000050 2020-02-13 01:05:33,285 Epoch 113 Step: 276600 Batch Loss: 1.236313 Tokens per Sec: 21635, Lr: 0.000050 2020-02-13 01:05:43,414 Epoch 113 Step: 276700 Batch Loss: 1.115592 Tokens per Sec: 22001, Lr: 0.000050 2020-02-13 01:05:53,493 Epoch 113 Step: 276800 Batch Loss: 1.027799 Tokens per Sec: 21989, Lr: 0.000050 2020-02-13 01:06:03,532 Epoch 113 Step: 276900 Batch Loss: 1.068062 Tokens per Sec: 22345, Lr: 0.000050 2020-02-13 01:06:13,443 Epoch 113 Step: 277000 Batch Loss: 1.321952 Tokens per Sec: 23103, Lr: 0.000050 2020-02-13 01:06:32,229 Example #0 2020-02-13 01:06:32,229 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 01:06:32,229 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'vesen', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 01:06:32,229 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 01:06:32,229 Reference: 10 : ​ 6 - 9 . 2020-02-13 01:06:32,230 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu hen atô ve la her shi vea za hemen u lun a dooshima u a lu vesen la her . — Marku 10 : 6 - 9 . 2020-02-13 01:06:32,230 Example #1 2020-02-13 01:06:32,230 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 01:06:32,230 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 01:06:32,230 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 01:06:32,230 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 01:06:32,230 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung , man kwagh ne mgbôghom ! — Rom . 2020-02-13 01:06:32,230 Example #2 2020-02-13 01:06:32,230 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 01:06:32,230 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 01:06:32,230 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 01:06:32,230 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 01:06:32,230 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 01:06:32,231 Example #3 2020-02-13 01:06:32,231 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 01:06:32,231 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-13 01:06:32,231 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 01:06:32,231 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 01:06:32,231 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-13 01:06:32,231 Validation result (greedy) at epoch 113, step 277000: bleu: 29.71, loss: 39159.1992, ppl: 3.7538, duration: 18.7875s 2020-02-13 01:06:42,171 Epoch 113 Step: 277100 Batch Loss: 1.294479 Tokens per Sec: 22339, Lr: 0.000050 2020-02-13 01:06:52,129 Epoch 113 Step: 277200 Batch Loss: 1.101472 Tokens per Sec: 22065, Lr: 0.000050 2020-02-13 01:07:02,029 Epoch 113 Step: 277300 Batch Loss: 1.230680 Tokens per Sec: 22403, Lr: 0.000050 2020-02-13 01:07:11,905 Epoch 113 Step: 277400 Batch Loss: 1.585091 Tokens per Sec: 22250, Lr: 0.000050 2020-02-13 01:07:21,925 Epoch 113 Step: 277500 Batch Loss: 1.354469 Tokens per Sec: 21809, Lr: 0.000050 2020-02-13 01:07:32,004 Epoch 113 Step: 277600 Batch Loss: 1.320046 Tokens per Sec: 22178, Lr: 0.000050 2020-02-13 01:07:42,070 Epoch 113 Step: 277700 Batch Loss: 1.241592 Tokens per Sec: 21326, Lr: 0.000050 2020-02-13 01:07:52,243 Epoch 113 Step: 277800 Batch Loss: 1.036798 Tokens per Sec: 22142, Lr: 0.000050 2020-02-13 01:07:56,167 Epoch 113: total training loss 3064.37 2020-02-13 01:07:56,167 EPOCH 114 2020-02-13 01:08:02,602 Epoch 114 Step: 277900 Batch Loss: 1.433509 Tokens per Sec: 20708, Lr: 0.000050 2020-02-13 01:08:12,676 Epoch 114 Step: 278000 Batch Loss: 1.294026 Tokens per Sec: 22604, Lr: 0.000050 2020-02-13 01:08:32,713 Hooray! New best validation result [ppl]! 2020-02-13 01:08:32,714 Saving new checkpoint. 2020-02-13 01:08:32,915 Example #0 2020-02-13 01:08:32,915 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 01:08:32,915 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'vesen', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 01:08:32,915 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 01:08:32,916 Reference: 10 : ​ 6 - 9 . 2020-02-13 01:08:32,916 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu hen atô ve la her shi vea za hemen u lun a dooshima u a lu vesen la her . — Marku 10 : 6 - 9 . 2020-02-13 01:08:32,916 Example #1 2020-02-13 01:08:32,916 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 01:08:32,916 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 01:08:32,916 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 01:08:32,916 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 01:08:32,916 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 01:08:32,916 Example #2 2020-02-13 01:08:32,916 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 01:08:32,916 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 01:08:32,916 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 01:08:32,916 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 01:08:32,916 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 01:08:32,917 Example #3 2020-02-13 01:08:32,917 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 01:08:32,917 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-13 01:08:32,917 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 01:08:32,917 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 01:08:32,917 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-13 01:08:32,917 Validation result (greedy) at epoch 114, step 278000: bleu: 29.86, loss: 39114.3008, ppl: 3.7481, duration: 20.2409s 2020-02-13 01:08:42,999 Epoch 114 Step: 278100 Batch Loss: 1.458118 Tokens per Sec: 22302, Lr: 0.000050 2020-02-13 01:08:53,110 Epoch 114 Step: 278200 Batch Loss: 1.383111 Tokens per Sec: 22203, Lr: 0.000050 2020-02-13 01:09:03,206 Epoch 114 Step: 278300 Batch Loss: 1.271594 Tokens per Sec: 21514, Lr: 0.000050 2020-02-13 01:09:13,264 Epoch 114 Step: 278400 Batch Loss: 1.263114 Tokens per Sec: 21539, Lr: 0.000050 2020-02-13 01:09:23,377 Epoch 114 Step: 278500 Batch Loss: 1.358837 Tokens per Sec: 22217, Lr: 0.000050 2020-02-13 01:09:33,413 Epoch 114 Step: 278600 Batch Loss: 1.321559 Tokens per Sec: 21486, Lr: 0.000050 2020-02-13 01:09:43,476 Epoch 114 Step: 278700 Batch Loss: 1.011265 Tokens per Sec: 21443, Lr: 0.000050 2020-02-13 01:09:53,591 Epoch 114 Step: 278800 Batch Loss: 1.232873 Tokens per Sec: 21474, Lr: 0.000050 2020-02-13 01:10:03,668 Epoch 114 Step: 278900 Batch Loss: 1.127200 Tokens per Sec: 21646, Lr: 0.000050 2020-02-13 01:10:13,668 Epoch 114 Step: 279000 Batch Loss: 1.355100 Tokens per Sec: 22542, Lr: 0.000050 2020-02-13 01:10:32,620 Example #0 2020-02-13 01:10:32,620 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 01:10:32,620 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'vesen', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 01:10:32,620 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 01:10:32,620 Reference: 10 : ​ 6 - 9 . 2020-02-13 01:10:32,620 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu hen atô ve la her shi vea za hemen u lun a dooshima u a lu vesen la her . — Marku 10 : 6 - 9 . 2020-02-13 01:10:32,620 Example #1 2020-02-13 01:10:32,620 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 01:10:32,621 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 01:10:32,621 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 01:10:32,621 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 01:10:32,621 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 01:10:32,621 Example #2 2020-02-13 01:10:32,621 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 01:10:32,621 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 01:10:32,621 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 01:10:32,621 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 01:10:32,621 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 01:10:32,621 Example #3 2020-02-13 01:10:32,621 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 01:10:32,621 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-13 01:10:32,621 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 01:10:32,621 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 01:10:32,621 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-13 01:10:32,622 Validation result (greedy) at epoch 114, step 279000: bleu: 29.64, loss: 39131.0625, ppl: 3.7502, duration: 18.9529s 2020-02-13 01:10:42,468 Epoch 114 Step: 279100 Batch Loss: 1.164719 Tokens per Sec: 22283, Lr: 0.000050 2020-02-13 01:10:52,392 Epoch 114 Step: 279200 Batch Loss: 0.978154 Tokens per Sec: 21745, Lr: 0.000050 2020-02-13 01:11:02,275 Epoch 114 Step: 279300 Batch Loss: 1.273271 Tokens per Sec: 22766, Lr: 0.000050 2020-02-13 01:11:12,156 Epoch 114 Step: 279400 Batch Loss: 1.334352 Tokens per Sec: 22562, Lr: 0.000050 2020-02-13 01:11:22,083 Epoch 114 Step: 279500 Batch Loss: 0.998257 Tokens per Sec: 22404, Lr: 0.000050 2020-02-13 01:11:31,972 Epoch 114 Step: 279600 Batch Loss: 1.328596 Tokens per Sec: 22047, Lr: 0.000050 2020-02-13 01:11:41,889 Epoch 114 Step: 279700 Batch Loss: 1.456774 Tokens per Sec: 22121, Lr: 0.000050 2020-02-13 01:11:51,843 Epoch 114 Step: 279800 Batch Loss: 1.047552 Tokens per Sec: 22054, Lr: 0.000050 2020-02-13 01:12:01,833 Epoch 114 Step: 279900 Batch Loss: 1.342141 Tokens per Sec: 21840, Lr: 0.000050 2020-02-13 01:12:11,922 Epoch 114 Step: 280000 Batch Loss: 0.950339 Tokens per Sec: 21714, Lr: 0.000050 2020-02-13 01:12:31,878 Hooray! New best validation result [ppl]! 2020-02-13 01:12:31,878 Saving new checkpoint. 2020-02-13 01:12:32,069 Example #0 2020-02-13 01:12:32,070 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 01:12:32,070 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'vesen', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 01:12:32,070 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 01:12:32,070 Reference: 10 : ​ 6 - 9 . 2020-02-13 01:12:32,070 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu vesen la her . — Marku 10 : 6 - 9 . 2020-02-13 01:12:32,070 Example #1 2020-02-13 01:12:32,070 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 01:12:32,070 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 01:12:32,070 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 01:12:32,070 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 01:12:32,070 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 01:12:32,070 Example #2 2020-02-13 01:12:32,070 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 01:12:32,070 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 01:12:32,071 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 01:12:32,071 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 01:12:32,071 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 01:12:32,071 Example #3 2020-02-13 01:12:32,071 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 01:12:32,071 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-13 01:12:32,071 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 01:12:32,071 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 01:12:32,071 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-13 01:12:32,071 Validation result (greedy) at epoch 114, step 280000: bleu: 29.76, loss: 39113.3086, ppl: 3.7480, duration: 20.1483s 2020-02-13 01:12:42,186 Epoch 114 Step: 280100 Batch Loss: 1.258851 Tokens per Sec: 22285, Lr: 0.000050 2020-02-13 01:12:52,173 Epoch 114 Step: 280200 Batch Loss: 1.270872 Tokens per Sec: 21969, Lr: 0.000050 2020-02-13 01:13:02,031 Epoch 114 Step: 280300 Batch Loss: 1.131677 Tokens per Sec: 22964, Lr: 0.000050 2020-02-13 01:13:02,137 Epoch 114: total training loss 3069.73 2020-02-13 01:13:02,137 EPOCH 115 2020-02-13 01:13:12,203 Epoch 115 Step: 280400 Batch Loss: 1.373764 Tokens per Sec: 21720, Lr: 0.000050 2020-02-13 01:13:22,087 Epoch 115 Step: 280500 Batch Loss: 1.248913 Tokens per Sec: 22361, Lr: 0.000050 2020-02-13 01:13:32,023 Epoch 115 Step: 280600 Batch Loss: 1.145051 Tokens per Sec: 22284, Lr: 0.000050 2020-02-13 01:13:42,034 Epoch 115 Step: 280700 Batch Loss: 1.338518 Tokens per Sec: 21854, Lr: 0.000050 2020-02-13 01:13:51,996 Epoch 115 Step: 280800 Batch Loss: 1.096688 Tokens per Sec: 22563, Lr: 0.000050 2020-02-13 01:14:01,945 Epoch 115 Step: 280900 Batch Loss: 1.285862 Tokens per Sec: 22466, Lr: 0.000050 2020-02-13 01:14:11,877 Epoch 115 Step: 281000 Batch Loss: 1.380284 Tokens per Sec: 22061, Lr: 0.000050 2020-02-13 01:14:30,972 Example #0 2020-02-13 01:14:30,973 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 01:14:30,973 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'vesen', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 01:14:30,973 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 01:14:30,973 Reference: 10 : ​ 6 - 9 . 2020-02-13 01:14:30,973 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu vesen la her . — Marku 10 : 6 - 9 . 2020-02-13 01:14:30,973 Example #1 2020-02-13 01:14:30,973 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 01:14:30,973 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 01:14:30,973 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 01:14:30,973 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 01:14:30,973 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 01:14:30,973 Example #2 2020-02-13 01:14:30,973 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 01:14:30,973 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 01:14:30,974 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 01:14:30,974 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 01:14:30,974 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 01:14:30,974 Example #3 2020-02-13 01:14:30,974 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 01:14:30,974 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-13 01:14:30,974 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 01:14:30,974 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 01:14:30,974 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-13 01:14:30,974 Validation result (greedy) at epoch 115, step 281000: bleu: 29.78, loss: 39156.2422, ppl: 3.7534, duration: 19.0968s 2020-02-13 01:14:41,032 Epoch 115 Step: 281100 Batch Loss: 1.280852 Tokens per Sec: 22143, Lr: 0.000050 2020-02-13 01:14:51,046 Epoch 115 Step: 281200 Batch Loss: 1.305778 Tokens per Sec: 22232, Lr: 0.000050 2020-02-13 01:15:01,181 Epoch 115 Step: 281300 Batch Loss: 1.027848 Tokens per Sec: 22215, Lr: 0.000050 2020-02-13 01:15:11,302 Epoch 115 Step: 281400 Batch Loss: 1.122173 Tokens per Sec: 21636, Lr: 0.000050 2020-02-13 01:15:21,435 Epoch 115 Step: 281500 Batch Loss: 1.354213 Tokens per Sec: 21753, Lr: 0.000050 2020-02-13 01:15:31,468 Epoch 115 Step: 281600 Batch Loss: 1.348399 Tokens per Sec: 21573, Lr: 0.000050 2020-02-13 01:15:41,434 Epoch 115 Step: 281700 Batch Loss: 0.993015 Tokens per Sec: 22760, Lr: 0.000050 2020-02-13 01:15:51,381 Epoch 115 Step: 281800 Batch Loss: 1.194731 Tokens per Sec: 21914, Lr: 0.000050 2020-02-13 01:16:01,397 Epoch 115 Step: 281900 Batch Loss: 1.085989 Tokens per Sec: 21779, Lr: 0.000050 2020-02-13 01:16:11,536 Epoch 115 Step: 282000 Batch Loss: 1.132449 Tokens per Sec: 21618, Lr: 0.000050 2020-02-13 01:16:31,298 Example #0 2020-02-13 01:16:31,298 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 01:16:31,298 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 01:16:31,298 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 01:16:31,298 Reference: 10 : ​ 6 - 9 . 2020-02-13 01:16:31,298 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 01:16:31,298 Example #1 2020-02-13 01:16:31,298 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 01:16:31,298 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 01:16:31,298 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 01:16:31,298 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 01:16:31,299 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 01:16:31,299 Example #2 2020-02-13 01:16:31,299 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 01:16:31,299 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 01:16:31,299 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 01:16:31,299 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 01:16:31,299 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 01:16:31,299 Example #3 2020-02-13 01:16:31,299 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 01:16:31,299 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-13 01:16:31,299 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 01:16:31,299 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 01:16:31,299 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-13 01:16:31,299 Validation result (greedy) at epoch 115, step 282000: bleu: 29.78, loss: 39150.7305, ppl: 3.7527, duration: 19.7632s 2020-02-13 01:16:41,553 Epoch 115 Step: 282100 Batch Loss: 1.265343 Tokens per Sec: 21935, Lr: 0.000050 2020-02-13 01:16:51,750 Epoch 115 Step: 282200 Batch Loss: 1.146186 Tokens per Sec: 21764, Lr: 0.000050 2020-02-13 01:17:01,859 Epoch 115 Step: 282300 Batch Loss: 1.404612 Tokens per Sec: 22174, Lr: 0.000050 2020-02-13 01:17:11,798 Epoch 115 Step: 282400 Batch Loss: 1.263981 Tokens per Sec: 21851, Lr: 0.000050 2020-02-13 01:17:21,701 Epoch 115 Step: 282500 Batch Loss: 1.130717 Tokens per Sec: 22270, Lr: 0.000050 2020-02-13 01:17:31,594 Epoch 115 Step: 282600 Batch Loss: 1.136044 Tokens per Sec: 22007, Lr: 0.000050 2020-02-13 01:17:41,669 Epoch 115 Step: 282700 Batch Loss: 1.281173 Tokens per Sec: 21882, Lr: 0.000050 2020-02-13 01:17:47,680 Epoch 115: total training loss 3059.26 2020-02-13 01:17:47,680 EPOCH 116 2020-02-13 01:17:52,083 Epoch 116 Step: 282800 Batch Loss: 1.299658 Tokens per Sec: 19561, Lr: 0.000050 2020-02-13 01:18:02,137 Epoch 116 Step: 282900 Batch Loss: 1.145177 Tokens per Sec: 22069, Lr: 0.000050 2020-02-13 01:18:12,144 Epoch 116 Step: 283000 Batch Loss: 1.215855 Tokens per Sec: 22799, Lr: 0.000050 2020-02-13 01:18:31,245 Example #0 2020-02-13 01:18:31,245 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 01:18:31,245 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'vesen', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 01:18:31,245 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 01:18:31,245 Reference: 10 : ​ 6 - 9 . 2020-02-13 01:18:31,246 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu vesen la her . — Marku 10 : 6 - 9 . 2020-02-13 01:18:31,246 Example #1 2020-02-13 01:18:31,246 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 01:18:31,246 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 01:18:31,246 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 01:18:31,246 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 01:18:31,246 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 01:18:31,246 Example #2 2020-02-13 01:18:31,246 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 01:18:31,246 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 01:18:31,246 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 01:18:31,246 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 01:18:31,246 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 01:18:31,246 Example #3 2020-02-13 01:18:31,246 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 01:18:31,247 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-13 01:18:31,247 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 01:18:31,247 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 01:18:31,247 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-13 01:18:31,247 Validation result (greedy) at epoch 116, step 283000: bleu: 29.98, loss: 39148.1172, ppl: 3.7524, duration: 19.1026s 2020-02-13 01:18:41,256 Epoch 116 Step: 283100 Batch Loss: 1.361920 Tokens per Sec: 22018, Lr: 0.000050 2020-02-13 01:18:51,381 Epoch 116 Step: 283200 Batch Loss: 1.324743 Tokens per Sec: 21867, Lr: 0.000050 2020-02-13 01:19:01,390 Epoch 116 Step: 283300 Batch Loss: 1.271912 Tokens per Sec: 22129, Lr: 0.000050 2020-02-13 01:19:11,341 Epoch 116 Step: 283400 Batch Loss: 1.202076 Tokens per Sec: 21664, Lr: 0.000050 2020-02-13 01:19:21,297 Epoch 116 Step: 283500 Batch Loss: 0.979761 Tokens per Sec: 22589, Lr: 0.000050 2020-02-13 01:19:31,195 Epoch 116 Step: 283600 Batch Loss: 1.312353 Tokens per Sec: 22228, Lr: 0.000050 2020-02-13 01:19:41,263 Epoch 116 Step: 283700 Batch Loss: 1.260386 Tokens per Sec: 22094, Lr: 0.000050 2020-02-13 01:19:51,511 Epoch 116 Step: 283800 Batch Loss: 1.335513 Tokens per Sec: 21685, Lr: 0.000050 2020-02-13 01:20:01,724 Epoch 116 Step: 283900 Batch Loss: 1.230274 Tokens per Sec: 21072, Lr: 0.000050 2020-02-13 01:20:11,721 Epoch 116 Step: 284000 Batch Loss: 1.377525 Tokens per Sec: 22253, Lr: 0.000050 2020-02-13 01:20:30,697 Hooray! New best validation result [ppl]! 2020-02-13 01:20:30,697 Saving new checkpoint. 2020-02-13 01:20:30,892 Example #0 2020-02-13 01:20:30,892 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 01:20:30,892 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 01:20:30,892 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 01:20:30,892 Reference: 10 : ​ 6 - 9 . 2020-02-13 01:20:30,892 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea za hemen u lun a dooshima u a lu a mi la shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 01:20:30,892 Example #1 2020-02-13 01:20:30,893 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 01:20:30,893 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 01:20:30,893 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 01:20:30,893 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 01:20:30,893 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 01:20:30,893 Example #2 2020-02-13 01:20:30,893 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 01:20:30,893 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 01:20:30,893 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 01:20:30,893 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 01:20:30,893 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 01:20:30,893 Example #3 2020-02-13 01:20:30,893 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 01:20:30,893 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-13 01:20:30,894 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 01:20:30,894 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 01:20:30,894 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-13 01:20:30,894 Validation result (greedy) at epoch 116, step 284000: bleu: 29.99, loss: 39110.6211, ppl: 3.7476, duration: 19.1725s 2020-02-13 01:20:40,896 Epoch 116 Step: 284100 Batch Loss: 1.159766 Tokens per Sec: 22369, Lr: 0.000050 2020-02-13 01:20:50,985 Epoch 116 Step: 284200 Batch Loss: 1.088212 Tokens per Sec: 21553, Lr: 0.000050 2020-02-13 01:21:00,934 Epoch 116 Step: 284300 Batch Loss: 1.330864 Tokens per Sec: 21833, Lr: 0.000050 2020-02-13 01:21:11,007 Epoch 116 Step: 284400 Batch Loss: 1.355842 Tokens per Sec: 22209, Lr: 0.000050 2020-02-13 01:21:21,197 Epoch 116 Step: 284500 Batch Loss: 0.962129 Tokens per Sec: 21691, Lr: 0.000050 2020-02-13 01:21:31,256 Epoch 116 Step: 284600 Batch Loss: 1.425981 Tokens per Sec: 22125, Lr: 0.000050 2020-02-13 01:21:41,092 Epoch 116 Step: 284700 Batch Loss: 1.208878 Tokens per Sec: 22120, Lr: 0.000050 2020-02-13 01:21:51,002 Epoch 116 Step: 284800 Batch Loss: 1.213652 Tokens per Sec: 22292, Lr: 0.000050 2020-02-13 01:22:00,840 Epoch 116 Step: 284900 Batch Loss: 1.314245 Tokens per Sec: 22118, Lr: 0.000050 2020-02-13 01:22:10,702 Epoch 116 Step: 285000 Batch Loss: 1.299889 Tokens per Sec: 22249, Lr: 0.000050 2020-02-13 01:22:29,466 Hooray! New best validation result [ppl]! 2020-02-13 01:22:29,467 Saving new checkpoint. 2020-02-13 01:22:29,659 Example #0 2020-02-13 01:22:29,659 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 01:22:29,659 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'vesen', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 01:22:29,659 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 01:22:29,659 Reference: 10 : ​ 6 - 9 . 2020-02-13 01:22:29,660 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu vesen la her . — Marku 10 : 6 - 9 . 2020-02-13 01:22:29,660 Example #1 2020-02-13 01:22:29,660 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 01:22:29,660 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 01:22:29,660 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 01:22:29,660 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 01:22:29,660 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 01:22:29,660 Example #2 2020-02-13 01:22:29,660 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 01:22:29,660 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 01:22:29,660 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 01:22:29,660 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 01:22:29,660 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 01:22:29,660 Example #3 2020-02-13 01:22:29,660 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 01:22:29,661 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-13 01:22:29,661 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 01:22:29,661 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 01:22:29,661 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-13 01:22:29,661 Validation result (greedy) at epoch 116, step 285000: bleu: 29.81, loss: 39104.1602, ppl: 3.7468, duration: 18.9584s 2020-02-13 01:22:39,509 Epoch 116 Step: 285100 Batch Loss: 1.234269 Tokens per Sec: 22494, Lr: 0.000050 2020-02-13 01:22:49,405 Epoch 116 Step: 285200 Batch Loss: 1.357598 Tokens per Sec: 22311, Lr: 0.000050 2020-02-13 01:22:51,666 Epoch 116: total training loss 3067.24 2020-02-13 01:22:51,666 EPOCH 117 2020-02-13 01:22:59,608 Epoch 117 Step: 285300 Batch Loss: 1.338422 Tokens per Sec: 21708, Lr: 0.000050 2020-02-13 01:23:09,675 Epoch 117 Step: 285400 Batch Loss: 0.800065 Tokens per Sec: 21957, Lr: 0.000050 2020-02-13 01:23:19,744 Epoch 117 Step: 285500 Batch Loss: 1.275990 Tokens per Sec: 21768, Lr: 0.000050 2020-02-13 01:23:29,551 Epoch 117 Step: 285600 Batch Loss: 1.276745 Tokens per Sec: 21748, Lr: 0.000050 2020-02-13 01:23:39,482 Epoch 117 Step: 285700 Batch Loss: 1.346274 Tokens per Sec: 22671, Lr: 0.000050 2020-02-13 01:23:49,471 Epoch 117 Step: 285800 Batch Loss: 1.548813 Tokens per Sec: 22731, Lr: 0.000050 2020-02-13 01:23:59,410 Epoch 117 Step: 285900 Batch Loss: 1.324448 Tokens per Sec: 21936, Lr: 0.000050 2020-02-13 01:24:09,372 Epoch 117 Step: 286000 Batch Loss: 1.266462 Tokens per Sec: 22398, Lr: 0.000050 2020-02-13 01:24:28,630 Example #0 2020-02-13 01:24:28,630 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 01:24:28,630 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 01:24:28,630 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 01:24:28,631 Reference: 10 : ​ 6 - 9 . 2020-02-13 01:24:28,631 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu hen atô ve la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 01:24:28,631 Example #1 2020-02-13 01:24:28,631 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 01:24:28,631 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 01:24:28,631 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 01:24:28,631 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 01:24:28,631 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 01:24:28,631 Example #2 2020-02-13 01:24:28,631 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 01:24:28,631 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 01:24:28,631 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 01:24:28,632 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 01:24:28,632 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 01:24:28,632 Example #3 2020-02-13 01:24:28,632 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 01:24:28,632 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-13 01:24:28,632 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 01:24:28,632 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 01:24:28,632 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-13 01:24:28,632 Validation result (greedy) at epoch 117, step 286000: bleu: 29.82, loss: 39129.6562, ppl: 3.7501, duration: 19.2594s 2020-02-13 01:24:38,518 Epoch 117 Step: 286100 Batch Loss: 1.072018 Tokens per Sec: 21790, Lr: 0.000050 2020-02-13 01:24:48,474 Epoch 117 Step: 286200 Batch Loss: 1.487099 Tokens per Sec: 21756, Lr: 0.000050 2020-02-13 01:24:58,414 Epoch 117 Step: 286300 Batch Loss: 1.084898 Tokens per Sec: 21876, Lr: 0.000050 2020-02-13 01:25:08,441 Epoch 117 Step: 286400 Batch Loss: 1.347120 Tokens per Sec: 22295, Lr: 0.000050 2020-02-13 01:25:18,345 Epoch 117 Step: 286500 Batch Loss: 1.394524 Tokens per Sec: 22274, Lr: 0.000050 2020-02-13 01:25:28,312 Epoch 117 Step: 286600 Batch Loss: 1.427318 Tokens per Sec: 21405, Lr: 0.000050 2020-02-13 01:25:38,279 Epoch 117 Step: 286700 Batch Loss: 1.018947 Tokens per Sec: 22293, Lr: 0.000050 2020-02-13 01:25:48,267 Epoch 117 Step: 286800 Batch Loss: 1.310530 Tokens per Sec: 22330, Lr: 0.000050 2020-02-13 01:25:58,348 Epoch 117 Step: 286900 Batch Loss: 1.137686 Tokens per Sec: 22147, Lr: 0.000050 2020-02-13 01:26:08,456 Epoch 117 Step: 287000 Batch Loss: 1.116836 Tokens per Sec: 21860, Lr: 0.000050 2020-02-13 01:26:28,053 Hooray! New best validation result [ppl]! 2020-02-13 01:26:28,053 Saving new checkpoint. 2020-02-13 01:26:28,245 Example #0 2020-02-13 01:26:28,245 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 01:26:28,245 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'kura', 'dooshima', 've', 'la', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 01:26:28,245 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 01:26:28,246 Reference: 10 : ​ 6 - 9 . 2020-02-13 01:26:28,246 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea kura dooshima ve la shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 01:26:28,246 Example #1 2020-02-13 01:26:28,246 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 01:26:28,246 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 01:26:28,246 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 01:26:28,246 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 01:26:28,246 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 01:26:28,246 Example #2 2020-02-13 01:26:28,246 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 01:26:28,246 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 01:26:28,246 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 01:26:28,246 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 01:26:28,246 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 01:26:28,246 Example #3 2020-02-13 01:26:28,247 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 01:26:28,247 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-13 01:26:28,247 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 01:26:28,247 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 01:26:28,247 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-13 01:26:28,247 Validation result (greedy) at epoch 117, step 287000: bleu: 29.99, loss: 39094.4023, ppl: 3.7456, duration: 19.7902s 2020-02-13 01:26:38,356 Epoch 117 Step: 287100 Batch Loss: 1.329365 Tokens per Sec: 22312, Lr: 0.000050 2020-02-13 01:26:48,513 Epoch 117 Step: 287200 Batch Loss: 1.192995 Tokens per Sec: 21875, Lr: 0.000050 2020-02-13 01:26:58,597 Epoch 117 Step: 287300 Batch Loss: 1.233371 Tokens per Sec: 21856, Lr: 0.000050 2020-02-13 01:27:08,833 Epoch 117 Step: 287400 Batch Loss: 1.051859 Tokens per Sec: 21691, Lr: 0.000050 2020-02-13 01:27:19,024 Epoch 117 Step: 287500 Batch Loss: 1.242325 Tokens per Sec: 21600, Lr: 0.000050 2020-02-13 01:27:29,100 Epoch 117 Step: 287600 Batch Loss: 1.254313 Tokens per Sec: 21712, Lr: 0.000050 2020-02-13 01:27:37,675 Epoch 117: total training loss 3067.56 2020-02-13 01:27:37,676 EPOCH 118 2020-02-13 01:27:39,238 Epoch 118 Step: 287700 Batch Loss: 0.838474 Tokens per Sec: 18562, Lr: 0.000050 2020-02-13 01:27:49,159 Epoch 118 Step: 287800 Batch Loss: 1.275967 Tokens per Sec: 21699, Lr: 0.000050 2020-02-13 01:27:59,004 Epoch 118 Step: 287900 Batch Loss: 1.422452 Tokens per Sec: 21818, Lr: 0.000050 2020-02-13 01:28:09,033 Epoch 118 Step: 288000 Batch Loss: 1.160297 Tokens per Sec: 22056, Lr: 0.000050 2020-02-13 01:28:27,724 Example #0 2020-02-13 01:28:27,724 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 01:28:27,724 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 01:28:27,724 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 01:28:27,724 Reference: 10 : ​ 6 - 9 . 2020-02-13 01:28:27,724 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu hen atô ve la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 01:28:27,724 Example #1 2020-02-13 01:28:27,724 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 01:28:27,724 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 01:28:27,724 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 01:28:27,724 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 01:28:27,724 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 01:28:27,725 Example #2 2020-02-13 01:28:27,725 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 01:28:27,725 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 01:28:27,725 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 01:28:27,725 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 01:28:27,725 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 01:28:27,725 Example #3 2020-02-13 01:28:27,725 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 01:28:27,725 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-13 01:28:27,725 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 01:28:27,725 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 01:28:27,725 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-13 01:28:27,725 Validation result (greedy) at epoch 118, step 288000: bleu: 29.75, loss: 39131.4062, ppl: 3.7503, duration: 18.6912s 2020-02-13 01:28:37,694 Epoch 118 Step: 288100 Batch Loss: 1.348476 Tokens per Sec: 22469, Lr: 0.000050 2020-02-13 01:28:47,737 Epoch 118 Step: 288200 Batch Loss: 1.330711 Tokens per Sec: 21886, Lr: 0.000050 2020-02-13 01:28:57,756 Epoch 118 Step: 288300 Batch Loss: 1.357764 Tokens per Sec: 21967, Lr: 0.000050 2020-02-13 01:29:07,783 Epoch 118 Step: 288400 Batch Loss: 1.053623 Tokens per Sec: 22422, Lr: 0.000050 2020-02-13 01:29:17,857 Epoch 118 Step: 288500 Batch Loss: 1.351263 Tokens per Sec: 22359, Lr: 0.000050 2020-02-13 01:29:27,936 Epoch 118 Step: 288600 Batch Loss: 1.403342 Tokens per Sec: 21765, Lr: 0.000050 2020-02-13 01:29:37,969 Epoch 118 Step: 288700 Batch Loss: 1.305338 Tokens per Sec: 22060, Lr: 0.000050 2020-02-13 01:29:48,012 Epoch 118 Step: 288800 Batch Loss: 1.026387 Tokens per Sec: 21904, Lr: 0.000050 2020-02-13 01:29:58,000 Epoch 118 Step: 288900 Batch Loss: 1.269853 Tokens per Sec: 21935, Lr: 0.000050 2020-02-13 01:30:07,972 Epoch 118 Step: 289000 Batch Loss: 1.381671 Tokens per Sec: 22794, Lr: 0.000050 2020-02-13 01:30:27,076 Example #0 2020-02-13 01:30:27,076 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 01:30:27,076 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'vesen', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 01:30:27,076 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 01:30:27,076 Reference: 10 : ​ 6 - 9 . 2020-02-13 01:30:27,076 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu vesen la her . — Marku 10 : 6 - 9 . 2020-02-13 01:30:27,077 Example #1 2020-02-13 01:30:27,077 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 01:30:27,077 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 01:30:27,077 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 01:30:27,077 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 01:30:27,077 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 01:30:27,077 Example #2 2020-02-13 01:30:27,077 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 01:30:27,077 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 01:30:27,077 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 01:30:27,077 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 01:30:27,077 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 01:30:27,077 Example #3 2020-02-13 01:30:27,077 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 01:30:27,077 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-13 01:30:27,077 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 01:30:27,078 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 01:30:27,078 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-13 01:30:27,078 Validation result (greedy) at epoch 118, step 289000: bleu: 29.75, loss: 39101.3750, ppl: 3.7465, duration: 19.1052s 2020-02-13 01:30:37,023 Epoch 118 Step: 289100 Batch Loss: 1.278684 Tokens per Sec: 22582, Lr: 0.000050 2020-02-13 01:30:46,987 Epoch 118 Step: 289200 Batch Loss: 1.229061 Tokens per Sec: 22306, Lr: 0.000050 2020-02-13 01:30:56,980 Epoch 118 Step: 289300 Batch Loss: 1.299142 Tokens per Sec: 21889, Lr: 0.000050 2020-02-13 01:31:07,029 Epoch 118 Step: 289400 Batch Loss: 1.106078 Tokens per Sec: 21579, Lr: 0.000050 2020-02-13 01:31:17,046 Epoch 118 Step: 289500 Batch Loss: 1.280638 Tokens per Sec: 21980, Lr: 0.000050 2020-02-13 01:31:26,910 Epoch 118 Step: 289600 Batch Loss: 1.332867 Tokens per Sec: 22333, Lr: 0.000050 2020-02-13 01:31:36,754 Epoch 118 Step: 289700 Batch Loss: 1.467029 Tokens per Sec: 22031, Lr: 0.000050 2020-02-13 01:31:46,606 Epoch 118 Step: 289800 Batch Loss: 1.082863 Tokens per Sec: 22512, Lr: 0.000050 2020-02-13 01:31:56,485 Epoch 118 Step: 289900 Batch Loss: 1.228364 Tokens per Sec: 22519, Lr: 0.000050 2020-02-13 01:32:06,400 Epoch 118 Step: 290000 Batch Loss: 0.965844 Tokens per Sec: 22071, Lr: 0.000050 2020-02-13 01:32:25,792 Example #0 2020-02-13 01:32:25,792 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 01:32:25,792 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'vesen', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 01:32:25,792 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 01:32:25,793 Reference: 10 : ​ 6 - 9 . 2020-02-13 01:32:25,793 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu hen atô ve la shi vea za hemen u lun a dooshima u a lu vesen la her . — Marku 10 : 6 - 9 . 2020-02-13 01:32:25,793 Example #1 2020-02-13 01:32:25,793 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 01:32:25,793 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 01:32:25,793 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 01:32:25,793 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 01:32:25,793 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 01:32:25,793 Example #2 2020-02-13 01:32:25,793 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 01:32:25,793 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 01:32:25,793 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 01:32:25,793 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 01:32:25,793 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 01:32:25,793 Example #3 2020-02-13 01:32:25,794 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 01:32:25,794 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-13 01:32:25,794 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 01:32:25,794 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 01:32:25,794 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-13 01:32:25,794 Validation result (greedy) at epoch 118, step 290000: bleu: 29.84, loss: 39148.5859, ppl: 3.7524, duration: 19.3932s 2020-02-13 01:32:35,655 Epoch 118 Step: 290100 Batch Loss: 1.277523 Tokens per Sec: 22756, Lr: 0.000050 2020-02-13 01:32:40,435 Epoch 118: total training loss 3061.70 2020-02-13 01:32:40,435 EPOCH 119 2020-02-13 01:32:45,910 Epoch 119 Step: 290200 Batch Loss: 1.216874 Tokens per Sec: 21298, Lr: 0.000050 2020-02-13 01:32:55,956 Epoch 119 Step: 290300 Batch Loss: 1.199007 Tokens per Sec: 21909, Lr: 0.000050 2020-02-13 01:33:05,997 Epoch 119 Step: 290400 Batch Loss: 1.106190 Tokens per Sec: 21852, Lr: 0.000050 2020-02-13 01:33:15,957 Epoch 119 Step: 290500 Batch Loss: 0.910358 Tokens per Sec: 21888, Lr: 0.000050 2020-02-13 01:33:26,050 Epoch 119 Step: 290600 Batch Loss: 1.337779 Tokens per Sec: 22490, Lr: 0.000050 2020-02-13 01:33:35,961 Epoch 119 Step: 290700 Batch Loss: 1.250397 Tokens per Sec: 22198, Lr: 0.000050 2020-02-13 01:33:45,933 Epoch 119 Step: 290800 Batch Loss: 1.214812 Tokens per Sec: 21857, Lr: 0.000050 2020-02-13 01:33:55,878 Epoch 119 Step: 290900 Batch Loss: 1.026430 Tokens per Sec: 21987, Lr: 0.000050 2020-02-13 01:34:05,797 Epoch 119 Step: 291000 Batch Loss: 1.212233 Tokens per Sec: 22120, Lr: 0.000050 2020-02-13 01:34:25,050 Example #0 2020-02-13 01:34:25,050 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 01:34:25,050 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'vesen', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 01:34:25,050 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 01:34:25,050 Reference: 10 : ​ 6 - 9 . 2020-02-13 01:34:25,050 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu vesen la her . — Marku 10 : 6 - 9 . 2020-02-13 01:34:25,050 Example #1 2020-02-13 01:34:25,050 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 01:34:25,051 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 01:34:25,051 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 01:34:25,051 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 01:34:25,051 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 01:34:25,051 Example #2 2020-02-13 01:34:25,051 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 01:34:25,051 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 01:34:25,051 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 01:34:25,051 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 01:34:25,051 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 01:34:25,051 Example #3 2020-02-13 01:34:25,051 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 01:34:25,051 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-13 01:34:25,051 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 01:34:25,051 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 01:34:25,051 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-13 01:34:25,052 Validation result (greedy) at epoch 119, step 291000: bleu: 29.97, loss: 39169.9570, ppl: 3.7552, duration: 19.2537s 2020-02-13 01:34:34,960 Epoch 119 Step: 291100 Batch Loss: 1.526721 Tokens per Sec: 22353, Lr: 0.000050 2020-02-13 01:34:44,852 Epoch 119 Step: 291200 Batch Loss: 1.402693 Tokens per Sec: 22140, Lr: 0.000050 2020-02-13 01:34:54,831 Epoch 119 Step: 291300 Batch Loss: 1.419414 Tokens per Sec: 21477, Lr: 0.000050 2020-02-13 01:35:04,727 Epoch 119 Step: 291400 Batch Loss: 1.213086 Tokens per Sec: 22387, Lr: 0.000050 2020-02-13 01:35:14,592 Epoch 119 Step: 291500 Batch Loss: 1.377990 Tokens per Sec: 22326, Lr: 0.000050 2020-02-13 01:35:24,541 Epoch 119 Step: 291600 Batch Loss: 1.195428 Tokens per Sec: 22474, Lr: 0.000050 2020-02-13 01:35:34,448 Epoch 119 Step: 291700 Batch Loss: 1.351403 Tokens per Sec: 22639, Lr: 0.000050 2020-02-13 01:35:44,243 Epoch 119 Step: 291800 Batch Loss: 1.229114 Tokens per Sec: 21772, Lr: 0.000050 2020-02-13 01:35:54,159 Epoch 119 Step: 291900 Batch Loss: 1.230659 Tokens per Sec: 22928, Lr: 0.000050 2020-02-13 01:36:04,101 Epoch 119 Step: 292000 Batch Loss: 1.157660 Tokens per Sec: 22106, Lr: 0.000050 2020-02-13 01:36:23,039 Example #0 2020-02-13 01:36:23,039 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 01:36:23,039 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'vesen', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 01:36:23,039 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 01:36:23,039 Reference: 10 : ​ 6 - 9 . 2020-02-13 01:36:23,040 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu hen atô ve la her shi vea za hemen u lun a dooshima u a lu vesen la her . — Marku 10 : 6 - 9 . 2020-02-13 01:36:23,040 Example #1 2020-02-13 01:36:23,040 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 01:36:23,040 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 01:36:23,040 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 01:36:23,040 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 01:36:23,040 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 01:36:23,040 Example #2 2020-02-13 01:36:23,040 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 01:36:23,040 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 01:36:23,040 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 01:36:23,040 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 01:36:23,040 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 01:36:23,040 Example #3 2020-02-13 01:36:23,040 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 01:36:23,040 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-13 01:36:23,041 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 01:36:23,041 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 01:36:23,041 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-13 01:36:23,041 Validation result (greedy) at epoch 119, step 292000: bleu: 29.82, loss: 39127.7539, ppl: 3.7498, duration: 18.9392s 2020-02-13 01:36:32,888 Epoch 119 Step: 292100 Batch Loss: 1.215162 Tokens per Sec: 22556, Lr: 0.000050 2020-02-13 01:36:42,829 Epoch 119 Step: 292200 Batch Loss: 1.246727 Tokens per Sec: 22112, Lr: 0.000050 2020-02-13 01:36:52,751 Epoch 119 Step: 292300 Batch Loss: 1.239104 Tokens per Sec: 22548, Lr: 0.000050 2020-02-13 01:37:02,715 Epoch 119 Step: 292400 Batch Loss: 0.872811 Tokens per Sec: 22502, Lr: 0.000050 2020-02-13 01:37:12,655 Epoch 119 Step: 292500 Batch Loss: 1.232592 Tokens per Sec: 22466, Lr: 0.000050 2020-02-13 01:37:22,577 Epoch 119 Step: 292600 Batch Loss: 1.325185 Tokens per Sec: 21802, Lr: 0.000050 2020-02-13 01:37:23,573 Epoch 119: total training loss 3063.14 2020-02-13 01:37:23,573 EPOCH 120 2020-02-13 01:37:32,866 Epoch 120 Step: 292700 Batch Loss: 1.141963 Tokens per Sec: 21546, Lr: 0.000050 2020-02-13 01:37:42,863 Epoch 120 Step: 292800 Batch Loss: 1.289481 Tokens per Sec: 21757, Lr: 0.000050 2020-02-13 01:37:52,883 Epoch 120 Step: 292900 Batch Loss: 1.231151 Tokens per Sec: 22154, Lr: 0.000050 2020-02-13 01:38:02,731 Epoch 120 Step: 293000 Batch Loss: 1.246250 Tokens per Sec: 21836, Lr: 0.000050 2020-02-13 01:38:21,687 Example #0 2020-02-13 01:38:21,688 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 01:38:21,688 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'vesen', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 01:38:21,688 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 01:38:21,688 Reference: 10 : ​ 6 - 9 . 2020-02-13 01:38:21,688 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu hen atô ve la her shi vea za hemen u lun a dooshima u a lu vesen la her . — Marku 10 : 6 - 9 . 2020-02-13 01:38:21,688 Example #1 2020-02-13 01:38:21,688 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 01:38:21,688 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 01:38:21,688 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 01:38:21,688 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 01:38:21,688 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 01:38:21,688 Example #2 2020-02-13 01:38:21,688 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 01:38:21,688 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 01:38:21,688 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 01:38:21,689 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 01:38:21,689 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 01:38:21,689 Example #3 2020-02-13 01:38:21,689 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 01:38:21,689 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-13 01:38:21,689 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 01:38:21,689 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 01:38:21,689 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-13 01:38:21,689 Validation result (greedy) at epoch 120, step 293000: bleu: 30.14, loss: 39144.9219, ppl: 3.7520, duration: 18.9575s 2020-02-13 01:38:31,557 Epoch 120 Step: 293100 Batch Loss: 0.988198 Tokens per Sec: 21993, Lr: 0.000035 2020-02-13 01:38:41,489 Epoch 120 Step: 293200 Batch Loss: 1.303895 Tokens per Sec: 22274, Lr: 0.000035 2020-02-13 01:38:51,461 Epoch 120 Step: 293300 Batch Loss: 1.330806 Tokens per Sec: 22421, Lr: 0.000035 2020-02-13 01:39:01,362 Epoch 120 Step: 293400 Batch Loss: 1.188581 Tokens per Sec: 22563, Lr: 0.000035 2020-02-13 01:39:11,328 Epoch 120 Step: 293500 Batch Loss: 1.053802 Tokens per Sec: 21550, Lr: 0.000035 2020-02-13 01:39:21,460 Epoch 120 Step: 293600 Batch Loss: 1.201415 Tokens per Sec: 21993, Lr: 0.000035 2020-02-13 01:39:31,633 Epoch 120 Step: 293700 Batch Loss: 1.138998 Tokens per Sec: 22288, Lr: 0.000035 2020-02-13 01:39:41,923 Epoch 120 Step: 293800 Batch Loss: 1.360935 Tokens per Sec: 21194, Lr: 0.000035 2020-02-13 01:39:52,011 Epoch 120 Step: 293900 Batch Loss: 1.230271 Tokens per Sec: 21565, Lr: 0.000035 2020-02-13 01:40:01,985 Epoch 120 Step: 294000 Batch Loss: 1.270100 Tokens per Sec: 22410, Lr: 0.000035 2020-02-13 01:40:21,261 Hooray! New best validation result [ppl]! 2020-02-13 01:40:21,262 Saving new checkpoint. 2020-02-13 01:40:21,465 Example #0 2020-02-13 01:40:21,465 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 01:40:21,465 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 01:40:21,465 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 01:40:21,465 Reference: 10 : ​ 6 - 9 . 2020-02-13 01:40:21,465 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 01:40:21,465 Example #1 2020-02-13 01:40:21,466 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 01:40:21,466 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 01:40:21,466 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 01:40:21,466 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 01:40:21,466 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 01:40:21,466 Example #2 2020-02-13 01:40:21,466 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 01:40:21,466 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 01:40:21,466 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 01:40:21,466 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 01:40:21,466 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 01:40:21,466 Example #3 2020-02-13 01:40:21,466 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 01:40:21,466 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-13 01:40:21,466 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 01:40:21,466 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 01:40:21,467 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-13 01:40:21,467 Validation result (greedy) at epoch 120, step 294000: bleu: 30.23, loss: 39060.1914, ppl: 3.7413, duration: 19.4807s 2020-02-13 01:40:31,413 Epoch 120 Step: 294100 Batch Loss: 1.251168 Tokens per Sec: 21916, Lr: 0.000035 2020-02-13 01:40:41,361 Epoch 120 Step: 294200 Batch Loss: 0.812227 Tokens per Sec: 22246, Lr: 0.000035 2020-02-13 01:40:51,323 Epoch 120 Step: 294300 Batch Loss: 1.054025 Tokens per Sec: 22283, Lr: 0.000035 2020-02-13 01:41:01,407 Epoch 120 Step: 294400 Batch Loss: 1.396798 Tokens per Sec: 22476, Lr: 0.000035 2020-02-13 01:41:11,556 Epoch 120 Step: 294500 Batch Loss: 1.293965 Tokens per Sec: 21031, Lr: 0.000035 2020-02-13 01:41:21,773 Epoch 120 Step: 294600 Batch Loss: 1.098830 Tokens per Sec: 21167, Lr: 0.000035 2020-02-13 01:41:31,873 Epoch 120 Step: 294700 Batch Loss: 1.375786 Tokens per Sec: 22053, Lr: 0.000035 2020-02-13 01:41:41,986 Epoch 120 Step: 294800 Batch Loss: 1.470380 Tokens per Sec: 22192, Lr: 0.000035 2020-02-13 01:41:51,991 Epoch 120 Step: 294900 Batch Loss: 1.461394 Tokens per Sec: 22376, Lr: 0.000035 2020-02-13 01:42:02,030 Epoch 120 Step: 295000 Batch Loss: 1.274257 Tokens per Sec: 21627, Lr: 0.000035 2020-02-13 01:42:20,749 Example #0 2020-02-13 01:42:20,749 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 01:42:20,750 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 01:42:20,750 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 01:42:20,750 Reference: 10 : ​ 6 - 9 . 2020-02-13 01:42:20,750 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu hen atô ve la shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 01:42:20,750 Example #1 2020-02-13 01:42:20,750 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 01:42:20,750 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 01:42:20,750 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 01:42:20,750 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 01:42:20,750 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 01:42:20,750 Example #2 2020-02-13 01:42:20,750 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 01:42:20,750 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 01:42:20,750 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 01:42:20,750 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 01:42:20,751 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 01:42:20,751 Example #3 2020-02-13 01:42:20,751 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 01:42:20,751 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-13 01:42:20,751 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 01:42:20,751 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 01:42:20,751 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-13 01:42:20,751 Validation result (greedy) at epoch 120, step 295000: bleu: 30.20, loss: 39106.8203, ppl: 3.7472, duration: 18.7207s 2020-02-13 01:42:28,079 Epoch 120: total training loss 3060.10 2020-02-13 01:42:28,079 EPOCH 121 2020-02-13 01:42:30,921 Epoch 121 Step: 295100 Batch Loss: 0.874512 Tokens per Sec: 19824, Lr: 0.000035 2020-02-13 01:42:40,867 Epoch 121 Step: 295200 Batch Loss: 1.560549 Tokens per Sec: 21974, Lr: 0.000035 2020-02-13 01:42:50,843 Epoch 121 Step: 295300 Batch Loss: 1.244527 Tokens per Sec: 22081, Lr: 0.000035 2020-02-13 01:43:01,005 Epoch 121 Step: 295400 Batch Loss: 1.338041 Tokens per Sec: 21425, Lr: 0.000035 2020-02-13 01:43:11,170 Epoch 121 Step: 295500 Batch Loss: 1.104248 Tokens per Sec: 22388, Lr: 0.000035 2020-02-13 01:43:21,140 Epoch 121 Step: 295600 Batch Loss: 1.343024 Tokens per Sec: 22085, Lr: 0.000035 2020-02-13 01:43:31,130 Epoch 121 Step: 295700 Batch Loss: 1.402730 Tokens per Sec: 22425, Lr: 0.000035 2020-02-13 01:43:41,122 Epoch 121 Step: 295800 Batch Loss: 1.314868 Tokens per Sec: 22031, Lr: 0.000035 2020-02-13 01:43:51,261 Epoch 121 Step: 295900 Batch Loss: 1.137491 Tokens per Sec: 22043, Lr: 0.000035 2020-02-13 01:44:01,216 Epoch 121 Step: 296000 Batch Loss: 1.207372 Tokens per Sec: 21459, Lr: 0.000035 2020-02-13 01:44:20,409 Example #0 2020-02-13 01:44:20,409 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 01:44:20,409 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 01:44:20,409 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 01:44:20,409 Reference: 10 : ​ 6 - 9 . 2020-02-13 01:44:20,409 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu hen atô ve la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 01:44:20,409 Example #1 2020-02-13 01:44:20,409 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 01:44:20,409 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 01:44:20,409 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 01:44:20,409 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 01:44:20,410 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 01:44:20,410 Example #2 2020-02-13 01:44:20,410 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 01:44:20,410 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 01:44:20,410 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 01:44:20,410 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 01:44:20,410 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 01:44:20,410 Example #3 2020-02-13 01:44:20,410 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 01:44:20,410 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-13 01:44:20,410 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 01:44:20,410 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 01:44:20,410 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-13 01:44:20,410 Validation result (greedy) at epoch 121, step 296000: bleu: 30.06, loss: 39128.6172, ppl: 3.7499, duration: 19.1941s 2020-02-13 01:44:30,334 Epoch 121 Step: 296100 Batch Loss: 1.275069 Tokens per Sec: 22428, Lr: 0.000035 2020-02-13 01:44:40,395 Epoch 121 Step: 296200 Batch Loss: 1.164876 Tokens per Sec: 22316, Lr: 0.000035 2020-02-13 01:44:50,554 Epoch 121 Step: 296300 Batch Loss: 1.122248 Tokens per Sec: 22060, Lr: 0.000035 2020-02-13 01:45:00,588 Epoch 121 Step: 296400 Batch Loss: 1.330712 Tokens per Sec: 21748, Lr: 0.000035 2020-02-13 01:45:10,497 Epoch 121 Step: 296500 Batch Loss: 1.393502 Tokens per Sec: 22668, Lr: 0.000035 2020-02-13 01:45:20,496 Epoch 121 Step: 296600 Batch Loss: 1.242900 Tokens per Sec: 21320, Lr: 0.000035 2020-02-13 01:45:30,570 Epoch 121 Step: 296700 Batch Loss: 1.447136 Tokens per Sec: 22208, Lr: 0.000035 2020-02-13 01:45:40,675 Epoch 121 Step: 296800 Batch Loss: 1.463283 Tokens per Sec: 22163, Lr: 0.000035 2020-02-13 01:45:50,905 Epoch 121 Step: 296900 Batch Loss: 1.404332 Tokens per Sec: 21379, Lr: 0.000035 2020-02-13 01:46:00,856 Epoch 121 Step: 297000 Batch Loss: 1.105256 Tokens per Sec: 22863, Lr: 0.000035 2020-02-13 01:46:19,643 Example #0 2020-02-13 01:46:19,643 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 01:46:19,643 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 01:46:19,643 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 01:46:19,643 Reference: 10 : ​ 6 - 9 . 2020-02-13 01:46:19,644 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 01:46:19,644 Example #1 2020-02-13 01:46:19,644 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 01:46:19,644 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 01:46:19,644 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 01:46:19,644 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 01:46:19,644 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 01:46:19,644 Example #2 2020-02-13 01:46:19,644 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 01:46:19,644 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 01:46:19,644 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 01:46:19,644 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 01:46:19,644 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 01:46:19,645 Example #3 2020-02-13 01:46:19,645 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 01:46:19,645 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-13 01:46:19,645 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 01:46:19,645 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 01:46:19,645 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-13 01:46:19,645 Validation result (greedy) at epoch 121, step 297000: bleu: 29.71, loss: 39103.6055, ppl: 3.7468, duration: 18.7889s 2020-02-13 01:46:29,491 Epoch 121 Step: 297100 Batch Loss: 1.277820 Tokens per Sec: 21488, Lr: 0.000035 2020-02-13 01:46:39,364 Epoch 121 Step: 297200 Batch Loss: 1.281786 Tokens per Sec: 22767, Lr: 0.000035 2020-02-13 01:46:49,295 Epoch 121 Step: 297300 Batch Loss: 1.247615 Tokens per Sec: 22453, Lr: 0.000035 2020-02-13 01:46:59,236 Epoch 121 Step: 297400 Batch Loss: 1.309100 Tokens per Sec: 22252, Lr: 0.000035 2020-02-13 01:47:09,385 Epoch 121 Step: 297500 Batch Loss: 1.226864 Tokens per Sec: 21723, Lr: 0.000035 2020-02-13 01:47:12,616 Epoch 121: total training loss 3048.60 2020-02-13 01:47:12,616 EPOCH 122 2020-02-13 01:47:19,759 Epoch 122 Step: 297600 Batch Loss: 1.185661 Tokens per Sec: 21302, Lr: 0.000035 2020-02-13 01:47:29,826 Epoch 122 Step: 297700 Batch Loss: 1.164758 Tokens per Sec: 22103, Lr: 0.000035 2020-02-13 01:47:39,873 Epoch 122 Step: 297800 Batch Loss: 1.090173 Tokens per Sec: 21746, Lr: 0.000035 2020-02-13 01:47:49,995 Epoch 122 Step: 297900 Batch Loss: 0.986817 Tokens per Sec: 22412, Lr: 0.000035 2020-02-13 01:48:00,184 Epoch 122 Step: 298000 Batch Loss: 1.404217 Tokens per Sec: 21900, Lr: 0.000035 2020-02-13 01:48:20,006 Example #0 2020-02-13 01:48:20,006 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 01:48:20,007 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'her', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 01:48:20,007 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 01:48:20,007 Reference: 10 : ​ 6 - 9 . 2020-02-13 01:48:20,007 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea za hemen u lun a dooshima u a lu hen atô ve la shi vea za hemen u lun a dooshima u a lu her la her . — Marku 10 : 6 - 9 . 2020-02-13 01:48:20,007 Example #1 2020-02-13 01:48:20,007 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 01:48:20,007 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 01:48:20,007 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 01:48:20,007 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 01:48:20,007 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 01:48:20,007 Example #2 2020-02-13 01:48:20,007 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 01:48:20,007 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 01:48:20,007 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 01:48:20,008 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 01:48:20,008 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 01:48:20,008 Example #3 2020-02-13 01:48:20,008 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 01:48:20,008 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-13 01:48:20,008 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 01:48:20,008 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 01:48:20,008 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-13 01:48:20,008 Validation result (greedy) at epoch 122, step 298000: bleu: 30.04, loss: 39077.6367, ppl: 3.7435, duration: 19.8234s 2020-02-13 01:48:30,199 Epoch 122 Step: 298100 Batch Loss: 0.943971 Tokens per Sec: 21591, Lr: 0.000035 2020-02-13 01:48:40,402 Epoch 122 Step: 298200 Batch Loss: 1.394563 Tokens per Sec: 21826, Lr: 0.000035 2020-02-13 01:48:50,640 Epoch 122 Step: 298300 Batch Loss: 1.415503 Tokens per Sec: 21673, Lr: 0.000035 2020-02-13 01:49:00,536 Epoch 122 Step: 298400 Batch Loss: 1.288342 Tokens per Sec: 22242, Lr: 0.000035 2020-02-13 01:49:10,403 Epoch 122 Step: 298500 Batch Loss: 1.320506 Tokens per Sec: 22208, Lr: 0.000035 2020-02-13 01:49:20,301 Epoch 122 Step: 298600 Batch Loss: 1.287893 Tokens per Sec: 22330, Lr: 0.000035 2020-02-13 01:49:30,281 Epoch 122 Step: 298700 Batch Loss: 1.366692 Tokens per Sec: 21643, Lr: 0.000035 2020-02-13 01:49:40,298 Epoch 122 Step: 298800 Batch Loss: 1.175110 Tokens per Sec: 22575, Lr: 0.000035 2020-02-13 01:49:50,418 Epoch 122 Step: 298900 Batch Loss: 1.121058 Tokens per Sec: 21891, Lr: 0.000035 2020-02-13 01:50:00,643 Epoch 122 Step: 299000 Batch Loss: 1.079600 Tokens per Sec: 21445, Lr: 0.000035 2020-02-13 01:50:20,335 Example #0 2020-02-13 01:50:20,335 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 01:50:20,335 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 've', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 01:50:20,335 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 01:50:20,336 Reference: 10 : ​ 6 - 9 . 2020-02-13 01:50:20,336 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima ve la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 01:50:20,336 Example #1 2020-02-13 01:50:20,336 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 01:50:20,336 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 01:50:20,336 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 01:50:20,336 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 01:50:20,336 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 01:50:20,336 Example #2 2020-02-13 01:50:20,336 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 01:50:20,336 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 01:50:20,336 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 01:50:20,336 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 01:50:20,336 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 01:50:20,336 Example #3 2020-02-13 01:50:20,337 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 01:50:20,337 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-13 01:50:20,337 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 01:50:20,337 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 01:50:20,337 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-13 01:50:20,337 Validation result (greedy) at epoch 122, step 299000: bleu: 30.02, loss: 39074.0586, ppl: 3.7430, duration: 19.6932s 2020-02-13 01:50:30,315 Epoch 122 Step: 299100 Batch Loss: 1.407962 Tokens per Sec: 21848, Lr: 0.000035 2020-02-13 01:50:40,181 Epoch 122 Step: 299200 Batch Loss: 1.408911 Tokens per Sec: 21996, Lr: 0.000035 2020-02-13 01:50:50,121 Epoch 122 Step: 299300 Batch Loss: 1.105096 Tokens per Sec: 22503, Lr: 0.000035 2020-02-13 01:51:00,000 Epoch 122 Step: 299400 Batch Loss: 1.294959 Tokens per Sec: 22323, Lr: 0.000035 2020-02-13 01:51:09,918 Epoch 122 Step: 299500 Batch Loss: 1.335099 Tokens per Sec: 22547, Lr: 0.000035 2020-02-13 01:51:19,921 Epoch 122 Step: 299600 Batch Loss: 0.975372 Tokens per Sec: 22357, Lr: 0.000035 2020-02-13 01:51:29,801 Epoch 122 Step: 299700 Batch Loss: 0.935892 Tokens per Sec: 22327, Lr: 0.000035 2020-02-13 01:51:39,706 Epoch 122 Step: 299800 Batch Loss: 1.117000 Tokens per Sec: 22341, Lr: 0.000035 2020-02-13 01:51:49,687 Epoch 122 Step: 299900 Batch Loss: 1.281815 Tokens per Sec: 22508, Lr: 0.000035 2020-02-13 01:51:58,289 Epoch 122: total training loss 3042.02 2020-02-13 01:51:58,289 EPOCH 123 2020-02-13 01:51:59,858 Epoch 123 Step: 300000 Batch Loss: 1.387238 Tokens per Sec: 19228, Lr: 0.000035 2020-02-13 01:52:18,955 Example #0 2020-02-13 01:52:18,955 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 01:52:18,955 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 01:52:18,955 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 01:52:18,956 Reference: 10 : ​ 6 - 9 . 2020-02-13 01:52:18,956 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 01:52:18,956 Example #1 2020-02-13 01:52:18,956 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 01:52:18,956 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 01:52:18,956 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 01:52:18,956 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 01:52:18,956 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 01:52:18,956 Example #2 2020-02-13 01:52:18,956 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 01:52:18,956 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 01:52:18,956 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 01:52:18,956 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 01:52:18,956 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 01:52:18,956 Example #3 2020-02-13 01:52:18,957 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 01:52:18,957 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-13 01:52:18,957 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 01:52:18,957 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 01:52:18,957 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-13 01:52:18,957 Validation result (greedy) at epoch 123, step 300000: bleu: 30.03, loss: 39086.0078, ppl: 3.7445, duration: 19.0980s 2020-02-13 01:52:28,885 Epoch 123 Step: 300100 Batch Loss: 0.993123 Tokens per Sec: 21663, Lr: 0.000025 2020-02-13 01:52:38,793 Epoch 123 Step: 300200 Batch Loss: 0.927405 Tokens per Sec: 22240, Lr: 0.000025 2020-02-13 01:52:48,792 Epoch 123 Step: 300300 Batch Loss: 1.347097 Tokens per Sec: 22441, Lr: 0.000025 2020-02-13 01:52:58,723 Epoch 123 Step: 300400 Batch Loss: 1.202892 Tokens per Sec: 22497, Lr: 0.000025 2020-02-13 01:53:08,693 Epoch 123 Step: 300500 Batch Loss: 1.321265 Tokens per Sec: 22826, Lr: 0.000025 2020-02-13 01:53:18,629 Epoch 123 Step: 300600 Batch Loss: 1.368494 Tokens per Sec: 22564, Lr: 0.000025 2020-02-13 01:53:28,543 Epoch 123 Step: 300700 Batch Loss: 1.373105 Tokens per Sec: 22314, Lr: 0.000025 2020-02-13 01:53:38,437 Epoch 123 Step: 300800 Batch Loss: 1.425950 Tokens per Sec: 22462, Lr: 0.000025 2020-02-13 01:53:48,392 Epoch 123 Step: 300900 Batch Loss: 1.120012 Tokens per Sec: 22627, Lr: 0.000025 2020-02-13 01:53:58,320 Epoch 123 Step: 301000 Batch Loss: 1.237273 Tokens per Sec: 22214, Lr: 0.000025 2020-02-13 01:54:17,445 Hooray! New best validation result [ppl]! 2020-02-13 01:54:17,445 Saving new checkpoint. 2020-02-13 01:54:17,650 Example #0 2020-02-13 01:54:17,650 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 01:54:17,650 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 01:54:17,650 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 01:54:17,650 Reference: 10 : ​ 6 - 9 . 2020-02-13 01:54:17,650 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 01:54:17,650 Example #1 2020-02-13 01:54:17,650 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 01:54:17,650 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 01:54:17,651 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 01:54:17,651 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 01:54:17,651 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 01:54:17,651 Example #2 2020-02-13 01:54:17,651 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 01:54:17,651 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 01:54:17,651 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 01:54:17,651 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 01:54:17,651 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 01:54:17,651 Example #3 2020-02-13 01:54:17,651 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 01:54:17,651 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-13 01:54:17,651 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 01:54:17,652 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 01:54:17,652 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-13 01:54:17,652 Validation result (greedy) at epoch 123, step 301000: bleu: 30.05, loss: 39041.4219, ppl: 3.7389, duration: 19.3312s 2020-02-13 01:54:27,663 Epoch 123 Step: 301100 Batch Loss: 1.336029 Tokens per Sec: 21849, Lr: 0.000025 2020-02-13 01:54:37,681 Epoch 123 Step: 301200 Batch Loss: 1.455642 Tokens per Sec: 22170, Lr: 0.000025 2020-02-13 01:54:47,784 Epoch 123 Step: 301300 Batch Loss: 1.311412 Tokens per Sec: 22214, Lr: 0.000025 2020-02-13 01:54:57,861 Epoch 123 Step: 301400 Batch Loss: 1.325327 Tokens per Sec: 21684, Lr: 0.000025 2020-02-13 01:55:07,820 Epoch 123 Step: 301500 Batch Loss: 1.344703 Tokens per Sec: 22359, Lr: 0.000025 2020-02-13 01:55:17,805 Epoch 123 Step: 301600 Batch Loss: 1.358923 Tokens per Sec: 22400, Lr: 0.000025 2020-02-13 01:55:27,761 Epoch 123 Step: 301700 Batch Loss: 1.256299 Tokens per Sec: 22345, Lr: 0.000025 2020-02-13 01:55:37,786 Epoch 123 Step: 301800 Batch Loss: 1.137383 Tokens per Sec: 21456, Lr: 0.000025 2020-02-13 01:55:47,828 Epoch 123 Step: 301900 Batch Loss: 1.231528 Tokens per Sec: 22229, Lr: 0.000025 2020-02-13 01:55:57,809 Epoch 123 Step: 302000 Batch Loss: 1.123157 Tokens per Sec: 21557, Lr: 0.000025 2020-02-13 01:56:16,858 Example #0 2020-02-13 01:56:16,858 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 01:56:16,859 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 01:56:16,859 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 01:56:16,859 Reference: 10 : ​ 6 - 9 . 2020-02-13 01:56:16,859 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 01:56:16,859 Example #1 2020-02-13 01:56:16,859 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 01:56:16,859 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 01:56:16,859 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 01:56:16,859 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 01:56:16,859 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 01:56:16,859 Example #2 2020-02-13 01:56:16,859 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 01:56:16,859 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 01:56:16,859 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 01:56:16,859 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 01:56:16,860 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 01:56:16,860 Example #3 2020-02-13 01:56:16,860 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 01:56:16,860 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-13 01:56:16,860 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 01:56:16,860 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 01:56:16,860 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-13 01:56:16,860 Validation result (greedy) at epoch 123, step 302000: bleu: 29.94, loss: 39071.3359, ppl: 3.7427, duration: 19.0504s 2020-02-13 01:56:26,770 Epoch 123 Step: 302100 Batch Loss: 1.339618 Tokens per Sec: 22327, Lr: 0.000025 2020-02-13 01:56:36,670 Epoch 123 Step: 302200 Batch Loss: 1.259565 Tokens per Sec: 22659, Lr: 0.000025 2020-02-13 01:56:46,621 Epoch 123 Step: 302300 Batch Loss: 1.047744 Tokens per Sec: 22231, Lr: 0.000025 2020-02-13 01:56:56,531 Epoch 123 Step: 302400 Batch Loss: 1.197726 Tokens per Sec: 22672, Lr: 0.000025 2020-02-13 01:57:00,206 Epoch 123: total training loss 3032.36 2020-02-13 01:57:00,206 EPOCH 124 2020-02-13 01:57:06,758 Epoch 124 Step: 302500 Batch Loss: 1.316740 Tokens per Sec: 21748, Lr: 0.000025 2020-02-13 01:57:16,666 Epoch 124 Step: 302600 Batch Loss: 1.354810 Tokens per Sec: 22621, Lr: 0.000025 2020-02-13 01:57:26,624 Epoch 124 Step: 302700 Batch Loss: 1.184757 Tokens per Sec: 21977, Lr: 0.000025 2020-02-13 01:57:36,491 Epoch 124 Step: 302800 Batch Loss: 1.417567 Tokens per Sec: 22603, Lr: 0.000025 2020-02-13 01:57:46,400 Epoch 124 Step: 302900 Batch Loss: 1.291038 Tokens per Sec: 22115, Lr: 0.000025 2020-02-13 01:57:56,486 Epoch 124 Step: 303000 Batch Loss: 1.233257 Tokens per Sec: 21762, Lr: 0.000025 2020-02-13 01:58:15,917 Example #0 2020-02-13 01:58:15,917 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 01:58:15,917 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'kura', 'dooshima', 've', 'la', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 01:58:15,918 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 01:58:15,918 Reference: 10 : ​ 6 - 9 . 2020-02-13 01:58:15,918 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea kura dooshima ve la shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 01:58:15,918 Example #1 2020-02-13 01:58:15,918 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 01:58:15,918 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 01:58:15,918 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 01:58:15,918 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 01:58:15,918 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 01:58:15,918 Example #2 2020-02-13 01:58:15,918 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 01:58:15,918 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 01:58:15,918 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 01:58:15,918 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 01:58:15,918 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 01:58:15,919 Example #3 2020-02-13 01:58:15,919 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 01:58:15,919 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-13 01:58:15,919 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 01:58:15,919 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 01:58:15,919 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-13 01:58:15,919 Validation result (greedy) at epoch 124, step 303000: bleu: 29.98, loss: 39056.8320, ppl: 3.7408, duration: 19.4327s 2020-02-13 01:58:25,917 Epoch 124 Step: 303100 Batch Loss: 1.139769 Tokens per Sec: 21481, Lr: 0.000025 2020-02-13 01:58:35,835 Epoch 124 Step: 303200 Batch Loss: 1.309878 Tokens per Sec: 22329, Lr: 0.000025 2020-02-13 01:58:45,732 Epoch 124 Step: 303300 Batch Loss: 1.400098 Tokens per Sec: 21988, Lr: 0.000025 2020-02-13 01:58:55,697 Epoch 124 Step: 303400 Batch Loss: 1.189941 Tokens per Sec: 21827, Lr: 0.000025 2020-02-13 01:59:05,620 Epoch 124 Step: 303500 Batch Loss: 1.302169 Tokens per Sec: 22102, Lr: 0.000025 2020-02-13 01:59:15,501 Epoch 124 Step: 303600 Batch Loss: 1.299294 Tokens per Sec: 21846, Lr: 0.000025 2020-02-13 01:59:25,389 Epoch 124 Step: 303700 Batch Loss: 1.157288 Tokens per Sec: 23017, Lr: 0.000025 2020-02-13 01:59:35,249 Epoch 124 Step: 303800 Batch Loss: 1.480787 Tokens per Sec: 22539, Lr: 0.000025 2020-02-13 01:59:45,105 Epoch 124 Step: 303900 Batch Loss: 1.100494 Tokens per Sec: 22864, Lr: 0.000025 2020-02-13 01:59:55,039 Epoch 124 Step: 304000 Batch Loss: 1.313818 Tokens per Sec: 22155, Lr: 0.000025 2020-02-13 02:00:14,041 Example #0 2020-02-13 02:00:14,041 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 02:00:14,041 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'vesen', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 02:00:14,041 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 02:00:14,041 Reference: 10 : ​ 6 - 9 . 2020-02-13 02:00:14,041 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu hen atô ve la her shi vea za hemen u lun a dooshima u a lu vesen la her . — Marku 10 : 6 - 9 . 2020-02-13 02:00:14,041 Example #1 2020-02-13 02:00:14,041 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 02:00:14,041 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 02:00:14,042 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 02:00:14,042 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 02:00:14,042 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 02:00:14,042 Example #2 2020-02-13 02:00:14,042 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 02:00:14,042 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 02:00:14,042 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 02:00:14,042 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 02:00:14,042 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 02:00:14,042 Example #3 2020-02-13 02:00:14,042 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 02:00:14,042 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-13 02:00:14,042 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 02:00:14,042 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 02:00:14,042 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-13 02:00:14,043 Validation result (greedy) at epoch 124, step 304000: bleu: 30.00, loss: 39065.1133, ppl: 3.7419, duration: 19.0030s 2020-02-13 02:00:24,063 Epoch 124 Step: 304100 Batch Loss: 1.316230 Tokens per Sec: 22240, Lr: 0.000025 2020-02-13 02:00:33,987 Epoch 124 Step: 304200 Batch Loss: 1.140233 Tokens per Sec: 22579, Lr: 0.000025 2020-02-13 02:00:43,931 Epoch 124 Step: 304300 Batch Loss: 1.032943 Tokens per Sec: 21959, Lr: 0.000025 2020-02-13 02:00:53,918 Epoch 124 Step: 304400 Batch Loss: 1.460914 Tokens per Sec: 22391, Lr: 0.000025 2020-02-13 02:01:03,885 Epoch 124 Step: 304500 Batch Loss: 1.164934 Tokens per Sec: 22359, Lr: 0.000025 2020-02-13 02:01:13,847 Epoch 124 Step: 304600 Batch Loss: 1.260535 Tokens per Sec: 22284, Lr: 0.000025 2020-02-13 02:01:23,767 Epoch 124 Step: 304700 Batch Loss: 1.262552 Tokens per Sec: 22180, Lr: 0.000025 2020-02-13 02:01:33,704 Epoch 124 Step: 304800 Batch Loss: 1.382692 Tokens per Sec: 23118, Lr: 0.000025 2020-02-13 02:01:42,739 Epoch 124: total training loss 3034.98 2020-02-13 02:01:42,740 EPOCH 125 2020-02-13 02:01:43,915 Epoch 125 Step: 304900 Batch Loss: 1.103293 Tokens per Sec: 16198, Lr: 0.000025 2020-02-13 02:01:53,900 Epoch 125 Step: 305000 Batch Loss: 1.283290 Tokens per Sec: 22712, Lr: 0.000025 2020-02-13 02:02:13,221 Example #0 2020-02-13 02:02:13,221 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 02:02:13,221 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'vesen', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 02:02:13,221 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 02:02:13,221 Reference: 10 : ​ 6 - 9 . 2020-02-13 02:02:13,221 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu hen atô ve la her shi vea za hemen u lun a dooshima u a lu vesen la her . — Marku 10 : 6 - 9 . 2020-02-13 02:02:13,221 Example #1 2020-02-13 02:02:13,221 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 02:02:13,221 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 02:02:13,221 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 02:02:13,221 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 02:02:13,221 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 02:02:13,222 Example #2 2020-02-13 02:02:13,222 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 02:02:13,222 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 02:02:13,222 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 02:02:13,222 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 02:02:13,222 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 02:02:13,222 Example #3 2020-02-13 02:02:13,222 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 02:02:13,222 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-13 02:02:13,222 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 02:02:13,222 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 02:02:13,222 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-13 02:02:13,222 Validation result (greedy) at epoch 125, step 305000: bleu: 30.09, loss: 39079.9688, ppl: 3.7438, duration: 19.3217s 2020-02-13 02:02:23,103 Epoch 125 Step: 305100 Batch Loss: 1.382937 Tokens per Sec: 22496, Lr: 0.000025 2020-02-13 02:02:33,103 Epoch 125 Step: 305200 Batch Loss: 1.326125 Tokens per Sec: 22204, Lr: 0.000025 2020-02-13 02:02:42,982 Epoch 125 Step: 305300 Batch Loss: 1.143446 Tokens per Sec: 22403, Lr: 0.000025 2020-02-13 02:02:52,911 Epoch 125 Step: 305400 Batch Loss: 1.351618 Tokens per Sec: 21974, Lr: 0.000025 2020-02-13 02:03:02,897 Epoch 125 Step: 305500 Batch Loss: 1.033369 Tokens per Sec: 22530, Lr: 0.000025 2020-02-13 02:03:12,820 Epoch 125 Step: 305600 Batch Loss: 1.544235 Tokens per Sec: 22635, Lr: 0.000025 2020-02-13 02:03:22,739 Epoch 125 Step: 305700 Batch Loss: 1.103464 Tokens per Sec: 22236, Lr: 0.000025 2020-02-13 02:03:32,549 Epoch 125 Step: 305800 Batch Loss: 1.061159 Tokens per Sec: 22800, Lr: 0.000025 2020-02-13 02:03:42,402 Epoch 125 Step: 305900 Batch Loss: 1.234054 Tokens per Sec: 22118, Lr: 0.000025 2020-02-13 02:03:52,300 Epoch 125 Step: 306000 Batch Loss: 1.375284 Tokens per Sec: 22138, Lr: 0.000025 2020-02-13 02:04:11,819 Example #0 2020-02-13 02:04:11,819 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 02:04:11,819 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'kura', 'dooshima', 've', 'la', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 02:04:11,820 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 02:04:11,820 Reference: 10 : ​ 6 - 9 . 2020-02-13 02:04:11,820 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea kura dooshima ve la shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 02:04:11,820 Example #1 2020-02-13 02:04:11,820 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 02:04:11,820 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 02:04:11,820 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 02:04:11,820 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 02:04:11,820 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 02:04:11,820 Example #2 2020-02-13 02:04:11,820 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 02:04:11,820 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 02:04:11,820 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 02:04:11,820 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 02:04:11,820 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 02:04:11,821 Example #3 2020-02-13 02:04:11,821 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 02:04:11,821 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-13 02:04:11,821 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 02:04:11,821 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 02:04:11,821 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-13 02:04:11,821 Validation result (greedy) at epoch 125, step 306000: bleu: 30.24, loss: 39058.6758, ppl: 3.7411, duration: 19.5201s 2020-02-13 02:04:21,676 Epoch 125 Step: 306100 Batch Loss: 1.255560 Tokens per Sec: 22190, Lr: 0.000025 2020-02-13 02:04:31,495 Epoch 125 Step: 306200 Batch Loss: 1.208472 Tokens per Sec: 22286, Lr: 0.000025 2020-02-13 02:04:41,449 Epoch 125 Step: 306300 Batch Loss: 1.345084 Tokens per Sec: 22149, Lr: 0.000025 2020-02-13 02:04:51,327 Epoch 125 Step: 306400 Batch Loss: 1.297771 Tokens per Sec: 22228, Lr: 0.000025 2020-02-13 02:05:01,168 Epoch 125 Step: 306500 Batch Loss: 1.193193 Tokens per Sec: 22078, Lr: 0.000025 2020-02-13 02:05:11,097 Epoch 125 Step: 306600 Batch Loss: 1.239293 Tokens per Sec: 22686, Lr: 0.000025 2020-02-13 02:05:21,062 Epoch 125 Step: 306700 Batch Loss: 1.247765 Tokens per Sec: 22396, Lr: 0.000025 2020-02-13 02:05:30,976 Epoch 125 Step: 306800 Batch Loss: 1.446016 Tokens per Sec: 22702, Lr: 0.000025 2020-02-13 02:05:40,865 Epoch 125 Step: 306900 Batch Loss: 1.319994 Tokens per Sec: 22840, Lr: 0.000025 2020-02-13 02:05:50,828 Epoch 125 Step: 307000 Batch Loss: 1.397125 Tokens per Sec: 22843, Lr: 0.000025 2020-02-13 02:06:10,159 Hooray! New best validation result [ppl]! 2020-02-13 02:06:10,159 Saving new checkpoint. 2020-02-13 02:06:10,360 Example #0 2020-02-13 02:06:10,360 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 02:06:10,361 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 02:06:10,361 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 02:06:10,361 Reference: 10 : ​ 6 - 9 . 2020-02-13 02:06:10,361 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 02:06:10,361 Example #1 2020-02-13 02:06:10,361 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 02:06:10,361 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 02:06:10,361 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 02:06:10,361 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 02:06:10,361 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 02:06:10,361 Example #2 2020-02-13 02:06:10,361 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 02:06:10,361 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 02:06:10,361 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 02:06:10,361 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 02:06:10,362 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 02:06:10,362 Example #3 2020-02-13 02:06:10,362 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 02:06:10,362 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-13 02:06:10,362 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 02:06:10,362 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 02:06:10,362 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-13 02:06:10,362 Validation result (greedy) at epoch 125, step 307000: bleu: 30.16, loss: 39029.0312, ppl: 3.7373, duration: 19.5332s 2020-02-13 02:06:20,344 Epoch 125 Step: 307100 Batch Loss: 1.225818 Tokens per Sec: 21988, Lr: 0.000025 2020-02-13 02:06:30,227 Epoch 125 Step: 307200 Batch Loss: 1.301729 Tokens per Sec: 22030, Lr: 0.000025 2020-02-13 02:06:40,176 Epoch 125 Step: 307300 Batch Loss: 1.226275 Tokens per Sec: 22016, Lr: 0.000025 2020-02-13 02:06:44,549 Epoch 125: total training loss 3031.44 2020-02-13 02:06:44,549 EPOCH 126 2020-02-13 02:06:50,655 Epoch 126 Step: 307400 Batch Loss: 1.276301 Tokens per Sec: 20627, Lr: 0.000025 2020-02-13 02:07:00,731 Epoch 126 Step: 307500 Batch Loss: 0.910138 Tokens per Sec: 22110, Lr: 0.000025 2020-02-13 02:07:10,769 Epoch 126 Step: 307600 Batch Loss: 1.081769 Tokens per Sec: 22217, Lr: 0.000025 2020-02-13 02:07:20,758 Epoch 126 Step: 307700 Batch Loss: 1.193331 Tokens per Sec: 21691, Lr: 0.000025 2020-02-13 02:07:30,685 Epoch 126 Step: 307800 Batch Loss: 1.384777 Tokens per Sec: 22349, Lr: 0.000025 2020-02-13 02:07:40,585 Epoch 126 Step: 307900 Batch Loss: 1.183730 Tokens per Sec: 22320, Lr: 0.000025 2020-02-13 02:07:50,608 Epoch 126 Step: 308000 Batch Loss: 1.201577 Tokens per Sec: 22323, Lr: 0.000025 2020-02-13 02:08:09,469 Hooray! New best validation result [ppl]! 2020-02-13 02:08:09,469 Saving new checkpoint. 2020-02-13 02:08:09,658 Example #0 2020-02-13 02:08:09,658 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 02:08:09,658 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'kura', 'dooshima', 've', 'la', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 02:08:09,658 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 02:08:09,658 Reference: 10 : ​ 6 - 9 . 2020-02-13 02:08:09,658 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea kura dooshima ve la shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 02:08:09,658 Example #1 2020-02-13 02:08:09,658 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 02:08:09,658 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 02:08:09,659 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 02:08:09,659 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 02:08:09,659 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 02:08:09,659 Example #2 2020-02-13 02:08:09,659 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 02:08:09,659 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 02:08:09,659 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 02:08:09,659 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 02:08:09,659 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 02:08:09,659 Example #3 2020-02-13 02:08:09,659 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 02:08:09,659 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-13 02:08:09,659 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 02:08:09,659 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 02:08:09,659 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-13 02:08:09,660 Validation result (greedy) at epoch 126, step 308000: bleu: 30.10, loss: 39023.7773, ppl: 3.7367, duration: 19.0511s 2020-02-13 02:08:19,522 Epoch 126 Step: 308100 Batch Loss: 1.312710 Tokens per Sec: 22485, Lr: 0.000025 2020-02-13 02:08:29,387 Epoch 126 Step: 308200 Batch Loss: 1.352761 Tokens per Sec: 22345, Lr: 0.000025 2020-02-13 02:08:39,338 Epoch 126 Step: 308300 Batch Loss: 1.219691 Tokens per Sec: 22455, Lr: 0.000025 2020-02-13 02:08:49,406 Epoch 126 Step: 308400 Batch Loss: 1.317281 Tokens per Sec: 22375, Lr: 0.000025 2020-02-13 02:08:59,444 Epoch 126 Step: 308500 Batch Loss: 1.171016 Tokens per Sec: 22032, Lr: 0.000025 2020-02-13 02:09:09,399 Epoch 126 Step: 308600 Batch Loss: 1.345441 Tokens per Sec: 22192, Lr: 0.000025 2020-02-13 02:09:19,293 Epoch 126 Step: 308700 Batch Loss: 1.351377 Tokens per Sec: 22151, Lr: 0.000025 2020-02-13 02:09:29,242 Epoch 126 Step: 308800 Batch Loss: 1.094367 Tokens per Sec: 22157, Lr: 0.000025 2020-02-13 02:09:39,090 Epoch 126 Step: 308900 Batch Loss: 1.254726 Tokens per Sec: 22078, Lr: 0.000025 2020-02-13 02:09:48,988 Epoch 126 Step: 309000 Batch Loss: 1.319536 Tokens per Sec: 22460, Lr: 0.000025 2020-02-13 02:10:08,131 Example #0 2020-02-13 02:10:08,131 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 02:10:08,131 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 02:10:08,131 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 02:10:08,131 Reference: 10 : ​ 6 - 9 . 2020-02-13 02:10:08,131 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 02:10:08,132 Example #1 2020-02-13 02:10:08,132 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 02:10:08,132 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 02:10:08,132 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 02:10:08,132 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 02:10:08,132 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 02:10:08,132 Example #2 2020-02-13 02:10:08,132 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 02:10:08,132 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 02:10:08,132 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 02:10:08,132 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 02:10:08,132 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 02:10:08,132 Example #3 2020-02-13 02:10:08,132 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 02:10:08,132 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-13 02:10:08,132 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 02:10:08,132 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 02:10:08,133 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-13 02:10:08,133 Validation result (greedy) at epoch 126, step 309000: bleu: 30.15, loss: 39081.6484, ppl: 3.7440, duration: 19.1443s 2020-02-13 02:10:17,994 Epoch 126 Step: 309100 Batch Loss: 1.321482 Tokens per Sec: 23172, Lr: 0.000025 2020-02-13 02:10:27,866 Epoch 126 Step: 309200 Batch Loss: 1.152840 Tokens per Sec: 21875, Lr: 0.000025 2020-02-13 02:10:37,930 Epoch 126 Step: 309300 Batch Loss: 1.526487 Tokens per Sec: 21449, Lr: 0.000025 2020-02-13 02:10:48,116 Epoch 126 Step: 309400 Batch Loss: 1.453353 Tokens per Sec: 21575, Lr: 0.000025 2020-02-13 02:10:58,292 Epoch 126 Step: 309500 Batch Loss: 1.208371 Tokens per Sec: 21465, Lr: 0.000025 2020-02-13 02:11:08,393 Epoch 126 Step: 309600 Batch Loss: 1.341498 Tokens per Sec: 21863, Lr: 0.000025 2020-02-13 02:11:18,310 Epoch 126 Step: 309700 Batch Loss: 1.328931 Tokens per Sec: 22091, Lr: 0.000025 2020-02-13 02:11:28,315 Epoch 126 Step: 309800 Batch Loss: 1.223836 Tokens per Sec: 22093, Lr: 0.000025 2020-02-13 02:11:28,626 Epoch 126: total training loss 3038.23 2020-02-13 02:11:28,626 EPOCH 127 2020-02-13 02:11:38,678 Epoch 127 Step: 309900 Batch Loss: 1.309919 Tokens per Sec: 20773, Lr: 0.000025 2020-02-13 02:11:48,884 Epoch 127 Step: 310000 Batch Loss: 1.365402 Tokens per Sec: 21647, Lr: 0.000025 2020-02-13 02:12:08,713 Example #0 2020-02-13 02:12:08,713 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 02:12:08,713 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'kura', 'dooshima', 've', 'la', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 02:12:08,713 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 02:12:08,713 Reference: 10 : ​ 6 - 9 . 2020-02-13 02:12:08,713 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea kura dooshima ve la shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 02:12:08,713 Example #1 2020-02-13 02:12:08,713 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 02:12:08,713 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 02:12:08,713 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 02:12:08,713 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 02:12:08,713 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 02:12:08,714 Example #2 2020-02-13 02:12:08,714 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 02:12:08,714 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 02:12:08,714 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 02:12:08,714 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 02:12:08,714 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 02:12:08,714 Example #3 2020-02-13 02:12:08,714 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 02:12:08,714 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-13 02:12:08,714 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 02:12:08,714 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 02:12:08,714 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-13 02:12:08,714 Validation result (greedy) at epoch 127, step 310000: bleu: 29.91, loss: 39058.1758, ppl: 3.7410, duration: 19.8300s 2020-02-13 02:12:18,710 Epoch 127 Step: 310100 Batch Loss: 1.213650 Tokens per Sec: 22188, Lr: 0.000025 2020-02-13 02:12:28,868 Epoch 127 Step: 310200 Batch Loss: 1.004184 Tokens per Sec: 21998, Lr: 0.000025 2020-02-13 02:12:38,941 Epoch 127 Step: 310300 Batch Loss: 1.157527 Tokens per Sec: 21941, Lr: 0.000025 2020-02-13 02:12:49,095 Epoch 127 Step: 310400 Batch Loss: 1.264614 Tokens per Sec: 22214, Lr: 0.000025 2020-02-13 02:12:59,255 Epoch 127 Step: 310500 Batch Loss: 1.349729 Tokens per Sec: 21527, Lr: 0.000025 2020-02-13 02:13:09,209 Epoch 127 Step: 310600 Batch Loss: 1.107174 Tokens per Sec: 21676, Lr: 0.000025 2020-02-13 02:13:19,216 Epoch 127 Step: 310700 Batch Loss: 1.340088 Tokens per Sec: 21983, Lr: 0.000025 2020-02-13 02:13:29,236 Epoch 127 Step: 310800 Batch Loss: 1.071440 Tokens per Sec: 22498, Lr: 0.000025 2020-02-13 02:13:39,300 Epoch 127 Step: 310900 Batch Loss: 1.151200 Tokens per Sec: 21727, Lr: 0.000025 2020-02-13 02:13:49,365 Epoch 127 Step: 311000 Batch Loss: 1.233940 Tokens per Sec: 22119, Lr: 0.000025 2020-02-13 02:14:08,875 Example #0 2020-02-13 02:14:08,875 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 02:14:08,876 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'her', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 02:14:08,876 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 02:14:08,876 Reference: 10 : ​ 6 - 9 . 2020-02-13 02:14:08,876 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu hen atô ve la her shi vea za hemen u lun a dooshima u a lu her la her . — Marku 10 : 6 - 9 . 2020-02-13 02:14:08,876 Example #1 2020-02-13 02:14:08,876 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 02:14:08,876 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 02:14:08,876 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 02:14:08,876 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 02:14:08,876 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 02:14:08,876 Example #2 2020-02-13 02:14:08,876 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 02:14:08,876 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 02:14:08,876 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 02:14:08,876 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 02:14:08,877 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 02:14:08,877 Example #3 2020-02-13 02:14:08,877 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 02:14:08,877 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-13 02:14:08,877 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 02:14:08,877 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 02:14:08,877 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-13 02:14:08,877 Validation result (greedy) at epoch 127, step 311000: bleu: 29.96, loss: 39050.9609, ppl: 3.7401, duration: 19.5116s 2020-02-13 02:14:18,951 Epoch 127 Step: 311100 Batch Loss: 1.029879 Tokens per Sec: 21771, Lr: 0.000025 2020-02-13 02:14:29,043 Epoch 127 Step: 311200 Batch Loss: 1.334941 Tokens per Sec: 21476, Lr: 0.000025 2020-02-13 02:14:39,168 Epoch 127 Step: 311300 Batch Loss: 1.284095 Tokens per Sec: 21885, Lr: 0.000025 2020-02-13 02:14:49,391 Epoch 127 Step: 311400 Batch Loss: 1.159360 Tokens per Sec: 21358, Lr: 0.000025 2020-02-13 02:14:59,510 Epoch 127 Step: 311500 Batch Loss: 1.143971 Tokens per Sec: 21916, Lr: 0.000025 2020-02-13 02:15:09,568 Epoch 127 Step: 311600 Batch Loss: 1.354012 Tokens per Sec: 21583, Lr: 0.000025 2020-02-13 02:15:19,604 Epoch 127 Step: 311700 Batch Loss: 1.381679 Tokens per Sec: 21843, Lr: 0.000025 2020-02-13 02:15:29,583 Epoch 127 Step: 311800 Batch Loss: 1.303959 Tokens per Sec: 21953, Lr: 0.000025 2020-02-13 02:15:39,794 Epoch 127 Step: 311900 Batch Loss: 1.151879 Tokens per Sec: 22102, Lr: 0.000025 2020-02-13 02:15:49,837 Epoch 127 Step: 312000 Batch Loss: 1.168875 Tokens per Sec: 22070, Lr: 0.000025 2020-02-13 02:16:09,124 Example #0 2020-02-13 02:16:09,124 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 02:16:09,125 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'vesen', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 02:16:09,125 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 02:16:09,125 Reference: 10 : ​ 6 - 9 . 2020-02-13 02:16:09,125 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu hen atô ve la her shi vea za hemen u lun a dooshima u a lu vesen la her . — Marku 10 : 6 - 9 . 2020-02-13 02:16:09,125 Example #1 2020-02-13 02:16:09,125 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 02:16:09,125 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 02:16:09,125 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 02:16:09,125 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 02:16:09,125 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 02:16:09,125 Example #2 2020-02-13 02:16:09,125 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 02:16:09,125 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 02:16:09,125 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 02:16:09,125 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 02:16:09,126 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 02:16:09,126 Example #3 2020-02-13 02:16:09,126 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 02:16:09,126 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-13 02:16:09,126 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 02:16:09,126 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 02:16:09,126 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-13 02:16:09,126 Validation result (greedy) at epoch 127, step 312000: bleu: 30.15, loss: 39070.3984, ppl: 3.7426, duration: 19.2883s 2020-02-13 02:16:19,071 Epoch 127 Step: 312100 Batch Loss: 1.299254 Tokens per Sec: 22826, Lr: 0.000025 2020-02-13 02:16:28,995 Epoch 127 Step: 312200 Batch Loss: 1.091593 Tokens per Sec: 22733, Lr: 0.000025 2020-02-13 02:16:35,188 Epoch 127: total training loss 3037.74 2020-02-13 02:16:35,188 EPOCH 128 2020-02-13 02:16:39,089 Epoch 128 Step: 312300 Batch Loss: 1.259056 Tokens per Sec: 20475, Lr: 0.000025 2020-02-13 02:16:49,045 Epoch 128 Step: 312400 Batch Loss: 1.304222 Tokens per Sec: 22612, Lr: 0.000025 2020-02-13 02:16:58,964 Epoch 128 Step: 312500 Batch Loss: 1.117184 Tokens per Sec: 21918, Lr: 0.000025 2020-02-13 02:17:09,070 Epoch 128 Step: 312600 Batch Loss: 1.269048 Tokens per Sec: 21831, Lr: 0.000025 2020-02-13 02:17:19,023 Epoch 128 Step: 312700 Batch Loss: 1.078515 Tokens per Sec: 22482, Lr: 0.000025 2020-02-13 02:17:28,954 Epoch 128 Step: 312800 Batch Loss: 1.290655 Tokens per Sec: 22222, Lr: 0.000025 2020-02-13 02:17:38,878 Epoch 128 Step: 312900 Batch Loss: 1.261813 Tokens per Sec: 22506, Lr: 0.000025 2020-02-13 02:17:48,840 Epoch 128 Step: 313000 Batch Loss: 1.063553 Tokens per Sec: 21756, Lr: 0.000025 2020-02-13 02:18:07,867 Example #0 2020-02-13 02:18:07,867 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 02:18:07,867 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 02:18:07,867 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 02:18:07,867 Reference: 10 : ​ 6 - 9 . 2020-02-13 02:18:07,867 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 02:18:07,867 Example #1 2020-02-13 02:18:07,867 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 02:18:07,867 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 02:18:07,867 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 02:18:07,867 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 02:18:07,867 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 02:18:07,868 Example #2 2020-02-13 02:18:07,868 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 02:18:07,868 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 02:18:07,868 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 02:18:07,868 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 02:18:07,868 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 02:18:07,868 Example #3 2020-02-13 02:18:07,868 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 02:18:07,868 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-13 02:18:07,868 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 02:18:07,868 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 02:18:07,868 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-13 02:18:07,868 Validation result (greedy) at epoch 128, step 313000: bleu: 30.15, loss: 39074.7930, ppl: 3.7431, duration: 19.0277s 2020-02-13 02:18:17,827 Epoch 128 Step: 313100 Batch Loss: 1.355501 Tokens per Sec: 22525, Lr: 0.000025 2020-02-13 02:18:27,942 Epoch 128 Step: 313200 Batch Loss: 1.290354 Tokens per Sec: 22345, Lr: 0.000025 2020-02-13 02:18:37,809 Epoch 128 Step: 313300 Batch Loss: 1.112706 Tokens per Sec: 22162, Lr: 0.000025 2020-02-13 02:18:47,791 Epoch 128 Step: 313400 Batch Loss: 1.170797 Tokens per Sec: 22062, Lr: 0.000025 2020-02-13 02:18:57,759 Epoch 128 Step: 313500 Batch Loss: 1.295845 Tokens per Sec: 21777, Lr: 0.000025 2020-02-13 02:19:07,882 Epoch 128 Step: 313600 Batch Loss: 1.358825 Tokens per Sec: 21627, Lr: 0.000025 2020-02-13 02:19:18,017 Epoch 128 Step: 313700 Batch Loss: 1.263037 Tokens per Sec: 21529, Lr: 0.000025 2020-02-13 02:19:28,005 Epoch 128 Step: 313800 Batch Loss: 1.278469 Tokens per Sec: 22371, Lr: 0.000025 2020-02-13 02:19:38,115 Epoch 128 Step: 313900 Batch Loss: 1.274630 Tokens per Sec: 22157, Lr: 0.000025 2020-02-13 02:19:48,099 Epoch 128 Step: 314000 Batch Loss: 1.356524 Tokens per Sec: 22382, Lr: 0.000025 2020-02-13 02:20:06,746 Example #0 2020-02-13 02:20:06,746 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 02:20:06,746 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 02:20:06,747 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 02:20:06,747 Reference: 10 : ​ 6 - 9 . 2020-02-13 02:20:06,747 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 02:20:06,747 Example #1 2020-02-13 02:20:06,747 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 02:20:06,747 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 02:20:06,747 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 02:20:06,747 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 02:20:06,747 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 02:20:06,747 Example #2 2020-02-13 02:20:06,747 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 02:20:06,747 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 02:20:06,747 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 02:20:06,747 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 02:20:06,747 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 02:20:06,748 Example #3 2020-02-13 02:20:06,748 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 02:20:06,748 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-13 02:20:06,748 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 02:20:06,748 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 02:20:06,748 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-13 02:20:06,748 Validation result (greedy) at epoch 128, step 314000: bleu: 30.05, loss: 39054.6875, ppl: 3.7406, duration: 18.6485s 2020-02-13 02:20:16,688 Epoch 128 Step: 314100 Batch Loss: 1.201128 Tokens per Sec: 22357, Lr: 0.000017 2020-02-13 02:20:26,578 Epoch 128 Step: 314200 Batch Loss: 1.309206 Tokens per Sec: 21611, Lr: 0.000017 2020-02-13 02:20:36,492 Epoch 128 Step: 314300 Batch Loss: 1.368574 Tokens per Sec: 22466, Lr: 0.000017 2020-02-13 02:20:46,480 Epoch 128 Step: 314400 Batch Loss: 1.313216 Tokens per Sec: 22256, Lr: 0.000017 2020-02-13 02:20:56,628 Epoch 128 Step: 314500 Batch Loss: 1.311305 Tokens per Sec: 21844, Lr: 0.000017 2020-02-13 02:21:06,684 Epoch 128 Step: 314600 Batch Loss: 1.374086 Tokens per Sec: 21801, Lr: 0.000017 2020-02-13 02:21:16,683 Epoch 128 Step: 314700 Batch Loss: 1.071430 Tokens per Sec: 22034, Lr: 0.000017 2020-02-13 02:21:19,131 Epoch 128: total training loss 3037.04 2020-02-13 02:21:19,131 EPOCH 129 2020-02-13 02:21:27,193 Epoch 129 Step: 314800 Batch Loss: 1.246944 Tokens per Sec: 20569, Lr: 0.000017 2020-02-13 02:21:37,267 Epoch 129 Step: 314900 Batch Loss: 0.950821 Tokens per Sec: 21947, Lr: 0.000017 2020-02-13 02:21:47,424 Epoch 129 Step: 315000 Batch Loss: 1.208312 Tokens per Sec: 21788, Lr: 0.000017 2020-02-13 02:22:06,704 Example #0 2020-02-13 02:22:06,704 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 02:22:06,704 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 02:22:06,704 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 02:22:06,704 Reference: 10 : ​ 6 - 9 . 2020-02-13 02:22:06,704 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 02:22:06,705 Example #1 2020-02-13 02:22:06,705 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 02:22:06,705 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 02:22:06,705 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 02:22:06,705 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 02:22:06,705 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 02:22:06,705 Example #2 2020-02-13 02:22:06,705 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 02:22:06,705 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 02:22:06,705 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 02:22:06,705 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 02:22:06,705 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 02:22:06,705 Example #3 2020-02-13 02:22:06,705 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 02:22:06,705 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-13 02:22:06,706 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 02:22:06,706 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 02:22:06,706 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-13 02:22:06,706 Validation result (greedy) at epoch 129, step 315000: bleu: 30.05, loss: 39044.0586, ppl: 3.7392, duration: 19.2816s 2020-02-13 02:22:16,611 Epoch 129 Step: 315100 Batch Loss: 1.070706 Tokens per Sec: 21922, Lr: 0.000017 2020-02-13 02:22:26,518 Epoch 129 Step: 315200 Batch Loss: 1.286344 Tokens per Sec: 22581, Lr: 0.000017 2020-02-13 02:22:36,429 Epoch 129 Step: 315300 Batch Loss: 1.380446 Tokens per Sec: 22228, Lr: 0.000017 2020-02-13 02:22:46,350 Epoch 129 Step: 315400 Batch Loss: 1.153335 Tokens per Sec: 21641, Lr: 0.000017 2020-02-13 02:22:56,292 Epoch 129 Step: 315500 Batch Loss: 1.326963 Tokens per Sec: 22415, Lr: 0.000017 2020-02-13 02:23:06,223 Epoch 129 Step: 315600 Batch Loss: 1.310209 Tokens per Sec: 22954, Lr: 0.000017 2020-02-13 02:23:16,292 Epoch 129 Step: 315700 Batch Loss: 1.035847 Tokens per Sec: 21126, Lr: 0.000017 2020-02-13 02:23:26,464 Epoch 129 Step: 315800 Batch Loss: 1.262007 Tokens per Sec: 21508, Lr: 0.000017 2020-02-13 02:23:36,412 Epoch 129 Step: 315900 Batch Loss: 1.177509 Tokens per Sec: 22203, Lr: 0.000017 2020-02-13 02:23:46,346 Epoch 129 Step: 316000 Batch Loss: 1.276114 Tokens per Sec: 21964, Lr: 0.000017 2020-02-13 02:24:05,775 Example #0 2020-02-13 02:24:05,775 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 02:24:05,775 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 02:24:05,775 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 02:24:05,775 Reference: 10 : ​ 6 - 9 . 2020-02-13 02:24:05,775 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 02:24:05,775 Example #1 2020-02-13 02:24:05,776 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 02:24:05,776 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 02:24:05,776 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 02:24:05,776 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 02:24:05,776 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 02:24:05,776 Example #2 2020-02-13 02:24:05,776 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 02:24:05,776 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 02:24:05,776 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 02:24:05,776 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 02:24:05,776 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 02:24:05,776 Example #3 2020-02-13 02:24:05,776 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 02:24:05,777 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-13 02:24:05,777 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 02:24:05,777 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 02:24:05,777 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-13 02:24:05,777 Validation result (greedy) at epoch 129, step 316000: bleu: 30.13, loss: 39043.2656, ppl: 3.7391, duration: 19.4297s 2020-02-13 02:24:15,844 Epoch 129 Step: 316100 Batch Loss: 1.219544 Tokens per Sec: 22634, Lr: 0.000017 2020-02-13 02:24:26,035 Epoch 129 Step: 316200 Batch Loss: 1.323922 Tokens per Sec: 21750, Lr: 0.000017 2020-02-13 02:24:35,998 Epoch 129 Step: 316300 Batch Loss: 1.300081 Tokens per Sec: 22793, Lr: 0.000017 2020-02-13 02:24:45,977 Epoch 129 Step: 316400 Batch Loss: 1.129371 Tokens per Sec: 21914, Lr: 0.000017 2020-02-13 02:24:56,031 Epoch 129 Step: 316500 Batch Loss: 1.230831 Tokens per Sec: 22530, Lr: 0.000017 2020-02-13 02:25:06,108 Epoch 129 Step: 316600 Batch Loss: 1.350072 Tokens per Sec: 21644, Lr: 0.000017 2020-02-13 02:25:16,106 Epoch 129 Step: 316700 Batch Loss: 1.286696 Tokens per Sec: 22450, Lr: 0.000017 2020-02-13 02:25:26,190 Epoch 129 Step: 316800 Batch Loss: 1.044339 Tokens per Sec: 21787, Lr: 0.000017 2020-02-13 02:25:36,269 Epoch 129 Step: 316900 Batch Loss: 1.103710 Tokens per Sec: 22134, Lr: 0.000017 2020-02-13 02:25:46,242 Epoch 129 Step: 317000 Batch Loss: 1.032398 Tokens per Sec: 21766, Lr: 0.000017 2020-02-13 02:26:05,149 Example #0 2020-02-13 02:26:05,149 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 02:26:05,149 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 02:26:05,149 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 02:26:05,149 Reference: 10 : ​ 6 - 9 . 2020-02-13 02:26:05,149 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 02:26:05,150 Example #1 2020-02-13 02:26:05,150 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 02:26:05,150 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 02:26:05,150 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 02:26:05,150 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 02:26:05,150 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 02:26:05,150 Example #2 2020-02-13 02:26:05,150 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 02:26:05,150 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 02:26:05,150 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 02:26:05,150 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 02:26:05,150 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 02:26:05,150 Example #3 2020-02-13 02:26:05,150 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 02:26:05,150 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-13 02:26:05,150 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 02:26:05,151 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 02:26:05,151 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-13 02:26:05,151 Validation result (greedy) at epoch 129, step 317000: bleu: 30.05, loss: 39033.9414, ppl: 3.7379, duration: 18.9080s 2020-02-13 02:26:15,141 Epoch 129 Step: 317100 Batch Loss: 1.331119 Tokens per Sec: 22154, Lr: 0.000017 2020-02-13 02:26:23,374 Epoch 129: total training loss 3030.75 2020-02-13 02:26:23,374 EPOCH 130 2020-02-13 02:26:25,450 Epoch 130 Step: 317200 Batch Loss: 1.339214 Tokens per Sec: 20229, Lr: 0.000017 2020-02-13 02:26:35,385 Epoch 130 Step: 317300 Batch Loss: 1.313796 Tokens per Sec: 22068, Lr: 0.000017 2020-02-13 02:26:45,350 Epoch 130 Step: 317400 Batch Loss: 1.331680 Tokens per Sec: 22588, Lr: 0.000017 2020-02-13 02:26:55,327 Epoch 130 Step: 317500 Batch Loss: 1.425030 Tokens per Sec: 22059, Lr: 0.000017 2020-02-13 02:27:05,297 Epoch 130 Step: 317600 Batch Loss: 1.112592 Tokens per Sec: 21951, Lr: 0.000017 2020-02-13 02:27:15,431 Epoch 130 Step: 317700 Batch Loss: 1.059142 Tokens per Sec: 22011, Lr: 0.000017 2020-02-13 02:27:25,532 Epoch 130 Step: 317800 Batch Loss: 1.104029 Tokens per Sec: 21593, Lr: 0.000017 2020-02-13 02:27:35,588 Epoch 130 Step: 317900 Batch Loss: 1.299753 Tokens per Sec: 22112, Lr: 0.000017 2020-02-13 02:27:45,513 Epoch 130 Step: 318000 Batch Loss: 1.258987 Tokens per Sec: 22231, Lr: 0.000017 2020-02-13 02:28:04,327 Example #0 2020-02-13 02:28:04,327 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 02:28:04,328 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 02:28:04,328 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 02:28:04,328 Reference: 10 : ​ 6 - 9 . 2020-02-13 02:28:04,328 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 02:28:04,328 Example #1 2020-02-13 02:28:04,328 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 02:28:04,328 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 02:28:04,328 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 02:28:04,328 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 02:28:04,328 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 02:28:04,328 Example #2 2020-02-13 02:28:04,328 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 02:28:04,328 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 02:28:04,329 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 02:28:04,329 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 02:28:04,329 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 02:28:04,329 Example #3 2020-02-13 02:28:04,329 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 02:28:04,329 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-13 02:28:04,329 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 02:28:04,329 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 02:28:04,329 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-13 02:28:04,329 Validation result (greedy) at epoch 130, step 318000: bleu: 29.98, loss: 39037.8438, ppl: 3.7384, duration: 18.8153s 2020-02-13 02:28:14,179 Epoch 130 Step: 318100 Batch Loss: 1.236388 Tokens per Sec: 22497, Lr: 0.000017 2020-02-13 02:28:24,047 Epoch 130 Step: 318200 Batch Loss: 1.317045 Tokens per Sec: 21859, Lr: 0.000017 2020-02-13 02:28:33,943 Epoch 130 Step: 318300 Batch Loss: 1.344335 Tokens per Sec: 22329, Lr: 0.000017 2020-02-13 02:28:43,812 Epoch 130 Step: 318400 Batch Loss: 1.283267 Tokens per Sec: 22121, Lr: 0.000017 2020-02-13 02:28:53,750 Epoch 130 Step: 318500 Batch Loss: 1.327713 Tokens per Sec: 22477, Lr: 0.000017 2020-02-13 02:29:03,683 Epoch 130 Step: 318600 Batch Loss: 1.020413 Tokens per Sec: 22100, Lr: 0.000017 2020-02-13 02:29:13,603 Epoch 130 Step: 318700 Batch Loss: 1.262169 Tokens per Sec: 22602, Lr: 0.000017 2020-02-13 02:29:23,466 Epoch 130 Step: 318800 Batch Loss: 1.211724 Tokens per Sec: 22525, Lr: 0.000017 2020-02-13 02:29:33,334 Epoch 130 Step: 318900 Batch Loss: 0.883758 Tokens per Sec: 22217, Lr: 0.000017 2020-02-13 02:29:43,274 Epoch 130 Step: 319000 Batch Loss: 1.108618 Tokens per Sec: 22508, Lr: 0.000017 2020-02-13 02:30:02,345 Example #0 2020-02-13 02:30:02,345 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 02:30:02,345 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 02:30:02,345 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 02:30:02,346 Reference: 10 : ​ 6 - 9 . 2020-02-13 02:30:02,346 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 02:30:02,346 Example #1 2020-02-13 02:30:02,346 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 02:30:02,346 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 02:30:02,346 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 02:30:02,346 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 02:30:02,346 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 02:30:02,346 Example #2 2020-02-13 02:30:02,346 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 02:30:02,346 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 02:30:02,346 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 02:30:02,346 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 02:30:02,346 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 02:30:02,346 Example #3 2020-02-13 02:30:02,347 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 02:30:02,347 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-13 02:30:02,347 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 02:30:02,347 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 02:30:02,347 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-13 02:30:02,347 Validation result (greedy) at epoch 130, step 319000: bleu: 30.07, loss: 39045.0781, ppl: 3.7394, duration: 19.0724s 2020-02-13 02:30:12,223 Epoch 130 Step: 319100 Batch Loss: 1.135671 Tokens per Sec: 23074, Lr: 0.000017 2020-02-13 02:30:22,328 Epoch 130 Step: 319200 Batch Loss: 1.286298 Tokens per Sec: 21567, Lr: 0.000017 2020-02-13 02:30:32,386 Epoch 130 Step: 319300 Batch Loss: 1.257099 Tokens per Sec: 21800, Lr: 0.000017 2020-02-13 02:30:42,428 Epoch 130 Step: 319400 Batch Loss: 1.081523 Tokens per Sec: 21402, Lr: 0.000017 2020-02-13 02:30:52,518 Epoch 130 Step: 319500 Batch Loss: 1.134164 Tokens per Sec: 21679, Lr: 0.000017 2020-02-13 02:31:02,466 Epoch 130 Step: 319600 Batch Loss: 1.117155 Tokens per Sec: 22710, Lr: 0.000017 2020-02-13 02:31:06,548 Epoch 130: total training loss 3028.94 2020-02-13 02:31:06,549 EPOCH 131 2020-02-13 02:31:12,668 Epoch 131 Step: 319700 Batch Loss: 1.275932 Tokens per Sec: 21532, Lr: 0.000017 2020-02-13 02:31:22,521 Epoch 131 Step: 319800 Batch Loss: 1.268711 Tokens per Sec: 22063, Lr: 0.000017 2020-02-13 02:31:32,391 Epoch 131 Step: 319900 Batch Loss: 1.377063 Tokens per Sec: 22529, Lr: 0.000017 2020-02-13 02:31:42,334 Epoch 131 Step: 320000 Batch Loss: 1.337518 Tokens per Sec: 22103, Lr: 0.000017 2020-02-13 02:32:01,802 Example #0 2020-02-13 02:32:01,802 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 02:32:01,802 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'kura', 'dooshima', 've', 'la', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 02:32:01,802 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 02:32:01,803 Reference: 10 : ​ 6 - 9 . 2020-02-13 02:32:01,803 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea kura dooshima ve la shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 02:32:01,803 Example #1 2020-02-13 02:32:01,803 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 02:32:01,803 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 02:32:01,803 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 02:32:01,803 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 02:32:01,803 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 02:32:01,803 Example #2 2020-02-13 02:32:01,803 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 02:32:01,803 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 02:32:01,803 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 02:32:01,803 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 02:32:01,803 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 02:32:01,803 Example #3 2020-02-13 02:32:01,804 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 02:32:01,804 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-13 02:32:01,804 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 02:32:01,804 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 02:32:01,804 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-13 02:32:01,804 Validation result (greedy) at epoch 131, step 320000: bleu: 30.17, loss: 39046.4375, ppl: 3.7395, duration: 19.4696s 2020-02-13 02:32:11,864 Epoch 131 Step: 320100 Batch Loss: 1.289699 Tokens per Sec: 22137, Lr: 0.000012 2020-02-13 02:32:21,702 Epoch 131 Step: 320200 Batch Loss: 1.196697 Tokens per Sec: 21962, Lr: 0.000012 2020-02-13 02:32:31,595 Epoch 131 Step: 320300 Batch Loss: 1.423687 Tokens per Sec: 22484, Lr: 0.000012 2020-02-13 02:32:41,543 Epoch 131 Step: 320400 Batch Loss: 1.242102 Tokens per Sec: 22448, Lr: 0.000012 2020-02-13 02:32:51,624 Epoch 131 Step: 320500 Batch Loss: 1.236165 Tokens per Sec: 21568, Lr: 0.000012 2020-02-13 02:33:01,672 Epoch 131 Step: 320600 Batch Loss: 1.144948 Tokens per Sec: 22183, Lr: 0.000012 2020-02-13 02:33:11,589 Epoch 131 Step: 320700 Batch Loss: 0.997838 Tokens per Sec: 21404, Lr: 0.000012 2020-02-13 02:33:21,643 Epoch 131 Step: 320800 Batch Loss: 1.052424 Tokens per Sec: 21997, Lr: 0.000012 2020-02-13 02:33:31,555 Epoch 131 Step: 320900 Batch Loss: 1.264707 Tokens per Sec: 22338, Lr: 0.000012 2020-02-13 02:33:41,458 Epoch 131 Step: 321000 Batch Loss: 1.188874 Tokens per Sec: 21798, Lr: 0.000012 2020-02-13 02:34:00,582 Hooray! New best validation result [ppl]! 2020-02-13 02:34:00,582 Saving new checkpoint. 2020-02-13 02:34:00,779 Example #0 2020-02-13 02:34:00,779 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 02:34:00,779 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 02:34:00,779 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 02:34:00,779 Reference: 10 : ​ 6 - 9 . 2020-02-13 02:34:00,779 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 02:34:00,780 Example #1 2020-02-13 02:34:00,780 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 02:34:00,780 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 02:34:00,780 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 02:34:00,780 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 02:34:00,780 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 02:34:00,780 Example #2 2020-02-13 02:34:00,780 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 02:34:00,781 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 02:34:00,781 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 02:34:00,781 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 02:34:00,781 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 02:34:00,781 Example #3 2020-02-13 02:34:00,781 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 02:34:00,781 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-13 02:34:00,781 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 02:34:00,781 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 02:34:00,781 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-13 02:34:00,781 Validation result (greedy) at epoch 131, step 321000: bleu: 30.06, loss: 39020.6602, ppl: 3.7363, duration: 19.3229s 2020-02-13 02:34:10,742 Epoch 131 Step: 321100 Batch Loss: 1.017493 Tokens per Sec: 22533, Lr: 0.000012 2020-02-13 02:34:20,710 Epoch 131 Step: 321200 Batch Loss: 1.203030 Tokens per Sec: 22205, Lr: 0.000012 2020-02-13 02:34:30,582 Epoch 131 Step: 321300 Batch Loss: 1.205485 Tokens per Sec: 22292, Lr: 0.000012 2020-02-13 02:34:40,404 Epoch 131 Step: 321400 Batch Loss: 1.431243 Tokens per Sec: 22012, Lr: 0.000012 2020-02-13 02:34:50,295 Epoch 131 Step: 321500 Batch Loss: 1.248143 Tokens per Sec: 22021, Lr: 0.000012 2020-02-13 02:35:00,105 Epoch 131 Step: 321600 Batch Loss: 1.074087 Tokens per Sec: 23061, Lr: 0.000012 2020-02-13 02:35:10,019 Epoch 131 Step: 321700 Batch Loss: 1.331015 Tokens per Sec: 22390, Lr: 0.000012 2020-02-13 02:35:19,953 Epoch 131 Step: 321800 Batch Loss: 1.232699 Tokens per Sec: 22613, Lr: 0.000012 2020-02-13 02:35:30,033 Epoch 131 Step: 321900 Batch Loss: 1.190254 Tokens per Sec: 21986, Lr: 0.000012 2020-02-13 02:35:40,053 Epoch 131 Step: 322000 Batch Loss: 1.348868 Tokens per Sec: 22171, Lr: 0.000012 2020-02-13 02:35:58,918 Example #0 2020-02-13 02:35:58,918 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 02:35:58,918 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 02:35:58,919 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 02:35:58,919 Reference: 10 : ​ 6 - 9 . 2020-02-13 02:35:58,919 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 02:35:58,919 Example #1 2020-02-13 02:35:58,919 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 02:35:58,919 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 02:35:58,919 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 02:35:58,919 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 02:35:58,919 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 02:35:58,919 Example #2 2020-02-13 02:35:58,919 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 02:35:58,919 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 02:35:58,919 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 02:35:58,919 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 02:35:58,919 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 02:35:58,920 Example #3 2020-02-13 02:35:58,920 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 02:35:58,920 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-13 02:35:58,920 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 02:35:58,920 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 02:35:58,920 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-13 02:35:58,920 Validation result (greedy) at epoch 131, step 322000: bleu: 30.16, loss: 39039.7070, ppl: 3.7387, duration: 18.8667s 2020-02-13 02:36:08,785 Epoch 131 Step: 322100 Batch Loss: 1.313927 Tokens per Sec: 22415, Lr: 0.000012 2020-02-13 02:36:09,282 Epoch 131: total training loss 3032.52 2020-02-13 02:36:09,282 EPOCH 132 2020-02-13 02:36:18,963 Epoch 132 Step: 322200 Batch Loss: 1.363723 Tokens per Sec: 22051, Lr: 0.000012 2020-02-13 02:36:28,951 Epoch 132 Step: 322300 Batch Loss: 1.285845 Tokens per Sec: 22155, Lr: 0.000012 2020-02-13 02:36:38,980 Epoch 132 Step: 322400 Batch Loss: 1.292724 Tokens per Sec: 21896, Lr: 0.000012 2020-02-13 02:36:49,032 Epoch 132 Step: 322500 Batch Loss: 1.342407 Tokens per Sec: 21741, Lr: 0.000012 2020-02-13 02:36:58,948 Epoch 132 Step: 322600 Batch Loss: 1.350160 Tokens per Sec: 22291, Lr: 0.000012 2020-02-13 02:37:08,882 Epoch 132 Step: 322700 Batch Loss: 1.219082 Tokens per Sec: 21826, Lr: 0.000012 2020-02-13 02:37:18,765 Epoch 132 Step: 322800 Batch Loss: 1.395606 Tokens per Sec: 22066, Lr: 0.000012 2020-02-13 02:37:28,689 Epoch 132 Step: 322900 Batch Loss: 1.394762 Tokens per Sec: 22317, Lr: 0.000012 2020-02-13 02:37:38,779 Epoch 132 Step: 323000 Batch Loss: 1.269937 Tokens per Sec: 21530, Lr: 0.000012 2020-02-13 02:37:59,066 Hooray! New best validation result [ppl]! 2020-02-13 02:37:59,067 Saving new checkpoint. 2020-02-13 02:37:59,259 Example #0 2020-02-13 02:37:59,259 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 02:37:59,259 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 02:37:59,259 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 02:37:59,259 Reference: 10 : ​ 6 - 9 . 2020-02-13 02:37:59,259 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 02:37:59,259 Example #1 2020-02-13 02:37:59,259 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 02:37:59,259 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 02:37:59,259 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 02:37:59,259 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 02:37:59,260 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 02:37:59,260 Example #2 2020-02-13 02:37:59,260 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 02:37:59,260 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 02:37:59,260 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 02:37:59,260 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 02:37:59,260 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 02:37:59,260 Example #3 2020-02-13 02:37:59,260 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 02:37:59,260 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-13 02:37:59,260 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 02:37:59,260 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 02:37:59,260 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-13 02:37:59,261 Validation result (greedy) at epoch 132, step 323000: bleu: 30.25, loss: 39015.0273, ppl: 3.7356, duration: 20.4805s 2020-02-13 02:38:09,458 Epoch 132 Step: 323100 Batch Loss: 1.121644 Tokens per Sec: 21832, Lr: 0.000012 2020-02-13 02:38:19,602 Epoch 132 Step: 323200 Batch Loss: 1.126626 Tokens per Sec: 21773, Lr: 0.000012 2020-02-13 02:38:29,572 Epoch 132 Step: 323300 Batch Loss: 1.205503 Tokens per Sec: 22136, Lr: 0.000012 2020-02-13 02:38:39,516 Epoch 132 Step: 323400 Batch Loss: 1.145078 Tokens per Sec: 22352, Lr: 0.000012 2020-02-13 02:38:49,529 Epoch 132 Step: 323500 Batch Loss: 1.342141 Tokens per Sec: 22689, Lr: 0.000012 2020-02-13 02:38:59,438 Epoch 132 Step: 323600 Batch Loss: 1.162364 Tokens per Sec: 22531, Lr: 0.000012 2020-02-13 02:39:09,358 Epoch 132 Step: 323700 Batch Loss: 1.033106 Tokens per Sec: 22310, Lr: 0.000012 2020-02-13 02:39:19,320 Epoch 132 Step: 323800 Batch Loss: 1.224700 Tokens per Sec: 22271, Lr: 0.000012 2020-02-13 02:39:29,505 Epoch 132 Step: 323900 Batch Loss: 1.251616 Tokens per Sec: 21386, Lr: 0.000012 2020-02-13 02:39:39,602 Epoch 132 Step: 324000 Batch Loss: 1.331135 Tokens per Sec: 21766, Lr: 0.000012 2020-02-13 02:39:59,471 Example #0 2020-02-13 02:39:59,472 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 02:39:59,472 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'her', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 02:39:59,472 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 02:39:59,472 Reference: 10 : ​ 6 - 9 . 2020-02-13 02:39:59,472 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu hen atô ve la her shi vea za hemen u lun a dooshima u a lu her la her . — Marku 10 : 6 - 9 . 2020-02-13 02:39:59,472 Example #1 2020-02-13 02:39:59,472 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 02:39:59,472 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 02:39:59,472 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 02:39:59,472 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 02:39:59,472 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 02:39:59,472 Example #2 2020-02-13 02:39:59,472 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 02:39:59,472 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 02:39:59,473 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 02:39:59,473 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 02:39:59,473 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 02:39:59,473 Example #3 2020-02-13 02:39:59,473 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 02:39:59,473 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-13 02:39:59,473 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 02:39:59,473 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 02:39:59,473 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-13 02:39:59,473 Validation result (greedy) at epoch 132, step 324000: bleu: 30.17, loss: 39021.3750, ppl: 3.7364, duration: 19.8709s 2020-02-13 02:40:09,627 Epoch 132 Step: 324100 Batch Loss: 1.301186 Tokens per Sec: 21646, Lr: 0.000012 2020-02-13 02:40:19,482 Epoch 132 Step: 324200 Batch Loss: 1.308699 Tokens per Sec: 22047, Lr: 0.000012 2020-02-13 02:40:29,431 Epoch 132 Step: 324300 Batch Loss: 1.278895 Tokens per Sec: 22446, Lr: 0.000012 2020-02-13 02:40:39,402 Epoch 132 Step: 324400 Batch Loss: 0.983386 Tokens per Sec: 22553, Lr: 0.000012 2020-02-13 02:40:49,545 Epoch 132 Step: 324500 Batch Loss: 0.990579 Tokens per Sec: 21667, Lr: 0.000012 2020-02-13 02:40:56,034 Epoch 132: total training loss 3025.25 2020-02-13 02:40:56,035 EPOCH 133 2020-02-13 02:40:59,917 Epoch 133 Step: 324600 Batch Loss: 0.933766 Tokens per Sec: 20433, Lr: 0.000012 2020-02-13 02:41:09,894 Epoch 133 Step: 324700 Batch Loss: 1.274499 Tokens per Sec: 22562, Lr: 0.000012 2020-02-13 02:41:19,823 Epoch 133 Step: 324800 Batch Loss: 1.209333 Tokens per Sec: 22173, Lr: 0.000012 2020-02-13 02:41:29,805 Epoch 133 Step: 324900 Batch Loss: 1.175129 Tokens per Sec: 21979, Lr: 0.000012 2020-02-13 02:41:39,712 Epoch 133 Step: 325000 Batch Loss: 1.338600 Tokens per Sec: 22347, Lr: 0.000012 2020-02-13 02:41:58,815 Example #0 2020-02-13 02:41:58,815 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 02:41:58,815 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 02:41:58,815 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 02:41:58,815 Reference: 10 : ​ 6 - 9 . 2020-02-13 02:41:58,815 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 02:41:58,815 Example #1 2020-02-13 02:41:58,815 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 02:41:58,815 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 02:41:58,815 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 02:41:58,815 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 02:41:58,815 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 02:41:58,816 Example #2 2020-02-13 02:41:58,816 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 02:41:58,816 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 02:41:58,816 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 02:41:58,816 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 02:41:58,816 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 02:41:58,816 Example #3 2020-02-13 02:41:58,816 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 02:41:58,816 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-13 02:41:58,816 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 02:41:58,816 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 02:41:58,816 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-13 02:41:58,816 Validation result (greedy) at epoch 133, step 325000: bleu: 30.14, loss: 39038.2852, ppl: 3.7385, duration: 19.1041s 2020-02-13 02:42:08,843 Epoch 133 Step: 325100 Batch Loss: 1.279643 Tokens per Sec: 21593, Lr: 0.000012 2020-02-13 02:42:18,872 Epoch 133 Step: 325200 Batch Loss: 1.297185 Tokens per Sec: 21980, Lr: 0.000012 2020-02-13 02:42:29,032 Epoch 133 Step: 325300 Batch Loss: 1.138721 Tokens per Sec: 21489, Lr: 0.000012 2020-02-13 02:42:39,158 Epoch 133 Step: 325400 Batch Loss: 1.310227 Tokens per Sec: 22454, Lr: 0.000012 2020-02-13 02:42:49,145 Epoch 133 Step: 325500 Batch Loss: 1.263884 Tokens per Sec: 21598, Lr: 0.000012 2020-02-13 02:42:59,092 Epoch 133 Step: 325600 Batch Loss: 1.172676 Tokens per Sec: 22156, Lr: 0.000012 2020-02-13 02:43:09,078 Epoch 133 Step: 325700 Batch Loss: 1.327940 Tokens per Sec: 21946, Lr: 0.000012 2020-02-13 02:43:19,183 Epoch 133 Step: 325800 Batch Loss: 1.054770 Tokens per Sec: 22492, Lr: 0.000012 2020-02-13 02:43:29,152 Epoch 133 Step: 325900 Batch Loss: 1.105679 Tokens per Sec: 22477, Lr: 0.000012 2020-02-13 02:43:39,138 Epoch 133 Step: 326000 Batch Loss: 1.200364 Tokens per Sec: 22183, Lr: 0.000012 2020-02-13 02:43:58,141 Hooray! New best validation result [ppl]! 2020-02-13 02:43:58,142 Saving new checkpoint. 2020-02-13 02:43:58,332 Example #0 2020-02-13 02:43:58,332 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 02:43:58,332 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 02:43:58,332 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 02:43:58,332 Reference: 10 : ​ 6 - 9 . 2020-02-13 02:43:58,332 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 02:43:58,332 Example #1 2020-02-13 02:43:58,332 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 02:43:58,333 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 02:43:58,333 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 02:43:58,333 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 02:43:58,333 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 02:43:58,333 Example #2 2020-02-13 02:43:58,333 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 02:43:58,333 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 02:43:58,333 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 02:43:58,333 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 02:43:58,333 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 02:43:58,333 Example #3 2020-02-13 02:43:58,333 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 02:43:58,333 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-13 02:43:58,333 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 02:43:58,333 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 02:43:58,333 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-13 02:43:58,334 Validation result (greedy) at epoch 133, step 326000: bleu: 30.17, loss: 39009.5742, ppl: 3.7349, duration: 19.1954s 2020-02-13 02:44:08,276 Epoch 133 Step: 326100 Batch Loss: 1.146162 Tokens per Sec: 22409, Lr: 0.000012 2020-02-13 02:44:18,323 Epoch 133 Step: 326200 Batch Loss: 1.310506 Tokens per Sec: 22186, Lr: 0.000012 2020-02-13 02:44:28,255 Epoch 133 Step: 326300 Batch Loss: 1.341368 Tokens per Sec: 22231, Lr: 0.000012 2020-02-13 02:44:38,194 Epoch 133 Step: 326400 Batch Loss: 1.491352 Tokens per Sec: 21693, Lr: 0.000012 2020-02-13 02:44:48,171 Epoch 133 Step: 326500 Batch Loss: 1.068105 Tokens per Sec: 22055, Lr: 0.000012 2020-02-13 02:44:58,190 Epoch 133 Step: 326600 Batch Loss: 1.314122 Tokens per Sec: 22325, Lr: 0.000012 2020-02-13 02:45:08,242 Epoch 133 Step: 326700 Batch Loss: 1.324088 Tokens per Sec: 21794, Lr: 0.000012 2020-02-13 02:45:18,196 Epoch 133 Step: 326800 Batch Loss: 1.283971 Tokens per Sec: 22388, Lr: 0.000012 2020-02-13 02:45:28,286 Epoch 133 Step: 326900 Batch Loss: 1.406092 Tokens per Sec: 22218, Lr: 0.000012 2020-02-13 02:45:38,141 Epoch 133 Step: 327000 Batch Loss: 0.874778 Tokens per Sec: 22025, Lr: 0.000012 2020-02-13 02:45:57,080 Example #0 2020-02-13 02:45:57,080 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 02:45:57,080 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 02:45:57,080 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 02:45:57,080 Reference: 10 : ​ 6 - 9 . 2020-02-13 02:45:57,080 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 02:45:57,080 Example #1 2020-02-13 02:45:57,080 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 02:45:57,081 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 02:45:57,081 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 02:45:57,081 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 02:45:57,081 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 02:45:57,081 Example #2 2020-02-13 02:45:57,081 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 02:45:57,081 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 02:45:57,081 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 02:45:57,081 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 02:45:57,081 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 02:45:57,081 Example #3 2020-02-13 02:45:57,081 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 02:45:57,081 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-13 02:45:57,081 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 02:45:57,081 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 02:45:57,081 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-13 02:45:57,082 Validation result (greedy) at epoch 133, step 327000: bleu: 30.12, loss: 39018.3828, ppl: 3.7360, duration: 18.9397s 2020-02-13 02:45:59,268 Epoch 133: total training loss 3025.15 2020-02-13 02:45:59,268 EPOCH 134 2020-02-13 02:46:07,310 Epoch 134 Step: 327100 Batch Loss: 1.281626 Tokens per Sec: 21617, Lr: 0.000012 2020-02-13 02:46:17,325 Epoch 134 Step: 327200 Batch Loss: 1.120028 Tokens per Sec: 22766, Lr: 0.000012 2020-02-13 02:46:27,266 Epoch 134 Step: 327300 Batch Loss: 1.226529 Tokens per Sec: 22181, Lr: 0.000012 2020-02-13 02:46:37,191 Epoch 134 Step: 327400 Batch Loss: 1.432390 Tokens per Sec: 22159, Lr: 0.000012 2020-02-13 02:46:47,246 Epoch 134 Step: 327500 Batch Loss: 1.226054 Tokens per Sec: 22017, Lr: 0.000012 2020-02-13 02:46:57,153 Epoch 134 Step: 327600 Batch Loss: 1.259517 Tokens per Sec: 22065, Lr: 0.000012 2020-02-13 02:47:07,136 Epoch 134 Step: 327700 Batch Loss: 1.198792 Tokens per Sec: 22049, Lr: 0.000012 2020-02-13 02:47:17,075 Epoch 134 Step: 327800 Batch Loss: 1.148848 Tokens per Sec: 21876, Lr: 0.000012 2020-02-13 02:47:27,013 Epoch 134 Step: 327900 Batch Loss: 0.805007 Tokens per Sec: 22236, Lr: 0.000012 2020-02-13 02:47:36,940 Epoch 134 Step: 328000 Batch Loss: 1.285530 Tokens per Sec: 22366, Lr: 0.000012 2020-02-13 02:47:56,413 Example #0 2020-02-13 02:47:56,413 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 02:47:56,413 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 02:47:56,413 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 02:47:56,413 Reference: 10 : ​ 6 - 9 . 2020-02-13 02:47:56,413 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 02:47:56,413 Example #1 2020-02-13 02:47:56,413 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 02:47:56,413 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 02:47:56,413 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 02:47:56,413 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 02:47:56,414 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 02:47:56,414 Example #2 2020-02-13 02:47:56,414 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 02:47:56,414 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 02:47:56,414 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 02:47:56,414 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 02:47:56,414 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 02:47:56,414 Example #3 2020-02-13 02:47:56,414 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 02:47:56,414 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-13 02:47:56,414 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 02:47:56,414 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 02:47:56,414 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-13 02:47:56,415 Validation result (greedy) at epoch 134, step 328000: bleu: 30.14, loss: 39023.0430, ppl: 3.7366, duration: 19.4741s 2020-02-13 02:48:06,335 Epoch 134 Step: 328100 Batch Loss: 1.315961 Tokens per Sec: 22177, Lr: 0.000012 2020-02-13 02:48:16,277 Epoch 134 Step: 328200 Batch Loss: 1.338800 Tokens per Sec: 22251, Lr: 0.000012 2020-02-13 02:48:26,452 Epoch 134 Step: 328300 Batch Loss: 1.263982 Tokens per Sec: 21449, Lr: 0.000012 2020-02-13 02:48:36,514 Epoch 134 Step: 328400 Batch Loss: 1.066256 Tokens per Sec: 21946, Lr: 0.000012 2020-02-13 02:48:46,459 Epoch 134 Step: 328500 Batch Loss: 0.871921 Tokens per Sec: 22312, Lr: 0.000012 2020-02-13 02:48:56,415 Epoch 134 Step: 328600 Batch Loss: 1.270002 Tokens per Sec: 22363, Lr: 0.000012 2020-02-13 02:49:06,580 Epoch 134 Step: 328700 Batch Loss: 1.271530 Tokens per Sec: 21880, Lr: 0.000012 2020-02-13 02:49:16,653 Epoch 134 Step: 328800 Batch Loss: 1.451880 Tokens per Sec: 21801, Lr: 0.000012 2020-02-13 02:49:26,709 Epoch 134 Step: 328900 Batch Loss: 1.306511 Tokens per Sec: 21565, Lr: 0.000012 2020-02-13 02:49:36,690 Epoch 134 Step: 329000 Batch Loss: 1.092976 Tokens per Sec: 21757, Lr: 0.000012 2020-02-13 02:49:55,263 Example #0 2020-02-13 02:49:55,263 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 02:49:55,263 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 02:49:55,263 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 02:49:55,263 Reference: 10 : ​ 6 - 9 . 2020-02-13 02:49:55,263 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 02:49:55,263 Example #1 2020-02-13 02:49:55,263 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 02:49:55,263 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 02:49:55,263 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 02:49:55,264 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 02:49:55,264 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 02:49:55,264 Example #2 2020-02-13 02:49:55,264 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 02:49:55,264 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 02:49:55,264 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 02:49:55,264 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 02:49:55,264 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 02:49:55,264 Example #3 2020-02-13 02:49:55,264 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 02:49:55,264 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-13 02:49:55,264 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 02:49:55,264 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 02:49:55,264 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-13 02:49:55,264 Validation result (greedy) at epoch 134, step 329000: bleu: 30.11, loss: 39011.7266, ppl: 3.7351, duration: 18.5739s 2020-02-13 02:50:05,326 Epoch 134 Step: 329100 Batch Loss: 1.225160 Tokens per Sec: 21841, Lr: 0.000012 2020-02-13 02:50:15,346 Epoch 134 Step: 329200 Batch Loss: 0.832486 Tokens per Sec: 22364, Lr: 0.000012 2020-02-13 02:50:25,273 Epoch 134 Step: 329300 Batch Loss: 1.308533 Tokens per Sec: 22929, Lr: 0.000012 2020-02-13 02:50:35,236 Epoch 134 Step: 329400 Batch Loss: 0.751535 Tokens per Sec: 22876, Lr: 0.000012 2020-02-13 02:50:42,969 Epoch 134: total training loss 3023.02 2020-02-13 02:50:42,969 EPOCH 135 2020-02-13 02:50:45,438 Epoch 135 Step: 329500 Batch Loss: 1.242294 Tokens per Sec: 20187, Lr: 0.000012 2020-02-13 02:50:55,373 Epoch 135 Step: 329600 Batch Loss: 1.053290 Tokens per Sec: 22550, Lr: 0.000012 2020-02-13 02:51:05,367 Epoch 135 Step: 329700 Batch Loss: 1.282514 Tokens per Sec: 22529, Lr: 0.000012 2020-02-13 02:51:15,358 Epoch 135 Step: 329800 Batch Loss: 1.130103 Tokens per Sec: 22261, Lr: 0.000012 2020-02-13 02:51:25,407 Epoch 135 Step: 329900 Batch Loss: 1.183266 Tokens per Sec: 22004, Lr: 0.000012 2020-02-13 02:51:35,400 Epoch 135 Step: 330000 Batch Loss: 1.343862 Tokens per Sec: 22512, Lr: 0.000012 2020-02-13 02:51:54,885 Example #0 2020-02-13 02:51:54,885 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 02:51:54,885 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 02:51:54,885 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 02:51:54,886 Reference: 10 : ​ 6 - 9 . 2020-02-13 02:51:54,886 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 02:51:54,886 Example #1 2020-02-13 02:51:54,886 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 02:51:54,886 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 02:51:54,886 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 02:51:54,886 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 02:51:54,886 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 02:51:54,886 Example #2 2020-02-13 02:51:54,886 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 02:51:54,886 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 02:51:54,886 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 02:51:54,886 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 02:51:54,886 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 02:51:54,886 Example #3 2020-02-13 02:51:54,886 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 02:51:54,887 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-13 02:51:54,887 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 02:51:54,887 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 02:51:54,887 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-13 02:51:54,887 Validation result (greedy) at epoch 135, step 330000: bleu: 30.14, loss: 39010.8633, ppl: 3.7350, duration: 19.4861s 2020-02-13 02:52:04,835 Epoch 135 Step: 330100 Batch Loss: 1.166108 Tokens per Sec: 22319, Lr: 0.000012 2020-02-13 02:52:14,830 Epoch 135 Step: 330200 Batch Loss: 1.244292 Tokens per Sec: 22307, Lr: 0.000012 2020-02-13 02:52:24,857 Epoch 135 Step: 330300 Batch Loss: 1.472642 Tokens per Sec: 21850, Lr: 0.000012 2020-02-13 02:52:34,813 Epoch 135 Step: 330400 Batch Loss: 1.246041 Tokens per Sec: 23073, Lr: 0.000012 2020-02-13 02:52:44,722 Epoch 135 Step: 330500 Batch Loss: 1.210905 Tokens per Sec: 21834, Lr: 0.000012 2020-02-13 02:52:54,666 Epoch 135 Step: 330600 Batch Loss: 1.291890 Tokens per Sec: 22227, Lr: 0.000012 2020-02-13 02:53:04,707 Epoch 135 Step: 330700 Batch Loss: 1.191696 Tokens per Sec: 21849, Lr: 0.000012 2020-02-13 02:53:14,810 Epoch 135 Step: 330800 Batch Loss: 1.336001 Tokens per Sec: 21356, Lr: 0.000012 2020-02-13 02:53:24,998 Epoch 135 Step: 330900 Batch Loss: 1.168732 Tokens per Sec: 21956, Lr: 0.000012 2020-02-13 02:53:35,178 Epoch 135 Step: 331000 Batch Loss: 1.334533 Tokens per Sec: 21828, Lr: 0.000012 2020-02-13 02:53:54,341 Example #0 2020-02-13 02:53:54,341 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 02:53:54,341 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 02:53:54,341 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 02:53:54,341 Reference: 10 : ​ 6 - 9 . 2020-02-13 02:53:54,341 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 02:53:54,341 Example #1 2020-02-13 02:53:54,341 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 02:53:54,341 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 02:53:54,341 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 02:53:54,341 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 02:53:54,342 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 02:53:54,342 Example #2 2020-02-13 02:53:54,342 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 02:53:54,342 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 02:53:54,342 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 02:53:54,342 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 02:53:54,342 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 02:53:54,342 Example #3 2020-02-13 02:53:54,342 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 02:53:54,342 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-13 02:53:54,342 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 02:53:54,342 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 02:53:54,342 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-13 02:53:54,342 Validation result (greedy) at epoch 135, step 331000: bleu: 30.13, loss: 39013.5742, ppl: 3.7354, duration: 19.1634s 2020-02-13 02:54:04,331 Epoch 135 Step: 331100 Batch Loss: 1.242503 Tokens per Sec: 21701, Lr: 0.000012 2020-02-13 02:54:14,258 Epoch 135 Step: 331200 Batch Loss: 1.074947 Tokens per Sec: 22331, Lr: 0.000012 2020-02-13 02:54:24,302 Epoch 135 Step: 331300 Batch Loss: 1.264850 Tokens per Sec: 21733, Lr: 0.000012 2020-02-13 02:54:34,271 Epoch 135 Step: 331400 Batch Loss: 1.055591 Tokens per Sec: 21871, Lr: 0.000012 2020-02-13 02:54:44,441 Epoch 135 Step: 331500 Batch Loss: 1.265845 Tokens per Sec: 21786, Lr: 0.000012 2020-02-13 02:54:54,664 Epoch 135 Step: 331600 Batch Loss: 1.267930 Tokens per Sec: 21434, Lr: 0.000012 2020-02-13 02:55:04,910 Epoch 135 Step: 331700 Batch Loss: 1.353612 Tokens per Sec: 21599, Lr: 0.000012 2020-02-13 02:55:15,018 Epoch 135 Step: 331800 Batch Loss: 1.160552 Tokens per Sec: 21470, Lr: 0.000012 2020-02-13 02:55:24,939 Epoch 135 Step: 331900 Batch Loss: 1.325603 Tokens per Sec: 22386, Lr: 0.000012 2020-02-13 02:55:28,616 Epoch 135: total training loss 3023.17 2020-02-13 02:55:28,616 EPOCH 136 2020-02-13 02:55:35,100 Epoch 136 Step: 332000 Batch Loss: 1.304520 Tokens per Sec: 21927, Lr: 0.000012 2020-02-13 02:55:54,234 Hooray! New best validation result [ppl]! 2020-02-13 02:55:54,235 Saving new checkpoint. 2020-02-13 02:55:54,424 Example #0 2020-02-13 02:55:54,425 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 02:55:54,425 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'her', 'la', ',', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 02:55:54,425 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 02:55:54,425 Reference: 10 : ​ 6 - 9 . 2020-02-13 02:55:54,425 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea za hemen u lun a dooshima u a lu her la , shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 02:55:54,425 Example #1 2020-02-13 02:55:54,425 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 02:55:54,425 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 02:55:54,425 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 02:55:54,425 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 02:55:54,425 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 02:55:54,426 Example #2 2020-02-13 02:55:54,426 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 02:55:54,426 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 02:55:54,426 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 02:55:54,426 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 02:55:54,426 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 02:55:54,426 Example #3 2020-02-13 02:55:54,426 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 02:55:54,426 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-13 02:55:54,426 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 02:55:54,426 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 02:55:54,426 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-13 02:55:54,426 Validation result (greedy) at epoch 136, step 332000: bleu: 30.08, loss: 39002.6719, ppl: 3.7340, duration: 19.3265s 2020-02-13 02:56:04,371 Epoch 136 Step: 332100 Batch Loss: 1.393917 Tokens per Sec: 21928, Lr: 0.000012 2020-02-13 02:56:14,452 Epoch 136 Step: 332200 Batch Loss: 1.322464 Tokens per Sec: 21621, Lr: 0.000012 2020-02-13 02:56:24,392 Epoch 136 Step: 332300 Batch Loss: 1.386483 Tokens per Sec: 22465, Lr: 0.000012 2020-02-13 02:56:34,497 Epoch 136 Step: 332400 Batch Loss: 1.225785 Tokens per Sec: 22123, Lr: 0.000012 2020-02-13 02:56:44,760 Epoch 136 Step: 332500 Batch Loss: 1.327020 Tokens per Sec: 21326, Lr: 0.000012 2020-02-13 02:56:54,871 Epoch 136 Step: 332600 Batch Loss: 1.108376 Tokens per Sec: 21911, Lr: 0.000012 2020-02-13 02:57:04,803 Epoch 136 Step: 332700 Batch Loss: 1.327727 Tokens per Sec: 22010, Lr: 0.000012 2020-02-13 02:57:14,686 Epoch 136 Step: 332800 Batch Loss: 1.275753 Tokens per Sec: 22023, Lr: 0.000012 2020-02-13 02:57:24,799 Epoch 136 Step: 332900 Batch Loss: 1.181403 Tokens per Sec: 22095, Lr: 0.000012 2020-02-13 02:57:34,859 Epoch 136 Step: 333000 Batch Loss: 1.252592 Tokens per Sec: 22158, Lr: 0.000012 2020-02-13 02:57:54,374 Example #0 2020-02-13 02:57:54,374 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 02:57:54,374 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 02:57:54,374 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 02:57:54,374 Reference: 10 : ​ 6 - 9 . 2020-02-13 02:57:54,374 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu hen atô ve la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 02:57:54,374 Example #1 2020-02-13 02:57:54,374 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 02:57:54,374 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 02:57:54,374 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 02:57:54,374 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 02:57:54,374 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 02:57:54,374 Example #2 2020-02-13 02:57:54,375 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 02:57:54,375 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 02:57:54,375 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 02:57:54,375 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 02:57:54,375 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 02:57:54,375 Example #3 2020-02-13 02:57:54,375 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 02:57:54,375 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-13 02:57:54,375 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 02:57:54,375 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 02:57:54,375 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-13 02:57:54,375 Validation result (greedy) at epoch 136, step 333000: bleu: 29.96, loss: 39011.0000, ppl: 3.7350, duration: 19.5156s 2020-02-13 02:58:04,345 Epoch 136 Step: 333100 Batch Loss: 1.116104 Tokens per Sec: 22327, Lr: 0.000012 2020-02-13 02:58:14,171 Epoch 136 Step: 333200 Batch Loss: 1.104013 Tokens per Sec: 21619, Lr: 0.000012 2020-02-13 02:58:24,002 Epoch 136 Step: 333300 Batch Loss: 1.200213 Tokens per Sec: 22693, Lr: 0.000012 2020-02-13 02:58:33,805 Epoch 136 Step: 333400 Batch Loss: 1.046903 Tokens per Sec: 22312, Lr: 0.000012 2020-02-13 02:58:43,889 Epoch 136 Step: 333500 Batch Loss: 1.169741 Tokens per Sec: 21887, Lr: 0.000012 2020-02-13 02:58:54,075 Epoch 136 Step: 333600 Batch Loss: 1.188376 Tokens per Sec: 21992, Lr: 0.000012 2020-02-13 02:59:04,053 Epoch 136 Step: 333700 Batch Loss: 1.251943 Tokens per Sec: 22878, Lr: 0.000012 2020-02-13 02:59:13,992 Epoch 136 Step: 333800 Batch Loss: 1.285790 Tokens per Sec: 22036, Lr: 0.000012 2020-02-13 02:59:24,160 Epoch 136 Step: 333900 Batch Loss: 1.196835 Tokens per Sec: 22181, Lr: 0.000012 2020-02-13 02:59:34,319 Epoch 136 Step: 334000 Batch Loss: 1.055617 Tokens per Sec: 21352, Lr: 0.000012 2020-02-13 02:59:53,356 Hooray! New best validation result [ppl]! 2020-02-13 02:59:53,356 Saving new checkpoint. 2020-02-13 02:59:53,556 Example #0 2020-02-13 02:59:53,556 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 02:59:53,556 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 02:59:53,556 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 02:59:53,556 Reference: 10 : ​ 6 - 9 . 2020-02-13 02:59:53,556 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 02:59:53,556 Example #1 2020-02-13 02:59:53,556 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 02:59:53,556 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 02:59:53,557 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 02:59:53,557 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 02:59:53,557 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 02:59:53,557 Example #2 2020-02-13 02:59:53,557 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 02:59:53,557 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 02:59:53,557 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 02:59:53,557 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 02:59:53,557 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 02:59:53,557 Example #3 2020-02-13 02:59:53,557 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 02:59:53,557 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-13 02:59:53,557 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 02:59:53,557 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 02:59:53,557 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-13 02:59:53,558 Validation result (greedy) at epoch 136, step 334000: bleu: 30.09, loss: 38973.8203, ppl: 3.7304, duration: 19.2376s 2020-02-13 03:00:03,451 Epoch 136 Step: 334100 Batch Loss: 1.428388 Tokens per Sec: 22023, Lr: 0.000012 2020-02-13 03:00:13,360 Epoch 136 Step: 334200 Batch Loss: 1.121411 Tokens per Sec: 22080, Lr: 0.000012 2020-02-13 03:00:23,383 Epoch 136 Step: 334300 Batch Loss: 1.318969 Tokens per Sec: 22115, Lr: 0.000012 2020-02-13 03:00:33,074 Epoch 136: total training loss 3025.52 2020-02-13 03:00:33,075 EPOCH 137 2020-02-13 03:00:33,561 Epoch 137 Step: 334400 Batch Loss: 1.118490 Tokens per Sec: 7558, Lr: 0.000012 2020-02-13 03:00:43,465 Epoch 137 Step: 334500 Batch Loss: 0.993714 Tokens per Sec: 22509, Lr: 0.000012 2020-02-13 03:00:53,515 Epoch 137 Step: 334600 Batch Loss: 1.138014 Tokens per Sec: 21863, Lr: 0.000012 2020-02-13 03:01:03,474 Epoch 137 Step: 334700 Batch Loss: 1.366758 Tokens per Sec: 21645, Lr: 0.000012 2020-02-13 03:01:13,434 Epoch 137 Step: 334800 Batch Loss: 1.378901 Tokens per Sec: 22323, Lr: 0.000012 2020-02-13 03:01:23,433 Epoch 137 Step: 334900 Batch Loss: 1.381982 Tokens per Sec: 22081, Lr: 0.000012 2020-02-13 03:01:33,312 Epoch 137 Step: 335000 Batch Loss: 1.114192 Tokens per Sec: 22296, Lr: 0.000012 2020-02-13 03:01:52,398 Example #0 2020-02-13 03:01:52,398 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 03:01:52,398 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 03:01:52,399 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 03:01:52,399 Reference: 10 : ​ 6 - 9 . 2020-02-13 03:01:52,399 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 03:01:52,399 Example #1 2020-02-13 03:01:52,399 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 03:01:52,399 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 03:01:52,399 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 03:01:52,399 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 03:01:52,399 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 03:01:52,399 Example #2 2020-02-13 03:01:52,399 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 03:01:52,399 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 03:01:52,399 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 03:01:52,399 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 03:01:52,399 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 03:01:52,400 Example #3 2020-02-13 03:01:52,400 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 03:01:52,400 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-13 03:01:52,400 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 03:01:52,400 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 03:01:52,400 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-13 03:01:52,400 Validation result (greedy) at epoch 137, step 335000: bleu: 30.05, loss: 38982.6250, ppl: 3.7315, duration: 19.0878s 2020-02-13 03:02:02,279 Epoch 137 Step: 335100 Batch Loss: 1.093303 Tokens per Sec: 22728, Lr: 0.000012 2020-02-13 03:02:12,249 Epoch 137 Step: 335200 Batch Loss: 1.057185 Tokens per Sec: 21911, Lr: 0.000012 2020-02-13 03:02:22,191 Epoch 137 Step: 335300 Batch Loss: 1.012797 Tokens per Sec: 22423, Lr: 0.000012 2020-02-13 03:02:32,141 Epoch 137 Step: 335400 Batch Loss: 1.405345 Tokens per Sec: 22849, Lr: 0.000012 2020-02-13 03:02:42,043 Epoch 137 Step: 335500 Batch Loss: 1.381756 Tokens per Sec: 22539, Lr: 0.000012 2020-02-13 03:02:52,006 Epoch 137 Step: 335600 Batch Loss: 1.279072 Tokens per Sec: 22231, Lr: 0.000012 2020-02-13 03:03:02,011 Epoch 137 Step: 335700 Batch Loss: 1.306430 Tokens per Sec: 21766, Lr: 0.000012 2020-02-13 03:03:11,924 Epoch 137 Step: 335800 Batch Loss: 1.160346 Tokens per Sec: 22457, Lr: 0.000012 2020-02-13 03:03:21,927 Epoch 137 Step: 335900 Batch Loss: 1.326955 Tokens per Sec: 22178, Lr: 0.000012 2020-02-13 03:03:31,845 Epoch 137 Step: 336000 Batch Loss: 1.450752 Tokens per Sec: 22627, Lr: 0.000012 2020-02-13 03:03:50,973 Example #0 2020-02-13 03:03:50,974 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 03:03:50,974 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 03:03:50,974 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 03:03:50,974 Reference: 10 : ​ 6 - 9 . 2020-02-13 03:03:50,974 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 03:03:50,974 Example #1 2020-02-13 03:03:50,974 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 03:03:50,974 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 03:03:50,974 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 03:03:50,974 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 03:03:50,974 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 03:03:50,974 Example #2 2020-02-13 03:03:50,974 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 03:03:50,974 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 03:03:50,974 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 03:03:50,975 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 03:03:50,975 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 03:03:50,975 Example #3 2020-02-13 03:03:50,975 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 03:03:50,975 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-13 03:03:50,975 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 03:03:50,975 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 03:03:50,975 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-13 03:03:50,975 Validation result (greedy) at epoch 137, step 336000: bleu: 30.20, loss: 38997.4258, ppl: 3.7333, duration: 19.1292s 2020-02-13 03:04:00,876 Epoch 137 Step: 336100 Batch Loss: 1.298315 Tokens per Sec: 22043, Lr: 0.000012 2020-02-13 03:04:10,828 Epoch 137 Step: 336200 Batch Loss: 1.311965 Tokens per Sec: 22124, Lr: 0.000012 2020-02-13 03:04:20,709 Epoch 137 Step: 336300 Batch Loss: 1.130004 Tokens per Sec: 22232, Lr: 0.000012 2020-02-13 03:04:30,542 Epoch 137 Step: 336400 Batch Loss: 1.234899 Tokens per Sec: 22767, Lr: 0.000012 2020-02-13 03:04:40,415 Epoch 137 Step: 336500 Batch Loss: 1.313615 Tokens per Sec: 22890, Lr: 0.000012 2020-02-13 03:04:50,343 Epoch 137 Step: 336600 Batch Loss: 1.404832 Tokens per Sec: 22014, Lr: 0.000012 2020-02-13 03:05:00,345 Epoch 137 Step: 336700 Batch Loss: 1.328918 Tokens per Sec: 21924, Lr: 0.000012 2020-02-13 03:05:10,444 Epoch 137 Step: 336800 Batch Loss: 1.522175 Tokens per Sec: 21891, Lr: 0.000012 2020-02-13 03:05:15,627 Epoch 137: total training loss 3019.82 2020-02-13 03:05:15,627 EPOCH 138 2020-02-13 03:05:20,640 Epoch 138 Step: 336900 Batch Loss: 1.290551 Tokens per Sec: 21401, Lr: 0.000012 2020-02-13 03:05:30,515 Epoch 138 Step: 337000 Batch Loss: 1.287560 Tokens per Sec: 22363, Lr: 0.000012 2020-02-13 03:05:49,602 Example #0 2020-02-13 03:05:49,602 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 03:05:49,602 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 03:05:49,602 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 03:05:49,602 Reference: 10 : ​ 6 - 9 . 2020-02-13 03:05:49,602 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 03:05:49,602 Example #1 2020-02-13 03:05:49,602 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 03:05:49,602 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 03:05:49,602 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 03:05:49,602 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 03:05:49,602 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 03:05:49,603 Example #2 2020-02-13 03:05:49,603 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 03:05:49,603 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 03:05:49,603 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 03:05:49,603 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 03:05:49,603 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 03:05:49,603 Example #3 2020-02-13 03:05:49,603 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 03:05:49,603 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-13 03:05:49,603 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 03:05:49,603 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 03:05:49,603 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-13 03:05:49,603 Validation result (greedy) at epoch 138, step 337000: bleu: 30.11, loss: 38990.4375, ppl: 3.7325, duration: 19.0880s 2020-02-13 03:05:59,442 Epoch 138 Step: 337100 Batch Loss: 1.298529 Tokens per Sec: 22535, Lr: 0.000012 2020-02-13 03:06:09,331 Epoch 138 Step: 337200 Batch Loss: 1.024804 Tokens per Sec: 22041, Lr: 0.000012 2020-02-13 03:06:19,289 Epoch 138 Step: 337300 Batch Loss: 1.177057 Tokens per Sec: 22224, Lr: 0.000012 2020-02-13 03:06:29,317 Epoch 138 Step: 337400 Batch Loss: 1.081189 Tokens per Sec: 21863, Lr: 0.000012 2020-02-13 03:06:39,392 Epoch 138 Step: 337500 Batch Loss: 1.444822 Tokens per Sec: 22031, Lr: 0.000012 2020-02-13 03:06:49,442 Epoch 138 Step: 337600 Batch Loss: 1.315276 Tokens per Sec: 22129, Lr: 0.000012 2020-02-13 03:06:59,329 Epoch 138 Step: 337700 Batch Loss: 1.203431 Tokens per Sec: 21988, Lr: 0.000012 2020-02-13 03:07:09,302 Epoch 138 Step: 337800 Batch Loss: 1.252675 Tokens per Sec: 21956, Lr: 0.000012 2020-02-13 03:07:19,183 Epoch 138 Step: 337900 Batch Loss: 1.205330 Tokens per Sec: 22833, Lr: 0.000012 2020-02-13 03:07:29,061 Epoch 138 Step: 338000 Batch Loss: 1.246554 Tokens per Sec: 22117, Lr: 0.000012 2020-02-13 03:07:47,712 Example #0 2020-02-13 03:07:47,712 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 03:07:47,712 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 03:07:47,712 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 03:07:47,712 Reference: 10 : ​ 6 - 9 . 2020-02-13 03:07:47,712 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 03:07:47,712 Example #1 2020-02-13 03:07:47,712 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 03:07:47,712 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 03:07:47,712 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 03:07:47,712 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 03:07:47,712 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 03:07:47,713 Example #2 2020-02-13 03:07:47,713 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 03:07:47,713 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 03:07:47,713 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 03:07:47,713 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 03:07:47,713 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 03:07:47,713 Example #3 2020-02-13 03:07:47,713 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 03:07:47,713 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-13 03:07:47,713 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 03:07:47,713 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 03:07:47,713 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-13 03:07:47,713 Validation result (greedy) at epoch 138, step 338000: bleu: 30.01, loss: 39006.9922, ppl: 3.7345, duration: 18.6514s 2020-02-13 03:07:57,640 Epoch 138 Step: 338100 Batch Loss: 1.394366 Tokens per Sec: 21821, Lr: 0.000012 2020-02-13 03:08:07,608 Epoch 138 Step: 338200 Batch Loss: 1.361840 Tokens per Sec: 21841, Lr: 0.000012 2020-02-13 03:08:17,552 Epoch 138 Step: 338300 Batch Loss: 1.303092 Tokens per Sec: 22927, Lr: 0.000012 2020-02-13 03:08:27,470 Epoch 138 Step: 338400 Batch Loss: 1.173657 Tokens per Sec: 21967, Lr: 0.000012 2020-02-13 03:08:37,371 Epoch 138 Step: 338500 Batch Loss: 0.953271 Tokens per Sec: 21945, Lr: 0.000012 2020-02-13 03:08:47,275 Epoch 138 Step: 338600 Batch Loss: 1.244598 Tokens per Sec: 22032, Lr: 0.000012 2020-02-13 03:08:57,189 Epoch 138 Step: 338700 Batch Loss: 1.423469 Tokens per Sec: 22947, Lr: 0.000012 2020-02-13 03:09:07,067 Epoch 138 Step: 338800 Batch Loss: 1.269919 Tokens per Sec: 22394, Lr: 0.000012 2020-02-13 03:09:17,062 Epoch 138 Step: 338900 Batch Loss: 1.186960 Tokens per Sec: 21973, Lr: 0.000012 2020-02-13 03:09:27,073 Epoch 138 Step: 339000 Batch Loss: 1.188816 Tokens per Sec: 22454, Lr: 0.000012 2020-02-13 03:09:46,000 Example #0 2020-02-13 03:09:46,000 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 03:09:46,000 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 03:09:46,000 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 03:09:46,001 Reference: 10 : ​ 6 - 9 . 2020-02-13 03:09:46,001 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 03:09:46,001 Example #1 2020-02-13 03:09:46,001 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 03:09:46,001 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 03:09:46,001 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 03:09:46,001 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 03:09:46,001 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 03:09:46,001 Example #2 2020-02-13 03:09:46,001 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 03:09:46,001 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 03:09:46,001 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 03:09:46,001 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 03:09:46,001 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 03:09:46,002 Example #3 2020-02-13 03:09:46,002 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 03:09:46,002 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-13 03:09:46,002 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 03:09:46,002 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 03:09:46,002 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-13 03:09:46,002 Validation result (greedy) at epoch 138, step 339000: bleu: 30.06, loss: 38996.4727, ppl: 3.7332, duration: 18.9283s 2020-02-13 03:09:55,987 Epoch 138 Step: 339100 Batch Loss: 1.210012 Tokens per Sec: 21934, Lr: 0.000012 2020-02-13 03:10:05,990 Epoch 138 Step: 339200 Batch Loss: 1.388735 Tokens per Sec: 22575, Lr: 0.000012 2020-02-13 03:10:15,924 Epoch 138 Step: 339300 Batch Loss: 1.250635 Tokens per Sec: 22338, Lr: 0.000012 2020-02-13 03:10:17,023 Epoch 138: total training loss 3022.01 2020-02-13 03:10:17,023 EPOCH 139 2020-02-13 03:10:26,119 Epoch 139 Step: 339400 Batch Loss: 1.371639 Tokens per Sec: 21539, Lr: 0.000012 2020-02-13 03:10:36,193 Epoch 139 Step: 339500 Batch Loss: 1.284317 Tokens per Sec: 22172, Lr: 0.000012 2020-02-13 03:10:46,327 Epoch 139 Step: 339600 Batch Loss: 1.312302 Tokens per Sec: 21711, Lr: 0.000012 2020-02-13 03:10:56,467 Epoch 139 Step: 339700 Batch Loss: 1.457855 Tokens per Sec: 21815, Lr: 0.000012 2020-02-13 03:11:06,576 Epoch 139 Step: 339800 Batch Loss: 1.187504 Tokens per Sec: 21834, Lr: 0.000012 2020-02-13 03:11:16,513 Epoch 139 Step: 339900 Batch Loss: 1.294827 Tokens per Sec: 22338, Lr: 0.000012 2020-02-13 03:11:26,458 Epoch 139 Step: 340000 Batch Loss: 1.225371 Tokens per Sec: 22602, Lr: 0.000012 2020-02-13 03:11:45,513 Example #0 2020-02-13 03:11:45,514 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 03:11:45,514 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 03:11:45,514 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 03:11:45,514 Reference: 10 : ​ 6 - 9 . 2020-02-13 03:11:45,514 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 03:11:45,514 Example #1 2020-02-13 03:11:45,514 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 03:11:45,514 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 03:11:45,514 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 03:11:45,514 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 03:11:45,514 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 03:11:45,514 Example #2 2020-02-13 03:11:45,514 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 03:11:45,514 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 03:11:45,514 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 03:11:45,515 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 03:11:45,515 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 03:11:45,515 Example #3 2020-02-13 03:11:45,515 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 03:11:45,515 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-13 03:11:45,515 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 03:11:45,515 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 03:11:45,515 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-13 03:11:45,515 Validation result (greedy) at epoch 139, step 340000: bleu: 30.15, loss: 38991.9727, ppl: 3.7326, duration: 19.0565s 2020-02-13 03:11:55,616 Epoch 139 Step: 340100 Batch Loss: 1.465514 Tokens per Sec: 22053, Lr: 0.000008 2020-02-13 03:12:05,679 Epoch 139 Step: 340200 Batch Loss: 1.262606 Tokens per Sec: 21692, Lr: 0.000008 2020-02-13 03:12:15,539 Epoch 139 Step: 340300 Batch Loss: 1.124292 Tokens per Sec: 22076, Lr: 0.000008 2020-02-13 03:12:25,500 Epoch 139 Step: 340400 Batch Loss: 1.121805 Tokens per Sec: 22111, Lr: 0.000008 2020-02-13 03:12:35,436 Epoch 139 Step: 340500 Batch Loss: 1.264234 Tokens per Sec: 22719, Lr: 0.000008 2020-02-13 03:12:45,277 Epoch 139 Step: 340600 Batch Loss: 1.338059 Tokens per Sec: 22917, Lr: 0.000008 2020-02-13 03:12:55,257 Epoch 139 Step: 340700 Batch Loss: 1.346114 Tokens per Sec: 22930, Lr: 0.000008 2020-02-13 03:13:05,195 Epoch 139 Step: 340800 Batch Loss: 1.072021 Tokens per Sec: 21852, Lr: 0.000008 2020-02-13 03:13:15,234 Epoch 139 Step: 340900 Batch Loss: 1.315749 Tokens per Sec: 21850, Lr: 0.000008 2020-02-13 03:13:25,283 Epoch 139 Step: 341000 Batch Loss: 1.318789 Tokens per Sec: 21988, Lr: 0.000008 2020-02-13 03:13:44,148 Example #0 2020-02-13 03:13:44,148 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 03:13:44,148 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 03:13:44,148 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 03:13:44,148 Reference: 10 : ​ 6 - 9 . 2020-02-13 03:13:44,148 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 03:13:44,149 Example #1 2020-02-13 03:13:44,149 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 03:13:44,149 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 03:13:44,149 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 03:13:44,149 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 03:13:44,149 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 03:13:44,149 Example #2 2020-02-13 03:13:44,149 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 03:13:44,149 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 03:13:44,149 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 03:13:44,149 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 03:13:44,149 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 03:13:44,149 Example #3 2020-02-13 03:13:44,149 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 03:13:44,149 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-13 03:13:44,149 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 03:13:44,150 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 03:13:44,150 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-13 03:13:44,150 Validation result (greedy) at epoch 139, step 341000: bleu: 30.16, loss: 38999.3828, ppl: 3.7336, duration: 18.8666s 2020-02-13 03:13:54,108 Epoch 139 Step: 341100 Batch Loss: 1.135223 Tokens per Sec: 21934, Lr: 0.000008 2020-02-13 03:14:04,193 Epoch 139 Step: 341200 Batch Loss: 1.247263 Tokens per Sec: 22202, Lr: 0.000008 2020-02-13 03:14:14,161 Epoch 139 Step: 341300 Batch Loss: 1.301640 Tokens per Sec: 22003, Lr: 0.000008 2020-02-13 03:14:24,046 Epoch 139 Step: 341400 Batch Loss: 1.257915 Tokens per Sec: 22821, Lr: 0.000008 2020-02-13 03:14:33,947 Epoch 139 Step: 341500 Batch Loss: 0.888233 Tokens per Sec: 22215, Lr: 0.000008 2020-02-13 03:14:43,843 Epoch 139 Step: 341600 Batch Loss: 1.348129 Tokens per Sec: 22778, Lr: 0.000008 2020-02-13 03:14:53,867 Epoch 139 Step: 341700 Batch Loss: 1.262446 Tokens per Sec: 22297, Lr: 0.000008 2020-02-13 03:14:59,887 Epoch 139: total training loss 3010.74 2020-02-13 03:14:59,888 EPOCH 140 2020-02-13 03:15:04,049 Epoch 140 Step: 341800 Batch Loss: 1.328096 Tokens per Sec: 20309, Lr: 0.000008 2020-02-13 03:15:13,998 Epoch 140 Step: 341900 Batch Loss: 1.129110 Tokens per Sec: 22592, Lr: 0.000008 2020-02-13 03:15:24,060 Epoch 140 Step: 342000 Batch Loss: 1.376179 Tokens per Sec: 22290, Lr: 0.000008 2020-02-13 03:15:43,111 Example #0 2020-02-13 03:15:43,111 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 03:15:43,111 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 03:15:43,111 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 03:15:43,111 Reference: 10 : ​ 6 - 9 . 2020-02-13 03:15:43,111 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 03:15:43,111 Example #1 2020-02-13 03:15:43,111 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 03:15:43,111 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 03:15:43,112 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 03:15:43,112 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 03:15:43,112 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 03:15:43,112 Example #2 2020-02-13 03:15:43,112 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 03:15:43,112 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 03:15:43,112 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 03:15:43,112 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 03:15:43,112 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 03:15:43,112 Example #3 2020-02-13 03:15:43,112 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 03:15:43,112 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-13 03:15:43,112 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 03:15:43,112 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 03:15:43,112 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-13 03:15:43,113 Validation result (greedy) at epoch 140, step 342000: bleu: 30.04, loss: 38997.7773, ppl: 3.7334, duration: 19.0514s 2020-02-13 03:15:53,073 Epoch 140 Step: 342100 Batch Loss: 1.115348 Tokens per Sec: 22013, Lr: 0.000008 2020-02-13 03:16:03,002 Epoch 140 Step: 342200 Batch Loss: 1.160123 Tokens per Sec: 22030, Lr: 0.000008 2020-02-13 03:16:12,935 Epoch 140 Step: 342300 Batch Loss: 1.096521 Tokens per Sec: 22113, Lr: 0.000008 2020-02-13 03:16:22,850 Epoch 140 Step: 342400 Batch Loss: 1.167110 Tokens per Sec: 22272, Lr: 0.000008 2020-02-13 03:16:32,730 Epoch 140 Step: 342500 Batch Loss: 1.232327 Tokens per Sec: 22441, Lr: 0.000008 2020-02-13 03:16:42,593 Epoch 140 Step: 342600 Batch Loss: 1.238927 Tokens per Sec: 21433, Lr: 0.000008 2020-02-13 03:16:52,488 Epoch 140 Step: 342700 Batch Loss: 1.126925 Tokens per Sec: 21788, Lr: 0.000008 2020-02-13 03:17:02,396 Epoch 140 Step: 342800 Batch Loss: 1.227557 Tokens per Sec: 22399, Lr: 0.000008 2020-02-13 03:17:12,297 Epoch 140 Step: 342900 Batch Loss: 1.070554 Tokens per Sec: 22038, Lr: 0.000008 2020-02-13 03:17:22,154 Epoch 140 Step: 343000 Batch Loss: 1.311914 Tokens per Sec: 22370, Lr: 0.000008 2020-02-13 03:17:41,037 Example #0 2020-02-13 03:17:41,038 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 03:17:41,038 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 03:17:41,038 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 03:17:41,038 Reference: 10 : ​ 6 - 9 . 2020-02-13 03:17:41,038 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 03:17:41,038 Example #1 2020-02-13 03:17:41,038 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 03:17:41,038 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 03:17:41,038 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 03:17:41,038 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 03:17:41,038 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 03:17:41,038 Example #2 2020-02-13 03:17:41,038 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 03:17:41,038 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 03:17:41,038 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 03:17:41,039 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 03:17:41,039 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 03:17:41,039 Example #3 2020-02-13 03:17:41,039 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 03:17:41,039 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-13 03:17:41,039 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 03:17:41,039 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 03:17:41,039 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-13 03:17:41,039 Validation result (greedy) at epoch 140, step 343000: bleu: 29.97, loss: 38996.9922, ppl: 3.7333, duration: 18.8843s 2020-02-13 03:17:50,991 Epoch 140 Step: 343100 Batch Loss: 1.406073 Tokens per Sec: 23057, Lr: 0.000008 2020-02-13 03:18:00,899 Epoch 140 Step: 343200 Batch Loss: 1.411231 Tokens per Sec: 22775, Lr: 0.000008 2020-02-13 03:18:10,792 Epoch 140 Step: 343300 Batch Loss: 1.237185 Tokens per Sec: 22002, Lr: 0.000008 2020-02-13 03:18:20,802 Epoch 140 Step: 343400 Batch Loss: 1.178584 Tokens per Sec: 21811, Lr: 0.000008 2020-02-13 03:18:30,743 Epoch 140 Step: 343500 Batch Loss: 1.165043 Tokens per Sec: 22559, Lr: 0.000008 2020-02-13 03:18:40,824 Epoch 140 Step: 343600 Batch Loss: 1.355272 Tokens per Sec: 22312, Lr: 0.000008 2020-02-13 03:18:50,918 Epoch 140 Step: 343700 Batch Loss: 1.346688 Tokens per Sec: 21541, Lr: 0.000008 2020-02-13 03:19:01,002 Epoch 140 Step: 343800 Batch Loss: 1.238483 Tokens per Sec: 21625, Lr: 0.000008 2020-02-13 03:19:11,100 Epoch 140 Step: 343900 Batch Loss: 1.200174 Tokens per Sec: 22169, Lr: 0.000008 2020-02-13 03:19:21,228 Epoch 140 Step: 344000 Batch Loss: 1.211047 Tokens per Sec: 21811, Lr: 0.000008 2020-02-13 03:19:40,507 Example #0 2020-02-13 03:19:40,508 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 03:19:40,508 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 03:19:40,508 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 03:19:40,508 Reference: 10 : ​ 6 - 9 . 2020-02-13 03:19:40,508 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 03:19:40,508 Example #1 2020-02-13 03:19:40,508 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 03:19:40,508 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 03:19:40,508 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 03:19:40,508 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 03:19:40,508 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 03:19:40,508 Example #2 2020-02-13 03:19:40,508 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 03:19:40,509 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 03:19:40,509 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 03:19:40,509 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 03:19:40,509 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 03:19:40,509 Example #3 2020-02-13 03:19:40,509 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 03:19:40,509 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-13 03:19:40,509 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 03:19:40,509 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 03:19:40,509 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-13 03:19:40,509 Validation result (greedy) at epoch 140, step 344000: bleu: 30.09, loss: 39000.0312, ppl: 3.7337, duration: 19.2811s 2020-02-13 03:19:50,633 Epoch 140 Step: 344100 Batch Loss: 1.303274 Tokens per Sec: 21502, Lr: 0.000008 2020-02-13 03:20:00,590 Epoch 140 Step: 344200 Batch Loss: 1.115070 Tokens per Sec: 21737, Lr: 0.000008 2020-02-13 03:20:03,180 Epoch 140: total training loss 3029.67 2020-02-13 03:20:03,180 EPOCH 141 2020-02-13 03:20:10,744 Epoch 141 Step: 344300 Batch Loss: 1.143939 Tokens per Sec: 21858, Lr: 0.000008 2020-02-13 03:20:20,635 Epoch 141 Step: 344400 Batch Loss: 1.123117 Tokens per Sec: 22655, Lr: 0.000008 2020-02-13 03:20:30,502 Epoch 141 Step: 344500 Batch Loss: 0.915760 Tokens per Sec: 22018, Lr: 0.000008 2020-02-13 03:20:40,310 Epoch 141 Step: 344600 Batch Loss: 1.062586 Tokens per Sec: 22283, Lr: 0.000008 2020-02-13 03:20:50,272 Epoch 141 Step: 344700 Batch Loss: 1.109022 Tokens per Sec: 22281, Lr: 0.000008 2020-02-13 03:21:00,160 Epoch 141 Step: 344800 Batch Loss: 1.224705 Tokens per Sec: 22666, Lr: 0.000008 2020-02-13 03:21:10,107 Epoch 141 Step: 344900 Batch Loss: 1.135750 Tokens per Sec: 22521, Lr: 0.000008 2020-02-13 03:21:20,236 Epoch 141 Step: 345000 Batch Loss: 1.160855 Tokens per Sec: 21901, Lr: 0.000008 2020-02-13 03:21:38,893 Example #0 2020-02-13 03:21:38,893 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 03:21:38,893 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 03:21:38,894 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 03:21:38,894 Reference: 10 : ​ 6 - 9 . 2020-02-13 03:21:38,894 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 03:21:38,894 Example #1 2020-02-13 03:21:38,894 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 03:21:38,894 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 03:21:38,894 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 03:21:38,894 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 03:21:38,894 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 03:21:38,894 Example #2 2020-02-13 03:21:38,894 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 03:21:38,894 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 03:21:38,894 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 03:21:38,894 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 03:21:38,894 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 03:21:38,895 Example #3 2020-02-13 03:21:38,895 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 03:21:38,895 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-13 03:21:38,895 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 03:21:38,895 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 03:21:38,895 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-13 03:21:38,895 Validation result (greedy) at epoch 141, step 345000: bleu: 30.11, loss: 38993.2305, ppl: 3.7328, duration: 18.6583s 2020-02-13 03:21:48,901 Epoch 141 Step: 345100 Batch Loss: 1.274617 Tokens per Sec: 22008, Lr: 0.000008 2020-02-13 03:21:58,774 Epoch 141 Step: 345200 Batch Loss: 1.021268 Tokens per Sec: 22233, Lr: 0.000008 2020-02-13 03:22:08,702 Epoch 141 Step: 345300 Batch Loss: 0.905474 Tokens per Sec: 21631, Lr: 0.000008 2020-02-13 03:22:18,617 Epoch 141 Step: 345400 Batch Loss: 1.347442 Tokens per Sec: 22010, Lr: 0.000008 2020-02-13 03:22:28,511 Epoch 141 Step: 345500 Batch Loss: 1.139947 Tokens per Sec: 22264, Lr: 0.000008 2020-02-13 03:22:38,332 Epoch 141 Step: 345600 Batch Loss: 1.229334 Tokens per Sec: 22356, Lr: 0.000008 2020-02-13 03:22:48,207 Epoch 141 Step: 345700 Batch Loss: 0.958409 Tokens per Sec: 22384, Lr: 0.000008 2020-02-13 03:22:58,119 Epoch 141 Step: 345800 Batch Loss: 1.252402 Tokens per Sec: 21850, Lr: 0.000008 2020-02-13 03:23:08,035 Epoch 141 Step: 345900 Batch Loss: 1.233129 Tokens per Sec: 22156, Lr: 0.000008 2020-02-13 03:23:17,949 Epoch 141 Step: 346000 Batch Loss: 1.270470 Tokens per Sec: 22314, Lr: 0.000008 2020-02-13 03:23:36,731 Example #0 2020-02-13 03:23:36,731 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 03:23:36,731 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 03:23:36,731 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 03:23:36,731 Reference: 10 : ​ 6 - 9 . 2020-02-13 03:23:36,731 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 03:23:36,732 Example #1 2020-02-13 03:23:36,732 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 03:23:36,732 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 03:23:36,732 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 03:23:36,732 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 03:23:36,732 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 03:23:36,732 Example #2 2020-02-13 03:23:36,732 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 03:23:36,732 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 03:23:36,732 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 03:23:36,732 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 03:23:36,732 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 03:23:36,732 Example #3 2020-02-13 03:23:36,732 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 03:23:36,732 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-13 03:23:36,732 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 03:23:36,733 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 03:23:36,733 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-13 03:23:36,733 Validation result (greedy) at epoch 141, step 346000: bleu: 30.19, loss: 38997.3672, ppl: 3.7333, duration: 18.7828s 2020-02-13 03:23:46,740 Epoch 141 Step: 346100 Batch Loss: 1.273453 Tokens per Sec: 21815, Lr: 0.000006 2020-02-13 03:23:56,771 Epoch 141 Step: 346200 Batch Loss: 1.359789 Tokens per Sec: 22168, Lr: 0.000006 2020-02-13 03:24:06,767 Epoch 141 Step: 346300 Batch Loss: 1.148227 Tokens per Sec: 22410, Lr: 0.000006 2020-02-13 03:24:16,744 Epoch 141 Step: 346400 Batch Loss: 1.156749 Tokens per Sec: 22169, Lr: 0.000006 2020-02-13 03:24:26,716 Epoch 141 Step: 346500 Batch Loss: 1.298335 Tokens per Sec: 21914, Lr: 0.000006 2020-02-13 03:24:36,613 Epoch 141 Step: 346600 Batch Loss: 0.984153 Tokens per Sec: 22614, Lr: 0.000006 2020-02-13 03:24:45,750 Epoch 141: total training loss 3027.03 2020-02-13 03:24:45,750 EPOCH 142 2020-02-13 03:24:47,551 Epoch 142 Step: 346700 Batch Loss: 0.991761 Tokens per Sec: 9444, Lr: 0.000006 2020-02-13 03:24:57,449 Epoch 142 Step: 346800 Batch Loss: 1.225342 Tokens per Sec: 22922, Lr: 0.000006 2020-02-13 03:25:07,443 Epoch 142 Step: 346900 Batch Loss: 1.339152 Tokens per Sec: 22348, Lr: 0.000006 2020-02-13 03:25:17,397 Epoch 142 Step: 347000 Batch Loss: 1.149501 Tokens per Sec: 21954, Lr: 0.000006 2020-02-13 03:25:36,132 Example #0 2020-02-13 03:25:36,132 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 03:25:36,132 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 03:25:36,132 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 03:25:36,132 Reference: 10 : ​ 6 - 9 . 2020-02-13 03:25:36,132 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 03:25:36,132 Example #1 2020-02-13 03:25:36,132 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 03:25:36,132 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 03:25:36,132 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 03:25:36,133 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 03:25:36,133 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 03:25:36,133 Example #2 2020-02-13 03:25:36,133 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 03:25:36,133 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 03:25:36,133 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 03:25:36,133 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 03:25:36,133 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 03:25:36,133 Example #3 2020-02-13 03:25:36,133 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 03:25:36,133 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-13 03:25:36,133 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 03:25:36,133 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 03:25:36,133 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-13 03:25:36,133 Validation result (greedy) at epoch 142, step 347000: bleu: 30.09, loss: 38983.6680, ppl: 3.7316, duration: 18.7357s 2020-02-13 03:25:46,120 Epoch 142 Step: 347100 Batch Loss: 1.133895 Tokens per Sec: 22520, Lr: 0.000006 2020-02-13 03:25:56,273 Epoch 142 Step: 347200 Batch Loss: 1.255747 Tokens per Sec: 20655, Lr: 0.000006 2020-02-13 03:26:06,198 Epoch 142 Step: 347300 Batch Loss: 1.219186 Tokens per Sec: 22813, Lr: 0.000006 2020-02-13 03:26:16,278 Epoch 142 Step: 347400 Batch Loss: 1.172045 Tokens per Sec: 21590, Lr: 0.000006 2020-02-13 03:26:26,342 Epoch 142 Step: 347500 Batch Loss: 1.348962 Tokens per Sec: 22205, Lr: 0.000006 2020-02-13 03:26:36,440 Epoch 142 Step: 347600 Batch Loss: 1.066751 Tokens per Sec: 21913, Lr: 0.000006 2020-02-13 03:26:46,449 Epoch 142 Step: 347700 Batch Loss: 1.331768 Tokens per Sec: 21644, Lr: 0.000006 2020-02-13 03:26:56,547 Epoch 142 Step: 347800 Batch Loss: 1.358311 Tokens per Sec: 21311, Lr: 0.000006 2020-02-13 03:27:06,555 Epoch 142 Step: 347900 Batch Loss: 1.323690 Tokens per Sec: 22530, Lr: 0.000006 2020-02-13 03:27:16,439 Epoch 142 Step: 348000 Batch Loss: 1.036000 Tokens per Sec: 21765, Lr: 0.000006 2020-02-13 03:27:35,232 Hooray! New best validation result [ppl]! 2020-02-13 03:27:35,232 Saving new checkpoint. 2020-02-13 03:27:35,421 Example #0 2020-02-13 03:27:35,421 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 03:27:35,421 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 03:27:35,421 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 03:27:35,421 Reference: 10 : ​ 6 - 9 . 2020-02-13 03:27:35,421 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 03:27:35,422 Example #1 2020-02-13 03:27:35,422 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 03:27:35,422 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 03:27:35,422 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 03:27:35,422 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 03:27:35,422 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 03:27:35,422 Example #2 2020-02-13 03:27:35,422 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 03:27:35,422 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 03:27:35,422 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 03:27:35,422 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 03:27:35,422 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 03:27:35,422 Example #3 2020-02-13 03:27:35,422 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 03:27:35,422 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-13 03:27:35,422 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 03:27:35,423 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 03:27:35,423 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-13 03:27:35,423 Validation result (greedy) at epoch 142, step 348000: bleu: 30.25, loss: 38973.2734, ppl: 3.7303, duration: 18.9829s 2020-02-13 03:27:45,307 Epoch 142 Step: 348100 Batch Loss: 1.219208 Tokens per Sec: 22344, Lr: 0.000006 2020-02-13 03:27:55,282 Epoch 142 Step: 348200 Batch Loss: 1.292620 Tokens per Sec: 21784, Lr: 0.000006 2020-02-13 03:28:05,369 Epoch 142 Step: 348300 Batch Loss: 1.208328 Tokens per Sec: 21734, Lr: 0.000006 2020-02-13 03:28:15,380 Epoch 142 Step: 348400 Batch Loss: 1.277612 Tokens per Sec: 21988, Lr: 0.000006 2020-02-13 03:28:25,376 Epoch 142 Step: 348500 Batch Loss: 1.173263 Tokens per Sec: 22619, Lr: 0.000006 2020-02-13 03:28:35,269 Epoch 142 Step: 348600 Batch Loss: 0.892765 Tokens per Sec: 21953, Lr: 0.000006 2020-02-13 03:28:45,144 Epoch 142 Step: 348700 Batch Loss: 1.315611 Tokens per Sec: 22396, Lr: 0.000006 2020-02-13 03:28:55,130 Epoch 142 Step: 348800 Batch Loss: 0.856231 Tokens per Sec: 21659, Lr: 0.000006 2020-02-13 03:29:05,055 Epoch 142 Step: 348900 Batch Loss: 1.010823 Tokens per Sec: 22474, Lr: 0.000006 2020-02-13 03:29:14,914 Epoch 142 Step: 349000 Batch Loss: 1.148085 Tokens per Sec: 22774, Lr: 0.000006 2020-02-13 03:29:33,792 Example #0 2020-02-13 03:29:33,792 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 03:29:33,792 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 03:29:33,792 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 03:29:33,792 Reference: 10 : ​ 6 - 9 . 2020-02-13 03:29:33,792 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 03:29:33,792 Example #1 2020-02-13 03:29:33,792 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 03:29:33,792 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 03:29:33,793 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 03:29:33,793 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 03:29:33,793 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 03:29:33,793 Example #2 2020-02-13 03:29:33,793 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 03:29:33,793 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 03:29:33,793 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 03:29:33,793 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 03:29:33,793 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 03:29:33,793 Example #3 2020-02-13 03:29:33,793 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 03:29:33,793 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-13 03:29:33,793 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 03:29:33,793 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 03:29:33,793 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-13 03:29:33,793 Validation result (greedy) at epoch 142, step 349000: bleu: 30.16, loss: 38997.2734, ppl: 3.7333, duration: 18.8789s 2020-02-13 03:29:43,663 Epoch 142 Step: 349100 Batch Loss: 1.273457 Tokens per Sec: 22284, Lr: 0.000006 2020-02-13 03:29:49,473 Epoch 142: total training loss 3027.93 2020-02-13 03:29:49,473 EPOCH 143 2020-02-13 03:29:53,962 Epoch 143 Step: 349200 Batch Loss: 1.306099 Tokens per Sec: 20922, Lr: 0.000006 2020-02-13 03:30:04,025 Epoch 143 Step: 349300 Batch Loss: 1.088203 Tokens per Sec: 21897, Lr: 0.000006 2020-02-13 03:30:13,960 Epoch 143 Step: 349400 Batch Loss: 0.892941 Tokens per Sec: 22108, Lr: 0.000006 2020-02-13 03:30:23,990 Epoch 143 Step: 349500 Batch Loss: 1.078555 Tokens per Sec: 22339, Lr: 0.000006 2020-02-13 03:30:33,990 Epoch 143 Step: 349600 Batch Loss: 1.066249 Tokens per Sec: 21840, Lr: 0.000006 2020-02-13 03:30:44,144 Epoch 143 Step: 349700 Batch Loss: 1.162642 Tokens per Sec: 22258, Lr: 0.000006 2020-02-13 03:30:54,316 Epoch 143 Step: 349800 Batch Loss: 1.021706 Tokens per Sec: 21199, Lr: 0.000006 2020-02-13 03:31:04,491 Epoch 143 Step: 349900 Batch Loss: 1.327444 Tokens per Sec: 21945, Lr: 0.000006 2020-02-13 03:31:14,627 Epoch 143 Step: 350000 Batch Loss: 1.252263 Tokens per Sec: 22047, Lr: 0.000006 2020-02-13 03:31:33,961 Example #0 2020-02-13 03:31:33,961 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 03:31:33,961 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 03:31:33,962 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 03:31:33,962 Reference: 10 : ​ 6 - 9 . 2020-02-13 03:31:33,962 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 03:31:33,962 Example #1 2020-02-13 03:31:33,962 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 03:31:33,962 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 03:31:33,962 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 03:31:33,962 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 03:31:33,962 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 03:31:33,962 Example #2 2020-02-13 03:31:33,962 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 03:31:33,962 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 03:31:33,962 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 03:31:33,962 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 03:31:33,962 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 03:31:33,963 Example #3 2020-02-13 03:31:33,963 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 03:31:33,963 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-13 03:31:33,963 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 03:31:33,963 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 03:31:33,963 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-13 03:31:33,963 Validation result (greedy) at epoch 143, step 350000: bleu: 30.07, loss: 38990.5000, ppl: 3.7325, duration: 19.3357s 2020-02-13 03:31:44,122 Epoch 143 Step: 350100 Batch Loss: 1.343189 Tokens per Sec: 22022, Lr: 0.000006 2020-02-13 03:31:54,384 Epoch 143 Step: 350200 Batch Loss: 1.249495 Tokens per Sec: 21833, Lr: 0.000006 2020-02-13 03:32:04,546 Epoch 143 Step: 350300 Batch Loss: 1.279824 Tokens per Sec: 22386, Lr: 0.000006 2020-02-13 03:32:14,751 Epoch 143 Step: 350400 Batch Loss: 1.261269 Tokens per Sec: 21534, Lr: 0.000006 2020-02-13 03:32:24,807 Epoch 143 Step: 350500 Batch Loss: 1.242538 Tokens per Sec: 22191, Lr: 0.000006 2020-02-13 03:32:34,928 Epoch 143 Step: 350600 Batch Loss: 1.336823 Tokens per Sec: 22038, Lr: 0.000006 2020-02-13 03:32:44,992 Epoch 143 Step: 350700 Batch Loss: 1.186748 Tokens per Sec: 21354, Lr: 0.000006 2020-02-13 03:32:55,124 Epoch 143 Step: 350800 Batch Loss: 1.211106 Tokens per Sec: 21949, Lr: 0.000006 2020-02-13 03:33:05,246 Epoch 143 Step: 350900 Batch Loss: 1.324573 Tokens per Sec: 21644, Lr: 0.000006 2020-02-13 03:33:15,326 Epoch 143 Step: 351000 Batch Loss: 1.326696 Tokens per Sec: 22035, Lr: 0.000006 2020-02-13 03:33:34,080 Hooray! New best validation result [ppl]! 2020-02-13 03:33:34,081 Saving new checkpoint. 2020-02-13 03:33:34,275 Example #0 2020-02-13 03:33:34,275 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 03:33:34,275 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 03:33:34,275 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 03:33:34,275 Reference: 10 : ​ 6 - 9 . 2020-02-13 03:33:34,275 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 03:33:34,275 Example #1 2020-02-13 03:33:34,275 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 03:33:34,275 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 03:33:34,276 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 03:33:34,276 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 03:33:34,276 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 03:33:34,276 Example #2 2020-02-13 03:33:34,276 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 03:33:34,276 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 03:33:34,276 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 03:33:34,276 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 03:33:34,276 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 03:33:34,276 Example #3 2020-02-13 03:33:34,276 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 03:33:34,276 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-13 03:33:34,276 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 03:33:34,276 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 03:33:34,276 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-13 03:33:34,277 Validation result (greedy) at epoch 143, step 351000: bleu: 30.09, loss: 38969.5039, ppl: 3.7298, duration: 18.9496s 2020-02-13 03:33:44,261 Epoch 143 Step: 351100 Batch Loss: 1.152937 Tokens per Sec: 22105, Lr: 0.000006 2020-02-13 03:33:54,308 Epoch 143 Step: 351200 Batch Loss: 1.236219 Tokens per Sec: 22076, Lr: 0.000006 2020-02-13 03:34:04,233 Epoch 143 Step: 351300 Batch Loss: 1.334227 Tokens per Sec: 22621, Lr: 0.000006 2020-02-13 03:34:14,319 Epoch 143 Step: 351400 Batch Loss: 1.312032 Tokens per Sec: 22245, Lr: 0.000006 2020-02-13 03:34:24,374 Epoch 143 Step: 351500 Batch Loss: 1.162445 Tokens per Sec: 21710, Lr: 0.000006 2020-02-13 03:34:34,340 Epoch 143 Step: 351600 Batch Loss: 1.321942 Tokens per Sec: 21895, Lr: 0.000006 2020-02-13 03:34:35,340 Epoch 143: total training loss 3011.97 2020-02-13 03:34:35,340 EPOCH 144 2020-02-13 03:34:44,539 Epoch 144 Step: 351700 Batch Loss: 1.328501 Tokens per Sec: 21892, Lr: 0.000006 2020-02-13 03:34:54,535 Epoch 144 Step: 351800 Batch Loss: 1.144440 Tokens per Sec: 22739, Lr: 0.000006 2020-02-13 03:35:04,686 Epoch 144 Step: 351900 Batch Loss: 1.372385 Tokens per Sec: 21476, Lr: 0.000006 2020-02-13 03:35:14,839 Epoch 144 Step: 352000 Batch Loss: 1.191260 Tokens per Sec: 21879, Lr: 0.000006 2020-02-13 03:35:34,402 Example #0 2020-02-13 03:35:34,403 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 03:35:34,403 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 03:35:34,403 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 03:35:34,403 Reference: 10 : ​ 6 - 9 . 2020-02-13 03:35:34,403 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 03:35:34,403 Example #1 2020-02-13 03:35:34,403 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 03:35:34,403 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 03:35:34,403 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 03:35:34,403 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 03:35:34,403 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 03:35:34,403 Example #2 2020-02-13 03:35:34,404 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 03:35:34,404 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 03:35:34,404 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 03:35:34,404 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 03:35:34,404 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 03:35:34,404 Example #3 2020-02-13 03:35:34,404 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 03:35:34,404 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-13 03:35:34,404 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 03:35:34,404 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 03:35:34,404 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-13 03:35:34,404 Validation result (greedy) at epoch 144, step 352000: bleu: 30.10, loss: 38990.2578, ppl: 3.7324, duration: 19.5650s 2020-02-13 03:35:44,657 Epoch 144 Step: 352100 Batch Loss: 1.260751 Tokens per Sec: 21546, Lr: 0.000006 2020-02-13 03:35:54,908 Epoch 144 Step: 352200 Batch Loss: 1.316102 Tokens per Sec: 21209, Lr: 0.000006 2020-02-13 03:36:04,912 Epoch 144 Step: 352300 Batch Loss: 1.228550 Tokens per Sec: 22006, Lr: 0.000006 2020-02-13 03:36:14,829 Epoch 144 Step: 352400 Batch Loss: 1.064736 Tokens per Sec: 22360, Lr: 0.000006 2020-02-13 03:36:24,907 Epoch 144 Step: 352500 Batch Loss: 1.398965 Tokens per Sec: 21569, Lr: 0.000006 2020-02-13 03:36:34,858 Epoch 144 Step: 352600 Batch Loss: 1.320586 Tokens per Sec: 22680, Lr: 0.000006 2020-02-13 03:36:44,753 Epoch 144 Step: 352700 Batch Loss: 1.271117 Tokens per Sec: 22510, Lr: 0.000006 2020-02-13 03:36:54,688 Epoch 144 Step: 352800 Batch Loss: 1.567363 Tokens per Sec: 22201, Lr: 0.000006 2020-02-13 03:37:04,613 Epoch 144 Step: 352900 Batch Loss: 1.305658 Tokens per Sec: 22390, Lr: 0.000006 2020-02-13 03:37:14,555 Epoch 144 Step: 353000 Batch Loss: 1.318461 Tokens per Sec: 22364, Lr: 0.000006 2020-02-13 03:37:33,988 Example #0 2020-02-13 03:37:33,988 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 03:37:33,988 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 03:37:33,988 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 03:37:33,988 Reference: 10 : ​ 6 - 9 . 2020-02-13 03:37:33,988 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 03:37:33,989 Example #1 2020-02-13 03:37:33,989 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 03:37:33,989 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 03:37:33,989 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 03:37:33,989 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 03:37:33,989 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 03:37:33,989 Example #2 2020-02-13 03:37:33,989 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 03:37:33,989 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 03:37:33,989 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 03:37:33,989 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 03:37:33,989 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 03:37:33,989 Example #3 2020-02-13 03:37:33,989 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 03:37:33,989 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-13 03:37:33,990 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 03:37:33,990 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 03:37:33,990 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-13 03:37:33,990 Validation result (greedy) at epoch 144, step 353000: bleu: 30.08, loss: 38980.9102, ppl: 3.7313, duration: 19.4346s 2020-02-13 03:37:43,854 Epoch 144 Step: 353100 Batch Loss: 1.326486 Tokens per Sec: 22128, Lr: 0.000006 2020-02-13 03:37:53,815 Epoch 144 Step: 353200 Batch Loss: 0.979620 Tokens per Sec: 21751, Lr: 0.000006 2020-02-13 03:38:03,719 Epoch 144 Step: 353300 Batch Loss: 0.868787 Tokens per Sec: 22408, Lr: 0.000006 2020-02-13 03:38:13,575 Epoch 144 Step: 353400 Batch Loss: 1.360703 Tokens per Sec: 22192, Lr: 0.000006 2020-02-13 03:38:23,721 Epoch 144 Step: 353500 Batch Loss: 1.226915 Tokens per Sec: 21883, Lr: 0.000006 2020-02-13 03:38:33,767 Epoch 144 Step: 353600 Batch Loss: 1.079561 Tokens per Sec: 21549, Lr: 0.000006 2020-02-13 03:38:43,757 Epoch 144 Step: 353700 Batch Loss: 1.350982 Tokens per Sec: 22157, Lr: 0.000006 2020-02-13 03:38:53,654 Epoch 144 Step: 353800 Batch Loss: 1.290971 Tokens per Sec: 22188, Lr: 0.000006 2020-02-13 03:39:03,547 Epoch 144 Step: 353900 Batch Loss: 1.034181 Tokens per Sec: 22398, Lr: 0.000006 2020-02-13 03:39:13,438 Epoch 144 Step: 354000 Batch Loss: 1.159908 Tokens per Sec: 22299, Lr: 0.000006 2020-02-13 03:39:32,224 Example #0 2020-02-13 03:39:32,224 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 03:39:32,225 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 03:39:32,225 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 03:39:32,225 Reference: 10 : ​ 6 - 9 . 2020-02-13 03:39:32,225 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 03:39:32,225 Example #1 2020-02-13 03:39:32,225 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 03:39:32,225 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 03:39:32,225 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 03:39:32,225 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 03:39:32,225 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 03:39:32,225 Example #2 2020-02-13 03:39:32,225 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 03:39:32,225 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 03:39:32,225 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 03:39:32,226 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 03:39:32,226 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 03:39:32,226 Example #3 2020-02-13 03:39:32,226 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 03:39:32,226 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-13 03:39:32,226 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 03:39:32,226 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 03:39:32,226 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-13 03:39:32,226 Validation result (greedy) at epoch 144, step 354000: bleu: 30.04, loss: 38989.5781, ppl: 3.7323, duration: 18.7871s 2020-02-13 03:39:39,166 Epoch 144: total training loss 3017.26 2020-02-13 03:39:39,166 EPOCH 145 2020-02-13 03:39:42,390 Epoch 145 Step: 354100 Batch Loss: 1.290571 Tokens per Sec: 21016, Lr: 0.000006 2020-02-13 03:39:52,537 Epoch 145 Step: 354200 Batch Loss: 1.242559 Tokens per Sec: 22475, Lr: 0.000006 2020-02-13 03:40:02,651 Epoch 145 Step: 354300 Batch Loss: 1.278553 Tokens per Sec: 21052, Lr: 0.000006 2020-02-13 03:40:12,822 Epoch 145 Step: 354400 Batch Loss: 1.148555 Tokens per Sec: 21622, Lr: 0.000006 2020-02-13 03:40:22,956 Epoch 145 Step: 354500 Batch Loss: 1.124896 Tokens per Sec: 21832, Lr: 0.000006 2020-02-13 03:40:33,173 Epoch 145 Step: 354600 Batch Loss: 1.332148 Tokens per Sec: 21455, Lr: 0.000006 2020-02-13 03:40:43,281 Epoch 145 Step: 354700 Batch Loss: 1.175773 Tokens per Sec: 22458, Lr: 0.000006 2020-02-13 03:40:53,428 Epoch 145 Step: 354800 Batch Loss: 1.297041 Tokens per Sec: 21864, Lr: 0.000006 2020-02-13 03:41:03,424 Epoch 145 Step: 354900 Batch Loss: 1.219896 Tokens per Sec: 21799, Lr: 0.000006 2020-02-13 03:41:13,399 Epoch 145 Step: 355000 Batch Loss: 1.261921 Tokens per Sec: 22533, Lr: 0.000006 2020-02-13 03:41:32,297 Example #0 2020-02-13 03:41:32,297 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 03:41:32,297 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 03:41:32,297 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 03:41:32,297 Reference: 10 : ​ 6 - 9 . 2020-02-13 03:41:32,297 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 03:41:32,298 Example #1 2020-02-13 03:41:32,298 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 03:41:32,298 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 03:41:32,298 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 03:41:32,298 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 03:41:32,298 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 03:41:32,298 Example #2 2020-02-13 03:41:32,298 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 03:41:32,298 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 03:41:32,298 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 03:41:32,298 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 03:41:32,298 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 03:41:32,298 Example #3 2020-02-13 03:41:32,298 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 03:41:32,298 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-13 03:41:32,298 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 03:41:32,299 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 03:41:32,299 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-13 03:41:32,299 Validation result (greedy) at epoch 145, step 355000: bleu: 30.03, loss: 38996.7539, ppl: 3.7333, duration: 18.8995s 2020-02-13 03:41:42,185 Epoch 145 Step: 355100 Batch Loss: 1.304175 Tokens per Sec: 22316, Lr: 0.000006 2020-02-13 03:41:52,089 Epoch 145 Step: 355200 Batch Loss: 1.286616 Tokens per Sec: 22273, Lr: 0.000006 2020-02-13 03:42:01,947 Epoch 145 Step: 355300 Batch Loss: 1.299716 Tokens per Sec: 22603, Lr: 0.000006 2020-02-13 03:42:11,801 Epoch 145 Step: 355400 Batch Loss: 1.313183 Tokens per Sec: 22214, Lr: 0.000006 2020-02-13 03:42:21,749 Epoch 145 Step: 355500 Batch Loss: 1.154320 Tokens per Sec: 22241, Lr: 0.000006 2020-02-13 03:42:31,748 Epoch 145 Step: 355600 Batch Loss: 1.238377 Tokens per Sec: 21865, Lr: 0.000006 2020-02-13 03:42:41,594 Epoch 145 Step: 355700 Batch Loss: 1.275642 Tokens per Sec: 22695, Lr: 0.000006 2020-02-13 03:42:51,559 Epoch 145 Step: 355800 Batch Loss: 1.384052 Tokens per Sec: 22016, Lr: 0.000006 2020-02-13 03:43:01,440 Epoch 145 Step: 355900 Batch Loss: 1.197991 Tokens per Sec: 21913, Lr: 0.000006 2020-02-13 03:43:11,355 Epoch 145 Step: 356000 Batch Loss: 1.390451 Tokens per Sec: 22477, Lr: 0.000006 2020-02-13 03:43:30,354 Example #0 2020-02-13 03:43:30,354 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 03:43:30,354 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 03:43:30,354 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 03:43:30,354 Reference: 10 : ​ 6 - 9 . 2020-02-13 03:43:30,355 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 03:43:30,355 Example #1 2020-02-13 03:43:30,355 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 03:43:30,355 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 03:43:30,355 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 03:43:30,355 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 03:43:30,355 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 03:43:30,355 Example #2 2020-02-13 03:43:30,355 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 03:43:30,355 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 03:43:30,355 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 03:43:30,355 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 03:43:30,355 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 03:43:30,356 Example #3 2020-02-13 03:43:30,356 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 03:43:30,356 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-13 03:43:30,356 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 03:43:30,356 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 03:43:30,356 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-13 03:43:30,356 Validation result (greedy) at epoch 145, step 356000: bleu: 30.04, loss: 38981.0898, ppl: 3.7313, duration: 19.0003s 2020-02-13 03:43:40,278 Epoch 145 Step: 356100 Batch Loss: 1.020237 Tokens per Sec: 22369, Lr: 0.000006 2020-02-13 03:43:50,223 Epoch 145 Step: 356200 Batch Loss: 1.340286 Tokens per Sec: 22223, Lr: 0.000006 2020-02-13 03:44:00,125 Epoch 145 Step: 356300 Batch Loss: 1.313858 Tokens per Sec: 22401, Lr: 0.000006 2020-02-13 03:44:10,059 Epoch 145 Step: 356400 Batch Loss: 1.206853 Tokens per Sec: 22740, Lr: 0.000006 2020-02-13 03:44:19,943 Epoch 145 Step: 356500 Batch Loss: 0.990912 Tokens per Sec: 22478, Lr: 0.000006 2020-02-13 03:44:22,417 Epoch 145: total training loss 3013.61 2020-02-13 03:44:22,417 EPOCH 146 2020-02-13 03:44:30,110 Epoch 146 Step: 356600 Batch Loss: 1.144096 Tokens per Sec: 21375, Lr: 0.000006 2020-02-13 03:44:40,091 Epoch 146 Step: 356700 Batch Loss: 1.205438 Tokens per Sec: 22273, Lr: 0.000006 2020-02-13 03:44:50,042 Epoch 146 Step: 356800 Batch Loss: 1.222136 Tokens per Sec: 21196, Lr: 0.000006 2020-02-13 03:44:59,968 Epoch 146 Step: 356900 Batch Loss: 1.207918 Tokens per Sec: 22350, Lr: 0.000006 2020-02-13 03:45:09,880 Epoch 146 Step: 357000 Batch Loss: 1.005498 Tokens per Sec: 21841, Lr: 0.000006 2020-02-13 03:45:29,012 Example #0 2020-02-13 03:45:29,013 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 03:45:29,013 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 03:45:29,013 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 03:45:29,013 Reference: 10 : ​ 6 - 9 . 2020-02-13 03:45:29,013 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 03:45:29,013 Example #1 2020-02-13 03:45:29,013 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 03:45:29,013 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 03:45:29,013 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 03:45:29,013 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 03:45:29,013 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 03:45:29,013 Example #2 2020-02-13 03:45:29,013 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 03:45:29,014 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 03:45:29,014 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 03:45:29,014 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 03:45:29,014 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 03:45:29,014 Example #3 2020-02-13 03:45:29,014 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 03:45:29,014 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-13 03:45:29,014 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 03:45:29,014 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 03:45:29,014 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-13 03:45:29,014 Validation result (greedy) at epoch 146, step 357000: bleu: 30.20, loss: 38993.3984, ppl: 3.7328, duration: 19.1336s 2020-02-13 03:45:38,960 Epoch 146 Step: 357100 Batch Loss: 1.216455 Tokens per Sec: 22080, Lr: 0.000004 2020-02-13 03:45:48,893 Epoch 146 Step: 357200 Batch Loss: 1.072734 Tokens per Sec: 22256, Lr: 0.000004 2020-02-13 03:45:58,779 Epoch 146 Step: 357300 Batch Loss: 1.207281 Tokens per Sec: 22736, Lr: 0.000004 2020-02-13 03:46:08,754 Epoch 146 Step: 357400 Batch Loss: 1.257297 Tokens per Sec: 22068, Lr: 0.000004 2020-02-13 03:46:18,631 Epoch 146 Step: 357500 Batch Loss: 1.190617 Tokens per Sec: 22673, Lr: 0.000004 2020-02-13 03:46:28,517 Epoch 146 Step: 357600 Batch Loss: 1.202441 Tokens per Sec: 21894, Lr: 0.000004 2020-02-13 03:46:38,586 Epoch 146 Step: 357700 Batch Loss: 0.954987 Tokens per Sec: 22240, Lr: 0.000004 2020-02-13 03:46:48,862 Epoch 146 Step: 357800 Batch Loss: 1.214005 Tokens per Sec: 21765, Lr: 0.000004 2020-02-13 03:46:58,796 Epoch 146 Step: 357900 Batch Loss: 1.158072 Tokens per Sec: 22563, Lr: 0.000004 2020-02-13 03:47:08,808 Epoch 146 Step: 358000 Batch Loss: 1.057624 Tokens per Sec: 22219, Lr: 0.000004 2020-02-13 03:47:27,942 Example #0 2020-02-13 03:47:27,942 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 03:47:27,942 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 03:47:27,942 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 03:47:27,942 Reference: 10 : ​ 6 - 9 . 2020-02-13 03:47:27,942 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 03:47:27,942 Example #1 2020-02-13 03:47:27,942 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 03:47:27,942 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 03:47:27,942 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 03:47:27,942 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 03:47:27,943 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 03:47:27,943 Example #2 2020-02-13 03:47:27,943 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 03:47:27,943 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 03:47:27,943 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 03:47:27,943 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 03:47:27,943 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 03:47:27,943 Example #3 2020-02-13 03:47:27,943 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 03:47:27,943 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-13 03:47:27,943 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 03:47:27,943 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 03:47:27,943 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-13 03:47:27,943 Validation result (greedy) at epoch 146, step 358000: bleu: 30.21, loss: 38985.8984, ppl: 3.7319, duration: 19.1351s 2020-02-13 03:47:37,896 Epoch 146 Step: 358100 Batch Loss: 1.315599 Tokens per Sec: 22057, Lr: 0.000004 2020-02-13 03:47:47,851 Epoch 146 Step: 358200 Batch Loss: 1.022536 Tokens per Sec: 21810, Lr: 0.000004 2020-02-13 03:47:57,759 Epoch 146 Step: 358300 Batch Loss: 1.241705 Tokens per Sec: 22474, Lr: 0.000004 2020-02-13 03:48:07,675 Epoch 146 Step: 358400 Batch Loss: 1.332659 Tokens per Sec: 22827, Lr: 0.000004 2020-02-13 03:48:17,587 Epoch 146 Step: 358500 Batch Loss: 1.244100 Tokens per Sec: 21887, Lr: 0.000004 2020-02-13 03:48:27,589 Epoch 146 Step: 358600 Batch Loss: 1.330001 Tokens per Sec: 21782, Lr: 0.000004 2020-02-13 03:48:37,546 Epoch 146 Step: 358700 Batch Loss: 1.096525 Tokens per Sec: 22119, Lr: 0.000004 2020-02-13 03:48:47,856 Epoch 146 Step: 358800 Batch Loss: 1.253550 Tokens per Sec: 21562, Lr: 0.000004 2020-02-13 03:48:57,941 Epoch 146 Step: 358900 Batch Loss: 1.281978 Tokens per Sec: 21715, Lr: 0.000004 2020-02-13 03:49:06,786 Epoch 146: total training loss 3019.90 2020-02-13 03:49:06,786 EPOCH 147 2020-02-13 03:49:08,380 Epoch 147 Step: 359000 Batch Loss: 1.270052 Tokens per Sec: 17675, Lr: 0.000004 2020-02-13 03:49:28,058 Example #0 2020-02-13 03:49:28,058 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 03:49:28,058 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 03:49:28,058 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 03:49:28,058 Reference: 10 : ​ 6 - 9 . 2020-02-13 03:49:28,058 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 03:49:28,058 Example #1 2020-02-13 03:49:28,058 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 03:49:28,059 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 03:49:28,059 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 03:49:28,059 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 03:49:28,059 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 03:49:28,059 Example #2 2020-02-13 03:49:28,059 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 03:49:28,059 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 03:49:28,059 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 03:49:28,059 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 03:49:28,059 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 03:49:28,059 Example #3 2020-02-13 03:49:28,059 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 03:49:28,059 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-13 03:49:28,059 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 03:49:28,059 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 03:49:28,059 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-13 03:49:28,060 Validation result (greedy) at epoch 147, step 359000: bleu: 30.12, loss: 38976.9062, ppl: 3.7308, duration: 19.6792s 2020-02-13 03:49:38,112 Epoch 147 Step: 359100 Batch Loss: 1.130186 Tokens per Sec: 22083, Lr: 0.000004 2020-02-13 03:49:48,192 Epoch 147 Step: 359200 Batch Loss: 1.285860 Tokens per Sec: 21725, Lr: 0.000004 2020-02-13 03:49:58,251 Epoch 147 Step: 359300 Batch Loss: 1.240084 Tokens per Sec: 21695, Lr: 0.000004 2020-02-13 03:50:08,351 Epoch 147 Step: 359400 Batch Loss: 1.116415 Tokens per Sec: 21495, Lr: 0.000004 2020-02-13 03:50:18,186 Epoch 147 Step: 359500 Batch Loss: 1.342743 Tokens per Sec: 22383, Lr: 0.000004 2020-02-13 03:50:28,255 Epoch 147 Step: 359600 Batch Loss: 1.146647 Tokens per Sec: 22122, Lr: 0.000004 2020-02-13 03:50:38,317 Epoch 147 Step: 359700 Batch Loss: 1.438845 Tokens per Sec: 21858, Lr: 0.000004 2020-02-13 03:50:48,325 Epoch 147 Step: 359800 Batch Loss: 1.030866 Tokens per Sec: 22059, Lr: 0.000004 2020-02-13 03:50:58,420 Epoch 147 Step: 359900 Batch Loss: 1.348114 Tokens per Sec: 22164, Lr: 0.000004 2020-02-13 03:51:08,553 Epoch 147 Step: 360000 Batch Loss: 1.306784 Tokens per Sec: 21803, Lr: 0.000004 2020-02-13 03:51:28,175 Hooray! New best validation result [ppl]! 2020-02-13 03:51:28,176 Saving new checkpoint. 2020-02-13 03:51:28,369 Example #0 2020-02-13 03:51:28,369 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 03:51:28,369 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 03:51:28,370 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 03:51:28,370 Reference: 10 : ​ 6 - 9 . 2020-02-13 03:51:28,370 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 03:51:28,370 Example #1 2020-02-13 03:51:28,370 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 03:51:28,370 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 03:51:28,370 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 03:51:28,370 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 03:51:28,370 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 03:51:28,370 Example #2 2020-02-13 03:51:28,370 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 03:51:28,370 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 03:51:28,370 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 03:51:28,370 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 03:51:28,371 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 03:51:28,371 Example #3 2020-02-13 03:51:28,371 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 03:51:28,371 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-13 03:51:28,371 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 03:51:28,371 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 03:51:28,371 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-13 03:51:28,371 Validation result (greedy) at epoch 147, step 360000: bleu: 30.08, loss: 38968.8516, ppl: 3.7297, duration: 19.8169s 2020-02-13 03:51:38,514 Epoch 147 Step: 360100 Batch Loss: 1.038370 Tokens per Sec: 22110, Lr: 0.000004 2020-02-13 03:51:48,472 Epoch 147 Step: 360200 Batch Loss: 1.179284 Tokens per Sec: 21815, Lr: 0.000004 2020-02-13 03:51:58,332 Epoch 147 Step: 360300 Batch Loss: 1.029230 Tokens per Sec: 22460, Lr: 0.000004 2020-02-13 03:52:08,203 Epoch 147 Step: 360400 Batch Loss: 0.924054 Tokens per Sec: 22126, Lr: 0.000004 2020-02-13 03:52:18,095 Epoch 147 Step: 360500 Batch Loss: 1.332751 Tokens per Sec: 22302, Lr: 0.000004 2020-02-13 03:52:27,968 Epoch 147 Step: 360600 Batch Loss: 1.334231 Tokens per Sec: 22469, Lr: 0.000004 2020-02-13 03:52:37,846 Epoch 147 Step: 360700 Batch Loss: 1.067776 Tokens per Sec: 21967, Lr: 0.000004 2020-02-13 03:52:47,777 Epoch 147 Step: 360800 Batch Loss: 1.347965 Tokens per Sec: 22345, Lr: 0.000004 2020-02-13 03:52:57,780 Epoch 147 Step: 360900 Batch Loss: 1.136800 Tokens per Sec: 21895, Lr: 0.000004 2020-02-13 03:53:07,786 Epoch 147 Step: 361000 Batch Loss: 1.320621 Tokens per Sec: 22219, Lr: 0.000004 2020-02-13 03:53:27,165 Example #0 2020-02-13 03:53:27,165 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 03:53:27,165 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 03:53:27,165 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 03:53:27,166 Reference: 10 : ​ 6 - 9 . 2020-02-13 03:53:27,166 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 03:53:27,166 Example #1 2020-02-13 03:53:27,166 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 03:53:27,166 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 03:53:27,166 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 03:53:27,166 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 03:53:27,166 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 03:53:27,166 Example #2 2020-02-13 03:53:27,166 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 03:53:27,166 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 03:53:27,166 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 03:53:27,166 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 03:53:27,166 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 03:53:27,166 Example #3 2020-02-13 03:53:27,167 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 03:53:27,167 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-13 03:53:27,167 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 03:53:27,167 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 03:53:27,167 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-13 03:53:27,167 Validation result (greedy) at epoch 147, step 361000: bleu: 30.03, loss: 38975.4648, ppl: 3.7306, duration: 19.3799s 2020-02-13 03:53:37,246 Epoch 147 Step: 361100 Batch Loss: 1.063520 Tokens per Sec: 21600, Lr: 0.000004 2020-02-13 03:53:47,382 Epoch 147 Step: 361200 Batch Loss: 1.304870 Tokens per Sec: 22195, Lr: 0.000004 2020-02-13 03:53:57,478 Epoch 147 Step: 361300 Batch Loss: 1.170152 Tokens per Sec: 22071, Lr: 0.000004 2020-02-13 03:54:07,598 Epoch 147 Step: 361400 Batch Loss: 1.366774 Tokens per Sec: 21364, Lr: 0.000004 2020-02-13 03:54:12,655 Epoch 147: total training loss 3022.64 2020-02-13 03:54:12,655 EPOCH 148 2020-02-13 03:54:17,951 Epoch 148 Step: 361500 Batch Loss: 1.233535 Tokens per Sec: 20589, Lr: 0.000004 2020-02-13 03:54:28,129 Epoch 148 Step: 361600 Batch Loss: 1.295693 Tokens per Sec: 21888, Lr: 0.000004 2020-02-13 03:54:38,064 Epoch 148 Step: 361700 Batch Loss: 1.427006 Tokens per Sec: 22122, Lr: 0.000004 2020-02-13 03:54:48,051 Epoch 148 Step: 361800 Batch Loss: 1.332480 Tokens per Sec: 22384, Lr: 0.000004 2020-02-13 03:54:58,150 Epoch 148 Step: 361900 Batch Loss: 1.373642 Tokens per Sec: 22577, Lr: 0.000004 2020-02-13 03:55:08,403 Epoch 148 Step: 362000 Batch Loss: 1.313516 Tokens per Sec: 21478, Lr: 0.000004 2020-02-13 03:55:28,055 Example #0 2020-02-13 03:55:28,055 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 03:55:28,055 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 03:55:28,055 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 03:55:28,055 Reference: 10 : ​ 6 - 9 . 2020-02-13 03:55:28,055 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 03:55:28,055 Example #1 2020-02-13 03:55:28,056 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 03:55:28,056 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 03:55:28,056 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 03:55:28,056 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 03:55:28,056 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 03:55:28,056 Example #2 2020-02-13 03:55:28,056 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 03:55:28,056 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 03:55:28,056 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 03:55:28,056 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 03:55:28,056 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 03:55:28,056 Example #3 2020-02-13 03:55:28,056 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 03:55:28,056 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-13 03:55:28,056 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 03:55:28,057 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 03:55:28,057 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-13 03:55:28,057 Validation result (greedy) at epoch 148, step 362000: bleu: 30.13, loss: 38981.8867, ppl: 3.7314, duration: 19.6533s 2020-02-13 03:55:38,141 Epoch 148 Step: 362100 Batch Loss: 1.078503 Tokens per Sec: 22137, Lr: 0.000004 2020-02-13 03:55:48,255 Epoch 148 Step: 362200 Batch Loss: 1.012638 Tokens per Sec: 22163, Lr: 0.000004 2020-02-13 03:55:58,391 Epoch 148 Step: 362300 Batch Loss: 0.924040 Tokens per Sec: 22010, Lr: 0.000004 2020-02-13 03:56:08,394 Epoch 148 Step: 362400 Batch Loss: 1.329478 Tokens per Sec: 22296, Lr: 0.000004 2020-02-13 03:56:18,379 Epoch 148 Step: 362500 Batch Loss: 0.854609 Tokens per Sec: 21646, Lr: 0.000004 2020-02-13 03:56:28,318 Epoch 148 Step: 362600 Batch Loss: 1.373902 Tokens per Sec: 22545, Lr: 0.000004 2020-02-13 03:56:38,326 Epoch 148 Step: 362700 Batch Loss: 1.321980 Tokens per Sec: 21732, Lr: 0.000004 2020-02-13 03:56:48,354 Epoch 148 Step: 362800 Batch Loss: 1.285666 Tokens per Sec: 21953, Lr: 0.000004 2020-02-13 03:56:58,361 Epoch 148 Step: 362900 Batch Loss: 1.321591 Tokens per Sec: 22027, Lr: 0.000004 2020-02-13 03:57:08,440 Epoch 148 Step: 363000 Batch Loss: 1.094989 Tokens per Sec: 22186, Lr: 0.000004 2020-02-13 03:57:27,994 Example #0 2020-02-13 03:57:27,994 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 03:57:27,994 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 03:57:27,994 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 03:57:27,994 Reference: 10 : ​ 6 - 9 . 2020-02-13 03:57:27,994 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 03:57:27,995 Example #1 2020-02-13 03:57:27,995 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 03:57:27,995 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 03:57:27,995 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 03:57:27,995 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 03:57:27,995 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 03:57:27,995 Example #2 2020-02-13 03:57:27,995 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 03:57:27,995 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 03:57:27,995 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 03:57:27,995 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 03:57:27,995 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 03:57:27,995 Example #3 2020-02-13 03:57:27,995 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 03:57:27,995 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-13 03:57:27,996 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 03:57:27,996 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 03:57:27,996 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-13 03:57:27,996 Validation result (greedy) at epoch 148, step 363000: bleu: 30.03, loss: 38988.3984, ppl: 3.7322, duration: 19.5549s 2020-02-13 03:57:38,069 Epoch 148 Step: 363100 Batch Loss: 1.257452 Tokens per Sec: 21790, Lr: 0.000003 2020-02-13 03:57:48,202 Epoch 148 Step: 363200 Batch Loss: 1.466649 Tokens per Sec: 21533, Lr: 0.000003 2020-02-13 03:57:58,350 Epoch 148 Step: 363300 Batch Loss: 1.279112 Tokens per Sec: 22104, Lr: 0.000003 2020-02-13 03:58:08,363 Epoch 148 Step: 363400 Batch Loss: 1.313987 Tokens per Sec: 21767, Lr: 0.000003 2020-02-13 03:58:18,288 Epoch 148 Step: 363500 Batch Loss: 1.188464 Tokens per Sec: 22325, Lr: 0.000003 2020-02-13 03:58:28,256 Epoch 148 Step: 363600 Batch Loss: 1.234754 Tokens per Sec: 22253, Lr: 0.000003 2020-02-13 03:58:38,276 Epoch 148 Step: 363700 Batch Loss: 1.370557 Tokens per Sec: 22210, Lr: 0.000003 2020-02-13 03:58:48,261 Epoch 148 Step: 363800 Batch Loss: 1.247212 Tokens per Sec: 21286, Lr: 0.000003 2020-02-13 03:58:58,178 Epoch 148 Step: 363900 Batch Loss: 1.307513 Tokens per Sec: 22047, Lr: 0.000003 2020-02-13 03:58:58,971 Epoch 148: total training loss 3016.07 2020-02-13 03:58:58,971 EPOCH 149 2020-02-13 03:59:08,360 Epoch 149 Step: 364000 Batch Loss: 0.819529 Tokens per Sec: 21577, Lr: 0.000003 2020-02-13 03:59:27,026 Example #0 2020-02-13 03:59:27,026 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 03:59:27,026 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 03:59:27,026 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 03:59:27,026 Reference: 10 : ​ 6 - 9 . 2020-02-13 03:59:27,026 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 03:59:27,027 Example #1 2020-02-13 03:59:27,027 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 03:59:27,027 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 03:59:27,027 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 03:59:27,027 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 03:59:27,027 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 03:59:27,027 Example #2 2020-02-13 03:59:27,027 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 03:59:27,027 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 03:59:27,027 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 03:59:27,027 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 03:59:27,027 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 03:59:27,027 Example #3 2020-02-13 03:59:27,027 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 03:59:27,027 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-13 03:59:27,027 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 03:59:27,028 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 03:59:27,028 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-13 03:59:27,028 Validation result (greedy) at epoch 149, step 364000: bleu: 30.06, loss: 38973.6172, ppl: 3.7303, duration: 18.6669s 2020-02-13 03:59:36,916 Epoch 149 Step: 364100 Batch Loss: 1.113928 Tokens per Sec: 22443, Lr: 0.000003 2020-02-13 03:59:46,798 Epoch 149 Step: 364200 Batch Loss: 0.762830 Tokens per Sec: 22655, Lr: 0.000003 2020-02-13 03:59:56,638 Epoch 149 Step: 364300 Batch Loss: 1.117878 Tokens per Sec: 22405, Lr: 0.000003 2020-02-13 04:00:06,473 Epoch 149 Step: 364400 Batch Loss: 1.161033 Tokens per Sec: 22653, Lr: 0.000003 2020-02-13 04:00:16,311 Epoch 149 Step: 364500 Batch Loss: 1.320438 Tokens per Sec: 22641, Lr: 0.000003 2020-02-13 04:00:26,259 Epoch 149 Step: 364600 Batch Loss: 1.343564 Tokens per Sec: 22175, Lr: 0.000003 2020-02-13 04:00:36,103 Epoch 149 Step: 364700 Batch Loss: 1.325870 Tokens per Sec: 22360, Lr: 0.000003 2020-02-13 04:00:45,951 Epoch 149 Step: 364800 Batch Loss: 1.282765 Tokens per Sec: 22406, Lr: 0.000003 2020-02-13 04:00:55,815 Epoch 149 Step: 364900 Batch Loss: 1.135351 Tokens per Sec: 22485, Lr: 0.000003 2020-02-13 04:01:05,647 Epoch 149 Step: 365000 Batch Loss: 1.380826 Tokens per Sec: 22419, Lr: 0.000003 2020-02-13 04:01:24,624 Hooray! New best validation result [ppl]! 2020-02-13 04:01:24,624 Saving new checkpoint. 2020-02-13 04:01:24,823 Example #0 2020-02-13 04:01:24,823 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 04:01:24,824 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 04:01:24,824 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 04:01:24,824 Reference: 10 : ​ 6 - 9 . 2020-02-13 04:01:24,824 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 04:01:24,824 Example #1 2020-02-13 04:01:24,824 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 04:01:24,824 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 04:01:24,824 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 04:01:24,824 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 04:01:24,824 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 04:01:24,824 Example #2 2020-02-13 04:01:24,824 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 04:01:24,824 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 04:01:24,824 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 04:01:24,824 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 04:01:24,825 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 04:01:24,825 Example #3 2020-02-13 04:01:24,825 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 04:01:24,825 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-13 04:01:24,825 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 04:01:24,825 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 04:01:24,825 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-13 04:01:24,825 Validation result (greedy) at epoch 149, step 365000: bleu: 30.11, loss: 38963.6055, ppl: 3.7291, duration: 19.1774s 2020-02-13 04:01:34,647 Epoch 149 Step: 365100 Batch Loss: 1.232282 Tokens per Sec: 22999, Lr: 0.000003 2020-02-13 04:01:44,474 Epoch 149 Step: 365200 Batch Loss: 1.345421 Tokens per Sec: 22525, Lr: 0.000003 2020-02-13 04:01:54,360 Epoch 149 Step: 365300 Batch Loss: 1.162548 Tokens per Sec: 22209, Lr: 0.000003 2020-02-13 04:02:04,201 Epoch 149 Step: 365400 Batch Loss: 1.225146 Tokens per Sec: 22173, Lr: 0.000003 2020-02-13 04:02:14,180 Epoch 149 Step: 365500 Batch Loss: 1.183237 Tokens per Sec: 22476, Lr: 0.000003 2020-02-13 04:02:24,092 Epoch 149 Step: 365600 Batch Loss: 1.401037 Tokens per Sec: 22650, Lr: 0.000003 2020-02-13 04:02:34,035 Epoch 149 Step: 365700 Batch Loss: 1.298660 Tokens per Sec: 22724, Lr: 0.000003 2020-02-13 04:02:44,054 Epoch 149 Step: 365800 Batch Loss: 1.347122 Tokens per Sec: 22044, Lr: 0.000003 2020-02-13 04:02:53,982 Epoch 149 Step: 365900 Batch Loss: 1.446078 Tokens per Sec: 21592, Lr: 0.000003 2020-02-13 04:03:03,916 Epoch 149 Step: 366000 Batch Loss: 1.357218 Tokens per Sec: 21937, Lr: 0.000003 2020-02-13 04:03:22,985 Example #0 2020-02-13 04:03:22,985 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 04:03:22,985 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'hen', 'atô', 've', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'vesen', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 04:03:22,985 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 04:03:22,985 Reference: 10 : ​ 6 - 9 . 2020-02-13 04:03:22,985 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu hen atô ve la her shi vea za hemen u lun a dooshima u a lu vesen la her . — Marku 10 : 6 - 9 . 2020-02-13 04:03:22,986 Example #1 2020-02-13 04:03:22,986 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 04:03:22,986 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 04:03:22,986 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 04:03:22,986 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 04:03:22,986 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 04:03:22,986 Example #2 2020-02-13 04:03:22,986 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 04:03:22,986 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 04:03:22,986 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 04:03:22,986 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 04:03:22,986 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 04:03:22,986 Example #3 2020-02-13 04:03:22,986 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 04:03:22,986 Raw hypothesis: ['Alaghga', 'or', 'u', 'nan', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', 'yô', '.'] 2020-02-13 04:03:22,986 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 04:03:22,987 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 04:03:22,987 Hypothesis: Alaghga or u nan lu eren kwagh sha gbenda u vough ga yô . 2020-02-13 04:03:22,987 Validation result (greedy) at epoch 149, step 366000: bleu: 30.02, loss: 38973.3828, ppl: 3.7303, duration: 19.0704s 2020-02-13 04:03:32,866 Epoch 149 Step: 366100 Batch Loss: 0.992244 Tokens per Sec: 22358, Lr: 0.000003 2020-02-13 04:03:42,800 Epoch 149 Step: 366200 Batch Loss: 1.092835 Tokens per Sec: 21884, Lr: 0.000003 2020-02-13 04:03:52,768 Epoch 149 Step: 366300 Batch Loss: 1.355949 Tokens per Sec: 22604, Lr: 0.000003 2020-02-13 04:03:58,899 Epoch 149: total training loss 3010.80 2020-02-13 04:03:58,899 EPOCH 150 2020-02-13 04:04:02,946 Epoch 150 Step: 366400 Batch Loss: 1.398919 Tokens per Sec: 20902, Lr: 0.000003 2020-02-13 04:04:12,789 Epoch 150 Step: 366500 Batch Loss: 1.243339 Tokens per Sec: 22781, Lr: 0.000003 2020-02-13 04:04:22,662 Epoch 150 Step: 366600 Batch Loss: 1.375022 Tokens per Sec: 22210, Lr: 0.000003 2020-02-13 04:04:32,660 Epoch 150 Step: 366700 Batch Loss: 1.306185 Tokens per Sec: 22367, Lr: 0.000003 2020-02-13 04:04:42,619 Epoch 150 Step: 366800 Batch Loss: 1.214491 Tokens per Sec: 21638, Lr: 0.000003 2020-02-13 04:04:52,666 Epoch 150 Step: 366900 Batch Loss: 1.279241 Tokens per Sec: 21872, Lr: 0.000003 2020-02-13 04:05:02,591 Epoch 150 Step: 367000 Batch Loss: 1.144969 Tokens per Sec: 21945, Lr: 0.000003 2020-02-13 04:05:21,686 Example #0 2020-02-13 04:05:21,687 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 04:05:21,687 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 04:05:21,687 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 04:05:21,687 Reference: 10 : ​ 6 - 9 . 2020-02-13 04:05:21,687 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 04:05:21,687 Example #1 2020-02-13 04:05:21,687 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 04:05:21,687 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 04:05:21,687 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 04:05:21,687 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 04:05:21,687 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 04:05:21,687 Example #2 2020-02-13 04:05:21,687 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 04:05:21,688 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 04:05:21,688 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 04:05:21,688 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 04:05:21,688 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 04:05:21,688 Example #3 2020-02-13 04:05:21,688 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 04:05:21,688 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-13 04:05:21,688 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 04:05:21,688 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 04:05:21,688 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-13 04:05:21,688 Validation result (greedy) at epoch 150, step 367000: bleu: 30.14, loss: 38976.5781, ppl: 3.7307, duration: 19.0966s 2020-02-13 04:05:31,737 Epoch 150 Step: 367100 Batch Loss: 1.260332 Tokens per Sec: 21559, Lr: 0.000003 2020-02-13 04:05:41,667 Epoch 150 Step: 367200 Batch Loss: 1.100598 Tokens per Sec: 22153, Lr: 0.000003 2020-02-13 04:05:51,674 Epoch 150 Step: 367300 Batch Loss: 1.336341 Tokens per Sec: 21769, Lr: 0.000003 2020-02-13 04:06:01,579 Epoch 150 Step: 367400 Batch Loss: 1.248280 Tokens per Sec: 22008, Lr: 0.000003 2020-02-13 04:06:11,491 Epoch 150 Step: 367500 Batch Loss: 1.369675 Tokens per Sec: 22447, Lr: 0.000003 2020-02-13 04:06:21,539 Epoch 150 Step: 367600 Batch Loss: 1.093742 Tokens per Sec: 22316, Lr: 0.000003 2020-02-13 04:06:31,464 Epoch 150 Step: 367700 Batch Loss: 1.354177 Tokens per Sec: 21958, Lr: 0.000003 2020-02-13 04:06:41,393 Epoch 150 Step: 367800 Batch Loss: 1.355595 Tokens per Sec: 22333, Lr: 0.000003 2020-02-13 04:06:51,384 Epoch 150 Step: 367900 Batch Loss: 1.149606 Tokens per Sec: 22209, Lr: 0.000003 2020-02-13 04:07:01,362 Epoch 150 Step: 368000 Batch Loss: 1.287844 Tokens per Sec: 22717, Lr: 0.000003 2020-02-13 04:07:20,594 Example #0 2020-02-13 04:07:20,594 Raw source: ['Since', 'the', 'marriage', 'arrange@@', 'ment', 'in@@', 'st@@', 'itu@@', 'ted', 'by', 'Jehovah', 'is', 'a', 'lasting', 'one', ',', 'it', 'is', 'vital', 'that', 'cou@@', 'ples', 'ende@@', 'av@@', 'or', 'to', 'keep', 'the', 'f@@', 'l@@', 'ame', 'of', 'their', 'love', 'ab@@', 'la@@', 'ze', 'and', 'maintain', 'an', 'at@@', 'mo@@', 'sp@@', 'here', 'in', 'which', 'love', 'can', 'grow', '.', '\u200b', '—', 'Mark', '10', ':', '6', '-', '9', '.'] 2020-02-13 04:07:20,594 Raw hypothesis: ['Er', 'ivese', 'i', 'Yehova', 'a', 'ver', 'la', 'i', 'lu', 'kwagh', 'u', 'tsôron', 'yô', ',', 'gba', 'hange', 'hange', 'u', 'noov', 'man', 'kasev', 'vea', 'nôngo', 'kpoghuloo', 'vea', 'lu', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', 'shi', 'vea', 'za', 'hemen', 'u', 'lun', 'a', 'dooshima', 'u', 'a', 'lu', 'a', 'mi', 'la', 'her', '.', '—', 'Marku', '10', ':', '6', '-', '9', '.'] 2020-02-13 04:07:20,594 Source: Since the marriage arrangement instituted by Jehovah is a lasting one , it is vital that couples endeavor to keep the flame of their love ablaze and maintain an atmosphere in which love can grow . ​ — Mark 10 : 6 - 9 . 2020-02-13 04:07:20,594 Reference: 10 : ​ 6 - 9 . 2020-02-13 04:07:20,594 Hypothesis: Er ivese i Yehova a ver la i lu kwagh u tsôron yô , gba hange hange u noov man kasev vea nôngo kpoghuloo vea lu a dooshima u a lu a mi la her shi vea za hemen u lun a dooshima u a lu a mi la her . — Marku 10 : 6 - 9 . 2020-02-13 04:07:20,594 Example #1 2020-02-13 04:07:20,594 Raw source: ['We', 'too', 'can', '“', 'see', '”', 'such', 'a', 'wonderful', 'time', '\u200b', '—', 'and', 'it', 'is', 'near', 'indeed', '!', '\u200b', '—', 'Rom', '.'] 2020-02-13 04:07:20,594 Raw hypothesis: ['Se', 'kpa', 'se', 'fatyô', 'u', '‘', 'nengen', '’', 'a', 'shighe', 'u', 'doon', 'tsung', 'ne', ',', 'man', 'kwagh', 'ne', 'mgb@@', 'ôghom', '!', '—', 'Rom', '.'] 2020-02-13 04:07:20,594 Source: We too can “ see ” such a wonderful time ​ — and it is near indeed ! ​ — Rom . 2020-02-13 04:07:20,594 Reference: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne ken ishima yase , shi ngu ica a vese kpaa ga ! ​ — Rom . 2020-02-13 04:07:20,594 Hypothesis: Se kpa se fatyô u ‘ nengen ’ a shighe u doon tsung ne , man kwagh ne mgbôghom ! — Rom . 2020-02-13 04:07:20,595 Example #2 2020-02-13 04:07:20,595 Raw source: ['Ab@@', 'out', 'ten', 'years', 'later', ',', 'Paul', 'is', 'in', 'M@@', 'ace@@', 'don@@', 'ia', 'and', 'Timothy', 'is', 'in', 'Eph@@', 'esus', '.'] 2020-02-13 04:07:20,595 Raw hypothesis: ['Anyom', 'nga', 'kar', 'er', 'pue', 'nahan', 'yô', ',', 'Paulu', 'lu', 'ken', 'M@@', 'ase@@', 'don@@', 'ia', 'man', 'Timoteu', 'ken', 'E@@', 'fese', '.'] 2020-02-13 04:07:20,595 Source: About ten years later , Paul is in Macedonia and Timothy is in Ephesus . 2020-02-13 04:07:20,595 Reference: Anyom pue nga kar yô , Paulu yem ken Masedonia , Timoteu di lu ken Efese . 2020-02-13 04:07:20,595 Hypothesis: Anyom nga kar er pue nahan yô , Paulu lu ken Masedonia man Timoteu ken Efese . 2020-02-13 04:07:20,595 Example #3 2020-02-13 04:07:20,595 Raw source: ['It', 'could', 'be', 'that', 'an', 'individu@@', 'al', 'is', 'ac@@', 'ting', 'in', 'a', 'way', 'that', 'is', 'not', 'appro@@', 'pri@@', 'ate', '.'] 2020-02-13 04:07:20,595 Raw hypothesis: ['Alaghga', 'or', 'nana', 'lu', 'eren', 'kwagh', 'sha', 'gbenda', 'u', 'vough', 'ga', '.'] 2020-02-13 04:07:20,595 Source: It could be that an individual is acting in a way that is not appropriate . 2020-02-13 04:07:20,595 Reference: Alaghga ma anmgbian ngu eren inja ka doon ga . 2020-02-13 04:07:20,595 Hypothesis: Alaghga or nana lu eren kwagh sha gbenda u vough ga . 2020-02-13 04:07:20,595 Validation result (greedy) at epoch 150, step 368000: bleu: 30.06, loss: 38968.0703, ppl: 3.7296, duration: 19.2331s 2020-02-13 04:07:30,543 Epoch 150 Step: 368100 Batch Loss: 1.222374 Tokens per Sec: 22249, Lr: 0.000003 2020-02-13 04:07:40,466 Epoch 150 Step: 368200 Batch Loss: 1.192739 Tokens per Sec: 22044, Lr: 0.000003 2020-02-13 04:07:50,388 Epoch 150 Step: 368300 Batch Loss: 1.283008 Tokens per Sec: 22068, Lr: 0.000003 2020-02-13 04:08:00,266 Epoch 150 Step: 368400 Batch Loss: 1.339251 Tokens per Sec: 22121, Lr: 0.000003 2020-02-13 04:08:10,202 Epoch 150 Step: 368500 Batch Loss: 1.306905 Tokens per Sec: 22346, Lr: 0.000003 2020-02-13 04:08:20,253 Epoch 150 Step: 368600 Batch Loss: 1.204326 Tokens per Sec: 22408, Lr: 0.000003 2020-02-13 04:08:30,388 Epoch 150 Step: 368700 Batch Loss: 1.317032 Tokens per Sec: 21469, Lr: 0.000003 2020-02-13 04:08:40,321 Epoch 150 Step: 368800 Batch Loss: 1.450195 Tokens per Sec: 22174, Lr: 0.000003 2020-02-13 04:08:42,893 Epoch 150: total training loss 3021.53 2020-02-13 04:08:42,893 Training ended after 150 epochs. 2020-02-13 04:08:42,893 Best validation result (greedy) at step 365000: 3.73 ppl. 2020-02-13 04:09:09,290 dev bleu: 30.29 [Beam search decoding with beam size = 5 and alpha = 1.0] 2020-02-13 04:09:09,291 Translations saved to: models/entiv_transformer/00365000.hyps.dev 2020-02-13 04:09:15,605 test bleu: 44.70 [Beam search decoding with beam size = 5 and alpha = 1.0] 2020-02-13 04:09:15,605 Translations saved to: models/entiv_transformer/00365000.hyps.test