{"nbformat":4,"nbformat_minor":0,"metadata":{"accelerator":"GPU","colab":{"name":"Starter_notebook twi.ipynb","provenance":[{"file_id":"https://github.com/salomeyosei/masakhane-mt/blob/master/starter_notebook_twi.ipynb","timestamp":1590079563215}],"collapsed_sections":[]},"kernelspec":{"display_name":"Python 3","language":"python","name":"python3"},"language_info":{"codemirror_mode":{"name":"ipython","version":3},"file_extension":".py","mimetype":"text/x-python","name":"python","nbconvert_exporter":"python","pygments_lexer":"ipython3","version":"3.5.8"}},"cells":[{"cell_type":"markdown","metadata":{"colab_type":"text","id":"Igc5itf-xMGj"},"source":["# Masakhane - Machine Translation for African Languages (Using JoeyNMT)"]},{"cell_type":"markdown","metadata":{"colab_type":"text","id":"x4fXCKCf36IK"},"source":["## Note before beginning:\n","### - The idea is that you should be able to make minimal changes to this in order to get SOME result for your own translation corpus. \n","\n","### - The tl;dr: Go to the **\"TODO\"** comments which will tell you what to update to get up and running\n","\n","### - If you actually want to have a clue what you're doing, read the text and peek at the links\n","\n","### - With 100 epochs, it should take around 7 hours to run in Google Colab\n","\n","### - Once you've gotten a result for your language, please attach and email your notebook that generated it to masakhanetranslation@gmail.com\n","\n","### - If you care enough and get a chance, doing a brief background on your language would be amazing. See examples in  [(Martinus, 2019)](https://arxiv.org/abs/1906.05685)"]},{"cell_type":"markdown","metadata":{"colab_type":"text","id":"l929HimrxS0a"},"source":["## Retrieve your data & make a parallel corpus\n","\n","If you are wanting to use the JW300 data referenced on the Masakhane website or in our GitHub repo, you can use `opus-tools` to convert the data into a convenient format. `opus_read` from that package provides a convenient tool for reading the native aligned XML files and to convert them to TMX format. The tool can also be used to fetch relevant files from OPUS on the fly and to filter the data as necessary. [Read the documentation](https://pypi.org/project/opustools-pkg/) for more details.\n","\n","Once you have your corpus files in TMX format (an xml structure which will include the sentences in your target language and your source language in a single file), we recommend reading them into a pandas dataframe. Thankfully, Jade wrote a silly `tmx2dataframe` package which converts your tmx file to a pandas dataframe. "]},{"cell_type":"code","metadata":{"colab_type":"code","id":"oGRmDELn7Az0","outputId":"019fb3fc-5658-4487-d3b2-c97a377400f7","colab":{"base_uri":"https://localhost:8080/","height":122},"executionInfo":{"status":"ok","timestamp":1590079652700,"user_tz":0,"elapsed":25433,"user":{"displayName":"Salomey Osei","photoUrl":"","userId":"06221058988152607684"}}},"source":["from google.colab import drive\n","drive.mount('/content/drive')"],"execution_count":1,"outputs":[{"output_type":"stream","text":["Go to this URL in a browser: https://accounts.google.com/o/oauth2/auth?client_id=947318989803-6bn6qk8qdgf4n4g3pfee6491hc0brc4i.apps.googleusercontent.com&redirect_uri=urn%3aietf%3awg%3aoauth%3a2.0%3aoob&response_type=code&scope=email%20https%3a%2f%2fwww.googleapis.com%2fauth%2fdocs.test%20https%3a%2f%2fwww.googleapis.com%2fauth%2fdrive%20https%3a%2f%2fwww.googleapis.com%2fauth%2fdrive.photos.readonly%20https%3a%2f%2fwww.googleapis.com%2fauth%2fpeopleapi.readonly\n","\n","Enter your authorization code:\n","··········\n","Mounted at /content/drive\n"],"name":"stdout"}]},{"cell_type":"code","metadata":{"colab_type":"code","id":"Cn3tgQLzUxwn","colab":{}},"source":["# TODO: Set your source and target languages. Keep in mind, these traditionally use language codes as found here:\n","# These will also become the suffix's of all vocab and corpus files used throughout\n","import os\n","source_language = \"en\"\n","target_language = \"tw\" \n","lc = False  # If True, lowercase the data.\n","seed = 42  # Random seed for shuffling.\n","tag = \"baseline\" # Give a unique name to your folder - this is to ensure you don't rewrite any models you've already submitted\n","\n","os.environ[\"src\"] = source_language # Sets them in bash as well, since we often use bash scripts\n","os.environ[\"tgt\"] = target_language\n","os.environ[\"tag\"] = tag\n","\n","# This will save it to a folder in our gdrive instead!\n","!mkdir -p \"/content/drive/My Drive/masakhane/$src-$tgt-$tag\"\n","os.environ[\"gdrive_path\"] = \"/content/drive/My Drive/masakhane/%s-%s-%s\" % (source_language, target_language, tag)"],"execution_count":0,"outputs":[]},{"cell_type":"code","metadata":{"colab_type":"code","id":"kBSgJHEw7Nvx","outputId":"8dcabd9b-9df0-405a-da9d-7bd52e9db8cc","colab":{"base_uri":"https://localhost:8080/","height":34},"executionInfo":{"status":"ok","timestamp":1590079685109,"user_tz":0,"elapsed":3135,"user":{"displayName":"Salomey Osei","photoUrl":"","userId":"06221058988152607684"}}},"source":["!echo $gdrive_path"],"execution_count":3,"outputs":[{"output_type":"stream","text":["/content/drive/My Drive/masakhane/en-tw-baseline\n"],"name":"stdout"}]},{"cell_type":"code","metadata":{"colab_type":"code","id":"gA75Fs9ys8Y9","outputId":"6d83e4dd-a0bf-406d-db35-4d4372c8c785","colab":{"base_uri":"https://localhost:8080/","height":122},"executionInfo":{"status":"ok","timestamp":1590079690472,"user_tz":0,"elapsed":8208,"user":{"displayName":"Salomey Osei","photoUrl":"","userId":"06221058988152607684"}}},"source":["# Install opus-tools\n","! pip install opustools-pkg"],"execution_count":4,"outputs":[{"output_type":"stream","text":["Collecting opustools-pkg\n","\u001b[?25l  Downloading https://files.pythonhosted.org/packages/6c/9f/e829a0cceccc603450cd18e1ff80807b6237a88d9a8df2c0bb320796e900/opustools_pkg-0.0.52-py3-none-any.whl (80kB)\n","\u001b[K     |████████████████████████████████| 81kB 2.6MB/s \n","\u001b[?25hInstalling collected packages: opustools-pkg\n","Successfully installed opustools-pkg-0.0.52\n"],"name":"stdout"}]},{"cell_type":"code","metadata":{"colab_type":"code","id":"xq-tDZVks7ZD","outputId":"5771911a-285e-4467-ba06-feb0692b49f8","colab":{"base_uri":"https://localhost:8080/","height":204},"executionInfo":{"status":"ok","timestamp":1590079848250,"user_tz":0,"elapsed":165175,"user":{"displayName":"Salomey Osei","photoUrl":"","userId":"06221058988152607684"}}},"source":["# Downloading our corpus\n","! opus_read -d JW300 -s $src -t $tgt -wm moses -w jw300.$src jw300.$tgt -q\n","\n","# extract the corpus file\n","! gunzip JW300_latest_xml_$src-$tgt.xml.gz"],"execution_count":5,"outputs":[{"output_type":"stream","text":["\n","Alignment file /proj/nlpl/data/OPUS/JW300/latest/xml/en-tw.xml.gz not found. The following files are available for downloading:\n","\n","   5 MB https://object.pouta.csc.fi/OPUS-JW300/v1/xml/en-tw.xml.gz\n"," 263 MB https://object.pouta.csc.fi/OPUS-JW300/v1/xml/en.zip\n","  62 MB https://object.pouta.csc.fi/OPUS-JW300/v1/xml/tw.zip\n","\n"," 330 MB Total size\n","./JW300_latest_xml_en-tw.xml.gz ... 100% of 5 MB\n","./JW300_latest_xml_en.zip ... 100% of 263 MB\n","./JW300_latest_xml_tw.zip ... 100% of 62 MB\n"],"name":"stdout"}]},{"cell_type":"code","metadata":{"id":"Zo2Uhqn0IpT0","colab_type":"code","colab":{"base_uri":"https://localhost:8080/","height":190},"outputId":"7d256b34-af55-420b-d41e-a96ce0dca3c1","executionInfo":{"status":"ok","timestamp":1590079853703,"user_tz":0,"elapsed":5432,"user":{"displayName":"Salomey Osei","photoUrl":"","userId":"06221058988152607684"}}},"source":["!pip install ipython-autotime\n","%load_ext autotime"],"execution_count":6,"outputs":[{"output_type":"stream","text":["Collecting ipython-autotime\n","  Downloading https://files.pythonhosted.org/packages/e6/f9/0626bbdb322e3a078d968e87e3b01341e7890544de891d0cb613641220e6/ipython-autotime-0.1.tar.bz2\n","Building wheels for collected packages: ipython-autotime\n","  Building wheel for ipython-autotime (setup.py) ... \u001b[?25l\u001b[?25hdone\n","  Created wheel for ipython-autotime: filename=ipython_autotime-0.1-cp36-none-any.whl size=1832 sha256=ace7f4c8e5592366968beecefdff6b8560edc47c945dbed4cf29b19093eae26a\n","  Stored in directory: /root/.cache/pip/wheels/d2/df/81/2db1e54bc91002cec40334629bc39cfa86dff540b304ebcd6e\n","Successfully built ipython-autotime\n","Installing collected packages: ipython-autotime\n","Successfully installed ipython-autotime-0.1\n"],"name":"stdout"}]},{"cell_type":"code","metadata":{"colab_type":"code","id":"n48GDRnP8y2G","colab":{"base_uri":"https://localhost:8080/","height":595},"outputId":"d66c540d-9679-4a23-eb1a-f27b1a151361","executionInfo":{"status":"ok","timestamp":1590079865393,"user_tz":0,"elapsed":17118,"user":{"displayName":"Salomey Osei","photoUrl":"","userId":"06221058988152607684"}}},"source":["# Download the global test set.\n","! wget https://raw.githubusercontent.com/juliakreutzer/masakhane/master/jw300_utils/test/test.en-any.en\n","  \n","# And the specific test set for this language pair.\n","os.environ[\"trg\"] = target_language \n","os.environ[\"src\"] = source_language \n","\n","! wget https://raw.githubusercontent.com/juliakreutzer/masakhane/master/jw300_utils/test/test.en-$trg.en \n","! mv test.en-$trg.en test.en\n","! wget https://raw.githubusercontent.com/juliakreutzer/masakhane/master/jw300_utils/test/test.en-$trg.$trg \n","! mv test.en-$trg.$trg test.$trg"],"execution_count":7,"outputs":[{"output_type":"stream","text":["--2020-05-21 16:50:54--  https://raw.githubusercontent.com/juliakreutzer/masakhane/master/jw300_utils/test/test.en-any.en\n","Resolving raw.githubusercontent.com (raw.githubusercontent.com)... 151.101.0.133, 151.101.64.133, 151.101.128.133, ...\n","Connecting to raw.githubusercontent.com (raw.githubusercontent.com)|151.101.0.133|:443... connected.\n","HTTP request sent, awaiting response... 200 OK\n","Length: 277791 (271K) [text/plain]\n","Saving to: ‘test.en-any.en’\n","\n","test.en-any.en      100%[===================>] 271.28K  --.-KB/s    in 0.05s   \n","\n","2020-05-21 16:50:55 (5.10 MB/s) - ‘test.en-any.en’ saved [277791/277791]\n","\n","--2020-05-21 16:50:57--  https://raw.githubusercontent.com/juliakreutzer/masakhane/master/jw300_utils/test/test.en-tw.en\n","Resolving raw.githubusercontent.com (raw.githubusercontent.com)... 151.101.0.133, 151.101.64.133, 151.101.128.133, ...\n","Connecting to raw.githubusercontent.com (raw.githubusercontent.com)|151.101.0.133|:443... connected.\n","HTTP request sent, awaiting response... 200 OK\n","Length: 204124 (199K) [text/plain]\n","Saving to: ‘test.en-tw.en’\n","\n","test.en-tw.en       100%[===================>] 199.34K  --.-KB/s    in 0.05s   \n","\n","2020-05-21 16:50:57 (4.09 MB/s) - ‘test.en-tw.en’ saved [204124/204124]\n","\n","--2020-05-21 16:51:01--  https://raw.githubusercontent.com/juliakreutzer/masakhane/master/jw300_utils/test/test.en-tw.tw\n","Resolving raw.githubusercontent.com (raw.githubusercontent.com)... 151.101.0.133, 151.101.64.133, 151.101.128.133, ...\n","Connecting to raw.githubusercontent.com (raw.githubusercontent.com)|151.101.0.133|:443... connected.\n","HTTP request sent, awaiting response... 200 OK\n","Length: 214664 (210K) [text/plain]\n","Saving to: ‘test.en-tw.tw’\n","\n","test.en-tw.tw       100%[===================>] 209.63K  --.-KB/s    in 0.05s   \n","\n","2020-05-21 16:51:02 (4.14 MB/s) - ‘test.en-tw.tw’ saved [214664/214664]\n","\n","time: 11.5 s\n"],"name":"stdout"}]},{"cell_type":"code","metadata":{"colab_type":"code","id":"NqDG-CI28y2L","colab":{"base_uri":"https://localhost:8080/","height":51},"outputId":"d1655e64-2723-407a-9ed1-546f8e977209","executionInfo":{"status":"ok","timestamp":1590079865396,"user_tz":0,"elapsed":17117,"user":{"displayName":"Salomey Osei","photoUrl":"","userId":"06221058988152607684"}}},"source":["# Read the test data to filter from train and dev splits.\n","# Store english portion in set for quick filtering checks.\n","en_test_sents = set()\n","filter_test_sents = \"test.en-any.en\"\n","j = 0\n","with open(filter_test_sents) as f:\n","  for line in f:\n","    en_test_sents.add(line.strip())\n","    j += 1\n","print('Loaded {} global test sentences to filter from the training/dev data.'.format(j))"],"execution_count":8,"outputs":[{"output_type":"stream","text":["Loaded 3571 global test sentences to filter from the training/dev data.\n","time: 8.46 ms\n"],"name":"stdout"}]},{"cell_type":"code","metadata":{"colab_type":"code","id":"3CNdwLBCfSIl","colab":{"base_uri":"https://localhost:8080/","height":176},"outputId":"f8cb9b47-a1bb-4b1a-f152-f1213ffc1ad1","executionInfo":{"status":"ok","timestamp":1590079902870,"user_tz":0,"elapsed":54588,"user":{"displayName":"Salomey Osei","photoUrl":"","userId":"06221058988152607684"}}},"source":["import pandas as pd\n","\n","# TMX file to dataframe\n","source_file = 'jw300.' + source_language\n","target_file = 'jw300.' + target_language\n","\n","source = []\n","target = []\n","skip_lines = []  # Collect the line numbers of the source portion to skip the same lines for the target portion.\n","with open(source_file) as f:\n","    for i, line in enumerate(f):\n","        # Skip sentences that are contained in the test set.\n","        if line.strip() not in en_test_sents:\n","            source.append(line.strip())\n","        else:\n","            skip_lines.append(i)             \n","with open(target_file) as f:\n","    for j, line in enumerate(f):\n","        # Only add to corpus if corresponding source was not skipped.\n","        if j not in skip_lines:\n","            target.append(line.strip())\n","    \n","print('Loaded data and skipped {}/{} lines since contained in test set.'.format(len(skip_lines), i))\n","    \n","df = pd.DataFrame(zip(source, target), columns=['source_sentence', 'target_sentence'])\n","# if you get TypeError: data argument can't be an iterator is because of your zip version run this below\n","#df = pd.DataFrame(list(zip(source, target)), columns=['source_sentence', 'target_sentence'])\n","df.head(3)"],"execution_count":9,"outputs":[{"output_type":"stream","text":["Loaded data and skipped 6599/606196 lines since contained in test set.\n"],"name":"stdout"},{"output_type":"execute_result","data":{"text/html":["<div>\n","<style scoped>\n","    .dataframe tbody tr th:only-of-type {\n","        vertical-align: middle;\n","    }\n","\n","    .dataframe tbody tr th {\n","        vertical-align: top;\n","    }\n","\n","    .dataframe thead th {\n","        text-align: right;\n","    }\n","</style>\n","<table border=\"1\" class=\"dataframe\">\n","  <thead>\n","    <tr style=\"text-align: right;\">\n","      <th></th>\n","      <th>source_sentence</th>\n","      <th>target_sentence</th>\n","    </tr>\n","  </thead>\n","  <tbody>\n","    <tr>\n","      <th>0</th>\n","      <td>“ Oh , Jehovah , Keep My Young Girl Faithful ! ”</td>\n","      <td>“ Oo , Yehowa , Boa Me Babea Kumaa Yi Ma Onni ...</td>\n","    </tr>\n","    <tr>\n","      <th>1</th>\n","      <td>I WAS born in 1930 in Alsace , France , into a...</td>\n","      <td>WƆWOO me too abusua a wonim adwinne di mu wɔ A...</td>\n","    </tr>\n","    <tr>\n","      <th>2</th>\n","      <td>During the evenings , Father , sitting in his ...</td>\n","      <td>Ná Papa taa pa twere n’agua mu kenkan asase ho...</td>\n","    </tr>\n","  </tbody>\n","</table>\n","</div>"],"text/plain":["                                     source_sentence                                    target_sentence\n","0   “ Oh , Jehovah , Keep My Young Girl Faithful ! ”  “ Oo , Yehowa , Boa Me Babea Kumaa Yi Ma Onni ...\n","1  I WAS born in 1930 in Alsace , France , into a...  WƆWOO me too abusua a wonim adwinne di mu wɔ A...\n","2  During the evenings , Father , sitting in his ...  Ná Papa taa pa twere n’agua mu kenkan asase ho..."]},"metadata":{"tags":[]},"execution_count":9},{"output_type":"stream","text":["time: 37.2 s\n"],"name":"stdout"}]},{"cell_type":"markdown","metadata":{"colab_type":"text","id":"YkuK3B4p2AkN"},"source":["## Pre-processing and export\n","\n","It is generally a good idea to remove duplicate translations and conflicting translations from the corpus. In practice, these public corpora include some number of these that need to be cleaned.\n","\n","In addition we will split our data into dev/test/train and export to the filesystem."]},{"cell_type":"code","metadata":{"colab_type":"code","id":"M_2ouEOH1_1q","colab":{"base_uri":"https://localhost:8080/","height":204},"outputId":"fc7fa842-5cf2-41c3-e48a-9583de68f7e8","executionInfo":{"status":"ok","timestamp":1590079905928,"user_tz":0,"elapsed":3051,"user":{"displayName":"Salomey Osei","photoUrl":"","userId":"06221058988152607684"}}},"source":["# drop duplicate translations\n","df_pp = df.drop_duplicates()\n","\n","# drop conflicting translations\n","# (this is optional and something that you might want to comment out \n","# depending on the size of your corpus)\n","df_pp.drop_duplicates(subset='source_sentence', inplace=True)\n","df_pp.drop_duplicates(subset='target_sentence', inplace=True)\n","\n","# Shuffle the data to remove bias in dev set selection.\n","df_pp = df_pp.sample(frac=1, random_state=seed).reset_index(drop=True)"],"execution_count":10,"outputs":[{"output_type":"stream","text":["/usr/local/lib/python3.6/dist-packages/ipykernel_launcher.py:7: SettingWithCopyWarning: \n","A value is trying to be set on a copy of a slice from a DataFrame\n","\n","See the caveats in the documentation: https://pandas.pydata.org/pandas-docs/stable/user_guide/indexing.html#returning-a-view-versus-a-copy\n","  import sys\n","/usr/local/lib/python3.6/dist-packages/ipykernel_launcher.py:8: SettingWithCopyWarning: \n","A value is trying to be set on a copy of a slice from a DataFrame\n","\n","See the caveats in the documentation: https://pandas.pydata.org/pandas-docs/stable/user_guide/indexing.html#returning-a-view-versus-a-copy\n","  \n"],"name":"stderr"},{"output_type":"stream","text":["time: 1.61 s\n"],"name":"stdout"}]},{"cell_type":"code","metadata":{"colab_type":"code","id":"Z_1BwAApEtMk","colab":{"base_uri":"https://localhost:8080/","height":309},"outputId":"b2d4d2e9-5adc-4f9b-a5d6-221530e25315","executionInfo":{"status":"ok","timestamp":1590079917170,"user_tz":0,"elapsed":14287,"user":{"displayName":"Salomey Osei","photoUrl":"","userId":"06221058988152607684"}}},"source":["# Install fuzzy wuzzy to remove \"almost duplicate\" sentences in the\n","# test and training sets.\n","! pip install fuzzywuzzy\n","! pip install python-Levenshtein\n","import time\n","from fuzzywuzzy import process\n","import numpy as np\n","from os import cpu_count\n","from functools import partial\n","from multiprocessing import Pool\n","\n","\n","# reset the index of the training set after previous filtering\n","df_pp.reset_index(drop=False, inplace=True)\n","\n","# Remove samples from the training data set if they \"almost overlap\" with the\n","# samples in the test set.\n","\n","# Filtering function. Adjust pad to narrow down the candidate matches to\n","# within a certain length of characters of the given sample.\n","def fuzzfilter(sample, candidates, pad):\n","  candidates = [x for x in candidates if len(x) <= len(sample)+pad and len(x) >= len(sample)-pad] \n","  if len(candidates) > 0:\n","    return process.extractOne(sample, candidates)[1]\n","  else:\n","    return np.nan"],"execution_count":11,"outputs":[{"output_type":"stream","text":["Collecting fuzzywuzzy\n","  Downloading https://files.pythonhosted.org/packages/43/ff/74f23998ad2f93b945c0309f825be92e04e0348e062026998b5eefef4c33/fuzzywuzzy-0.18.0-py2.py3-none-any.whl\n","Installing collected packages: fuzzywuzzy\n","Successfully installed fuzzywuzzy-0.18.0\n","Collecting python-Levenshtein\n","\u001b[?25l  Downloading https://files.pythonhosted.org/packages/42/a9/d1785c85ebf9b7dfacd08938dd028209c34a0ea3b1bcdb895208bd40a67d/python-Levenshtein-0.12.0.tar.gz (48kB)\n","\u001b[K     |████████████████████████████████| 51kB 1.7MB/s \n","\u001b[?25hRequirement already satisfied: setuptools in /usr/local/lib/python3.6/dist-packages (from python-Levenshtein) (46.3.0)\n","Building wheels for collected packages: python-Levenshtein\n","  Building wheel for python-Levenshtein (setup.py) ... \u001b[?25l\u001b[?25hdone\n","  Created wheel for python-Levenshtein: filename=python_Levenshtein-0.12.0-cp36-cp36m-linux_x86_64.whl size=144780 sha256=ac2d1a427827267ec91933380418a960c89dbcf3533b21c2c634c8fdbdd5e835\n","  Stored in directory: /root/.cache/pip/wheels/de/c2/93/660fd5f7559049268ad2dc6d81c4e39e9e36518766eaf7e342\n","Successfully built python-Levenshtein\n","Installing collected packages: python-Levenshtein\n","Successfully installed python-Levenshtein-0.12.0\n","time: 10.8 s\n"],"name":"stdout"}]},{"cell_type":"code","metadata":{"id":"DH5-aklzRz5X","colab_type":"code","colab":{"base_uri":"https://localhost:8080/","height":360},"outputId":"cc67c550-f392-4ee2-ec6a-439e46122116","executionInfo":{"status":"ok","timestamp":1590089763998,"user_tz":0,"elapsed":9861111,"user":{"displayName":"Salomey Osei","photoUrl":"","userId":"06221058988152607684"}}},"source":["start_time = time.time()\n","### iterating over pandas dataframe rows is not recomended, let use multi processing to apply the function\n","\n","with Pool(cpu_count()-1) as pool:\n","    scores = pool.map(partial(fuzzfilter, candidates=list(en_test_sents), pad=5), df_pp['source_sentence'])\n","hours, rem = divmod(time.time() - start_time, 3600)\n","minutes, seconds = divmod(rem, 60)\n","print(\"done in {}h:{}min:{}seconds\".format(hours, minutes, seconds))\n","\n","# Filter out \"almost overlapping samples\"\n","df_pp = df_pp.assign(scores=scores)\n","df_pp = df_pp[df_pp['scores'] < 95]"],"execution_count":12,"outputs":[{"output_type":"stream","text":["WARNING:root:Applied processor reduces input query to empty string, all comparisons will have score 0. [Query: '”']\n","WARNING:root:Applied processor reduces input query to empty string, all comparisons will have score 0. [Query: '↓']\n","WARNING:root:Applied processor reduces input query to empty string, all comparisons will have score 0. [Query: '․ ․ ․ ․ ․']\n","WARNING:root:Applied processor reduces input query to empty string, all comparisons will have score 0. [Query: '↓ ↓ ↓']\n","WARNING:root:Applied processor reduces input query to empty string, all comparisons will have score 0. [Query: '$ $ $']\n","WARNING:root:Applied processor reduces input query to empty string, all comparisons will have score 0. [Query: '⇩']\n","WARNING:root:Applied processor reduces input query to empty string, all comparisons will have score 0. [Query: '․ ․ ․ ․']\n","WARNING:root:Applied processor reduces input query to empty string, all comparisons will have score 0. [Query: '']\n","WARNING:root:Applied processor reduces input query to empty string, all comparisons will have score 0. [Query: '*']\n","WARNING:root:Applied processor reduces input query to empty string, all comparisons will have score 0. [Query: '․ ․ ․ ․ ․ ․ ․ ․']\n","WARNING:root:Applied processor reduces input query to empty string, all comparisons will have score 0. [Query: '↓ ↓ ↓ ↓']\n","WARNING:root:Applied processor reduces input query to empty string, all comparisons will have score 0. [Query: '* * *']\n","WARNING:root:Applied processor reduces input query to empty string, all comparisons will have score 0. [Query: '․ ․ ․ ․ ․ ․']\n","WARNING:root:Applied processor reduces input query to empty string, all comparisons will have score 0. [Query: '→ →']\n","WARNING:root:Applied processor reduces input query to empty string, all comparisons will have score 0. [Query: '․ ․']\n","WARNING:root:Applied processor reduces input query to empty string, all comparisons will have score 0. [Query: '- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -']\n","WARNING:root:Applied processor reduces input query to empty string, all comparisons will have score 0. [Query: '↓ ↓']\n"],"name":"stderr"},{"output_type":"stream","text":["done in 2.0h:44.0min:6.609394788742065seconds\n","time: 2h 44min 6s\n"],"name":"stdout"}]},{"cell_type":"code","metadata":{"colab_type":"code","id":"hxxBOCA-xXhy","colab":{"base_uri":"https://localhost:8080/","height":836},"outputId":"7ad42da6-1f23-4561-87a1-2f42284e31d1","executionInfo":{"status":"ok","timestamp":1590089818883,"user_tz":0,"elapsed":9915993,"user":{"displayName":"Salomey Osei","photoUrl":"","userId":"06221058988152607684"}}},"source":["# This section does the split between train/dev for the parallel corpora then saves them as separate files\n","# We use 1000 dev test and the given test set.\n","import csv\n","\n","# Do the split between dev/train and create parallel corpora\n","num_dev_patterns = 1000\n","\n","# Optional: lower case the corpora - this will make it easier to generalize, but without proper casing.\n","if lc:  # Julia: making lowercasing optional\n","    df_pp[\"source_sentence\"] = df_pp[\"source_sentence\"].str.lower()\n","    df_pp[\"target_sentence\"] = df_pp[\"target_sentence\"].str.lower()\n","\n","# Julia: test sets are already generated\n","dev = df_pp.tail(num_dev_patterns) # Herman: Error in original\n","stripped = df_pp.drop(df_pp.tail(num_dev_patterns).index)\n","\n","with open(\"train.\"+source_language, \"w\") as src_file, open(\"train.\"+target_language, \"w\") as trg_file:\n","  for index, row in stripped.iterrows():\n","    src_file.write(row[\"source_sentence\"]+\"\\n\")\n","    trg_file.write(row[\"target_sentence\"]+\"\\n\")\n","    \n","with open(\"dev.\"+source_language, \"w\") as src_file, open(\"dev.\"+target_language, \"w\") as trg_file:\n","  for index, row in dev.iterrows():\n","    src_file.write(row[\"source_sentence\"]+\"\\n\")\n","    trg_file.write(row[\"target_sentence\"]+\"\\n\")\n","\n","#stripped[[\"source_sentence\"]].to_csv(\"train.\"+source_language, header=False, index=False)  # Herman: Added `header=False` everywhere\n","#stripped[[\"target_sentence\"]].to_csv(\"train.\"+target_language, header=False, index=False)  # Julia: Problematic handling of quotation marks.\n","\n","#dev[[\"source_sentence\"]].to_csv(\"dev.\"+source_language, header=False, index=False)\n","#dev[[\"target_sentence\"]].to_csv(\"dev.\"+target_language, header=False, index=False)\n","\n","# Doublecheck the format below. There should be no extra quotation marks or weird characters.\n","! head train.*\n","! head dev.*"],"execution_count":13,"outputs":[{"output_type":"stream","text":["==> train.en <==\n","The message appealed to me .\n","In writing to fellow Christians , the apostle Paul indicated that fathers in particular were to “ go on bringing [ their children ] up in the discipline and mental - regulating of Jehovah . ” ​ — Ephesians 6 : 4 .\n","They easily begin to think that they know best or that wisdom from the intelligentsia of this world is superior to God’s , that it is more up - to - date .\n","God purposed it to be a global paradise , comfortably populated by humans — men and women — all living in peace and harmony .\n","To introduce the Bible’s message , we used phonographs .\n","But he replied : “ As one of the senseless women speaks , you speak also .\n","Flaunting their vibrant colors , they run across the water and take to the air , only to land again and repeat the ritual .\n","How might elders use questions when helping individuals who have been wounded emotionally ?\n","Paul here employs a figure of speech .\n","• Why do we desire to act with courage ?\n","\n","==> train.tw <==\n","M’ani gyee asɛm no ho .\n","Bere a ɔsomafo Paulo rekyerɛw krataa akɔma ne mfɛfo Kristofo no , ɔkyerɛe sɛ agyanom titiriw na ɛsɛ sɛ ‘ wɔkɔ so tete wɔn mma wɔ Yehowa nteɛso ne nyansakyerɛ mu . ’ — Efesofo 6 : 4 .\n","Ɛnkyɛ na wɔafi ase asusuw sɛ wonim biribiara anaa wiase yi nhomanimfo nyansa korɔn sen Onyankopɔn de , na ɛno mmom na ɛyɛ ne bere mu de .\n","Ná Onyankopɔn atirimpɔw ne sɛ ɛbɛyɛ wiase nyinaa paradise , a nnipa — mmarima ne mmea — a wɔn nyinaa te asomdwoe ne biakoyɛ mu ahyɛ so ma na wɔnkyere so .\n","Ná yɛde gramafon na ɛka Bible mu asɛm kyerɛ nkurɔfo .\n","Nanso obuae sɛ : “ Sɛ mmea nnyennyentwi no mu bi kasa na wokasa yi .\n","Bere a wɔde wɔn kɔla a ɛyɛ fɛ a ɛwɔ wɔn ho rekyerɛ no , wotu mmirika fa nsu no ani na wɔyɛ sɛ wɔretu a na wɔasan abesi , wɔyɛ saa toatoa so .\n","Ɔkwan bɛn so na mpanyimfo betumi de nsɛmmisa adi dwuma bere a wɔreboa ankorankoro a wɔahaw nkate fam no ?\n","Paulo de kasakoa bi di dwuma wɔ ha .\n","• Dɛn nti na yɛpɛ sɛ yɛda akokoduru adi ?\n","==> dev.en <==\n","Such cases made ancient oracles notorious for being vague and enigmatic .\n","If so , you would be worthy of death .\n","Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","He encourages his worshippers to ‘ throw all their anxiety upon him , ’ especially when they are in great distress . ​ — 1 Peter 5 : 7 .\n","The Three Cages\n","Jesus set the standard in balancing secular interests and spiritual matters .\n","BRIGHTON ( B ) , The Brighton Centre , Kings Rd .\n","“ The faithful and discreet slave ” has spared no effort in providing literature even for some whose language is spoken by relatively few people .\n","They had authority to press into service men , horses , ships , or anything else needed to expedite public business .\n","\n","==> dev.tw <==\n","Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","Sɛ ɛte saa a , ɛnde na wofata owu .\n","Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","Ɔhyɛ n’asomfo nyinaa nkuran sɛ , ‘ wɔnto wɔn dadwen nyinaa ngu ne so . ’ Sɛ dadwen kɛse bi bɛtɔ wɔn so a , saa bere no paa na ɛsɛ sɛ wɔde saa asɛm no yɛ adwuma . ​ — 1 Petro 5 : 7 .\n","Ebuw Abiɛsa No\n","Yesu ma yehuu nea ɛfata sɛ yɛde di kan bere a yɛresisi gyinae afa honam fam nneɛma ne honhom fam nneɛma ho .\n","BRIGHTON ( B ) , The Brighton Centre , Kings Rd .\n","“ Akoa nokwafo ne ɔbadwemma ” no abɔ mmɔden biara atintim nhoma wɔ kasa a nnipa a wɔka nnɔɔso mpo mu .\n","Na wɔwɔ tumi sɛ wɔde ɔhyɛ fa mmarima , apɔnkɔ , po so ahyɛn anaa biribiara a wohia de ayɛ ɔman no nnwuma ntɛmntɛm .\n","time: 54.8 s\n"],"name":"stdout"}]},{"cell_type":"markdown","metadata":{"colab_type":"text","id":"epeCydmCyS8X"},"source":["\n","\n","---\n","\n","\n","## Installation of JoeyNMT\n","\n","JoeyNMT is a simple, minimalist NMT package which is useful for learning and teaching. Check out the documentation for JoeyNMT [here](https://joeynmt.readthedocs.io)  "]},{"cell_type":"code","metadata":{"colab_type":"code","id":"iBRMm4kMxZ8L","colab":{"base_uri":"https://localhost:8080/","height":1000},"outputId":"9c38e319-9a2f-4e39-aeef-4cea3050fc56","executionInfo":{"status":"ok","timestamp":1590089833217,"user_tz":0,"elapsed":9930324,"user":{"displayName":"Salomey Osei","photoUrl":"","userId":"06221058988152607684"}}},"source":["# Install JoeyNMT\n","! git clone https://github.com/joeynmt/joeynmt.git\n","! cd joeynmt; pip3 install ."],"execution_count":14,"outputs":[{"output_type":"stream","text":["Cloning into 'joeynmt'...\n","remote: Enumerating objects: 14, done.\u001b[K\n","remote: Counting objects: 100% (14/14), done.\u001b[K\n","remote: Compressing objects: 100% (13/13), done.\u001b[K\n","remote: Total 2409 (delta 3), reused 4 (delta 1), pack-reused 2395\u001b[K\n","Receiving objects: 100% (2409/2409), 2.63 MiB | 2.18 MiB/s, done.\n","Resolving deltas: 100% (1682/1682), done.\n","Processing /content/joeynmt\n","Requirement already satisfied: future in /usr/local/lib/python3.6/dist-packages (from joeynmt==0.0.1) (0.16.0)\n","Requirement already satisfied: pillow in /usr/local/lib/python3.6/dist-packages (from joeynmt==0.0.1) (7.0.0)\n","Requirement already satisfied: numpy<2.0,>=1.14.5 in /usr/local/lib/python3.6/dist-packages (from joeynmt==0.0.1) (1.18.4)\n","Requirement already satisfied: setuptools>=41.0.0 in /usr/local/lib/python3.6/dist-packages (from joeynmt==0.0.1) (46.3.0)\n","Requirement already satisfied: torch>=1.1 in /usr/local/lib/python3.6/dist-packages (from joeynmt==0.0.1) (1.5.0+cu101)\n","Requirement already satisfied: tensorflow>=1.14 in /usr/local/lib/python3.6/dist-packages (from joeynmt==0.0.1) (2.2.0)\n","Requirement already satisfied: torchtext in /usr/local/lib/python3.6/dist-packages (from joeynmt==0.0.1) (0.3.1)\n","Collecting sacrebleu>=1.3.6\n","\u001b[?25l  Downloading https://files.pythonhosted.org/packages/6e/9d/9846507837ca50ae20917f59d83b79246b8313bd19d4f5bf575ecb98132b/sacrebleu-1.4.9-py3-none-any.whl (60kB)\n","\u001b[K     |████████████████████████████████| 61kB 1.8MB/s \n","\u001b[?25hCollecting subword-nmt\n","  Downloading https://files.pythonhosted.org/packages/74/60/6600a7bc09e7ab38bc53a48a20d8cae49b837f93f5842a41fe513a694912/subword_nmt-0.3.7-py2.py3-none-any.whl\n","Requirement already satisfied: matplotlib in /usr/local/lib/python3.6/dist-packages (from joeynmt==0.0.1) (3.2.1)\n","Requirement already satisfied: seaborn in /usr/local/lib/python3.6/dist-packages (from joeynmt==0.0.1) (0.10.1)\n","Collecting pyyaml>=5.1\n","\u001b[?25l  Downloading https://files.pythonhosted.org/packages/64/c2/b80047c7ac2478f9501676c988a5411ed5572f35d1beff9cae07d321512c/PyYAML-5.3.1.tar.gz (269kB)\n","\u001b[K     |████████████████████████████████| 276kB 7.0MB/s \n","\u001b[?25hCollecting pylint\n","\u001b[?25l  Downloading https://files.pythonhosted.org/packages/37/6e/36419ec1bd2208e157dff7fc3e565b185394c0dc4901e9e2f983cb1d4b7f/pylint-2.5.2-py3-none-any.whl (324kB)\n","\u001b[K     |████████████████████████████████| 327kB 23.4MB/s \n","\u001b[?25hRequirement already satisfied: six==1.12 in /usr/local/lib/python3.6/dist-packages (from joeynmt==0.0.1) (1.12.0)\n","Collecting wrapt==1.11.1\n","  Downloading https://files.pythonhosted.org/packages/67/b2/0f71ca90b0ade7fad27e3d20327c996c6252a2ffe88f50a95bba7434eda9/wrapt-1.11.1.tar.gz\n","Requirement already satisfied: absl-py>=0.7.0 in /usr/local/lib/python3.6/dist-packages (from tensorflow>=1.14->joeynmt==0.0.1) (0.9.0)\n","Requirement already satisfied: protobuf>=3.8.0 in /usr/local/lib/python3.6/dist-packages (from tensorflow>=1.14->joeynmt==0.0.1) (3.10.0)\n","Requirement already satisfied: wheel>=0.26; python_version >= \"3\" in /usr/local/lib/python3.6/dist-packages (from tensorflow>=1.14->joeynmt==0.0.1) (0.34.2)\n","Requirement already satisfied: keras-preprocessing>=1.1.0 in /usr/local/lib/python3.6/dist-packages (from tensorflow>=1.14->joeynmt==0.0.1) (1.1.2)\n","Requirement already satisfied: opt-einsum>=2.3.2 in /usr/local/lib/python3.6/dist-packages (from tensorflow>=1.14->joeynmt==0.0.1) (3.2.1)\n","Requirement already satisfied: scipy==1.4.1; python_version >= \"3\" in /usr/local/lib/python3.6/dist-packages (from tensorflow>=1.14->joeynmt==0.0.1) (1.4.1)\n","Requirement already satisfied: tensorboard<2.3.0,>=2.2.0 in /usr/local/lib/python3.6/dist-packages (from tensorflow>=1.14->joeynmt==0.0.1) (2.2.1)\n","Requirement already satisfied: tensorflow-estimator<2.3.0,>=2.2.0 in /usr/local/lib/python3.6/dist-packages (from tensorflow>=1.14->joeynmt==0.0.1) (2.2.0)\n","Requirement already satisfied: google-pasta>=0.1.8 in /usr/local/lib/python3.6/dist-packages (from tensorflow>=1.14->joeynmt==0.0.1) (0.2.0)\n","Requirement already satisfied: termcolor>=1.1.0 in /usr/local/lib/python3.6/dist-packages (from tensorflow>=1.14->joeynmt==0.0.1) (1.1.0)\n","Requirement already satisfied: astunparse==1.6.3 in /usr/local/lib/python3.6/dist-packages (from tensorflow>=1.14->joeynmt==0.0.1) (1.6.3)\n","Requirement already satisfied: gast==0.3.3 in /usr/local/lib/python3.6/dist-packages (from tensorflow>=1.14->joeynmt==0.0.1) (0.3.3)\n","Requirement already satisfied: grpcio>=1.8.6 in /usr/local/lib/python3.6/dist-packages (from tensorflow>=1.14->joeynmt==0.0.1) (1.29.0)\n","Requirement already satisfied: h5py<2.11.0,>=2.10.0 in /usr/local/lib/python3.6/dist-packages (from tensorflow>=1.14->joeynmt==0.0.1) (2.10.0)\n","Requirement already satisfied: requests in /usr/local/lib/python3.6/dist-packages (from torchtext->joeynmt==0.0.1) (2.23.0)\n","Requirement already satisfied: tqdm in /usr/local/lib/python3.6/dist-packages (from torchtext->joeynmt==0.0.1) (4.41.1)\n","Collecting portalocker\n","  Downloading https://files.pythonhosted.org/packages/53/84/7b3146ec6378d28abc73ab484f09f47dfa008ad6f03f33d90a369f880e25/portalocker-1.7.0-py2.py3-none-any.whl\n","Requirement already satisfied: typing in /usr/local/lib/python3.6/dist-packages (from sacrebleu>=1.3.6->joeynmt==0.0.1) (3.6.6)\n","Requirement already satisfied: kiwisolver>=1.0.1 in /usr/local/lib/python3.6/dist-packages (from matplotlib->joeynmt==0.0.1) (1.2.0)\n","Requirement already satisfied: cycler>=0.10 in /usr/local/lib/python3.6/dist-packages (from matplotlib->joeynmt==0.0.1) (0.10.0)\n","Requirement already satisfied: python-dateutil>=2.1 in /usr/local/lib/python3.6/dist-packages (from matplotlib->joeynmt==0.0.1) (2.8.1)\n","Requirement already satisfied: pyparsing!=2.0.4,!=2.1.2,!=2.1.6,>=2.0.1 in /usr/local/lib/python3.6/dist-packages (from matplotlib->joeynmt==0.0.1) (2.4.7)\n","Requirement already satisfied: pandas>=0.22.0 in /usr/local/lib/python3.6/dist-packages (from seaborn->joeynmt==0.0.1) (1.0.3)\n","Collecting astroid<=2.5,>=2.4.0\n","\u001b[?25l  Downloading https://files.pythonhosted.org/packages/46/c9/e9c2642dfb169590fb8bdb395f9329da042ee559c2ae7c1e612a3e5f40b4/astroid-2.4.1-py3-none-any.whl (214kB)\n","\u001b[K     |████████████████████████████████| 215kB 33.3MB/s \n","\u001b[?25hCollecting toml>=0.7.1\n","  Downloading https://files.pythonhosted.org/packages/9f/e1/1b40b80f2e1663a6b9f497123c11d7d988c0919abbf3c3f2688e448c5363/toml-0.10.1-py2.py3-none-any.whl\n","Collecting mccabe<0.7,>=0.6\n","  Downloading https://files.pythonhosted.org/packages/87/89/479dc97e18549e21354893e4ee4ef36db1d237534982482c3681ee6e7b57/mccabe-0.6.1-py2.py3-none-any.whl\n","Collecting isort<5,>=4.2.5\n","\u001b[?25l  Downloading https://files.pythonhosted.org/packages/e5/b0/c121fd1fa3419ea9bfd55c7f9c4fedfec5143208d8c7ad3ce3db6c623c21/isort-4.3.21-py2.py3-none-any.whl (42kB)\n","\u001b[K     |████████████████████████████████| 51kB 6.9MB/s \n","\u001b[?25hRequirement already satisfied: google-auth<2,>=1.6.3 in /usr/local/lib/python3.6/dist-packages (from tensorboard<2.3.0,>=2.2.0->tensorflow>=1.14->joeynmt==0.0.1) (1.7.2)\n","Requirement already satisfied: tensorboard-plugin-wit>=1.6.0 in /usr/local/lib/python3.6/dist-packages (from tensorboard<2.3.0,>=2.2.0->tensorflow>=1.14->joeynmt==0.0.1) (1.6.0.post3)\n","Requirement already satisfied: werkzeug>=0.11.15 in /usr/local/lib/python3.6/dist-packages (from tensorboard<2.3.0,>=2.2.0->tensorflow>=1.14->joeynmt==0.0.1) (1.0.1)\n","Requirement already satisfied: google-auth-oauthlib<0.5,>=0.4.1 in /usr/local/lib/python3.6/dist-packages (from tensorboard<2.3.0,>=2.2.0->tensorflow>=1.14->joeynmt==0.0.1) (0.4.1)\n","Requirement already satisfied: markdown>=2.6.8 in /usr/local/lib/python3.6/dist-packages (from tensorboard<2.3.0,>=2.2.0->tensorflow>=1.14->joeynmt==0.0.1) (3.2.2)\n","Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python3.6/dist-packages (from requests->torchtext->joeynmt==0.0.1) (2020.4.5.1)\n","Requirement already satisfied: chardet<4,>=3.0.2 in /usr/local/lib/python3.6/dist-packages (from requests->torchtext->joeynmt==0.0.1) (3.0.4)\n","Requirement already satisfied: idna<3,>=2.5 in /usr/local/lib/python3.6/dist-packages (from requests->torchtext->joeynmt==0.0.1) (2.9)\n","Requirement already satisfied: urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 in /usr/local/lib/python3.6/dist-packages (from requests->torchtext->joeynmt==0.0.1) (1.24.3)\n","Requirement already satisfied: pytz>=2017.2 in /usr/local/lib/python3.6/dist-packages (from pandas>=0.22.0->seaborn->joeynmt==0.0.1) (2018.9)\n","Collecting typed-ast<1.5,>=1.4.0; implementation_name == \"cpython\" and python_version < \"3.8\"\n","\u001b[?25l  Downloading https://files.pythonhosted.org/packages/90/ed/5459080d95eb87a02fe860d447197be63b6e2b5e9ff73c2b0a85622994f4/typed_ast-1.4.1-cp36-cp36m-manylinux1_x86_64.whl (737kB)\n","\u001b[K     |████████████████████████████████| 747kB 22.9MB/s \n","\u001b[?25hCollecting lazy-object-proxy==1.4.*\n","\u001b[?25l  Downloading https://files.pythonhosted.org/packages/0b/dd/b1e3407e9e6913cf178e506cd0dee818e58694d9a5cd1984e3f6a8b9a10f/lazy_object_proxy-1.4.3-cp36-cp36m-manylinux1_x86_64.whl (55kB)\n","\u001b[K     |████████████████████████████████| 61kB 7.4MB/s \n","\u001b[?25hRequirement already satisfied: pyasn1-modules>=0.2.1 in /usr/local/lib/python3.6/dist-packages (from google-auth<2,>=1.6.3->tensorboard<2.3.0,>=2.2.0->tensorflow>=1.14->joeynmt==0.0.1) (0.2.8)\n","Requirement already satisfied: rsa<4.1,>=3.1.4 in /usr/local/lib/python3.6/dist-packages (from google-auth<2,>=1.6.3->tensorboard<2.3.0,>=2.2.0->tensorflow>=1.14->joeynmt==0.0.1) (4.0)\n","Requirement already satisfied: cachetools<3.2,>=2.0.0 in /usr/local/lib/python3.6/dist-packages (from google-auth<2,>=1.6.3->tensorboard<2.3.0,>=2.2.0->tensorflow>=1.14->joeynmt==0.0.1) (3.1.1)\n","Requirement already satisfied: requests-oauthlib>=0.7.0 in /usr/local/lib/python3.6/dist-packages (from google-auth-oauthlib<0.5,>=0.4.1->tensorboard<2.3.0,>=2.2.0->tensorflow>=1.14->joeynmt==0.0.1) (1.3.0)\n","Requirement already satisfied: importlib-metadata; python_version < \"3.8\" in /usr/local/lib/python3.6/dist-packages (from markdown>=2.6.8->tensorboard<2.3.0,>=2.2.0->tensorflow>=1.14->joeynmt==0.0.1) (1.6.0)\n","Requirement already satisfied: pyasn1<0.5.0,>=0.4.6 in /usr/local/lib/python3.6/dist-packages (from pyasn1-modules>=0.2.1->google-auth<2,>=1.6.3->tensorboard<2.3.0,>=2.2.0->tensorflow>=1.14->joeynmt==0.0.1) (0.4.8)\n","Requirement already satisfied: oauthlib>=3.0.0 in /usr/local/lib/python3.6/dist-packages (from requests-oauthlib>=0.7.0->google-auth-oauthlib<0.5,>=0.4.1->tensorboard<2.3.0,>=2.2.0->tensorflow>=1.14->joeynmt==0.0.1) (3.1.0)\n","Requirement already satisfied: zipp>=0.5 in /usr/local/lib/python3.6/dist-packages (from importlib-metadata; python_version < \"3.8\"->markdown>=2.6.8->tensorboard<2.3.0,>=2.2.0->tensorflow>=1.14->joeynmt==0.0.1) (3.1.0)\n","Building wheels for collected packages: joeynmt, pyyaml, wrapt\n","  Building wheel for joeynmt (setup.py) ... \u001b[?25l\u001b[?25hdone\n","  Created wheel for joeynmt: filename=joeynmt-0.0.1-cp36-none-any.whl size=73768 sha256=da8645223b06773d105a1bcc75c52b79a8a821fb8335bf2a8caca892828dabcb\n","  Stored in directory: /tmp/pip-ephem-wheel-cache-mx6gip50/wheels/db/01/db/751cc9f3e7f6faec127c43644ba250a3ea7ad200594aeda70a\n","  Building wheel for pyyaml (setup.py) ... \u001b[?25l\u001b[?25hdone\n","  Created wheel for pyyaml: filename=PyYAML-5.3.1-cp36-cp36m-linux_x86_64.whl size=44621 sha256=651a55e8c111050dda0b4c61a0ef9be4df1dcbff92af8f4668d73f9bfc8a92f5\n","  Stored in directory: /root/.cache/pip/wheels/a7/c1/ea/cf5bd31012e735dc1dfea3131a2d5eae7978b251083d6247bd\n","  Building wheel for wrapt (setup.py) ... \u001b[?25l\u001b[?25hdone\n","  Created wheel for wrapt: filename=wrapt-1.11.1-cp36-cp36m-linux_x86_64.whl size=67429 sha256=70c724df4203711c3630d0de30b2bd97506c5bc779e8d1ccd942c209bea47141\n","  Stored in directory: /root/.cache/pip/wheels/89/67/41/63cbf0f6ac0a6156588b9587be4db5565f8c6d8ccef98202fc\n","Successfully built joeynmt pyyaml wrapt\n","Installing collected packages: portalocker, sacrebleu, subword-nmt, pyyaml, typed-ast, lazy-object-proxy, wrapt, astroid, toml, mccabe, isort, pylint, joeynmt\n","  Found existing installation: PyYAML 3.13\n","    Uninstalling PyYAML-3.13:\n","      Successfully uninstalled PyYAML-3.13\n","  Found existing installation: wrapt 1.12.1\n","    Uninstalling wrapt-1.12.1:\n","      Successfully uninstalled wrapt-1.12.1\n","Successfully installed astroid-2.4.1 isort-4.3.21 joeynmt-0.0.1 lazy-object-proxy-1.4.3 mccabe-0.6.1 portalocker-1.7.0 pylint-2.5.2 pyyaml-5.3.1 sacrebleu-1.4.9 subword-nmt-0.3.7 toml-0.10.1 typed-ast-1.4.1 wrapt-1.11.1\n","time: 14.4 s\n"],"name":"stdout"}]},{"cell_type":"markdown","metadata":{"colab_type":"text","id":"AaE77Tcppex9"},"source":["# Preprocessing the Data into Subword BPE Tokens\n","\n","- One of the most powerful improvements for agglutinative languages (a feature of most Bantu languages) is using BPE tokenization [ (Sennrich, 2015) ](https://arxiv.org/abs/1508.07909).\n","\n","- It was also shown that by optimizing the umber of BPE codes we significantly improve results for low-resourced languages [(Sennrich, 2019)](https://www.aclweb.org/anthology/P19-1021) [(Martinus, 2019)](https://arxiv.org/abs/1906.05685)\n","\n","- Below we have the scripts for doing BPE tokenization of our data. We use 4000 tokens as recommended by [(Sennrich, 2019)](https://www.aclweb.org/anthology/P19-1021). You do not need to change anything. Simply running the below will be suitable. "]},{"cell_type":"code","metadata":{"colab_type":"code","id":"H-TyjtmXB1mL","colab":{"base_uri":"https://localhost:8080/","height":445},"outputId":"7d21d162-26e1-4a01-88b3-af3cc4e44cdd","executionInfo":{"status":"ok","timestamp":1590090016272,"user_tz":0,"elapsed":10113376,"user":{"displayName":"Salomey Osei","photoUrl":"","userId":"06221058988152607684"}}},"source":["# One of the huge boosts in NMT performance was to use a different method of tokenizing. \n","# Usually, NMT would tokenize by words. However, using a method called BPE gave amazing boosts to performance\n","\n","# Do subword NMT\n","from os import path\n","os.environ[\"src\"] = source_language # Sets them in bash as well, since we often use bash scripts\n","os.environ[\"tgt\"] = target_language\n","\n","# Learn BPEs on the training data.\n","os.environ[\"data_path\"] = path.join(\"joeynmt\", \"data\", source_language + target_language) # Herman! \n","! subword-nmt learn-joint-bpe-and-vocab --input train.$src train.$tgt -s 4000 -o bpe.codes.4000 --write-vocabulary vocab.$src vocab.$tgt\n","\n","# Apply BPE splits to the development and test data.\n","! subword-nmt apply-bpe -c bpe.codes.4000 --vocabulary vocab.$src < train.$src > train.bpe.$src\n","! subword-nmt apply-bpe -c bpe.codes.4000 --vocabulary vocab.$tgt < train.$tgt > train.bpe.$tgt\n","\n","! subword-nmt apply-bpe -c bpe.codes.4000 --vocabulary vocab.$src < dev.$src > dev.bpe.$src\n","! subword-nmt apply-bpe -c bpe.codes.4000 --vocabulary vocab.$tgt < dev.$tgt > dev.bpe.$tgt\n","! subword-nmt apply-bpe -c bpe.codes.4000 --vocabulary vocab.$src < test.$src > test.bpe.$src\n","! subword-nmt apply-bpe -c bpe.codes.4000 --vocabulary vocab.$tgt < test.$tgt > test.bpe.$tgt\n","\n","# Create directory, move everyone we care about to the correct location\n","! mkdir -p $data_path\n","! cp train.* $data_path\n","! cp test.* $data_path\n","! cp dev.* $data_path\n","! cp bpe.codes.4000 $data_path\n","! ls $data_path\n","\n","# Also move everything we care about to a mounted location in google drive (relevant if running in colab) at gdrive_path\n","! cp train.* \"$gdrive_path\"\n","! cp test.* \"$gdrive_path\"\n","! cp dev.* \"$gdrive_path\"\n","! cp bpe.codes.4000 \"$gdrive_path\"\n","! ls \"$gdrive_path\"\n","\n","# Create that vocab using build_vocab\n","! sudo chmod 777 joeynmt/scripts/build_vocab.py\n","! joeynmt/scripts/build_vocab.py joeynmt/data/$src$tgt/train.bpe.$src joeynmt/data/$src$tgt/train.bpe.$tgt --output_path joeynmt/data/$src$tgt/vocab.txt\n","\n","# Some output\n","! echo \"BPE Xhosa Sentences\"\n","! tail -n 5 test.bpe.$tgt\n","! echo \"Combined BPE Vocab\"\n","! tail -n 10 joeynmt/data/$src$tgt/vocab.txt  # Herman"],"execution_count":15,"outputs":[{"output_type":"stream","text":["bpe.codes.4000\tdev.en\t     test.bpe.tw     test.tw\t   train.en\n","dev.bpe.en\tdev.tw\t     test.en\t     train.bpe.en  train.tw\n","dev.bpe.tw\ttest.bpe.en  test.en-any.en  train.bpe.tw\n","bpe.codes.4000\tdev.en\t     test.bpe.tw     test.tw\t   train.en\n","dev.bpe.en\tdev.tw\t     test.en\t     train.bpe.en  train.tw\n","dev.bpe.tw\ttest.bpe.en  test.en-any.en  train.bpe.tw\n","BPE Xhosa Sentences\n","18 , 19 . ( a ) Dɛn na w’@@ asafo mufo betumi ayɛ de aboa wo na wo@@ an@@ nyin@@ a ɔ@@ fã biara akyi ?\n","nhoma no ti 14 . “ Mi@@ dw@@ enn@@ wen Mmebusɛm 27 : 11 , Mateo 26 : 5@@ 2 , ne Yohane 13 : 35 ho ma ɛ@@ hyɛɛ me gyidi den , enti mank@@ ɔ s@@ ra@@ adi .\n","Bible mu nsɛm yi boaa me , enti bere a wɔre@@ di m’@@ asɛm no , m@@ ammɔ hu . ” ​ — An@@ dri@@ y , ofi U@@ k@@ ra@@ ine .\n","“ Yesaia 2 : 4 boaa me , enti man@@ nyin@@ a ɔ@@ fã biara wɔ sɔhwɛ mu .\n","M@@ it@@ waa wiase foforo no ho mfonini wɔ m’@@ adwenem , na mede m’ani buu bere a obiara re@@ mfa ako@@ de mp@@ i@@ ra ne n@@ ua bio no . ” ​ — W@@ il@@ m@@ er , ofi Col@@ om@@ bia .\n","Combined BPE Vocab\n","⁄@@\n","Õ@@\n","₡\n","-@@\n","eremia\n","ụ@@\n","Hebre@@\n","ō\n","ụ\n","▼\n","time: 3min 2s\n"],"name":"stdout"}]},{"cell_type":"code","metadata":{"colab_type":"code","id":"IlMitUHR8Qy-","colab":{"base_uri":"https://localhost:8080/","height":85},"outputId":"c8e9732f-430a-4631-caa7-706debb2cf2d","executionInfo":{"status":"ok","timestamp":1590090028932,"user_tz":0,"elapsed":10126033,"user":{"displayName":"Salomey Osei","photoUrl":"","userId":"06221058988152607684"}}},"source":["# Also move everything we care about to a mounted location in google drive (relevant if running in colab) at gdrive_path\n","! cp train.* \"$gdrive_path\"\n","! cp test.* \"$gdrive_path\"\n","! cp dev.* \"$gdrive_path\"\n","! cp bpe.codes.4000 \"$gdrive_path\"\n","! ls \"$gdrive_path\""],"execution_count":16,"outputs":[{"output_type":"stream","text":["bpe.codes.4000\tdev.en\t     test.bpe.tw     test.tw\t   train.en\n","dev.bpe.en\tdev.tw\t     test.en\t     train.bpe.en  train.tw\n","dev.bpe.tw\ttest.bpe.en  test.en-any.en  train.bpe.tw\n","time: 12.6 s\n"],"name":"stdout"}]},{"cell_type":"markdown","metadata":{"colab_type":"text","id":"Ixmzi60WsUZ8"},"source":["# Creating the JoeyNMT Config\n","\n","JoeyNMT requires a yaml config. We provide a template below. We've also set a number of defaults with it, that you may play with!\n","\n","- We used Transformer architecture \n","- We set our dropout to reasonably high: 0.3 (recommended in  [(Sennrich, 2019)](https://www.aclweb.org/anthology/P19-1021))\n","\n","Things worth playing with:\n","- The batch size (also recommended to change for low-resourced languages)\n","- The number of epochs (we've set it at 30 just so it runs in about an hour, for testing purposes)\n","- The decoder options (beam_size, alpha)\n","- Evaluation metrics (BLEU versus Crhf4)"]},{"cell_type":"code","metadata":{"colab_type":"code","id":"PIs1lY2hxMsl","colab":{"base_uri":"https://localhost:8080/","height":34},"outputId":"156c43a6-2f9d-4850-ef5f-cce72ccf9958","executionInfo":{"status":"ok","timestamp":1590090028934,"user_tz":0,"elapsed":10126032,"user":{"displayName":"Salomey Osei","photoUrl":"","userId":"06221058988152607684"}}},"source":["# This creates the config file for our JoeyNMT system. It might seem overwhelming so we've provided a couple of useful parameters you'll need to update\n","# (You can of course play with all the parameters if you'd like!)\n","\n","name = '%s%s' % (source_language, target_language)\n","gdrive_path = os.environ[\"gdrive_path\"]\n","\n","# Create the config\n","config = \"\"\"\n","name: \"{name}_transformer\"\n","\n","data:\n","    src: \"{source_language}\"\n","    trg: \"{target_language}\"\n","    train: \"data/{name}/train.bpe\"\n","    dev:   \"data/{name}/dev.bpe\"\n","    test:  \"data/{name}/test.bpe\"\n","    level: \"bpe\"\n","    lowercase: False\n","    max_sent_length: 100\n","    src_vocab: \"data/{name}/vocab.txt\"\n","    trg_vocab: \"data/{name}/vocab.txt\"\n","\n","testing:\n","    beam_size: 5\n","    alpha: 1.0\n","\n","training:\n","    #load_model: \"{gdrive_path}/models/{name}_transformer/1.ckpt\" # if uncommented, load a pre-trained model from this checkpoint\n","    random_seed: 42\n","    optimizer: \"adam\"\n","    normalization: \"tokens\"\n","    adam_betas: [0.9, 0.999] \n","    scheduling: \"plateau\"           # TODO: try switching from plateau to Noam scheduling\n","    patience: 5                     # For plateau: decrease learning rate by decrease_factor if validation score has not improved for this many validation rounds.\n","    learning_rate_factor: 0.5       # factor for Noam scheduler (used with Transformer)\n","    learning_rate_warmup: 1000      # warmup steps for Noam scheduler (used with Transformer)\n","    decrease_factor: 0.7\n","    loss: \"crossentropy\"\n","    learning_rate: 0.0003\n","    learning_rate_min: 0.00000001\n","    weight_decay: 0.0\n","    label_smoothing: 0.1\n","    batch_size: 4096\n","    batch_type: \"token\"\n","    eval_batch_size: 3600\n","    eval_batch_type: \"token\"\n","    batch_multiplier: 1\n","    early_stopping_metric: \"ppl\"\n","    epochs: 25                     # TODO: Decrease for when playing around and checking of working. Around 30 is sufficient to check if its working at all\n","    validation_freq: 1000          # TODO: Set to at least once per epoch.\n","    logging_freq: 100\n","    eval_metric: \"bleu\"\n","    model_dir: \"models/{name}_transformer\"\n","    overwrite: False               # TODO: Set to True if you want to overwrite possibly existing models. \n","    shuffle: True\n","    use_cuda: True\n","    max_output_length: 100\n","    print_valid_sents: [0, 1, 2, 3]\n","    keep_last_ckpts: 3\n","\n","model:\n","    initializer: \"xavier\"\n","    bias_initializer: \"zeros\"\n","    init_gain: 1.0\n","    embed_initializer: \"xavier\"\n","    embed_init_gain: 1.0\n","    tied_embeddings: True\n","    tied_softmax: True\n","    encoder:\n","        type: \"transformer\"\n","        num_layers: 6\n","        num_heads: 4             # TODO: Increase to 8 for larger data.\n","        embeddings:\n","            embedding_dim: 256   # TODO: Increase to 512 for larger data.\n","            scale: True\n","            dropout: 0.2\n","        # typically ff_size = 4 x hidden_size\n","        hidden_size: 256         # TODO: Increase to 512 for larger data.\n","        ff_size: 1024            # TODO: Increase to 2048 for larger data.\n","        dropout: 0.3\n","    decoder:\n","        type: \"transformer\"\n","        num_layers: 6\n","        num_heads: 4              # TODO: Increase to 8 for larger data.\n","        embeddings:\n","            embedding_dim: 256    # TODO: Increase to 512 for larger data.\n","            scale: True\n","            dropout: 0.2\n","        # typically ff_size = 4 x hidden_size\n","        hidden_size: 256         # TODO: Increase to 512 for larger data.\n","        ff_size: 1024            # TODO: Increase to 2048 for larger data.\n","        dropout: 0.3\n","\"\"\".format(name=name, gdrive_path=os.environ[\"gdrive_path\"], source_language=source_language, target_language=target_language)\n","with open(\"joeynmt/configs/transformer_{name}.yaml\".format(name=name),'w') as f:\n","    f.write(config)"],"execution_count":17,"outputs":[{"output_type":"stream","text":["time: 27.3 ms\n"],"name":"stdout"}]},{"cell_type":"markdown","metadata":{"colab_type":"text","id":"pIifxE3Qzuvs"},"source":["# Train the Model\n","\n","This single line of joeynmt runs the training using the config we made above"]},{"cell_type":"code","metadata":{"colab_type":"code","id":"6ZBPFwT94WpI","colab":{"base_uri":"https://localhost:8080/","height":1000},"outputId":"f8e100ac-a0d5-4158-e94d-c328389ec274","executionInfo":{"status":"ok","timestamp":1590108554582,"user_tz":0,"elapsed":28651678,"user":{"displayName":"Salomey Osei","photoUrl":"","userId":"06221058988152607684"}}},"source":["# Train the model\n","# You can press Ctrl-C to stop. And then run the next cell to save your checkpoints! \n","!cd joeynmt; python3 -m joeynmt train configs/transformer_$src$tgt.yaml"],"execution_count":18,"outputs":[{"output_type":"stream","text":["2020-05-21 19:40:43,127 Hello! This is Joey-NMT.\n","2020-05-21 19:40:43.250811: I tensorflow/stream_executor/platform/default/dso_loader.cc:44] Successfully opened dynamic library libcudart.so.10.1\n","2020-05-21 19:40:44,313 Total params: 12188160\n","2020-05-21 19:40:44,315 Trainable parameters: ['decoder.layer_norm.bias', 'decoder.layer_norm.weight', 'decoder.layers.0.dec_layer_norm.bias', 'decoder.layers.0.dec_layer_norm.weight', 'decoder.layers.0.feed_forward.layer_norm.bias', 'decoder.layers.0.feed_forward.layer_norm.weight', 'decoder.layers.0.feed_forward.pwff_layer.0.bias', 'decoder.layers.0.feed_forward.pwff_layer.0.weight', 'decoder.layers.0.feed_forward.pwff_layer.3.bias', 'decoder.layers.0.feed_forward.pwff_layer.3.weight', 'decoder.layers.0.src_trg_att.k_layer.bias', 'decoder.layers.0.src_trg_att.k_layer.weight', 'decoder.layers.0.src_trg_att.output_layer.bias', 'decoder.layers.0.src_trg_att.output_layer.weight', 'decoder.layers.0.src_trg_att.q_layer.bias', 'decoder.layers.0.src_trg_att.q_layer.weight', 'decoder.layers.0.src_trg_att.v_layer.bias', 'decoder.layers.0.src_trg_att.v_layer.weight', 'decoder.layers.0.trg_trg_att.k_layer.bias', 'decoder.layers.0.trg_trg_att.k_layer.weight', 'decoder.layers.0.trg_trg_att.output_layer.bias', 'decoder.layers.0.trg_trg_att.output_layer.weight', 'decoder.layers.0.trg_trg_att.q_layer.bias', 'decoder.layers.0.trg_trg_att.q_layer.weight', 'decoder.layers.0.trg_trg_att.v_layer.bias', 'decoder.layers.0.trg_trg_att.v_layer.weight', 'decoder.layers.0.x_layer_norm.bias', 'decoder.layers.0.x_layer_norm.weight', 'decoder.layers.1.dec_layer_norm.bias', 'decoder.layers.1.dec_layer_norm.weight', 'decoder.layers.1.feed_forward.layer_norm.bias', 'decoder.layers.1.feed_forward.layer_norm.weight', 'decoder.layers.1.feed_forward.pwff_layer.0.bias', 'decoder.layers.1.feed_forward.pwff_layer.0.weight', 'decoder.layers.1.feed_forward.pwff_layer.3.bias', 'decoder.layers.1.feed_forward.pwff_layer.3.weight', 'decoder.layers.1.src_trg_att.k_layer.bias', 'decoder.layers.1.src_trg_att.k_layer.weight', 'decoder.layers.1.src_trg_att.output_layer.bias', 'decoder.layers.1.src_trg_att.output_layer.weight', 'decoder.layers.1.src_trg_att.q_layer.bias', 'decoder.layers.1.src_trg_att.q_layer.weight', 'decoder.layers.1.src_trg_att.v_layer.bias', 'decoder.layers.1.src_trg_att.v_layer.weight', 'decoder.layers.1.trg_trg_att.k_layer.bias', 'decoder.layers.1.trg_trg_att.k_layer.weight', 'decoder.layers.1.trg_trg_att.output_layer.bias', 'decoder.layers.1.trg_trg_att.output_layer.weight', 'decoder.layers.1.trg_trg_att.q_layer.bias', 'decoder.layers.1.trg_trg_att.q_layer.weight', 'decoder.layers.1.trg_trg_att.v_layer.bias', 'decoder.layers.1.trg_trg_att.v_layer.weight', 'decoder.layers.1.x_layer_norm.bias', 'decoder.layers.1.x_layer_norm.weight', 'decoder.layers.2.dec_layer_norm.bias', 'decoder.layers.2.dec_layer_norm.weight', 'decoder.layers.2.feed_forward.layer_norm.bias', 'decoder.layers.2.feed_forward.layer_norm.weight', 'decoder.layers.2.feed_forward.pwff_layer.0.bias', 'decoder.layers.2.feed_forward.pwff_layer.0.weight', 'decoder.layers.2.feed_forward.pwff_layer.3.bias', 'decoder.layers.2.feed_forward.pwff_layer.3.weight', 'decoder.layers.2.src_trg_att.k_layer.bias', 'decoder.layers.2.src_trg_att.k_layer.weight', 'decoder.layers.2.src_trg_att.output_layer.bias', 'decoder.layers.2.src_trg_att.output_layer.weight', 'decoder.layers.2.src_trg_att.q_layer.bias', 'decoder.layers.2.src_trg_att.q_layer.weight', 'decoder.layers.2.src_trg_att.v_layer.bias', 'decoder.layers.2.src_trg_att.v_layer.weight', 'decoder.layers.2.trg_trg_att.k_layer.bias', 'decoder.layers.2.trg_trg_att.k_layer.weight', 'decoder.layers.2.trg_trg_att.output_layer.bias', 'decoder.layers.2.trg_trg_att.output_layer.weight', 'decoder.layers.2.trg_trg_att.q_layer.bias', 'decoder.layers.2.trg_trg_att.q_layer.weight', 'decoder.layers.2.trg_trg_att.v_layer.bias', 'decoder.layers.2.trg_trg_att.v_layer.weight', 'decoder.layers.2.x_layer_norm.bias', 'decoder.layers.2.x_layer_norm.weight', 'decoder.layers.3.dec_layer_norm.bias', 'decoder.layers.3.dec_layer_norm.weight', 'decoder.layers.3.feed_forward.layer_norm.bias', 'decoder.layers.3.feed_forward.layer_norm.weight', 'decoder.layers.3.feed_forward.pwff_layer.0.bias', 'decoder.layers.3.feed_forward.pwff_layer.0.weight', 'decoder.layers.3.feed_forward.pwff_layer.3.bias', 'decoder.layers.3.feed_forward.pwff_layer.3.weight', 'decoder.layers.3.src_trg_att.k_layer.bias', 'decoder.layers.3.src_trg_att.k_layer.weight', 'decoder.layers.3.src_trg_att.output_layer.bias', 'decoder.layers.3.src_trg_att.output_layer.weight', 'decoder.layers.3.src_trg_att.q_layer.bias', 'decoder.layers.3.src_trg_att.q_layer.weight', 'decoder.layers.3.src_trg_att.v_layer.bias', 'decoder.layers.3.src_trg_att.v_layer.weight', 'decoder.layers.3.trg_trg_att.k_layer.bias', 'decoder.layers.3.trg_trg_att.k_layer.weight', 'decoder.layers.3.trg_trg_att.output_layer.bias', 'decoder.layers.3.trg_trg_att.output_layer.weight', 'decoder.layers.3.trg_trg_att.q_layer.bias', 'decoder.layers.3.trg_trg_att.q_layer.weight', 'decoder.layers.3.trg_trg_att.v_layer.bias', 'decoder.layers.3.trg_trg_att.v_layer.weight', 'decoder.layers.3.x_layer_norm.bias', 'decoder.layers.3.x_layer_norm.weight', 'decoder.layers.4.dec_layer_norm.bias', 'decoder.layers.4.dec_layer_norm.weight', 'decoder.layers.4.feed_forward.layer_norm.bias', 'decoder.layers.4.feed_forward.layer_norm.weight', 'decoder.layers.4.feed_forward.pwff_layer.0.bias', 'decoder.layers.4.feed_forward.pwff_layer.0.weight', 'decoder.layers.4.feed_forward.pwff_layer.3.bias', 'decoder.layers.4.feed_forward.pwff_layer.3.weight', 'decoder.layers.4.src_trg_att.k_layer.bias', 'decoder.layers.4.src_trg_att.k_layer.weight', 'decoder.layers.4.src_trg_att.output_layer.bias', 'decoder.layers.4.src_trg_att.output_layer.weight', 'decoder.layers.4.src_trg_att.q_layer.bias', 'decoder.layers.4.src_trg_att.q_layer.weight', 'decoder.layers.4.src_trg_att.v_layer.bias', 'decoder.layers.4.src_trg_att.v_layer.weight', 'decoder.layers.4.trg_trg_att.k_layer.bias', 'decoder.layers.4.trg_trg_att.k_layer.weight', 'decoder.layers.4.trg_trg_att.output_layer.bias', 'decoder.layers.4.trg_trg_att.output_layer.weight', 'decoder.layers.4.trg_trg_att.q_layer.bias', 'decoder.layers.4.trg_trg_att.q_layer.weight', 'decoder.layers.4.trg_trg_att.v_layer.bias', 'decoder.layers.4.trg_trg_att.v_layer.weight', 'decoder.layers.4.x_layer_norm.bias', 'decoder.layers.4.x_layer_norm.weight', 'decoder.layers.5.dec_layer_norm.bias', 'decoder.layers.5.dec_layer_norm.weight', 'decoder.layers.5.feed_forward.layer_norm.bias', 'decoder.layers.5.feed_forward.layer_norm.weight', 'decoder.layers.5.feed_forward.pwff_layer.0.bias', 'decoder.layers.5.feed_forward.pwff_layer.0.weight', 'decoder.layers.5.feed_forward.pwff_layer.3.bias', 'decoder.layers.5.feed_forward.pwff_layer.3.weight', 'decoder.layers.5.src_trg_att.k_layer.bias', 'decoder.layers.5.src_trg_att.k_layer.weight', 'decoder.layers.5.src_trg_att.output_layer.bias', 'decoder.layers.5.src_trg_att.output_layer.weight', 'decoder.layers.5.src_trg_att.q_layer.bias', 'decoder.layers.5.src_trg_att.q_layer.weight', 'decoder.layers.5.src_trg_att.v_layer.bias', 'decoder.layers.5.src_trg_att.v_layer.weight', 'decoder.layers.5.trg_trg_att.k_layer.bias', 'decoder.layers.5.trg_trg_att.k_layer.weight', 'decoder.layers.5.trg_trg_att.output_layer.bias', 'decoder.layers.5.trg_trg_att.output_layer.weight', 'decoder.layers.5.trg_trg_att.q_layer.bias', 'decoder.layers.5.trg_trg_att.q_layer.weight', 'decoder.layers.5.trg_trg_att.v_layer.bias', 'decoder.layers.5.trg_trg_att.v_layer.weight', 'decoder.layers.5.x_layer_norm.bias', 'decoder.layers.5.x_layer_norm.weight', 'encoder.layer_norm.bias', 'encoder.layer_norm.weight', 'encoder.layers.0.feed_forward.layer_norm.bias', 'encoder.layers.0.feed_forward.layer_norm.weight', 'encoder.layers.0.feed_forward.pwff_layer.0.bias', 'encoder.layers.0.feed_forward.pwff_layer.0.weight', 'encoder.layers.0.feed_forward.pwff_layer.3.bias', 'encoder.layers.0.feed_forward.pwff_layer.3.weight', 'encoder.layers.0.layer_norm.bias', 'encoder.layers.0.layer_norm.weight', 'encoder.layers.0.src_src_att.k_layer.bias', 'encoder.layers.0.src_src_att.k_layer.weight', 'encoder.layers.0.src_src_att.output_layer.bias', 'encoder.layers.0.src_src_att.output_layer.weight', 'encoder.layers.0.src_src_att.q_layer.bias', 'encoder.layers.0.src_src_att.q_layer.weight', 'encoder.layers.0.src_src_att.v_layer.bias', 'encoder.layers.0.src_src_att.v_layer.weight', 'encoder.layers.1.feed_forward.layer_norm.bias', 'encoder.layers.1.feed_forward.layer_norm.weight', 'encoder.layers.1.feed_forward.pwff_layer.0.bias', 'encoder.layers.1.feed_forward.pwff_layer.0.weight', 'encoder.layers.1.feed_forward.pwff_layer.3.bias', 'encoder.layers.1.feed_forward.pwff_layer.3.weight', 'encoder.layers.1.layer_norm.bias', 'encoder.layers.1.layer_norm.weight', 'encoder.layers.1.src_src_att.k_layer.bias', 'encoder.layers.1.src_src_att.k_layer.weight', 'encoder.layers.1.src_src_att.output_layer.bias', 'encoder.layers.1.src_src_att.output_layer.weight', 'encoder.layers.1.src_src_att.q_layer.bias', 'encoder.layers.1.src_src_att.q_layer.weight', 'encoder.layers.1.src_src_att.v_layer.bias', 'encoder.layers.1.src_src_att.v_layer.weight', 'encoder.layers.2.feed_forward.layer_norm.bias', 'encoder.layers.2.feed_forward.layer_norm.weight', 'encoder.layers.2.feed_forward.pwff_layer.0.bias', 'encoder.layers.2.feed_forward.pwff_layer.0.weight', 'encoder.layers.2.feed_forward.pwff_layer.3.bias', 'encoder.layers.2.feed_forward.pwff_layer.3.weight', 'encoder.layers.2.layer_norm.bias', 'encoder.layers.2.layer_norm.weight', 'encoder.layers.2.src_src_att.k_layer.bias', 'encoder.layers.2.src_src_att.k_layer.weight', 'encoder.layers.2.src_src_att.output_layer.bias', 'encoder.layers.2.src_src_att.output_layer.weight', 'encoder.layers.2.src_src_att.q_layer.bias', 'encoder.layers.2.src_src_att.q_layer.weight', 'encoder.layers.2.src_src_att.v_layer.bias', 'encoder.layers.2.src_src_att.v_layer.weight', 'encoder.layers.3.feed_forward.layer_norm.bias', 'encoder.layers.3.feed_forward.layer_norm.weight', 'encoder.layers.3.feed_forward.pwff_layer.0.bias', 'encoder.layers.3.feed_forward.pwff_layer.0.weight', 'encoder.layers.3.feed_forward.pwff_layer.3.bias', 'encoder.layers.3.feed_forward.pwff_layer.3.weight', 'encoder.layers.3.layer_norm.bias', 'encoder.layers.3.layer_norm.weight', 'encoder.layers.3.src_src_att.k_layer.bias', 'encoder.layers.3.src_src_att.k_layer.weight', 'encoder.layers.3.src_src_att.output_layer.bias', 'encoder.layers.3.src_src_att.output_layer.weight', 'encoder.layers.3.src_src_att.q_layer.bias', 'encoder.layers.3.src_src_att.q_layer.weight', 'encoder.layers.3.src_src_att.v_layer.bias', 'encoder.layers.3.src_src_att.v_layer.weight', 'encoder.layers.4.feed_forward.layer_norm.bias', 'encoder.layers.4.feed_forward.layer_norm.weight', 'encoder.layers.4.feed_forward.pwff_layer.0.bias', 'encoder.layers.4.feed_forward.pwff_layer.0.weight', 'encoder.layers.4.feed_forward.pwff_layer.3.bias', 'encoder.layers.4.feed_forward.pwff_layer.3.weight', 'encoder.layers.4.layer_norm.bias', 'encoder.layers.4.layer_norm.weight', 'encoder.layers.4.src_src_att.k_layer.bias', 'encoder.layers.4.src_src_att.k_layer.weight', 'encoder.layers.4.src_src_att.output_layer.bias', 'encoder.layers.4.src_src_att.output_layer.weight', 'encoder.layers.4.src_src_att.q_layer.bias', 'encoder.layers.4.src_src_att.q_layer.weight', 'encoder.layers.4.src_src_att.v_layer.bias', 'encoder.layers.4.src_src_att.v_layer.weight', 'encoder.layers.5.feed_forward.layer_norm.bias', 'encoder.layers.5.feed_forward.layer_norm.weight', 'encoder.layers.5.feed_forward.pwff_layer.0.bias', 'encoder.layers.5.feed_forward.pwff_layer.0.weight', 'encoder.layers.5.feed_forward.pwff_layer.3.bias', 'encoder.layers.5.feed_forward.pwff_layer.3.weight', 'encoder.layers.5.layer_norm.bias', 'encoder.layers.5.layer_norm.weight', 'encoder.layers.5.src_src_att.k_layer.bias', 'encoder.layers.5.src_src_att.k_layer.weight', 'encoder.layers.5.src_src_att.output_layer.bias', 'encoder.layers.5.src_src_att.output_layer.weight', 'encoder.layers.5.src_src_att.q_layer.bias', 'encoder.layers.5.src_src_att.q_layer.weight', 'encoder.layers.5.src_src_att.v_layer.bias', 'encoder.layers.5.src_src_att.v_layer.weight', 'src_embed.lut.weight']\n","2020-05-21 19:41:00,047 cfg.name                           : entw_transformer\n","2020-05-21 19:41:00,047 cfg.data.src                       : en\n","2020-05-21 19:41:00,048 cfg.data.trg                       : tw\n","2020-05-21 19:41:00,048 cfg.data.train                     : data/entw/train.bpe\n","2020-05-21 19:41:00,048 cfg.data.dev                       : data/entw/dev.bpe\n","2020-05-21 19:41:00,048 cfg.data.test                      : data/entw/test.bpe\n","2020-05-21 19:41:00,048 cfg.data.level                     : bpe\n","2020-05-21 19:41:00,048 cfg.data.lowercase                 : False\n","2020-05-21 19:41:00,048 cfg.data.max_sent_length           : 100\n","2020-05-21 19:41:00,048 cfg.data.src_vocab                 : data/entw/vocab.txt\n","2020-05-21 19:41:00,048 cfg.data.trg_vocab                 : data/entw/vocab.txt\n","2020-05-21 19:41:00,048 cfg.testing.beam_size              : 5\n","2020-05-21 19:41:00,048 cfg.testing.alpha                  : 1.0\n","2020-05-21 19:41:00,048 cfg.training.random_seed           : 42\n","2020-05-21 19:41:00,048 cfg.training.optimizer             : adam\n","2020-05-21 19:41:00,048 cfg.training.normalization         : tokens\n","2020-05-21 19:41:00,048 cfg.training.adam_betas            : [0.9, 0.999]\n","2020-05-21 19:41:00,048 cfg.training.scheduling            : plateau\n","2020-05-21 19:41:00,048 cfg.training.patience              : 5\n","2020-05-21 19:41:00,048 cfg.training.learning_rate_factor  : 0.5\n","2020-05-21 19:41:00,049 cfg.training.learning_rate_warmup  : 1000\n","2020-05-21 19:41:00,049 cfg.training.decrease_factor       : 0.7\n","2020-05-21 19:41:00,049 cfg.training.loss                  : crossentropy\n","2020-05-21 19:41:00,049 cfg.training.learning_rate         : 0.0003\n","2020-05-21 19:41:00,049 cfg.training.learning_rate_min     : 1e-08\n","2020-05-21 19:41:00,049 cfg.training.weight_decay          : 0.0\n","2020-05-21 19:41:00,049 cfg.training.label_smoothing       : 0.1\n","2020-05-21 19:41:00,049 cfg.training.batch_size            : 4096\n","2020-05-21 19:41:00,049 cfg.training.batch_type            : token\n","2020-05-21 19:41:00,049 cfg.training.eval_batch_size       : 3600\n","2020-05-21 19:41:00,049 cfg.training.eval_batch_type       : token\n","2020-05-21 19:41:00,049 cfg.training.batch_multiplier      : 1\n","2020-05-21 19:41:00,049 cfg.training.early_stopping_metric : ppl\n","2020-05-21 19:41:00,049 cfg.training.epochs                : 25\n","2020-05-21 19:41:00,049 cfg.training.validation_freq       : 1000\n","2020-05-21 19:41:00,049 cfg.training.logging_freq          : 100\n","2020-05-21 19:41:00,050 cfg.training.eval_metric           : bleu\n","2020-05-21 19:41:00,050 cfg.training.model_dir             : models/entw_transformer\n","2020-05-21 19:41:00,050 cfg.training.overwrite             : False\n","2020-05-21 19:41:00,050 cfg.training.shuffle               : True\n","2020-05-21 19:41:00,050 cfg.training.use_cuda              : True\n","2020-05-21 19:41:00,050 cfg.training.max_output_length     : 100\n","2020-05-21 19:41:00,050 cfg.training.print_valid_sents     : [0, 1, 2, 3]\n","2020-05-21 19:41:00,050 cfg.training.keep_last_ckpts       : 3\n","2020-05-21 19:41:00,050 cfg.model.initializer              : xavier\n","2020-05-21 19:41:00,050 cfg.model.bias_initializer         : zeros\n","2020-05-21 19:41:00,050 cfg.model.init_gain                : 1.0\n","2020-05-21 19:41:00,050 cfg.model.embed_initializer        : xavier\n","2020-05-21 19:41:00,050 cfg.model.embed_init_gain          : 1.0\n","2020-05-21 19:41:00,050 cfg.model.tied_embeddings          : True\n","2020-05-21 19:41:00,050 cfg.model.tied_softmax             : True\n","2020-05-21 19:41:00,050 cfg.model.encoder.type             : transformer\n","2020-05-21 19:41:00,050 cfg.model.encoder.num_layers       : 6\n","2020-05-21 19:41:00,051 cfg.model.encoder.num_heads        : 4\n","2020-05-21 19:41:00,051 cfg.model.encoder.embeddings.embedding_dim : 256\n","2020-05-21 19:41:00,051 cfg.model.encoder.embeddings.scale : True\n","2020-05-21 19:41:00,051 cfg.model.encoder.embeddings.dropout : 0.2\n","2020-05-21 19:41:00,051 cfg.model.encoder.hidden_size      : 256\n","2020-05-21 19:41:00,051 cfg.model.encoder.ff_size          : 1024\n","2020-05-21 19:41:00,051 cfg.model.encoder.dropout          : 0.3\n","2020-05-21 19:41:00,051 cfg.model.decoder.type             : transformer\n","2020-05-21 19:41:00,051 cfg.model.decoder.num_layers       : 6\n","2020-05-21 19:41:00,051 cfg.model.decoder.num_heads        : 4\n","2020-05-21 19:41:00,051 cfg.model.decoder.embeddings.embedding_dim : 256\n","2020-05-21 19:41:00,051 cfg.model.decoder.embeddings.scale : True\n","2020-05-21 19:41:00,051 cfg.model.decoder.embeddings.dropout : 0.2\n","2020-05-21 19:41:00,051 cfg.model.decoder.hidden_size      : 256\n","2020-05-21 19:41:00,051 cfg.model.decoder.ff_size          : 1024\n","2020-05-21 19:41:00,051 cfg.model.decoder.dropout          : 0.3\n","2020-05-21 19:41:00,051 Data set sizes: \n","\ttrain 540520,\n","\tvalid 1000,\n","\ttest 2695\n","2020-05-21 19:41:00,051 First training example:\n","\t[SRC] The message appe@@ aled to me .\n","\t[TRG] M’@@ ani gyee asɛm no ho .\n","2020-05-21 19:41:00,052 First 10 words (src): (0) <unk> (1) <pad> (2) <s> (3) </s> (4) . (5) , (6) a (7) no (8) the (9) sɛ\n","2020-05-21 19:41:00,052 First 10 words (trg): (0) <unk> (1) <pad> (2) <s> (3) </s> (4) . (5) , (6) a (7) no (8) the (9) sɛ\n","2020-05-21 19:41:00,052 Number of Src words (types): 4406\n","2020-05-21 19:41:00,052 Number of Trg words (types): 4406\n","2020-05-21 19:41:00,053 Model(\n","\tencoder=TransformerEncoder(num_layers=6, num_heads=4),\n","\tdecoder=TransformerDecoder(num_layers=6, num_heads=4),\n","\tsrc_embed=Embeddings(embedding_dim=256, vocab_size=4406),\n","\ttrg_embed=Embeddings(embedding_dim=256, vocab_size=4406))\n","2020-05-21 19:41:00,056 EPOCH 1\n","/pytorch/torch/csrc/utils/python_arg_parser.cpp:756: UserWarning: This overload of nonzero is deprecated:\n","\tnonzero(Tensor input, *, Tensor out)\n","Consider using one of the following signatures instead:\n","\tnonzero(Tensor input, *, bool as_tuple)\n","2020-05-21 19:41:11,824 Epoch   1 Step:      100 Batch Loss:     5.400221 Tokens per Sec:    20381, Lr: 0.000300\n","2020-05-21 19:41:22,595 Epoch   1 Step:      200 Batch Loss:     5.334151 Tokens per Sec:    21870, Lr: 0.000300\n","2020-05-21 19:41:33,380 Epoch   1 Step:      300 Batch Loss:     4.878510 Tokens per Sec:    22463, Lr: 0.000300\n","2020-05-21 19:41:44,080 Epoch   1 Step:      400 Batch Loss:     5.001289 Tokens per Sec:    22184, Lr: 0.000300\n","2020-05-21 19:41:54,878 Epoch   1 Step:      500 Batch Loss:     4.621071 Tokens per Sec:    22364, Lr: 0.000300\n","2020-05-21 19:42:05,604 Epoch   1 Step:      600 Batch Loss:     4.431422 Tokens per Sec:    22441, Lr: 0.000300\n","2020-05-21 19:42:16,381 Epoch   1 Step:      700 Batch Loss:     4.202115 Tokens per Sec:    22181, Lr: 0.000300\n","2020-05-21 19:42:27,199 Epoch   1 Step:      800 Batch Loss:     4.304370 Tokens per Sec:    22161, Lr: 0.000300\n","2020-05-21 19:42:38,009 Epoch   1 Step:      900 Batch Loss:     4.521495 Tokens per Sec:    22216, Lr: 0.000300\n","2020-05-21 19:42:48,844 Epoch   1 Step:     1000 Batch Loss:     4.051861 Tokens per Sec:    22659, Lr: 0.000300\n","2020-05-21 19:43:09,924 Hooray! New best validation result [ppl]!\n","2020-05-21 19:43:09,924 Saving new checkpoint.\n","2020-05-21 19:43:10,172 Example #0\n","2020-05-21 19:43:10,172 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 19:43:10,172 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 19:43:10,172 \tHypothesis: Sɛ nhwɛso no , na wɔhia sɛ yɛhia sɛ yɛhia sɛ yɛhia sɛ yɛhia .\n","2020-05-21 19:43:10,173 Example #1\n","2020-05-21 19:43:10,173 \tSource:     If so , you would be worthy of death .\n","2020-05-21 19:43:10,173 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 19:43:10,173 \tHypothesis: Nanso , na yɛhia sɛ , na yɛhia .\n","2020-05-21 19:43:10,173 Example #2\n","2020-05-21 19:43:10,173 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 19:43:10,173 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 19:43:10,173 \tHypothesis: Sɛ nhwɛso no , na wɔhia sɛ , na yɛhia sɛ yɛhia sɛ yɛhia sɛ yɛhia sɛ yɛhia sɛ yɛhia sɛ yɛhia sɛ yɛhia no .\n","2020-05-21 19:43:10,173 Example #3\n","2020-05-21 19:43:10,174 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 19:43:10,174 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 19:43:10,174 \tHypothesis: Sɛ nhwɛso no , na yɛhia sɛ yɛhia sɛ , na yɛhia sɛ yɛhia sɛ yɛhia sɛ yɛhia sɛ yɛhia .\n","2020-05-21 19:43:10,174 Validation result (greedy) at epoch   1, step     1000: bleu:   1.16, loss: 109860.8594, ppl:  63.7985, duration: 21.3293s\n","2020-05-21 19:43:20,896 Epoch   1 Step:     1100 Batch Loss:     4.231697 Tokens per Sec:    22196, Lr: 0.000300\n","2020-05-21 19:43:31,588 Epoch   1 Step:     1200 Batch Loss:     4.408602 Tokens per Sec:    22009, Lr: 0.000300\n","2020-05-21 19:43:42,235 Epoch   1 Step:     1300 Batch Loss:     4.007001 Tokens per Sec:    22098, Lr: 0.000300\n","2020-05-21 19:43:53,058 Epoch   1 Step:     1400 Batch Loss:     3.821635 Tokens per Sec:    22570, Lr: 0.000300\n","2020-05-21 19:44:03,728 Epoch   1 Step:     1500 Batch Loss:     3.979501 Tokens per Sec:    22295, Lr: 0.000300\n","2020-05-21 19:44:14,478 Epoch   1 Step:     1600 Batch Loss:     3.944362 Tokens per Sec:    22471, Lr: 0.000300\n","2020-05-21 19:44:25,164 Epoch   1 Step:     1700 Batch Loss:     3.991561 Tokens per Sec:    21997, Lr: 0.000300\n","2020-05-21 19:44:35,867 Epoch   1 Step:     1800 Batch Loss:     3.931001 Tokens per Sec:    22094, Lr: 0.000300\n","2020-05-21 19:44:46,622 Epoch   1 Step:     1900 Batch Loss:     4.110495 Tokens per Sec:    22175, Lr: 0.000300\n","2020-05-21 19:44:57,470 Epoch   1 Step:     2000 Batch Loss:     3.373621 Tokens per Sec:    22315, Lr: 0.000300\n","2020-05-21 19:45:10,023 Hooray! New best validation result [ppl]!\n","2020-05-21 19:45:10,023 Saving new checkpoint.\n","2020-05-21 19:45:10,262 Example #0\n","2020-05-21 19:45:10,263 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 19:45:10,263 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 19:45:10,263 \tHypothesis: Wɔyɛɛ adwuma a wɔkɔ so no , na wɔhyɛɛ wɔn ho .\n","2020-05-21 19:45:10,263 Example #1\n","2020-05-21 19:45:10,263 \tSource:     If so , you would be worthy of death .\n","2020-05-21 19:45:10,263 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 19:45:10,263 \tHypothesis: Sɛ wugye ho sɛ , wugye wo ho .\n","2020-05-21 19:45:10,263 Example #2\n","2020-05-21 19:45:10,264 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 19:45:10,264 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 19:45:10,264 \tHypothesis: Sɛ nhwɛso no , na na na wɔhyɛɛ no sɛ wɔhyɛɛ wɔn ho asɛm a , na wɔhyɛɛ wɔn ho asɛm no ho asɛm no ho asɛm .\n","2020-05-21 19:45:10,264 Example #3\n","2020-05-21 19:45:10,264 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 19:45:10,264 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 19:45:10,264 \tHypothesis: Yesu ka sɛ , na ɔmma no , na ɔmma no , na mmom na mmom na mmom na mmom wɔn a wɔkɔ so no .\n","2020-05-21 19:45:10,264 Validation result (greedy) at epoch   1, step     2000: bleu:   2.88, loss: 95330.9219, ppl:  36.8222, duration: 12.7945s\n","2020-05-21 19:45:21,124 Epoch   1 Step:     2100 Batch Loss:     3.702724 Tokens per Sec:    22559, Lr: 0.000300\n","2020-05-21 19:45:31,934 Epoch   1 Step:     2200 Batch Loss:     3.440918 Tokens per Sec:    22594, Lr: 0.000300\n","2020-05-21 19:45:42,612 Epoch   1 Step:     2300 Batch Loss:     3.573675 Tokens per Sec:    22174, Lr: 0.000300\n","2020-05-21 19:45:53,443 Epoch   1 Step:     2400 Batch Loss:     3.548729 Tokens per Sec:    22174, Lr: 0.000300\n","2020-05-21 19:46:04,225 Epoch   1 Step:     2500 Batch Loss:     3.551210 Tokens per Sec:    22532, Lr: 0.000300\n","2020-05-21 19:46:14,900 Epoch   1 Step:     2600 Batch Loss:     3.562808 Tokens per Sec:    21827, Lr: 0.000300\n","2020-05-21 19:46:25,666 Epoch   1 Step:     2700 Batch Loss:     3.925247 Tokens per Sec:    22368, Lr: 0.000300\n","2020-05-21 19:46:36,425 Epoch   1 Step:     2800 Batch Loss:     3.600335 Tokens per Sec:    22023, Lr: 0.000300\n","2020-05-21 19:46:46,971 Epoch   1 Step:     2900 Batch Loss:     3.073956 Tokens per Sec:    21655, Lr: 0.000300\n","2020-05-21 19:46:57,808 Epoch   1 Step:     3000 Batch Loss:     3.240138 Tokens per Sec:    22574, Lr: 0.000300\n","2020-05-21 19:47:13,099 Hooray! New best validation result [ppl]!\n","2020-05-21 19:47:13,099 Saving new checkpoint.\n","2020-05-21 19:47:13,336 Example #0\n","2020-05-21 19:47:13,336 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 19:47:13,336 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 19:47:13,336 \tHypothesis: Wɔyɛɛ saa asɛm no mu nsɛm a wɔato din no ho dwuma wɔ hɔ .\n","2020-05-21 19:47:13,336 Example #1\n","2020-05-21 19:47:13,337 \tSource:     If so , you would be worthy of death .\n","2020-05-21 19:47:13,337 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 19:47:13,337 \tHypothesis: Sɛ woyɛ saa a , wubehu sɛ wubehu sɛ wubenya asase so .\n","2020-05-21 19:47:13,337 Example #2\n","2020-05-21 19:47:13,337 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 19:47:13,337 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 19:47:13,337 \tHypothesis: Kae sɛ , ɔsomafo Paulo kaa asɛm a ɛwɔ hɔ no ho asɛm sɛ ɔkyerɛw nsɛm a ɛwɔ hɔ no ho !\n","2020-05-21 19:47:13,337 Example #3\n","2020-05-21 19:47:13,337 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 19:47:13,337 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 19:47:13,338 \tHypothesis: Ná Yesu de ne ho asɛm a , na ɛsɛ sɛ yɛdɔ no , na mmom ɛsɛ sɛ yɛdɔ wɔn .\n","2020-05-21 19:47:13,338 Validation result (greedy) at epoch   1, step     3000: bleu:   4.42, loss: 86224.4844, ppl:  26.0921, duration: 15.5286s\n","2020-05-21 19:47:24,188 Epoch   1 Step:     3100 Batch Loss:     3.505201 Tokens per Sec:    23085, Lr: 0.000300\n","2020-05-21 19:47:34,994 Epoch   1 Step:     3200 Batch Loss:     3.268883 Tokens per Sec:    22026, Lr: 0.000300\n","2020-05-21 19:47:45,703 Epoch   1 Step:     3300 Batch Loss:     3.313485 Tokens per Sec:    22357, Lr: 0.000300\n","2020-05-21 19:47:56,478 Epoch   1 Step:     3400 Batch Loss:     2.995073 Tokens per Sec:    22494, Lr: 0.000300\n","2020-05-21 19:48:07,307 Epoch   1 Step:     3500 Batch Loss:     3.209073 Tokens per Sec:    22282, Lr: 0.000300\n","2020-05-21 19:48:17,896 Epoch   1 Step:     3600 Batch Loss:     3.170426 Tokens per Sec:    22120, Lr: 0.000300\n","2020-05-21 19:48:28,679 Epoch   1 Step:     3700 Batch Loss:     3.360814 Tokens per Sec:    22470, Lr: 0.000300\n","2020-05-21 19:48:39,400 Epoch   1 Step:     3800 Batch Loss:     3.487178 Tokens per Sec:    22253, Lr: 0.000300\n","2020-05-21 19:48:50,077 Epoch   1 Step:     3900 Batch Loss:     3.084253 Tokens per Sec:    22337, Lr: 0.000300\n","2020-05-21 19:49:00,871 Epoch   1 Step:     4000 Batch Loss:     2.890452 Tokens per Sec:    22325, Lr: 0.000300\n","2020-05-21 19:49:23,926 Hooray! New best validation result [ppl]!\n","2020-05-21 19:49:23,927 Saving new checkpoint.\n","2020-05-21 19:49:24,219 Example #0\n","2020-05-21 19:49:24,220 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 19:49:24,220 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 19:49:24,220 \tHypothesis: Nea edi kan no , na tete tete no yɛ den ma wɔatumi ayɛ adwuma .\n","2020-05-21 19:49:24,220 Example #1\n","2020-05-21 19:49:24,220 \tSource:     If so , you would be worthy of death .\n","2020-05-21 19:49:24,220 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 19:49:24,220 \tHypothesis: Sɛ woyɛ saa a , wubehu sɛ wubenya nkwa .\n","2020-05-21 19:49:24,220 Example #2\n","2020-05-21 19:49:24,220 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 19:49:24,220 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 19:49:24,220 \tHypothesis: Nea edi kan no , ɔsomafo Yohane kaa ho asɛm sɛ : “ Abusua a wɔawuwu no yɛ den !\n","2020-05-21 19:49:24,220 Example #3\n","2020-05-21 19:49:24,221 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 19:49:24,221 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 19:49:24,221 \tHypothesis: Ná Yesu yɛ den ma afoforo , na mmom Paulo de , nanso na mmom ɛsɛ sɛ afoforo yɛ wɔn a , na wɔbɛma wɔn ho afi wɔn ho .\n","2020-05-21 19:49:24,221 Validation result (greedy) at epoch   1, step     4000: bleu:   5.56, loss: 80323.1406, ppl:  20.8718, duration: 23.3495s\n","2020-05-21 19:49:34,932 Epoch   1 Step:     4100 Batch Loss:     3.054173 Tokens per Sec:    22705, Lr: 0.000300\n","2020-05-21 19:49:45,706 Epoch   1 Step:     4200 Batch Loss:     3.003175 Tokens per Sec:    22476, Lr: 0.000300\n","2020-05-21 19:49:56,486 Epoch   1 Step:     4300 Batch Loss:     3.297234 Tokens per Sec:    22288, Lr: 0.000300\n","2020-05-21 19:50:07,242 Epoch   1 Step:     4400 Batch Loss:     3.114406 Tokens per Sec:    22465, Lr: 0.000300\n","2020-05-21 19:50:17,979 Epoch   1 Step:     4500 Batch Loss:     3.221140 Tokens per Sec:    22036, Lr: 0.000300\n","2020-05-21 19:50:28,692 Epoch   1 Step:     4600 Batch Loss:     2.875343 Tokens per Sec:    22298, Lr: 0.000300\n","2020-05-21 19:50:39,379 Epoch   1 Step:     4700 Batch Loss:     2.754534 Tokens per Sec:    21999, Lr: 0.000300\n","2020-05-21 19:50:50,160 Epoch   1 Step:     4800 Batch Loss:     2.929832 Tokens per Sec:    22450, Lr: 0.000300\n","2020-05-21 19:51:00,848 Epoch   1 Step:     4900 Batch Loss:     3.245987 Tokens per Sec:    22060, Lr: 0.000300\n","2020-05-21 19:51:11,560 Epoch   1 Step:     5000 Batch Loss:     2.916297 Tokens per Sec:    22194, Lr: 0.000300\n","2020-05-21 19:51:30,567 Hooray! New best validation result [ppl]!\n","2020-05-21 19:51:30,568 Saving new checkpoint.\n","2020-05-21 19:51:30,819 Example #0\n","2020-05-21 19:51:30,820 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 19:51:30,820 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 19:51:30,820 \tHypothesis: Wɔ tete tete tete tete tete tete no , na ɛsono nea ɛmfata ne sɛ wɔbɛkɔ so ayɛ adwuma .\n","2020-05-21 19:51:30,820 Example #1\n","2020-05-21 19:51:30,820 \tSource:     If so , you would be worthy of death .\n","2020-05-21 19:51:30,820 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 19:51:30,820 \tHypothesis: Sɛ wote nka sɛ , wubehu sɛ owu .\n","2020-05-21 19:51:30,820 Example #2\n","2020-05-21 19:51:30,820 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 19:51:30,821 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 19:51:30,821 \tHypothesis: Nea edi kan no , ɔsomafo Yohane hui sɛ ɔsomafo Yohane yɛ adwuma a na nnipa a wɔwɔ hɔ no yɛ wɔn a wɔresɛe no !\n","2020-05-21 19:51:30,821 Example #3\n","2020-05-21 19:51:30,821 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 19:51:30,821 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 19:51:30,821 \tHypothesis: Ná Yesu yɛ bɔne a ɛho hia paa , na mmom Petro ne afoforo a wɔwɔ hɔ no , na mmom ɛsɛ sɛ afoforo yɛ wɔn ade .\n","2020-05-21 19:51:30,821 Validation result (greedy) at epoch   1, step     5000: bleu:   7.06, loss: 75845.7422, ppl:  17.6200, duration: 19.2609s\n","2020-05-21 19:51:41,618 Epoch   1 Step:     5100 Batch Loss:     3.054271 Tokens per Sec:    22013, Lr: 0.000300\n","2020-05-21 19:51:52,452 Epoch   1 Step:     5200 Batch Loss:     2.829607 Tokens per Sec:    22138, Lr: 0.000300\n","2020-05-21 19:52:03,193 Epoch   1 Step:     5300 Batch Loss:     2.777941 Tokens per Sec:    21694, Lr: 0.000300\n","2020-05-21 19:52:14,027 Epoch   1 Step:     5400 Batch Loss:     3.141502 Tokens per Sec:    22562, Lr: 0.000300\n","2020-05-21 19:52:24,797 Epoch   1 Step:     5500 Batch Loss:     3.039142 Tokens per Sec:    22168, Lr: 0.000300\n","2020-05-21 19:52:35,458 Epoch   1 Step:     5600 Batch Loss:     2.898122 Tokens per Sec:    21871, Lr: 0.000300\n","2020-05-21 19:52:46,226 Epoch   1 Step:     5700 Batch Loss:     2.652012 Tokens per Sec:    21874, Lr: 0.000300\n","2020-05-21 19:52:57,076 Epoch   1 Step:     5800 Batch Loss:     3.077167 Tokens per Sec:    22263, Lr: 0.000300\n","2020-05-21 19:53:07,976 Epoch   1 Step:     5900 Batch Loss:     2.794728 Tokens per Sec:    22523, Lr: 0.000300\n","2020-05-21 19:53:18,777 Epoch   1 Step:     6000 Batch Loss:     2.467360 Tokens per Sec:    22281, Lr: 0.000300\n","2020-05-21 19:53:36,505 Hooray! New best validation result [ppl]!\n","2020-05-21 19:53:36,506 Saving new checkpoint.\n","2020-05-21 19:53:36,783 Example #0\n","2020-05-21 19:53:36,783 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 19:53:36,783 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 19:53:36,783 \tHypothesis: Ɛda adi sɛ , tete mmere a ɛte saa no yɛ den na ɛma yehu sɛ wɔde wɔn ho hyɛ wɔn den .\n","2020-05-21 19:53:36,784 Example #1\n","2020-05-21 19:53:36,784 \tSource:     If so , you would be worthy of death .\n","2020-05-21 19:53:36,784 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 19:53:36,784 \tHypothesis: Sɛ wote nka a , wubehu sɛ wuwu .\n","2020-05-21 19:53:36,784 Example #2\n","2020-05-21 19:53:36,784 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 19:53:36,784 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 19:53:36,784 \tHypothesis: Afei , sɛnea ɔsomafo Yohane yɛe no , ɔsomafo Yohane hui sɛ nnipakuw kɛse yi yɛ nnipakuw kɛse !\n","2020-05-21 19:53:36,784 Example #3\n","2020-05-21 19:53:36,784 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 19:53:36,784 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 19:53:36,784 \tHypothesis: Ná Yesu yɛ obi a ɔboa afoforo , na mmom ɛsɛ sɛ yɛboa afoforo ma wɔatumi ayɛ nea Petro de ma afoforo .\n","2020-05-21 19:53:36,785 Validation result (greedy) at epoch   1, step     6000: bleu:   8.73, loss: 72087.5703, ppl:  15.2850, duration: 18.0073s\n","2020-05-21 19:53:41,538 Epoch   1: total training loss 21763.88\n","2020-05-21 19:53:41,539 EPOCH 2\n","2020-05-21 19:53:48,314 Epoch   2 Step:     6100 Batch Loss:     2.595567 Tokens per Sec:    19822, Lr: 0.000300\n","2020-05-21 19:53:59,024 Epoch   2 Step:     6200 Batch Loss:     3.068531 Tokens per Sec:    21699, Lr: 0.000300\n","2020-05-21 19:54:09,897 Epoch   2 Step:     6300 Batch Loss:     2.616318 Tokens per Sec:    22480, Lr: 0.000300\n","2020-05-21 19:54:20,687 Epoch   2 Step:     6400 Batch Loss:     3.022771 Tokens per Sec:    22444, Lr: 0.000300\n","2020-05-21 19:54:31,521 Epoch   2 Step:     6500 Batch Loss:     3.129659 Tokens per Sec:    22216, Lr: 0.000300\n","2020-05-21 19:54:42,460 Epoch   2 Step:     6600 Batch Loss:     3.090124 Tokens per Sec:    22561, Lr: 0.000300\n","2020-05-21 19:54:53,193 Epoch   2 Step:     6700 Batch Loss:     2.679626 Tokens per Sec:    22221, Lr: 0.000300\n","2020-05-21 19:55:04,013 Epoch   2 Step:     6800 Batch Loss:     2.764066 Tokens per Sec:    22266, Lr: 0.000300\n","2020-05-21 19:55:14,871 Epoch   2 Step:     6900 Batch Loss:     3.000021 Tokens per Sec:    22469, Lr: 0.000300\n","2020-05-21 19:55:25,635 Epoch   2 Step:     7000 Batch Loss:     3.019233 Tokens per Sec:    22102, Lr: 0.000300\n","2020-05-21 19:55:43,014 Hooray! New best validation result [ppl]!\n","2020-05-21 19:55:43,015 Saving new checkpoint.\n","2020-05-21 19:55:43,315 Example #0\n","2020-05-21 19:55:43,315 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 19:55:43,315 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 19:55:43,315 \tHypothesis: Ɛtɔ mmere bi a , tete tete no nyaa adwene sɛ ɛyɛ nokware na wɔde wɔn ho hyɛ wɔn den .\n","2020-05-21 19:55:43,315 Example #1\n","2020-05-21 19:55:43,316 \tSource:     If so , you would be worthy of death .\n","2020-05-21 19:55:43,316 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 19:55:43,316 \tHypothesis: Sɛ ɛte saa a , wubehu sɛ wubehu owu .\n","2020-05-21 19:55:43,316 Example #2\n","2020-05-21 19:55:43,316 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 19:55:43,316 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 19:55:43,316 \tHypothesis: Nea edi kan no , ɔsomafo Yohane huu sɛnea ɛbɛyɛ a nnipakuw kɛse yi yɛ fɛ !\n","2020-05-21 19:55:43,316 Example #3\n","2020-05-21 19:55:43,316 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 19:55:43,316 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 19:55:43,316 \tHypothesis: Ná Yesu wɔ nkate mu , na ehia sɛ yɛboa afoforo , na mmom Petro nso hia afoforo .\n","2020-05-21 19:55:43,316 Validation result (greedy) at epoch   2, step     7000: bleu:  10.11, loss: 68820.2969, ppl:  13.5080, duration: 17.6815s\n","2020-05-21 19:55:54,263 Epoch   2 Step:     7100 Batch Loss:     3.048615 Tokens per Sec:    22147, Lr: 0.000300\n","2020-05-21 19:56:05,067 Epoch   2 Step:     7200 Batch Loss:     2.773782 Tokens per Sec:    22181, Lr: 0.000300\n","2020-05-21 19:56:15,847 Epoch   2 Step:     7300 Batch Loss:     2.807312 Tokens per Sec:    21784, Lr: 0.000300\n","2020-05-21 19:56:26,625 Epoch   2 Step:     7400 Batch Loss:     2.612873 Tokens per Sec:    22286, Lr: 0.000300\n","2020-05-21 19:56:37,567 Epoch   2 Step:     7500 Batch Loss:     2.964066 Tokens per Sec:    22625, Lr: 0.000300\n","2020-05-21 19:56:48,411 Epoch   2 Step:     7600 Batch Loss:     2.609281 Tokens per Sec:    22108, Lr: 0.000300\n","2020-05-21 19:56:59,204 Epoch   2 Step:     7700 Batch Loss:     2.624629 Tokens per Sec:    22090, Lr: 0.000300\n","2020-05-21 19:57:10,044 Epoch   2 Step:     7800 Batch Loss:     2.714041 Tokens per Sec:    22255, Lr: 0.000300\n","2020-05-21 19:57:20,699 Epoch   2 Step:     7900 Batch Loss:     2.863642 Tokens per Sec:    21954, Lr: 0.000300\n","2020-05-21 19:57:31,447 Epoch   2 Step:     8000 Batch Loss:     2.815384 Tokens per Sec:    22354, Lr: 0.000300\n","2020-05-21 19:57:48,113 Hooray! New best validation result [ppl]!\n","2020-05-21 19:57:48,113 Saving new checkpoint.\n","2020-05-21 19:57:48,389 Example #0\n","2020-05-21 19:57:48,389 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 19:57:48,389 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 19:57:48,389 \tHypothesis: Ɛtɔ mmere bi a , tete tete tete mmere a ɛte saa no yɛ den na ama wɔatumi ayɛ adwuma .\n","2020-05-21 19:57:48,390 Example #1\n","2020-05-21 19:57:48,390 \tSource:     If so , you would be worthy of death .\n","2020-05-21 19:57:48,390 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 19:57:48,390 \tHypothesis: Sɛ saa a , wubenya owu .\n","2020-05-21 19:57:48,390 Example #2\n","2020-05-21 19:57:48,390 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 19:57:48,390 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 19:57:48,390 \tHypothesis: Nea ɛto so abien no , ɔsomafo Yohane huu nneɛma a ɛho hia kɛse yi ho adanse kɛse !\n","2020-05-21 19:57:48,390 Example #3\n","2020-05-21 19:57:48,391 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 19:57:48,391 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 19:57:48,391 \tHypothesis: Ná Yesu wɔ nkate mu , na ehia sɛ Petro ne afoforo di mfomso , nanso afoforo nso de wɔn ho to wɔn so .\n","2020-05-21 19:57:48,391 Validation result (greedy) at epoch   2, step     8000: bleu:  11.49, loss: 66377.2422, ppl:  12.3156, duration: 16.9435s\n","2020-05-21 19:57:59,280 Epoch   2 Step:     8100 Batch Loss:     2.327297 Tokens per Sec:    22062, Lr: 0.000300\n","2020-05-21 19:58:10,025 Epoch   2 Step:     8200 Batch Loss:     2.572250 Tokens per Sec:    22135, Lr: 0.000300\n","2020-05-21 19:58:20,807 Epoch   2 Step:     8300 Batch Loss:     2.185339 Tokens per Sec:    22042, Lr: 0.000300\n","2020-05-21 19:58:31,557 Epoch   2 Step:     8400 Batch Loss:     2.551353 Tokens per Sec:    21667, Lr: 0.000300\n","2020-05-21 19:58:42,446 Epoch   2 Step:     8500 Batch Loss:     2.423698 Tokens per Sec:    22303, Lr: 0.000300\n","2020-05-21 19:58:53,189 Epoch   2 Step:     8600 Batch Loss:     2.594472 Tokens per Sec:    22467, Lr: 0.000300\n","2020-05-21 19:59:04,060 Epoch   2 Step:     8700 Batch Loss:     2.491833 Tokens per Sec:    22390, Lr: 0.000300\n","2020-05-21 19:59:14,830 Epoch   2 Step:     8800 Batch Loss:     2.694777 Tokens per Sec:    21927, Lr: 0.000300\n","2020-05-21 19:59:25,640 Epoch   2 Step:     8900 Batch Loss:     2.480007 Tokens per Sec:    22066, Lr: 0.000300\n","2020-05-21 19:59:36,499 Epoch   2 Step:     9000 Batch Loss:     2.640591 Tokens per Sec:    22266, Lr: 0.000300\n","2020-05-21 19:59:52,760 Hooray! New best validation result [ppl]!\n","2020-05-21 19:59:52,760 Saving new checkpoint.\n","2020-05-21 19:59:53,020 Example #0\n","2020-05-21 19:59:53,021 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 19:59:53,021 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 19:59:53,021 \tHypothesis: Ɛtɔ mmere bi a , tete mmere a ɛte saa no na tete tete no yɛ den .\n","2020-05-21 19:59:53,021 Example #1\n","2020-05-21 19:59:53,021 \tSource:     If so , you would be worthy of death .\n","2020-05-21 19:59:53,021 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 19:59:53,021 \tHypothesis: Sɛ saa a , wubewu .\n","2020-05-21 19:59:53,021 Example #2\n","2020-05-21 19:59:53,021 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 19:59:53,021 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 19:59:53,022 \tHypothesis: Nea edi kan no , ɔsomafo Yohane huu anisoadehu a na ɛwɔ anisoadehu yi mu no ho hwɛ !\n","2020-05-21 19:59:53,022 Example #3\n","2020-05-21 19:59:53,022 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 19:59:53,022 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 19:59:53,022 \tHypothesis: Ná Yesu wɔ nkate mu , na ehia sɛ Petro ne afoforo nya wɔn ho abotare , na mmom Petro nso yɛ saa .\n","2020-05-21 19:59:53,022 Validation result (greedy) at epoch   2, step     9000: bleu:  12.07, loss: 64206.8047, ppl:  11.3448, duration: 16.5229s\n","2020-05-21 20:00:03,809 Epoch   2 Step:     9100 Batch Loss:     2.675457 Tokens per Sec:    22020, Lr: 0.000300\n","2020-05-21 20:00:14,589 Epoch   2 Step:     9200 Batch Loss:     2.787509 Tokens per Sec:    22500, Lr: 0.000300\n","2020-05-21 20:00:25,365 Epoch   2 Step:     9300 Batch Loss:     2.712395 Tokens per Sec:    22068, Lr: 0.000300\n","2020-05-21 20:00:36,147 Epoch   2 Step:     9400 Batch Loss:     2.925033 Tokens per Sec:    21972, Lr: 0.000300\n","2020-05-21 20:00:46,936 Epoch   2 Step:     9500 Batch Loss:     2.785448 Tokens per Sec:    22196, Lr: 0.000300\n","2020-05-21 20:00:57,626 Epoch   2 Step:     9600 Batch Loss:     2.763101 Tokens per Sec:    21942, Lr: 0.000300\n","2020-05-21 20:01:08,369 Epoch   2 Step:     9700 Batch Loss:     2.946581 Tokens per Sec:    21871, Lr: 0.000300\n","2020-05-21 20:01:19,206 Epoch   2 Step:     9800 Batch Loss:     2.949394 Tokens per Sec:    22007, Lr: 0.000300\n","2020-05-21 20:01:30,049 Epoch   2 Step:     9900 Batch Loss:     2.391139 Tokens per Sec:    22393, Lr: 0.000300\n","2020-05-21 20:01:40,772 Epoch   2 Step:    10000 Batch Loss:     2.405795 Tokens per Sec:    22239, Lr: 0.000300\n","2020-05-21 20:01:58,698 Hooray! New best validation result [ppl]!\n","2020-05-21 20:01:58,698 Saving new checkpoint.\n","2020-05-21 20:01:58,934 Example #0\n","2020-05-21 20:01:58,934 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 20:01:58,934 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 20:01:58,934 \tHypothesis: Tete a ɛte saa no maa tete no nyaa adwene sɛ wobeyi wɔn ho afi wɔn som mu .\n","2020-05-21 20:01:58,934 Example #1\n","2020-05-21 20:01:58,934 \tSource:     If so , you would be worthy of death .\n","2020-05-21 20:01:58,934 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 20:01:58,935 \tHypothesis: Sɛ saa a , wobɛpɛ sɛ wuwu .\n","2020-05-21 20:01:58,935 Example #2\n","2020-05-21 20:01:58,935 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 20:01:58,935 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 20:01:58,935 \tHypothesis: Oh , nea ɔsomafo Yohane hui no hui sɛ nnipakuw kɛse no yɛ kɛse !\n","2020-05-21 20:01:58,935 Example #3\n","2020-05-21 20:01:58,935 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 20:01:58,935 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 20:01:58,935 \tHypothesis: Ná Yesu wɔ nkate mu , na ehia sɛ Petro ne afoforo di dwuma , nanso afoforo nso da so ara da .\n","2020-05-21 20:01:58,935 Validation result (greedy) at epoch   2, step    10000: bleu:  12.97, loss: 62063.4609, ppl:  10.4613, duration: 18.1634s\n","2020-05-21 20:02:09,746 Epoch   2 Step:    10100 Batch Loss:     2.550464 Tokens per Sec:    22103, Lr: 0.000300\n","2020-05-21 20:02:20,598 Epoch   2 Step:    10200 Batch Loss:     2.823120 Tokens per Sec:    22180, Lr: 0.000300\n","2020-05-21 20:02:31,395 Epoch   2 Step:    10300 Batch Loss:     2.909714 Tokens per Sec:    22207, Lr: 0.000300\n","2020-05-21 20:02:42,296 Epoch   2 Step:    10400 Batch Loss:     2.483880 Tokens per Sec:    22231, Lr: 0.000300\n","2020-05-21 20:02:53,029 Epoch   2 Step:    10500 Batch Loss:     2.765825 Tokens per Sec:    22222, Lr: 0.000300\n","2020-05-21 20:03:03,959 Epoch   2 Step:    10600 Batch Loss:     2.705989 Tokens per Sec:    22127, Lr: 0.000300\n","2020-05-21 20:03:14,635 Epoch   2 Step:    10700 Batch Loss:     2.414613 Tokens per Sec:    21923, Lr: 0.000300\n","2020-05-21 20:03:25,376 Epoch   2 Step:    10800 Batch Loss:     2.203488 Tokens per Sec:    22244, Lr: 0.000300\n","2020-05-21 20:03:36,117 Epoch   2 Step:    10900 Batch Loss:     2.586446 Tokens per Sec:    21918, Lr: 0.000300\n","2020-05-21 20:03:46,857 Epoch   2 Step:    11000 Batch Loss:     2.361821 Tokens per Sec:    21963, Lr: 0.000300\n","2020-05-21 20:04:04,609 Hooray! New best validation result [ppl]!\n","2020-05-21 20:04:04,609 Saving new checkpoint.\n","2020-05-21 20:04:04,838 Example #0\n","2020-05-21 20:04:04,838 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 20:04:04,838 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 20:04:04,838 \tHypothesis: Ɛtɔ mmere bi a , na tete mmere mu no , na ɛyɛ den sɛ wɔbɛhyɛ wɔn ho so .\n","2020-05-21 20:04:04,838 Example #1\n","2020-05-21 20:04:04,838 \tSource:     If so , you would be worthy of death .\n","2020-05-21 20:04:04,838 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 20:04:04,839 \tHypothesis: Sɛ saa a , wobɛpɛ sɛ wuwu .\n","2020-05-21 20:04:04,839 Example #2\n","2020-05-21 20:04:04,839 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 20:04:04,839 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 20:04:04,839 \tHypothesis: Oh , nea ɔsomafo Yohane huu no huu amane wɔ anisoadehu a nnipakuw kɛse no mu !\n","2020-05-21 20:04:04,839 Example #3\n","2020-05-21 20:04:04,839 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 20:04:04,839 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 20:04:04,839 \tHypothesis: Ná Yesu wɔ nkate ne nkate mu , na mmom afoforo nso hia wɔn , na mmom afoforo da so ara da .\n","2020-05-21 20:04:04,839 Validation result (greedy) at epoch   2, step    11000: bleu:  13.72, loss: 60652.7891, ppl:   9.9177, duration: 17.9818s\n","2020-05-21 20:04:15,661 Epoch   2 Step:    11100 Batch Loss:     2.733219 Tokens per Sec:    21821, Lr: 0.000300\n","2020-05-21 20:04:26,336 Epoch   2 Step:    11200 Batch Loss:     2.366240 Tokens per Sec:    21916, Lr: 0.000300\n","2020-05-21 20:04:37,147 Epoch   2 Step:    11300 Batch Loss:     2.178252 Tokens per Sec:    22327, Lr: 0.000300\n","2020-05-21 20:04:48,000 Epoch   2 Step:    11400 Batch Loss:     2.637095 Tokens per Sec:    22407, Lr: 0.000300\n","2020-05-21 20:04:58,749 Epoch   2 Step:    11500 Batch Loss:     2.589300 Tokens per Sec:    21979, Lr: 0.000300\n","2020-05-21 20:05:09,624 Epoch   2 Step:    11600 Batch Loss:     2.611398 Tokens per Sec:    22340, Lr: 0.000300\n","2020-05-21 20:05:20,465 Epoch   2 Step:    11700 Batch Loss:     2.476963 Tokens per Sec:    22214, Lr: 0.000300\n","2020-05-21 20:05:31,249 Epoch   2 Step:    11800 Batch Loss:     2.377032 Tokens per Sec:    22071, Lr: 0.000300\n","2020-05-21 20:05:41,992 Epoch   2 Step:    11900 Batch Loss:     2.617657 Tokens per Sec:    22199, Lr: 0.000300\n","2020-05-21 20:05:52,723 Epoch   2 Step:    12000 Batch Loss:     2.366577 Tokens per Sec:    22379, Lr: 0.000300\n","2020-05-21 20:06:09,388 Hooray! New best validation result [ppl]!\n","2020-05-21 20:06:09,388 Saving new checkpoint.\n","2020-05-21 20:06:09,621 Example #0\n","2020-05-21 20:06:09,621 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 20:06:09,622 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 20:06:09,622 \tHypothesis: Ɛtɔ mmere bi a , na tete mmere a ɛte saa no yɛ ade a ɛyɛ nwonwa na ɛma obi nya ne ho adwemmɔne .\n","2020-05-21 20:06:09,622 Example #1\n","2020-05-21 20:06:09,622 \tSource:     If so , you would be worthy of death .\n","2020-05-21 20:06:09,622 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 20:06:09,622 \tHypothesis: Sɛ saa a , ɛnde na wubewu .\n","2020-05-21 20:06:09,622 Example #2\n","2020-05-21 20:06:09,622 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 20:06:09,622 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 20:06:09,622 \tHypothesis: Oh , nea ɔsomafo Yohane huu no wɔ anisoadehu a nnipakuw kɛse no mufo kɛse no mu !\n","2020-05-21 20:06:09,622 Example #3\n","2020-05-21 20:06:09,622 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 20:06:09,622 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 20:06:09,623 \tHypothesis: Ná Yesu wɔ nkate fam , na ehia sɛ ɔboa Petro , nanso afoforo nso da so ara da .\n","2020-05-21 20:06:09,623 Validation result (greedy) at epoch   2, step    12000: bleu:  14.69, loss: 59153.0586, ppl:   9.3708, duration: 16.8992s\n","2020-05-21 20:06:19,587 Epoch   2: total training loss 16116.48\n","2020-05-21 20:06:19,587 EPOCH 3\n","2020-05-21 20:06:21,126 Epoch   3 Step:    12100 Batch Loss:     2.200214 Tokens per Sec:    10518, Lr: 0.000300\n","2020-05-21 20:06:31,914 Epoch   3 Step:    12200 Batch Loss:     2.568231 Tokens per Sec:    22268, Lr: 0.000300\n","2020-05-21 20:06:42,719 Epoch   3 Step:    12300 Batch Loss:     2.478721 Tokens per Sec:    21891, Lr: 0.000300\n","2020-05-21 20:06:53,607 Epoch   3 Step:    12400 Batch Loss:     2.230456 Tokens per Sec:    22551, Lr: 0.000300\n","2020-05-21 20:07:04,372 Epoch   3 Step:    12500 Batch Loss:     2.832182 Tokens per Sec:    22119, Lr: 0.000300\n","2020-05-21 20:07:15,078 Epoch   3 Step:    12600 Batch Loss:     2.224597 Tokens per Sec:    22218, Lr: 0.000300\n","2020-05-21 20:07:25,809 Epoch   3 Step:    12700 Batch Loss:     2.592146 Tokens per Sec:    22185, Lr: 0.000300\n","2020-05-21 20:07:36,567 Epoch   3 Step:    12800 Batch Loss:     2.195639 Tokens per Sec:    21965, Lr: 0.000300\n","2020-05-21 20:07:47,311 Epoch   3 Step:    12900 Batch Loss:     2.308671 Tokens per Sec:    22388, Lr: 0.000300\n","2020-05-21 20:07:58,123 Epoch   3 Step:    13000 Batch Loss:     2.298582 Tokens per Sec:    21959, Lr: 0.000300\n","2020-05-21 20:08:12,934 Hooray! New best validation result [ppl]!\n","2020-05-21 20:08:12,935 Saving new checkpoint.\n","2020-05-21 20:08:13,180 Example #0\n","2020-05-21 20:08:13,181 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 20:08:13,181 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 20:08:13,181 \tHypothesis: Ɛtɔ mmere bi a , na tete mmere mu nneɛma a ɛyɛ hu a ɛyɛ hu na ɛyɛ den .\n","2020-05-21 20:08:13,181 Example #1\n","2020-05-21 20:08:13,181 \tSource:     If so , you would be worthy of death .\n","2020-05-21 20:08:13,181 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 20:08:13,181 \tHypothesis: Sɛ saa a , ɛnde na wubewu .\n","2020-05-21 20:08:13,181 Example #2\n","2020-05-21 20:08:13,182 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 20:08:13,182 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 20:08:13,182 \tHypothesis: Oh , nea ɔsomafo Yohane hui no huu nnipakuw kɛse a wɔwɔ nkurow kɛse no !\n","2020-05-21 20:08:13,182 Example #3\n","2020-05-21 20:08:13,182 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 20:08:13,182 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 20:08:13,182 \tHypothesis: Ná Yesu wɔ nkate ne mmoa a ɛho hia , nanso Petro ne afoforo a wɔda no adi no da .\n","2020-05-21 20:08:13,182 Validation result (greedy) at epoch   3, step    13000: bleu:  15.09, loss: 58085.8398, ppl:   9.0000, duration: 15.0593s\n","2020-05-21 20:08:24,086 Epoch   3 Step:    13100 Batch Loss:     2.531863 Tokens per Sec:    22284, Lr: 0.000300\n","2020-05-21 20:08:34,877 Epoch   3 Step:    13200 Batch Loss:     2.773176 Tokens per Sec:    22148, Lr: 0.000300\n","2020-05-21 20:08:45,704 Epoch   3 Step:    13300 Batch Loss:     2.349779 Tokens per Sec:    22212, Lr: 0.000300\n","2020-05-21 20:08:56,367 Epoch   3 Step:    13400 Batch Loss:     2.583769 Tokens per Sec:    22168, Lr: 0.000300\n","2020-05-21 20:09:07,127 Epoch   3 Step:    13500 Batch Loss:     2.484365 Tokens per Sec:    21892, Lr: 0.000300\n","2020-05-21 20:09:17,933 Epoch   3 Step:    13600 Batch Loss:     2.374513 Tokens per Sec:    22030, Lr: 0.000300\n","2020-05-21 20:09:28,661 Epoch   3 Step:    13700 Batch Loss:     2.272899 Tokens per Sec:    21997, Lr: 0.000300\n","2020-05-21 20:09:39,525 Epoch   3 Step:    13800 Batch Loss:     2.518093 Tokens per Sec:    22565, Lr: 0.000300\n","2020-05-21 20:09:50,258 Epoch   3 Step:    13900 Batch Loss:     2.735178 Tokens per Sec:    21867, Lr: 0.000300\n","2020-05-21 20:10:00,947 Epoch   3 Step:    14000 Batch Loss:     2.144598 Tokens per Sec:    21951, Lr: 0.000300\n","2020-05-21 20:10:15,921 Hooray! New best validation result [ppl]!\n","2020-05-21 20:10:15,921 Saving new checkpoint.\n","2020-05-21 20:10:16,215 Example #0\n","2020-05-21 20:10:16,215 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 20:10:16,215 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 20:10:16,215 \tHypothesis: Ɛtɔ mmere bi a , na tete mmere mu nneɛma a ɛte saa no yɛ aniberesɛm a ɛyɛ hu na ɛma ɛyɛ den .\n","2020-05-21 20:10:16,215 Example #1\n","2020-05-21 20:10:16,216 \tSource:     If so , you would be worthy of death .\n","2020-05-21 20:10:16,216 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 20:10:16,216 \tHypothesis: Sɛ saa a , anka wobɛpɛ sɛ wuwu .\n","2020-05-21 20:10:16,216 Example #2\n","2020-05-21 20:10:16,216 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 20:10:16,216 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 20:10:16,216 \tHypothesis: Nea ɛyɛ nwonwa ne sɛ , ɔsomafo Yohane huu eyi a na nnipakuw kɛse no ani gye ho !\n","2020-05-21 20:10:16,216 Example #3\n","2020-05-21 20:10:16,216 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 20:10:16,216 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 20:10:16,216 \tHypothesis: Ná Yesu wɔ nkate fam , na ehia sɛ Petro ne afoforo di nkitaho , nanso na afoforo nso da so ara da .\n","2020-05-21 20:10:16,217 Validation result (greedy) at epoch   3, step    14000: bleu:  15.93, loss: 56943.1250, ppl:   8.6193, duration: 15.2690s\n","2020-05-21 20:10:27,017 Epoch   3 Step:    14100 Batch Loss:     2.100186 Tokens per Sec:    22140, Lr: 0.000300\n","2020-05-21 20:10:37,882 Epoch   3 Step:    14200 Batch Loss:     2.177093 Tokens per Sec:    22064, Lr: 0.000300\n","2020-05-21 20:10:48,694 Epoch   3 Step:    14300 Batch Loss:     2.303249 Tokens per Sec:    22420, Lr: 0.000300\n","2020-05-21 20:10:59,397 Epoch   3 Step:    14400 Batch Loss:     2.408033 Tokens per Sec:    21887, Lr: 0.000300\n","2020-05-21 20:11:10,255 Epoch   3 Step:    14500 Batch Loss:     2.227624 Tokens per Sec:    22476, Lr: 0.000300\n","2020-05-21 20:11:21,154 Epoch   3 Step:    14600 Batch Loss:     2.251582 Tokens per Sec:    22441, Lr: 0.000300\n","2020-05-21 20:11:31,905 Epoch   3 Step:    14700 Batch Loss:     2.246356 Tokens per Sec:    22108, Lr: 0.000300\n","2020-05-21 20:11:42,736 Epoch   3 Step:    14800 Batch Loss:     2.304019 Tokens per Sec:    22492, Lr: 0.000300\n","2020-05-21 20:11:53,533 Epoch   3 Step:    14900 Batch Loss:     2.497545 Tokens per Sec:    21335, Lr: 0.000300\n","2020-05-21 20:12:04,353 Epoch   3 Step:    15000 Batch Loss:     2.600769 Tokens per Sec:    21841, Lr: 0.000300\n","2020-05-21 20:12:21,429 Hooray! New best validation result [ppl]!\n","2020-05-21 20:12:21,430 Saving new checkpoint.\n","2020-05-21 20:12:21,693 Example #0\n","2020-05-21 20:12:21,693 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 20:12:21,693 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 20:12:21,693 \tHypothesis: Ɛtɔ mmere bi a , na tete nneɛma a ɛte saa no yɛ anifuraefo ne wɔn a wɔfata .\n","2020-05-21 20:12:21,693 Example #1\n","2020-05-21 20:12:21,694 \tSource:     If so , you would be worthy of death .\n","2020-05-21 20:12:21,694 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 20:12:21,694 \tHypothesis: Sɛ saa a , anka wubewu .\n","2020-05-21 20:12:21,694 Example #2\n","2020-05-21 20:12:21,694 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 20:12:21,694 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 20:12:21,694 \tHypothesis: Hwɛ sɛnea ɔsomafo Yohane huu anisoadehu kɛse yi ho anisoadehu kɛse !\n","2020-05-21 20:12:21,694 Example #3\n","2020-05-21 20:12:21,694 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 20:12:21,694 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 20:12:21,694 \tHypothesis: Ná Yesu wɔ nkate ne ɔdɔ mu , na na ehia sɛ Petro ne afoforo di nkitaho .\n","2020-05-21 20:12:21,694 Validation result (greedy) at epoch   3, step    15000: bleu:  16.44, loss: 55890.4336, ppl:   8.2828, duration: 17.3408s\n","2020-05-21 20:12:32,564 Epoch   3 Step:    15100 Batch Loss:     2.289284 Tokens per Sec:    22497, Lr: 0.000300\n","2020-05-21 20:12:43,425 Epoch   3 Step:    15200 Batch Loss:     2.356402 Tokens per Sec:    22339, Lr: 0.000300\n","2020-05-21 20:12:54,366 Epoch   3 Step:    15300 Batch Loss:     2.344790 Tokens per Sec:    22540, Lr: 0.000300\n","2020-05-21 20:13:05,247 Epoch   3 Step:    15400 Batch Loss:     2.484527 Tokens per Sec:    21935, Lr: 0.000300\n","2020-05-21 20:13:16,054 Epoch   3 Step:    15500 Batch Loss:     2.213316 Tokens per Sec:    22090, Lr: 0.000300\n","2020-05-21 20:13:26,995 Epoch   3 Step:    15600 Batch Loss:     2.435350 Tokens per Sec:    22043, Lr: 0.000300\n","2020-05-21 20:13:37,839 Epoch   3 Step:    15700 Batch Loss:     2.253911 Tokens per Sec:    22049, Lr: 0.000300\n","2020-05-21 20:13:48,535 Epoch   3 Step:    15800 Batch Loss:     2.133878 Tokens per Sec:    21974, Lr: 0.000300\n","2020-05-21 20:13:59,382 Epoch   3 Step:    15900 Batch Loss:     1.966239 Tokens per Sec:    22316, Lr: 0.000300\n","2020-05-21 20:14:10,269 Epoch   3 Step:    16000 Batch Loss:     2.389025 Tokens per Sec:    21919, Lr: 0.000300\n","2020-05-21 20:14:25,528 Hooray! New best validation result [ppl]!\n","2020-05-21 20:14:25,528 Saving new checkpoint.\n","2020-05-21 20:14:25,795 Example #0\n","2020-05-21 20:14:25,796 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 20:14:25,796 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 20:14:25,796 \tHypothesis: Ɛtɔ mmere bi a , na tete nneɛma a wɔhwehwɛ sɛ wɔde yɛ adwuma na wɔhwehwɛ wɔn .\n","2020-05-21 20:14:25,796 Example #1\n","2020-05-21 20:14:25,796 \tSource:     If so , you would be worthy of death .\n","2020-05-21 20:14:25,796 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 20:14:25,796 \tHypothesis: Sɛ saa a , wubenya owu mu kyɛfa .\n","2020-05-21 20:14:25,796 Example #2\n","2020-05-21 20:14:25,796 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 20:14:25,796 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 20:14:25,797 \tHypothesis: Hwɛ sɛnea ɔsomafo Yohane nyaa anisoadehu kɛse yi ho anisoadehu kɛse no !\n","2020-05-21 20:14:25,797 Example #3\n","2020-05-21 20:14:25,797 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 20:14:25,797 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 20:14:25,797 \tHypothesis: Ná Yesu wɔ nkate fam , na ehia sɛ Petro ne afoforo di nkitaho , na mmom na afoforo nso da so ara da .\n","2020-05-21 20:14:25,797 Validation result (greedy) at epoch   3, step    16000: bleu:  17.31, loss: 54738.5117, ppl:   7.9296, duration: 15.5279s\n","2020-05-21 20:14:36,680 Epoch   3 Step:    16100 Batch Loss:     2.073450 Tokens per Sec:    22091, Lr: 0.000300\n","2020-05-21 20:14:47,555 Epoch   3 Step:    16200 Batch Loss:     2.630596 Tokens per Sec:    22644, Lr: 0.000300\n","2020-05-21 20:14:58,460 Epoch   3 Step:    16300 Batch Loss:     2.221980 Tokens per Sec:    22084, Lr: 0.000300\n","2020-05-21 20:15:09,362 Epoch   3 Step:    16400 Batch Loss:     2.687165 Tokens per Sec:    22063, Lr: 0.000300\n","2020-05-21 20:15:20,117 Epoch   3 Step:    16500 Batch Loss:     2.556054 Tokens per Sec:    21602, Lr: 0.000300\n","2020-05-21 20:15:30,981 Epoch   3 Step:    16600 Batch Loss:     2.731128 Tokens per Sec:    22440, Lr: 0.000300\n","2020-05-21 20:15:41,758 Epoch   3 Step:    16700 Batch Loss:     2.566213 Tokens per Sec:    21719, Lr: 0.000300\n","2020-05-21 20:15:52,572 Epoch   3 Step:    16800 Batch Loss:     2.524320 Tokens per Sec:    22063, Lr: 0.000300\n","2020-05-21 20:16:03,436 Epoch   3 Step:    16900 Batch Loss:     2.229460 Tokens per Sec:    21855, Lr: 0.000300\n","2020-05-21 20:16:14,316 Epoch   3 Step:    17000 Batch Loss:     2.405974 Tokens per Sec:    22398, Lr: 0.000300\n","2020-05-21 20:16:31,310 Hooray! New best validation result [ppl]!\n","2020-05-21 20:16:31,310 Saving new checkpoint.\n","2020-05-21 20:16:31,583 Example #0\n","2020-05-21 20:16:31,584 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 20:16:31,584 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 20:16:31,584 \tHypothesis: Ɛtɔ mmere bi a na tete mmere mu no , na ɛyɛ den sɛ wɔbɛhyɛ da na wɔatumi ayɛ saa .\n","2020-05-21 20:16:31,584 Example #1\n","2020-05-21 20:16:31,584 \tSource:     If so , you would be worthy of death .\n","2020-05-21 20:16:31,584 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 20:16:31,584 \tHypothesis: Sɛ saa a , ɛnde na wofata owu .\n","2020-05-21 20:16:31,584 Example #2\n","2020-05-21 20:16:31,584 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 20:16:31,584 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 20:16:31,584 \tHypothesis: Hwɛ sɛnea ɔsomafo Yohane nyaa anisoadehu a nnipakuw kɛse no de mae no ho anisoadehu !\n","2020-05-21 20:16:31,584 Example #3\n","2020-05-21 20:16:31,585 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 20:16:31,585 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 20:16:31,585 \tHypothesis: Ná Yesu wɔ nkate fam ne ahiade ho hia , nanso Petro ne afoforo a wɔwɔ hɔ no da so ara da .\n","2020-05-21 20:16:31,585 Validation result (greedy) at epoch   3, step    17000: bleu:  17.58, loss: 54238.6992, ppl:   7.7811, duration: 17.2682s\n","2020-05-21 20:16:42,429 Epoch   3 Step:    17100 Batch Loss:     2.104651 Tokens per Sec:    21969, Lr: 0.000300\n","2020-05-21 20:16:53,125 Epoch   3 Step:    17200 Batch Loss:     2.361593 Tokens per Sec:    21888, Lr: 0.000300\n","2020-05-21 20:17:03,940 Epoch   3 Step:    17300 Batch Loss:     2.333509 Tokens per Sec:    21787, Lr: 0.000300\n","2020-05-21 20:17:14,800 Epoch   3 Step:    17400 Batch Loss:     2.271157 Tokens per Sec:    22086, Lr: 0.000300\n","2020-05-21 20:17:25,683 Epoch   3 Step:    17500 Batch Loss:     2.385113 Tokens per Sec:    22374, Lr: 0.000300\n","2020-05-21 20:17:36,441 Epoch   3 Step:    17600 Batch Loss:     2.204388 Tokens per Sec:    21796, Lr: 0.000300\n","2020-05-21 20:17:47,468 Epoch   3 Step:    17700 Batch Loss:     2.589707 Tokens per Sec:    22587, Lr: 0.000300\n","2020-05-21 20:17:58,346 Epoch   3 Step:    17800 Batch Loss:     2.602588 Tokens per Sec:    22073, Lr: 0.000300\n","2020-05-21 20:18:09,120 Epoch   3 Step:    17900 Batch Loss:     2.311448 Tokens per Sec:    21677, Lr: 0.000300\n","2020-05-21 20:18:19,999 Epoch   3 Step:    18000 Batch Loss:     2.599225 Tokens per Sec:    22059, Lr: 0.000300\n","2020-05-21 20:18:36,576 Hooray! New best validation result [ppl]!\n","2020-05-21 20:18:36,576 Saving new checkpoint.\n","2020-05-21 20:18:36,874 Example #0\n","2020-05-21 20:18:36,874 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 20:18:36,874 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 20:18:36,874 \tHypothesis: Ɛtɔ mmere bi a na tete mmere bi a na ɛyɛ den ma wɔn sɛ wobegye wɔn ani na wɔabu wɔn ani agu wɔn so .\n","2020-05-21 20:18:36,874 Example #1\n","2020-05-21 20:18:36,875 \tSource:     If so , you would be worthy of death .\n","2020-05-21 20:18:36,875 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 20:18:36,875 \tHypothesis: Sɛ saa a , ɛnde na ɛsɛ sɛ wuwu .\n","2020-05-21 20:18:36,875 Example #2\n","2020-05-21 20:18:36,875 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 20:18:36,875 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 20:18:36,875 \tHypothesis: Oh , hwɛ sɛnea ɔsomafo Yohane huu nnipakuw kɛse yi ho anisoadehu a ɛyɛ nwonwa !\n","2020-05-21 20:18:36,875 Example #3\n","2020-05-21 20:18:36,875 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 20:18:36,875 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 20:18:36,875 \tHypothesis: Ná Yesu wɔ nkate fam ne mmoa a ɛho hia , nanso Petro ne afoforo a wɔda no adi no da so ara .\n","2020-05-21 20:18:36,876 Validation result (greedy) at epoch   3, step    18000: bleu:  18.24, loss: 53437.9453, ppl:   7.5489, duration: 16.8761s\n","2020-05-21 20:18:47,620 Epoch   3 Step:    18100 Batch Loss:     2.326572 Tokens per Sec:    21449, Lr: 0.000300\n","2020-05-21 20:18:52,395 Epoch   3: total training loss 14203.23\n","2020-05-21 20:18:52,395 EPOCH 4\n","2020-05-21 20:18:59,154 Epoch   4 Step:    18200 Batch Loss:     2.250816 Tokens per Sec:    19654, Lr: 0.000300\n","2020-05-21 20:19:10,025 Epoch   4 Step:    18300 Batch Loss:     2.433025 Tokens per Sec:    22104, Lr: 0.000300\n","2020-05-21 20:19:20,715 Epoch   4 Step:    18400 Batch Loss:     1.915312 Tokens per Sec:    21805, Lr: 0.000300\n","2020-05-21 20:19:31,513 Epoch   4 Step:    18500 Batch Loss:     2.254973 Tokens per Sec:    22144, Lr: 0.000300\n","2020-05-21 20:19:42,291 Epoch   4 Step:    18600 Batch Loss:     2.581388 Tokens per Sec:    21850, Lr: 0.000300\n","2020-05-21 20:19:53,096 Epoch   4 Step:    18700 Batch Loss:     2.039251 Tokens per Sec:    22034, Lr: 0.000300\n","2020-05-21 20:20:04,070 Epoch   4 Step:    18800 Batch Loss:     2.328020 Tokens per Sec:    22186, Lr: 0.000300\n","2020-05-21 20:20:15,048 Epoch   4 Step:    18900 Batch Loss:     2.467361 Tokens per Sec:    22169, Lr: 0.000300\n","2020-05-21 20:20:25,905 Epoch   4 Step:    19000 Batch Loss:     2.034632 Tokens per Sec:    22455, Lr: 0.000300\n","2020-05-21 20:20:39,671 Hooray! New best validation result [ppl]!\n","2020-05-21 20:20:39,671 Saving new checkpoint.\n","2020-05-21 20:20:39,940 Example #0\n","2020-05-21 20:20:39,941 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 20:20:39,941 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 20:20:39,941 \tHypothesis: Ɛtɔ mmere bi a , na tete nneɛma a ɛyɛ hu a ɛyɛ hu na ɛyɛ nokware .\n","2020-05-21 20:20:39,941 Example #1\n","2020-05-21 20:20:39,941 \tSource:     If so , you would be worthy of death .\n","2020-05-21 20:20:39,941 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 20:20:39,941 \tHypothesis: Sɛ saa a , ɛnde na wubewu .\n","2020-05-21 20:20:39,941 Example #2\n","2020-05-21 20:20:39,941 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 20:20:39,941 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 20:20:39,942 \tHypothesis: Hwɛ sɛnea ɔsomafo Yohane nyaa anigye wɔ anisoadehu kɛse yi mu !\n","2020-05-21 20:20:39,942 Example #3\n","2020-05-21 20:20:39,942 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 20:20:39,942 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 20:20:39,942 \tHypothesis: Ná Yesu wɔ nkate fam , na na ehia sɛ Petro ne afoforo di nkitaho .\n","2020-05-21 20:20:39,942 Validation result (greedy) at epoch   4, step    19000: bleu:  18.17, loss: 52919.9570, ppl:   7.4025, duration: 14.0371s\n","2020-05-21 20:20:50,780 Epoch   4 Step:    19100 Batch Loss:     2.499422 Tokens per Sec:    21941, Lr: 0.000300\n","2020-05-21 20:21:01,638 Epoch   4 Step:    19200 Batch Loss:     2.148228 Tokens per Sec:    22075, Lr: 0.000300\n","2020-05-21 20:21:12,526 Epoch   4 Step:    19300 Batch Loss:     1.893360 Tokens per Sec:    21909, Lr: 0.000300\n","2020-05-21 20:21:23,346 Epoch   4 Step:    19400 Batch Loss:     2.238263 Tokens per Sec:    21684, Lr: 0.000300\n","2020-05-21 20:21:34,293 Epoch   4 Step:    19500 Batch Loss:     2.136102 Tokens per Sec:    22611, Lr: 0.000300\n","2020-05-21 20:21:45,058 Epoch   4 Step:    19600 Batch Loss:     2.290465 Tokens per Sec:    22340, Lr: 0.000300\n","2020-05-21 20:21:55,809 Epoch   4 Step:    19700 Batch Loss:     2.050661 Tokens per Sec:    22117, Lr: 0.000300\n","2020-05-21 20:22:06,514 Epoch   4 Step:    19800 Batch Loss:     2.125943 Tokens per Sec:    21655, Lr: 0.000300\n","2020-05-21 20:22:17,408 Epoch   4 Step:    19900 Batch Loss:     2.228277 Tokens per Sec:    22314, Lr: 0.000300\n","2020-05-21 20:22:28,224 Epoch   4 Step:    20000 Batch Loss:     1.955518 Tokens per Sec:    22263, Lr: 0.000300\n","2020-05-21 20:22:42,809 Hooray! New best validation result [ppl]!\n","2020-05-21 20:22:42,809 Saving new checkpoint.\n","2020-05-21 20:22:43,075 Example #0\n","2020-05-21 20:22:43,075 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 20:22:43,076 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 20:22:43,076 \tHypothesis: Nsɛm a ɛte saa a tete mmere mu no maa nkurɔfo nyaa wɔn ho adwemmɔne na wɔpaw wɔn .\n","2020-05-21 20:22:43,076 Example #1\n","2020-05-21 20:22:43,076 \tSource:     If so , you would be worthy of death .\n","2020-05-21 20:22:43,076 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 20:22:43,076 \tHypothesis: Sɛ saa a , anka wubewu .\n","2020-05-21 20:22:43,076 Example #2\n","2020-05-21 20:22:43,076 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 20:22:43,076 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 20:22:43,077 \tHypothesis: Hwɛ sɛnea ɔsomafo Yohane nyaa nkɔanim wɔ anisoadehu a ɛyɛ nwonwa yi mu !\n","2020-05-21 20:22:43,077 Example #3\n","2020-05-21 20:22:43,077 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 20:22:43,077 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 20:22:43,077 \tHypothesis: Ná Yesu wɔ nkate fam , na na ehia sɛ ɔboa Petro , na mmom afoforo nso da so ara da .\n","2020-05-21 20:22:43,077 Validation result (greedy) at epoch   4, step    20000: bleu:  18.97, loss: 52087.8359, ppl:   7.1731, duration: 14.8529s\n","2020-05-21 20:22:53,909 Epoch   4 Step:    20100 Batch Loss:     2.292684 Tokens per Sec:    22056, Lr: 0.000300\n","2020-05-21 20:23:04,694 Epoch   4 Step:    20200 Batch Loss:     2.182096 Tokens per Sec:    21581, Lr: 0.000300\n","2020-05-21 20:23:15,535 Epoch   4 Step:    20300 Batch Loss:     2.232628 Tokens per Sec:    21746, Lr: 0.000300\n","2020-05-21 20:23:26,289 Epoch   4 Step:    20400 Batch Loss:     2.174431 Tokens per Sec:    22328, Lr: 0.000300\n","2020-05-21 20:23:37,051 Epoch   4 Step:    20500 Batch Loss:     2.133427 Tokens per Sec:    22120, Lr: 0.000300\n","2020-05-21 20:23:48,045 Epoch   4 Step:    20600 Batch Loss:     2.301947 Tokens per Sec:    22164, Lr: 0.000300\n","2020-05-21 20:23:58,940 Epoch   4 Step:    20700 Batch Loss:     1.933576 Tokens per Sec:    21956, Lr: 0.000300\n","2020-05-21 20:24:09,687 Epoch   4 Step:    20800 Batch Loss:     1.858767 Tokens per Sec:    21671, Lr: 0.000300\n","2020-05-21 20:24:20,431 Epoch   4 Step:    20900 Batch Loss:     2.078728 Tokens per Sec:    22200, Lr: 0.000300\n","2020-05-21 20:24:31,259 Epoch   4 Step:    21000 Batch Loss:     2.119385 Tokens per Sec:    22258, Lr: 0.000300\n","2020-05-21 20:24:46,237 Hooray! New best validation result [ppl]!\n","2020-05-21 20:24:46,238 Saving new checkpoint.\n","2020-05-21 20:24:46,471 Example #0\n","2020-05-21 20:24:46,471 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 20:24:46,471 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 20:24:46,471 \tHypothesis: Ɛtɔ mmere bi a , tete nneɛma a ɛyɛ hu a na ɛyɛ den ma wɔn a wɔhwehwɛ wɔn no yɛ wɔn ade .\n","2020-05-21 20:24:46,471 Example #1\n","2020-05-21 20:24:46,472 \tSource:     If so , you would be worthy of death .\n","2020-05-21 20:24:46,472 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 20:24:46,472 \tHypothesis: Sɛ saa a , ɛnde na ɛsɛ sɛ wuwu .\n","2020-05-21 20:24:46,472 Example #2\n","2020-05-21 20:24:46,472 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 20:24:46,472 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 20:24:46,472 \tHypothesis: Oh , hwɛ sɛnea ɔsomafo Yohane huu nnipakuw kɛse yi ho anisoadehu a ɛyɛ nwonwa !\n","2020-05-21 20:24:46,472 Example #3\n","2020-05-21 20:24:46,472 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 20:24:46,472 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 20:24:46,472 \tHypothesis: Ná Yesu wɔ nkate fam , na na ehia sɛ Petro ne afoforo di nkitaho , nanso na afoforo nso da so ara da .\n","2020-05-21 20:24:46,473 Validation result (greedy) at epoch   4, step    21000: bleu:  19.49, loss: 51602.2734, ppl:   7.0425, duration: 15.2137s\n","2020-05-21 20:24:57,276 Epoch   4 Step:    21100 Batch Loss:     2.213169 Tokens per Sec:    22392, Lr: 0.000300\n","2020-05-21 20:25:08,056 Epoch   4 Step:    21200 Batch Loss:     2.007126 Tokens per Sec:    21880, Lr: 0.000300\n","2020-05-21 20:25:18,884 Epoch   4 Step:    21300 Batch Loss:     2.223762 Tokens per Sec:    22175, Lr: 0.000300\n","2020-05-21 20:25:29,717 Epoch   4 Step:    21400 Batch Loss:     2.448901 Tokens per Sec:    21800, Lr: 0.000300\n","2020-05-21 20:25:40,491 Epoch   4 Step:    21500 Batch Loss:     2.088121 Tokens per Sec:    22294, Lr: 0.000300\n","2020-05-21 20:25:51,294 Epoch   4 Step:    21600 Batch Loss:     2.301044 Tokens per Sec:    22553, Lr: 0.000300\n","2020-05-21 20:26:02,104 Epoch   4 Step:    21700 Batch Loss:     2.132211 Tokens per Sec:    22009, Lr: 0.000300\n","2020-05-21 20:26:12,912 Epoch   4 Step:    21800 Batch Loss:     1.849291 Tokens per Sec:    22198, Lr: 0.000300\n","2020-05-21 20:26:23,729 Epoch   4 Step:    21900 Batch Loss:     2.591214 Tokens per Sec:    22301, Lr: 0.000300\n","2020-05-21 20:26:34,602 Epoch   4 Step:    22000 Batch Loss:     2.193555 Tokens per Sec:    22020, Lr: 0.000300\n","2020-05-21 20:26:47,855 Hooray! New best validation result [ppl]!\n","2020-05-21 20:26:47,855 Saving new checkpoint.\n","2020-05-21 20:26:48,086 Example #0\n","2020-05-21 20:26:48,086 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 20:26:48,086 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 20:26:48,087 \tHypothesis: Saa nsɛm yi maa tete ahonyade a na ɛyɛ hu ne amanne .\n","2020-05-21 20:26:48,087 Example #1\n","2020-05-21 20:26:48,087 \tSource:     If so , you would be worthy of death .\n","2020-05-21 20:26:48,087 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 20:26:48,087 \tHypothesis: Sɛ saa a , anka wubewu .\n","2020-05-21 20:26:48,087 Example #2\n","2020-05-21 20:26:48,087 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 20:26:48,087 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 20:26:48,087 \tHypothesis: Oh , hwɛ sɛnea ɔsomafo Yohane huu nnipakuw kɛse no anisoadehu a ɛyɛ nwonwa yi ho anisoadehu a ɛyɛ nwonwa !\n","2020-05-21 20:26:48,087 Example #3\n","2020-05-21 20:26:48,087 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 20:26:48,087 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 20:26:48,087 \tHypothesis: Ná Yesu wɔ nkate fam , na na ehia sɛ Petro ne afoforo da so ara yɛ wɔn ade .\n","2020-05-21 20:26:48,088 Validation result (greedy) at epoch   4, step    22000: bleu:  20.18, loss: 51046.2734, ppl:   6.8960, duration: 13.4850s\n","2020-05-21 20:26:58,798 Epoch   4 Step:    22100 Batch Loss:     2.329859 Tokens per Sec:    22096, Lr: 0.000300\n","2020-05-21 20:27:09,476 Epoch   4 Step:    22200 Batch Loss:     2.355283 Tokens per Sec:    22028, Lr: 0.000300\n","2020-05-21 20:27:20,240 Epoch   4 Step:    22300 Batch Loss:     2.050479 Tokens per Sec:    22226, Lr: 0.000300\n","2020-05-21 20:27:30,992 Epoch   4 Step:    22400 Batch Loss:     1.987772 Tokens per Sec:    22085, Lr: 0.000300\n","2020-05-21 20:27:41,793 Epoch   4 Step:    22500 Batch Loss:     2.087610 Tokens per Sec:    22345, Lr: 0.000300\n","2020-05-21 20:27:52,530 Epoch   4 Step:    22600 Batch Loss:     2.240821 Tokens per Sec:    22141, Lr: 0.000300\n","2020-05-21 20:28:03,298 Epoch   4 Step:    22700 Batch Loss:     2.139207 Tokens per Sec:    22227, Lr: 0.000300\n","2020-05-21 20:28:14,073 Epoch   4 Step:    22800 Batch Loss:     2.119464 Tokens per Sec:    22144, Lr: 0.000300\n","2020-05-21 20:28:24,744 Epoch   4 Step:    22900 Batch Loss:     2.097127 Tokens per Sec:    22638, Lr: 0.000300\n","2020-05-21 20:28:35,514 Epoch   4 Step:    23000 Batch Loss:     2.167089 Tokens per Sec:    22399, Lr: 0.000300\n","2020-05-21 20:28:50,239 Hooray! New best validation result [ppl]!\n","2020-05-21 20:28:50,240 Saving new checkpoint.\n","2020-05-21 20:28:50,469 Example #0\n","2020-05-21 20:28:50,470 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 20:28:50,470 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 20:28:50,470 \tHypothesis: Saa nsɛm no maa tete akofo no nyaa adwene sɛ wɔbɛhyɛ wɔn den na wɔatwe wɔn ho afi wɔn ho .\n","2020-05-21 20:28:50,470 Example #1\n","2020-05-21 20:28:50,470 \tSource:     If so , you would be worthy of death .\n","2020-05-21 20:28:50,470 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 20:28:50,470 \tHypothesis: Sɛ saa a , ɛnde na ɛsɛ sɛ wuwu .\n","2020-05-21 20:28:50,470 Example #2\n","2020-05-21 20:28:50,470 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 20:28:50,470 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 20:28:50,470 \tHypothesis: Ko , hwɛ sɛnea ɔsomafo Yohane huu nnipakuw kɛse no anisoadehu a ɛyɛ nwonwa yi !\n","2020-05-21 20:28:50,470 Example #3\n","2020-05-21 20:28:50,471 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 20:28:50,471 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 20:28:50,471 \tHypothesis: Ná Yesu wɔ nkate fam , na na ehia sɛ Petro ne afoforo da so ara da .\n","2020-05-21 20:28:50,471 Validation result (greedy) at epoch   4, step    23000: bleu:  20.32, loss: 50586.9375, ppl:   6.7772, duration: 14.9564s\n","2020-05-21 20:29:01,345 Epoch   4 Step:    23100 Batch Loss:     2.030808 Tokens per Sec:    22561, Lr: 0.000300\n","2020-05-21 20:29:11,979 Epoch   4 Step:    23200 Batch Loss:     2.420050 Tokens per Sec:    22140, Lr: 0.000300\n","2020-05-21 20:29:22,747 Epoch   4 Step:    23300 Batch Loss:     1.895166 Tokens per Sec:    22524, Lr: 0.000300\n","2020-05-21 20:29:33,491 Epoch   4 Step:    23400 Batch Loss:     2.150982 Tokens per Sec:    21895, Lr: 0.000300\n","2020-05-21 20:29:44,127 Epoch   4 Step:    23500 Batch Loss:     1.990108 Tokens per Sec:    22188, Lr: 0.000300\n","2020-05-21 20:29:54,841 Epoch   4 Step:    23600 Batch Loss:     2.297214 Tokens per Sec:    22349, Lr: 0.000300\n","2020-05-21 20:30:05,545 Epoch   4 Step:    23700 Batch Loss:     1.984220 Tokens per Sec:    22261, Lr: 0.000300\n","2020-05-21 20:30:16,280 Epoch   4 Step:    23800 Batch Loss:     2.277573 Tokens per Sec:    22224, Lr: 0.000300\n","2020-05-21 20:30:27,061 Epoch   4 Step:    23900 Batch Loss:     2.138779 Tokens per Sec:    22171, Lr: 0.000300\n","2020-05-21 20:30:37,736 Epoch   4 Step:    24000 Batch Loss:     2.141025 Tokens per Sec:    22353, Lr: 0.000300\n","2020-05-21 20:30:49,038 Hooray! New best validation result [ppl]!\n","2020-05-21 20:30:49,038 Saving new checkpoint.\n","2020-05-21 20:30:49,297 Example #0\n","2020-05-21 20:30:49,297 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 20:30:49,297 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 20:30:49,298 \tHypothesis: Nsɛm a ɛte saa no maa tete ahoni no nyaa nkɔso a na ɛyɛ den ma wɔn .\n","2020-05-21 20:30:49,298 Example #1\n","2020-05-21 20:30:49,298 \tSource:     If so , you would be worthy of death .\n","2020-05-21 20:30:49,298 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 20:30:49,298 \tHypothesis: Sɛ saa a , ɛnde na wubewu .\n","2020-05-21 20:30:49,298 Example #2\n","2020-05-21 20:30:49,298 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 20:30:49,298 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 20:30:49,298 \tHypothesis: Nea ɛyɛ nwonwa ne sɛ , ɔsomafo Yohane huu nnipakuw kɛse yi ho anisoadehu a ɛyɛ nwonwa !\n","2020-05-21 20:30:49,298 Example #3\n","2020-05-21 20:30:49,299 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 20:30:49,299 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 20:30:49,299 \tHypothesis: Ná Yesu wɔ nkate fam , na na ehia sɛ ɔboa Petro , nanso na afoforo nso da so ara da .\n","2020-05-21 20:30:49,299 Validation result (greedy) at epoch   4, step    24000: bleu:  20.12, loss: 50214.2930, ppl:   6.6823, duration: 11.5624s\n","2020-05-21 20:31:00,020 Epoch   4 Step:    24100 Batch Loss:     2.280591 Tokens per Sec:    22521, Lr: 0.000300\n","2020-05-21 20:31:10,661 Epoch   4 Step:    24200 Batch Loss:     2.081914 Tokens per Sec:    21574, Lr: 0.000300\n","2020-05-21 20:31:10,798 Epoch   4: total training loss 13181.01\n","2020-05-21 20:31:10,798 EPOCH 5\n","2020-05-21 20:31:22,055 Epoch   5 Step:    24300 Batch Loss:     2.133892 Tokens per Sec:    20589, Lr: 0.000300\n","2020-05-21 20:31:32,839 Epoch   5 Step:    24400 Batch Loss:     2.274389 Tokens per Sec:    22899, Lr: 0.000300\n","2020-05-21 20:31:43,603 Epoch   5 Step:    24500 Batch Loss:     2.031079 Tokens per Sec:    22495, Lr: 0.000300\n","2020-05-21 20:31:54,326 Epoch   5 Step:    24600 Batch Loss:     1.893503 Tokens per Sec:    22241, Lr: 0.000300\n","2020-05-21 20:32:04,999 Epoch   5 Step:    24700 Batch Loss:     2.205602 Tokens per Sec:    22288, Lr: 0.000300\n","2020-05-21 20:32:15,732 Epoch   5 Step:    24800 Batch Loss:     2.028462 Tokens per Sec:    22302, Lr: 0.000300\n","2020-05-21 20:32:26,476 Epoch   5 Step:    24900 Batch Loss:     1.856085 Tokens per Sec:    22180, Lr: 0.000300\n","2020-05-21 20:32:37,143 Epoch   5 Step:    25000 Batch Loss:     2.289798 Tokens per Sec:    21950, Lr: 0.000300\n","2020-05-21 20:32:49,449 Hooray! New best validation result [ppl]!\n","2020-05-21 20:32:49,449 Saving new checkpoint.\n","2020-05-21 20:32:49,678 Example #0\n","2020-05-21 20:32:49,678 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 20:32:49,678 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 20:32:49,678 \tHypothesis: Nsɛm a ɛte saa maa tete ahoni no nyaa nkɔso a na ɛyɛ den na wɔhwehwɛ sɛ wɔyɛ wɔn ade .\n","2020-05-21 20:32:49,678 Example #1\n","2020-05-21 20:32:49,679 \tSource:     If so , you would be worthy of death .\n","2020-05-21 20:32:49,679 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 20:32:49,679 \tHypothesis: Sɛ saa a , ɛnde na wubewu .\n","2020-05-21 20:32:49,679 Example #2\n","2020-05-21 20:32:49,679 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 20:32:49,679 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 20:32:49,679 \tHypothesis: Nea edi kan no , hwɛ sɛnea ɔsomafo Yohane huu nnipakuw kɛse no anisoadehu a ɛyɛ hu yi !\n","2020-05-21 20:32:49,679 Example #3\n","2020-05-21 20:32:49,679 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 20:32:49,679 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 20:32:49,679 \tHypothesis: Ná Yesu wɔ nkate fam ne ahiade a ɛho hia , nanso Petro ne afoforo no da so ara da .\n","2020-05-21 20:32:49,679 Validation result (greedy) at epoch   5, step    25000: bleu:  21.20, loss: 49788.1523, ppl:   6.5755, duration: 12.5362s\n","2020-05-21 20:33:00,452 Epoch   5 Step:    25100 Batch Loss:     2.103583 Tokens per Sec:    22041, Lr: 0.000300\n","2020-05-21 20:33:11,346 Epoch   5 Step:    25200 Batch Loss:     2.338555 Tokens per Sec:    22681, Lr: 0.000300\n","2020-05-21 20:33:21,989 Epoch   5 Step:    25300 Batch Loss:     2.151240 Tokens per Sec:    22079, Lr: 0.000300\n","2020-05-21 20:33:32,698 Epoch   5 Step:    25400 Batch Loss:     1.640370 Tokens per Sec:    21902, Lr: 0.000300\n","2020-05-21 20:33:43,469 Epoch   5 Step:    25500 Batch Loss:     2.125797 Tokens per Sec:    22446, Lr: 0.000300\n","2020-05-21 20:33:54,241 Epoch   5 Step:    25600 Batch Loss:     2.068910 Tokens per Sec:    22615, Lr: 0.000300\n","2020-05-21 20:34:04,966 Epoch   5 Step:    25700 Batch Loss:     2.023896 Tokens per Sec:    22119, Lr: 0.000300\n","2020-05-21 20:34:15,905 Epoch   5 Step:    25800 Batch Loss:     1.978477 Tokens per Sec:    22035, Lr: 0.000300\n","2020-05-21 20:34:26,586 Epoch   5 Step:    25900 Batch Loss:     2.162666 Tokens per Sec:    21685, Lr: 0.000300\n","2020-05-21 20:34:37,337 Epoch   5 Step:    26000 Batch Loss:     2.251327 Tokens per Sec:    22118, Lr: 0.000300\n","2020-05-21 20:34:50,779 Hooray! New best validation result [ppl]!\n","2020-05-21 20:34:50,780 Saving new checkpoint.\n","2020-05-21 20:34:51,040 Example #0\n","2020-05-21 20:34:51,040 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 20:34:51,040 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 20:34:51,040 \tHypothesis: Saa nsɛm no maa tete ahemfo no nyaa adwene sɛ wɔbɛkɔ so ayɛ wɔn ade na wɔabu wɔn ani agu wɔn so .\n","2020-05-21 20:34:51,040 Example #1\n","2020-05-21 20:34:51,040 \tSource:     If so , you would be worthy of death .\n","2020-05-21 20:34:51,040 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 20:34:51,040 \tHypothesis: Sɛ saa a , ɛnde na wubewu .\n","2020-05-21 20:34:51,040 Example #2\n","2020-05-21 20:34:51,041 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 20:34:51,041 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 20:34:51,041 \tHypothesis: Oo , hwɛ sɛnea ɔsomafo Yohane nyaa anisoadehu a ɛyɛ nwonwa yi ho anisoadehu a ɛyɛ nwonwa !\n","2020-05-21 20:34:51,041 Example #3\n","2020-05-21 20:34:51,041 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 20:34:51,041 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 20:34:51,041 \tHypothesis: Ná Yesu wɔ nkate fam , na ehia sɛ ɔboa Petro , na mmom afoforo nso da so ara da .\n","2020-05-21 20:34:51,041 Validation result (greedy) at epoch   5, step    26000: bleu:  20.61, loss: 49435.9609, ppl:   6.4885, duration: 13.7040s\n","2020-05-21 20:35:01,788 Epoch   5 Step:    26100 Batch Loss:     2.128553 Tokens per Sec:    22138, Lr: 0.000300\n","2020-05-21 20:35:12,684 Epoch   5 Step:    26200 Batch Loss:     2.247628 Tokens per Sec:    22383, Lr: 0.000300\n","2020-05-21 20:35:23,455 Epoch   5 Step:    26300 Batch Loss:     1.752484 Tokens per Sec:    22257, Lr: 0.000300\n","2020-05-21 20:35:34,203 Epoch   5 Step:    26400 Batch Loss:     1.930246 Tokens per Sec:    22091, Lr: 0.000300\n","2020-05-21 20:35:44,897 Epoch   5 Step:    26500 Batch Loss:     2.215172 Tokens per Sec:    22399, Lr: 0.000300\n","2020-05-21 20:35:55,604 Epoch   5 Step:    26600 Batch Loss:     2.144328 Tokens per Sec:    21849, Lr: 0.000300\n","2020-05-21 20:36:06,391 Epoch   5 Step:    26700 Batch Loss:     1.782701 Tokens per Sec:    22159, Lr: 0.000300\n","2020-05-21 20:36:17,226 Epoch   5 Step:    26800 Batch Loss:     2.010042 Tokens per Sec:    22290, Lr: 0.000300\n","2020-05-21 20:36:27,999 Epoch   5 Step:    26900 Batch Loss:     2.035632 Tokens per Sec:    22315, Lr: 0.000300\n","2020-05-21 20:36:38,796 Epoch   5 Step:    27000 Batch Loss:     2.126678 Tokens per Sec:    22242, Lr: 0.000300\n","2020-05-21 20:36:51,356 Hooray! New best validation result [ppl]!\n","2020-05-21 20:36:51,356 Saving new checkpoint.\n","2020-05-21 20:36:51,590 Example #0\n","2020-05-21 20:36:51,590 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 20:36:51,590 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 20:36:51,590 \tHypothesis: Nsɛm a ɛte saa no maa tete ahoni no nyaa adwene sɛ wɔbɛkɔ so ayɛ wɔn ade na wɔabu wɔn ani agu wɔn ho so .\n","2020-05-21 20:36:51,590 Example #1\n","2020-05-21 20:36:51,590 \tSource:     If so , you would be worthy of death .\n","2020-05-21 20:36:51,590 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 20:36:51,591 \tHypothesis: Sɛ saa a , ɛnde na ɛsɛ sɛ wuwu .\n","2020-05-21 20:36:51,591 Example #2\n","2020-05-21 20:36:51,591 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 20:36:51,591 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 20:36:51,591 \tHypothesis: Ko , hwɛ sɛnea ɔsomafo Yohane huu nnipakuw kɛse no anisoadehu a ɛyɛ nwonwa yi !\n","2020-05-21 20:36:51,591 Example #3\n","2020-05-21 20:36:51,591 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 20:36:51,591 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 20:36:51,591 \tHypothesis: Ná Yesu wɔ nkate fam , na ohia mmoa , nanso Petro ne afoforo nso da so ara da .\n","2020-05-21 20:36:51,591 Validation result (greedy) at epoch   5, step    27000: bleu:  21.56, loss: 49078.2188, ppl:   6.4012, duration: 12.7948s\n","2020-05-21 20:37:02,268 Epoch   5 Step:    27100 Batch Loss:     1.904228 Tokens per Sec:    21654, Lr: 0.000300\n","2020-05-21 20:37:13,030 Epoch   5 Step:    27200 Batch Loss:     1.913052 Tokens per Sec:    22146, Lr: 0.000300\n","2020-05-21 20:37:23,813 Epoch   5 Step:    27300 Batch Loss:     2.028959 Tokens per Sec:    21852, Lr: 0.000300\n","2020-05-21 20:37:34,645 Epoch   5 Step:    27400 Batch Loss:     1.998308 Tokens per Sec:    22313, Lr: 0.000300\n","2020-05-21 20:37:45,350 Epoch   5 Step:    27500 Batch Loss:     1.863852 Tokens per Sec:    21913, Lr: 0.000300\n","2020-05-21 20:37:56,246 Epoch   5 Step:    27600 Batch Loss:     1.796470 Tokens per Sec:    22251, Lr: 0.000300\n","2020-05-21 20:38:07,017 Epoch   5 Step:    27700 Batch Loss:     2.191067 Tokens per Sec:    22323, Lr: 0.000300\n","2020-05-21 20:38:17,686 Epoch   5 Step:    27800 Batch Loss:     2.048769 Tokens per Sec:    21971, Lr: 0.000300\n","2020-05-21 20:38:28,526 Epoch   5 Step:    27900 Batch Loss:     2.154636 Tokens per Sec:    22467, Lr: 0.000300\n","2020-05-21 20:38:39,391 Epoch   5 Step:    28000 Batch Loss:     1.795905 Tokens per Sec:    22249, Lr: 0.000300\n","2020-05-21 20:38:53,042 Hooray! New best validation result [ppl]!\n","2020-05-21 20:38:53,042 Saving new checkpoint.\n","2020-05-21 20:38:53,274 Example #0\n","2020-05-21 20:38:53,274 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 20:38:53,274 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 20:38:53,274 \tHypothesis: Tete mmeae a na tete no yɛ ade a ɛyɛ hu a na ɛyɛ hu na ɛyɛ aniberesɛm .\n","2020-05-21 20:38:53,274 Example #1\n","2020-05-21 20:38:53,275 \tSource:     If so , you would be worthy of death .\n","2020-05-21 20:38:53,275 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 20:38:53,275 \tHypothesis: Sɛ saa a , ɛnde na wubewu .\n","2020-05-21 20:38:53,275 Example #2\n","2020-05-21 20:38:53,275 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 20:38:53,275 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 20:38:53,275 \tHypothesis: Hwɛ sɛnea ɔsomafo Yohane huu nnipakuw kɛse no anisoadehu a ɛyɛ hu yi !\n","2020-05-21 20:38:53,275 Example #3\n","2020-05-21 20:38:53,275 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 20:38:53,275 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 20:38:53,275 \tHypothesis: Ná Yesu wɔ nkate fam , na na ohia mmoa , nanso Petro ne afoforo a wɔda no adi no da so ara .\n","2020-05-21 20:38:53,275 Validation result (greedy) at epoch   5, step    28000: bleu:  22.01, loss: 48415.0117, ppl:   6.2426, duration: 13.8843s\n","2020-05-21 20:39:04,080 Epoch   5 Step:    28100 Batch Loss:     1.777950 Tokens per Sec:    22023, Lr: 0.000300\n","2020-05-21 20:39:14,865 Epoch   5 Step:    28200 Batch Loss:     1.710906 Tokens per Sec:    21696, Lr: 0.000300\n","2020-05-21 20:39:25,740 Epoch   5 Step:    28300 Batch Loss:     2.099056 Tokens per Sec:    22234, Lr: 0.000300\n","2020-05-21 20:39:36,569 Epoch   5 Step:    28400 Batch Loss:     2.109424 Tokens per Sec:    22196, Lr: 0.000300\n","2020-05-21 20:39:47,369 Epoch   5 Step:    28500 Batch Loss:     1.977178 Tokens per Sec:    22285, Lr: 0.000300\n","2020-05-21 20:39:58,144 Epoch   5 Step:    28600 Batch Loss:     2.145848 Tokens per Sec:    22065, Lr: 0.000300\n","2020-05-21 20:40:08,959 Epoch   5 Step:    28700 Batch Loss:     2.005975 Tokens per Sec:    22364, Lr: 0.000300\n","2020-05-21 20:40:19,760 Epoch   5 Step:    28800 Batch Loss:     2.014386 Tokens per Sec:    22204, Lr: 0.000300\n","2020-05-21 20:40:30,504 Epoch   5 Step:    28900 Batch Loss:     1.954891 Tokens per Sec:    22050, Lr: 0.000300\n","2020-05-21 20:40:41,329 Epoch   5 Step:    29000 Batch Loss:     2.386691 Tokens per Sec:    22398, Lr: 0.000300\n","2020-05-21 20:40:52,939 Hooray! New best validation result [ppl]!\n","2020-05-21 20:40:52,939 Saving new checkpoint.\n","2020-05-21 20:40:53,186 Example #0\n","2020-05-21 20:40:53,186 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 20:40:53,186 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 20:40:53,186 \tHypothesis: Nsɛm a ɛtete saa no maa tete ahoni a na wɔwɔ hɔ no nyaa wɔn ho adwempa na wɔanyɛ wɔn ade .\n","2020-05-21 20:40:53,186 Example #1\n","2020-05-21 20:40:53,186 \tSource:     If so , you would be worthy of death .\n","2020-05-21 20:40:53,187 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 20:40:53,187 \tHypothesis: Sɛ saa a , wubewu .\n","2020-05-21 20:40:53,187 Example #2\n","2020-05-21 20:40:53,187 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 20:40:53,187 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 20:40:53,187 \tHypothesis: Oh , hwɛ sɛnea ɔsomafo Yohane huu nnipakuw kɛse no anisoadehu a ɛyɛ hu yi !\n","2020-05-21 20:40:53,187 Example #3\n","2020-05-21 20:40:53,187 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 20:40:53,187 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 20:40:53,187 \tHypothesis: Ná Yesu wɔ nkate fam , na ohia mmoa , nanso Petro ne afoforo nso da so ara da .\n","2020-05-21 20:40:53,187 Validation result (greedy) at epoch   5, step    29000: bleu:  22.07, loss: 48288.6992, ppl:   6.2129, duration: 11.8577s\n","2020-05-21 20:41:04,127 Epoch   5 Step:    29100 Batch Loss:     2.014886 Tokens per Sec:    22448, Lr: 0.000300\n","2020-05-21 20:41:14,959 Epoch   5 Step:    29200 Batch Loss:     2.033258 Tokens per Sec:    22143, Lr: 0.000300\n","2020-05-21 20:41:25,764 Epoch   5 Step:    29300 Batch Loss:     2.038312 Tokens per Sec:    22177, Lr: 0.000300\n","2020-05-21 20:41:36,508 Epoch   5 Step:    29400 Batch Loss:     1.972273 Tokens per Sec:    21939, Lr: 0.000300\n","2020-05-21 20:41:47,261 Epoch   5 Step:    29500 Batch Loss:     1.997018 Tokens per Sec:    22251, Lr: 0.000300\n","2020-05-21 20:41:58,082 Epoch   5 Step:    29600 Batch Loss:     2.148215 Tokens per Sec:    21712, Lr: 0.000300\n","2020-05-21 20:42:08,871 Epoch   5 Step:    29700 Batch Loss:     1.931006 Tokens per Sec:    22259, Lr: 0.000300\n","2020-05-21 20:42:19,655 Epoch   5 Step:    29800 Batch Loss:     1.973439 Tokens per Sec:    22085, Lr: 0.000300\n","2020-05-21 20:42:30,546 Epoch   5 Step:    29900 Batch Loss:     2.086052 Tokens per Sec:    22029, Lr: 0.000300\n","2020-05-21 20:42:41,294 Epoch   5 Step:    30000 Batch Loss:     1.916431 Tokens per Sec:    22059, Lr: 0.000300\n","2020-05-21 20:42:55,308 Hooray! New best validation result [ppl]!\n","2020-05-21 20:42:55,309 Saving new checkpoint.\n","2020-05-21 20:42:55,565 Example #0\n","2020-05-21 20:42:55,566 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 20:42:55,566 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 20:42:55,566 \tHypothesis: Nsɛm a ɛtete saa no maa tete mmeae a na wɔmpɛ sɛ wɔyɛ wɔn ade na wɔyɛ nsi .\n","2020-05-21 20:42:55,566 Example #1\n","2020-05-21 20:42:55,566 \tSource:     If so , you would be worthy of death .\n","2020-05-21 20:42:55,566 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 20:42:55,566 \tHypothesis: Sɛ saa a , anka wubewu .\n","2020-05-21 20:42:55,566 Example #2\n","2020-05-21 20:42:55,566 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 20:42:55,566 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 20:42:55,567 \tHypothesis: Oh , hwɛ sɛnea ɔsomafo Yohane huu nnipakuw kɛse no anisoadehu a ɛyɛ hu yi !\n","2020-05-21 20:42:55,567 Example #3\n","2020-05-21 20:42:55,567 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 20:42:55,567 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 20:42:55,567 \tHypothesis: Ná Yesu wɔ nkate fam , na na ohia mmoa , nanso Petro ne afoforo no da so ara da .\n","2020-05-21 20:42:55,567 Validation result (greedy) at epoch   5, step    30000: bleu:  22.14, loss: 47960.4688, ppl:   6.1362, duration: 14.2733s\n","2020-05-21 20:43:06,328 Epoch   5 Step:    30100 Batch Loss:     1.720045 Tokens per Sec:    21730, Lr: 0.000300\n","2020-05-21 20:43:17,139 Epoch   5 Step:    30200 Batch Loss:     1.927489 Tokens per Sec:    22115, Lr: 0.000300\n","2020-05-21 20:43:23,547 Epoch   5: total training loss 12524.29\n","2020-05-21 20:43:23,548 EPOCH 6\n","2020-05-21 20:43:28,620 Epoch   6 Step:    30300 Batch Loss:     2.295597 Tokens per Sec:    19377, Lr: 0.000300\n","2020-05-21 20:43:39,330 Epoch   6 Step:    30400 Batch Loss:     2.138646 Tokens per Sec:    21805, Lr: 0.000300\n","2020-05-21 20:43:50,131 Epoch   6 Step:    30500 Batch Loss:     1.616635 Tokens per Sec:    22017, Lr: 0.000300\n","2020-05-21 20:44:00,962 Epoch   6 Step:    30600 Batch Loss:     2.099761 Tokens per Sec:    21933, Lr: 0.000300\n","2020-05-21 20:44:11,869 Epoch   6 Step:    30700 Batch Loss:     1.849033 Tokens per Sec:    22318, Lr: 0.000300\n","2020-05-21 20:44:22,613 Epoch   6 Step:    30800 Batch Loss:     2.066134 Tokens per Sec:    21584, Lr: 0.000300\n","2020-05-21 20:44:33,495 Epoch   6 Step:    30900 Batch Loss:     2.111825 Tokens per Sec:    21951, Lr: 0.000300\n","2020-05-21 20:44:44,240 Epoch   6 Step:    31000 Batch Loss:     1.961246 Tokens per Sec:    21950, Lr: 0.000300\n","2020-05-21 20:44:56,599 Hooray! New best validation result [ppl]!\n","2020-05-21 20:44:56,600 Saving new checkpoint.\n","2020-05-21 20:44:56,862 Example #0\n","2020-05-21 20:44:56,863 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 20:44:56,863 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 20:44:56,863 \tHypothesis: Nsɛm a ɛte saa maa tete nneɛma a na ɛyɛ hu a na ɛyɛ hu na ɛyɛ aniberesɛm .\n","2020-05-21 20:44:56,863 Example #1\n","2020-05-21 20:44:56,863 \tSource:     If so , you would be worthy of death .\n","2020-05-21 20:44:56,863 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 20:44:56,863 \tHypothesis: Sɛ saa a , anka wubewu .\n","2020-05-21 20:44:56,863 Example #2\n","2020-05-21 20:44:56,863 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 20:44:56,863 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 20:44:56,863 \tHypothesis: Oh , hwɛ sɛnea ɔsomafo Yohane huu nnipakuw kɛse no anisoadehu a ɛyɛ hu yi !\n","2020-05-21 20:44:56,863 Example #3\n","2020-05-21 20:44:56,864 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 20:44:56,864 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 20:44:56,864 \tHypothesis: Ná Yesu wɔ nkate fam , na na ehia sɛ ɔboa no , nanso Petro ne afoforo no da so ara da .\n","2020-05-21 20:44:56,864 Validation result (greedy) at epoch   6, step    31000: bleu:  22.26, loss: 47794.8555, ppl:   6.0979, duration: 12.6239s\n","2020-05-21 20:45:07,661 Epoch   6 Step:    31100 Batch Loss:     2.134946 Tokens per Sec:    21970, Lr: 0.000300\n","2020-05-21 20:45:18,520 Epoch   6 Step:    31200 Batch Loss:     2.232231 Tokens per Sec:    22165, Lr: 0.000300\n","2020-05-21 20:45:29,310 Epoch   6 Step:    31300 Batch Loss:     1.722596 Tokens per Sec:    22089, Lr: 0.000300\n","2020-05-21 20:45:40,086 Epoch   6 Step:    31400 Batch Loss:     2.102271 Tokens per Sec:    21808, Lr: 0.000300\n","2020-05-21 20:45:50,902 Epoch   6 Step:    31500 Batch Loss:     1.981070 Tokens per Sec:    22012, Lr: 0.000300\n","2020-05-21 20:46:01,649 Epoch   6 Step:    31600 Batch Loss:     1.986920 Tokens per Sec:    22075, Lr: 0.000300\n","2020-05-21 20:46:12,480 Epoch   6 Step:    31700 Batch Loss:     2.160661 Tokens per Sec:    22261, Lr: 0.000300\n","2020-05-21 20:46:23,316 Epoch   6 Step:    31800 Batch Loss:     1.979197 Tokens per Sec:    22118, Lr: 0.000300\n","2020-05-21 20:46:34,066 Epoch   6 Step:    31900 Batch Loss:     1.840167 Tokens per Sec:    21950, Lr: 0.000300\n","2020-05-21 20:46:44,905 Epoch   6 Step:    32000 Batch Loss:     2.113887 Tokens per Sec:    22355, Lr: 0.000300\n","2020-05-21 20:46:56,898 Hooray! New best validation result [ppl]!\n","2020-05-21 20:46:56,899 Saving new checkpoint.\n","2020-05-21 20:46:57,141 Example #0\n","2020-05-21 20:46:57,141 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 20:46:57,141 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 20:46:57,141 \tHypothesis: Nsɛm a ɛtete saa no maa tete nneɛma a na ɛyɛ hu a na wɔreyɛ no ne wɔn a wɔyɛ nsi .\n","2020-05-21 20:46:57,141 Example #1\n","2020-05-21 20:46:57,141 \tSource:     If so , you would be worthy of death .\n","2020-05-21 20:46:57,142 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 20:46:57,142 \tHypothesis: Sɛ saa a , anka wubewu .\n","2020-05-21 20:46:57,142 Example #2\n","2020-05-21 20:46:57,142 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 20:46:57,142 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 20:46:57,142 \tHypothesis: Oo , hwɛ sɛnea ɔsomafo Yohane huu nnipakuw kɛse no anisoadehu a ɛyɛ hu yi !\n","2020-05-21 20:46:57,142 Example #3\n","2020-05-21 20:46:57,142 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 20:46:57,142 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 20:46:57,143 \tHypothesis: Ná Yesu wɔ nkate fam ne mmoa a ehia , nanso Petro ne afoforo no da so ara da .\n","2020-05-21 20:46:57,143 Validation result (greedy) at epoch   6, step    32000: bleu:  22.56, loss: 47344.0508, ppl:   5.9948, duration: 12.2378s\n","2020-05-21 20:47:07,992 Epoch   6 Step:    32100 Batch Loss:     2.077777 Tokens per Sec:    22106, Lr: 0.000300\n","2020-05-21 20:47:18,794 Epoch   6 Step:    32200 Batch Loss:     2.046630 Tokens per Sec:    22161, Lr: 0.000300\n","2020-05-21 20:47:29,576 Epoch   6 Step:    32300 Batch Loss:     2.024469 Tokens per Sec:    21874, Lr: 0.000300\n","2020-05-21 20:47:40,355 Epoch   6 Step:    32400 Batch Loss:     1.955361 Tokens per Sec:    22380, Lr: 0.000300\n","2020-05-21 20:47:51,152 Epoch   6 Step:    32500 Batch Loss:     1.970888 Tokens per Sec:    22296, Lr: 0.000300\n","2020-05-21 20:48:02,023 Epoch   6 Step:    32600 Batch Loss:     2.283533 Tokens per Sec:    22237, Lr: 0.000300\n","2020-05-21 20:48:12,866 Epoch   6 Step:    32700 Batch Loss:     2.046909 Tokens per Sec:    22292, Lr: 0.000300\n","2020-05-21 20:48:23,694 Epoch   6 Step:    32800 Batch Loss:     2.175475 Tokens per Sec:    22493, Lr: 0.000300\n","2020-05-21 20:48:34,543 Epoch   6 Step:    32900 Batch Loss:     1.906769 Tokens per Sec:    21945, Lr: 0.000300\n","2020-05-21 20:48:45,446 Epoch   6 Step:    33000 Batch Loss:     1.896705 Tokens per Sec:    22349, Lr: 0.000300\n","2020-05-21 20:48:58,815 Hooray! New best validation result [ppl]!\n","2020-05-21 20:48:58,815 Saving new checkpoint.\n","2020-05-21 20:48:59,068 Example #0\n","2020-05-21 20:48:59,069 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 20:48:59,069 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 20:48:59,069 \tHypothesis: Nsɛm a ɛte saa no maa tete ahoni no nyaa ahotɔ ne amanne .\n","2020-05-21 20:48:59,069 Example #1\n","2020-05-21 20:48:59,069 \tSource:     If so , you would be worthy of death .\n","2020-05-21 20:48:59,069 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 20:48:59,069 \tHypothesis: Sɛ ɛte saa a , wubewu .\n","2020-05-21 20:48:59,069 Example #2\n","2020-05-21 20:48:59,069 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 20:48:59,070 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 20:48:59,070 \tHypothesis: Hwɛ sɛnea ɔsomafo Yohane nyaa anisoadehu a ɛyɛ hu yi ho anisoadehu a ɛyɛ hu !\n","2020-05-21 20:48:59,070 Example #3\n","2020-05-21 20:48:59,070 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 20:48:59,070 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 20:48:59,070 \tHypothesis: Ná Yesu wɔ nkate fam , na ohia mmoa , nanso Petro ne afoforo no daa adi pefee .\n","2020-05-21 20:48:59,070 Validation result (greedy) at epoch   6, step    33000: bleu:  22.80, loss: 47036.3672, ppl:   5.9254, duration: 13.6240s\n","2020-05-21 20:49:09,952 Epoch   6 Step:    33100 Batch Loss:     2.266930 Tokens per Sec:    22470, Lr: 0.000300\n","2020-05-21 20:49:20,693 Epoch   6 Step:    33200 Batch Loss:     1.665410 Tokens per Sec:    22200, Lr: 0.000300\n","2020-05-21 20:49:31,586 Epoch   6 Step:    33300 Batch Loss:     2.056847 Tokens per Sec:    22097, Lr: 0.000300\n","2020-05-21 20:49:42,431 Epoch   6 Step:    33400 Batch Loss:     1.988657 Tokens per Sec:    21760, Lr: 0.000300\n","2020-05-21 20:49:53,171 Epoch   6 Step:    33500 Batch Loss:     2.148526 Tokens per Sec:    22118, Lr: 0.000300\n","2020-05-21 20:50:03,869 Epoch   6 Step:    33600 Batch Loss:     1.929891 Tokens per Sec:    22151, Lr: 0.000300\n","2020-05-21 20:50:14,604 Epoch   6 Step:    33700 Batch Loss:     1.839728 Tokens per Sec:    21732, Lr: 0.000300\n","2020-05-21 20:50:25,384 Epoch   6 Step:    33800 Batch Loss:     2.130099 Tokens per Sec:    22315, Lr: 0.000300\n","2020-05-21 20:50:36,211 Epoch   6 Step:    33900 Batch Loss:     2.123720 Tokens per Sec:    22088, Lr: 0.000300\n","2020-05-21 20:50:46,980 Epoch   6 Step:    34000 Batch Loss:     1.975439 Tokens per Sec:    22001, Lr: 0.000300\n","2020-05-21 20:50:59,808 Hooray! New best validation result [ppl]!\n","2020-05-21 20:50:59,808 Saving new checkpoint.\n","2020-05-21 20:51:00,067 Example #0\n","2020-05-21 20:51:00,067 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 20:51:00,067 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 20:51:00,067 \tHypothesis: Nsɛm a ɛtete saa maa tete ahoni no nyaa ahosodi ne amanne .\n","2020-05-21 20:51:00,068 Example #1\n","2020-05-21 20:51:00,068 \tSource:     If so , you would be worthy of death .\n","2020-05-21 20:51:00,068 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 20:51:00,068 \tHypothesis: Sɛ saa a , anka wubewu .\n","2020-05-21 20:51:00,068 Example #2\n","2020-05-21 20:51:00,068 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 20:51:00,068 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 20:51:00,068 \tHypothesis: Hwɛ sɛnea ɔsomafo Yohane nyaa anisoadehu a ɛyɛ nwonwa yi ho anisoadehu a ɛyɛ nwonwa !\n","2020-05-21 20:51:00,068 Example #3\n","2020-05-21 20:51:00,068 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 20:51:00,068 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 20:51:00,068 \tHypothesis: Ná Yesu wɔ nkate fam ne hia a ehia sɛ ɔboa no , nanso Petro ne afoforo no da so ara da .\n","2020-05-21 20:51:00,069 Validation result (greedy) at epoch   6, step    34000: bleu:  22.91, loss: 46815.8555, ppl:   5.8762, duration: 13.0878s\n","2020-05-21 20:51:10,921 Epoch   6 Step:    34100 Batch Loss:     2.030265 Tokens per Sec:    22416, Lr: 0.000300\n","2020-05-21 20:51:21,700 Epoch   6 Step:    34200 Batch Loss:     1.842445 Tokens per Sec:    22085, Lr: 0.000300\n","2020-05-21 20:51:32,512 Epoch   6 Step:    34300 Batch Loss:     2.266333 Tokens per Sec:    22148, Lr: 0.000300\n","2020-05-21 20:51:43,200 Epoch   6 Step:    34400 Batch Loss:     1.976704 Tokens per Sec:    21905, Lr: 0.000300\n","2020-05-21 20:51:54,010 Epoch   6 Step:    34500 Batch Loss:     2.099412 Tokens per Sec:    22327, Lr: 0.000300\n","2020-05-21 20:52:04,833 Epoch   6 Step:    34600 Batch Loss:     2.327076 Tokens per Sec:    22111, Lr: 0.000300\n","2020-05-21 20:52:15,579 Epoch   6 Step:    34700 Batch Loss:     2.077675 Tokens per Sec:    21722, Lr: 0.000300\n","2020-05-21 20:52:26,406 Epoch   6 Step:    34800 Batch Loss:     1.726948 Tokens per Sec:    22181, Lr: 0.000300\n","2020-05-21 20:52:37,219 Epoch   6 Step:    34900 Batch Loss:     2.138126 Tokens per Sec:    21750, Lr: 0.000300\n","2020-05-21 20:52:48,078 Epoch   6 Step:    35000 Batch Loss:     2.120733 Tokens per Sec:    22053, Lr: 0.000300\n","2020-05-21 20:53:00,341 Hooray! New best validation result [ppl]!\n","2020-05-21 20:53:00,341 Saving new checkpoint.\n","2020-05-21 20:53:00,574 Example #0\n","2020-05-21 20:53:00,574 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 20:53:00,574 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 20:53:00,574 \tHypothesis: Nsɛm a ɛte saa maa tete ahoni no nyaa ahokyere ne aniberesɛm .\n","2020-05-21 20:53:00,574 Example #1\n","2020-05-21 20:53:00,574 \tSource:     If so , you would be worthy of death .\n","2020-05-21 20:53:00,575 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 20:53:00,575 \tHypothesis: Sɛ saa a , anka wobɛfata sɛ wuwu .\n","2020-05-21 20:53:00,575 Example #2\n","2020-05-21 20:53:00,575 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 20:53:00,575 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 20:53:00,575 \tHypothesis: Hwɛ sɛnea ɔsomafo Yohane nyaa anisoadehu a ɛyɛ hu yi ho anisoadehu kɛse yi !\n","2020-05-21 20:53:00,575 Example #3\n","2020-05-21 20:53:00,575 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 20:53:00,575 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 20:53:00,575 \tHypothesis: Ná Yesu wɔ nkate fam ne mmoa , nanso Petro ne afoforo no da so ara da .\n","2020-05-21 20:53:00,575 Validation result (greedy) at epoch   6, step    35000: bleu:  23.03, loss: 46446.9141, ppl:   5.7948, duration: 12.4967s\n","2020-05-21 20:53:11,393 Epoch   6 Step:    35100 Batch Loss:     1.719507 Tokens per Sec:    21981, Lr: 0.000300\n","2020-05-21 20:53:22,252 Epoch   6 Step:    35200 Batch Loss:     2.074207 Tokens per Sec:    22501, Lr: 0.000300\n","2020-05-21 20:53:33,068 Epoch   6 Step:    35300 Batch Loss:     2.089633 Tokens per Sec:    21962, Lr: 0.000300\n","2020-05-21 20:53:43,919 Epoch   6 Step:    35400 Batch Loss:     1.928434 Tokens per Sec:    22579, Lr: 0.000300\n","2020-05-21 20:53:54,723 Epoch   6 Step:    35500 Batch Loss:     2.124056 Tokens per Sec:    21873, Lr: 0.000300\n","2020-05-21 20:54:05,336 Epoch   6 Step:    35600 Batch Loss:     1.862241 Tokens per Sec:    21652, Lr: 0.000300\n","2020-05-21 20:54:16,168 Epoch   6 Step:    35700 Batch Loss:     2.007133 Tokens per Sec:    21965, Lr: 0.000300\n","2020-05-21 20:54:26,979 Epoch   6 Step:    35800 Batch Loss:     1.810417 Tokens per Sec:    22421, Lr: 0.000300\n","2020-05-21 20:54:37,675 Epoch   6 Step:    35900 Batch Loss:     2.020769 Tokens per Sec:    22009, Lr: 0.000300\n","2020-05-21 20:54:48,481 Epoch   6 Step:    36000 Batch Loss:     2.008993 Tokens per Sec:    22134, Lr: 0.000300\n","2020-05-21 20:55:01,357 Hooray! New best validation result [ppl]!\n","2020-05-21 20:55:01,357 Saving new checkpoint.\n","2020-05-21 20:55:01,599 Example #0\n","2020-05-21 20:55:01,599 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 20:55:01,600 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 20:55:01,600 \tHypothesis: Nsɛm a ɛte saa maa tete ahoni no nyaa adwene sɛ wɔbɛkɔ so ayɛ wɔn basabasa .\n","2020-05-21 20:55:01,600 Example #1\n","2020-05-21 20:55:01,600 \tSource:     If so , you would be worthy of death .\n","2020-05-21 20:55:01,600 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 20:55:01,600 \tHypothesis: Sɛ saa a , anka wubewu .\n","2020-05-21 20:55:01,600 Example #2\n","2020-05-21 20:55:01,600 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 20:55:01,600 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 20:55:01,600 \tHypothesis: Oo , hwɛ sɛnea ɔsomafo Yohane huu nnipakuw kɛse no anisoadehu a ɛyɛ hu yi !\n","2020-05-21 20:55:01,600 Example #3\n","2020-05-21 20:55:01,601 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 20:55:01,601 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 20:55:01,601 \tHypothesis: Ná Yesu wɔ nkate fam , na na ohia mmoa , nanso Petro ne afoforo no da so ara da .\n","2020-05-21 20:55:01,601 Validation result (greedy) at epoch   6, step    36000: bleu:  23.28, loss: 46170.6914, ppl:   5.7345, duration: 13.1193s\n","2020-05-21 20:55:12,493 Epoch   6 Step:    36100 Batch Loss:     2.093529 Tokens per Sec:    22242, Lr: 0.000300\n","2020-05-21 20:55:23,330 Epoch   6 Step:    36200 Batch Loss:     1.881746 Tokens per Sec:    22107, Lr: 0.000300\n","2020-05-21 20:55:34,104 Epoch   6 Step:    36300 Batch Loss:     1.871380 Tokens per Sec:    22381, Lr: 0.000300\n","2020-05-21 20:55:36,088 Epoch   6: total training loss 12038.94\n","2020-05-21 20:55:36,088 EPOCH 7\n","2020-05-21 20:55:45,624 Epoch   7 Step:    36400 Batch Loss:     2.164080 Tokens per Sec:    20323, Lr: 0.000300\n","2020-05-21 20:55:56,388 Epoch   7 Step:    36500 Batch Loss:     2.007117 Tokens per Sec:    22320, Lr: 0.000300\n","2020-05-21 20:56:07,096 Epoch   7 Step:    36600 Batch Loss:     1.771942 Tokens per Sec:    22125, Lr: 0.000300\n","2020-05-21 20:56:17,956 Epoch   7 Step:    36700 Batch Loss:     1.822039 Tokens per Sec:    22215, Lr: 0.000300\n","2020-05-21 20:56:28,738 Epoch   7 Step:    36800 Batch Loss:     2.272600 Tokens per Sec:    22235, Lr: 0.000300\n","2020-05-21 20:56:39,586 Epoch   7 Step:    36900 Batch Loss:     1.959614 Tokens per Sec:    22224, Lr: 0.000300\n","2020-05-21 20:56:50,416 Epoch   7 Step:    37000 Batch Loss:     2.071926 Tokens per Sec:    22281, Lr: 0.000300\n","2020-05-21 20:57:03,811 Hooray! New best validation result [ppl]!\n","2020-05-21 20:57:03,811 Saving new checkpoint.\n","2020-05-21 20:57:04,042 Example #0\n","2020-05-21 20:57:04,042 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 20:57:04,042 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 20:57:04,042 \tHypothesis: Nsɛm a ɛtete saa maa tete nneɛma a na ɛyɛ hu a na ɛyɛ den sɛ wɔbɛkɔ so ayɛ adwuma na wɔabu wɔn ani agu so .\n","2020-05-21 20:57:04,042 Example #1\n","2020-05-21 20:57:04,043 \tSource:     If so , you would be worthy of death .\n","2020-05-21 20:57:04,043 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 20:57:04,043 \tHypothesis: Sɛ saa a , anka wubewu .\n","2020-05-21 20:57:04,043 Example #2\n","2020-05-21 20:57:04,043 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 20:57:04,043 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 20:57:04,043 \tHypothesis: Oh , hwɛ sɛnea ɔsomafo Yohane huu nnipakuw kɛse no anisoadehu a ɛyɛ hu yi !\n","2020-05-21 20:57:04,043 Example #3\n","2020-05-21 20:57:04,043 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 20:57:04,043 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 20:57:04,043 \tHypothesis: Ná Yesu wɔ nkate fam , na na ohia mmoa , nanso Petro ne afoforo no daa .\n","2020-05-21 20:57:04,043 Validation result (greedy) at epoch   7, step    37000: bleu:  23.31, loss: 46064.5117, ppl:   5.7116, duration: 13.6267s\n","2020-05-21 20:57:14,867 Epoch   7 Step:    37100 Batch Loss:     2.148548 Tokens per Sec:    22264, Lr: 0.000300\n","2020-05-21 20:57:25,662 Epoch   7 Step:    37200 Batch Loss:     1.719895 Tokens per Sec:    22335, Lr: 0.000300\n","2020-05-21 20:57:36,408 Epoch   7 Step:    37300 Batch Loss:     1.964990 Tokens per Sec:    22076, Lr: 0.000300\n","2020-05-21 20:57:47,196 Epoch   7 Step:    37400 Batch Loss:     2.053929 Tokens per Sec:    21995, Lr: 0.000300\n","2020-05-21 20:57:58,099 Epoch   7 Step:    37500 Batch Loss:     2.111418 Tokens per Sec:    22464, Lr: 0.000300\n","2020-05-21 20:58:08,823 Epoch   7 Step:    37600 Batch Loss:     1.735331 Tokens per Sec:    22173, Lr: 0.000300\n","2020-05-21 20:58:19,556 Epoch   7 Step:    37700 Batch Loss:     1.949342 Tokens per Sec:    22182, Lr: 0.000300\n","2020-05-21 20:58:30,347 Epoch   7 Step:    37800 Batch Loss:     1.646136 Tokens per Sec:    22123, Lr: 0.000300\n","2020-05-21 20:58:41,033 Epoch   7 Step:    37900 Batch Loss:     2.216803 Tokens per Sec:    21976, Lr: 0.000300\n","2020-05-21 20:58:51,802 Epoch   7 Step:    38000 Batch Loss:     2.031726 Tokens per Sec:    22089, Lr: 0.000300\n","2020-05-21 20:59:04,956 Hooray! New best validation result [ppl]!\n","2020-05-21 20:59:04,956 Saving new checkpoint.\n","2020-05-21 20:59:05,223 Example #0\n","2020-05-21 20:59:05,224 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 20:59:05,224 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 20:59:05,224 \tHypothesis: Nsɛm a ɛte saa maa tete nneɛma a na ɛyɛ hu a na ɛyɛ hu a na ɛyɛ den na ɛyɛ anika .\n","2020-05-21 20:59:05,224 Example #1\n","2020-05-21 20:59:05,224 \tSource:     If so , you would be worthy of death .\n","2020-05-21 20:59:05,224 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 20:59:05,224 \tHypothesis: Sɛ saa a , anka wobɛfata sɛ wuwu .\n","2020-05-21 20:59:05,224 Example #2\n","2020-05-21 20:59:05,224 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 20:59:05,224 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 20:59:05,224 \tHypothesis: Oh , hwɛ sɛnea ɔsomafo Yohane huu nnipakuw kɛse no anisoadehu a ɛyɛ hu yi !\n","2020-05-21 20:59:05,224 Example #3\n","2020-05-21 20:59:05,225 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 20:59:05,225 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 20:59:05,225 \tHypothesis: Ná Yesu wɔ nkate fam ne mmoa a ehia , nanso Petro ne afoforo no daa so ara da .\n","2020-05-21 20:59:05,225 Validation result (greedy) at epoch   7, step    38000: bleu:  23.45, loss: 45972.4492, ppl:   5.6917, duration: 13.4229s\n","2020-05-21 20:59:15,988 Epoch   7 Step:    38100 Batch Loss:     1.651605 Tokens per Sec:    22543, Lr: 0.000300\n","2020-05-21 20:59:26,823 Epoch   7 Step:    38200 Batch Loss:     1.707977 Tokens per Sec:    22242, Lr: 0.000300\n","2020-05-21 20:59:37,613 Epoch   7 Step:    38300 Batch Loss:     1.848531 Tokens per Sec:    22041, Lr: 0.000300\n","2020-05-21 20:59:48,378 Epoch   7 Step:    38400 Batch Loss:     2.030581 Tokens per Sec:    21964, Lr: 0.000300\n","2020-05-21 20:59:59,302 Epoch   7 Step:    38500 Batch Loss:     1.673377 Tokens per Sec:    22265, Lr: 0.000300\n","2020-05-21 21:00:10,022 Epoch   7 Step:    38600 Batch Loss:     2.147644 Tokens per Sec:    21840, Lr: 0.000300\n","2020-05-21 21:00:20,814 Epoch   7 Step:    38700 Batch Loss:     1.901756 Tokens per Sec:    22176, Lr: 0.000300\n","2020-05-21 21:00:31,560 Epoch   7 Step:    38800 Batch Loss:     1.868076 Tokens per Sec:    21971, Lr: 0.000300\n","2020-05-21 21:00:42,432 Epoch   7 Step:    38900 Batch Loss:     1.856781 Tokens per Sec:    22499, Lr: 0.000300\n","2020-05-21 21:00:53,157 Epoch   7 Step:    39000 Batch Loss:     1.831660 Tokens per Sec:    21799, Lr: 0.000300\n","2020-05-21 21:01:06,576 Hooray! New best validation result [ppl]!\n","2020-05-21 21:01:06,576 Saving new checkpoint.\n","2020-05-21 21:01:06,806 Example #0\n","2020-05-21 21:01:06,806 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 21:01:06,806 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 21:01:06,806 \tHypothesis: Nsɛm a ɛte saa maa tete nneɛma a na ɛyɛ hu a na ɛyɛ den sɛ wɔbɛhyɛ wɔn den na wɔabu wɔn ani agu so .\n","2020-05-21 21:01:06,806 Example #1\n","2020-05-21 21:01:06,806 \tSource:     If so , you would be worthy of death .\n","2020-05-21 21:01:06,806 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 21:01:06,806 \tHypothesis: Sɛ saa a , anka wobɛfata sɛ wuwu .\n","2020-05-21 21:01:06,806 Example #2\n","2020-05-21 21:01:06,807 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 21:01:06,807 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 21:01:06,807 \tHypothesis: Hwɛ sɛnea ɔsomafo Yohane ani gyei bere a ohui sɛ nnipakuw kɛse no anisoadehu a ɛyɛ nwonwa yi rehu no !\n","2020-05-21 21:01:06,807 Example #3\n","2020-05-21 21:01:06,807 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 21:01:06,807 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 21:01:06,807 \tHypothesis: Ná Yesu wɔ nkate fam ahokyere ne mmoa , nanso Petro ne afoforo no da so ara da .\n","2020-05-21 21:01:06,807 Validation result (greedy) at epoch   7, step    39000: bleu:  23.20, loss: 45646.3672, ppl:   5.6219, duration: 13.6495s\n","2020-05-21 21:01:17,616 Epoch   7 Step:    39100 Batch Loss:     1.774203 Tokens per Sec:    22199, Lr: 0.000300\n","2020-05-21 21:01:28,395 Epoch   7 Step:    39200 Batch Loss:     2.000518 Tokens per Sec:    22079, Lr: 0.000300\n","2020-05-21 21:01:39,182 Epoch   7 Step:    39300 Batch Loss:     1.923680 Tokens per Sec:    22023, Lr: 0.000300\n","2020-05-21 21:01:50,004 Epoch   7 Step:    39400 Batch Loss:     1.857467 Tokens per Sec:    22410, Lr: 0.000300\n","2020-05-21 21:02:00,813 Epoch   7 Step:    39500 Batch Loss:     1.780759 Tokens per Sec:    22072, Lr: 0.000300\n","2020-05-21 21:02:11,650 Epoch   7 Step:    39600 Batch Loss:     1.945573 Tokens per Sec:    22246, Lr: 0.000300\n","2020-05-21 21:02:22,355 Epoch   7 Step:    39700 Batch Loss:     2.003506 Tokens per Sec:    21816, Lr: 0.000300\n","2020-05-21 21:02:33,115 Epoch   7 Step:    39800 Batch Loss:     2.007060 Tokens per Sec:    22266, Lr: 0.000300\n","2020-05-21 21:02:43,949 Epoch   7 Step:    39900 Batch Loss:     2.071754 Tokens per Sec:    22247, Lr: 0.000300\n","2020-05-21 21:02:54,701 Epoch   7 Step:    40000 Batch Loss:     2.027560 Tokens per Sec:    22259, Lr: 0.000300\n","2020-05-21 21:03:07,287 Hooray! New best validation result [ppl]!\n","2020-05-21 21:03:07,287 Saving new checkpoint.\n","2020-05-21 21:03:07,544 Example #0\n","2020-05-21 21:03:07,545 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 21:03:07,545 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 21:03:07,545 \tHypothesis: Nsɛm a ɛte saa maa tete ahoni no nyaa ahomegye ne amanne .\n","2020-05-21 21:03:07,545 Example #1\n","2020-05-21 21:03:07,545 \tSource:     If so , you would be worthy of death .\n","2020-05-21 21:03:07,545 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 21:03:07,545 \tHypothesis: Sɛ saa a , anka wobɛfata sɛ wuwu .\n","2020-05-21 21:03:07,545 Example #2\n","2020-05-21 21:03:07,545 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 21:03:07,545 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 21:03:07,546 \tHypothesis: Oh , hwɛ sɛnea ɔsomafo Yohane huu nnipakuw kɛse no anisoadehu a ɛyɛ hu yi !\n","2020-05-21 21:03:07,546 Example #3\n","2020-05-21 21:03:07,546 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 21:03:07,546 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 21:03:07,546 \tHypothesis: Ná Yesu wɔ nkate fam , na na ohia mmoa , nanso Petro ne afoforo no da so ara da .\n","2020-05-21 21:03:07,546 Validation result (greedy) at epoch   7, step    40000: bleu:  23.83, loss: 45530.0742, ppl:   5.5972, duration: 12.8449s\n","2020-05-21 21:03:18,318 Epoch   7 Step:    40100 Batch Loss:     1.822171 Tokens per Sec:    21830, Lr: 0.000300\n","2020-05-21 21:03:29,138 Epoch   7 Step:    40200 Batch Loss:     1.720566 Tokens per Sec:    22221, Lr: 0.000300\n","2020-05-21 21:03:39,868 Epoch   7 Step:    40300 Batch Loss:     1.828958 Tokens per Sec:    22121, Lr: 0.000300\n","2020-05-21 21:03:50,749 Epoch   7 Step:    40400 Batch Loss:     1.837891 Tokens per Sec:    22696, Lr: 0.000300\n","2020-05-21 21:04:01,574 Epoch   7 Step:    40500 Batch Loss:     2.456938 Tokens per Sec:    22653, Lr: 0.000300\n","2020-05-21 21:04:12,350 Epoch   7 Step:    40600 Batch Loss:     1.949815 Tokens per Sec:    22200, Lr: 0.000300\n","2020-05-21 21:04:23,113 Epoch   7 Step:    40700 Batch Loss:     2.036666 Tokens per Sec:    22363, Lr: 0.000300\n","2020-05-21 21:04:33,954 Epoch   7 Step:    40800 Batch Loss:     1.665251 Tokens per Sec:    22128, Lr: 0.000300\n","2020-05-21 21:04:44,738 Epoch   7 Step:    40900 Batch Loss:     2.021648 Tokens per Sec:    22542, Lr: 0.000300\n","2020-05-21 21:04:55,482 Epoch   7 Step:    41000 Batch Loss:     2.047648 Tokens per Sec:    21928, Lr: 0.000300\n","2020-05-21 21:05:07,739 Hooray! New best validation result [ppl]!\n","2020-05-21 21:05:07,740 Saving new checkpoint.\n","2020-05-21 21:05:07,982 Example #0\n","2020-05-21 21:05:07,982 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 21:05:07,982 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 21:05:07,983 \tHypothesis: Nsɛm a ɛtete saa maa tete ahoni no nyaa ahomegye ne amanne .\n","2020-05-21 21:05:07,983 Example #1\n","2020-05-21 21:05:07,983 \tSource:     If so , you would be worthy of death .\n","2020-05-21 21:05:07,983 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 21:05:07,983 \tHypothesis: Sɛ saa a , anka wubewu .\n","2020-05-21 21:05:07,983 Example #2\n","2020-05-21 21:05:07,983 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 21:05:07,983 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 21:05:07,983 \tHypothesis: Oh , hwɛ sɛnea ɔsomafo Yohane huu nnipakuw kɛse no anisoadehu a ɛyɛ hu yi !\n","2020-05-21 21:05:07,983 Example #3\n","2020-05-21 21:05:07,983 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 21:05:07,983 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 21:05:07,984 \tHypothesis: Ná Yesu wɔ nkate fam , na na ohia mmoa , nanso Petro ne afoforo no daa adi mpɛn pii .\n","2020-05-21 21:05:07,984 Validation result (greedy) at epoch   7, step    41000: bleu:  24.05, loss: 45320.1289, ppl:   5.5530, duration: 12.5013s\n","2020-05-21 21:05:18,892 Epoch   7 Step:    41100 Batch Loss:     2.046256 Tokens per Sec:    21275, Lr: 0.000300\n","2020-05-21 21:05:29,739 Epoch   7 Step:    41200 Batch Loss:     1.844762 Tokens per Sec:    22291, Lr: 0.000300\n","2020-05-21 21:05:40,569 Epoch   7 Step:    41300 Batch Loss:     1.819583 Tokens per Sec:    21895, Lr: 0.000300\n","2020-05-21 21:05:51,270 Epoch   7 Step:    41400 Batch Loss:     1.814587 Tokens per Sec:    21753, Lr: 0.000300\n","2020-05-21 21:06:02,004 Epoch   7 Step:    41500 Batch Loss:     2.072147 Tokens per Sec:    22086, Lr: 0.000300\n","2020-05-21 21:06:12,741 Epoch   7 Step:    41600 Batch Loss:     1.934547 Tokens per Sec:    22031, Lr: 0.000300\n","2020-05-21 21:06:23,471 Epoch   7 Step:    41700 Batch Loss:     2.158408 Tokens per Sec:    21949, Lr: 0.000300\n","2020-05-21 21:06:34,193 Epoch   7 Step:    41800 Batch Loss:     1.761230 Tokens per Sec:    22225, Lr: 0.000300\n","2020-05-21 21:06:44,890 Epoch   7 Step:    41900 Batch Loss:     1.994507 Tokens per Sec:    22407, Lr: 0.000300\n","2020-05-21 21:06:55,705 Epoch   7 Step:    42000 Batch Loss:     2.059717 Tokens per Sec:    22157, Lr: 0.000300\n","2020-05-21 21:07:07,748 Hooray! New best validation result [ppl]!\n","2020-05-21 21:07:07,748 Saving new checkpoint.\n","2020-05-21 21:07:07,978 Example #0\n","2020-05-21 21:07:07,978 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 21:07:07,979 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 21:07:07,979 \tHypothesis: Nsɛm a ɛtete saa maa tete nneɛma a na ɛyɛ hu a na ɛyɛ hu sɛ wɔresisi wɔn ani so na wɔyɛ nsi .\n","2020-05-21 21:07:07,979 Example #1\n","2020-05-21 21:07:07,979 \tSource:     If so , you would be worthy of death .\n","2020-05-21 21:07:07,979 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 21:07:07,979 \tHypothesis: Sɛ saa a , anka wubewu .\n","2020-05-21 21:07:07,979 Example #2\n","2020-05-21 21:07:07,979 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 21:07:07,979 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 21:07:07,979 \tHypothesis: Hwɛ sɛnea ɔsomafo Yohane huu anisoadehu a ɛyɛ nwonwa yi !\n","2020-05-21 21:07:07,979 Example #3\n","2020-05-21 21:07:07,980 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 21:07:07,980 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 21:07:07,980 \tHypothesis: Ná Yesu wɔ nkate fam ahokyere ne hia mu , nanso Petro ne afoforo no da so ara da .\n","2020-05-21 21:07:07,980 Validation result (greedy) at epoch   7, step    42000: bleu:  23.95, loss: 45291.0312, ppl:   5.5469, duration: 12.2748s\n","2020-05-21 21:07:18,851 Epoch   7 Step:    42100 Batch Loss:     1.936538 Tokens per Sec:    22242, Lr: 0.000300\n","2020-05-21 21:07:29,673 Epoch   7 Step:    42200 Batch Loss:     1.940256 Tokens per Sec:    22223, Lr: 0.000300\n","2020-05-21 21:07:40,459 Epoch   7 Step:    42300 Batch Loss:     1.813453 Tokens per Sec:    21881, Lr: 0.000300\n","2020-05-21 21:07:48,094 Epoch   7: total training loss 11696.03\n","2020-05-21 21:07:48,095 EPOCH 8\n","2020-05-21 21:07:51,971 Epoch   8 Step:    42400 Batch Loss:     1.853057 Tokens per Sec:    17874, Lr: 0.000300\n","2020-05-21 21:08:02,781 Epoch   8 Step:    42500 Batch Loss:     1.823998 Tokens per Sec:    22445, Lr: 0.000300\n","2020-05-21 21:08:13,536 Epoch   8 Step:    42600 Batch Loss:     2.043802 Tokens per Sec:    22287, Lr: 0.000300\n","2020-05-21 21:08:24,307 Epoch   8 Step:    42700 Batch Loss:     1.476813 Tokens per Sec:    22185, Lr: 0.000300\n","2020-05-21 21:08:35,028 Epoch   8 Step:    42800 Batch Loss:     1.921837 Tokens per Sec:    22273, Lr: 0.000300\n","2020-05-21 21:08:45,694 Epoch   8 Step:    42900 Batch Loss:     2.476961 Tokens per Sec:    22074, Lr: 0.000300\n","2020-05-21 21:08:56,437 Epoch   8 Step:    43000 Batch Loss:     1.976154 Tokens per Sec:    22066, Lr: 0.000300\n","2020-05-21 21:09:08,330 Hooray! New best validation result [ppl]!\n","2020-05-21 21:09:08,331 Saving new checkpoint.\n","2020-05-21 21:09:08,597 Example #0\n","2020-05-21 21:09:08,597 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 21:09:08,597 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 21:09:08,597 \tHypothesis: Nsɛm a ɛtete saa maa tete nneɛma a na wɔagye din no nyaa nkɔso ne amanne .\n","2020-05-21 21:09:08,597 Example #1\n","2020-05-21 21:09:08,598 \tSource:     If so , you would be worthy of death .\n","2020-05-21 21:09:08,598 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 21:09:08,598 \tHypothesis: Sɛ saa a , wubewu .\n","2020-05-21 21:09:08,598 Example #2\n","2020-05-21 21:09:08,598 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 21:09:08,598 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 21:09:08,598 \tHypothesis: Hwɛ sɛnea ɔsomafo Yohane nyaa anigye kɛse wɔ nnipakuw kɛse no anisoadehu a ɛyɛ hu yi mu !\n","2020-05-21 21:09:08,598 Example #3\n","2020-05-21 21:09:08,598 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 21:09:08,598 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 21:09:08,598 \tHypothesis: Ná Yesu wɔ nkate fam ahokyere ne hia mu , nanso Petro ne afoforo no da so ara da .\n","2020-05-21 21:09:08,598 Validation result (greedy) at epoch   8, step    43000: bleu:  24.02, loss: 45072.3242, ppl:   5.5012, duration: 12.1613s\n","2020-05-21 21:09:19,379 Epoch   8 Step:    43100 Batch Loss:     2.079955 Tokens per Sec:    22326, Lr: 0.000300\n","2020-05-21 21:09:30,146 Epoch   8 Step:    43200 Batch Loss:     1.691426 Tokens per Sec:    22049, Lr: 0.000300\n","2020-05-21 21:09:41,003 Epoch   8 Step:    43300 Batch Loss:     1.733198 Tokens per Sec:    22224, Lr: 0.000300\n","2020-05-21 21:09:51,824 Epoch   8 Step:    43400 Batch Loss:     1.966528 Tokens per Sec:    22779, Lr: 0.000300\n","2020-05-21 21:10:02,487 Epoch   8 Step:    43500 Batch Loss:     2.036931 Tokens per Sec:    21926, Lr: 0.000300\n","2020-05-21 21:10:13,336 Epoch   8 Step:    43600 Batch Loss:     1.840119 Tokens per Sec:    22032, Lr: 0.000300\n","2020-05-21 21:10:24,226 Epoch   8 Step:    43700 Batch Loss:     1.974767 Tokens per Sec:    22139, Lr: 0.000300\n","2020-05-21 21:10:35,006 Epoch   8 Step:    43800 Batch Loss:     1.770539 Tokens per Sec:    22223, Lr: 0.000300\n","2020-05-21 21:10:45,839 Epoch   8 Step:    43900 Batch Loss:     1.772755 Tokens per Sec:    22391, Lr: 0.000300\n","2020-05-21 21:10:56,694 Epoch   8 Step:    44000 Batch Loss:     1.879773 Tokens per Sec:    22194, Lr: 0.000300\n","2020-05-21 21:11:09,367 Hooray! New best validation result [ppl]!\n","2020-05-21 21:11:09,368 Saving new checkpoint.\n","2020-05-21 21:11:09,611 Example #0\n","2020-05-21 21:11:09,612 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 21:11:09,612 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 21:11:09,612 \tHypothesis: Nsɛm a ɛtete saa no maa tete nneɛma a na ɛyɛ den sɛ wɔbɛkɔ so ayɛ den na wɔabu wɔn ani agu so .\n","2020-05-21 21:11:09,612 Example #1\n","2020-05-21 21:11:09,612 \tSource:     If so , you would be worthy of death .\n","2020-05-21 21:11:09,612 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 21:11:09,612 \tHypothesis: Sɛ saa a , anka wobɛfata sɛ wuwu .\n","2020-05-21 21:11:09,612 Example #2\n","2020-05-21 21:11:09,612 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 21:11:09,612 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 21:11:09,612 \tHypothesis: Oh , hwɛ sɛnea ɔsomafo Yohane huu nnipakuw kɛse no anisoadehu a ɛyɛ hu yi !\n","2020-05-21 21:11:09,613 Example #3\n","2020-05-21 21:11:09,613 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 21:11:09,613 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 21:11:09,613 \tHypothesis: Ná Yesu wɔ nkate fam ne hia a ehia sɛ ɔboa no , nanso Petro ne afoforo no daa adi mpɛn pii .\n","2020-05-21 21:11:09,613 Validation result (greedy) at epoch   8, step    44000: bleu:  24.07, loss: 44780.2383, ppl:   5.4407, duration: 12.9190s\n","2020-05-21 21:11:20,440 Epoch   8 Step:    44100 Batch Loss:     2.325165 Tokens per Sec:    22035, Lr: 0.000300\n","2020-05-21 21:11:31,252 Epoch   8 Step:    44200 Batch Loss:     2.080871 Tokens per Sec:    22190, Lr: 0.000300\n","2020-05-21 21:11:41,939 Epoch   8 Step:    44300 Batch Loss:     2.035164 Tokens per Sec:    21895, Lr: 0.000300\n","2020-05-21 21:11:52,734 Epoch   8 Step:    44400 Batch Loss:     1.733613 Tokens per Sec:    22145, Lr: 0.000300\n","2020-05-21 21:12:03,511 Epoch   8 Step:    44500 Batch Loss:     1.888944 Tokens per Sec:    22328, Lr: 0.000300\n","2020-05-21 21:12:14,252 Epoch   8 Step:    44600 Batch Loss:     1.957755 Tokens per Sec:    21746, Lr: 0.000300\n","2020-05-21 21:12:25,015 Epoch   8 Step:    44700 Batch Loss:     1.866936 Tokens per Sec:    21971, Lr: 0.000300\n","2020-05-21 21:12:35,798 Epoch   8 Step:    44800 Batch Loss:     2.357099 Tokens per Sec:    22101, Lr: 0.000300\n","2020-05-21 21:12:46,501 Epoch   8 Step:    44900 Batch Loss:     1.728834 Tokens per Sec:    21911, Lr: 0.000300\n","2020-05-21 21:12:57,290 Epoch   8 Step:    45000 Batch Loss:     2.062426 Tokens per Sec:    22389, Lr: 0.000300\n","2020-05-21 21:13:09,747 Hooray! New best validation result [ppl]!\n","2020-05-21 21:13:09,747 Saving new checkpoint.\n","2020-05-21 21:13:10,002 Example #0\n","2020-05-21 21:13:10,002 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 21:13:10,002 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 21:13:10,002 \tHypothesis: Nsɛm a ɛtete saa maa tete nneɛma a na wɔhwehwɛ sɛ wɔyɛ wɔn ade na wɔyɛ wɔn ade wɔ amannɔne no ho .\n","2020-05-21 21:13:10,002 Example #1\n","2020-05-21 21:13:10,002 \tSource:     If so , you would be worthy of death .\n","2020-05-21 21:13:10,002 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 21:13:10,002 \tHypothesis: Sɛ saa a , wubewu .\n","2020-05-21 21:13:10,002 Example #2\n","2020-05-21 21:13:10,002 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 21:13:10,003 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 21:13:10,003 \tHypothesis: Oh , hwɛ sɛnea ɔsomafo Yohane huu nnipakuw kɛse no anisoadehu a ɛyɛ hu yi !\n","2020-05-21 21:13:10,003 Example #3\n","2020-05-21 21:13:10,003 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 21:13:10,003 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 21:13:10,003 \tHypothesis: Ná Yesu wɔ nkate fam , na ohia mmoa , nanso Petro ne afoforo no daa .\n","2020-05-21 21:13:10,003 Validation result (greedy) at epoch   8, step    45000: bleu:  24.25, loss: 44677.6211, ppl:   5.4196, duration: 12.7129s\n","2020-05-21 21:13:20,915 Epoch   8 Step:    45100 Batch Loss:     2.170984 Tokens per Sec:    21844, Lr: 0.000300\n","2020-05-21 21:13:31,565 Epoch   8 Step:    45200 Batch Loss:     2.020337 Tokens per Sec:    22089, Lr: 0.000300\n","2020-05-21 21:13:42,261 Epoch   8 Step:    45300 Batch Loss:     1.685860 Tokens per Sec:    21960, Lr: 0.000300\n","2020-05-21 21:13:52,889 Epoch   8 Step:    45400 Batch Loss:     1.790694 Tokens per Sec:    21821, Lr: 0.000300\n","2020-05-21 21:14:03,713 Epoch   8 Step:    45500 Batch Loss:     2.071634 Tokens per Sec:    22355, Lr: 0.000300\n","2020-05-21 21:14:14,450 Epoch   8 Step:    45600 Batch Loss:     1.977427 Tokens per Sec:    22282, Lr: 0.000300\n","2020-05-21 21:14:25,145 Epoch   8 Step:    45700 Batch Loss:     1.957128 Tokens per Sec:    21829, Lr: 0.000300\n","2020-05-21 21:14:35,902 Epoch   8 Step:    45800 Batch Loss:     1.883194 Tokens per Sec:    22069, Lr: 0.000300\n","2020-05-21 21:14:46,755 Epoch   8 Step:    45900 Batch Loss:     1.824974 Tokens per Sec:    22314, Lr: 0.000300\n","2020-05-21 21:14:57,502 Epoch   8 Step:    46000 Batch Loss:     1.803579 Tokens per Sec:    21765, Lr: 0.000300\n","2020-05-21 21:15:10,309 Hooray! New best validation result [ppl]!\n","2020-05-21 21:15:10,309 Saving new checkpoint.\n","2020-05-21 21:15:10,567 Example #0\n","2020-05-21 21:15:10,567 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 21:15:10,568 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 21:15:10,568 \tHypothesis: Nsɛm a ɛtete saa maa tete nneɛma a na ɛyɛ hu sɛ wɔbɛma wɔn ho ayɛ den na wɔabu wɔn ani agu so .\n","2020-05-21 21:15:10,568 Example #1\n","2020-05-21 21:15:10,568 \tSource:     If so , you would be worthy of death .\n","2020-05-21 21:15:10,568 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 21:15:10,568 \tHypothesis: Sɛ saa a , anka wubewu .\n","2020-05-21 21:15:10,568 Example #2\n","2020-05-21 21:15:10,568 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 21:15:10,568 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 21:15:10,568 \tHypothesis: Oo , hwɛ sɛnea ɔsomafo Yohane huu anisoadehu a ɛyɛ hu yi !\n","2020-05-21 21:15:10,568 Example #3\n","2020-05-21 21:15:10,569 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 21:15:10,569 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 21:15:10,569 \tHypothesis: Ná Yesu wɔ nkate fam ahotɔ ne mmoa , nanso Petro ne afoforo no daa no adi mpɛn pii .\n","2020-05-21 21:15:10,569 Validation result (greedy) at epoch   8, step    46000: bleu:  24.59, loss: 44496.1367, ppl:   5.3826, duration: 13.0668s\n","2020-05-21 21:15:21,386 Epoch   8 Step:    46100 Batch Loss:     2.033067 Tokens per Sec:    22148, Lr: 0.000300\n","2020-05-21 21:15:32,140 Epoch   8 Step:    46200 Batch Loss:     1.647463 Tokens per Sec:    22061, Lr: 0.000300\n","2020-05-21 21:15:42,933 Epoch   8 Step:    46300 Batch Loss:     1.983132 Tokens per Sec:    22372, Lr: 0.000300\n","2020-05-21 21:15:53,792 Epoch   8 Step:    46400 Batch Loss:     1.711615 Tokens per Sec:    22123, Lr: 0.000300\n","2020-05-21 21:16:04,708 Epoch   8 Step:    46500 Batch Loss:     1.741343 Tokens per Sec:    22721, Lr: 0.000300\n","2020-05-21 21:16:15,409 Epoch   8 Step:    46600 Batch Loss:     1.989769 Tokens per Sec:    21737, Lr: 0.000300\n","2020-05-21 21:16:26,210 Epoch   8 Step:    46700 Batch Loss:     1.861353 Tokens per Sec:    22196, Lr: 0.000300\n","2020-05-21 21:16:36,917 Epoch   8 Step:    46800 Batch Loss:     1.717310 Tokens per Sec:    22240, Lr: 0.000300\n","2020-05-21 21:16:47,686 Epoch   8 Step:    46900 Batch Loss:     1.854499 Tokens per Sec:    22332, Lr: 0.000300\n","2020-05-21 21:16:58,374 Epoch   8 Step:    47000 Batch Loss:     1.889696 Tokens per Sec:    22276, Lr: 0.000300\n","2020-05-21 21:17:11,382 Example #0\n","2020-05-21 21:17:11,383 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 21:17:11,383 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 21:17:11,383 \tHypothesis: Nsɛm a ɛtete saa maa tete nkurow no nyaa ahotɔ ne amanne so tumi .\n","2020-05-21 21:17:11,383 Example #1\n","2020-05-21 21:17:11,383 \tSource:     If so , you would be worthy of death .\n","2020-05-21 21:17:11,383 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 21:17:11,383 \tHypothesis: Sɛ ɛte saa a , anka ɛsɛ sɛ wuwu .\n","2020-05-21 21:17:11,383 Example #2\n","2020-05-21 21:17:11,383 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 21:17:11,383 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 21:17:11,383 \tHypothesis: Hwɛ sɛnea ɔsomafo Yohane nyaa anigye bere a ohui sɛ nnipakuw kɛse no anisoadehu a ɛyɛ hu yi !\n","2020-05-21 21:17:11,383 Example #3\n","2020-05-21 21:17:11,384 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 21:17:11,384 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 21:17:11,384 \tHypothesis: Ná Yesu wɔ nkate fam ahotɔ ne hia mu , nanso Petro ne afoforo no daa adi mpɛn pii .\n","2020-05-21 21:17:11,384 Validation result (greedy) at epoch   8, step    47000: bleu:  24.32, loss: 44567.1172, ppl:   5.3970, duration: 13.0094s\n","2020-05-21 21:17:22,169 Epoch   8 Step:    47100 Batch Loss:     2.081611 Tokens per Sec:    22221, Lr: 0.000300\n","2020-05-21 21:17:33,089 Epoch   8 Step:    47200 Batch Loss:     1.695500 Tokens per Sec:    22229, Lr: 0.000300\n","2020-05-21 21:17:43,778 Epoch   8 Step:    47300 Batch Loss:     1.912476 Tokens per Sec:    21562, Lr: 0.000300\n","2020-05-21 21:17:54,522 Epoch   8 Step:    47400 Batch Loss:     1.912695 Tokens per Sec:    22272, Lr: 0.000300\n","2020-05-21 21:18:05,233 Epoch   8 Step:    47500 Batch Loss:     1.945719 Tokens per Sec:    22263, Lr: 0.000300\n","2020-05-21 21:18:16,016 Epoch   8 Step:    47600 Batch Loss:     1.660527 Tokens per Sec:    21966, Lr: 0.000300\n","2020-05-21 21:18:26,748 Epoch   8 Step:    47700 Batch Loss:     1.855924 Tokens per Sec:    22392, Lr: 0.000300\n","2020-05-21 21:18:37,546 Epoch   8 Step:    47800 Batch Loss:     1.914935 Tokens per Sec:    22257, Lr: 0.000300\n","2020-05-21 21:18:48,380 Epoch   8 Step:    47900 Batch Loss:     1.836402 Tokens per Sec:    22512, Lr: 0.000300\n","2020-05-21 21:18:59,110 Epoch   8 Step:    48000 Batch Loss:     1.746927 Tokens per Sec:    22035, Lr: 0.000300\n","2020-05-21 21:19:11,649 Hooray! New best validation result [ppl]!\n","2020-05-21 21:19:11,649 Saving new checkpoint.\n","2020-05-21 21:19:11,914 Example #0\n","2020-05-21 21:19:11,914 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 21:19:11,914 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 21:19:11,914 \tHypothesis: Nsɛm a ɛtete saa no maa tete nneɛma a na ɛyɛ hu sɛ obi bɛda ne ho adi na wabu n’ani agu so .\n","2020-05-21 21:19:11,915 Example #1\n","2020-05-21 21:19:11,915 \tSource:     If so , you would be worthy of death .\n","2020-05-21 21:19:11,915 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 21:19:11,915 \tHypothesis: Sɛ saa a , anka wobɛfata owu .\n","2020-05-21 21:19:11,915 Example #2\n","2020-05-21 21:19:11,915 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 21:19:11,915 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 21:19:11,915 \tHypothesis: Oo , hwɛ sɛnea ɔsomafo Yohane huu nnipakuw kɛse no anisoadehu a ɛyɛ nwonwa yi !\n","2020-05-21 21:19:11,915 Example #3\n","2020-05-21 21:19:11,915 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 21:19:11,915 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 21:19:11,915 \tHypothesis: Ná Yesu wɔ nkate fam , na na ohia mmoa , nanso Petro ne afoforo no daa adi mpɛn pii .\n","2020-05-21 21:19:11,916 Validation result (greedy) at epoch   8, step    48000: bleu:  24.60, loss: 44194.8516, ppl:   5.3216, duration: 12.8056s\n","2020-05-21 21:19:22,768 Epoch   8 Step:    48100 Batch Loss:     2.009908 Tokens per Sec:    22284, Lr: 0.000300\n","2020-05-21 21:19:33,566 Epoch   8 Step:    48200 Batch Loss:     1.917027 Tokens per Sec:    22300, Lr: 0.000300\n","2020-05-21 21:19:44,198 Epoch   8 Step:    48300 Batch Loss:     1.988431 Tokens per Sec:    21690, Lr: 0.000300\n","2020-05-21 21:19:55,024 Epoch   8 Step:    48400 Batch Loss:     2.036227 Tokens per Sec:    22310, Lr: 0.000300\n","2020-05-21 21:19:58,690 Epoch   8: total training loss 11446.69\n","2020-05-21 21:19:58,690 EPOCH 9\n","2020-05-21 21:20:06,498 Epoch   9 Step:    48500 Batch Loss:     1.637827 Tokens per Sec:    20245, Lr: 0.000300\n","2020-05-21 21:20:17,397 Epoch   9 Step:    48600 Batch Loss:     1.920165 Tokens per Sec:    22777, Lr: 0.000300\n","2020-05-21 21:20:28,159 Epoch   9 Step:    48700 Batch Loss:     1.757161 Tokens per Sec:    22336, Lr: 0.000300\n","2020-05-21 21:20:39,045 Epoch   9 Step:    48800 Batch Loss:     2.026510 Tokens per Sec:    22432, Lr: 0.000300\n","2020-05-21 21:20:49,951 Epoch   9 Step:    48900 Batch Loss:     1.670369 Tokens per Sec:    22391, Lr: 0.000300\n","2020-05-21 21:21:00,731 Epoch   9 Step:    49000 Batch Loss:     2.124752 Tokens per Sec:    21964, Lr: 0.000300\n","2020-05-21 21:21:13,725 Hooray! New best validation result [ppl]!\n","2020-05-21 21:21:13,725 Saving new checkpoint.\n","2020-05-21 21:21:14,013 Example #0\n","2020-05-21 21:21:14,013 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 21:21:14,013 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 21:21:14,014 \tHypothesis: Nsɛm a ɛte saa maa tete ahoni huu sɛ wɔagye wɔn ani na wɔyɛ wɔn basabasa .\n","2020-05-21 21:21:14,014 Example #1\n","2020-05-21 21:21:14,014 \tSource:     If so , you would be worthy of death .\n","2020-05-21 21:21:14,014 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 21:21:14,014 \tHypothesis: Sɛ saa a , anka wobɛfata sɛ wuwu .\n","2020-05-21 21:21:14,014 Example #2\n","2020-05-21 21:21:14,014 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 21:21:14,014 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 21:21:14,014 \tHypothesis: Oo , hwɛ sɛnea ɔsomafo Yohane huu nnipakuw kɛse no anisoadehu a ɛyɛ nwonwa yi !\n","2020-05-21 21:21:14,014 Example #3\n","2020-05-21 21:21:14,014 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 21:21:14,014 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 21:21:14,014 \tHypothesis: Ná Yesu wɔ nkate fam ne mmoa , nanso Petro ne afoforo no daa adi mpɛn pii .\n","2020-05-21 21:21:14,015 Validation result (greedy) at epoch   9, step    49000: bleu:  24.87, loss: 44017.5547, ppl:   5.2860, duration: 13.2829s\n","2020-05-21 21:21:24,632 Epoch   9 Step:    49100 Batch Loss:     1.783566 Tokens per Sec:    22053, Lr: 0.000300\n","2020-05-21 21:21:35,457 Epoch   9 Step:    49200 Batch Loss:     1.876629 Tokens per Sec:    22004, Lr: 0.000300\n","2020-05-21 21:21:46,293 Epoch   9 Step:    49300 Batch Loss:     2.128602 Tokens per Sec:    22184, Lr: 0.000300\n","2020-05-21 21:21:57,035 Epoch   9 Step:    49400 Batch Loss:     1.777593 Tokens per Sec:    22174, Lr: 0.000300\n","2020-05-21 21:22:07,777 Epoch   9 Step:    49500 Batch Loss:     1.872013 Tokens per Sec:    22099, Lr: 0.000300\n","2020-05-21 21:22:18,590 Epoch   9 Step:    49600 Batch Loss:     1.904417 Tokens per Sec:    22265, Lr: 0.000300\n","2020-05-21 21:22:29,454 Epoch   9 Step:    49700 Batch Loss:     2.228929 Tokens per Sec:    22600, Lr: 0.000300\n","2020-05-21 21:22:40,299 Epoch   9 Step:    49800 Batch Loss:     1.663976 Tokens per Sec:    22066, Lr: 0.000300\n","2020-05-21 21:22:51,073 Epoch   9 Step:    49900 Batch Loss:     2.224943 Tokens per Sec:    22243, Lr: 0.000300\n","2020-05-21 21:23:01,904 Epoch   9 Step:    50000 Batch Loss:     1.834091 Tokens per Sec:    22146, Lr: 0.000300\n","2020-05-21 21:23:13,865 Hooray! New best validation result [ppl]!\n","2020-05-21 21:23:13,865 Saving new checkpoint.\n","2020-05-21 21:23:14,122 Example #0\n","2020-05-21 21:23:14,123 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 21:23:14,123 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 21:23:14,123 \tHypothesis: Nsɛm a ɛte saa maa tete nneɛma a na ɛyɛ hu sɛ na ɛyɛ den na ɛyɛ aniberesɛm .\n","2020-05-21 21:23:14,123 Example #1\n","2020-05-21 21:23:14,123 \tSource:     If so , you would be worthy of death .\n","2020-05-21 21:23:14,123 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 21:23:14,123 \tHypothesis: Sɛ saa a , ɛnde na wofata sɛ wuwu .\n","2020-05-21 21:23:14,123 Example #2\n","2020-05-21 21:23:14,123 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 21:23:14,123 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 21:23:14,123 \tHypothesis: Hwɛ anigye ara a ɔsomafo Yohane nyaa wɔ nnipakuw kɛse no anisoadehu a ɛyɛ hu yi mu !\n","2020-05-21 21:23:14,123 Example #3\n","2020-05-21 21:23:14,124 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 21:23:14,124 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 21:23:14,124 \tHypothesis: Ná Yesu wɔ nkate fam ahokyere ne mmoa , nanso Petro ne afoforo no daa so ara da .\n","2020-05-21 21:23:14,124 Validation result (greedy) at epoch   9, step    50000: bleu:  24.87, loss: 43836.6133, ppl:   5.2499, duration: 12.2192s\n","2020-05-21 21:23:24,839 Epoch   9 Step:    50100 Batch Loss:     2.104011 Tokens per Sec:    22204, Lr: 0.000300\n","2020-05-21 21:23:35,507 Epoch   9 Step:    50200 Batch Loss:     1.651152 Tokens per Sec:    21799, Lr: 0.000300\n","2020-05-21 21:23:46,340 Epoch   9 Step:    50300 Batch Loss:     1.835316 Tokens per Sec:    22259, Lr: 0.000300\n","2020-05-21 21:23:57,139 Epoch   9 Step:    50400 Batch Loss:     1.726039 Tokens per Sec:    22194, Lr: 0.000300\n","2020-05-21 21:24:07,916 Epoch   9 Step:    50500 Batch Loss:     1.800342 Tokens per Sec:    22026, Lr: 0.000300\n","2020-05-21 21:24:18,715 Epoch   9 Step:    50600 Batch Loss:     1.869373 Tokens per Sec:    22294, Lr: 0.000300\n","2020-05-21 21:24:29,729 Epoch   9 Step:    50700 Batch Loss:     2.177090 Tokens per Sec:    22047, Lr: 0.000300\n","2020-05-21 21:24:40,440 Epoch   9 Step:    50800 Batch Loss:     1.904045 Tokens per Sec:    22009, Lr: 0.000300\n","2020-05-21 21:24:51,204 Epoch   9 Step:    50900 Batch Loss:     1.781936 Tokens per Sec:    22307, Lr: 0.000300\n","2020-05-21 21:25:02,022 Epoch   9 Step:    51000 Batch Loss:     2.184935 Tokens per Sec:    22252, Lr: 0.000300\n","2020-05-21 21:25:14,352 Example #0\n","2020-05-21 21:25:14,352 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 21:25:14,352 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 21:25:14,352 \tHypothesis: Nsɛm a ɛtete saa maa tete nneɛma no nyaa nkɔanim sɛ wɔbɛkɔ so ayɛ den na wɔabu wɔn ani agu so .\n","2020-05-21 21:25:14,352 Example #1\n","2020-05-21 21:25:14,353 \tSource:     If so , you would be worthy of death .\n","2020-05-21 21:25:14,353 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 21:25:14,353 \tHypothesis: Sɛ saa a , anka wobɛfata sɛ wuwu .\n","2020-05-21 21:25:14,353 Example #2\n","2020-05-21 21:25:14,353 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 21:25:14,353 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 21:25:14,353 \tHypothesis: Oo , hwɛ sɛnea ɔsomafo Yohane huu anisoadehu a ɛyɛ nwonwa yi !\n","2020-05-21 21:25:14,353 Example #3\n","2020-05-21 21:25:14,353 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 21:25:14,353 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 21:25:14,353 \tHypothesis: Ná Yesu wɔ nkate fam , na na ohia mmoa , nanso Petro ne afoforo no daa .\n","2020-05-21 21:25:14,353 Validation result (greedy) at epoch   9, step    51000: bleu:  24.99, loss: 43881.3398, ppl:   5.2588, duration: 12.3314s\n","2020-05-21 21:25:25,086 Epoch   9 Step:    51100 Batch Loss:     1.640004 Tokens per Sec:    22214, Lr: 0.000300\n","2020-05-21 21:25:35,942 Epoch   9 Step:    51200 Batch Loss:     1.932614 Tokens per Sec:    22453, Lr: 0.000300\n","2020-05-21 21:25:46,798 Epoch   9 Step:    51300 Batch Loss:     2.008647 Tokens per Sec:    21800, Lr: 0.000300\n","2020-05-21 21:25:57,611 Epoch   9 Step:    51400 Batch Loss:     1.625679 Tokens per Sec:    21699, Lr: 0.000300\n","2020-05-21 21:26:08,416 Epoch   9 Step:    51500 Batch Loss:     1.927614 Tokens per Sec:    22214, Lr: 0.000300\n","2020-05-21 21:26:19,306 Epoch   9 Step:    51600 Batch Loss:     1.771975 Tokens per Sec:    22712, Lr: 0.000300\n","2020-05-21 21:26:29,917 Epoch   9 Step:    51700 Batch Loss:     2.002075 Tokens per Sec:    21955, Lr: 0.000300\n","2020-05-21 21:26:40,648 Epoch   9 Step:    51800 Batch Loss:     1.951857 Tokens per Sec:    22091, Lr: 0.000300\n","2020-05-21 21:26:51,460 Epoch   9 Step:    51900 Batch Loss:     1.977166 Tokens per Sec:    21965, Lr: 0.000300\n","2020-05-21 21:27:02,198 Epoch   9 Step:    52000 Batch Loss:     1.986689 Tokens per Sec:    22081, Lr: 0.000300\n","2020-05-21 21:27:14,662 Hooray! New best validation result [ppl]!\n","2020-05-21 21:27:14,663 Saving new checkpoint.\n","2020-05-21 21:27:14,928 Example #0\n","2020-05-21 21:27:14,929 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 21:27:14,929 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 21:27:14,929 \tHypothesis: Nsɛm a ɛte saa no maa tete nneɛma a na ɛyɛ hu sɛ wɔbɛma wɔn ani agye na wɔabu wɔn ani agu so .\n","2020-05-21 21:27:14,929 Example #1\n","2020-05-21 21:27:14,929 \tSource:     If so , you would be worthy of death .\n","2020-05-21 21:27:14,929 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 21:27:14,929 \tHypothesis: Sɛ saa a , anka wobɛfata sɛ wuwu .\n","2020-05-21 21:27:14,929 Example #2\n","2020-05-21 21:27:14,929 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 21:27:14,929 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 21:27:14,930 \tHypothesis: Oo , hwɛ sɛnea ɔsomafo Yohane huu anisoadehu a ɛyɛ hu yi a ɛyɛ nwonwa yi !\n","2020-05-21 21:27:14,930 Example #3\n","2020-05-21 21:27:14,930 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 21:27:14,930 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 21:27:14,930 \tHypothesis: Ná Yesu wɔ nkate fam ahokyere ne hia a ehia , nanso Petro ne afoforo no daa adi mpɛn pii .\n","2020-05-21 21:27:14,930 Validation result (greedy) at epoch   9, step    52000: bleu:  24.51, loss: 43733.8633, ppl:   5.2296, duration: 12.7313s\n","2020-05-21 21:27:25,793 Epoch   9 Step:    52100 Batch Loss:     1.496121 Tokens per Sec:    22437, Lr: 0.000300\n","2020-05-21 21:27:36,652 Epoch   9 Step:    52200 Batch Loss:     1.685675 Tokens per Sec:    22202, Lr: 0.000300\n","2020-05-21 21:27:47,517 Epoch   9 Step:    52300 Batch Loss:     2.147330 Tokens per Sec:    22357, Lr: 0.000300\n","2020-05-21 21:27:58,216 Epoch   9 Step:    52400 Batch Loss:     2.241218 Tokens per Sec:    21662, Lr: 0.000300\n","2020-05-21 21:28:09,110 Epoch   9 Step:    52500 Batch Loss:     1.825669 Tokens per Sec:    22865, Lr: 0.000300\n","2020-05-21 21:28:19,908 Epoch   9 Step:    52600 Batch Loss:     2.084340 Tokens per Sec:    22307, Lr: 0.000300\n","2020-05-21 21:28:30,795 Epoch   9 Step:    52700 Batch Loss:     1.790300 Tokens per Sec:    22316, Lr: 0.000300\n","2020-05-21 21:28:41,510 Epoch   9 Step:    52800 Batch Loss:     1.818321 Tokens per Sec:    21877, Lr: 0.000300\n","2020-05-21 21:28:52,268 Epoch   9 Step:    52900 Batch Loss:     2.460408 Tokens per Sec:    22252, Lr: 0.000300\n","2020-05-21 21:29:02,872 Epoch   9 Step:    53000 Batch Loss:     1.888697 Tokens per Sec:    21369, Lr: 0.000300\n","2020-05-21 21:29:14,563 Hooray! New best validation result [ppl]!\n","2020-05-21 21:29:14,563 Saving new checkpoint.\n","2020-05-21 21:29:14,818 Example #0\n","2020-05-21 21:29:14,818 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 21:29:14,818 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 21:29:14,819 \tHypothesis: Nsɛm a ɛtete saa no maa tete aguadi ahorow nyaa nkɔso na wɔanyɛ wɔn ade .\n","2020-05-21 21:29:14,819 Example #1\n","2020-05-21 21:29:14,819 \tSource:     If so , you would be worthy of death .\n","2020-05-21 21:29:14,819 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 21:29:14,819 \tHypothesis: Sɛ ɛte saa a , ɛnde na wofata sɛ wuwu .\n","2020-05-21 21:29:14,819 Example #2\n","2020-05-21 21:29:14,819 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 21:29:14,819 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 21:29:14,819 \tHypothesis: Hwɛ sɛnea ɔsomafo Yohane ani gyei bere a ohuu nnipakuw kɛse no anisoadehu a ɛyɛ hu yi !\n","2020-05-21 21:29:14,819 Example #3\n","2020-05-21 21:29:14,819 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 21:29:14,819 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 21:29:14,819 \tHypothesis: Ná Yesu wɔ nkate fam , na na ohia mmoa , nanso Petro ne afoforo no daa so ara .\n","2020-05-21 21:29:14,820 Validation result (greedy) at epoch   9, step    53000: bleu:  24.67, loss: 43552.9258, ppl:   5.1939, duration: 11.9468s\n","2020-05-21 21:29:25,665 Epoch   9 Step:    53100 Batch Loss:     1.911299 Tokens per Sec:    22041, Lr: 0.000300\n","2020-05-21 21:29:36,382 Epoch   9 Step:    53200 Batch Loss:     1.873276 Tokens per Sec:    21963, Lr: 0.000300\n","2020-05-21 21:29:47,128 Epoch   9 Step:    53300 Batch Loss:     1.753452 Tokens per Sec:    22130, Lr: 0.000300\n","2020-05-21 21:29:57,780 Epoch   9 Step:    53400 Batch Loss:     1.923041 Tokens per Sec:    21482, Lr: 0.000300\n","2020-05-21 21:30:08,622 Epoch   9 Step:    53500 Batch Loss:     1.769697 Tokens per Sec:    22266, Lr: 0.000300\n","2020-05-21 21:30:19,466 Epoch   9 Step:    53600 Batch Loss:     1.749749 Tokens per Sec:    22280, Lr: 0.000300\n","2020-05-21 21:30:30,213 Epoch   9 Step:    53700 Batch Loss:     1.628037 Tokens per Sec:    22226, Lr: 0.000300\n","2020-05-21 21:30:40,885 Epoch   9 Step:    53800 Batch Loss:     1.811345 Tokens per Sec:    21998, Lr: 0.000300\n","2020-05-21 21:30:51,721 Epoch   9 Step:    53900 Batch Loss:     2.018898 Tokens per Sec:    22262, Lr: 0.000300\n","2020-05-21 21:31:02,547 Epoch   9 Step:    54000 Batch Loss:     1.697388 Tokens per Sec:    22256, Lr: 0.000300\n","2020-05-21 21:31:14,518 Example #0\n","2020-05-21 21:31:14,518 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 21:31:14,518 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 21:31:14,519 \tHypothesis: Saa nsɛm no maa tete nneɛma no dii nkonim sɛ wɔbɛsɛe wɔn adwene na wɔabu wɔn ani agu so .\n","2020-05-21 21:31:14,519 Example #1\n","2020-05-21 21:31:14,519 \tSource:     If so , you would be worthy of death .\n","2020-05-21 21:31:14,519 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 21:31:14,519 \tHypothesis: Sɛ saa a , anka wobɛfata sɛ wuwu .\n","2020-05-21 21:31:14,519 Example #2\n","2020-05-21 21:31:14,519 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 21:31:14,519 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 21:31:14,519 \tHypothesis: Oo , hwɛ sɛnea ɔsomafo Yohane huu nnipakuw kɛse no anisoadehu a ɛyɛ hu yi !\n","2020-05-21 21:31:14,519 Example #3\n","2020-05-21 21:31:14,519 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 21:31:14,519 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 21:31:14,519 \tHypothesis: Ná Yesu wɔ nkate fam , na na ohia mmoa , nanso Petro ne afoforo no daa so ara da .\n","2020-05-21 21:31:14,520 Validation result (greedy) at epoch   9, step    54000: bleu:  24.76, loss: 43563.5273, ppl:   5.1960, duration: 11.9721s\n","2020-05-21 21:31:25,282 Epoch   9 Step:    54100 Batch Loss:     2.060805 Tokens per Sec:    22627, Lr: 0.000300\n","2020-05-21 21:31:35,982 Epoch   9 Step:    54200 Batch Loss:     1.698400 Tokens per Sec:    22237, Lr: 0.000300\n","2020-05-21 21:31:46,813 Epoch   9 Step:    54300 Batch Loss:     1.918332 Tokens per Sec:    22535, Lr: 0.000300\n","2020-05-21 21:31:57,531 Epoch   9 Step:    54400 Batch Loss:     1.924791 Tokens per Sec:    21644, Lr: 0.000300\n","2020-05-21 21:32:06,639 Epoch   9: total training loss 11197.72\n","2020-05-21 21:32:06,639 EPOCH 10\n","2020-05-21 21:32:09,046 Epoch  10 Step:    54500 Batch Loss:     1.798722 Tokens per Sec:    14063, Lr: 0.000300\n","2020-05-21 21:32:19,877 Epoch  10 Step:    54600 Batch Loss:     2.037398 Tokens per Sec:    22603, Lr: 0.000300\n","2020-05-21 21:32:30,756 Epoch  10 Step:    54700 Batch Loss:     1.757915 Tokens per Sec:    22049, Lr: 0.000300\n","2020-05-21 21:32:41,544 Epoch  10 Step:    54800 Batch Loss:     1.784305 Tokens per Sec:    22043, Lr: 0.000300\n","2020-05-21 21:32:52,339 Epoch  10 Step:    54900 Batch Loss:     1.650972 Tokens per Sec:    21951, Lr: 0.000300\n","2020-05-21 21:33:03,172 Epoch  10 Step:    55000 Batch Loss:     1.814636 Tokens per Sec:    22426, Lr: 0.000300\n","2020-05-21 21:33:16,214 Hooray! New best validation result [ppl]!\n","2020-05-21 21:33:16,214 Saving new checkpoint.\n","2020-05-21 21:33:16,557 Example #0\n","2020-05-21 21:33:16,557 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 21:33:16,557 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 21:33:16,557 \tHypothesis: Nsɛm a ɛte saa no maa tete aguadi no nyaa adwene sɛ wɔbɛkɔ so ayɛ den na wɔabu wɔn ani agu so .\n","2020-05-21 21:33:16,557 Example #1\n","2020-05-21 21:33:16,557 \tSource:     If so , you would be worthy of death .\n","2020-05-21 21:33:16,557 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 21:33:16,557 \tHypothesis: Sɛ ɛte saa a , anka wobɛfata sɛ wuwu .\n","2020-05-21 21:33:16,557 Example #2\n","2020-05-21 21:33:16,558 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 21:33:16,558 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 21:33:16,558 \tHypothesis: Hwɛ sɛnea ɔsomafo Yohane ani gyei sɛ ohuu nnipakuw kɛse no anisoadehu a ɛyɛ nwonwa yi !\n","2020-05-21 21:33:16,558 Example #3\n","2020-05-21 21:33:16,558 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 21:33:16,558 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 21:33:16,558 \tHypothesis: Ná Yesu wɔ nkate fam ahokyere , na na ohia mmoa , nanso Petro ne afoforo no daa nna adi mpɛn pii .\n","2020-05-21 21:33:16,558 Validation result (greedy) at epoch  10, step    55000: bleu:  25.25, loss: 43322.5273, ppl:   5.1488, duration: 13.3860s\n","2020-05-21 21:33:27,355 Epoch  10 Step:    55100 Batch Loss:     1.834321 Tokens per Sec:    21913, Lr: 0.000300\n","2020-05-21 21:33:38,253 Epoch  10 Step:    55200 Batch Loss:     1.393985 Tokens per Sec:    22413, Lr: 0.000300\n","2020-05-21 21:33:49,107 Epoch  10 Step:    55300 Batch Loss:     1.676350 Tokens per Sec:    22522, Lr: 0.000300\n","2020-05-21 21:33:59,920 Epoch  10 Step:    55400 Batch Loss:     2.080560 Tokens per Sec:    22097, Lr: 0.000300\n","2020-05-21 21:34:10,833 Epoch  10 Step:    55500 Batch Loss:     1.912960 Tokens per Sec:    22350, Lr: 0.000300\n","2020-05-21 21:34:21,621 Epoch  10 Step:    55600 Batch Loss:     1.664321 Tokens per Sec:    22219, Lr: 0.000300\n","2020-05-21 21:34:32,402 Epoch  10 Step:    55700 Batch Loss:     1.753752 Tokens per Sec:    22274, Lr: 0.000300\n","2020-05-21 21:34:43,179 Epoch  10 Step:    55800 Batch Loss:     2.021837 Tokens per Sec:    22255, Lr: 0.000300\n","2020-05-21 21:34:53,852 Epoch  10 Step:    55900 Batch Loss:     1.858658 Tokens per Sec:    21847, Lr: 0.000300\n","2020-05-21 21:35:04,651 Epoch  10 Step:    56000 Batch Loss:     1.905867 Tokens per Sec:    22107, Lr: 0.000300\n","2020-05-21 21:35:17,165 Hooray! New best validation result [ppl]!\n","2020-05-21 21:35:17,165 Saving new checkpoint.\n","2020-05-21 21:35:17,421 Example #0\n","2020-05-21 21:35:17,421 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 21:35:17,421 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 21:35:17,421 \tHypothesis: Nsɛm a ɛtete saa maa tete agumadi no nyaa adwene sɛ wɔbɛbɔ mmɔden na wɔabɔ wɔn bra .\n","2020-05-21 21:35:17,421 Example #1\n","2020-05-21 21:35:17,421 \tSource:     If so , you would be worthy of death .\n","2020-05-21 21:35:17,421 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 21:35:17,421 \tHypothesis: Sɛ saa a , anka wobɛfata sɛ wuwu .\n","2020-05-21 21:35:17,421 Example #2\n","2020-05-21 21:35:17,422 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 21:35:17,422 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 21:35:17,422 \tHypothesis: Hwɛ sɛnea ɔsomafo Yohane ani gyei sɛ ohuu nnipakuw kɛse no anisoadehu a ɛyɛ nwonwa yi !\n","2020-05-21 21:35:17,422 Example #3\n","2020-05-21 21:35:17,422 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 21:35:17,422 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 21:35:17,422 \tHypothesis: Ná Yesu wɔ nkate fam yaw , na na ohia mmoa , nanso Petro ne afoforo no daa adi mpɛn pii .\n","2020-05-21 21:35:17,422 Validation result (greedy) at epoch  10, step    56000: bleu:  24.95, loss: 43293.6016, ppl:   5.1432, duration: 12.7707s\n","2020-05-21 21:35:28,115 Epoch  10 Step:    56100 Batch Loss:     1.841802 Tokens per Sec:    21661, Lr: 0.000300\n","2020-05-21 21:35:38,899 Epoch  10 Step:    56200 Batch Loss:     1.817205 Tokens per Sec:    22038, Lr: 0.000300\n","2020-05-21 21:35:49,694 Epoch  10 Step:    56300 Batch Loss:     1.693680 Tokens per Sec:    21975, Lr: 0.000300\n","2020-05-21 21:36:00,474 Epoch  10 Step:    56400 Batch Loss:     1.671565 Tokens per Sec:    22318, Lr: 0.000300\n","2020-05-21 21:36:11,401 Epoch  10 Step:    56500 Batch Loss:     1.971529 Tokens per Sec:    22626, Lr: 0.000300\n","2020-05-21 21:36:22,352 Epoch  10 Step:    56600 Batch Loss:     1.518734 Tokens per Sec:    22160, Lr: 0.000300\n","2020-05-21 21:36:33,299 Epoch  10 Step:    56700 Batch Loss:     1.681758 Tokens per Sec:    22494, Lr: 0.000300\n","2020-05-21 21:36:44,046 Epoch  10 Step:    56800 Batch Loss:     1.811907 Tokens per Sec:    22106, Lr: 0.000300\n","2020-05-21 21:36:54,831 Epoch  10 Step:    56900 Batch Loss:     1.606947 Tokens per Sec:    21972, Lr: 0.000300\n","2020-05-21 21:37:05,499 Epoch  10 Step:    57000 Batch Loss:     1.880820 Tokens per Sec:    21881, Lr: 0.000300\n","2020-05-21 21:37:17,657 Example #0\n","2020-05-21 21:37:17,657 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 21:37:17,657 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 21:37:17,657 \tHypothesis: Nsɛm a ɛtete saa no maa tete nneɛma a na ɛyɛ hu sɛ wɔresɛe na wɔyɛ wɔn ade wɔ ɔkwan a ɛfata so .\n","2020-05-21 21:37:17,657 Example #1\n","2020-05-21 21:37:17,657 \tSource:     If so , you would be worthy of death .\n","2020-05-21 21:37:17,657 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 21:37:17,658 \tHypothesis: Sɛ saa a , anka wobɛfata owu .\n","2020-05-21 21:37:17,658 Example #2\n","2020-05-21 21:37:17,658 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 21:37:17,658 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 21:37:17,658 \tHypothesis: Oh , hwɛ sɛnea ɔsomafo Yohane ani gyei sɛ ohuu nnipakuw kɛse no anisoadehu a ɛyɛ hu yi !\n","2020-05-21 21:37:17,658 Example #3\n","2020-05-21 21:37:17,658 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 21:37:17,658 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 21:37:17,658 \tHypothesis: Ná Yesu wɔ nkate fam , na ohia mmoa , nanso Petro ne afoforo no daa .\n","2020-05-21 21:37:17,658 Validation result (greedy) at epoch  10, step    57000: bleu:  25.27, loss: 43352.1914, ppl:   5.1546, duration: 12.1594s\n","2020-05-21 21:37:28,496 Epoch  10 Step:    57100 Batch Loss:     1.668545 Tokens per Sec:    22218, Lr: 0.000300\n","2020-05-21 21:37:39,273 Epoch  10 Step:    57200 Batch Loss:     1.856141 Tokens per Sec:    21946, Lr: 0.000300\n","2020-05-21 21:37:50,154 Epoch  10 Step:    57300 Batch Loss:     1.969366 Tokens per Sec:    22101, Lr: 0.000300\n","2020-05-21 21:38:00,887 Epoch  10 Step:    57400 Batch Loss:     1.700790 Tokens per Sec:    21529, Lr: 0.000300\n","2020-05-21 21:38:11,723 Epoch  10 Step:    57500 Batch Loss:     1.895240 Tokens per Sec:    21756, Lr: 0.000300\n","2020-05-21 21:38:22,477 Epoch  10 Step:    57600 Batch Loss:     1.788386 Tokens per Sec:    22403, Lr: 0.000300\n","2020-05-21 21:38:33,292 Epoch  10 Step:    57700 Batch Loss:     1.955655 Tokens per Sec:    22373, Lr: 0.000300\n","2020-05-21 21:38:44,145 Epoch  10 Step:    57800 Batch Loss:     1.755254 Tokens per Sec:    22326, Lr: 0.000300\n","2020-05-21 21:38:54,946 Epoch  10 Step:    57900 Batch Loss:     1.726254 Tokens per Sec:    21833, Lr: 0.000300\n","2020-05-21 21:39:05,765 Epoch  10 Step:    58000 Batch Loss:     1.776768 Tokens per Sec:    22226, Lr: 0.000300\n","2020-05-21 21:39:18,634 Hooray! New best validation result [ppl]!\n","2020-05-21 21:39:18,635 Saving new checkpoint.\n","2020-05-21 21:39:18,878 Example #0\n","2020-05-21 21:39:18,878 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 21:39:18,878 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 21:39:18,878 \tHypothesis: Saa nsɛm no maa tete ahemfo huu sɛ wɔagye wɔn ani na wɔyɛ wɔn ade wɔ ɔkwan a wɔfa so yɛ wɔn ade no so .\n","2020-05-21 21:39:18,878 Example #1\n","2020-05-21 21:39:18,878 \tSource:     If so , you would be worthy of death .\n","2020-05-21 21:39:18,879 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 21:39:18,879 \tHypothesis: Sɛ saa a , na wofata owu .\n","2020-05-21 21:39:18,879 Example #2\n","2020-05-21 21:39:18,879 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 21:39:18,879 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 21:39:18,879 \tHypothesis: Oh , hwɛ sɛnea ɔsomafo Yohane huu anisoadehu a ɛyɛ hu yi !\n","2020-05-21 21:39:18,879 Example #3\n","2020-05-21 21:39:18,879 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 21:39:18,879 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 21:39:18,879 \tHypothesis: Ná Yesu wɔ nkate fam yaw na ohia mmoa , nanso Petro ne afoforo daa .\n","2020-05-21 21:39:18,879 Validation result (greedy) at epoch  10, step    58000: bleu:  25.23, loss: 43042.3281, ppl:   5.0945, duration: 13.1144s\n","2020-05-21 21:39:29,711 Epoch  10 Step:    58100 Batch Loss:     2.199688 Tokens per Sec:    22284, Lr: 0.000300\n","2020-05-21 21:39:40,548 Epoch  10 Step:    58200 Batch Loss:     1.869339 Tokens per Sec:    22270, Lr: 0.000300\n","2020-05-21 21:39:51,370 Epoch  10 Step:    58300 Batch Loss:     1.845791 Tokens per Sec:    22095, Lr: 0.000300\n","2020-05-21 21:40:02,123 Epoch  10 Step:    58400 Batch Loss:     1.649336 Tokens per Sec:    21793, Lr: 0.000300\n","2020-05-21 21:40:13,018 Epoch  10 Step:    58500 Batch Loss:     1.880162 Tokens per Sec:    22315, Lr: 0.000300\n","2020-05-21 21:40:23,764 Epoch  10 Step:    58600 Batch Loss:     1.665243 Tokens per Sec:    21806, Lr: 0.000300\n","2020-05-21 21:40:34,637 Epoch  10 Step:    58700 Batch Loss:     2.108155 Tokens per Sec:    22218, Lr: 0.000300\n","2020-05-21 21:40:45,378 Epoch  10 Step:    58800 Batch Loss:     1.837179 Tokens per Sec:    21724, Lr: 0.000300\n","2020-05-21 21:40:56,247 Epoch  10 Step:    58900 Batch Loss:     1.759280 Tokens per Sec:    22107, Lr: 0.000300\n","2020-05-21 21:41:07,059 Epoch  10 Step:    59000 Batch Loss:     1.934286 Tokens per Sec:    22396, Lr: 0.000300\n","2020-05-21 21:41:19,992 Example #0\n","2020-05-21 21:41:19,992 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 21:41:19,992 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 21:41:19,992 \tHypothesis: Nsɛm a ɛtete saa maa tete nneɛma a na ɛyɛ hu sɛ wɔresɛe na wɔyɛ wɔn ade wɔ amannɔne .\n","2020-05-21 21:41:19,993 Example #1\n","2020-05-21 21:41:19,993 \tSource:     If so , you would be worthy of death .\n","2020-05-21 21:41:19,993 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 21:41:19,993 \tHypothesis: Sɛ saa a , wubewu .\n","2020-05-21 21:41:19,993 Example #2\n","2020-05-21 21:41:19,993 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 21:41:19,993 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 21:41:19,993 \tHypothesis: Oo , hwɛ sɛnea ɔsomafo Yohane huu nnipakuw kɛse no anisoadehu a ɛyɛ hu yi !\n","2020-05-21 21:41:19,993 Example #3\n","2020-05-21 21:41:19,993 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 21:41:19,993 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 21:41:19,993 \tHypothesis: Ná Yesu wɔ nkate fam , na na ohia mmoa , nanso Petro ne afoforo no daa .\n","2020-05-21 21:41:19,994 Validation result (greedy) at epoch  10, step    59000: bleu:  25.50, loss: 43045.0703, ppl:   5.0951, duration: 12.9339s\n","2020-05-21 21:41:30,808 Epoch  10 Step:    59100 Batch Loss:     1.553499 Tokens per Sec:    21586, Lr: 0.000300\n","2020-05-21 21:41:41,612 Epoch  10 Step:    59200 Batch Loss:     1.691247 Tokens per Sec:    22333, Lr: 0.000300\n","2020-05-21 21:41:52,466 Epoch  10 Step:    59300 Batch Loss:     1.942844 Tokens per Sec:    22027, Lr: 0.000300\n","2020-05-21 21:42:03,296 Epoch  10 Step:    59400 Batch Loss:     1.759777 Tokens per Sec:    22051, Lr: 0.000300\n","2020-05-21 21:42:14,153 Epoch  10 Step:    59500 Batch Loss:     1.839991 Tokens per Sec:    22213, Lr: 0.000300\n","2020-05-21 21:42:24,822 Epoch  10 Step:    59600 Batch Loss:     2.013305 Tokens per Sec:    21914, Lr: 0.000300\n","2020-05-21 21:42:35,669 Epoch  10 Step:    59700 Batch Loss:     1.939570 Tokens per Sec:    22466, Lr: 0.000300\n","2020-05-21 21:42:46,467 Epoch  10 Step:    59800 Batch Loss:     1.649502 Tokens per Sec:    22123, Lr: 0.000300\n","2020-05-21 21:42:57,341 Epoch  10 Step:    59900 Batch Loss:     1.907070 Tokens per Sec:    22338, Lr: 0.000300\n","2020-05-21 21:43:08,083 Epoch  10 Step:    60000 Batch Loss:     1.585758 Tokens per Sec:    21830, Lr: 0.000300\n","2020-05-21 21:43:22,359 Hooray! New best validation result [ppl]!\n","2020-05-21 21:43:22,359 Saving new checkpoint.\n","2020-05-21 21:43:22,597 Example #0\n","2020-05-21 21:43:22,597 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 21:43:22,597 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 21:43:22,597 \tHypothesis: Nsɛm a ɛtete saa no maa tete nneɛma dii nkonim sɛ wɔreyɛ adwuma na wɔabu wɔn ani agu so .\n","2020-05-21 21:43:22,597 Example #1\n","2020-05-21 21:43:22,598 \tSource:     If so , you would be worthy of death .\n","2020-05-21 21:43:22,598 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 21:43:22,598 \tHypothesis: Sɛ saa a , ɛnde na ɛsɛ sɛ wuwu .\n","2020-05-21 21:43:22,598 Example #2\n","2020-05-21 21:43:22,598 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 21:43:22,598 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 21:43:22,598 \tHypothesis: Hwɛ sɛnea ɔsomafo Yohane ani gyei bere a ohuu nnipakuw kɛse no anisoadehu a ɛyɛ hu yi !\n","2020-05-21 21:43:22,598 Example #3\n","2020-05-21 21:43:22,598 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 21:43:22,598 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 21:43:22,598 \tHypothesis: Ná Yesu wɔ nkate fam , na ohia mmoa , nanso Petro ne afoforo no daa .\n","2020-05-21 21:43:22,598 Validation result (greedy) at epoch  10, step    60000: bleu:  25.60, loss: 42705.0352, ppl:   5.0300, duration: 14.5154s\n","2020-05-21 21:43:33,407 Epoch  10 Step:    60100 Batch Loss:     2.127111 Tokens per Sec:    21986, Lr: 0.000300\n","2020-05-21 21:43:44,239 Epoch  10 Step:    60200 Batch Loss:     1.830607 Tokens per Sec:    22260, Lr: 0.000300\n","2020-05-21 21:43:55,020 Epoch  10 Step:    60300 Batch Loss:     1.886366 Tokens per Sec:    22073, Lr: 0.000300\n","2020-05-21 21:44:05,761 Epoch  10 Step:    60400 Batch Loss:     1.995314 Tokens per Sec:    22049, Lr: 0.000300\n","2020-05-21 21:44:16,489 Epoch  10 Step:    60500 Batch Loss:     1.733498 Tokens per Sec:    22276, Lr: 0.000300\n","2020-05-21 21:44:20,416 Epoch  10: total training loss 11034.40\n","2020-05-21 21:44:20,416 EPOCH 11\n","2020-05-21 21:44:27,884 Epoch  11 Step:    60600 Batch Loss:     1.785024 Tokens per Sec:    19558, Lr: 0.000300\n","2020-05-21 21:44:38,695 Epoch  11 Step:    60700 Batch Loss:     1.743182 Tokens per Sec:    22286, Lr: 0.000300\n","2020-05-21 21:44:49,521 Epoch  11 Step:    60800 Batch Loss:     1.666359 Tokens per Sec:    22249, Lr: 0.000300\n","2020-05-21 21:45:00,338 Epoch  11 Step:    60900 Batch Loss:     1.793769 Tokens per Sec:    22382, Lr: 0.000300\n","2020-05-21 21:45:11,095 Epoch  11 Step:    61000 Batch Loss:     1.615945 Tokens per Sec:    22292, Lr: 0.000300\n","2020-05-21 21:45:23,476 Hooray! New best validation result [ppl]!\n","2020-05-21 21:45:23,476 Saving new checkpoint.\n","2020-05-21 21:45:23,747 Example #0\n","2020-05-21 21:45:23,748 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 21:45:23,748 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 21:45:23,748 \tHypothesis: Nsɛm a ɛte saa no maa tete nkurow no nyaa nkɔso na wɔde yɛɛ adwuma .\n","2020-05-21 21:45:23,748 Example #1\n","2020-05-21 21:45:23,748 \tSource:     If so , you would be worthy of death .\n","2020-05-21 21:45:23,748 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 21:45:23,748 \tHypothesis: Sɛ saa a , anka wobɛfata sɛ wuwu .\n","2020-05-21 21:45:23,748 Example #2\n","2020-05-21 21:45:23,748 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 21:45:23,748 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 21:45:23,749 \tHypothesis: Oo , hwɛ sɛnea ɔsomafo Yohane ani gyei sɛ ohuu nnipakuw kɛse no anisoadehu a ɛyɛ hu yi !\n","2020-05-21 21:45:23,749 Example #3\n","2020-05-21 21:45:23,749 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 21:45:23,749 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 21:45:23,749 \tHypothesis: Ná Yesu wɔ nkate fam , na na ohia mmoa , nanso Petro ne afoforo no daa daa .\n","2020-05-21 21:45:23,749 Validation result (greedy) at epoch  11, step    61000: bleu:  25.76, loss: 42700.7031, ppl:   5.0291, duration: 12.6539s\n","2020-05-21 21:45:34,502 Epoch  11 Step:    61100 Batch Loss:     1.587038 Tokens per Sec:    22125, Lr: 0.000300\n","2020-05-21 21:45:45,211 Epoch  11 Step:    61200 Batch Loss:     1.576608 Tokens per Sec:    21982, Lr: 0.000300\n","2020-05-21 21:45:55,976 Epoch  11 Step:    61300 Batch Loss:     1.876483 Tokens per Sec:    21903, Lr: 0.000300\n","2020-05-21 21:46:06,760 Epoch  11 Step:    61400 Batch Loss:     1.797146 Tokens per Sec:    22495, Lr: 0.000300\n","2020-05-21 21:46:17,622 Epoch  11 Step:    61500 Batch Loss:     1.726460 Tokens per Sec:    22219, Lr: 0.000300\n","2020-05-21 21:46:28,361 Epoch  11 Step:    61600 Batch Loss:     1.689947 Tokens per Sec:    22054, Lr: 0.000300\n","2020-05-21 21:46:39,351 Epoch  11 Step:    61700 Batch Loss:     1.641699 Tokens per Sec:    22333, Lr: 0.000300\n","2020-05-21 21:46:50,068 Epoch  11 Step:    61800 Batch Loss:     1.590890 Tokens per Sec:    22016, Lr: 0.000300\n","2020-05-21 21:47:00,895 Epoch  11 Step:    61900 Batch Loss:     1.751767 Tokens per Sec:    22311, Lr: 0.000300\n","2020-05-21 21:47:11,600 Epoch  11 Step:    62000 Batch Loss:     1.645348 Tokens per Sec:    22581, Lr: 0.000300\n","2020-05-21 21:47:23,703 Hooray! New best validation result [ppl]!\n","2020-05-21 21:47:23,703 Saving new checkpoint.\n","2020-05-21 21:47:23,973 Example #0\n","2020-05-21 21:47:23,973 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 21:47:23,974 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 21:47:23,974 \tHypothesis: Nsɛm a ɛtete saa maa tete nneɛma a na ɛyɛ hu a na ɛyɛ hu na ɛyɛ nwonwa .\n","2020-05-21 21:47:23,974 Example #1\n","2020-05-21 21:47:23,974 \tSource:     If so , you would be worthy of death .\n","2020-05-21 21:47:23,974 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 21:47:23,974 \tHypothesis: Sɛ saa a , anka wobɛfata sɛ wuwu .\n","2020-05-21 21:47:23,974 Example #2\n","2020-05-21 21:47:23,974 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 21:47:23,974 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 21:47:23,974 \tHypothesis: Oo , hwɛ sɛnea ɔsomafo Yohane ani gyei bere a ohuu nnipakuw kɛse no anisoadehu a ɛyɛ hu yi !\n","2020-05-21 21:47:23,974 Example #3\n","2020-05-21 21:47:23,975 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 21:47:23,975 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 21:47:23,975 \tHypothesis: Ná Yesu wɔ nkate fam ahokyere ne mmoa , nanso Petro ne afoforo no daa adi mpɛn pii .\n","2020-05-21 21:47:23,975 Validation result (greedy) at epoch  11, step    62000: bleu:  25.87, loss: 42574.2930, ppl:   5.0051, duration: 12.3751s\n","2020-05-21 21:47:34,722 Epoch  11 Step:    62100 Batch Loss:     1.732812 Tokens per Sec:    21815, Lr: 0.000300\n","2020-05-21 21:47:45,498 Epoch  11 Step:    62200 Batch Loss:     1.645030 Tokens per Sec:    22177, Lr: 0.000300\n","2020-05-21 21:47:56,321 Epoch  11 Step:    62300 Batch Loss:     1.672682 Tokens per Sec:    22453, Lr: 0.000300\n","2020-05-21 21:48:07,180 Epoch  11 Step:    62400 Batch Loss:     1.807276 Tokens per Sec:    22243, Lr: 0.000300\n","2020-05-21 21:48:17,851 Epoch  11 Step:    62500 Batch Loss:     1.934826 Tokens per Sec:    22159, Lr: 0.000300\n","2020-05-21 21:48:28,570 Epoch  11 Step:    62600 Batch Loss:     1.764820 Tokens per Sec:    22342, Lr: 0.000300\n","2020-05-21 21:48:39,362 Epoch  11 Step:    62700 Batch Loss:     1.605666 Tokens per Sec:    21973, Lr: 0.000300\n","2020-05-21 21:48:50,072 Epoch  11 Step:    62800 Batch Loss:     1.961544 Tokens per Sec:    22191, Lr: 0.000300\n","2020-05-21 21:49:00,886 Epoch  11 Step:    62900 Batch Loss:     1.610234 Tokens per Sec:    21878, Lr: 0.000300\n","2020-05-21 21:49:11,692 Epoch  11 Step:    63000 Batch Loss:     1.665118 Tokens per Sec:    22563, Lr: 0.000300\n","2020-05-21 21:49:23,894 Hooray! New best validation result [ppl]!\n","2020-05-21 21:49:23,894 Saving new checkpoint.\n","2020-05-21 21:49:24,123 Example #0\n","2020-05-21 21:49:24,123 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 21:49:24,123 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 21:49:24,123 \tHypothesis: Saa nsɛm no maa tete nneɛma no yɛɛ nea na ɛyɛ nwonwa sɛ wɔbɛbɔ wɔn ho ban na wɔabu wɔn ani agu so .\n","2020-05-21 21:49:24,123 Example #1\n","2020-05-21 21:49:24,123 \tSource:     If so , you would be worthy of death .\n","2020-05-21 21:49:24,123 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 21:49:24,123 \tHypothesis: Sɛ saa a , ɛnde na ɛsɛ sɛ wuwu .\n","2020-05-21 21:49:24,123 Example #2\n","2020-05-21 21:49:24,124 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 21:49:24,124 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 21:49:24,124 \tHypothesis: Oo , hwɛ anigye ara a ɔsomafo Yohane hui sɛ nnipakuw kɛse no anisoadehu a ɛyɛ hu yi !\n","2020-05-21 21:49:24,124 Example #3\n","2020-05-21 21:49:24,124 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 21:49:24,124 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 21:49:24,124 \tHypothesis: Ná Yesu wɔ nkate fam yaw , na na ohia mmoa , nanso Petro ne afoforo no daa .\n","2020-05-21 21:49:24,124 Validation result (greedy) at epoch  11, step    63000: bleu:  25.96, loss: 42475.9297, ppl:   4.9866, duration: 12.4317s\n","2020-05-21 21:49:34,849 Epoch  11 Step:    63100 Batch Loss:     2.011898 Tokens per Sec:    22105, Lr: 0.000300\n","2020-05-21 21:49:45,600 Epoch  11 Step:    63200 Batch Loss:     1.881241 Tokens per Sec:    22264, Lr: 0.000300\n","2020-05-21 21:49:56,450 Epoch  11 Step:    63300 Batch Loss:     1.652439 Tokens per Sec:    22314, Lr: 0.000300\n","2020-05-21 21:50:07,156 Epoch  11 Step:    63400 Batch Loss:     1.839536 Tokens per Sec:    21835, Lr: 0.000300\n","2020-05-21 21:50:17,843 Epoch  11 Step:    63500 Batch Loss:     1.776841 Tokens per Sec:    22157, Lr: 0.000300\n","2020-05-21 21:50:28,643 Epoch  11 Step:    63600 Batch Loss:     2.011692 Tokens per Sec:    22481, Lr: 0.000300\n","2020-05-21 21:50:39,450 Epoch  11 Step:    63700 Batch Loss:     1.535732 Tokens per Sec:    22320, Lr: 0.000300\n","2020-05-21 21:50:50,260 Epoch  11 Step:    63800 Batch Loss:     1.662118 Tokens per Sec:    21937, Lr: 0.000300\n","2020-05-21 21:51:01,077 Epoch  11 Step:    63900 Batch Loss:     1.730392 Tokens per Sec:    22054, Lr: 0.000300\n","2020-05-21 21:51:11,849 Epoch  11 Step:    64000 Batch Loss:     1.842535 Tokens per Sec:    22163, Lr: 0.000300\n","2020-05-21 21:51:24,031 Hooray! New best validation result [ppl]!\n","2020-05-21 21:51:24,032 Saving new checkpoint.\n","2020-05-21 21:51:24,262 Example #0\n","2020-05-21 21:51:24,263 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 21:51:24,263 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 21:51:24,263 \tHypothesis: Nsɛm a ɛtete saa no maa tete agumadi no dii nkonim sɛ wɔbɛbɔ wɔn ho ban na wɔabu wɔn ani agu so .\n","2020-05-21 21:51:24,263 Example #1\n","2020-05-21 21:51:24,263 \tSource:     If so , you would be worthy of death .\n","2020-05-21 21:51:24,263 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 21:51:24,263 \tHypothesis: Sɛ saa a , anka wobɛfata sɛ wuwu .\n","2020-05-21 21:51:24,263 Example #2\n","2020-05-21 21:51:24,263 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 21:51:24,263 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 21:51:24,263 \tHypothesis: Hwɛ sɛnea ɔsomafo Yohane ani gyei sɛ ohuu nnipakuw kɛse no anisoadehu a ɛyɛ hu yi !\n","2020-05-21 21:51:24,263 Example #3\n","2020-05-21 21:51:24,264 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 21:51:24,264 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 21:51:24,264 \tHypothesis: Ná Yesu wɔ nkate fam , na na ohia mmoa , nanso Petro ne afoforo no daa .\n","2020-05-21 21:51:24,264 Validation result (greedy) at epoch  11, step    64000: bleu:  25.96, loss: 42353.1641, ppl:   4.9635, duration: 12.4146s\n","2020-05-21 21:51:35,074 Epoch  11 Step:    64100 Batch Loss:     1.739244 Tokens per Sec:    22374, Lr: 0.000300\n","2020-05-21 21:51:45,940 Epoch  11 Step:    64200 Batch Loss:     1.928494 Tokens per Sec:    22202, Lr: 0.000300\n","2020-05-21 21:51:56,752 Epoch  11 Step:    64300 Batch Loss:     1.839805 Tokens per Sec:    22320, Lr: 0.000300\n","2020-05-21 21:52:07,506 Epoch  11 Step:    64400 Batch Loss:     2.168672 Tokens per Sec:    21784, Lr: 0.000300\n","2020-05-21 21:52:18,288 Epoch  11 Step:    64500 Batch Loss:     1.820998 Tokens per Sec:    22564, Lr: 0.000300\n","2020-05-21 21:52:29,091 Epoch  11 Step:    64600 Batch Loss:     1.891680 Tokens per Sec:    22266, Lr: 0.000300\n","2020-05-21 21:52:39,851 Epoch  11 Step:    64700 Batch Loss:     1.950783 Tokens per Sec:    21640, Lr: 0.000300\n","2020-05-21 21:52:50,525 Epoch  11 Step:    64800 Batch Loss:     1.549035 Tokens per Sec:    21696, Lr: 0.000300\n","2020-05-21 21:53:01,242 Epoch  11 Step:    64900 Batch Loss:     1.745394 Tokens per Sec:    22096, Lr: 0.000300\n","2020-05-21 21:53:12,018 Epoch  11 Step:    65000 Batch Loss:     1.766949 Tokens per Sec:    22227, Lr: 0.000300\n","2020-05-21 21:53:24,582 Hooray! New best validation result [ppl]!\n","2020-05-21 21:53:24,582 Saving new checkpoint.\n","2020-05-21 21:53:24,815 Example #0\n","2020-05-21 21:53:24,815 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 21:53:24,815 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 21:53:24,815 \tHypothesis: Nsɛm a ɛtete saa no maa tete nneɛma a na ɛyɛ hu sɛ wɔyɛ anibiannaso na wɔyɛ wɔn ade .\n","2020-05-21 21:53:24,815 Example #1\n","2020-05-21 21:53:24,816 \tSource:     If so , you would be worthy of death .\n","2020-05-21 21:53:24,816 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 21:53:24,816 \tHypothesis: Sɛ saa a , anka wobɛfata sɛ wuwu .\n","2020-05-21 21:53:24,816 Example #2\n","2020-05-21 21:53:24,816 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 21:53:24,816 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 21:53:24,816 \tHypothesis: Hwɛ sɛnea ɔsomafo Yohane ani gyei bere a ohui sɛ nnipakuw kɛse no anisoadehu a ɛyɛ hu yi !\n","2020-05-21 21:53:24,816 Example #3\n","2020-05-21 21:53:24,816 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 21:53:24,816 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 21:53:24,816 \tHypothesis: Ná Yesu wɔ nkate fam ahokyere ne mmoa , nanso Petro ne afoforo no daa nna adi mpɛn pii .\n","2020-05-21 21:53:24,816 Validation result (greedy) at epoch  11, step    65000: bleu:  25.54, loss: 42330.4609, ppl:   4.9592, duration: 12.7982s\n","2020-05-21 21:53:35,548 Epoch  11 Step:    65100 Batch Loss:     1.758731 Tokens per Sec:    22354, Lr: 0.000300\n","2020-05-21 21:53:46,381 Epoch  11 Step:    65200 Batch Loss:     1.927175 Tokens per Sec:    22433, Lr: 0.000300\n","2020-05-21 21:53:57,228 Epoch  11 Step:    65300 Batch Loss:     1.994954 Tokens per Sec:    22391, Lr: 0.000300\n","2020-05-21 21:54:08,072 Epoch  11 Step:    65400 Batch Loss:     1.776746 Tokens per Sec:    22437, Lr: 0.000300\n","2020-05-21 21:54:18,871 Epoch  11 Step:    65500 Batch Loss:     1.982504 Tokens per Sec:    22495, Lr: 0.000300\n","2020-05-21 21:54:29,584 Epoch  11 Step:    65600 Batch Loss:     1.927567 Tokens per Sec:    22161, Lr: 0.000300\n","2020-05-21 21:54:40,372 Epoch  11 Step:    65700 Batch Loss:     1.577390 Tokens per Sec:    22192, Lr: 0.000300\n","2020-05-21 21:54:51,126 Epoch  11 Step:    65800 Batch Loss:     1.719332 Tokens per Sec:    22173, Lr: 0.000300\n","2020-05-21 21:55:01,826 Epoch  11 Step:    65900 Batch Loss:     1.740276 Tokens per Sec:    22165, Lr: 0.000300\n","2020-05-21 21:55:12,554 Epoch  11 Step:    66000 Batch Loss:     2.613891 Tokens per Sec:    22270, Lr: 0.000300\n","2020-05-21 21:55:24,738 Hooray! New best validation result [ppl]!\n","2020-05-21 21:55:24,738 Saving new checkpoint.\n","2020-05-21 21:55:24,983 Example #0\n","2020-05-21 21:55:24,983 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 21:55:24,983 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 21:55:24,983 \tHypothesis: Nsɛm a ɛtete saa no maa tete nneɛma a na ɛyɛ nwonwa sɛ wɔbɛbɔ wɔn ho ban na wɔabu wɔn ani agu so .\n","2020-05-21 21:55:24,984 Example #1\n","2020-05-21 21:55:24,984 \tSource:     If so , you would be worthy of death .\n","2020-05-21 21:55:24,984 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 21:55:24,984 \tHypothesis: Sɛ saa a , anka wobɛfata sɛ wuwu .\n","2020-05-21 21:55:24,984 Example #2\n","2020-05-21 21:55:24,984 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 21:55:24,984 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 21:55:24,984 \tHypothesis: Oo , hwɛ sɛnea ɔsomafo Yohane ani gyei bere a ohui sɛ nnipakuw kɛse no anisoadehu a ɛyɛ hu yi !\n","2020-05-21 21:55:24,984 Example #3\n","2020-05-21 21:55:24,984 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 21:55:24,984 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 21:55:24,984 \tHypothesis: Ná Yesu wɔ nkate fam haw ne hia a ehia sɛ ɔboa no , nanso Petro ne afoforo no daa .\n","2020-05-21 21:55:24,985 Validation result (greedy) at epoch  11, step    66000: bleu:  25.58, loss: 42035.4570, ppl:   4.9042, duration: 12.4299s\n","2020-05-21 21:55:35,839 Epoch  11 Step:    66100 Batch Loss:     1.693928 Tokens per Sec:    22177, Lr: 0.000300\n","2020-05-21 21:55:46,656 Epoch  11 Step:    66200 Batch Loss:     1.718923 Tokens per Sec:    22110, Lr: 0.000300\n","2020-05-21 21:55:57,520 Epoch  11 Step:    66300 Batch Loss:     1.781920 Tokens per Sec:    22481, Lr: 0.000300\n","2020-05-21 21:56:08,239 Epoch  11 Step:    66400 Batch Loss:     1.736492 Tokens per Sec:    21882, Lr: 0.000300\n","2020-05-21 21:56:18,926 Epoch  11 Step:    66500 Batch Loss:     1.924015 Tokens per Sec:    21934, Lr: 0.000300\n","2020-05-21 21:56:28,577 Epoch  11: total training loss 10867.10\n","2020-05-21 21:56:28,577 EPOCH 12\n","2020-05-21 21:56:30,346 Epoch  12 Step:    66600 Batch Loss:     1.563246 Tokens per Sec:    13189, Lr: 0.000300\n","2020-05-21 21:56:41,185 Epoch  12 Step:    66700 Batch Loss:     1.848273 Tokens per Sec:    22100, Lr: 0.000300\n","2020-05-21 21:56:51,976 Epoch  12 Step:    66800 Batch Loss:     1.511586 Tokens per Sec:    21734, Lr: 0.000300\n","2020-05-21 21:57:02,806 Epoch  12 Step:    66900 Batch Loss:     1.707781 Tokens per Sec:    21851, Lr: 0.000300\n","2020-05-21 21:57:13,550 Epoch  12 Step:    67000 Batch Loss:     1.580806 Tokens per Sec:    22429, Lr: 0.000300\n","2020-05-21 21:57:25,570 Example #0\n","2020-05-21 21:57:25,570 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 21:57:25,570 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 21:57:25,570 \tHypothesis: Nsɛm a ɛtete saa no maa tete aguadi ho dwiriw wɔn sɛ wɔbɛbɔ wɔn ho ban na wɔabu wɔn ani agu so .\n","2020-05-21 21:57:25,570 Example #1\n","2020-05-21 21:57:25,570 \tSource:     If so , you would be worthy of death .\n","2020-05-21 21:57:25,570 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 21:57:25,570 \tHypothesis: Sɛ saa a , anka wobɛfata owu .\n","2020-05-21 21:57:25,570 Example #2\n","2020-05-21 21:57:25,570 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 21:57:25,571 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 21:57:25,571 \tHypothesis: Oo , hwɛ sɛnea ɔsomafo Yohane ani gyei sɛ ohuu nnipakuw kɛse no anisoadehu a ɛyɛ hu yi !\n","2020-05-21 21:57:25,571 Example #3\n","2020-05-21 21:57:25,571 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 21:57:25,571 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 21:57:25,571 \tHypothesis: Ná Yesu wɔ nkate fam haw ne mmoa , nanso Petro ne afoforo no daa .\n","2020-05-21 21:57:25,571 Validation result (greedy) at epoch  12, step    67000: bleu:  25.85, loss: 42130.2773, ppl:   4.9218, duration: 12.0212s\n","2020-05-21 21:57:36,380 Epoch  12 Step:    67100 Batch Loss:     1.791293 Tokens per Sec:    22471, Lr: 0.000300\n","2020-05-21 21:57:47,105 Epoch  12 Step:    67200 Batch Loss:     1.703264 Tokens per Sec:    22109, Lr: 0.000300\n","2020-05-21 21:57:57,872 Epoch  12 Step:    67300 Batch Loss:     1.740452 Tokens per Sec:    22348, Lr: 0.000300\n","2020-05-21 21:58:08,660 Epoch  12 Step:    67400 Batch Loss:     1.936906 Tokens per Sec:    22330, Lr: 0.000300\n","2020-05-21 21:58:19,408 Epoch  12 Step:    67500 Batch Loss:     1.750787 Tokens per Sec:    22398, Lr: 0.000300\n","2020-05-21 21:58:30,107 Epoch  12 Step:    67600 Batch Loss:     2.456560 Tokens per Sec:    22401, Lr: 0.000300\n","2020-05-21 21:58:40,788 Epoch  12 Step:    67700 Batch Loss:     1.687206 Tokens per Sec:    22014, Lr: 0.000300\n","2020-05-21 21:58:51,573 Epoch  12 Step:    67800 Batch Loss:     1.703570 Tokens per Sec:    22214, Lr: 0.000300\n","2020-05-21 21:59:02,261 Epoch  12 Step:    67900 Batch Loss:     1.923750 Tokens per Sec:    22053, Lr: 0.000300\n","2020-05-21 21:59:13,112 Epoch  12 Step:    68000 Batch Loss:     1.959711 Tokens per Sec:    22655, Lr: 0.000300\n","2020-05-21 21:59:24,885 Example #0\n","2020-05-21 21:59:24,885 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 21:59:24,885 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 21:59:24,885 \tHypothesis: Nsɛm a ɛtete saa no maa tete nkurow a na ɛyɛ hu sɛ wɔagye wɔn atom na wɔyɛ anibiannaso .\n","2020-05-21 21:59:24,885 Example #1\n","2020-05-21 21:59:24,885 \tSource:     If so , you would be worthy of death .\n","2020-05-21 21:59:24,886 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 21:59:24,886 \tHypothesis: Sɛ saa a , anka wobɛfata sɛ wuwu .\n","2020-05-21 21:59:24,886 Example #2\n","2020-05-21 21:59:24,886 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 21:59:24,886 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 21:59:24,886 \tHypothesis: Oo , hwɛ sɛnea ɔsomafo Yohane ani gyei bere a ohuu nnipakuw kɛse no anisoadehu a ɛyɛ hu yi !\n","2020-05-21 21:59:24,886 Example #3\n","2020-05-21 21:59:24,886 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 21:59:24,886 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 21:59:24,886 \tHypothesis: Ná Yesu wɔ nkate fam , na na ohia mmoa , nanso Petro ne afoforo no daa .\n","2020-05-21 21:59:24,886 Validation result (greedy) at epoch  12, step    68000: bleu:  26.38, loss: 42154.2266, ppl:   4.9262, duration: 11.7743s\n","2020-05-21 21:59:35,644 Epoch  12 Step:    68100 Batch Loss:     1.713437 Tokens per Sec:    22166, Lr: 0.000300\n","2020-05-21 21:59:46,465 Epoch  12 Step:    68200 Batch Loss:     2.041981 Tokens per Sec:    22622, Lr: 0.000300\n","2020-05-21 21:59:57,136 Epoch  12 Step:    68300 Batch Loss:     1.709425 Tokens per Sec:    22049, Lr: 0.000300\n","2020-05-21 22:00:07,847 Epoch  12 Step:    68400 Batch Loss:     1.858787 Tokens per Sec:    22071, Lr: 0.000300\n","2020-05-21 22:00:18,599 Epoch  12 Step:    68500 Batch Loss:     1.804831 Tokens per Sec:    22271, Lr: 0.000300\n","2020-05-21 22:00:29,431 Epoch  12 Step:    68600 Batch Loss:     1.991322 Tokens per Sec:    22377, Lr: 0.000300\n","2020-05-21 22:00:40,259 Epoch  12 Step:    68700 Batch Loss:     1.869286 Tokens per Sec:    21887, Lr: 0.000300\n","2020-05-21 22:00:50,992 Epoch  12 Step:    68800 Batch Loss:     1.713604 Tokens per Sec:    22003, Lr: 0.000300\n","2020-05-21 22:01:01,814 Epoch  12 Step:    68900 Batch Loss:     1.955697 Tokens per Sec:    22412, Lr: 0.000300\n","2020-05-21 22:01:12,657 Epoch  12 Step:    69000 Batch Loss:     1.910276 Tokens per Sec:    22373, Lr: 0.000300\n","2020-05-21 22:01:24,774 Hooray! New best validation result [ppl]!\n","2020-05-21 22:01:24,775 Saving new checkpoint.\n","2020-05-21 22:01:25,010 Example #0\n","2020-05-21 22:01:25,011 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 22:01:25,011 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 22:01:25,011 \tHypothesis: Nsɛm a ɛtete saa no maa tete nkurow no dii nkonim sɛ wobegye wɔn ani na wɔabu wɔn ani agu so .\n","2020-05-21 22:01:25,011 Example #1\n","2020-05-21 22:01:25,011 \tSource:     If so , you would be worthy of death .\n","2020-05-21 22:01:25,011 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 22:01:25,011 \tHypothesis: Sɛ ɛte saa a , anka wobɛfata sɛ wuwu .\n","2020-05-21 22:01:25,011 Example #2\n","2020-05-21 22:01:25,012 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 22:01:25,012 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 22:01:25,012 \tHypothesis: Oo , hwɛ sɛnea ɔsomafo Yohane ani gyei bere a ohuu nnipakuw kɛse no anisoadehu a ɛyɛ nwonwa yi !\n","2020-05-21 22:01:25,012 Example #3\n","2020-05-21 22:01:25,012 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 22:01:25,012 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 22:01:25,012 \tHypothesis: Ná Yesu wɔ nkate fam yaw , na ohia mmoa , nanso Petro ne afoforo no daa .\n","2020-05-21 22:01:25,012 Validation result (greedy) at epoch  12, step    69000: bleu:  26.28, loss: 41889.3984, ppl:   4.8771, duration: 12.3550s\n","2020-05-21 22:01:35,795 Epoch  12 Step:    69100 Batch Loss:     1.876211 Tokens per Sec:    22362, Lr: 0.000300\n","2020-05-21 22:01:46,546 Epoch  12 Step:    69200 Batch Loss:     2.029723 Tokens per Sec:    22071, Lr: 0.000300\n","2020-05-21 22:01:57,325 Epoch  12 Step:    69300 Batch Loss:     1.768298 Tokens per Sec:    22309, Lr: 0.000300\n","2020-05-21 22:02:08,225 Epoch  12 Step:    69400 Batch Loss:     1.644811 Tokens per Sec:    21915, Lr: 0.000300\n","2020-05-21 22:02:18,906 Epoch  12 Step:    69500 Batch Loss:     1.864196 Tokens per Sec:    21899, Lr: 0.000300\n","2020-05-21 22:02:29,710 Epoch  12 Step:    69600 Batch Loss:     1.817587 Tokens per Sec:    22166, Lr: 0.000300\n","2020-05-21 22:02:40,510 Epoch  12 Step:    69700 Batch Loss:     1.655965 Tokens per Sec:    22468, Lr: 0.000300\n","2020-05-21 22:02:51,200 Epoch  12 Step:    69800 Batch Loss:     1.468245 Tokens per Sec:    22189, Lr: 0.000300\n","2020-05-21 22:03:01,985 Epoch  12 Step:    69900 Batch Loss:     1.938439 Tokens per Sec:    22348, Lr: 0.000300\n","2020-05-21 22:03:12,829 Epoch  12 Step:    70000 Batch Loss:     1.665029 Tokens per Sec:    22272, Lr: 0.000300\n","2020-05-21 22:03:25,027 Hooray! New best validation result [ppl]!\n","2020-05-21 22:03:25,027 Saving new checkpoint.\n","2020-05-21 22:03:25,297 Example #0\n","2020-05-21 22:03:25,297 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 22:03:25,298 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 22:03:25,298 \tHypothesis: Nsɛm a ɛtete saa maa tete agumadi no dii adanse sɛ ɛyɛ aniberesɛm na ɛyɛ nwonwa .\n","2020-05-21 22:03:25,298 Example #1\n","2020-05-21 22:03:25,298 \tSource:     If so , you would be worthy of death .\n","2020-05-21 22:03:25,298 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 22:03:25,298 \tHypothesis: Sɛ ɛte saa a , anka wobɛfata sɛ wuwu .\n","2020-05-21 22:03:25,298 Example #2\n","2020-05-21 22:03:25,298 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 22:03:25,298 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 22:03:25,298 \tHypothesis: Oo , hwɛ sɛnea ɔsomafo Yohane ani gyei sɛ ohuu nnipakuw kɛse no anisoadehu a ɛyɛ nwonwa yi !\n","2020-05-21 22:03:25,298 Example #3\n","2020-05-21 22:03:25,299 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 22:03:25,299 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 22:03:25,299 \tHypothesis: Ná Yesu wɔ nkate fam ahokyere ne hia mu , nanso Petro ne afoforo no daa .\n","2020-05-21 22:03:25,299 Validation result (greedy) at epoch  12, step    70000: bleu:  26.01, loss: 41850.4258, ppl:   4.8700, duration: 12.4700s\n","2020-05-21 22:03:36,164 Epoch  12 Step:    70100 Batch Loss:     1.683439 Tokens per Sec:    22617, Lr: 0.000300\n","2020-05-21 22:03:46,785 Epoch  12 Step:    70200 Batch Loss:     1.682979 Tokens per Sec:    21985, Lr: 0.000300\n","2020-05-21 22:03:57,531 Epoch  12 Step:    70300 Batch Loss:     1.795263 Tokens per Sec:    22036, Lr: 0.000300\n","2020-05-21 22:04:08,322 Epoch  12 Step:    70400 Batch Loss:     1.673757 Tokens per Sec:    22142, Lr: 0.000300\n","2020-05-21 22:04:19,058 Epoch  12 Step:    70500 Batch Loss:     1.630619 Tokens per Sec:    22074, Lr: 0.000300\n","2020-05-21 22:04:29,824 Epoch  12 Step:    70600 Batch Loss:     1.493163 Tokens per Sec:    22202, Lr: 0.000300\n","2020-05-21 22:04:40,629 Epoch  12 Step:    70700 Batch Loss:     1.795636 Tokens per Sec:    22443, Lr: 0.000300\n","2020-05-21 22:04:51,399 Epoch  12 Step:    70800 Batch Loss:     1.561071 Tokens per Sec:    22058, Lr: 0.000300\n","2020-05-21 22:05:02,108 Epoch  12 Step:    70900 Batch Loss:     1.913081 Tokens per Sec:    22158, Lr: 0.000300\n","2020-05-21 22:05:12,961 Epoch  12 Step:    71000 Batch Loss:     1.884084 Tokens per Sec:    22458, Lr: 0.000300\n","2020-05-21 22:05:25,370 Hooray! New best validation result [ppl]!\n","2020-05-21 22:05:25,370 Saving new checkpoint.\n","2020-05-21 22:05:25,601 Example #0\n","2020-05-21 22:05:25,601 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 22:05:25,601 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 22:05:25,601 \tHypothesis: Nsɛm a ɛtete saa maa tete agumadi no dii adanse sɛ ɛyɛ den na ɛyɛ aniberesɛm .\n","2020-05-21 22:05:25,601 Example #1\n","2020-05-21 22:05:25,601 \tSource:     If so , you would be worthy of death .\n","2020-05-21 22:05:25,601 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 22:05:25,601 \tHypothesis: Sɛ ɛte saa a , anka wobɛfata owu .\n","2020-05-21 22:05:25,601 Example #2\n","2020-05-21 22:05:25,602 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 22:05:25,602 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 22:05:25,602 \tHypothesis: Oo , hwɛ sɛnea ɔsomafo Yohane ani gyei sɛ ohuu nnipakuw kɛse no anisoadehu a ɛyɛ hu yi !\n","2020-05-21 22:05:25,602 Example #3\n","2020-05-21 22:05:25,602 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 22:05:25,602 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 22:05:25,602 \tHypothesis: Ná Yesu wɔ nkate fam , na ohia mmoa , nanso Petro ne afoforo no daa so ara da .\n","2020-05-21 22:05:25,602 Validation result (greedy) at epoch  12, step    71000: bleu:  26.03, loss: 41709.2383, ppl:   4.8440, duration: 12.6411s\n","2020-05-21 22:05:36,286 Epoch  12 Step:    71100 Batch Loss:     1.838254 Tokens per Sec:    22279, Lr: 0.000300\n","2020-05-21 22:05:47,025 Epoch  12 Step:    71200 Batch Loss:     1.854517 Tokens per Sec:    22190, Lr: 0.000300\n","2020-05-21 22:05:57,788 Epoch  12 Step:    71300 Batch Loss:     1.937563 Tokens per Sec:    22052, Lr: 0.000300\n","2020-05-21 22:06:08,586 Epoch  12 Step:    71400 Batch Loss:     1.727061 Tokens per Sec:    22229, Lr: 0.000300\n","2020-05-21 22:06:19,347 Epoch  12 Step:    71500 Batch Loss:     1.747447 Tokens per Sec:    22261, Lr: 0.000300\n","2020-05-21 22:06:30,127 Epoch  12 Step:    71600 Batch Loss:     1.823141 Tokens per Sec:    22416, Lr: 0.000300\n","2020-05-21 22:06:40,869 Epoch  12 Step:    71700 Batch Loss:     1.709538 Tokens per Sec:    22018, Lr: 0.000300\n","2020-05-21 22:06:51,573 Epoch  12 Step:    71800 Batch Loss:     1.823511 Tokens per Sec:    22034, Lr: 0.000300\n","2020-05-21 22:07:02,199 Epoch  12 Step:    71900 Batch Loss:     1.773130 Tokens per Sec:    21993, Lr: 0.000300\n","2020-05-21 22:07:13,005 Epoch  12 Step:    72000 Batch Loss:     1.828594 Tokens per Sec:    22208, Lr: 0.000300\n","2020-05-21 22:07:26,345 Hooray! New best validation result [ppl]!\n","2020-05-21 22:07:26,346 Saving new checkpoint.\n","2020-05-21 22:07:26,579 Example #0\n","2020-05-21 22:07:26,579 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 22:07:26,579 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 22:07:26,579 \tHypothesis: Nsɛm a ɛtete saa maa tete nneɛma dii adanse sɛ ɛyɛ den sɛ wɔbɛbɔ wɔn ho ban na wɔabu wɔn ani agu so .\n","2020-05-21 22:07:26,579 Example #1\n","2020-05-21 22:07:26,580 \tSource:     If so , you would be worthy of death .\n","2020-05-21 22:07:26,580 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 22:07:26,580 \tHypothesis: Sɛ saa a , anka wobɛfata owu .\n","2020-05-21 22:07:26,580 Example #2\n","2020-05-21 22:07:26,580 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 22:07:26,580 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 22:07:26,580 \tHypothesis: Oo , hwɛ sɛnea ɔsomafo Yohane ani gyei sɛ ohuu nnipakuw kɛse no anisoadehu a ɛyɛ anigye yi !\n","2020-05-21 22:07:26,580 Example #3\n","2020-05-21 22:07:26,580 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 22:07:26,580 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 22:07:26,580 \tHypothesis: Ná Yesu wɔ nkate fam , na na ohia mmoa , nanso Petro ne afoforo no daa adi mpɛn pii .\n","2020-05-21 22:07:26,581 Validation result (greedy) at epoch  12, step    72000: bleu:  26.45, loss: 41678.9492, ppl:   4.8385, duration: 13.5746s\n","2020-05-21 22:07:37,294 Epoch  12 Step:    72100 Batch Loss:     1.628102 Tokens per Sec:    21925, Lr: 0.000300\n","2020-05-21 22:07:48,096 Epoch  12 Step:    72200 Batch Loss:     1.668787 Tokens per Sec:    22107, Lr: 0.000300\n","2020-05-21 22:07:58,907 Epoch  12 Step:    72300 Batch Loss:     2.015127 Tokens per Sec:    22411, Lr: 0.000300\n","2020-05-21 22:08:09,623 Epoch  12 Step:    72400 Batch Loss:     1.609432 Tokens per Sec:    22171, Lr: 0.000300\n","2020-05-21 22:08:20,352 Epoch  12 Step:    72500 Batch Loss:     2.130917 Tokens per Sec:    21851, Lr: 0.000300\n","2020-05-21 22:08:31,247 Epoch  12 Step:    72600 Batch Loss:     1.655468 Tokens per Sec:    22154, Lr: 0.000300\n","2020-05-21 22:08:35,951 Epoch  12: total training loss 10734.77\n","2020-05-21 22:08:35,951 EPOCH 13\n","2020-05-21 22:08:42,818 Epoch  13 Step:    72700 Batch Loss:     1.936442 Tokens per Sec:    19815, Lr: 0.000300\n","2020-05-21 22:08:53,620 Epoch  13 Step:    72800 Batch Loss:     1.797524 Tokens per Sec:    21993, Lr: 0.000300\n","2020-05-21 22:09:04,454 Epoch  13 Step:    72900 Batch Loss:     1.965978 Tokens per Sec:    22363, Lr: 0.000300\n","2020-05-21 22:09:15,264 Epoch  13 Step:    73000 Batch Loss:     1.750520 Tokens per Sec:    22363, Lr: 0.000300\n","2020-05-21 22:09:27,311 Hooray! New best validation result [ppl]!\n","2020-05-21 22:09:27,311 Saving new checkpoint.\n","2020-05-21 22:09:27,540 Example #0\n","2020-05-21 22:09:27,540 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 22:09:27,540 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 22:09:27,540 \tHypothesis: Nsɛm a ɛtete saa maa tete nneɛma a na ɛyɛ hu no dii adanse sɛ ɛyɛ aniwu na ɛyɛ aniberesɛm .\n","2020-05-21 22:09:27,540 Example #1\n","2020-05-21 22:09:27,541 \tSource:     If so , you would be worthy of death .\n","2020-05-21 22:09:27,541 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 22:09:27,541 \tHypothesis: Sɛ saa a , anka wobɛfata owu .\n","2020-05-21 22:09:27,541 Example #2\n","2020-05-21 22:09:27,541 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 22:09:27,541 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 22:09:27,541 \tHypothesis: Oo , hwɛ sɛnea ɔsomafo Yohane ani gyei bere a ohui sɛ nnipakuw kɛse no anisoadehu a ɛyɛ hu yi !\n","2020-05-21 22:09:27,541 Example #3\n","2020-05-21 22:09:27,541 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 22:09:27,541 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 22:09:27,541 \tHypothesis: Ná Yesu wɔ nkate fam , na na ohia mmoa , nanso Petro ne afoforo no daa .\n","2020-05-21 22:09:27,541 Validation result (greedy) at epoch  13, step    73000: bleu:  26.31, loss: 41674.2695, ppl:   4.8376, duration: 12.2769s\n","2020-05-21 22:09:38,395 Epoch  13 Step:    73100 Batch Loss:     1.431198 Tokens per Sec:    22124, Lr: 0.000300\n","2020-05-21 22:09:49,142 Epoch  13 Step:    73200 Batch Loss:     1.553703 Tokens per Sec:    21858, Lr: 0.000300\n","2020-05-21 22:09:59,770 Epoch  13 Step:    73300 Batch Loss:     1.982315 Tokens per Sec:    21563, Lr: 0.000300\n","2020-05-21 22:10:10,602 Epoch  13 Step:    73400 Batch Loss:     1.593791 Tokens per Sec:    22389, Lr: 0.000300\n","2020-05-21 22:10:21,384 Epoch  13 Step:    73500 Batch Loss:     1.721212 Tokens per Sec:    22502, Lr: 0.000300\n","2020-05-21 22:10:32,198 Epoch  13 Step:    73600 Batch Loss:     2.117959 Tokens per Sec:    22193, Lr: 0.000300\n","2020-05-21 22:10:42,912 Epoch  13 Step:    73700 Batch Loss:     1.772450 Tokens per Sec:    22329, Lr: 0.000300\n","2020-05-21 22:10:53,654 Epoch  13 Step:    73800 Batch Loss:     1.774506 Tokens per Sec:    22292, Lr: 0.000300\n","2020-05-21 22:11:04,412 Epoch  13 Step:    73900 Batch Loss:     1.708618 Tokens per Sec:    22078, Lr: 0.000300\n","2020-05-21 22:11:15,229 Epoch  13 Step:    74000 Batch Loss:     1.599108 Tokens per Sec:    22198, Lr: 0.000300\n","2020-05-21 22:11:27,852 Hooray! New best validation result [ppl]!\n","2020-05-21 22:11:27,852 Saving new checkpoint.\n","2020-05-21 22:11:28,087 Example #0\n","2020-05-21 22:11:28,087 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 22:11:28,087 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 22:11:28,087 \tHypothesis: Nsɛm a ɛtete saa no maa tete agumadi no dii adanse sɛ ɛyɛ den na ɛyɛ nwonwa .\n","2020-05-21 22:11:28,087 Example #1\n","2020-05-21 22:11:28,087 \tSource:     If so , you would be worthy of death .\n","2020-05-21 22:11:28,087 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 22:11:28,088 \tHypothesis: Sɛ saa a , anka wobɛfata sɛ wuwu .\n","2020-05-21 22:11:28,088 Example #2\n","2020-05-21 22:11:28,088 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 22:11:28,088 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 22:11:28,088 \tHypothesis: Oo , hwɛ sɛnea ɔsomafo Yohane ani gyei bere a ohuu nnipakuw kɛse no anisoadehu a ɛyɛ nwonwa yi !\n","2020-05-21 22:11:28,088 Example #3\n","2020-05-21 22:11:28,088 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 22:11:28,088 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 22:11:28,088 \tHypothesis: Ná Yesu wɔ nkate fam , na na ohia mmoa , nanso Petro ne afoforo no daa adi mpɛn pii .\n","2020-05-21 22:11:28,088 Validation result (greedy) at epoch  13, step    74000: bleu:  26.06, loss: 41626.0781, ppl:   4.8288, duration: 12.8587s\n","2020-05-21 22:11:38,969 Epoch  13 Step:    74100 Batch Loss:     1.856456 Tokens per Sec:    22263, Lr: 0.000300\n","2020-05-21 22:11:49,771 Epoch  13 Step:    74200 Batch Loss:     1.692604 Tokens per Sec:    21921, Lr: 0.000300\n","2020-05-21 22:12:00,614 Epoch  13 Step:    74300 Batch Loss:     1.760284 Tokens per Sec:    22473, Lr: 0.000300\n","2020-05-21 22:12:11,403 Epoch  13 Step:    74400 Batch Loss:     1.688556 Tokens per Sec:    22314, Lr: 0.000300\n","2020-05-21 22:12:22,246 Epoch  13 Step:    74500 Batch Loss:     1.744477 Tokens per Sec:    22423, Lr: 0.000300\n","2020-05-21 22:12:33,084 Epoch  13 Step:    74600 Batch Loss:     1.785943 Tokens per Sec:    22349, Lr: 0.000300\n","2020-05-21 22:12:43,888 Epoch  13 Step:    74700 Batch Loss:     1.451743 Tokens per Sec:    21897, Lr: 0.000300\n","2020-05-21 22:12:54,617 Epoch  13 Step:    74800 Batch Loss:     1.755789 Tokens per Sec:    22271, Lr: 0.000300\n","2020-05-21 22:13:05,352 Epoch  13 Step:    74900 Batch Loss:     1.648850 Tokens per Sec:    22041, Lr: 0.000300\n","2020-05-21 22:13:16,196 Epoch  13 Step:    75000 Batch Loss:     1.656169 Tokens per Sec:    22407, Lr: 0.000300\n","2020-05-21 22:13:28,406 Hooray! New best validation result [ppl]!\n","2020-05-21 22:13:28,406 Saving new checkpoint.\n","2020-05-21 22:13:28,683 Example #0\n","2020-05-21 22:13:28,683 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 22:13:28,683 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 22:13:28,683 \tHypothesis: Nsɛm a ɛtete saa no maa tete aguadi ahorow no dii adanse sɛ ɛyɛ den na ɛyɛ anibiannaso .\n","2020-05-21 22:13:28,683 Example #1\n","2020-05-21 22:13:28,683 \tSource:     If so , you would be worthy of death .\n","2020-05-21 22:13:28,683 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 22:13:28,684 \tHypothesis: Sɛ saa a , anka wobɛfata sɛ wuwu .\n","2020-05-21 22:13:28,684 Example #2\n","2020-05-21 22:13:28,684 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 22:13:28,684 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 22:13:28,684 \tHypothesis: Hwɛ sɛnea ɔsomafo Yohane ani gyei bere a ohuu nnipakuw kɛse no anisoadehu a ɛyɛ hu yi !\n","2020-05-21 22:13:28,684 Example #3\n","2020-05-21 22:13:28,684 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 22:13:28,684 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 22:13:28,684 \tHypothesis: Ná Yesu wɔ nkate fam , na ohia mmoa , nanso Petro ne afoforo no daa adi mpɛn pii .\n","2020-05-21 22:13:28,684 Validation result (greedy) at epoch  13, step    75000: bleu:  26.66, loss: 41343.6875, ppl:   4.7775, duration: 12.4882s\n","2020-05-21 22:13:39,504 Epoch  13 Step:    75100 Batch Loss:     1.703858 Tokens per Sec:    22397, Lr: 0.000300\n","2020-05-21 22:13:50,300 Epoch  13 Step:    75200 Batch Loss:     1.744171 Tokens per Sec:    22316, Lr: 0.000300\n","2020-05-21 22:14:01,090 Epoch  13 Step:    75300 Batch Loss:     1.642923 Tokens per Sec:    22354, Lr: 0.000300\n","2020-05-21 22:14:11,901 Epoch  13 Step:    75400 Batch Loss:     1.736856 Tokens per Sec:    22588, Lr: 0.000300\n","2020-05-21 22:14:22,474 Epoch  13 Step:    75500 Batch Loss:     1.807152 Tokens per Sec:    21581, Lr: 0.000300\n","2020-05-21 22:14:33,289 Epoch  13 Step:    75600 Batch Loss:     1.697907 Tokens per Sec:    22506, Lr: 0.000300\n","2020-05-21 22:14:44,083 Epoch  13 Step:    75700 Batch Loss:     1.882063 Tokens per Sec:    22002, Lr: 0.000300\n","2020-05-21 22:14:54,868 Epoch  13 Step:    75800 Batch Loss:     1.722735 Tokens per Sec:    22302, Lr: 0.000300\n","2020-05-21 22:15:05,603 Epoch  13 Step:    75900 Batch Loss:     1.839254 Tokens per Sec:    22358, Lr: 0.000300\n","2020-05-21 22:15:16,323 Epoch  13 Step:    76000 Batch Loss:     1.906037 Tokens per Sec:    22048, Lr: 0.000300\n","2020-05-21 22:15:28,788 Example #0\n","2020-05-21 22:15:28,788 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 22:15:28,788 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 22:15:28,788 \tHypothesis: Nsɛm a ɛtete saa maa tete nneɛma a na ɛyɛ hu a na ɛyɛ hu sɛ wɔresɛe wɔn ani na wɔabu wɔn ani agu so .\n","2020-05-21 22:15:28,788 Example #1\n","2020-05-21 22:15:28,789 \tSource:     If so , you would be worthy of death .\n","2020-05-21 22:15:28,789 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 22:15:28,789 \tHypothesis: Sɛ saa a , anka wobɛfata owu .\n","2020-05-21 22:15:28,789 Example #2\n","2020-05-21 22:15:28,789 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 22:15:28,789 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 22:15:28,789 \tHypothesis: Oo , hwɛ sɛnea ɔsomafo Yohane ani gyei bere a ohuu nnipakuw kɛse no anisoadehu a ɛyɛ hu yi !\n","2020-05-21 22:15:28,789 Example #3\n","2020-05-21 22:15:28,789 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 22:15:28,789 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 22:15:28,789 \tHypothesis: Ná Yesu wɔ nkate fam haw ne hia a ehia sɛ ɔboa no , nanso Petro ne afoforo no daa .\n","2020-05-21 22:15:28,789 Validation result (greedy) at epoch  13, step    76000: bleu:  26.23, loss: 41534.3711, ppl:   4.8121, duration: 12.4663s\n","2020-05-21 22:15:39,617 Epoch  13 Step:    76100 Batch Loss:     1.773197 Tokens per Sec:    22407, Lr: 0.000300\n","2020-05-21 22:15:50,573 Epoch  13 Step:    76200 Batch Loss:     1.844555 Tokens per Sec:    22712, Lr: 0.000300\n","2020-05-21 22:16:01,280 Epoch  13 Step:    76300 Batch Loss:     1.706404 Tokens per Sec:    21880, Lr: 0.000300\n","2020-05-21 22:16:11,987 Epoch  13 Step:    76400 Batch Loss:     1.856584 Tokens per Sec:    22093, Lr: 0.000300\n","2020-05-21 22:16:22,771 Epoch  13 Step:    76500 Batch Loss:     1.809680 Tokens per Sec:    21834, Lr: 0.000300\n","2020-05-21 22:16:33,568 Epoch  13 Step:    76600 Batch Loss:     1.716659 Tokens per Sec:    21982, Lr: 0.000300\n","2020-05-21 22:16:44,240 Epoch  13 Step:    76700 Batch Loss:     1.863620 Tokens per Sec:    22063, Lr: 0.000300\n","2020-05-21 22:16:55,053 Epoch  13 Step:    76800 Batch Loss:     1.993002 Tokens per Sec:    22488, Lr: 0.000300\n","2020-05-21 22:17:05,832 Epoch  13 Step:    76900 Batch Loss:     1.714664 Tokens per Sec:    22211, Lr: 0.000300\n","2020-05-21 22:17:16,589 Epoch  13 Step:    77000 Batch Loss:     1.850917 Tokens per Sec:    22258, Lr: 0.000300\n","2020-05-21 22:17:29,033 Example #0\n","2020-05-21 22:17:29,033 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 22:17:29,033 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 22:17:29,034 \tHypothesis: Nsɛm a ɛtete saa maa tete nneɛma dii nkonim sɛ wɔbɛma wɔn ho ayɛ den na wɔabu wɔn ani agu so .\n","2020-05-21 22:17:29,034 Example #1\n","2020-05-21 22:17:29,034 \tSource:     If so , you would be worthy of death .\n","2020-05-21 22:17:29,034 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 22:17:29,034 \tHypothesis: Sɛ saa a , anka wobɛfata sɛ wuwu .\n","2020-05-21 22:17:29,034 Example #2\n","2020-05-21 22:17:29,034 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 22:17:29,034 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 22:17:29,034 \tHypothesis: Oo , hwɛ anigye ara a ɔsomafo Yohane hui sɛ nnipakuw kɛse no anisoadehu a ɛyɛ nwonwa yi !\n","2020-05-21 22:17:29,034 Example #3\n","2020-05-21 22:17:29,034 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 22:17:29,034 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 22:17:29,034 \tHypothesis: Ná Yesu wɔ nkate fam ahokyere ne hia , nanso Petro ne afoforo no daa .\n","2020-05-21 22:17:29,035 Validation result (greedy) at epoch  13, step    77000: bleu:  26.70, loss: 41426.3594, ppl:   4.7925, duration: 12.4451s\n","2020-05-21 22:17:39,879 Epoch  13 Step:    77100 Batch Loss:     1.894306 Tokens per Sec:    22046, Lr: 0.000300\n","2020-05-21 22:17:50,625 Epoch  13 Step:    77200 Batch Loss:     1.576494 Tokens per Sec:    21836, Lr: 0.000300\n","2020-05-21 22:18:01,478 Epoch  13 Step:    77300 Batch Loss:     1.783209 Tokens per Sec:    22465, Lr: 0.000300\n","2020-05-21 22:18:12,308 Epoch  13 Step:    77400 Batch Loss:     1.929764 Tokens per Sec:    22107, Lr: 0.000300\n","2020-05-21 22:18:23,133 Epoch  13 Step:    77500 Batch Loss:     1.859403 Tokens per Sec:    22244, Lr: 0.000300\n","2020-05-21 22:18:33,990 Epoch  13 Step:    77600 Batch Loss:     1.738903 Tokens per Sec:    22215, Lr: 0.000300\n","2020-05-21 22:18:44,782 Epoch  13 Step:    77700 Batch Loss:     1.756532 Tokens per Sec:    22449, Lr: 0.000300\n","2020-05-21 22:18:55,523 Epoch  13 Step:    77800 Batch Loss:     1.699117 Tokens per Sec:    22235, Lr: 0.000300\n","2020-05-21 22:19:06,277 Epoch  13 Step:    77900 Batch Loss:     1.848534 Tokens per Sec:    22194, Lr: 0.000300\n","2020-05-21 22:19:17,079 Epoch  13 Step:    78000 Batch Loss:     1.598971 Tokens per Sec:    21918, Lr: 0.000300\n","2020-05-21 22:19:28,927 Example #0\n","2020-05-21 22:19:28,928 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 22:19:28,928 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 22:19:28,928 \tHypothesis: Nsɛm a ɛtete saa no maa tete nneɛma dii adanse sɛ ɛyɛ den na ɛyɛ anibiannaso .\n","2020-05-21 22:19:28,928 Example #1\n","2020-05-21 22:19:28,928 \tSource:     If so , you would be worthy of death .\n","2020-05-21 22:19:28,928 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 22:19:28,928 \tHypothesis: Sɛ saa a , anka wobɛfata owu .\n","2020-05-21 22:19:28,928 Example #2\n","2020-05-21 22:19:28,928 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 22:19:28,928 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 22:19:28,928 \tHypothesis: Hwɛ sɛnea ɔsomafo Yohane ani gyei bere a ohui sɛ nnipakuw kɛse no anisoadehu a ɛyɛ anigye yi !\n","2020-05-21 22:19:28,929 Example #3\n","2020-05-21 22:19:28,929 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 22:19:28,929 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 22:19:28,929 \tHypothesis: Ná Yesu wɔ nkate fam haw na ohia mmoa , nanso Petro ne afoforo no daa .\n","2020-05-21 22:19:28,929 Validation result (greedy) at epoch  13, step    78000: bleu:  26.56, loss: 41517.6445, ppl:   4.8090, duration: 11.8500s\n","2020-05-21 22:19:39,746 Epoch  13 Step:    78100 Batch Loss:     1.704291 Tokens per Sec:    22406, Lr: 0.000300\n","2020-05-21 22:19:50,531 Epoch  13 Step:    78200 Batch Loss:     1.626563 Tokens per Sec:    22144, Lr: 0.000300\n","2020-05-21 22:20:01,270 Epoch  13 Step:    78300 Batch Loss:     1.731133 Tokens per Sec:    21912, Lr: 0.000300\n","2020-05-21 22:20:12,109 Epoch  13 Step:    78400 Batch Loss:     1.794759 Tokens per Sec:    22290, Lr: 0.000300\n","2020-05-21 22:20:22,994 Epoch  13 Step:    78500 Batch Loss:     1.635086 Tokens per Sec:    22329, Lr: 0.000300\n","2020-05-21 22:20:33,718 Epoch  13 Step:    78600 Batch Loss:     1.774957 Tokens per Sec:    21999, Lr: 0.000300\n","2020-05-21 22:20:42,911 Epoch  13: total training loss 10601.97\n","2020-05-21 22:20:42,911 EPOCH 14\n","2020-05-21 22:20:45,247 Epoch  14 Step:    78700 Batch Loss:     1.590335 Tokens per Sec:    14797, Lr: 0.000300\n","2020-05-21 22:20:56,074 Epoch  14 Step:    78800 Batch Loss:     1.588575 Tokens per Sec:    22287, Lr: 0.000300\n","2020-05-21 22:21:06,830 Epoch  14 Step:    78900 Batch Loss:     1.661081 Tokens per Sec:    22266, Lr: 0.000300\n","2020-05-21 22:21:17,501 Epoch  14 Step:    79000 Batch Loss:     2.031862 Tokens per Sec:    21780, Lr: 0.000300\n","2020-05-21 22:21:30,058 Hooray! New best validation result [ppl]!\n","2020-05-21 22:21:30,058 Saving new checkpoint.\n","2020-05-21 22:21:30,314 Example #0\n","2020-05-21 22:21:30,314 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 22:21:30,314 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 22:21:30,314 \tHypothesis: Nsɛm a ɛtete saa no maa tete nneɛma a na ɛyɛ hu sɛ wɔresɛe na wɔyɛ anibiannaso .\n","2020-05-21 22:21:30,314 Example #1\n","2020-05-21 22:21:30,314 \tSource:     If so , you would be worthy of death .\n","2020-05-21 22:21:30,314 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 22:21:30,315 \tHypothesis: Sɛ ɛte saa a , anka wobɛfata sɛ wuwu .\n","2020-05-21 22:21:30,315 Example #2\n","2020-05-21 22:21:30,315 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 22:21:30,315 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 22:21:30,315 \tHypothesis: Hwɛ sɛnea ɔsomafo Yohane ani gyei bere a ohui sɛ nnipakuw kɛse no anisoadehu a ɛyɛ hu yi !\n","2020-05-21 22:21:30,315 Example #3\n","2020-05-21 22:21:30,315 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 22:21:30,315 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 22:21:30,315 \tHypothesis: Ná Yesu wɔ nkate fam haw , na na ohia mmoa , nanso Petro ne afoforo no daa so ara da .\n","2020-05-21 22:21:30,315 Validation result (greedy) at epoch  14, step    79000: bleu:  26.63, loss: 41268.4922, ppl:   4.7639, duration: 12.8139s\n","2020-05-21 22:21:41,133 Epoch  14 Step:    79100 Batch Loss:     2.032289 Tokens per Sec:    22086, Lr: 0.000300\n","2020-05-21 22:21:51,901 Epoch  14 Step:    79200 Batch Loss:     1.576027 Tokens per Sec:    21891, Lr: 0.000300\n","2020-05-21 22:22:02,807 Epoch  14 Step:    79300 Batch Loss:     1.675697 Tokens per Sec:    22886, Lr: 0.000300\n","2020-05-21 22:22:13,586 Epoch  14 Step:    79400 Batch Loss:     1.818543 Tokens per Sec:    21635, Lr: 0.000300\n","2020-05-21 22:22:24,327 Epoch  14 Step:    79500 Batch Loss:     1.576744 Tokens per Sec:    22040, Lr: 0.000300\n","2020-05-21 22:22:35,176 Epoch  14 Step:    79600 Batch Loss:     1.714079 Tokens per Sec:    22202, Lr: 0.000300\n","2020-05-21 22:22:45,935 Epoch  14 Step:    79700 Batch Loss:     1.888596 Tokens per Sec:    21971, Lr: 0.000300\n","2020-05-21 22:22:56,837 Epoch  14 Step:    79800 Batch Loss:     1.564956 Tokens per Sec:    21822, Lr: 0.000300\n","2020-05-21 22:23:07,562 Epoch  14 Step:    79900 Batch Loss:     1.769063 Tokens per Sec:    21975, Lr: 0.000300\n","2020-05-21 22:23:18,384 Epoch  14 Step:    80000 Batch Loss:     1.604375 Tokens per Sec:    22504, Lr: 0.000300\n","2020-05-21 22:23:30,397 Example #0\n","2020-05-21 22:23:30,397 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 22:23:30,397 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 22:23:30,397 \tHypothesis: Nsɛm a ɛtete saa no maa tete nneɛma a na ɛyɛ nwonwa no dii adanse sɛ ɛyɛ den na ɛyɛ den .\n","2020-05-21 22:23:30,397 Example #1\n","2020-05-21 22:23:30,397 \tSource:     If so , you would be worthy of death .\n","2020-05-21 22:23:30,397 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 22:23:30,397 \tHypothesis: Sɛ saa a , anka wobɛfata owu .\n","2020-05-21 22:23:30,397 Example #2\n","2020-05-21 22:23:30,398 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 22:23:30,398 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 22:23:30,398 \tHypothesis: Hwɛ sɛnea ɔsomafo Yohane ani gyei bere a ohui sɛ nnipakuw kɛse no anisoadehu a ɛyɛ nwonwa yi !\n","2020-05-21 22:23:30,398 Example #3\n","2020-05-21 22:23:30,398 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 22:23:30,398 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 22:23:30,398 \tHypothesis: Ná Yesu wɔ nkate fam ahokyere ne mmoa , nanso Petro ne afoforo no daa so ara daa .\n","2020-05-21 22:23:30,398 Validation result (greedy) at epoch  14, step    80000: bleu:  26.97, loss: 41280.3828, ppl:   4.7661, duration: 12.0137s\n","2020-05-21 22:23:41,215 Epoch  14 Step:    80100 Batch Loss:     1.788630 Tokens per Sec:    21885, Lr: 0.000300\n","2020-05-21 22:23:51,968 Epoch  14 Step:    80200 Batch Loss:     1.918076 Tokens per Sec:    22475, Lr: 0.000300\n","2020-05-21 22:24:02,908 Epoch  14 Step:    80300 Batch Loss:     1.758220 Tokens per Sec:    22522, Lr: 0.000300\n","2020-05-21 22:24:13,596 Epoch  14 Step:    80400 Batch Loss:     1.519383 Tokens per Sec:    21838, Lr: 0.000300\n","2020-05-21 22:24:24,441 Epoch  14 Step:    80500 Batch Loss:     1.464577 Tokens per Sec:    22241, Lr: 0.000300\n","2020-05-21 22:24:35,159 Epoch  14 Step:    80600 Batch Loss:     1.889975 Tokens per Sec:    22062, Lr: 0.000300\n","2020-05-21 22:24:45,878 Epoch  14 Step:    80700 Batch Loss:     1.757616 Tokens per Sec:    22090, Lr: 0.000300\n","2020-05-21 22:24:56,649 Epoch  14 Step:    80800 Batch Loss:     1.788060 Tokens per Sec:    21734, Lr: 0.000300\n","2020-05-21 22:25:07,445 Epoch  14 Step:    80900 Batch Loss:     1.857655 Tokens per Sec:    22536, Lr: 0.000300\n","2020-05-21 22:25:18,104 Epoch  14 Step:    81000 Batch Loss:     1.654425 Tokens per Sec:    22046, Lr: 0.000300\n","2020-05-21 22:25:29,985 Example #0\n","2020-05-21 22:25:29,985 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 22:25:29,985 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 22:25:29,985 \tHypothesis: Nsɛm a ɛtete saa no maa tete nneɛma dii nkonim sɛ wɔbɛyɛ basabasa na wɔabu wɔn ani agu so .\n","2020-05-21 22:25:29,985 Example #1\n","2020-05-21 22:25:29,986 \tSource:     If so , you would be worthy of death .\n","2020-05-21 22:25:29,986 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 22:25:29,986 \tHypothesis: Sɛ saa a , anka wobɛfata owu .\n","2020-05-21 22:25:29,986 Example #2\n","2020-05-21 22:25:29,986 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 22:25:29,986 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 22:25:29,986 \tHypothesis: Hwɛ sɛnea ɔsomafo Yohane ani gyei bere a ohuu nnipakuw kɛse no anisoadehu a ɛyɛ anigye yi !\n","2020-05-21 22:25:29,986 Example #3\n","2020-05-21 22:25:29,986 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 22:25:29,986 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 22:25:29,986 \tHypothesis: Ná Yesu wɔ nkate fam ahokyere ne mmoa , nanso Petro ne afoforo no daa adi mpɛn pii .\n","2020-05-21 22:25:29,986 Validation result (greedy) at epoch  14, step    81000: bleu:  26.44, loss: 41320.2617, ppl:   4.7733, duration: 11.8817s\n","2020-05-21 22:25:40,786 Epoch  14 Step:    81100 Batch Loss:     1.717855 Tokens per Sec:    22570, Lr: 0.000300\n","2020-05-21 22:25:51,532 Epoch  14 Step:    81200 Batch Loss:     1.637515 Tokens per Sec:    22481, Lr: 0.000300\n","2020-05-21 22:26:02,329 Epoch  14 Step:    81300 Batch Loss:     1.623585 Tokens per Sec:    22491, Lr: 0.000300\n","2020-05-21 22:26:13,090 Epoch  14 Step:    81400 Batch Loss:     1.835636 Tokens per Sec:    22427, Lr: 0.000300\n","2020-05-21 22:26:23,819 Epoch  14 Step:    81500 Batch Loss:     1.615287 Tokens per Sec:    22064, Lr: 0.000300\n","2020-05-21 22:26:34,537 Epoch  14 Step:    81600 Batch Loss:     1.538748 Tokens per Sec:    22452, Lr: 0.000300\n","2020-05-21 22:26:45,295 Epoch  14 Step:    81700 Batch Loss:     1.625696 Tokens per Sec:    22099, Lr: 0.000300\n","2020-05-21 22:26:56,172 Epoch  14 Step:    81800 Batch Loss:     1.751224 Tokens per Sec:    22763, Lr: 0.000300\n","2020-05-21 22:27:06,874 Epoch  14 Step:    81900 Batch Loss:     1.742679 Tokens per Sec:    22213, Lr: 0.000300\n","2020-05-21 22:27:17,746 Epoch  14 Step:    82000 Batch Loss:     1.733059 Tokens per Sec:    22448, Lr: 0.000300\n","2020-05-21 22:27:29,897 Hooray! New best validation result [ppl]!\n","2020-05-21 22:27:29,897 Saving new checkpoint.\n","2020-05-21 22:27:30,126 Example #0\n","2020-05-21 22:27:30,127 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 22:27:30,127 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 22:27:30,127 \tHypothesis: Nsɛm a ɛtete saa no maa tete adan no dii nkonim sɛ wɔbɛyɛ basaa na wɔabu wɔn ani agu so .\n","2020-05-21 22:27:30,127 Example #1\n","2020-05-21 22:27:30,127 \tSource:     If so , you would be worthy of death .\n","2020-05-21 22:27:30,127 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 22:27:30,127 \tHypothesis: Sɛ saa a , anka wobɛfata owu .\n","2020-05-21 22:27:30,127 Example #2\n","2020-05-21 22:27:30,127 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 22:27:30,127 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 22:27:30,127 \tHypothesis: Hwɛ sɛnea ɔsomafo Yohane ani gyei bere a ohui sɛ nnipakuw kɛse no anisoadehu a ɛyɛ hu yi !\n","2020-05-21 22:27:30,127 Example #3\n","2020-05-21 22:27:30,128 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 22:27:30,128 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 22:27:30,128 \tHypothesis: Ná Yesu wɔ nkate fam haw , na na ohia mmoa , nanso Petro ne afoforo no daa .\n","2020-05-21 22:27:30,128 Validation result (greedy) at epoch  14, step    82000: bleu:  26.93, loss: 41146.3242, ppl:   4.7420, duration: 12.3813s\n","2020-05-21 22:27:40,907 Epoch  14 Step:    82100 Batch Loss:     1.803813 Tokens per Sec:    21990, Lr: 0.000300\n","2020-05-21 22:27:51,747 Epoch  14 Step:    82200 Batch Loss:     1.618868 Tokens per Sec:    22332, Lr: 0.000300\n","2020-05-21 22:28:02,668 Epoch  14 Step:    82300 Batch Loss:     1.733722 Tokens per Sec:    22283, Lr: 0.000300\n","2020-05-21 22:28:13,492 Epoch  14 Step:    82400 Batch Loss:     1.585080 Tokens per Sec:    21961, Lr: 0.000300\n","2020-05-21 22:28:24,121 Epoch  14 Step:    82500 Batch Loss:     2.859913 Tokens per Sec:    21391, Lr: 0.000300\n","2020-05-21 22:28:34,965 Epoch  14 Step:    82600 Batch Loss:     1.530861 Tokens per Sec:    22316, Lr: 0.000300\n","2020-05-21 22:28:45,748 Epoch  14 Step:    82700 Batch Loss:     1.702560 Tokens per Sec:    22138, Lr: 0.000300\n","2020-05-21 22:28:56,625 Epoch  14 Step:    82800 Batch Loss:     1.700762 Tokens per Sec:    22215, Lr: 0.000300\n","2020-05-21 22:29:07,425 Epoch  14 Step:    82900 Batch Loss:     1.867829 Tokens per Sec:    22158, Lr: 0.000300\n","2020-05-21 22:29:18,140 Epoch  14 Step:    83000 Batch Loss:     1.644533 Tokens per Sec:    22117, Lr: 0.000300\n","2020-05-21 22:29:29,943 Hooray! New best validation result [ppl]!\n","2020-05-21 22:29:29,943 Saving new checkpoint.\n","2020-05-21 22:29:30,178 Example #0\n","2020-05-21 22:29:30,178 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 22:29:30,178 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 22:29:30,178 \tHypothesis: Nsɛm a ɛtete saa no maa tete nneɛma a na ɛyɛ hu no yɛɛ den sɛ wobegye atom na wɔabu wɔn ani agu so .\n","2020-05-21 22:29:30,178 Example #1\n","2020-05-21 22:29:30,178 \tSource:     If so , you would be worthy of death .\n","2020-05-21 22:29:30,178 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 22:29:30,179 \tHypothesis: Sɛ saa a , anka wobɛfata owu .\n","2020-05-21 22:29:30,179 Example #2\n","2020-05-21 22:29:30,179 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 22:29:30,179 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 22:29:30,179 \tHypothesis: Oo , hwɛ sɛnea ɔsomafo Yohane ani gyei bere a ohuu nnipakuw kɛse no anisoadehu a ɛyɛ hu yi !\n","2020-05-21 22:29:30,179 Example #3\n","2020-05-21 22:29:30,179 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 22:29:30,179 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 22:29:30,179 \tHypothesis: Ná Yesu wɔ nkate fam ahokyere ne hia mu , nanso Petro ne afoforo no daa adi mpɛn pii .\n","2020-05-21 22:29:30,179 Validation result (greedy) at epoch  14, step    83000: bleu:  27.15, loss: 41016.7266, ppl:   4.7188, duration: 12.0392s\n","2020-05-21 22:29:40,951 Epoch  14 Step:    83100 Batch Loss:     1.531985 Tokens per Sec:    22215, Lr: 0.000300\n","2020-05-21 22:29:51,833 Epoch  14 Step:    83200 Batch Loss:     1.755604 Tokens per Sec:    22555, Lr: 0.000300\n","2020-05-21 22:30:02,554 Epoch  14 Step:    83300 Batch Loss:     2.114649 Tokens per Sec:    21730, Lr: 0.000300\n","2020-05-21 22:30:13,354 Epoch  14 Step:    83400 Batch Loss:     1.775198 Tokens per Sec:    22173, Lr: 0.000300\n","2020-05-21 22:30:24,040 Epoch  14 Step:    83500 Batch Loss:     1.875320 Tokens per Sec:    21913, Lr: 0.000300\n","2020-05-21 22:30:34,732 Epoch  14 Step:    83600 Batch Loss:     1.623158 Tokens per Sec:    21897, Lr: 0.000300\n","2020-05-21 22:30:45,455 Epoch  14 Step:    83700 Batch Loss:     1.675171 Tokens per Sec:    22087, Lr: 0.000300\n","2020-05-21 22:30:56,262 Epoch  14 Step:    83800 Batch Loss:     1.590775 Tokens per Sec:    22179, Lr: 0.000300\n","2020-05-21 22:31:07,086 Epoch  14 Step:    83900 Batch Loss:     1.555421 Tokens per Sec:    22510, Lr: 0.000300\n","2020-05-21 22:31:17,944 Epoch  14 Step:    84000 Batch Loss:     3.054714 Tokens per Sec:    22421, Lr: 0.000300\n","2020-05-21 22:31:30,669 Example #0\n","2020-05-21 22:31:30,669 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 22:31:30,669 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 22:31:30,669 \tHypothesis: Nsɛm a ɛtete saa no maa tete nneɛma dii adanse sɛ ɛyɛ den sɛ wɔbɛbɔ wɔn ho ban na wɔabu wɔn ani agu so .\n","2020-05-21 22:31:30,669 Example #1\n","2020-05-21 22:31:30,669 \tSource:     If so , you would be worthy of death .\n","2020-05-21 22:31:30,669 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 22:31:30,669 \tHypothesis: Sɛ saa a , ɛnde na ɛsɛ sɛ wuwu .\n","2020-05-21 22:31:30,670 Example #2\n","2020-05-21 22:31:30,670 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 22:31:30,670 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 22:31:30,670 \tHypothesis: Oo , hwɛ sɛnea ɔsomafo Yohane ani gyei bere a ohui sɛ nnipakuw kɛse no anisoadehu a ɛyɛ nwonwa yi !\n","2020-05-21 22:31:30,670 Example #3\n","2020-05-21 22:31:30,670 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 22:31:30,670 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 22:31:30,670 \tHypothesis: Ná Yesu wɔ nkate fam ahokyere ne mmoa , nanso Petro ne afoforo no daa adi mpɛn pii .\n","2020-05-21 22:31:30,670 Validation result (greedy) at epoch  14, step    84000: bleu:  26.80, loss: 41055.0547, ppl:   4.7256, duration: 12.7264s\n","2020-05-21 22:31:41,446 Epoch  14 Step:    84100 Batch Loss:     1.680847 Tokens per Sec:    21923, Lr: 0.000300\n","2020-05-21 22:31:52,307 Epoch  14 Step:    84200 Batch Loss:     1.751168 Tokens per Sec:    22272, Lr: 0.000300\n","2020-05-21 22:32:03,050 Epoch  14 Step:    84300 Batch Loss:     1.782283 Tokens per Sec:    22274, Lr: 0.000300\n","2020-05-21 22:32:13,785 Epoch  14 Step:    84400 Batch Loss:     1.519721 Tokens per Sec:    22386, Lr: 0.000300\n","2020-05-21 22:32:24,548 Epoch  14 Step:    84500 Batch Loss:     2.004127 Tokens per Sec:    22135, Lr: 0.000300\n","2020-05-21 22:32:35,347 Epoch  14 Step:    84600 Batch Loss:     1.903306 Tokens per Sec:    22089, Lr: 0.000300\n","2020-05-21 22:32:46,209 Epoch  14 Step:    84700 Batch Loss:     1.828839 Tokens per Sec:    22305, Lr: 0.000300\n","2020-05-21 22:32:49,978 Epoch  14: total training loss 10517.50\n","2020-05-21 22:32:49,979 EPOCH 15\n","2020-05-21 22:32:57,734 Epoch  15 Step:    84800 Batch Loss:     1.691816 Tokens per Sec:    19714, Lr: 0.000300\n","2020-05-21 22:33:08,429 Epoch  15 Step:    84900 Batch Loss:     1.640021 Tokens per Sec:    21530, Lr: 0.000300\n","2020-05-21 22:33:19,197 Epoch  15 Step:    85000 Batch Loss:     1.630148 Tokens per Sec:    22052, Lr: 0.000300\n","2020-05-21 22:33:32,323 Hooray! New best validation result [ppl]!\n","2020-05-21 22:33:32,323 Saving new checkpoint.\n","2020-05-21 22:33:32,554 Example #0\n","2020-05-21 22:33:32,555 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 22:33:32,555 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 22:33:32,555 \tHypothesis: Nsɛm a ɛtete saa no maa tete nneɛma a na ɛyɛ hu sɛ wɔagye din na wɔyɛ wɔn ade wɔ ɔkwan a wɔfa so yɛ adwuma no so .\n","2020-05-21 22:33:32,555 Example #1\n","2020-05-21 22:33:32,555 \tSource:     If so , you would be worthy of death .\n","2020-05-21 22:33:32,555 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 22:33:32,555 \tHypothesis: Sɛ saa a , anka wobɛfata sɛ wuwu .\n","2020-05-21 22:33:32,555 Example #2\n","2020-05-21 22:33:32,555 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 22:33:32,555 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 22:33:32,555 \tHypothesis: Oo , hwɛ sɛnea ɔsomafo Yohane ani gyei bere a ohui sɛ nnipakuw kɛse no ho anisoadehu a ɛyɛ nwonwa yi !\n","2020-05-21 22:33:32,556 Example #3\n","2020-05-21 22:33:32,556 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 22:33:32,556 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 22:33:32,556 \tHypothesis: Ná Yesu wɔ nkate fam ahokyere ne hia mu , nanso Petro ne afoforo no daa .\n","2020-05-21 22:33:32,556 Validation result (greedy) at epoch  15, step    85000: bleu:  27.23, loss: 40960.7852, ppl:   4.7088, duration: 13.3586s\n","2020-05-21 22:33:43,371 Epoch  15 Step:    85100 Batch Loss:     1.602000 Tokens per Sec:    21707, Lr: 0.000300\n","2020-05-21 22:33:54,187 Epoch  15 Step:    85200 Batch Loss:     1.828592 Tokens per Sec:    21924, Lr: 0.000300\n","2020-05-21 22:34:04,939 Epoch  15 Step:    85300 Batch Loss:     1.648622 Tokens per Sec:    21743, Lr: 0.000300\n","2020-05-21 22:34:15,811 Epoch  15 Step:    85400 Batch Loss:     1.920441 Tokens per Sec:    22305, Lr: 0.000300\n","2020-05-21 22:34:26,569 Epoch  15 Step:    85500 Batch Loss:     1.757869 Tokens per Sec:    21931, Lr: 0.000300\n","2020-05-21 22:34:37,306 Epoch  15 Step:    85600 Batch Loss:     1.772754 Tokens per Sec:    22005, Lr: 0.000300\n","2020-05-21 22:34:48,069 Epoch  15 Step:    85700 Batch Loss:     1.734986 Tokens per Sec:    22307, Lr: 0.000300\n","2020-05-21 22:34:58,837 Epoch  15 Step:    85800 Batch Loss:     1.877769 Tokens per Sec:    21984, Lr: 0.000300\n","2020-05-21 22:35:09,596 Epoch  15 Step:    85900 Batch Loss:     1.597505 Tokens per Sec:    22207, Lr: 0.000300\n","2020-05-21 22:35:20,464 Epoch  15 Step:    86000 Batch Loss:     1.769964 Tokens per Sec:    22049, Lr: 0.000300\n","2020-05-21 22:35:32,753 Hooray! New best validation result [ppl]!\n","2020-05-21 22:35:32,753 Saving new checkpoint.\n","2020-05-21 22:35:32,997 Example #0\n","2020-05-21 22:35:32,997 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 22:35:32,997 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 22:35:32,998 \tHypothesis: Nsɛm a ɛtete saa no maa tete anyinam ahoɔden a na wɔwɔ sɛ wɔbɛbɔ wɔn ho ban na wɔabu wɔn ani agu so .\n","2020-05-21 22:35:32,998 Example #1\n","2020-05-21 22:35:32,998 \tSource:     If so , you would be worthy of death .\n","2020-05-21 22:35:32,998 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 22:35:32,998 \tHypothesis: Sɛ saa a , anka wobɛfata sɛ wuwu .\n","2020-05-21 22:35:32,998 Example #2\n","2020-05-21 22:35:32,998 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 22:35:32,998 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 22:35:32,998 \tHypothesis: Oo , hwɛ sɛnea ɔsomafo Yohane ani gyei bere a ohuu nnipakuw kɛse no anisoadehu a ɛyɛ nwonwa yi !\n","2020-05-21 22:35:32,998 Example #3\n","2020-05-21 22:35:32,999 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 22:35:32,999 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 22:35:32,999 \tHypothesis: Ná Yesu wɔ nkate fam ahotɔ ne mmoa , nanso Petro ne afoforo no daa .\n","2020-05-21 22:35:32,999 Validation result (greedy) at epoch  15, step    86000: bleu:  26.65, loss: 40844.4453, ppl:   4.6881, duration: 12.5341s\n","2020-05-21 22:35:43,898 Epoch  15 Step:    86100 Batch Loss:     2.081188 Tokens per Sec:    22341, Lr: 0.000300\n","2020-05-21 22:35:54,655 Epoch  15 Step:    86200 Batch Loss:     1.799563 Tokens per Sec:    22158, Lr: 0.000300\n","2020-05-21 22:36:05,477 Epoch  15 Step:    86300 Batch Loss:     1.732258 Tokens per Sec:    22216, Lr: 0.000300\n","2020-05-21 22:36:16,384 Epoch  15 Step:    86400 Batch Loss:     1.451517 Tokens per Sec:    22155, Lr: 0.000300\n","2020-05-21 22:36:27,221 Epoch  15 Step:    86500 Batch Loss:     1.648014 Tokens per Sec:    22118, Lr: 0.000300\n","2020-05-21 22:36:37,944 Epoch  15 Step:    86600 Batch Loss:     1.783155 Tokens per Sec:    21676, Lr: 0.000300\n","2020-05-21 22:36:48,756 Epoch  15 Step:    86700 Batch Loss:     1.989165 Tokens per Sec:    22085, Lr: 0.000300\n","2020-05-21 22:36:59,687 Epoch  15 Step:    86800 Batch Loss:     1.659799 Tokens per Sec:    22368, Lr: 0.000300\n","2020-05-21 22:37:10,526 Epoch  15 Step:    86900 Batch Loss:     1.572884 Tokens per Sec:    22232, Lr: 0.000300\n","2020-05-21 22:37:21,324 Epoch  15 Step:    87000 Batch Loss:     1.573582 Tokens per Sec:    22504, Lr: 0.000300\n","2020-05-21 22:37:33,543 Example #0\n","2020-05-21 22:37:33,544 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 22:37:33,544 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 22:37:33,544 \tHypothesis: Nsɛm a ɛtete saa maa tete nneɛma a na wɔagye atom sɛ ɛyɛ den na ɛyɛ nwonwa .\n","2020-05-21 22:37:33,544 Example #1\n","2020-05-21 22:37:33,544 \tSource:     If so , you would be worthy of death .\n","2020-05-21 22:37:33,544 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 22:37:33,544 \tHypothesis: Sɛ saa a , anka wobɛfata sɛ wuwu .\n","2020-05-21 22:37:33,544 Example #2\n","2020-05-21 22:37:33,544 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 22:37:33,544 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 22:37:33,544 \tHypothesis: Oo , hwɛ sɛnea ɔsomafo Yohane ani gyei bere a ohui sɛ nnipakuw kɛse no anisoadehu a ɛyɛ nwonwa yi !\n","2020-05-21 22:37:33,545 Example #3\n","2020-05-21 22:37:33,545 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 22:37:33,545 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 22:37:33,545 \tHypothesis: Ná Yesu wɔ nkate fam ahotɔ ne mmoa , nanso Petro ne afoforo no daa adi mpɛn pii .\n","2020-05-21 22:37:33,545 Validation result (greedy) at epoch  15, step    87000: bleu:  27.04, loss: 40887.7461, ppl:   4.6958, duration: 12.2209s\n","2020-05-21 22:37:44,320 Epoch  15 Step:    87100 Batch Loss:     2.119088 Tokens per Sec:    22288, Lr: 0.000300\n","2020-05-21 22:37:55,030 Epoch  15 Step:    87200 Batch Loss:     1.796490 Tokens per Sec:    22106, Lr: 0.000300\n","2020-05-21 22:38:05,852 Epoch  15 Step:    87300 Batch Loss:     1.752237 Tokens per Sec:    21789, Lr: 0.000300\n","2020-05-21 22:38:16,733 Epoch  15 Step:    87400 Batch Loss:     1.701281 Tokens per Sec:    22071, Lr: 0.000300\n","2020-05-21 22:38:27,669 Epoch  15 Step:    87500 Batch Loss:     1.934571 Tokens per Sec:    22091, Lr: 0.000300\n","2020-05-21 22:38:38,439 Epoch  15 Step:    87600 Batch Loss:     1.622691 Tokens per Sec:    21922, Lr: 0.000300\n","2020-05-21 22:38:49,192 Epoch  15 Step:    87700 Batch Loss:     1.599691 Tokens per Sec:    22008, Lr: 0.000300\n","2020-05-21 22:38:59,950 Epoch  15 Step:    87800 Batch Loss:     1.702657 Tokens per Sec:    21939, Lr: 0.000300\n","2020-05-21 22:39:10,754 Epoch  15 Step:    87900 Batch Loss:     1.795229 Tokens per Sec:    22267, Lr: 0.000300\n","2020-05-21 22:39:21,584 Epoch  15 Step:    88000 Batch Loss:     1.702916 Tokens per Sec:    22105, Lr: 0.000300\n","2020-05-21 22:39:34,337 Hooray! New best validation result [ppl]!\n","2020-05-21 22:39:34,337 Saving new checkpoint.\n","2020-05-21 22:39:34,567 Example #0\n","2020-05-21 22:39:34,568 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 22:39:34,568 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 22:39:34,568 \tHypothesis: Nsɛm a ɛtete saa no maa tete nneɛma a na wɔmpɛ sɛ wɔyɛ no basabasa ne amannɔne no ho dwiriw wɔn .\n","2020-05-21 22:39:34,568 Example #1\n","2020-05-21 22:39:34,568 \tSource:     If so , you would be worthy of death .\n","2020-05-21 22:39:34,568 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 22:39:34,568 \tHypothesis: Sɛ saa a , anka wobɛfata sɛ wuwu .\n","2020-05-21 22:39:34,568 Example #2\n","2020-05-21 22:39:34,568 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 22:39:34,568 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 22:39:34,568 \tHypothesis: Oo , hwɛ sɛnea ɔsomafo Yohane ani gyei bere a ohui sɛ nnipakuw kɛse no anisoadehu a ɛyɛ hu yi !\n","2020-05-21 22:39:34,568 Example #3\n","2020-05-21 22:39:34,569 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 22:39:34,569 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 22:39:34,569 \tHypothesis: Ná Yesu wɔ nkate fam ahokyere ne mmoa , nanso Petro ne afoforo no daa .\n","2020-05-21 22:39:34,569 Validation result (greedy) at epoch  15, step    88000: bleu:  26.74, loss: 40820.6367, ppl:   4.6839, duration: 12.9848s\n","2020-05-21 22:39:45,411 Epoch  15 Step:    88100 Batch Loss:     1.803847 Tokens per Sec:    22361, Lr: 0.000300\n","2020-05-21 22:39:56,246 Epoch  15 Step:    88200 Batch Loss:     1.642446 Tokens per Sec:    22578, Lr: 0.000300\n","2020-05-21 22:40:07,056 Epoch  15 Step:    88300 Batch Loss:     1.654925 Tokens per Sec:    22202, Lr: 0.000300\n","2020-05-21 22:40:17,882 Epoch  15 Step:    88400 Batch Loss:     1.981664 Tokens per Sec:    22145, Lr: 0.000300\n","2020-05-21 22:40:28,675 Epoch  15 Step:    88500 Batch Loss:     1.975134 Tokens per Sec:    21842, Lr: 0.000300\n","2020-05-21 22:40:39,539 Epoch  15 Step:    88600 Batch Loss:     2.024757 Tokens per Sec:    22367, Lr: 0.000300\n","2020-05-21 22:40:50,289 Epoch  15 Step:    88700 Batch Loss:     1.662932 Tokens per Sec:    21758, Lr: 0.000300\n","2020-05-21 22:41:01,211 Epoch  15 Step:    88800 Batch Loss:     2.024347 Tokens per Sec:    22177, Lr: 0.000300\n","2020-05-21 22:41:11,983 Epoch  15 Step:    88900 Batch Loss:     1.634510 Tokens per Sec:    22053, Lr: 0.000300\n","2020-05-21 22:41:22,780 Epoch  15 Step:    89000 Batch Loss:     1.568660 Tokens per Sec:    22035, Lr: 0.000300\n","2020-05-21 22:41:35,256 Hooray! New best validation result [ppl]!\n","2020-05-21 22:41:35,256 Saving new checkpoint.\n","2020-05-21 22:41:35,486 Example #0\n","2020-05-21 22:41:35,486 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 22:41:35,486 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 22:41:35,486 \tHypothesis: Nsɛm a ɛtete saa no maa tete agumadi no dii mfomso sɛ wɔbɛbɔ wɔn ho ban na wɔabu wɔn ani agu so .\n","2020-05-21 22:41:35,486 Example #1\n","2020-05-21 22:41:35,487 \tSource:     If so , you would be worthy of death .\n","2020-05-21 22:41:35,487 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 22:41:35,487 \tHypothesis: Sɛ saa a , ɛnde wobɛfata owu .\n","2020-05-21 22:41:35,487 Example #2\n","2020-05-21 22:41:35,487 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 22:41:35,487 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 22:41:35,487 \tHypothesis: Oo , hwɛ anigye ara a ɔsomafo Yohane hui sɛ nnipakuw kɛse no anisoadehu a ɛyɛ anigye yi !\n","2020-05-21 22:41:35,487 Example #3\n","2020-05-21 22:41:35,487 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 22:41:35,487 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 22:41:35,487 \tHypothesis: Ná Yesu wɔ nkate fam ahotɔ ne mmoa , nanso Petro ne afoforo no daa adi mpɛn pii .\n","2020-05-21 22:41:35,488 Validation result (greedy) at epoch  15, step    89000: bleu:  26.72, loss: 40767.5586, ppl:   4.6745, duration: 12.7075s\n","2020-05-21 22:41:46,323 Epoch  15 Step:    89100 Batch Loss:     1.765688 Tokens per Sec:    22208, Lr: 0.000300\n","2020-05-21 22:41:57,147 Epoch  15 Step:    89200 Batch Loss:     1.840357 Tokens per Sec:    22279, Lr: 0.000300\n","2020-05-21 22:42:08,107 Epoch  15 Step:    89300 Batch Loss:     1.912491 Tokens per Sec:    22387, Lr: 0.000300\n","2020-05-21 22:42:18,964 Epoch  15 Step:    89400 Batch Loss:     1.535528 Tokens per Sec:    21667, Lr: 0.000300\n","2020-05-21 22:42:29,883 Epoch  15 Step:    89500 Batch Loss:     1.803249 Tokens per Sec:    22696, Lr: 0.000300\n","2020-05-21 22:42:40,667 Epoch  15 Step:    89600 Batch Loss:     1.820815 Tokens per Sec:    22247, Lr: 0.000300\n","2020-05-21 22:42:51,507 Epoch  15 Step:    89700 Batch Loss:     1.685302 Tokens per Sec:    22134, Lr: 0.000300\n","2020-05-21 22:43:02,332 Epoch  15 Step:    89800 Batch Loss:     1.700826 Tokens per Sec:    22064, Lr: 0.000300\n","2020-05-21 22:43:13,108 Epoch  15 Step:    89900 Batch Loss:     1.657697 Tokens per Sec:    21922, Lr: 0.000300\n","2020-05-21 22:43:23,952 Epoch  15 Step:    90000 Batch Loss:     2.371131 Tokens per Sec:    22135, Lr: 0.000300\n","2020-05-21 22:43:36,250 Example #0\n","2020-05-21 22:43:36,250 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 22:43:36,250 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 22:43:36,251 \tHypothesis: Nsɛm a ɛtete saa maa tete agumadi no dii nkonim sɛ obi bɛyɛ ɔyamyefo na ɔyɛ anifere .\n","2020-05-21 22:43:36,251 Example #1\n","2020-05-21 22:43:36,251 \tSource:     If so , you would be worthy of death .\n","2020-05-21 22:43:36,251 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 22:43:36,251 \tHypothesis: Sɛ saa a , ɛnde na wobɛfata sɛ wuwu .\n","2020-05-21 22:43:36,251 Example #2\n","2020-05-21 22:43:36,251 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 22:43:36,251 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 22:43:36,251 \tHypothesis: Oo , hwɛ anigye ara a ɔsomafo Yohane hui sɛ nnipakuw kɛse no anisoadehu a ɛyɛ nwonwa yi !\n","2020-05-21 22:43:36,251 Example #3\n","2020-05-21 22:43:36,252 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 22:43:36,252 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 22:43:36,252 \tHypothesis: Ná Yesu wɔ nkate fam ne mmoa , nanso Petro ne afoforo no daa .\n","2020-05-21 22:43:36,252 Validation result (greedy) at epoch  15, step    90000: bleu:  26.73, loss: 40813.3555, ppl:   4.6826, duration: 12.2992s\n","2020-05-21 22:43:47,051 Epoch  15 Step:    90100 Batch Loss:     1.897764 Tokens per Sec:    22335, Lr: 0.000300\n","2020-05-21 22:43:57,939 Epoch  15 Step:    90200 Batch Loss:     1.796067 Tokens per Sec:    22362, Lr: 0.000300\n","2020-05-21 22:44:08,716 Epoch  15 Step:    90300 Batch Loss:     1.673096 Tokens per Sec:    22178, Lr: 0.000300\n","2020-05-21 22:44:19,559 Epoch  15 Step:    90400 Batch Loss:     1.669083 Tokens per Sec:    22006, Lr: 0.000300\n","2020-05-21 22:44:30,330 Epoch  15 Step:    90500 Batch Loss:     1.840906 Tokens per Sec:    21896, Lr: 0.000300\n","2020-05-21 22:44:41,201 Epoch  15 Step:    90600 Batch Loss:     1.756057 Tokens per Sec:    22072, Lr: 0.000300\n","2020-05-21 22:44:52,112 Epoch  15 Step:    90700 Batch Loss:     1.646225 Tokens per Sec:    21792, Lr: 0.000300\n","2020-05-21 22:45:01,566 Epoch  15: total training loss 10434.58\n","2020-05-21 22:45:01,567 EPOCH 16\n","2020-05-21 22:45:03,868 Epoch  16 Step:    90800 Batch Loss:     1.693735 Tokens per Sec:    14641, Lr: 0.000300\n","2020-05-21 22:45:14,777 Epoch  16 Step:    90900 Batch Loss:     1.637714 Tokens per Sec:    21894, Lr: 0.000300\n","2020-05-21 22:45:25,545 Epoch  16 Step:    91000 Batch Loss:     1.413257 Tokens per Sec:    21742, Lr: 0.000300\n","2020-05-21 22:45:37,932 Hooray! New best validation result [ppl]!\n","2020-05-21 22:45:37,932 Saving new checkpoint.\n","2020-05-21 22:45:38,208 Example #0\n","2020-05-21 22:45:38,209 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 22:45:38,209 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 22:45:38,209 \tHypothesis: Nsɛm a ɛtete saa maa tete aguadi dii nkogu wɔ ɔkwan a wɔfa so yɛ den na ɛyɛ nwonwa so .\n","2020-05-21 22:45:38,209 Example #1\n","2020-05-21 22:45:38,209 \tSource:     If so , you would be worthy of death .\n","2020-05-21 22:45:38,209 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 22:45:38,209 \tHypothesis: Sɛ saa a , anka wobɛfata sɛ wuwu .\n","2020-05-21 22:45:38,209 Example #2\n","2020-05-21 22:45:38,209 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 22:45:38,209 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 22:45:38,209 \tHypothesis: Oo , hwɛ sɛnea ɔsomafo Yohane ani gyei bere a ohui sɛ nnipakuw kɛse no anisoadehu a ɛyɛ nwonwa yi !\n","2020-05-21 22:45:38,209 Example #3\n","2020-05-21 22:45:38,210 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 22:45:38,210 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 22:45:38,210 \tHypothesis: Ná Yesu wɔ nkate fam , na ohia mmoa , nanso Petro ne afoforo no daa .\n","2020-05-21 22:45:38,210 Validation result (greedy) at epoch  16, step    91000: bleu:  26.49, loss: 40692.9023, ppl:   4.6613, duration: 12.6649s\n","2020-05-21 22:45:49,145 Epoch  16 Step:    91100 Batch Loss:     1.397366 Tokens per Sec:    21960, Lr: 0.000300\n","2020-05-21 22:45:59,996 Epoch  16 Step:    91200 Batch Loss:     1.805716 Tokens per Sec:    21891, Lr: 0.000300\n","2020-05-21 22:46:10,925 Epoch  16 Step:    91300 Batch Loss:     1.727032 Tokens per Sec:    21875, Lr: 0.000300\n","2020-05-21 22:46:21,882 Epoch  16 Step:    91400 Batch Loss:     1.880776 Tokens per Sec:    22156, Lr: 0.000300\n","2020-05-21 22:46:32,729 Epoch  16 Step:    91500 Batch Loss:     1.579824 Tokens per Sec:    22477, Lr: 0.000300\n","2020-05-21 22:46:43,594 Epoch  16 Step:    91600 Batch Loss:     1.611363 Tokens per Sec:    21955, Lr: 0.000300\n","2020-05-21 22:46:54,496 Epoch  16 Step:    91700 Batch Loss:     1.704555 Tokens per Sec:    22204, Lr: 0.000300\n","2020-05-21 22:47:05,453 Epoch  16 Step:    91800 Batch Loss:     1.718418 Tokens per Sec:    21622, Lr: 0.000300\n","2020-05-21 22:47:16,433 Epoch  16 Step:    91900 Batch Loss:     1.694778 Tokens per Sec:    22158, Lr: 0.000300\n","2020-05-21 22:47:27,340 Epoch  16 Step:    92000 Batch Loss:     1.656902 Tokens per Sec:    21973, Lr: 0.000300\n","2020-05-21 22:47:40,210 Hooray! New best validation result [ppl]!\n","2020-05-21 22:47:40,210 Saving new checkpoint.\n","2020-05-21 22:47:40,451 Example #0\n","2020-05-21 22:47:40,451 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 22:47:40,451 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 22:47:40,451 \tHypothesis: Nsɛm a ɛtete saa maa tete anyinam ahoɔden yɛɛ den sɛ wɔbɛbɔ wɔn ho ban na wɔabu wɔn ani agu so .\n","2020-05-21 22:47:40,451 Example #1\n","2020-05-21 22:47:40,451 \tSource:     If so , you would be worthy of death .\n","2020-05-21 22:47:40,451 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 22:47:40,451 \tHypothesis: Sɛ saa a , anka wobɛfata owu .\n","2020-05-21 22:47:40,451 Example #2\n","2020-05-21 22:47:40,452 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 22:47:40,452 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 22:47:40,452 \tHypothesis: Oo , hwɛ anigye ara a ɔsomafo Yohane hui sɛ nnipakuw kɛse no anisoadehu a ɛyɛ nwonwa yi rehu !\n","2020-05-21 22:47:40,452 Example #3\n","2020-05-21 22:47:40,452 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 22:47:40,452 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 22:47:40,452 \tHypothesis: Ná Yesu wɔ nkate fam yaw ne mmoa , nanso Petro ne afoforo no daa adi mpɛn pii .\n","2020-05-21 22:47:40,452 Validation result (greedy) at epoch  16, step    92000: bleu:  27.18, loss: 40595.4102, ppl:   4.6442, duration: 13.1120s\n","2020-05-21 22:47:51,398 Epoch  16 Step:    92100 Batch Loss:     2.147989 Tokens per Sec:    22043, Lr: 0.000300\n","2020-05-21 22:48:02,257 Epoch  16 Step:    92200 Batch Loss:     1.565973 Tokens per Sec:    21723, Lr: 0.000300\n","2020-05-21 22:48:13,073 Epoch  16 Step:    92300 Batch Loss:     1.482008 Tokens per Sec:    21878, Lr: 0.000300\n","2020-05-21 22:48:23,991 Epoch  16 Step:    92400 Batch Loss:     1.940687 Tokens per Sec:    22540, Lr: 0.000300\n","2020-05-21 22:48:34,825 Epoch  16 Step:    92500 Batch Loss:     1.693276 Tokens per Sec:    21965, Lr: 0.000300\n","2020-05-21 22:48:45,890 Epoch  16 Step:    92600 Batch Loss:     1.660984 Tokens per Sec:    21585, Lr: 0.000300\n","2020-05-21 22:48:56,796 Epoch  16 Step:    92700 Batch Loss:     1.733357 Tokens per Sec:    22144, Lr: 0.000300\n","2020-05-21 22:49:07,617 Epoch  16 Step:    92800 Batch Loss:     1.835450 Tokens per Sec:    21612, Lr: 0.000300\n","2020-05-21 22:49:18,528 Epoch  16 Step:    92900 Batch Loss:     1.601707 Tokens per Sec:    22614, Lr: 0.000300\n","2020-05-21 22:49:29,199 Epoch  16 Step:    93000 Batch Loss:     1.815808 Tokens per Sec:    21661, Lr: 0.000300\n","2020-05-21 22:49:40,914 Hooray! New best validation result [ppl]!\n","2020-05-21 22:49:40,915 Saving new checkpoint.\n","2020-05-21 22:49:41,150 Example #0\n","2020-05-21 22:49:41,150 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 22:49:41,150 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 22:49:41,150 \tHypothesis: Nsɛm a ɛte saa no maa tete nkurow no dii nkogu wɔ ɔkwan a wɔfa so yɛ adwuma ne amannɔne so .\n","2020-05-21 22:49:41,150 Example #1\n","2020-05-21 22:49:41,150 \tSource:     If so , you would be worthy of death .\n","2020-05-21 22:49:41,150 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 22:49:41,150 \tHypothesis: Sɛ ɛte saa a , anka wobɛfata sɛ wuwu .\n","2020-05-21 22:49:41,151 Example #2\n","2020-05-21 22:49:41,151 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 22:49:41,151 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 22:49:41,151 \tHypothesis: Oo , hwɛ sɛnea ɔsomafo Yohane ani gyei bere a ohuu nnipakuw kɛse no anisoadehu a ɛyɛ nwonwa yi !\n","2020-05-21 22:49:41,151 Example #3\n","2020-05-21 22:49:41,151 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 22:49:41,151 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 22:49:41,151 \tHypothesis: Ná Yesu wɔ nkate fam ahokyere ne mmoa , nanso Petro ne afoforo no daa so ara da .\n","2020-05-21 22:49:41,151 Validation result (greedy) at epoch  16, step    93000: bleu:  26.91, loss: 40498.6719, ppl:   4.6272, duration: 11.9516s\n","2020-05-21 22:49:52,009 Epoch  16 Step:    93100 Batch Loss:     1.668278 Tokens per Sec:    21881, Lr: 0.000300\n","2020-05-21 22:50:03,003 Epoch  16 Step:    93200 Batch Loss:     1.831301 Tokens per Sec:    22772, Lr: 0.000300\n","2020-05-21 22:50:13,748 Epoch  16 Step:    93300 Batch Loss:     1.714227 Tokens per Sec:    22378, Lr: 0.000300\n","2020-05-21 22:50:24,697 Epoch  16 Step:    93400 Batch Loss:     1.769586 Tokens per Sec:    21937, Lr: 0.000300\n","2020-05-21 22:50:35,454 Epoch  16 Step:    93500 Batch Loss:     1.809353 Tokens per Sec:    22073, Lr: 0.000300\n","2020-05-21 22:50:46,196 Epoch  16 Step:    93600 Batch Loss:     1.531276 Tokens per Sec:    21783, Lr: 0.000300\n","2020-05-21 22:50:56,950 Epoch  16 Step:    93700 Batch Loss:     1.861742 Tokens per Sec:    21955, Lr: 0.000300\n","2020-05-21 22:51:07,701 Epoch  16 Step:    93800 Batch Loss:     2.002354 Tokens per Sec:    21858, Lr: 0.000300\n","2020-05-21 22:51:18,517 Epoch  16 Step:    93900 Batch Loss:     1.738120 Tokens per Sec:    22338, Lr: 0.000300\n","2020-05-21 22:51:29,309 Epoch  16 Step:    94000 Batch Loss:     1.816016 Tokens per Sec:    21892, Lr: 0.000300\n","2020-05-21 22:51:42,398 Hooray! New best validation result [ppl]!\n","2020-05-21 22:51:42,399 Saving new checkpoint.\n","2020-05-21 22:51:42,669 Example #0\n","2020-05-21 22:51:42,669 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 22:51:42,669 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 22:51:42,669 \tHypothesis: Nsɛm a ɛtete saa no maa tete agumadi no hui sɛ ɛyɛ den sɛ wɔbɛbɔ wɔn ho ban na wɔabu wɔn ani agu so .\n","2020-05-21 22:51:42,669 Example #1\n","2020-05-21 22:51:42,670 \tSource:     If so , you would be worthy of death .\n","2020-05-21 22:51:42,670 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 22:51:42,670 \tHypothesis: Sɛ saa a , ɛnde na ɛsɛ sɛ wuwu .\n","2020-05-21 22:51:42,670 Example #2\n","2020-05-21 22:51:42,670 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 22:51:42,670 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 22:51:42,670 \tHypothesis: Oo , hwɛ sɛnea ɔsomafo Yohane ani gyei bere a ohui sɛ nnipakuw kɛse no anisoadehu a ɛyɛ anigye yi !\n","2020-05-21 22:51:42,670 Example #3\n","2020-05-21 22:51:42,671 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 22:51:42,671 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 22:51:42,671 \tHypothesis: Ná Yesu wɔ nkate fam ahotɔ ne mmoa , nanso Petro ne afoforo no daa adi mpɛn pii .\n","2020-05-21 22:51:42,671 Validation result (greedy) at epoch  16, step    94000: bleu:  27.55, loss: 40470.0234, ppl:   4.6222, duration: 13.3617s\n","2020-05-21 22:51:53,532 Epoch  16 Step:    94100 Batch Loss:     1.778804 Tokens per Sec:    22201, Lr: 0.000300\n","2020-05-21 22:52:04,332 Epoch  16 Step:    94200 Batch Loss:     1.691247 Tokens per Sec:    21847, Lr: 0.000300\n","2020-05-21 22:52:15,201 Epoch  16 Step:    94300 Batch Loss:     1.739179 Tokens per Sec:    22264, Lr: 0.000300\n","2020-05-21 22:52:26,036 Epoch  16 Step:    94400 Batch Loss:     1.827150 Tokens per Sec:    21852, Lr: 0.000300\n","2020-05-21 22:52:36,834 Epoch  16 Step:    94500 Batch Loss:     1.625503 Tokens per Sec:    22405, Lr: 0.000300\n","2020-05-21 22:52:47,664 Epoch  16 Step:    94600 Batch Loss:     1.714850 Tokens per Sec:    21894, Lr: 0.000300\n","2020-05-21 22:52:58,485 Epoch  16 Step:    94700 Batch Loss:     1.720076 Tokens per Sec:    22000, Lr: 0.000300\n","2020-05-21 22:53:09,413 Epoch  16 Step:    94800 Batch Loss:     1.834068 Tokens per Sec:    22297, Lr: 0.000300\n","2020-05-21 22:53:20,305 Epoch  16 Step:    94900 Batch Loss:     1.881363 Tokens per Sec:    22342, Lr: 0.000300\n","2020-05-21 22:53:31,148 Epoch  16 Step:    95000 Batch Loss:     1.855401 Tokens per Sec:    22021, Lr: 0.000300\n","2020-05-21 22:53:43,728 Hooray! New best validation result [ppl]!\n","2020-05-21 22:53:43,728 Saving new checkpoint.\n","2020-05-21 22:53:43,997 Example #0\n","2020-05-21 22:53:43,997 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 22:53:43,997 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 22:53:43,997 \tHypothesis: Nsɛm a ɛtete saa maa tete apɔnkɔ no hui sɛ ɛyɛ den na ɛyɛ anika .\n","2020-05-21 22:53:43,997 Example #1\n","2020-05-21 22:53:43,997 \tSource:     If so , you would be worthy of death .\n","2020-05-21 22:53:43,997 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 22:53:43,997 \tHypothesis: Sɛ saa a , anka wobɛfata sɛ wuwu .\n","2020-05-21 22:53:43,997 Example #2\n","2020-05-21 22:53:43,998 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 22:53:43,998 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 22:53:43,998 \tHypothesis: Hwɛ anigye ara a ɔsomafo Yohane hui sɛ nnipakuw kɛse no anisoadehu a ɛyɛ anigye yi !\n","2020-05-21 22:53:43,998 Example #3\n","2020-05-21 22:53:43,998 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 22:53:43,998 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 22:53:43,998 \tHypothesis: Ná Yesu wɔ nkate fam haw ne mmoa , nanso Petro ne afoforo no daa .\n","2020-05-21 22:53:43,998 Validation result (greedy) at epoch  16, step    95000: bleu:  27.27, loss: 40204.1758, ppl:   4.5759, duration: 12.8500s\n","2020-05-21 22:53:54,793 Epoch  16 Step:    95100 Batch Loss:     1.657487 Tokens per Sec:    21210, Lr: 0.000300\n","2020-05-21 22:54:05,591 Epoch  16 Step:    95200 Batch Loss:     1.583499 Tokens per Sec:    22019, Lr: 0.000300\n","2020-05-21 22:54:16,481 Epoch  16 Step:    95300 Batch Loss:     1.721028 Tokens per Sec:    22174, Lr: 0.000300\n","2020-05-21 22:54:27,243 Epoch  16 Step:    95400 Batch Loss:     1.610866 Tokens per Sec:    21754, Lr: 0.000300\n","2020-05-21 22:54:38,067 Epoch  16 Step:    95500 Batch Loss:     1.735332 Tokens per Sec:    22031, Lr: 0.000300\n","2020-05-21 22:54:48,844 Epoch  16 Step:    95600 Batch Loss:     1.823362 Tokens per Sec:    22287, Lr: 0.000300\n","2020-05-21 22:54:59,651 Epoch  16 Step:    95700 Batch Loss:     1.977006 Tokens per Sec:    21968, Lr: 0.000300\n","2020-05-21 22:55:10,512 Epoch  16 Step:    95800 Batch Loss:     1.788079 Tokens per Sec:    22507, Lr: 0.000300\n","2020-05-21 22:55:21,220 Epoch  16 Step:    95900 Batch Loss:     1.870108 Tokens per Sec:    21923, Lr: 0.000300\n","2020-05-21 22:55:31,985 Epoch  16 Step:    96000 Batch Loss:     1.776454 Tokens per Sec:    22108, Lr: 0.000300\n","2020-05-21 22:55:44,430 Example #0\n","2020-05-21 22:55:44,430 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 22:55:44,430 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 22:55:44,430 \tHypothesis: Nsɛm a ɛtete saa no maa tete agumadi dii nkonim sɛ wɔbɛbɔ wɔn ho ban na wɔabu wɔn ani agu so .\n","2020-05-21 22:55:44,431 Example #1\n","2020-05-21 22:55:44,431 \tSource:     If so , you would be worthy of death .\n","2020-05-21 22:55:44,431 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 22:55:44,431 \tHypothesis: Sɛ saa a , ɛnde na ɛfata sɛ wuwu .\n","2020-05-21 22:55:44,431 Example #2\n","2020-05-21 22:55:44,431 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 22:55:44,431 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 22:55:44,431 \tHypothesis: Hwɛ sɛnea ɔsomafo Yohane ani gyei bere a ohui sɛ nnipakuw kɛse no anisoadehu a ɛyɛ nwonwa yi !\n","2020-05-21 22:55:44,431 Example #3\n","2020-05-21 22:55:44,431 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 22:55:44,431 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 22:55:44,431 \tHypothesis: Ná Yesu wɔ nkate fam ahokyere ne mmoa , nanso Petro ne afoforo no daa .\n","2020-05-21 22:55:44,431 Validation result (greedy) at epoch  16, step    96000: bleu:  27.34, loss: 40466.0977, ppl:   4.6215, duration: 12.4465s\n","2020-05-21 22:55:55,207 Epoch  16 Step:    96100 Batch Loss:     1.816713 Tokens per Sec:    22014, Lr: 0.000300\n","2020-05-21 22:56:06,065 Epoch  16 Step:    96200 Batch Loss:     1.626016 Tokens per Sec:    22206, Lr: 0.000300\n","2020-05-21 22:56:16,818 Epoch  16 Step:    96300 Batch Loss:     1.632564 Tokens per Sec:    21840, Lr: 0.000300\n","2020-05-21 22:56:27,629 Epoch  16 Step:    96400 Batch Loss:     1.699714 Tokens per Sec:    21993, Lr: 0.000300\n","2020-05-21 22:56:38,446 Epoch  16 Step:    96500 Batch Loss:     1.556257 Tokens per Sec:    21940, Lr: 0.000300\n","2020-05-21 22:56:49,212 Epoch  16 Step:    96600 Batch Loss:     1.487235 Tokens per Sec:    21894, Lr: 0.000300\n","2020-05-21 22:57:00,036 Epoch  16 Step:    96700 Batch Loss:     1.433185 Tokens per Sec:    22347, Lr: 0.000300\n","2020-05-21 22:57:10,814 Epoch  16 Step:    96800 Batch Loss:     1.804137 Tokens per Sec:    21956, Lr: 0.000300\n","2020-05-21 22:57:15,472 Epoch  16: total training loss 10359.65\n","2020-05-21 22:57:15,472 EPOCH 17\n","2020-05-21 22:57:22,353 Epoch  17 Step:    96900 Batch Loss:     1.596779 Tokens per Sec:    19937, Lr: 0.000300\n","2020-05-21 22:57:33,193 Epoch  17 Step:    97000 Batch Loss:     1.687486 Tokens per Sec:    21943, Lr: 0.000300\n","2020-05-21 22:57:46,370 Example #0\n","2020-05-21 22:57:46,370 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 22:57:46,370 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 22:57:46,370 \tHypothesis: Nsɛm a ɛtete saa maa tete anyansafo huu sɛ ɛyɛ den na ɛyɛ anibiannaso .\n","2020-05-21 22:57:46,370 Example #1\n","2020-05-21 22:57:46,371 \tSource:     If so , you would be worthy of death .\n","2020-05-21 22:57:46,371 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 22:57:46,371 \tHypothesis: Sɛ saa a , anka wobɛfata owu .\n","2020-05-21 22:57:46,371 Example #2\n","2020-05-21 22:57:46,371 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 22:57:46,371 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 22:57:46,371 \tHypothesis: Oo , hwɛ sɛnea ɔsomafo Yohane ani gyei sɛ ohuu nnipakuw kɛse no anisoadehu a ɛyɛ hu yi !\n","2020-05-21 22:57:46,371 Example #3\n","2020-05-21 22:57:46,371 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 22:57:46,371 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 22:57:46,371 \tHypothesis: Ná Yesu wɔ nkate fam yaw ne mmoa a ohia , nanso Petro ne afoforo no daa .\n","2020-05-21 22:57:46,371 Validation result (greedy) at epoch  17, step    97000: bleu:  26.95, loss: 40309.4375, ppl:   4.5942, duration: 13.1780s\n","2020-05-21 22:57:57,247 Epoch  17 Step:    97100 Batch Loss:     1.485490 Tokens per Sec:    22341, Lr: 0.000300\n","2020-05-21 22:58:08,037 Epoch  17 Step:    97200 Batch Loss:     1.689064 Tokens per Sec:    22017, Lr: 0.000300\n","2020-05-21 22:58:18,841 Epoch  17 Step:    97300 Batch Loss:     1.508791 Tokens per Sec:    21578, Lr: 0.000300\n","2020-05-21 22:58:29,749 Epoch  17 Step:    97400 Batch Loss:     1.620977 Tokens per Sec:    22320, Lr: 0.000300\n","2020-05-21 22:58:40,548 Epoch  17 Step:    97500 Batch Loss:     1.702016 Tokens per Sec:    22200, Lr: 0.000300\n","2020-05-21 22:58:51,414 Epoch  17 Step:    97600 Batch Loss:     1.730372 Tokens per Sec:    22184, Lr: 0.000300\n","2020-05-21 22:59:02,301 Epoch  17 Step:    97700 Batch Loss:     1.494908 Tokens per Sec:    21779, Lr: 0.000300\n","2020-05-21 22:59:13,159 Epoch  17 Step:    97800 Batch Loss:     1.701358 Tokens per Sec:    22249, Lr: 0.000300\n","2020-05-21 22:59:24,014 Epoch  17 Step:    97900 Batch Loss:     1.612217 Tokens per Sec:    22111, Lr: 0.000300\n","2020-05-21 22:59:34,888 Epoch  17 Step:    98000 Batch Loss:     1.721504 Tokens per Sec:    22217, Lr: 0.000300\n","2020-05-21 22:59:47,200 Example #0\n","2020-05-21 22:59:47,200 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 22:59:47,201 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 22:59:47,201 \tHypothesis: Nsɛm a ɛtete saa no maa tete apɔnkɔ no huu sɛ ɛyɛ den na ɛyɛ den .\n","2020-05-21 22:59:47,201 Example #1\n","2020-05-21 22:59:47,201 \tSource:     If so , you would be worthy of death .\n","2020-05-21 22:59:47,201 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 22:59:47,201 \tHypothesis: Sɛ saa a , anka wobɛfata owu .\n","2020-05-21 22:59:47,201 Example #2\n","2020-05-21 22:59:47,201 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 22:59:47,201 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 22:59:47,201 \tHypothesis: Oo , hwɛ sɛnea ɔsomafo Yohane ani gyei bere a ohui sɛ nnipakuw kɛse no anisoadehu a ɛyɛ anigye yi !\n","2020-05-21 22:59:47,201 Example #3\n","2020-05-21 22:59:47,201 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 22:59:47,201 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 22:59:47,202 \tHypothesis: Ná Yesu wɔ nkate fam haw na ohia mmoa , nanso Petro ne afoforo no daa .\n","2020-05-21 22:59:47,202 Validation result (greedy) at epoch  17, step    98000: bleu:  27.27, loss: 40214.0859, ppl:   4.5777, duration: 12.3137s\n","2020-05-21 22:59:57,955 Epoch  17 Step:    98100 Batch Loss:     1.400488 Tokens per Sec:    21637, Lr: 0.000300\n","2020-05-21 23:00:08,904 Epoch  17 Step:    98200 Batch Loss:     1.603391 Tokens per Sec:    22087, Lr: 0.000300\n","2020-05-21 23:00:19,706 Epoch  17 Step:    98300 Batch Loss:     1.523704 Tokens per Sec:    22211, Lr: 0.000300\n","2020-05-21 23:00:30,506 Epoch  17 Step:    98400 Batch Loss:     1.739461 Tokens per Sec:    22059, Lr: 0.000300\n","2020-05-21 23:00:41,381 Epoch  17 Step:    98500 Batch Loss:     1.805019 Tokens per Sec:    22005, Lr: 0.000300\n","2020-05-21 23:00:52,221 Epoch  17 Step:    98600 Batch Loss:     1.567027 Tokens per Sec:    22096, Lr: 0.000300\n","2020-05-21 23:01:03,145 Epoch  17 Step:    98700 Batch Loss:     1.614727 Tokens per Sec:    21581, Lr: 0.000300\n","2020-05-21 23:01:14,057 Epoch  17 Step:    98800 Batch Loss:     1.642746 Tokens per Sec:    22222, Lr: 0.000300\n","2020-05-21 23:01:25,085 Epoch  17 Step:    98900 Batch Loss:     1.776793 Tokens per Sec:    22229, Lr: 0.000300\n","2020-05-21 23:01:35,950 Epoch  17 Step:    99000 Batch Loss:     1.689481 Tokens per Sec:    21984, Lr: 0.000300\n","2020-05-21 23:01:48,107 Example #0\n","2020-05-21 23:01:48,107 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 23:01:48,107 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 23:01:48,107 \tHypothesis: Nsɛm a ɛtete saa no maa tete nneɛma a na wɔagye din sɛ ɛyɛ aniwu na ɛyɛ aniwu .\n","2020-05-21 23:01:48,108 Example #1\n","2020-05-21 23:01:48,108 \tSource:     If so , you would be worthy of death .\n","2020-05-21 23:01:48,108 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 23:01:48,108 \tHypothesis: Sɛ saa a , anka wobɛfata owu .\n","2020-05-21 23:01:48,108 Example #2\n","2020-05-21 23:01:48,108 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 23:01:48,108 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 23:01:48,108 \tHypothesis: Oo , hwɛ anigye ara a ɔsomafo Yohane hui sɛ nnipakuw kɛse no anisoadehu a ɛyɛ hu yi !\n","2020-05-21 23:01:48,108 Example #3\n","2020-05-21 23:01:48,108 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 23:01:48,108 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 23:01:48,108 \tHypothesis: Ná Yesu wɔ nkate fam ahotɔ ne hia a ehia sɛ ɔboa no , nanso Petro ne afoforo no daa adi mpɛn pii .\n","2020-05-21 23:01:48,109 Validation result (greedy) at epoch  17, step    99000: bleu:  27.16, loss: 40220.3828, ppl:   4.5787, duration: 12.1580s\n","2020-05-21 23:01:58,928 Epoch  17 Step:    99100 Batch Loss:     1.654462 Tokens per Sec:    21227, Lr: 0.000300\n","2020-05-21 23:02:09,882 Epoch  17 Step:    99200 Batch Loss:     1.381457 Tokens per Sec:    22163, Lr: 0.000300\n","2020-05-21 23:02:20,754 Epoch  17 Step:    99300 Batch Loss:     1.505808 Tokens per Sec:    21953, Lr: 0.000300\n","2020-05-21 23:02:31,672 Epoch  17 Step:    99400 Batch Loss:     1.703382 Tokens per Sec:    21900, Lr: 0.000300\n","2020-05-21 23:02:42,532 Epoch  17 Step:    99500 Batch Loss:     1.623224 Tokens per Sec:    22044, Lr: 0.000300\n","2020-05-21 23:02:53,370 Epoch  17 Step:    99600 Batch Loss:     1.828324 Tokens per Sec:    22466, Lr: 0.000300\n","2020-05-21 23:03:04,184 Epoch  17 Step:    99700 Batch Loss:     1.721703 Tokens per Sec:    21639, Lr: 0.000300\n","2020-05-21 23:03:14,990 Epoch  17 Step:    99800 Batch Loss:     1.681598 Tokens per Sec:    22262, Lr: 0.000300\n","2020-05-21 23:03:25,827 Epoch  17 Step:    99900 Batch Loss:     1.593184 Tokens per Sec:    21869, Lr: 0.000300\n","2020-05-21 23:03:36,654 Epoch  17 Step:   100000 Batch Loss:     1.695307 Tokens per Sec:    22003, Lr: 0.000300\n","2020-05-21 23:03:49,223 Example #0\n","2020-05-21 23:03:49,223 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 23:03:49,223 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 23:03:49,223 \tHypothesis: Nsɛm a ɛtete saa no maa tete nkurow no dii adanse sɛ ɛyɛ aniwu na ɛyɛ aniwu .\n","2020-05-21 23:03:49,224 Example #1\n","2020-05-21 23:03:49,224 \tSource:     If so , you would be worthy of death .\n","2020-05-21 23:03:49,224 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 23:03:49,224 \tHypothesis: Sɛ saa a , anka wobɛfata owu .\n","2020-05-21 23:03:49,224 Example #2\n","2020-05-21 23:03:49,224 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 23:03:49,224 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 23:03:49,224 \tHypothesis: Oo , hwɛ anigye ara a ɔsomafo Yohane hui sɛ nnipakuw kɛse no anisoadehu a ɛyɛ nwonwa yi !\n","2020-05-21 23:03:49,224 Example #3\n","2020-05-21 23:03:49,224 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 23:03:49,224 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 23:03:49,224 \tHypothesis: Ná Yesu wɔ nkate fam ahokyere ne mmoa , nanso Petro ne afoforo no daa .\n","2020-05-21 23:03:49,224 Validation result (greedy) at epoch  17, step   100000: bleu:  27.09, loss: 40407.3477, ppl:   4.6112, duration: 12.5697s\n","2020-05-21 23:04:00,063 Epoch  17 Step:   100100 Batch Loss:     1.794432 Tokens per Sec:    21797, Lr: 0.000300\n","2020-05-21 23:04:11,117 Epoch  17 Step:   100200 Batch Loss:     1.641254 Tokens per Sec:    21968, Lr: 0.000300\n","2020-05-21 23:04:22,091 Epoch  17 Step:   100300 Batch Loss:     1.640626 Tokens per Sec:    21926, Lr: 0.000300\n","2020-05-21 23:04:33,070 Epoch  17 Step:   100400 Batch Loss:     1.525023 Tokens per Sec:    21813, Lr: 0.000300\n","2020-05-21 23:04:43,935 Epoch  17 Step:   100500 Batch Loss:     1.682676 Tokens per Sec:    21952, Lr: 0.000300\n","2020-05-21 23:04:54,849 Epoch  17 Step:   100600 Batch Loss:     1.478022 Tokens per Sec:    22289, Lr: 0.000300\n","2020-05-21 23:05:05,828 Epoch  17 Step:   100700 Batch Loss:     1.696477 Tokens per Sec:    22076, Lr: 0.000300\n","2020-05-21 23:05:16,799 Epoch  17 Step:   100800 Batch Loss:     1.707554 Tokens per Sec:    21931, Lr: 0.000300\n","2020-05-21 23:05:27,634 Epoch  17 Step:   100900 Batch Loss:     1.622732 Tokens per Sec:    22087, Lr: 0.000300\n","2020-05-21 23:05:38,340 Epoch  17 Step:   101000 Batch Loss:     1.632771 Tokens per Sec:    21588, Lr: 0.000300\n","2020-05-21 23:05:51,821 Hooray! New best validation result [ppl]!\n","2020-05-21 23:05:51,821 Saving new checkpoint.\n","2020-05-21 23:05:52,101 Example #0\n","2020-05-21 23:05:52,102 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 23:05:52,102 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 23:05:52,102 \tHypothesis: Nsɛm a ɛtete saa no maa tete nkurow no dii nkonim sɛ wɔbɛma wɔn ho ayɛ den na wɔabu wɔn ani agu so .\n","2020-05-21 23:05:52,102 Example #1\n","2020-05-21 23:05:52,102 \tSource:     If so , you would be worthy of death .\n","2020-05-21 23:05:52,102 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 23:05:52,102 \tHypothesis: Sɛ saa a , anka wobɛfata sɛ wuwu .\n","2020-05-21 23:05:52,102 Example #2\n","2020-05-21 23:05:52,102 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 23:05:52,102 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 23:05:52,103 \tHypothesis: Hwɛ anigye ara a ɔsomafo Yohane hui sɛ nnipakuw kɛse no anisoadehu a ɛyɛ nwonwa yi renya !\n","2020-05-21 23:05:52,103 Example #3\n","2020-05-21 23:05:52,103 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 23:05:52,103 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 23:05:52,103 \tHypothesis: Ná Yesu wɔ nkate fam haw , na na ohia mmoa , nanso Petro ne afoforo no daa .\n","2020-05-21 23:05:52,103 Validation result (greedy) at epoch  17, step   101000: bleu:  27.58, loss: 40170.7383, ppl:   4.5702, duration: 13.7622s\n","2020-05-21 23:06:03,058 Epoch  17 Step:   101100 Batch Loss:     1.813221 Tokens per Sec:    21841, Lr: 0.000300\n","2020-05-21 23:06:13,976 Epoch  17 Step:   101200 Batch Loss:     1.657666 Tokens per Sec:    22125, Lr: 0.000300\n","2020-05-21 23:06:24,842 Epoch  17 Step:   101300 Batch Loss:     1.557880 Tokens per Sec:    21996, Lr: 0.000300\n","2020-05-21 23:06:35,830 Epoch  17 Step:   101400 Batch Loss:     1.922946 Tokens per Sec:    22190, Lr: 0.000300\n","2020-05-21 23:06:46,775 Epoch  17 Step:   101500 Batch Loss:     1.836491 Tokens per Sec:    21849, Lr: 0.000300\n","2020-05-21 23:06:57,587 Epoch  17 Step:   101600 Batch Loss:     1.448248 Tokens per Sec:    21717, Lr: 0.000300\n","2020-05-21 23:07:08,502 Epoch  17 Step:   101700 Batch Loss:     1.699303 Tokens per Sec:    22063, Lr: 0.000300\n","2020-05-21 23:07:19,261 Epoch  17 Step:   101800 Batch Loss:     1.597189 Tokens per Sec:    21339, Lr: 0.000300\n","2020-05-21 23:07:30,117 Epoch  17 Step:   101900 Batch Loss:     1.704787 Tokens per Sec:    22029, Lr: 0.000300\n","2020-05-21 23:07:41,010 Epoch  17 Step:   102000 Batch Loss:     1.489961 Tokens per Sec:    21827, Lr: 0.000300\n","2020-05-21 23:07:53,762 Hooray! New best validation result [ppl]!\n","2020-05-21 23:07:53,762 Saving new checkpoint.\n","2020-05-21 23:07:54,079 Example #0\n","2020-05-21 23:07:54,079 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 23:07:54,079 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 23:07:54,079 \tHypothesis: Nsɛm a ɛtete saa no maa tete nneɛma a na ɛyɛ hu sɛ na ɛyɛ den na ɛyɛ anika .\n","2020-05-21 23:07:54,079 Example #1\n","2020-05-21 23:07:54,080 \tSource:     If so , you would be worthy of death .\n","2020-05-21 23:07:54,080 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 23:07:54,080 \tHypothesis: Sɛ saa a , anka wobɛfata owu .\n","2020-05-21 23:07:54,080 Example #2\n","2020-05-21 23:07:54,080 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 23:07:54,080 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 23:07:54,080 \tHypothesis: Oo , hwɛ anigye ara a ɔsomafo Yohane hui sɛ nnipakuw kɛse no anisoadehu a ɛyɛ hu yi yɛ !\n","2020-05-21 23:07:54,080 Example #3\n","2020-05-21 23:07:54,080 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 23:07:54,080 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 23:07:54,080 \tHypothesis: Ná Yesu wɔ nkate fam haw , na na ohia mmoa , nanso Petro ne afoforo no daa .\n","2020-05-21 23:07:54,080 Validation result (greedy) at epoch  17, step   102000: bleu:  27.26, loss: 39969.6211, ppl:   4.5355, duration: 13.0706s\n","2020-05-21 23:08:04,993 Epoch  17 Step:   102100 Batch Loss:     1.736007 Tokens per Sec:    21929, Lr: 0.000300\n","2020-05-21 23:08:15,832 Epoch  17 Step:   102200 Batch Loss:     1.679515 Tokens per Sec:    22058, Lr: 0.000300\n","2020-05-21 23:08:26,707 Epoch  17 Step:   102300 Batch Loss:     1.584013 Tokens per Sec:    21910, Lr: 0.000300\n","2020-05-21 23:08:37,576 Epoch  17 Step:   102400 Batch Loss:     1.666901 Tokens per Sec:    21692, Lr: 0.000300\n","2020-05-21 23:08:48,411 Epoch  17 Step:   102500 Batch Loss:     1.664391 Tokens per Sec:    22008, Lr: 0.000300\n","2020-05-21 23:08:59,263 Epoch  17 Step:   102600 Batch Loss:     1.752643 Tokens per Sec:    22177, Lr: 0.000300\n","2020-05-21 23:09:10,097 Epoch  17 Step:   102700 Batch Loss:     1.789532 Tokens per Sec:    21272, Lr: 0.000300\n","2020-05-21 23:09:20,986 Epoch  17 Step:   102800 Batch Loss:     1.521645 Tokens per Sec:    21701, Lr: 0.000300\n","2020-05-21 23:09:31,914 Epoch  17: total training loss 10281.35\n","2020-05-21 23:09:31,914 EPOCH 18\n","2020-05-21 23:09:32,729 Epoch  18 Step:   102900 Batch Loss:     1.457355 Tokens per Sec:     1857, Lr: 0.000300\n","2020-05-21 23:09:43,700 Epoch  18 Step:   103000 Batch Loss:     2.027366 Tokens per Sec:    22620, Lr: 0.000300\n","2020-05-21 23:09:56,493 Hooray! New best validation result [ppl]!\n","2020-05-21 23:09:56,494 Saving new checkpoint.\n","2020-05-21 23:09:56,762 Example #0\n","2020-05-21 23:09:56,763 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 23:09:56,763 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 23:09:56,763 \tHypothesis: Nsɛm a ɛtete saa no maa tete nneɛma a na ɛyɛ hu a na ɛyɛ hu sɛ ɛyɛ den na ɛyɛ nwonwa .\n","2020-05-21 23:09:56,763 Example #1\n","2020-05-21 23:09:56,763 \tSource:     If so , you would be worthy of death .\n","2020-05-21 23:09:56,763 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 23:09:56,763 \tHypothesis: Sɛ ɛte saa a , ɛnde na wobɛfata sɛ wuwu .\n","2020-05-21 23:09:56,763 Example #2\n","2020-05-21 23:09:56,764 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 23:09:56,764 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 23:09:56,764 \tHypothesis: Oo , hwɛ sɛnea ɔsomafo Yohane ani gyei bere a ohuu nnipakuw kɛse no anisoadehu a ɛyɛ anigye yi !\n","2020-05-21 23:09:56,764 Example #3\n","2020-05-21 23:09:56,764 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 23:09:56,764 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 23:09:56,764 \tHypothesis: Ná Yesu wɔ nkate fam ahokyere ne mmoa , nanso Petro ne afoforo no daa so ara da .\n","2020-05-21 23:09:56,764 Validation result (greedy) at epoch  18, step   103000: bleu:  27.57, loss: 39943.8867, ppl:   4.5311, duration: 13.0636s\n","2020-05-21 23:10:07,660 Epoch  18 Step:   103100 Batch Loss:     1.403204 Tokens per Sec:    21988, Lr: 0.000300\n","2020-05-21 23:10:18,578 Epoch  18 Step:   103200 Batch Loss:     1.819104 Tokens per Sec:    21648, Lr: 0.000300\n","2020-05-21 23:10:29,516 Epoch  18 Step:   103300 Batch Loss:     1.845251 Tokens per Sec:    21861, Lr: 0.000300\n","2020-05-21 23:10:40,499 Epoch  18 Step:   103400 Batch Loss:     1.757379 Tokens per Sec:    22404, Lr: 0.000300\n","2020-05-21 23:10:51,306 Epoch  18 Step:   103500 Batch Loss:     1.811048 Tokens per Sec:    21920, Lr: 0.000300\n","2020-05-21 23:11:02,308 Epoch  18 Step:   103600 Batch Loss:     1.567998 Tokens per Sec:    22661, Lr: 0.000300\n","2020-05-21 23:11:13,212 Epoch  18 Step:   103700 Batch Loss:     1.750735 Tokens per Sec:    21942, Lr: 0.000300\n","2020-05-21 23:11:24,151 Epoch  18 Step:   103800 Batch Loss:     1.684888 Tokens per Sec:    21898, Lr: 0.000300\n","2020-05-21 23:11:35,056 Epoch  18 Step:   103900 Batch Loss:     1.821025 Tokens per Sec:    22003, Lr: 0.000300\n","2020-05-21 23:11:45,931 Epoch  18 Step:   104000 Batch Loss:     1.352605 Tokens per Sec:    21661, Lr: 0.000300\n","2020-05-21 23:11:58,672 Example #0\n","2020-05-21 23:11:58,672 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 23:11:58,672 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 23:11:58,672 \tHypothesis: Nsɛm a ɛtete saa maa tete tete nneɛma no yɛɛ nwonwa sɛ na ɛyɛ den na ɛyɛ nwonwa .\n","2020-05-21 23:11:58,672 Example #1\n","2020-05-21 23:11:58,672 \tSource:     If so , you would be worthy of death .\n","2020-05-21 23:11:58,672 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 23:11:58,672 \tHypothesis: Sɛ saa a , anka wobɛfata owu .\n","2020-05-21 23:11:58,672 Example #2\n","2020-05-21 23:11:58,673 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 23:11:58,673 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 23:11:58,673 \tHypothesis: Oo , hwɛ sɛnea ɔsomafo Yohane ani gyei bere a ohui sɛ nnipakuw kɛse no anisoadehu a ɛyɛ anigye yi !\n","2020-05-21 23:11:58,673 Example #3\n","2020-05-21 23:11:58,673 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 23:11:58,673 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 23:11:58,673 \tHypothesis: Ná Yesu wɔ nkate fam yaw ne mmoa , nanso Petro ne afoforo no daa so ara da .\n","2020-05-21 23:11:58,673 Validation result (greedy) at epoch  18, step   104000: bleu:  27.73, loss: 39999.4375, ppl:   4.5406, duration: 12.7416s\n","2020-05-21 23:12:09,578 Epoch  18 Step:   104100 Batch Loss:     1.859098 Tokens per Sec:    21872, Lr: 0.000300\n","2020-05-21 23:12:20,550 Epoch  18 Step:   104200 Batch Loss:     1.694881 Tokens per Sec:    22393, Lr: 0.000300\n","2020-05-21 23:12:31,512 Epoch  18 Step:   104300 Batch Loss:     1.595590 Tokens per Sec:    22005, Lr: 0.000300\n","2020-05-21 23:12:42,434 Epoch  18 Step:   104400 Batch Loss:     1.798072 Tokens per Sec:    21403, Lr: 0.000300\n","2020-05-21 23:12:53,304 Epoch  18 Step:   104500 Batch Loss:     1.685182 Tokens per Sec:    21581, Lr: 0.000300\n","2020-05-21 23:13:04,299 Epoch  18 Step:   104600 Batch Loss:     1.615681 Tokens per Sec:    21569, Lr: 0.000300\n","2020-05-21 23:13:15,318 Epoch  18 Step:   104700 Batch Loss:     1.490782 Tokens per Sec:    21853, Lr: 0.000300\n","2020-05-21 23:13:26,279 Epoch  18 Step:   104800 Batch Loss:     1.723266 Tokens per Sec:    21872, Lr: 0.000300\n","2020-05-21 23:13:37,182 Epoch  18 Step:   104900 Batch Loss:     1.844389 Tokens per Sec:    21515, Lr: 0.000300\n","2020-05-21 23:13:48,093 Epoch  18 Step:   105000 Batch Loss:     1.566957 Tokens per Sec:    21539, Lr: 0.000300\n","2020-05-21 23:14:01,267 Example #0\n","2020-05-21 23:14:01,267 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 23:14:01,267 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 23:14:01,267 \tHypothesis: Nsɛm a ɛtete saa no maa tete aguadifo no huu sɛ ɛyɛ den na ɛyɛ aniberesɛm .\n","2020-05-21 23:14:01,267 Example #1\n","2020-05-21 23:14:01,267 \tSource:     If so , you would be worthy of death .\n","2020-05-21 23:14:01,267 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 23:14:01,267 \tHypothesis: Sɛ saa a , anka wobɛfata owu .\n","2020-05-21 23:14:01,268 Example #2\n","2020-05-21 23:14:01,268 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 23:14:01,268 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 23:14:01,268 \tHypothesis: Oo , hwɛ anigye ara a ɔsomafo Yohane hui sɛ nnipakuw kɛse no anisoadehu a ɛyɛ hu yi !\n","2020-05-21 23:14:01,268 Example #3\n","2020-05-21 23:14:01,268 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 23:14:01,268 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 23:14:01,268 \tHypothesis: Ná Yesu wɔ nkate fam yaw , na na ohia mmoa , nanso Petro ne afoforo no daa .\n","2020-05-21 23:14:01,268 Validation result (greedy) at epoch  18, step   105000: bleu:  27.80, loss: 39984.0742, ppl:   4.5380, duration: 13.1751s\n","2020-05-21 23:14:12,261 Epoch  18 Step:   105100 Batch Loss:     1.698677 Tokens per Sec:    22309, Lr: 0.000300\n","2020-05-21 23:14:23,276 Epoch  18 Step:   105200 Batch Loss:     1.669180 Tokens per Sec:    21670, Lr: 0.000300\n","2020-05-21 23:14:34,322 Epoch  18 Step:   105300 Batch Loss:     1.769858 Tokens per Sec:    21385, Lr: 0.000300\n","2020-05-21 23:14:45,413 Epoch  18 Step:   105400 Batch Loss:     1.658538 Tokens per Sec:    21929, Lr: 0.000300\n","2020-05-21 23:14:56,464 Epoch  18 Step:   105500 Batch Loss:     1.576303 Tokens per Sec:    21522, Lr: 0.000300\n","2020-05-21 23:15:07,488 Epoch  18 Step:   105600 Batch Loss:     1.570956 Tokens per Sec:    21989, Lr: 0.000300\n","2020-05-21 23:15:18,417 Epoch  18 Step:   105700 Batch Loss:     1.696316 Tokens per Sec:    21470, Lr: 0.000300\n","2020-05-21 23:15:29,264 Epoch  18 Step:   105800 Batch Loss:     1.550538 Tokens per Sec:    21957, Lr: 0.000300\n","2020-05-21 23:15:40,261 Epoch  18 Step:   105900 Batch Loss:     1.716445 Tokens per Sec:    21859, Lr: 0.000300\n","2020-05-21 23:15:51,298 Epoch  18 Step:   106000 Batch Loss:     1.685658 Tokens per Sec:    21805, Lr: 0.000300\n","2020-05-21 23:16:03,599 Hooray! New best validation result [ppl]!\n","2020-05-21 23:16:03,599 Saving new checkpoint.\n","2020-05-21 23:16:03,929 Example #0\n","2020-05-21 23:16:03,929 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 23:16:03,929 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 23:16:03,929 \tHypothesis: Nsɛm a ɛtete saa no maa tete agumadi no yɛɛ den sɛ wɔbɛbɔ wɔn ho ban na wɔabu wɔn ani agu so .\n","2020-05-21 23:16:03,929 Example #1\n","2020-05-21 23:16:03,930 \tSource:     If so , you would be worthy of death .\n","2020-05-21 23:16:03,930 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 23:16:03,930 \tHypothesis: Sɛ saa a , anka wobɛfata owu .\n","2020-05-21 23:16:03,930 Example #2\n","2020-05-21 23:16:03,930 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 23:16:03,930 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 23:16:03,930 \tHypothesis: Oo , hwɛ sɛnea ɔsomafo Yohane ani gyei bere a ohuu nnipakuw kɛse no anisoadehu a ɛyɛ anigye yi !\n","2020-05-21 23:16:03,930 Example #3\n","2020-05-21 23:16:03,930 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 23:16:03,930 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 23:16:03,930 \tHypothesis: Ná Yesu wɔ nkate fam haw na ohia mmoa , nanso Petro ne afoforo no daa daa daa .\n","2020-05-21 23:16:03,930 Validation result (greedy) at epoch  18, step   106000: bleu:  27.59, loss: 39857.9961, ppl:   4.5164, duration: 12.6324s\n","2020-05-21 23:16:14,865 Epoch  18 Step:   106100 Batch Loss:     1.617706 Tokens per Sec:    21604, Lr: 0.000300\n","2020-05-21 23:16:25,868 Epoch  18 Step:   106200 Batch Loss:     1.541218 Tokens per Sec:    21929, Lr: 0.000300\n","2020-05-21 23:16:36,685 Epoch  18 Step:   106300 Batch Loss:     1.881515 Tokens per Sec:    21418, Lr: 0.000300\n","2020-05-21 23:16:47,684 Epoch  18 Step:   106400 Batch Loss:     1.669989 Tokens per Sec:    21646, Lr: 0.000300\n","2020-05-21 23:16:58,763 Epoch  18 Step:   106500 Batch Loss:     1.686722 Tokens per Sec:    22202, Lr: 0.000300\n","2020-05-21 23:17:09,777 Epoch  18 Step:   106600 Batch Loss:     1.659677 Tokens per Sec:    21944, Lr: 0.000300\n","2020-05-21 23:17:20,817 Epoch  18 Step:   106700 Batch Loss:     1.486424 Tokens per Sec:    22057, Lr: 0.000300\n","2020-05-21 23:17:31,927 Epoch  18 Step:   106800 Batch Loss:     1.693757 Tokens per Sec:    21834, Lr: 0.000300\n","2020-05-21 23:17:42,733 Epoch  18 Step:   106900 Batch Loss:     1.650592 Tokens per Sec:    21699, Lr: 0.000300\n","2020-05-21 23:17:53,707 Epoch  18 Step:   107000 Batch Loss:     1.448412 Tokens per Sec:    21768, Lr: 0.000300\n","2020-05-21 23:18:05,955 Hooray! New best validation result [ppl]!\n","2020-05-21 23:18:05,956 Saving new checkpoint.\n","2020-05-21 23:18:06,253 Example #0\n","2020-05-21 23:18:06,253 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 23:18:06,253 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 23:18:06,253 \tHypothesis: Nsɛm a ɛtete saa no maa tete agumadi no daa adi sɛ na ɛyɛ den na ɛyɛ anibiannaso .\n","2020-05-21 23:18:06,253 Example #1\n","2020-05-21 23:18:06,253 \tSource:     If so , you would be worthy of death .\n","2020-05-21 23:18:06,253 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 23:18:06,254 \tHypothesis: Sɛ saa a , anka wobɛfata sɛ wuwu .\n","2020-05-21 23:18:06,254 Example #2\n","2020-05-21 23:18:06,254 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 23:18:06,254 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 23:18:06,254 \tHypothesis: Hwɛ sɛnea ɔsomafo Yohane ani gyei bere a ohuu nnipakuw kɛse no anisoadehu a ɛyɛ anigye yi !\n","2020-05-21 23:18:06,254 Example #3\n","2020-05-21 23:18:06,254 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 23:18:06,254 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 23:18:06,254 \tHypothesis: Ná Yesu wɔ nkate fam haw na ohia mmoa , nanso Petro ne afoforo no daa adi mpɛn pii .\n","2020-05-21 23:18:06,255 Validation result (greedy) at epoch  18, step   107000: bleu:  27.44, loss: 39776.5859, ppl:   4.5025, duration: 12.5471s\n","2020-05-21 23:18:17,191 Epoch  18 Step:   107100 Batch Loss:     1.750173 Tokens per Sec:    21832, Lr: 0.000300\n","2020-05-21 23:18:28,057 Epoch  18 Step:   107200 Batch Loss:     1.560097 Tokens per Sec:    20899, Lr: 0.000300\n","2020-05-21 23:18:39,053 Epoch  18 Step:   107300 Batch Loss:     1.708061 Tokens per Sec:    21738, Lr: 0.000300\n","2020-05-21 23:18:50,036 Epoch  18 Step:   107400 Batch Loss:     1.800000 Tokens per Sec:    22143, Lr: 0.000300\n","2020-05-21 23:19:00,958 Epoch  18 Step:   107500 Batch Loss:     1.778982 Tokens per Sec:    22001, Lr: 0.000300\n","2020-05-21 23:19:11,829 Epoch  18 Step:   107600 Batch Loss:     1.863775 Tokens per Sec:    21707, Lr: 0.000300\n","2020-05-21 23:19:22,801 Epoch  18 Step:   107700 Batch Loss:     1.660815 Tokens per Sec:    21970, Lr: 0.000300\n","2020-05-21 23:19:33,821 Epoch  18 Step:   107800 Batch Loss:     1.882500 Tokens per Sec:    21862, Lr: 0.000300\n","2020-05-21 23:19:44,834 Epoch  18 Step:   107900 Batch Loss:     1.592377 Tokens per Sec:    21638, Lr: 0.000300\n","2020-05-21 23:19:55,789 Epoch  18 Step:   108000 Batch Loss:     1.502858 Tokens per Sec:    21822, Lr: 0.000300\n","2020-05-21 23:20:08,492 Hooray! New best validation result [ppl]!\n","2020-05-21 23:20:08,492 Saving new checkpoint.\n","2020-05-21 23:20:08,820 Example #0\n","2020-05-21 23:20:08,820 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 23:20:08,820 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 23:20:08,820 \tHypothesis: Nsɛm a ɛtete saa no maa tete agumadi no dii nkonim sɛ ɛyɛ den na ɛyɛ aniberesɛm .\n","2020-05-21 23:20:08,820 Example #1\n","2020-05-21 23:20:08,820 \tSource:     If so , you would be worthy of death .\n","2020-05-21 23:20:08,820 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 23:20:08,820 \tHypothesis: Sɛ saa a , anka wobɛfata sɛ wuwu .\n","2020-05-21 23:20:08,820 Example #2\n","2020-05-21 23:20:08,821 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 23:20:08,821 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 23:20:08,821 \tHypothesis: Hwɛ anigye ara a ɔsomafo Yohane hui sɛ nnipakuw kɛse no anisoadehu a ɛyɛ nwonwa yi !\n","2020-05-21 23:20:08,821 Example #3\n","2020-05-21 23:20:08,821 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 23:20:08,821 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 23:20:08,821 \tHypothesis: Ná Yesu wɔ nkate fam yaw , na na ohia mmoa , nanso Petro ne afoforo no daa so ara da .\n","2020-05-21 23:20:08,821 Validation result (greedy) at epoch  18, step   108000: bleu:  27.55, loss: 39722.5781, ppl:   4.4933, duration: 13.0321s\n","2020-05-21 23:20:19,867 Epoch  18 Step:   108100 Batch Loss:     1.618921 Tokens per Sec:    21781, Lr: 0.000300\n","2020-05-21 23:20:30,939 Epoch  18 Step:   108200 Batch Loss:     1.630751 Tokens per Sec:    22049, Lr: 0.000300\n","2020-05-21 23:20:41,753 Epoch  18 Step:   108300 Batch Loss:     1.716808 Tokens per Sec:    21937, Lr: 0.000300\n","2020-05-21 23:20:52,651 Epoch  18 Step:   108400 Batch Loss:     1.492177 Tokens per Sec:    21644, Lr: 0.000300\n","2020-05-21 23:21:03,721 Epoch  18 Step:   108500 Batch Loss:     1.639980 Tokens per Sec:    21994, Lr: 0.000300\n","2020-05-21 23:21:14,677 Epoch  18 Step:   108600 Batch Loss:     1.716911 Tokens per Sec:    21880, Lr: 0.000300\n","2020-05-21 23:21:25,675 Epoch  18 Step:   108700 Batch Loss:     1.542358 Tokens per Sec:    21728, Lr: 0.000300\n","2020-05-21 23:21:36,560 Epoch  18 Step:   108800 Batch Loss:     1.609827 Tokens per Sec:    21683, Lr: 0.000300\n","2020-05-21 23:21:47,515 Epoch  18 Step:   108900 Batch Loss:     1.688523 Tokens per Sec:    21828, Lr: 0.000300\n","2020-05-21 23:21:52,421 Epoch  18: total training loss 10182.64\n","2020-05-21 23:21:52,421 EPOCH 19\n","2020-05-21 23:21:59,258 Epoch  19 Step:   109000 Batch Loss:     1.768670 Tokens per Sec:    19383, Lr: 0.000300\n","2020-05-21 23:22:11,619 Example #0\n","2020-05-21 23:22:11,619 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 23:22:11,619 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 23:22:11,619 \tHypothesis: Nsɛm a ɛtete saa maa tete anyinam ahoɔden yɛɛ den sɛ wɔbɛbɔ wɔn ho ban na wɔabu wɔn ani agu so .\n","2020-05-21 23:22:11,619 Example #1\n","2020-05-21 23:22:11,619 \tSource:     If so , you would be worthy of death .\n","2020-05-21 23:22:11,619 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 23:22:11,619 \tHypothesis: Sɛ saa a , ɛnde na wobɛfata owu .\n","2020-05-21 23:22:11,619 Example #2\n","2020-05-21 23:22:11,620 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 23:22:11,620 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 23:22:11,620 \tHypothesis: Oo , hwɛ sɛnea ɔsomafo Yohane ani gyei bere a ohui sɛ nnipakuw kɛse no anisoadehu a ɛyɛ anigye yi !\n","2020-05-21 23:22:11,620 Example #3\n","2020-05-21 23:22:11,620 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 23:22:11,620 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 23:22:11,620 \tHypothesis: Ná Yesu wɔ nkate fam ahokyere ne mmoa , nanso Petro ne afoforo no daa .\n","2020-05-21 23:22:11,620 Validation result (greedy) at epoch  19, step   109000: bleu:  27.89, loss: 39863.8594, ppl:   4.5174, duration: 12.3619s\n","2020-05-21 23:22:22,591 Epoch  19 Step:   109100 Batch Loss:     1.585593 Tokens per Sec:    21829, Lr: 0.000300\n","2020-05-21 23:22:33,516 Epoch  19 Step:   109200 Batch Loss:     1.595020 Tokens per Sec:    21859, Lr: 0.000300\n","2020-05-21 23:22:44,366 Epoch  19 Step:   109300 Batch Loss:     1.786703 Tokens per Sec:    21611, Lr: 0.000300\n","2020-05-21 23:22:55,254 Epoch  19 Step:   109400 Batch Loss:     1.485102 Tokens per Sec:    21737, Lr: 0.000300\n","2020-05-21 23:23:06,194 Epoch  19 Step:   109500 Batch Loss:     1.669090 Tokens per Sec:    22158, Lr: 0.000300\n","2020-05-21 23:23:17,101 Epoch  19 Step:   109600 Batch Loss:     1.539154 Tokens per Sec:    22101, Lr: 0.000300\n","2020-05-21 23:23:27,903 Epoch  19 Step:   109700 Batch Loss:     1.565534 Tokens per Sec:    21897, Lr: 0.000300\n","2020-05-21 23:23:38,745 Epoch  19 Step:   109800 Batch Loss:     1.630944 Tokens per Sec:    21767, Lr: 0.000300\n","2020-05-21 23:23:49,602 Epoch  19 Step:   109900 Batch Loss:     1.754713 Tokens per Sec:    22132, Lr: 0.000300\n","2020-05-21 23:24:00,476 Epoch  19 Step:   110000 Batch Loss:     1.899090 Tokens per Sec:    21963, Lr: 0.000300\n","2020-05-21 23:24:12,979 Example #0\n","2020-05-21 23:24:12,979 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 23:24:12,979 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 23:24:12,979 \tHypothesis: Nsɛm a ɛtete saa no maa tete anyinam ahoɔden a na wɔde yɛ adwuma no yɛɛ anibiannaso .\n","2020-05-21 23:24:12,979 Example #1\n","2020-05-21 23:24:12,979 \tSource:     If so , you would be worthy of death .\n","2020-05-21 23:24:12,979 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 23:24:12,980 \tHypothesis: Sɛ saa a , ɛnde na wobɛfata owu .\n","2020-05-21 23:24:12,980 Example #2\n","2020-05-21 23:24:12,980 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 23:24:12,980 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 23:24:12,980 \tHypothesis: Oo , hwɛ sɛnea ɔsomafo Yohane ani gyei bere a ohuu nnipakuw kɛse no anisoadehu a ɛyɛ fɛ yi !\n","2020-05-21 23:24:12,980 Example #3\n","2020-05-21 23:24:12,980 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 23:24:12,980 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 23:24:12,980 \tHypothesis: Ná Yesu wɔ nkate fam yaw , na na ohia mmoa , nanso Petro ne afoforo no daa .\n","2020-05-21 23:24:12,980 Validation result (greedy) at epoch  19, step   110000: bleu:  27.57, loss: 39727.1836, ppl:   4.4941, duration: 12.5037s\n","2020-05-21 23:24:23,816 Epoch  19 Step:   110100 Batch Loss:     1.772787 Tokens per Sec:    22135, Lr: 0.000300\n","2020-05-21 23:24:34,835 Epoch  19 Step:   110200 Batch Loss:     1.644692 Tokens per Sec:    21938, Lr: 0.000300\n","2020-05-21 23:24:45,761 Epoch  19 Step:   110300 Batch Loss:     1.581746 Tokens per Sec:    21809, Lr: 0.000300\n","2020-05-21 23:24:56,680 Epoch  19 Step:   110400 Batch Loss:     1.723122 Tokens per Sec:    21848, Lr: 0.000300\n","2020-05-21 23:25:07,654 Epoch  19 Step:   110500 Batch Loss:     1.520363 Tokens per Sec:    22304, Lr: 0.000300\n","2020-05-21 23:25:18,592 Epoch  19 Step:   110600 Batch Loss:     1.582143 Tokens per Sec:    21609, Lr: 0.000300\n","2020-05-21 23:25:29,701 Epoch  19 Step:   110700 Batch Loss:     1.722042 Tokens per Sec:    21149, Lr: 0.000300\n","2020-05-21 23:25:40,703 Epoch  19 Step:   110800 Batch Loss:     1.664236 Tokens per Sec:    21910, Lr: 0.000300\n","2020-05-21 23:25:51,796 Epoch  19 Step:   110900 Batch Loss:     1.746987 Tokens per Sec:    21901, Lr: 0.000300\n","2020-05-21 23:26:02,889 Epoch  19 Step:   111000 Batch Loss:     1.545434 Tokens per Sec:    21344, Lr: 0.000300\n","2020-05-21 23:26:15,550 Hooray! New best validation result [ppl]!\n","2020-05-21 23:26:15,550 Saving new checkpoint.\n","2020-05-21 23:26:15,825 Example #0\n","2020-05-21 23:26:15,825 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 23:26:15,825 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 23:26:15,825 \tHypothesis: Nsɛm a ɛtete saa no maa tete nneɛma a na ɛyɛ hu sɛ na ɛyɛ den na ɛyɛ aniwu .\n","2020-05-21 23:26:15,826 Example #1\n","2020-05-21 23:26:15,826 \tSource:     If so , you would be worthy of death .\n","2020-05-21 23:26:15,826 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 23:26:15,826 \tHypothesis: Sɛ saa a , anka wobɛfata sɛ wuwu .\n","2020-05-21 23:26:15,826 Example #2\n","2020-05-21 23:26:15,826 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 23:26:15,826 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 23:26:15,826 \tHypothesis: Oo , hwɛ sɛnea ɔsomafo Yohane ani gyei bere a ohuu nnipakuw kɛse no anisoadehu a ɛyɛ nwonwa yi !\n","2020-05-21 23:26:15,826 Example #3\n","2020-05-21 23:26:15,827 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 23:26:15,827 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 23:26:15,827 \tHypothesis: Ná Yesu wɔ nkate fam yaw , na na ohia mmoa , nanso Petro ne afoforo no daa .\n","2020-05-21 23:26:15,827 Validation result (greedy) at epoch  19, step   111000: bleu:  27.83, loss: 39679.6445, ppl:   4.4860, duration: 12.9376s\n","2020-05-21 23:26:27,032 Epoch  19 Step:   111100 Batch Loss:     1.604148 Tokens per Sec:    21511, Lr: 0.000300\n","2020-05-21 23:26:38,141 Epoch  19 Step:   111200 Batch Loss:     1.902404 Tokens per Sec:    21234, Lr: 0.000300\n","2020-05-21 23:26:49,302 Epoch  19 Step:   111300 Batch Loss:     1.731107 Tokens per Sec:    21252, Lr: 0.000300\n","2020-05-21 23:27:00,306 Epoch  19 Step:   111400 Batch Loss:     1.668814 Tokens per Sec:    21757, Lr: 0.000300\n","2020-05-21 23:27:11,364 Epoch  19 Step:   111500 Batch Loss:     1.507263 Tokens per Sec:    21920, Lr: 0.000300\n","2020-05-21 23:27:22,282 Epoch  19 Step:   111600 Batch Loss:     1.507504 Tokens per Sec:    21790, Lr: 0.000300\n","2020-05-21 23:27:33,330 Epoch  19 Step:   111700 Batch Loss:     1.812275 Tokens per Sec:    21812, Lr: 0.000300\n","2020-05-21 23:27:44,342 Epoch  19 Step:   111800 Batch Loss:     1.549588 Tokens per Sec:    21552, Lr: 0.000300\n","2020-05-21 23:27:55,260 Epoch  19 Step:   111900 Batch Loss:     1.728001 Tokens per Sec:    21494, Lr: 0.000300\n","2020-05-21 23:28:06,186 Epoch  19 Step:   112000 Batch Loss:     1.744016 Tokens per Sec:    21613, Lr: 0.000300\n","2020-05-21 23:28:18,830 Hooray! New best validation result [ppl]!\n","2020-05-21 23:28:18,830 Saving new checkpoint.\n","2020-05-21 23:28:19,143 Example #0\n","2020-05-21 23:28:19,143 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 23:28:19,143 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 23:28:19,143 \tHypothesis: Nsɛm a ɛtete saa maa tete ahemfo huu sɛ ɛyɛ den na na wɔyɛ anibiannaso .\n","2020-05-21 23:28:19,144 Example #1\n","2020-05-21 23:28:19,144 \tSource:     If so , you would be worthy of death .\n","2020-05-21 23:28:19,144 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 23:28:19,144 \tHypothesis: Sɛ saa a , ɛnde na wobɛfata owu .\n","2020-05-21 23:28:19,144 Example #2\n","2020-05-21 23:28:19,144 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 23:28:19,144 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 23:28:19,144 \tHypothesis: Hwɛ sɛnea ɔsomafo Yohane ani gyei bere a ohuu nnipakuw kɛse no anisoadehu a ɛyɛ anigye yi !\n","2020-05-21 23:28:19,144 Example #3\n","2020-05-21 23:28:19,145 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 23:28:19,145 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 23:28:19,145 \tHypothesis: Ná Yesu wɔ nkate fam haw , na na ohia mmoa , nanso Petro ne afoforo no daa daa .\n","2020-05-21 23:28:19,145 Validation result (greedy) at epoch  19, step   112000: bleu:  27.84, loss: 39545.8086, ppl:   4.4634, duration: 12.9587s\n","2020-05-21 23:28:30,111 Epoch  19 Step:   112100 Batch Loss:     1.507426 Tokens per Sec:    21769, Lr: 0.000300\n","2020-05-21 23:28:41,066 Epoch  19 Step:   112200 Batch Loss:     1.679484 Tokens per Sec:    21681, Lr: 0.000300\n","2020-05-21 23:28:52,073 Epoch  19 Step:   112300 Batch Loss:     1.834113 Tokens per Sec:    21813, Lr: 0.000300\n","2020-05-21 23:29:02,952 Epoch  19 Step:   112400 Batch Loss:     1.897734 Tokens per Sec:    21828, Lr: 0.000300\n","2020-05-21 23:29:13,868 Epoch  19 Step:   112500 Batch Loss:     1.802882 Tokens per Sec:    21615, Lr: 0.000300\n","2020-05-21 23:29:24,841 Epoch  19 Step:   112600 Batch Loss:     1.604094 Tokens per Sec:    22073, Lr: 0.000300\n","2020-05-21 23:29:35,716 Epoch  19 Step:   112700 Batch Loss:     1.821656 Tokens per Sec:    21649, Lr: 0.000300\n","2020-05-21 23:29:46,580 Epoch  19 Step:   112800 Batch Loss:     1.739515 Tokens per Sec:    21570, Lr: 0.000300\n","2020-05-21 23:29:57,529 Epoch  19 Step:   112900 Batch Loss:     1.445062 Tokens per Sec:    21598, Lr: 0.000300\n","2020-05-21 23:30:08,628 Epoch  19 Step:   113000 Batch Loss:     1.317361 Tokens per Sec:    22036, Lr: 0.000300\n","2020-05-21 23:30:21,068 Example #0\n","2020-05-21 23:30:21,068 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 23:30:21,068 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 23:30:21,068 \tHypothesis: Nsɛm a ɛtete saa no maa tete aguadi no yɛɛ nwonwa sɛ na ɛyɛ anihaw na ɛyɛ nwonwa .\n","2020-05-21 23:30:21,068 Example #1\n","2020-05-21 23:30:21,068 \tSource:     If so , you would be worthy of death .\n","2020-05-21 23:30:21,068 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 23:30:21,068 \tHypothesis: Sɛ saa a , anka wobɛfata owu .\n","2020-05-21 23:30:21,068 Example #2\n","2020-05-21 23:30:21,069 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 23:30:21,069 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 23:30:21,069 \tHypothesis: Hwɛ sɛnea ɔsomafo Yohane ani gyei bere a ohuu nnipakuw kɛse no anisoadehu a ɛyɛ anigye yi !\n","2020-05-21 23:30:21,069 Example #3\n","2020-05-21 23:30:21,069 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 23:30:21,069 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 23:30:21,069 \tHypothesis: Ná Yesu wɔ nkate fam yaw , na na ohia mmoa , nanso Petro ne afoforo no daa daa mpɛn pii .\n","2020-05-21 23:30:21,069 Validation result (greedy) at epoch  19, step   113000: bleu:  27.86, loss: 39665.8828, ppl:   4.4837, duration: 12.4404s\n","2020-05-21 23:30:32,092 Epoch  19 Step:   113100 Batch Loss:     1.698523 Tokens per Sec:    21658, Lr: 0.000300\n","2020-05-21 23:30:43,065 Epoch  19 Step:   113200 Batch Loss:     1.638774 Tokens per Sec:    21806, Lr: 0.000300\n","2020-05-21 23:30:54,091 Epoch  19 Step:   113300 Batch Loss:     1.631334 Tokens per Sec:    21782, Lr: 0.000300\n","2020-05-21 23:31:05,191 Epoch  19 Step:   113400 Batch Loss:     1.862651 Tokens per Sec:    21823, Lr: 0.000300\n","2020-05-21 23:31:16,249 Epoch  19 Step:   113500 Batch Loss:     1.749843 Tokens per Sec:    22304, Lr: 0.000300\n","2020-05-21 23:31:27,151 Epoch  19 Step:   113600 Batch Loss:     1.914378 Tokens per Sec:    21600, Lr: 0.000300\n","2020-05-21 23:31:38,128 Epoch  19 Step:   113700 Batch Loss:     1.473573 Tokens per Sec:    21855, Lr: 0.000300\n","2020-05-21 23:31:49,134 Epoch  19 Step:   113800 Batch Loss:     1.985389 Tokens per Sec:    22052, Lr: 0.000300\n","2020-05-21 23:32:00,182 Epoch  19 Step:   113900 Batch Loss:     1.580928 Tokens per Sec:    21720, Lr: 0.000300\n","2020-05-21 23:32:11,133 Epoch  19 Step:   114000 Batch Loss:     1.605739 Tokens per Sec:    21799, Lr: 0.000300\n","2020-05-21 23:32:23,853 Hooray! New best validation result [ppl]!\n","2020-05-21 23:32:23,853 Saving new checkpoint.\n","2020-05-21 23:32:24,097 Example #0\n","2020-05-21 23:32:24,097 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 23:32:24,097 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 23:32:24,097 \tHypothesis: Nsɛm a ɛtete saa no maa tete nneɛma no yɛɛ nwonwa sɛ na ɛyɛ den na ɛyɛ anibiannaso .\n","2020-05-21 23:32:24,097 Example #1\n","2020-05-21 23:32:24,097 \tSource:     If so , you would be worthy of death .\n","2020-05-21 23:32:24,097 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 23:32:24,098 \tHypothesis: Sɛ saa a , ɛnde na wobɛfata sɛ wuwu .\n","2020-05-21 23:32:24,098 Example #2\n","2020-05-21 23:32:24,098 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 23:32:24,098 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 23:32:24,098 \tHypothesis: Oo , hwɛ sɛnea ɔsomafo Yohane ani gyei bere a ohuu nnipakuw kɛse no anisoadehu a ɛyɛ nwonwa yi !\n","2020-05-21 23:32:24,098 Example #3\n","2020-05-21 23:32:24,098 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 23:32:24,098 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 23:32:24,098 \tHypothesis: Ná Yesu wɔ nkate fam yaw , na na ohia mmoa , nanso Petro ne afoforo no daa .\n","2020-05-21 23:32:24,098 Validation result (greedy) at epoch  19, step   114000: bleu:  27.95, loss: 39423.5469, ppl:   4.4428, duration: 12.9653s\n","2020-05-21 23:32:35,176 Epoch  19 Step:   114100 Batch Loss:     1.537294 Tokens per Sec:    21858, Lr: 0.000300\n","2020-05-21 23:32:46,182 Epoch  19 Step:   114200 Batch Loss:     1.463959 Tokens per Sec:    21279, Lr: 0.000300\n","2020-05-21 23:32:57,219 Epoch  19 Step:   114300 Batch Loss:     1.685225 Tokens per Sec:    21552, Lr: 0.000300\n","2020-05-21 23:33:08,236 Epoch  19 Step:   114400 Batch Loss:     1.395698 Tokens per Sec:    21677, Lr: 0.000300\n","2020-05-21 23:33:19,341 Epoch  19 Step:   114500 Batch Loss:     2.033561 Tokens per Sec:    21939, Lr: 0.000300\n","2020-05-21 23:33:30,438 Epoch  19 Step:   114600 Batch Loss:     1.775490 Tokens per Sec:    21639, Lr: 0.000300\n","2020-05-21 23:33:41,426 Epoch  19 Step:   114700 Batch Loss:     1.630283 Tokens per Sec:    21679, Lr: 0.000300\n","2020-05-21 23:33:52,434 Epoch  19 Step:   114800 Batch Loss:     1.723860 Tokens per Sec:    21727, Lr: 0.000300\n","2020-05-21 23:34:03,432 Epoch  19 Step:   114900 Batch Loss:     1.827222 Tokens per Sec:    21643, Lr: 0.000300\n","2020-05-21 23:34:14,415 Epoch  19 Step:   115000 Batch Loss:     1.844815 Tokens per Sec:    21471, Lr: 0.000300\n","2020-05-21 23:34:27,317 Example #0\n","2020-05-21 23:34:27,317 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 23:34:27,317 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 23:34:27,317 \tHypothesis: Nsɛm a ɛtete saa no maa tete aporɔw no yɛɛ den sɛ wɔbɛbɔ wɔn ho ban na wɔabu wɔn ani agu so .\n","2020-05-21 23:34:27,317 Example #1\n","2020-05-21 23:34:27,318 \tSource:     If so , you would be worthy of death .\n","2020-05-21 23:34:27,318 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 23:34:27,318 \tHypothesis: Sɛ saa a , ɛnde na ɛfata sɛ wuwu .\n","2020-05-21 23:34:27,318 Example #2\n","2020-05-21 23:34:27,318 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 23:34:27,318 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 23:34:27,318 \tHypothesis: Oo , hwɛ anigye ara a ɔsomafo Yohane hui sɛ nnipakuw kɛse no anisoadehu a ɛyɛ anigye yi !\n","2020-05-21 23:34:27,318 Example #3\n","2020-05-21 23:34:27,318 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 23:34:27,318 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 23:34:27,319 \tHypothesis: Ná Yesu wɔ nkate fam yaw , na na ohia mmoa , nanso Petro ne afoforo no daa .\n","2020-05-21 23:34:27,319 Validation result (greedy) at epoch  19, step   115000: bleu:  27.94, loss: 39439.5117, ppl:   4.4455, duration: 12.9029s\n","2020-05-21 23:34:27,339 Epoch  19: total training loss 10145.95\n","2020-05-21 23:34:27,339 EPOCH 20\n","2020-05-21 23:34:39,373 Epoch  20 Step:   115100 Batch Loss:     1.827665 Tokens per Sec:    20204, Lr: 0.000300\n","2020-05-21 23:34:50,442 Epoch  20 Step:   115200 Batch Loss:     1.632931 Tokens per Sec:    21683, Lr: 0.000300\n","2020-05-21 23:35:01,515 Epoch  20 Step:   115300 Batch Loss:     1.492279 Tokens per Sec:    22081, Lr: 0.000300\n","2020-05-21 23:35:12,524 Epoch  20 Step:   115400 Batch Loss:     1.731786 Tokens per Sec:    21810, Lr: 0.000300\n","2020-05-21 23:35:23,600 Epoch  20 Step:   115500 Batch Loss:     1.553292 Tokens per Sec:    21790, Lr: 0.000300\n","2020-05-21 23:35:34,651 Epoch  20 Step:   115600 Batch Loss:     1.586280 Tokens per Sec:    21614, Lr: 0.000300\n","2020-05-21 23:35:45,676 Epoch  20 Step:   115700 Batch Loss:     1.674441 Tokens per Sec:    21964, Lr: 0.000300\n","2020-05-21 23:35:56,714 Epoch  20 Step:   115800 Batch Loss:     1.683367 Tokens per Sec:    21856, Lr: 0.000300\n","2020-05-21 23:36:07,766 Epoch  20 Step:   115900 Batch Loss:     1.740667 Tokens per Sec:    21472, Lr: 0.000300\n","2020-05-21 23:36:18,841 Epoch  20 Step:   116000 Batch Loss:     1.603451 Tokens per Sec:    21399, Lr: 0.000300\n","2020-05-21 23:36:31,578 Example #0\n","2020-05-21 23:36:31,578 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 23:36:31,578 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 23:36:31,578 \tHypothesis: Nsɛm a ɛtete saa no maa tete ahoni no hui sɛ ɛyɛ den na ɛyɛ anibiannaso .\n","2020-05-21 23:36:31,578 Example #1\n","2020-05-21 23:36:31,578 \tSource:     If so , you would be worthy of death .\n","2020-05-21 23:36:31,579 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 23:36:31,579 \tHypothesis: Sɛ saa a , anka wobɛfata owu .\n","2020-05-21 23:36:31,579 Example #2\n","2020-05-21 23:36:31,579 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 23:36:31,579 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 23:36:31,579 \tHypothesis: Oo , hwɛ anigye ara a ɔsomafo Yohane hui sɛ nnipakuw kɛse no anisoadehu a ɛyɛ nwonwa yi renya !\n","2020-05-21 23:36:31,579 Example #3\n","2020-05-21 23:36:31,579 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 23:36:31,579 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 23:36:31,579 \tHypothesis: Ná Yesu wɔ nkate fam ahokyere ne hia a ehia sɛ ɔboa no , nanso Petro ne afoforo no daa .\n","2020-05-21 23:36:31,579 Validation result (greedy) at epoch  20, step   116000: bleu:  28.24, loss: 39461.1992, ppl:   4.4491, duration: 12.7385s\n","2020-05-21 23:36:42,588 Epoch  20 Step:   116100 Batch Loss:     1.783297 Tokens per Sec:    21622, Lr: 0.000300\n","2020-05-21 23:36:53,722 Epoch  20 Step:   116200 Batch Loss:     1.702715 Tokens per Sec:    21852, Lr: 0.000300\n","2020-05-21 23:37:04,769 Epoch  20 Step:   116300 Batch Loss:     1.526885 Tokens per Sec:    21968, Lr: 0.000300\n","2020-05-21 23:37:15,816 Epoch  20 Step:   116400 Batch Loss:     1.564415 Tokens per Sec:    21632, Lr: 0.000300\n","2020-05-21 23:37:26,874 Epoch  20 Step:   116500 Batch Loss:     1.829173 Tokens per Sec:    21991, Lr: 0.000300\n","2020-05-21 23:37:37,956 Epoch  20 Step:   116600 Batch Loss:     1.477420 Tokens per Sec:    21270, Lr: 0.000300\n","2020-05-21 23:37:48,888 Epoch  20 Step:   116700 Batch Loss:     1.608857 Tokens per Sec:    21080, Lr: 0.000300\n","2020-05-21 23:37:59,940 Epoch  20 Step:   116800 Batch Loss:     1.526301 Tokens per Sec:    21616, Lr: 0.000300\n","2020-05-21 23:38:11,019 Epoch  20 Step:   116900 Batch Loss:     1.623044 Tokens per Sec:    21776, Lr: 0.000300\n","2020-05-21 23:38:22,128 Epoch  20 Step:   117000 Batch Loss:     1.633988 Tokens per Sec:    21965, Lr: 0.000300\n","2020-05-21 23:38:35,383 Example #0\n","2020-05-21 23:38:35,383 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 23:38:35,383 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 23:38:35,383 \tHypothesis: Nsɛm a ɛtete saa no maa tete ahemfie no huu sɛ ɛyɛ den na ɛyɛ anibiannaso .\n","2020-05-21 23:38:35,384 Example #1\n","2020-05-21 23:38:35,384 \tSource:     If so , you would be worthy of death .\n","2020-05-21 23:38:35,384 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 23:38:35,384 \tHypothesis: Sɛ saa a , ɛnde na wobɛfata owu .\n","2020-05-21 23:38:35,384 Example #2\n","2020-05-21 23:38:35,384 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 23:38:35,384 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 23:38:35,384 \tHypothesis: Oo , hwɛ anigye ara a ɔsomafo Yohane nyae bere a ohuu nnipakuw kɛse no anisoadehu a ɛyɛ hu yi !\n","2020-05-21 23:38:35,384 Example #3\n","2020-05-21 23:38:35,384 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 23:38:35,384 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 23:38:35,384 \tHypothesis: Ná Yesu wɔ nkate fam yaw , na na ohia mmoa , nanso Petro ne afoforo no daa .\n","2020-05-21 23:38:35,384 Validation result (greedy) at epoch  20, step   117000: bleu:  28.55, loss: 39426.8320, ppl:   4.4433, duration: 13.2558s\n","2020-05-21 23:38:46,489 Epoch  20 Step:   117100 Batch Loss:     1.676846 Tokens per Sec:    21663, Lr: 0.000300\n","2020-05-21 23:38:57,419 Epoch  20 Step:   117200 Batch Loss:     1.592686 Tokens per Sec:    21104, Lr: 0.000300\n","2020-05-21 23:39:08,321 Epoch  20 Step:   117300 Batch Loss:     1.541446 Tokens per Sec:    21738, Lr: 0.000300\n","2020-05-21 23:39:19,438 Epoch  20 Step:   117400 Batch Loss:     1.865763 Tokens per Sec:    21800, Lr: 0.000300\n","2020-05-21 23:39:30,446 Epoch  20 Step:   117500 Batch Loss:     1.716339 Tokens per Sec:    21387, Lr: 0.000300\n","2020-05-21 23:39:41,563 Epoch  20 Step:   117600 Batch Loss:     1.520115 Tokens per Sec:    22213, Lr: 0.000300\n","2020-05-21 23:39:52,519 Epoch  20 Step:   117700 Batch Loss:     1.479424 Tokens per Sec:    21183, Lr: 0.000300\n","2020-05-21 23:40:03,538 Epoch  20 Step:   117800 Batch Loss:     1.498492 Tokens per Sec:    21373, Lr: 0.000300\n","2020-05-21 23:40:14,486 Epoch  20 Step:   117900 Batch Loss:     1.888744 Tokens per Sec:    21675, Lr: 0.000300\n","2020-05-21 23:40:25,488 Epoch  20 Step:   118000 Batch Loss:     1.822111 Tokens per Sec:    21462, Lr: 0.000300\n","2020-05-21 23:40:37,826 Example #0\n","2020-05-21 23:40:37,826 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 23:40:37,826 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 23:40:37,826 \tHypothesis: Nsɛm a ɛtete saa no maa tete ahemfie no hui sɛ ɛyɛ den na ɛyɛ aniberesɛm .\n","2020-05-21 23:40:37,826 Example #1\n","2020-05-21 23:40:37,827 \tSource:     If so , you would be worthy of death .\n","2020-05-21 23:40:37,827 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 23:40:37,827 \tHypothesis: Sɛ saa a , ɛnde na wobɛfata owu .\n","2020-05-21 23:40:37,827 Example #2\n","2020-05-21 23:40:37,827 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 23:40:37,827 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 23:40:37,827 \tHypothesis: Oo , hwɛ anigye ara a ɔsomafo Yohane hui sɛ nnipakuw kɛse no anisoadehu a ɛyɛ anigye yi !\n","2020-05-21 23:40:37,827 Example #3\n","2020-05-21 23:40:37,827 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 23:40:37,827 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 23:40:37,827 \tHypothesis: Ná Yesu wɔ nkate fam yaw , na na ehia sɛ ɔboa afoforo , nanso Petro ne afoforo no daa .\n","2020-05-21 23:40:37,827 Validation result (greedy) at epoch  20, step   118000: bleu:  28.08, loss: 39500.1250, ppl:   4.4557, duration: 12.3392s\n","2020-05-21 23:40:48,707 Epoch  20 Step:   118100 Batch Loss:     1.754723 Tokens per Sec:    21768, Lr: 0.000300\n","2020-05-21 23:40:59,848 Epoch  20 Step:   118200 Batch Loss:     1.751724 Tokens per Sec:    22043, Lr: 0.000300\n","2020-05-21 23:41:10,837 Epoch  20 Step:   118300 Batch Loss:     1.692428 Tokens per Sec:    21970, Lr: 0.000300\n","2020-05-21 23:41:21,837 Epoch  20 Step:   118400 Batch Loss:     1.891033 Tokens per Sec:    21627, Lr: 0.000300\n","2020-05-21 23:41:32,822 Epoch  20 Step:   118500 Batch Loss:     1.434533 Tokens per Sec:    21677, Lr: 0.000300\n","2020-05-21 23:41:43,780 Epoch  20 Step:   118600 Batch Loss:     1.772137 Tokens per Sec:    21695, Lr: 0.000300\n","2020-05-21 23:41:54,766 Epoch  20 Step:   118700 Batch Loss:     1.580634 Tokens per Sec:    21580, Lr: 0.000300\n","2020-05-21 23:42:05,643 Epoch  20 Step:   118800 Batch Loss:     1.693407 Tokens per Sec:    21815, Lr: 0.000300\n","2020-05-21 23:42:16,613 Epoch  20 Step:   118900 Batch Loss:     1.757332 Tokens per Sec:    21635, Lr: 0.000300\n","2020-05-21 23:42:27,422 Epoch  20 Step:   119000 Batch Loss:     1.327909 Tokens per Sec:    21485, Lr: 0.000300\n","2020-05-21 23:42:40,590 Example #0\n","2020-05-21 23:42:40,590 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 23:42:40,590 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 23:42:40,590 \tHypothesis: Nsɛm a ɛtete saa no maa tete aguadi no yɛɛ nwonwa sɛ na ɛyɛ den na na ɛyɛ aniwu .\n","2020-05-21 23:42:40,591 Example #1\n","2020-05-21 23:42:40,591 \tSource:     If so , you would be worthy of death .\n","2020-05-21 23:42:40,591 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 23:42:40,591 \tHypothesis: Sɛ saa a , anka wobɛfata sɛ wuwu .\n","2020-05-21 23:42:40,591 Example #2\n","2020-05-21 23:42:40,591 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 23:42:40,591 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 23:42:40,591 \tHypothesis: Oo , hwɛ anigye ara a ɔsomafo Yohane hui sɛ nnipakuw kɛse no anisoadehu a ɛyɛ nwonwa yi renya !\n","2020-05-21 23:42:40,591 Example #3\n","2020-05-21 23:42:40,591 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 23:42:40,591 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 23:42:40,592 \tHypothesis: Ná Yesu wɔ nkate fam ahokyere ne hia a ehia sɛ ɔboa no , nanso Petro ne afoforo no daa adi mpɛn pii .\n","2020-05-21 23:42:40,592 Validation result (greedy) at epoch  20, step   119000: bleu:  28.03, loss: 39432.9844, ppl:   4.4444, duration: 13.1692s\n","2020-05-21 23:42:51,573 Epoch  20 Step:   119100 Batch Loss:     1.625386 Tokens per Sec:    22024, Lr: 0.000300\n","2020-05-21 23:43:02,557 Epoch  20 Step:   119200 Batch Loss:     1.856147 Tokens per Sec:    22039, Lr: 0.000300\n","2020-05-21 23:43:13,521 Epoch  20 Step:   119300 Batch Loss:     1.588063 Tokens per Sec:    22167, Lr: 0.000300\n","2020-05-21 23:43:24,501 Epoch  20 Step:   119400 Batch Loss:     1.759082 Tokens per Sec:    22002, Lr: 0.000300\n","2020-05-21 23:43:35,429 Epoch  20 Step:   119500 Batch Loss:     1.764243 Tokens per Sec:    21256, Lr: 0.000300\n","2020-05-21 23:43:46,331 Epoch  20 Step:   119600 Batch Loss:     1.666420 Tokens per Sec:    21783, Lr: 0.000300\n","2020-05-21 23:43:57,319 Epoch  20 Step:   119700 Batch Loss:     1.531587 Tokens per Sec:    22090, Lr: 0.000300\n","2020-05-21 23:44:08,401 Epoch  20 Step:   119800 Batch Loss:     1.527657 Tokens per Sec:    21996, Lr: 0.000300\n","2020-05-21 23:44:19,369 Epoch  20 Step:   119900 Batch Loss:     1.629132 Tokens per Sec:    21899, Lr: 0.000300\n","2020-05-21 23:44:30,224 Epoch  20 Step:   120000 Batch Loss:     1.961772 Tokens per Sec:    21454, Lr: 0.000300\n","2020-05-21 23:44:42,667 Hooray! New best validation result [ppl]!\n","2020-05-21 23:44:42,667 Saving new checkpoint.\n","2020-05-21 23:44:44,204 Example #0\n","2020-05-21 23:44:44,204 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 23:44:44,204 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 23:44:44,204 \tHypothesis: Nsɛm a ɛtete saa maa tete nneɛma a na ɛyɛ hu no yɛɛ nwonwa sɛ na ɛyɛ aniberesɛm na ɛyɛ aniberesɛm .\n","2020-05-21 23:44:44,204 Example #1\n","2020-05-21 23:44:44,204 \tSource:     If so , you would be worthy of death .\n","2020-05-21 23:44:44,205 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 23:44:44,205 \tHypothesis: Sɛ saa a , ɛnde na wobɛfata owu .\n","2020-05-21 23:44:44,205 Example #2\n","2020-05-21 23:44:44,205 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 23:44:44,205 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 23:44:44,205 \tHypothesis: Oo , hwɛ sɛnea ɔsomafo Yohane ani gyei bere a ohuu nnipakuw kɛse no anisoadehu a ɛyɛ anigye yi !\n","2020-05-21 23:44:44,205 Example #3\n","2020-05-21 23:44:44,205 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 23:44:44,205 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 23:44:44,205 \tHypothesis: Ná Yesu wɔ nkate fam yaw , na ohia mmoa , nanso Petro ne afoforo no daa .\n","2020-05-21 23:44:44,205 Validation result (greedy) at epoch  20, step   120000: bleu:  27.92, loss: 39235.5039, ppl:   4.4113, duration: 13.9816s\n","2020-05-21 23:44:55,179 Epoch  20 Step:   120100 Batch Loss:     1.732040 Tokens per Sec:    21895, Lr: 0.000300\n","2020-05-21 23:45:06,268 Epoch  20 Step:   120200 Batch Loss:     1.587706 Tokens per Sec:    22072, Lr: 0.000300\n","2020-05-21 23:45:17,347 Epoch  20 Step:   120300 Batch Loss:     1.849664 Tokens per Sec:    21972, Lr: 0.000300\n","2020-05-21 23:45:28,413 Epoch  20 Step:   120400 Batch Loss:     1.612561 Tokens per Sec:    21684, Lr: 0.000300\n","2020-05-21 23:45:39,555 Epoch  20 Step:   120500 Batch Loss:     1.730028 Tokens per Sec:    21428, Lr: 0.000300\n","2020-05-21 23:45:50,610 Epoch  20 Step:   120600 Batch Loss:     1.609071 Tokens per Sec:    21957, Lr: 0.000300\n","2020-05-21 23:46:01,699 Epoch  20 Step:   120700 Batch Loss:     1.726012 Tokens per Sec:    21942, Lr: 0.000300\n","2020-05-21 23:46:12,726 Epoch  20 Step:   120800 Batch Loss:     1.835225 Tokens per Sec:    21764, Lr: 0.000300\n","2020-05-21 23:46:23,606 Epoch  20 Step:   120900 Batch Loss:     1.738134 Tokens per Sec:    21622, Lr: 0.000300\n","2020-05-21 23:46:34,510 Epoch  20 Step:   121000 Batch Loss:     1.660584 Tokens per Sec:    22241, Lr: 0.000300\n","2020-05-21 23:46:47,394 Example #0\n","2020-05-21 23:46:47,395 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 23:46:47,395 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 23:46:47,395 \tHypothesis: Nsɛm a ɛtete saa no maa tete ahoni no hui sɛ ɛyɛ den na na ɛyɛ anibiannaso .\n","2020-05-21 23:46:47,395 Example #1\n","2020-05-21 23:46:47,395 \tSource:     If so , you would be worthy of death .\n","2020-05-21 23:46:47,395 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 23:46:47,395 \tHypothesis: Sɛ saa a , ɛnde na ɛfata sɛ wuwu .\n","2020-05-21 23:46:47,395 Example #2\n","2020-05-21 23:46:47,395 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 23:46:47,395 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 23:46:47,395 \tHypothesis: Oo , hwɛ sɛnea ɔsomafo Yohane ani gyei bere a ohuu nnipakuw kɛse no anisoadehu a ɛyɛ nwonwa yi !\n","2020-05-21 23:46:47,395 Example #3\n","2020-05-21 23:46:47,396 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 23:46:47,396 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 23:46:47,396 \tHypothesis: Ná Yesu wɔ nkate fam yaw , na na ohia mmoa , nanso Petro ne afoforo no daa .\n","2020-05-21 23:46:47,396 Validation result (greedy) at epoch  20, step   121000: bleu:  28.13, loss: 39249.7031, ppl:   4.4137, duration: 12.8852s\n","2020-05-21 23:46:52,092 Epoch  20: total training loss 10057.72\n","2020-05-21 23:46:52,092 EPOCH 21\n","2020-05-21 23:46:58,971 Epoch  21 Step:   121100 Batch Loss:     1.569003 Tokens per Sec:    19537, Lr: 0.000300\n","2020-05-21 23:47:09,944 Epoch  21 Step:   121200 Batch Loss:     1.658319 Tokens per Sec:    21916, Lr: 0.000300\n","2020-05-21 23:47:20,823 Epoch  21 Step:   121300 Batch Loss:     1.574273 Tokens per Sec:    21753, Lr: 0.000300\n","2020-05-21 23:47:31,678 Epoch  21 Step:   121400 Batch Loss:     1.937486 Tokens per Sec:    21675, Lr: 0.000300\n","2020-05-21 23:47:42,609 Epoch  21 Step:   121500 Batch Loss:     1.475008 Tokens per Sec:    21996, Lr: 0.000300\n","2020-05-21 23:47:53,576 Epoch  21 Step:   121600 Batch Loss:     1.666633 Tokens per Sec:    21885, Lr: 0.000300\n","2020-05-21 23:48:04,602 Epoch  21 Step:   121700 Batch Loss:     1.518021 Tokens per Sec:    21769, Lr: 0.000300\n","2020-05-21 23:48:15,577 Epoch  21 Step:   121800 Batch Loss:     1.772869 Tokens per Sec:    21517, Lr: 0.000300\n","2020-05-21 23:48:26,548 Epoch  21 Step:   121900 Batch Loss:     1.776584 Tokens per Sec:    22191, Lr: 0.000300\n","2020-05-21 23:48:37,400 Epoch  21 Step:   122000 Batch Loss:     1.851158 Tokens per Sec:    21255, Lr: 0.000300\n","2020-05-21 23:48:49,528 Example #0\n","2020-05-21 23:48:49,528 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 23:48:49,528 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 23:48:49,528 \tHypothesis: Nsɛm a ɛtete saa no maa tete ahoni no hui sɛ ɛyɛ aniwu na ɛyɛ anibiannaso .\n","2020-05-21 23:48:49,528 Example #1\n","2020-05-21 23:48:49,528 \tSource:     If so , you would be worthy of death .\n","2020-05-21 23:48:49,528 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 23:48:49,528 \tHypothesis: Sɛ saa a , anka wobɛfata owu .\n","2020-05-21 23:48:49,528 Example #2\n","2020-05-21 23:48:49,529 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 23:48:49,529 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 23:48:49,529 \tHypothesis: Oo , hwɛ anigye ara a ɔsomafo Yohane nyae bere a ohuu nnipakuw kɛse no anisoadehu a ɛyɛ nwonwa yi !\n","2020-05-21 23:48:49,529 Example #3\n","2020-05-21 23:48:49,529 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 23:48:49,529 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 23:48:49,529 \tHypothesis: Ná Yesu wɔ nkate fam yaw , na ohia mmoa , nanso Petro ne afoforo no daa .\n","2020-05-21 23:48:49,529 Validation result (greedy) at epoch  21, step   122000: bleu:  27.44, loss: 39545.4219, ppl:   4.4633, duration: 12.1292s\n","2020-05-21 23:49:00,376 Epoch  21 Step:   122100 Batch Loss:     1.950672 Tokens per Sec:    21655, Lr: 0.000300\n","2020-05-21 23:49:11,382 Epoch  21 Step:   122200 Batch Loss:     1.677181 Tokens per Sec:    21783, Lr: 0.000300\n","2020-05-21 23:49:22,379 Epoch  21 Step:   122300 Batch Loss:     1.686869 Tokens per Sec:    21652, Lr: 0.000300\n","2020-05-21 23:49:33,302 Epoch  21 Step:   122400 Batch Loss:     1.660375 Tokens per Sec:    22060, Lr: 0.000300\n","2020-05-21 23:49:44,348 Epoch  21 Step:   122500 Batch Loss:     1.515282 Tokens per Sec:    22212, Lr: 0.000300\n","2020-05-21 23:49:55,314 Epoch  21 Step:   122600 Batch Loss:     1.440753 Tokens per Sec:    22009, Lr: 0.000300\n","2020-05-21 23:50:06,173 Epoch  21 Step:   122700 Batch Loss:     1.648928 Tokens per Sec:    21403, Lr: 0.000300\n","2020-05-21 23:50:17,127 Epoch  21 Step:   122800 Batch Loss:     1.689371 Tokens per Sec:    21718, Lr: 0.000300\n","2020-05-21 23:50:28,083 Epoch  21 Step:   122900 Batch Loss:     1.552089 Tokens per Sec:    22340, Lr: 0.000300\n","2020-05-21 23:50:39,013 Epoch  21 Step:   123000 Batch Loss:     2.018459 Tokens per Sec:    21788, Lr: 0.000300\n","2020-05-21 23:50:52,346 Example #0\n","2020-05-21 23:50:52,347 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 23:50:52,347 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 23:50:52,347 \tHypothesis: Nsɛm a ɛtete saa maa tete apon no dii mfomso sɛ wɔbɛkyere wɔn na wɔabu wɔn ani agu so .\n","2020-05-21 23:50:52,347 Example #1\n","2020-05-21 23:50:52,347 \tSource:     If so , you would be worthy of death .\n","2020-05-21 23:50:52,347 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 23:50:52,347 \tHypothesis: Sɛ saa a , ɛnde na ɛsɛ sɛ wuwu .\n","2020-05-21 23:50:52,347 Example #2\n","2020-05-21 23:50:52,347 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 23:50:52,347 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 23:50:52,347 \tHypothesis: Oo , hwɛ anigye ara a ɔsomafo Yohane hui sɛ nnipakuw kɛse no anisoadehu a ɛyɛ nwonwa yi !\n","2020-05-21 23:50:52,348 Example #3\n","2020-05-21 23:50:52,348 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 23:50:52,348 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 23:50:52,348 \tHypothesis: Ná Yesu wɔ nkate fam yaw , na na ohia mmoa , nanso Petro ne afoforo no daa .\n","2020-05-21 23:50:52,348 Validation result (greedy) at epoch  21, step   123000: bleu:  28.39, loss: 39366.3438, ppl:   4.4332, duration: 13.3350s\n","2020-05-21 23:51:03,237 Epoch  21 Step:   123100 Batch Loss:     1.734932 Tokens per Sec:    22077, Lr: 0.000300\n","2020-05-21 23:51:14,184 Epoch  21 Step:   123200 Batch Loss:     1.668639 Tokens per Sec:    22021, Lr: 0.000300\n","2020-05-21 23:51:25,200 Epoch  21 Step:   123300 Batch Loss:     1.518899 Tokens per Sec:    21796, Lr: 0.000300\n","2020-05-21 23:51:36,185 Epoch  21 Step:   123400 Batch Loss:     1.848316 Tokens per Sec:    22169, Lr: 0.000300\n","2020-05-21 23:51:47,086 Epoch  21 Step:   123500 Batch Loss:     1.748760 Tokens per Sec:    21906, Lr: 0.000300\n","2020-05-21 23:51:58,080 Epoch  21 Step:   123600 Batch Loss:     1.878852 Tokens per Sec:    21771, Lr: 0.000300\n","2020-05-21 23:52:09,050 Epoch  21 Step:   123700 Batch Loss:     1.457591 Tokens per Sec:    22320, Lr: 0.000300\n","2020-05-21 23:52:19,959 Epoch  21 Step:   123800 Batch Loss:     1.687086 Tokens per Sec:    22131, Lr: 0.000300\n","2020-05-21 23:52:31,050 Epoch  21 Step:   123900 Batch Loss:     1.869238 Tokens per Sec:    22552, Lr: 0.000300\n","2020-05-21 23:52:41,893 Epoch  21 Step:   124000 Batch Loss:     1.641208 Tokens per Sec:    21505, Lr: 0.000300\n","2020-05-21 23:52:54,497 Example #0\n","2020-05-21 23:52:54,498 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 23:52:54,498 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 23:52:54,498 \tHypothesis: Nsɛm a ɛtete saa no maa tete ahoni no hui sɛ ɛyɛ aniwu na ɛyɛ aniwu .\n","2020-05-21 23:52:54,498 Example #1\n","2020-05-21 23:52:54,498 \tSource:     If so , you would be worthy of death .\n","2020-05-21 23:52:54,498 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 23:52:54,498 \tHypothesis: Sɛ saa a , ɛnde na ɛfata sɛ wuwu .\n","2020-05-21 23:52:54,498 Example #2\n","2020-05-21 23:52:54,498 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 23:52:54,498 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 23:52:54,498 \tHypothesis: Oo , hwɛ anigye ara a ɔsomafo Yohane hui sɛ nnipakuw kɛse no anisoadehu a ɛyɛ nwonwa yi !\n","2020-05-21 23:52:54,499 Example #3\n","2020-05-21 23:52:54,499 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 23:52:54,499 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 23:52:54,499 \tHypothesis: Ná Yesu wɔ nkate fam ahokyere ne hia a ehia sɛ ɔboa no , nanso Petro ne afoforo no daa .\n","2020-05-21 23:52:54,499 Validation result (greedy) at epoch  21, step   124000: bleu:  27.85, loss: 39260.6797, ppl:   4.4155, duration: 12.6052s\n","2020-05-21 23:53:05,510 Epoch  21 Step:   124100 Batch Loss:     1.729707 Tokens per Sec:    21629, Lr: 0.000300\n","2020-05-21 23:53:16,390 Epoch  21 Step:   124200 Batch Loss:     1.729278 Tokens per Sec:    21860, Lr: 0.000300\n","2020-05-21 23:53:27,261 Epoch  21 Step:   124300 Batch Loss:     1.499533 Tokens per Sec:    21590, Lr: 0.000300\n","2020-05-21 23:53:38,246 Epoch  21 Step:   124400 Batch Loss:     1.528672 Tokens per Sec:    21803, Lr: 0.000300\n","2020-05-21 23:53:49,006 Epoch  21 Step:   124500 Batch Loss:     1.786606 Tokens per Sec:    21713, Lr: 0.000300\n","2020-05-21 23:53:59,878 Epoch  21 Step:   124600 Batch Loss:     1.710212 Tokens per Sec:    21798, Lr: 0.000300\n","2020-05-21 23:54:10,857 Epoch  21 Step:   124700 Batch Loss:     1.692439 Tokens per Sec:    22133, Lr: 0.000300\n","2020-05-21 23:54:21,785 Epoch  21 Step:   124800 Batch Loss:     1.569542 Tokens per Sec:    22033, Lr: 0.000300\n","2020-05-21 23:54:32,680 Epoch  21 Step:   124900 Batch Loss:     1.654986 Tokens per Sec:    21569, Lr: 0.000300\n","2020-05-21 23:54:43,527 Epoch  21 Step:   125000 Batch Loss:     1.548799 Tokens per Sec:    21855, Lr: 0.000300\n","2020-05-21 23:54:57,167 Example #0\n","2020-05-21 23:54:57,167 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 23:54:57,167 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 23:54:57,167 \tHypothesis: Nsɛm a ɛtete saa maa tete apon no hui sɛ ɛyɛ den sɛ wɔbɛhyɛ wɔn so na wɔabɔ wɔn ho ban .\n","2020-05-21 23:54:57,167 Example #1\n","2020-05-21 23:54:57,168 \tSource:     If so , you would be worthy of death .\n","2020-05-21 23:54:57,168 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 23:54:57,168 \tHypothesis: Sɛ saa a , anka wobɛfata owu .\n","2020-05-21 23:54:57,168 Example #2\n","2020-05-21 23:54:57,168 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 23:54:57,168 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 23:54:57,168 \tHypothesis: Hwɛ anigye ara a ɔsomafo Yohane nyae bere a ohuu nnipakuw kɛse no anisoadehu a ɛyɛ hu yi !\n","2020-05-21 23:54:57,168 Example #3\n","2020-05-21 23:54:57,168 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 23:54:57,168 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 23:54:57,169 \tHypothesis: Ná Yesu wɔ nkate fam yaw ne mmoa , nanso Petro ne afoforo no daa .\n","2020-05-21 23:54:57,169 Validation result (greedy) at epoch  21, step   125000: bleu:  28.26, loss: 39296.5898, ppl:   4.4215, duration: 13.6415s\n","2020-05-21 23:55:08,132 Epoch  21 Step:   125100 Batch Loss:     1.616734 Tokens per Sec:    22265, Lr: 0.000300\n","2020-05-21 23:55:19,172 Epoch  21 Step:   125200 Batch Loss:     1.628343 Tokens per Sec:    22226, Lr: 0.000300\n","2020-05-21 23:55:29,938 Epoch  21 Step:   125300 Batch Loss:     1.661034 Tokens per Sec:    21857, Lr: 0.000300\n","2020-05-21 23:55:40,822 Epoch  21 Step:   125400 Batch Loss:     1.839753 Tokens per Sec:    21936, Lr: 0.000300\n","2020-05-21 23:55:51,701 Epoch  21 Step:   125500 Batch Loss:     1.722747 Tokens per Sec:    22154, Lr: 0.000300\n","2020-05-21 23:56:02,603 Epoch  21 Step:   125600 Batch Loss:     1.611513 Tokens per Sec:    21180, Lr: 0.000300\n","2020-05-21 23:56:13,591 Epoch  21 Step:   125700 Batch Loss:     1.525532 Tokens per Sec:    21767, Lr: 0.000300\n","2020-05-21 23:56:24,539 Epoch  21 Step:   125800 Batch Loss:     1.681107 Tokens per Sec:    22209, Lr: 0.000300\n","2020-05-21 23:56:35,566 Epoch  21 Step:   125900 Batch Loss:     1.817291 Tokens per Sec:    22052, Lr: 0.000300\n","2020-05-21 23:56:46,380 Epoch  21 Step:   126000 Batch Loss:     1.549475 Tokens per Sec:    21805, Lr: 0.000300\n","2020-05-21 23:56:59,111 Hooray! New best validation result [ppl]!\n","2020-05-21 23:56:59,111 Saving new checkpoint.\n","2020-05-21 23:56:59,356 Example #0\n","2020-05-21 23:56:59,356 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 23:56:59,356 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 23:56:59,356 \tHypothesis: Nsɛm a ɛtete saa no maa tete aporɔw no dii nkonim sɛ obi bɛyɛ ɔyarefo na ɔbrɛ ne ho ase .\n","2020-05-21 23:56:59,356 Example #1\n","2020-05-21 23:56:59,357 \tSource:     If so , you would be worthy of death .\n","2020-05-21 23:56:59,357 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 23:56:59,357 \tHypothesis: Sɛ saa a , anka wobɛfata sɛ wuwu .\n","2020-05-21 23:56:59,357 Example #2\n","2020-05-21 23:56:59,357 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 23:56:59,357 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 23:56:59,357 \tHypothesis: Oo , hwɛ anigye ara a ɔsomafo Yohane hui sɛ nnipakuw kɛse no anisoadehu a ɛyɛ nwonwa yi !\n","2020-05-21 23:56:59,357 Example #3\n","2020-05-21 23:56:59,357 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 23:56:59,357 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 23:56:59,357 \tHypothesis: Ná Yesu wɔ nkate fam ahokyere ne hia a ehia sɛ ɔboa no , nanso Petro ne afoforo no daa .\n","2020-05-21 23:56:59,358 Validation result (greedy) at epoch  21, step   126000: bleu:  27.99, loss: 39071.3242, ppl:   4.3840, duration: 12.9771s\n","2020-05-21 23:57:10,200 Epoch  21 Step:   126100 Batch Loss:     1.808258 Tokens per Sec:    21708, Lr: 0.000300\n","2020-05-21 23:57:21,069 Epoch  21 Step:   126200 Batch Loss:     1.901182 Tokens per Sec:    21788, Lr: 0.000300\n","2020-05-21 23:57:32,018 Epoch  21 Step:   126300 Batch Loss:     1.459915 Tokens per Sec:    22057, Lr: 0.000300\n","2020-05-21 23:57:42,847 Epoch  21 Step:   126400 Batch Loss:     1.915981 Tokens per Sec:    21838, Lr: 0.000300\n","2020-05-21 23:57:53,617 Epoch  21 Step:   126500 Batch Loss:     1.700307 Tokens per Sec:    22027, Lr: 0.000300\n","2020-05-21 23:58:04,437 Epoch  21 Step:   126600 Batch Loss:     1.552999 Tokens per Sec:    21432, Lr: 0.000300\n","2020-05-21 23:58:15,296 Epoch  21 Step:   126700 Batch Loss:     1.698991 Tokens per Sec:    22107, Lr: 0.000300\n","2020-05-21 23:58:26,099 Epoch  21 Step:   126800 Batch Loss:     1.595683 Tokens per Sec:    21901, Lr: 0.000300\n","2020-05-21 23:58:36,940 Epoch  21 Step:   126900 Batch Loss:     1.958014 Tokens per Sec:    21705, Lr: 0.000300\n","2020-05-21 23:58:47,844 Epoch  21 Step:   127000 Batch Loss:     1.579827 Tokens per Sec:    21932, Lr: 0.000300\n","2020-05-21 23:59:00,016 Example #0\n","2020-05-21 23:59:00,017 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-21 23:59:00,017 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-21 23:59:00,017 \tHypothesis: Nsɛm a ɛtete saa no maa tete apon no hui sɛ ɛyɛ den na ɛyɛ anika .\n","2020-05-21 23:59:00,017 Example #1\n","2020-05-21 23:59:00,017 \tSource:     If so , you would be worthy of death .\n","2020-05-21 23:59:00,017 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-21 23:59:00,017 \tHypothesis: Sɛ saa a , anka wobɛfata owu .\n","2020-05-21 23:59:00,017 Example #2\n","2020-05-21 23:59:00,017 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-21 23:59:00,017 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-21 23:59:00,017 \tHypothesis: Oo , hwɛ anigye ara a ɔsomafo Yohane hui sɛ nnipakuw kɛse no anisoadehu a ɛyɛ hu yi !\n","2020-05-21 23:59:00,017 Example #3\n","2020-05-21 23:59:00,018 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-21 23:59:00,018 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-21 23:59:00,018 \tHypothesis: Ná Yesu wɔ nkate fam haw , na na ohia mmoa , nanso Petro ne afoforo no daa .\n","2020-05-21 23:59:00,018 Validation result (greedy) at epoch  21, step   127000: bleu:  28.14, loss: 39090.1758, ppl:   4.3871, duration: 12.1738s\n","2020-05-21 23:59:10,920 Epoch  21 Step:   127100 Batch Loss:     1.757074 Tokens per Sec:    22201, Lr: 0.000300\n","2020-05-21 23:59:10,938 Epoch  21: total training loss 10034.98\n","2020-05-21 23:59:10,939 EPOCH 22\n","2020-05-21 23:59:22,372 Epoch  22 Step:   127200 Batch Loss:     1.411031 Tokens per Sec:    20057, Lr: 0.000300\n","2020-05-21 23:59:33,260 Epoch  22 Step:   127300 Batch Loss:     1.582780 Tokens per Sec:    22099, Lr: 0.000300\n","2020-05-21 23:59:44,006 Epoch  22 Step:   127400 Batch Loss:     1.526432 Tokens per Sec:    21571, Lr: 0.000300\n","2020-05-21 23:59:54,924 Epoch  22 Step:   127500 Batch Loss:     1.539951 Tokens per Sec:    21934, Lr: 0.000300\n","2020-05-22 00:00:05,885 Epoch  22 Step:   127600 Batch Loss:     1.517737 Tokens per Sec:    22222, Lr: 0.000300\n","2020-05-22 00:00:16,804 Epoch  22 Step:   127700 Batch Loss:     1.661037 Tokens per Sec:    21521, Lr: 0.000300\n","2020-05-22 00:00:27,625 Epoch  22 Step:   127800 Batch Loss:     1.676330 Tokens per Sec:    22014, Lr: 0.000300\n","2020-05-22 00:00:38,479 Epoch  22 Step:   127900 Batch Loss:     1.642467 Tokens per Sec:    22290, Lr: 0.000300\n","2020-05-22 00:00:49,311 Epoch  22 Step:   128000 Batch Loss:     1.647807 Tokens per Sec:    22503, Lr: 0.000300\n","2020-05-22 00:01:01,725 Example #0\n","2020-05-22 00:01:01,725 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-22 00:01:01,725 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-22 00:01:01,725 \tHypothesis: Nsɛm a ɛtete saa no maa tete apon no hui sɛ ɛyɛ den na ɛyɛ anika .\n","2020-05-22 00:01:01,725 Example #1\n","2020-05-22 00:01:01,726 \tSource:     If so , you would be worthy of death .\n","2020-05-22 00:01:01,726 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-22 00:01:01,726 \tHypothesis: Sɛ saa a , anka wobɛfata sɛ wuwu .\n","2020-05-22 00:01:01,726 Example #2\n","2020-05-22 00:01:01,726 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-22 00:01:01,726 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-22 00:01:01,726 \tHypothesis: Oo , hwɛ anigye ara a ɔsomafo Yohane hui sɛ nnipakuw kɛse no anisoadehu a ɛyɛ anigye yi !\n","2020-05-22 00:01:01,726 Example #3\n","2020-05-22 00:01:01,726 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-22 00:01:01,726 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-22 00:01:01,726 \tHypothesis: Ná Yesu wɔ nkate fam yaw , na na ohia mmoa , nanso Petro ne afoforo no daa .\n","2020-05-22 00:01:01,726 Validation result (greedy) at epoch  22, step   128000: bleu:  28.29, loss: 39310.8711, ppl:   4.4239, duration: 12.4151s\n","2020-05-22 00:01:12,565 Epoch  22 Step:   128100 Batch Loss:     1.574943 Tokens per Sec:    22183, Lr: 0.000300\n","2020-05-22 00:01:23,400 Epoch  22 Step:   128200 Batch Loss:     1.715069 Tokens per Sec:    22062, Lr: 0.000300\n","2020-05-22 00:01:34,241 Epoch  22 Step:   128300 Batch Loss:     1.725829 Tokens per Sec:    22003, Lr: 0.000300\n","2020-05-22 00:01:44,990 Epoch  22 Step:   128400 Batch Loss:     1.583094 Tokens per Sec:    22073, Lr: 0.000300\n","2020-05-22 00:01:55,785 Epoch  22 Step:   128500 Batch Loss:     1.568873 Tokens per Sec:    22182, Lr: 0.000300\n","2020-05-22 00:02:06,539 Epoch  22 Step:   128600 Batch Loss:     1.739220 Tokens per Sec:    22226, Lr: 0.000300\n","2020-05-22 00:02:17,390 Epoch  22 Step:   128700 Batch Loss:     1.609531 Tokens per Sec:    22533, Lr: 0.000300\n","2020-05-22 00:02:28,229 Epoch  22 Step:   128800 Batch Loss:     1.500288 Tokens per Sec:    22319, Lr: 0.000300\n","2020-05-22 00:02:38,884 Epoch  22 Step:   128900 Batch Loss:     1.642161 Tokens per Sec:    22137, Lr: 0.000300\n","2020-05-22 00:02:49,785 Epoch  22 Step:   129000 Batch Loss:     1.755324 Tokens per Sec:    22490, Lr: 0.000300\n","2020-05-22 00:03:02,595 Hooray! New best validation result [ppl]!\n","2020-05-22 00:03:02,595 Saving new checkpoint.\n","2020-05-22 00:03:02,865 Example #0\n","2020-05-22 00:03:02,865 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-22 00:03:02,865 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-22 00:03:02,865 \tHypothesis: Nsɛm a ɛtete saa maa tete apon no hui sɛ ɛyɛ den na ɛyɛ den .\n","2020-05-22 00:03:02,865 Example #1\n","2020-05-22 00:03:02,865 \tSource:     If so , you would be worthy of death .\n","2020-05-22 00:03:02,865 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-22 00:03:02,865 \tHypothesis: Sɛ saa a , anka wobɛfata owu .\n","2020-05-22 00:03:02,865 Example #2\n","2020-05-22 00:03:02,866 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-22 00:03:02,866 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-22 00:03:02,866 \tHypothesis: Oo , hwɛ sɛnea ɔsomafo Yohane ani gyei bere a ohui sɛ nnipakuw kɛse no anisoadehu a ɛyɛ nwonwa yi renya anisoadehu a ɛyɛ anigye yi !\n","2020-05-22 00:03:02,866 Example #3\n","2020-05-22 00:03:02,866 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-22 00:03:02,866 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-22 00:03:02,866 \tHypothesis: Ná Yesu wɔ nkate fam ahokyere ne mmoa , nanso Petro ne afoforo no daa .\n","2020-05-22 00:03:02,866 Validation result (greedy) at epoch  22, step   129000: bleu:  28.18, loss: 39037.0352, ppl:   4.3783, duration: 13.0811s\n","2020-05-22 00:03:13,607 Epoch  22 Step:   129100 Batch Loss:     1.539486 Tokens per Sec:    22011, Lr: 0.000300\n","2020-05-22 00:03:24,353 Epoch  22 Step:   129200 Batch Loss:     1.617920 Tokens per Sec:    22422, Lr: 0.000300\n","2020-05-22 00:03:35,192 Epoch  22 Step:   129300 Batch Loss:     1.746873 Tokens per Sec:    22886, Lr: 0.000300\n","2020-05-22 00:03:45,894 Epoch  22 Step:   129400 Batch Loss:     1.589065 Tokens per Sec:    22468, Lr: 0.000300\n","2020-05-22 00:03:56,612 Epoch  22 Step:   129500 Batch Loss:     1.621455 Tokens per Sec:    21538, Lr: 0.000300\n","2020-05-22 00:04:07,468 Epoch  22 Step:   129600 Batch Loss:     1.721953 Tokens per Sec:    21762, Lr: 0.000300\n","2020-05-22 00:04:18,359 Epoch  22 Step:   129700 Batch Loss:     1.650418 Tokens per Sec:    22345, Lr: 0.000300\n","2020-05-22 00:04:29,501 Epoch  22 Step:   129800 Batch Loss:     1.510087 Tokens per Sec:    21773, Lr: 0.000300\n","2020-05-22 00:04:40,595 Epoch  22 Step:   129900 Batch Loss:     1.593302 Tokens per Sec:    21862, Lr: 0.000300\n","2020-05-22 00:04:51,711 Epoch  22 Step:   130000 Batch Loss:     1.456468 Tokens per Sec:    21510, Lr: 0.000300\n","2020-05-22 00:05:04,200 Hooray! New best validation result [ppl]!\n","2020-05-22 00:05:04,200 Saving new checkpoint.\n","2020-05-22 00:05:04,523 Example #0\n","2020-05-22 00:05:04,523 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-22 00:05:04,523 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-22 00:05:04,523 \tHypothesis: Nsɛm a ɛtete saa maa tete ahemfo no hui sɛ ɛyɛ den na ɛyɛ anika .\n","2020-05-22 00:05:04,523 Example #1\n","2020-05-22 00:05:04,524 \tSource:     If so , you would be worthy of death .\n","2020-05-22 00:05:04,524 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-22 00:05:04,524 \tHypothesis: Sɛ saa a , ɛnde na wobɛfata owu .\n","2020-05-22 00:05:04,524 Example #2\n","2020-05-22 00:05:04,524 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-22 00:05:04,524 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-22 00:05:04,524 \tHypothesis: Oo , hwɛ sɛnea ɔsomafo Yohane ani gyei bere a ohui sɛ nnipakuw kɛse no anisoadehu a ɛyɛ nwonwa yi !\n","2020-05-22 00:05:04,524 Example #3\n","2020-05-22 00:05:04,524 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-22 00:05:04,524 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-22 00:05:04,524 \tHypothesis: Ná Yesu wɔ nkate fam yaw , na na ohia mmoa , nanso Petro ne afoforo no daa .\n","2020-05-22 00:05:04,524 Validation result (greedy) at epoch  22, step   130000: bleu:  27.83, loss: 39034.6875, ppl:   4.3779, duration: 12.8127s\n","2020-05-22 00:05:15,617 Epoch  22 Step:   130100 Batch Loss:     1.874694 Tokens per Sec:    21581, Lr: 0.000300\n","2020-05-22 00:05:26,618 Epoch  22 Step:   130200 Batch Loss:     1.668772 Tokens per Sec:    21532, Lr: 0.000300\n","2020-05-22 00:05:37,668 Epoch  22 Step:   130300 Batch Loss:     1.689298 Tokens per Sec:    22069, Lr: 0.000300\n","2020-05-22 00:05:48,483 Epoch  22 Step:   130400 Batch Loss:     1.571521 Tokens per Sec:    22130, Lr: 0.000300\n","2020-05-22 00:05:59,264 Epoch  22 Step:   130500 Batch Loss:     2.014127 Tokens per Sec:    21725, Lr: 0.000300\n","2020-05-22 00:06:10,077 Epoch  22 Step:   130600 Batch Loss:     1.327205 Tokens per Sec:    21832, Lr: 0.000300\n","2020-05-22 00:06:20,841 Epoch  22 Step:   130700 Batch Loss:     1.400474 Tokens per Sec:    21090, Lr: 0.000300\n","2020-05-22 00:06:31,813 Epoch  22 Step:   130800 Batch Loss:     1.663626 Tokens per Sec:    22059, Lr: 0.000300\n","2020-05-22 00:06:42,606 Epoch  22 Step:   130900 Batch Loss:     1.459670 Tokens per Sec:    21678, Lr: 0.000300\n","2020-05-22 00:06:53,529 Epoch  22 Step:   131000 Batch Loss:     1.529374 Tokens per Sec:    21432, Lr: 0.000300\n","2020-05-22 00:07:06,659 Hooray! New best validation result [ppl]!\n","2020-05-22 00:07:06,659 Saving new checkpoint.\n","2020-05-22 00:07:06,904 Example #0\n","2020-05-22 00:07:06,904 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-22 00:07:06,904 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-22 00:07:06,904 \tHypothesis: Nsɛm a ɛtete saa no maa tete apon no dii mfomso sɛ wobegye wɔn ani na wɔabɔ wɔn ho ban .\n","2020-05-22 00:07:06,904 Example #1\n","2020-05-22 00:07:06,904 \tSource:     If so , you would be worthy of death .\n","2020-05-22 00:07:06,904 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-22 00:07:06,904 \tHypothesis: Sɛ saa a , anka wobɛfata owu .\n","2020-05-22 00:07:06,905 Example #2\n","2020-05-22 00:07:06,905 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-22 00:07:06,905 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-22 00:07:06,905 \tHypothesis: Oo , hwɛ sɛnea ɔsomafo Yohane ani gyei bere a ohui sɛ nnipakuw kɛse no anisoadehu a ɛyɛ nwonwa yi !\n","2020-05-22 00:07:06,905 Example #3\n","2020-05-22 00:07:06,905 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-22 00:07:06,905 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-22 00:07:06,905 \tHypothesis: Ná Yesu wɔ nkate fam yaw , na na ohia mmoa , nanso Petro ne afoforo no daa .\n","2020-05-22 00:07:06,905 Validation result (greedy) at epoch  22, step   131000: bleu:  28.12, loss: 38922.8594, ppl:   4.3594, duration: 13.3764s\n","2020-05-22 00:07:17,764 Epoch  22 Step:   131100 Batch Loss:     1.706961 Tokens per Sec:    22077, Lr: 0.000300\n","2020-05-22 00:07:28,515 Epoch  22 Step:   131200 Batch Loss:     1.669600 Tokens per Sec:    22257, Lr: 0.000300\n","2020-05-22 00:07:39,248 Epoch  22 Step:   131300 Batch Loss:     1.762028 Tokens per Sec:    21524, Lr: 0.000300\n","2020-05-22 00:07:50,070 Epoch  22 Step:   131400 Batch Loss:     1.674416 Tokens per Sec:    22140, Lr: 0.000300\n","2020-05-22 00:08:00,895 Epoch  22 Step:   131500 Batch Loss:     1.650050 Tokens per Sec:    22063, Lr: 0.000300\n","2020-05-22 00:08:11,726 Epoch  22 Step:   131600 Batch Loss:     1.547044 Tokens per Sec:    21978, Lr: 0.000300\n","2020-05-22 00:08:22,615 Epoch  22 Step:   131700 Batch Loss:     1.613741 Tokens per Sec:    22094, Lr: 0.000300\n","2020-05-22 00:08:33,588 Epoch  22 Step:   131800 Batch Loss:     1.655593 Tokens per Sec:    21718, Lr: 0.000300\n","2020-05-22 00:08:44,612 Epoch  22 Step:   131900 Batch Loss:     1.672879 Tokens per Sec:    22109, Lr: 0.000300\n","2020-05-22 00:08:55,549 Epoch  22 Step:   132000 Batch Loss:     1.993517 Tokens per Sec:    22446, Lr: 0.000300\n","2020-05-22 00:09:08,135 Example #0\n","2020-05-22 00:09:08,135 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-22 00:09:08,135 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-22 00:09:08,135 \tHypothesis: Saa nsɛm no maa tete anyinam tumi yɛɛ den sɛ wɔbɛhyɛ wɔn so na wɔabu wɔn ani agu wɔn so .\n","2020-05-22 00:09:08,135 Example #1\n","2020-05-22 00:09:08,136 \tSource:     If so , you would be worthy of death .\n","2020-05-22 00:09:08,136 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-22 00:09:08,136 \tHypothesis: Sɛ saa a , anka wobɛfata owu .\n","2020-05-22 00:09:08,136 Example #2\n","2020-05-22 00:09:08,136 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-22 00:09:08,136 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-22 00:09:08,136 \tHypothesis: Oo , hwɛ anigye ara a ɔsomafo Yohane hui sɛ nnipakuw kɛse no anisoadehu a ɛyɛ anigye yi !\n","2020-05-22 00:09:08,136 Example #3\n","2020-05-22 00:09:08,136 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-22 00:09:08,136 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-22 00:09:08,136 \tHypothesis: Ná Yesu wɔ nkate fam ahokyere ne hia mmoa , nanso Petro ne afoforo no daa .\n","2020-05-22 00:09:08,136 Validation result (greedy) at epoch  22, step   132000: bleu:  28.39, loss: 39091.4609, ppl:   4.3873, duration: 12.5867s\n","2020-05-22 00:09:18,982 Epoch  22 Step:   132100 Batch Loss:     2.217041 Tokens per Sec:    22540, Lr: 0.000300\n","2020-05-22 00:09:29,883 Epoch  22 Step:   132200 Batch Loss:     1.409239 Tokens per Sec:    21843, Lr: 0.000300\n","2020-05-22 00:09:40,681 Epoch  22 Step:   132300 Batch Loss:     1.527377 Tokens per Sec:    22138, Lr: 0.000300\n","2020-05-22 00:09:51,546 Epoch  22 Step:   132400 Batch Loss:     1.514978 Tokens per Sec:    22061, Lr: 0.000300\n","2020-05-22 00:10:02,270 Epoch  22 Step:   132500 Batch Loss:     1.535875 Tokens per Sec:    21895, Lr: 0.000300\n","2020-05-22 00:10:13,084 Epoch  22 Step:   132600 Batch Loss:     1.706083 Tokens per Sec:    21964, Lr: 0.000300\n","2020-05-22 00:10:24,024 Epoch  22 Step:   132700 Batch Loss:     1.783471 Tokens per Sec:    22430, Lr: 0.000300\n","2020-05-22 00:10:34,963 Epoch  22 Step:   132800 Batch Loss:     1.768788 Tokens per Sec:    22130, Lr: 0.000300\n","2020-05-22 00:10:45,793 Epoch  22 Step:   132900 Batch Loss:     1.529685 Tokens per Sec:    22220, Lr: 0.000300\n","2020-05-22 00:10:56,785 Epoch  22 Step:   133000 Batch Loss:     1.786207 Tokens per Sec:    22212, Lr: 0.000300\n","2020-05-22 00:11:08,875 Hooray! New best validation result [ppl]!\n","2020-05-22 00:11:08,876 Saving new checkpoint.\n","2020-05-22 00:11:09,121 Example #0\n","2020-05-22 00:11:09,121 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-22 00:11:09,121 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-22 00:11:09,122 \tHypothesis: Nsɛm a ɛtete saa maa tete agumadi no dii mfomso sɛ wɔbɛbɔ wɔn ho ban na wɔabu wɔn ani agu so .\n","2020-05-22 00:11:09,122 Example #1\n","2020-05-22 00:11:09,122 \tSource:     If so , you would be worthy of death .\n","2020-05-22 00:11:09,122 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-22 00:11:09,122 \tHypothesis: Sɛ saa a , anka wobɛfata owu .\n","2020-05-22 00:11:09,122 Example #2\n","2020-05-22 00:11:09,122 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-22 00:11:09,122 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-22 00:11:09,122 \tHypothesis: Oo , hwɛ sɛnea ɔsomafo Yohane ani gyei bere a ohuu nnipakuw kɛse no anisoadehu a ɛyɛ nwonwa yi !\n","2020-05-22 00:11:09,122 Example #3\n","2020-05-22 00:11:09,123 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-22 00:11:09,123 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-22 00:11:09,123 \tHypothesis: Ná Yesu wɔ nkate fam ahokyere ne hia mmoa , nanso Petro ne afoforo no daa .\n","2020-05-22 00:11:09,123 Validation result (greedy) at epoch  22, step   133000: bleu:  28.55, loss: 38773.9883, ppl:   4.3350, duration: 12.3374s\n","2020-05-22 00:11:20,003 Epoch  22 Step:   133100 Batch Loss:     1.764508 Tokens per Sec:    22467, Lr: 0.000300\n","2020-05-22 00:11:25,261 Epoch  22: total training loss 9954.24\n","2020-05-22 00:11:25,261 EPOCH 23\n","2020-05-22 00:11:31,780 Epoch  23 Step:   133200 Batch Loss:     1.586076 Tokens per Sec:    19032, Lr: 0.000300\n","2020-05-22 00:11:42,662 Epoch  23 Step:   133300 Batch Loss:     1.659466 Tokens per Sec:    22190, Lr: 0.000300\n","2020-05-22 00:11:53,577 Epoch  23 Step:   133400 Batch Loss:     1.655281 Tokens per Sec:    21898, Lr: 0.000300\n","2020-05-22 00:12:04,610 Epoch  23 Step:   133500 Batch Loss:     1.307925 Tokens per Sec:    22083, Lr: 0.000300\n","2020-05-22 00:12:15,644 Epoch  23 Step:   133600 Batch Loss:     1.571197 Tokens per Sec:    22119, Lr: 0.000300\n","2020-05-22 00:12:26,749 Epoch  23 Step:   133700 Batch Loss:     1.707082 Tokens per Sec:    22371, Lr: 0.000300\n","2020-05-22 00:12:37,737 Epoch  23 Step:   133800 Batch Loss:     1.826087 Tokens per Sec:    21898, Lr: 0.000300\n","2020-05-22 00:12:48,589 Epoch  23 Step:   133900 Batch Loss:     1.480835 Tokens per Sec:    21671, Lr: 0.000300\n","2020-05-22 00:12:59,563 Epoch  23 Step:   134000 Batch Loss:     1.484462 Tokens per Sec:    22001, Lr: 0.000300\n","2020-05-22 00:13:12,457 Example #0\n","2020-05-22 00:13:12,458 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-22 00:13:12,458 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-22 00:13:12,458 \tHypothesis: Nsɛm a ɛtete saa maa tete ntade a na ɛyɛ hu sɛ obi bɛyɛ ɔyarefo na ɔyɛ anifere .\n","2020-05-22 00:13:12,458 Example #1\n","2020-05-22 00:13:12,458 \tSource:     If so , you would be worthy of death .\n","2020-05-22 00:13:12,458 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-22 00:13:12,458 \tHypothesis: Sɛ saa a , anka wobɛfata owu .\n","2020-05-22 00:13:12,458 Example #2\n","2020-05-22 00:13:12,458 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-22 00:13:12,458 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-22 00:13:12,458 \tHypothesis: Oo , hwɛ anigye ara a ɔsomafo Yohane hui sɛ nnipakuw kɛse no anisoadehu a ɛyɛ anigye yi !\n","2020-05-22 00:13:12,458 Example #3\n","2020-05-22 00:13:12,459 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-22 00:13:12,459 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-22 00:13:12,459 \tHypothesis: Ná Yesu wɔ nkate fam yaw , na na ohia mmoa , nanso Petro ne afoforo no daa .\n","2020-05-22 00:13:12,459 Validation result (greedy) at epoch  23, step   134000: bleu:  28.32, loss: 38901.6875, ppl:   4.3559, duration: 12.8953s\n","2020-05-22 00:13:23,385 Epoch  23 Step:   134100 Batch Loss:     1.775900 Tokens per Sec:    21955, Lr: 0.000300\n","2020-05-22 00:13:34,383 Epoch  23 Step:   134200 Batch Loss:     1.458948 Tokens per Sec:    21802, Lr: 0.000300\n","2020-05-22 00:13:45,449 Epoch  23 Step:   134300 Batch Loss:     1.630817 Tokens per Sec:    22137, Lr: 0.000300\n","2020-05-22 00:13:56,308 Epoch  23 Step:   134400 Batch Loss:     1.498360 Tokens per Sec:    21683, Lr: 0.000300\n","2020-05-22 00:14:07,063 Epoch  23 Step:   134500 Batch Loss:     1.440348 Tokens per Sec:    21677, Lr: 0.000300\n","2020-05-22 00:14:18,073 Epoch  23 Step:   134600 Batch Loss:     1.555099 Tokens per Sec:    21990, Lr: 0.000300\n","2020-05-22 00:14:28,837 Epoch  23 Step:   134700 Batch Loss:     1.577926 Tokens per Sec:    21538, Lr: 0.000300\n","2020-05-22 00:14:39,729 Epoch  23 Step:   134800 Batch Loss:     1.757146 Tokens per Sec:    22253, Lr: 0.000300\n","2020-05-22 00:14:50,519 Epoch  23 Step:   134900 Batch Loss:     1.672956 Tokens per Sec:    21531, Lr: 0.000300\n","2020-05-22 00:15:01,484 Epoch  23 Step:   135000 Batch Loss:     1.492662 Tokens per Sec:    22070, Lr: 0.000300\n","2020-05-22 00:15:13,475 Example #0\n","2020-05-22 00:15:13,475 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-22 00:15:13,475 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-22 00:15:13,475 \tHypothesis: Nsɛm a ɛtete saa no maa tete ntade a na ɛyɛ nwonwa sɛ obi bɛyɛ ɔyarefo na wabu n’ani agu so .\n","2020-05-22 00:15:13,475 Example #1\n","2020-05-22 00:15:13,475 \tSource:     If so , you would be worthy of death .\n","2020-05-22 00:15:13,475 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-22 00:15:13,475 \tHypothesis: Sɛ saa a , anka wobɛfata owu .\n","2020-05-22 00:15:13,475 Example #2\n","2020-05-22 00:15:13,476 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-22 00:15:13,476 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-22 00:15:13,476 \tHypothesis: Hwɛ sɛnea ɔsomafo Yohane ani gyei bere a ohuu nnipakuw kɛse no anisoadehu a ɛyɛ nwonwa yi !\n","2020-05-22 00:15:13,476 Example #3\n","2020-05-22 00:15:13,476 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-22 00:15:13,476 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-22 00:15:13,476 \tHypothesis: Ná Yesu wɔ nkate fam yaw na ohia mmoa , nanso Petro ne afoforo no daa .\n","2020-05-22 00:15:13,476 Validation result (greedy) at epoch  23, step   135000: bleu:  28.18, loss: 39047.9648, ppl:   4.3801, duration: 11.9914s\n","2020-05-22 00:15:24,514 Epoch  23 Step:   135100 Batch Loss:     1.663901 Tokens per Sec:    21858, Lr: 0.000300\n","2020-05-22 00:15:35,473 Epoch  23 Step:   135200 Batch Loss:     1.630109 Tokens per Sec:    21769, Lr: 0.000300\n","2020-05-22 00:15:46,409 Epoch  23 Step:   135300 Batch Loss:     1.709204 Tokens per Sec:    22177, Lr: 0.000300\n","2020-05-22 00:15:57,309 Epoch  23 Step:   135400 Batch Loss:     1.591058 Tokens per Sec:    22182, Lr: 0.000300\n","2020-05-22 00:16:08,251 Epoch  23 Step:   135500 Batch Loss:     1.766737 Tokens per Sec:    21659, Lr: 0.000300\n","2020-05-22 00:16:19,152 Epoch  23 Step:   135600 Batch Loss:     1.817703 Tokens per Sec:    21851, Lr: 0.000300\n","2020-05-22 00:16:30,075 Epoch  23 Step:   135700 Batch Loss:     1.680872 Tokens per Sec:    22099, Lr: 0.000300\n","2020-05-22 00:16:41,081 Epoch  23 Step:   135800 Batch Loss:     1.506380 Tokens per Sec:    21671, Lr: 0.000300\n","2020-05-22 00:16:52,038 Epoch  23 Step:   135900 Batch Loss:     1.637959 Tokens per Sec:    21842, Lr: 0.000300\n","2020-05-22 00:17:02,994 Epoch  23 Step:   136000 Batch Loss:     1.881582 Tokens per Sec:    22143, Lr: 0.000300\n","2020-05-22 00:17:15,774 Example #0\n","2020-05-22 00:17:15,775 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-22 00:17:15,775 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-22 00:17:15,775 \tHypothesis: Nsɛm a ɛte saa maa tete apontow no dii nkonim sɛ ɛyɛ anika na ɛyɛ aniberesɛm .\n","2020-05-22 00:17:15,775 Example #1\n","2020-05-22 00:17:15,775 \tSource:     If so , you would be worthy of death .\n","2020-05-22 00:17:15,775 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-22 00:17:15,775 \tHypothesis: Sɛ saa a , ɛnde na ɛfata sɛ wuwu .\n","2020-05-22 00:17:15,775 Example #2\n","2020-05-22 00:17:15,775 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-22 00:17:15,775 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-22 00:17:15,775 \tHypothesis: Oo , hwɛ anigye ara a ɔsomafo Yohane hui sɛ nnipakuw kɛse no anisoadehu a ɛyɛ nwonwa yi !\n","2020-05-22 00:17:15,775 Example #3\n","2020-05-22 00:17:15,776 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-22 00:17:15,776 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-22 00:17:15,776 \tHypothesis: Ná Yesu wɔ nkate fam yaw , na ohia mmoa , nanso Petro ne afoforo no daa .\n","2020-05-22 00:17:15,776 Validation result (greedy) at epoch  23, step   136000: bleu:  28.26, loss: 38899.5117, ppl:   4.3556, duration: 12.7817s\n","2020-05-22 00:17:26,668 Epoch  23 Step:   136100 Batch Loss:     1.688625 Tokens per Sec:    21787, Lr: 0.000300\n","2020-05-22 00:17:37,713 Epoch  23 Step:   136200 Batch Loss:     1.580290 Tokens per Sec:    21889, Lr: 0.000300\n","2020-05-22 00:17:48,680 Epoch  23 Step:   136300 Batch Loss:     1.231411 Tokens per Sec:    22128, Lr: 0.000300\n","2020-05-22 00:17:59,612 Epoch  23 Step:   136400 Batch Loss:     1.343262 Tokens per Sec:    21644, Lr: 0.000300\n","2020-05-22 00:18:10,561 Epoch  23 Step:   136500 Batch Loss:     1.811694 Tokens per Sec:    21793, Lr: 0.000300\n","2020-05-22 00:18:21,365 Epoch  23 Step:   136600 Batch Loss:     1.655176 Tokens per Sec:    21563, Lr: 0.000300\n","2020-05-22 00:18:32,348 Epoch  23 Step:   136700 Batch Loss:     1.704059 Tokens per Sec:    22238, Lr: 0.000300\n","2020-05-22 00:18:43,185 Epoch  23 Step:   136800 Batch Loss:     1.759651 Tokens per Sec:    21784, Lr: 0.000300\n","2020-05-22 00:18:54,156 Epoch  23 Step:   136900 Batch Loss:     1.726506 Tokens per Sec:    21524, Lr: 0.000300\n","2020-05-22 00:19:04,996 Epoch  23 Step:   137000 Batch Loss:     1.584149 Tokens per Sec:    21907, Lr: 0.000300\n","2020-05-22 00:19:17,013 Example #0\n","2020-05-22 00:19:17,014 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-22 00:19:17,014 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-22 00:19:17,014 \tHypothesis: Nsɛm a ɛtete saa no maa tete apontow no dii nkonim sɛ wobegye wɔn ani na wɔabu wɔn ani agu so .\n","2020-05-22 00:19:17,014 Example #1\n","2020-05-22 00:19:17,014 \tSource:     If so , you would be worthy of death .\n","2020-05-22 00:19:17,014 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-22 00:19:17,014 \tHypothesis: Sɛ saa a , ɛnde na ɛfata sɛ wuwu .\n","2020-05-22 00:19:17,014 Example #2\n","2020-05-22 00:19:17,014 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-22 00:19:17,014 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-22 00:19:17,015 \tHypothesis: Hwɛ anigye ara a ɔsomafo Yohane nyae bere a ohui sɛ nnipakuw kɛse no anisoadehu a ɛyɛ anigye yi !\n","2020-05-22 00:19:17,015 Example #3\n","2020-05-22 00:19:17,015 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-22 00:19:17,015 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-22 00:19:17,015 \tHypothesis: Ná Yesu wɔ nkate fam yaw na ohia mmoa , nanso Petro ne afoforo no daa mpɛn pii .\n","2020-05-22 00:19:17,015 Validation result (greedy) at epoch  23, step   137000: bleu:  28.54, loss: 38947.9805, ppl:   4.3636, duration: 12.0192s\n","2020-05-22 00:19:27,981 Epoch  23 Step:   137100 Batch Loss:     1.811278 Tokens per Sec:    21949, Lr: 0.000300\n","2020-05-22 00:19:38,848 Epoch  23 Step:   137200 Batch Loss:     1.421809 Tokens per Sec:    21738, Lr: 0.000300\n","2020-05-22 00:19:49,758 Epoch  23 Step:   137300 Batch Loss:     1.700715 Tokens per Sec:    21853, Lr: 0.000300\n","2020-05-22 00:20:00,717 Epoch  23 Step:   137400 Batch Loss:     1.393157 Tokens per Sec:    22270, Lr: 0.000300\n","2020-05-22 00:20:11,587 Epoch  23 Step:   137500 Batch Loss:     1.372879 Tokens per Sec:    21687, Lr: 0.000300\n","2020-05-22 00:20:22,426 Epoch  23 Step:   137600 Batch Loss:     1.842544 Tokens per Sec:    21698, Lr: 0.000300\n","2020-05-22 00:20:33,243 Epoch  23 Step:   137700 Batch Loss:     1.745078 Tokens per Sec:    21787, Lr: 0.000300\n","2020-05-22 00:20:44,141 Epoch  23 Step:   137800 Batch Loss:     1.484204 Tokens per Sec:    22006, Lr: 0.000300\n","2020-05-22 00:20:54,998 Epoch  23 Step:   137900 Batch Loss:     1.473628 Tokens per Sec:    21829, Lr: 0.000300\n","2020-05-22 00:21:05,887 Epoch  23 Step:   138000 Batch Loss:     1.759161 Tokens per Sec:    21953, Lr: 0.000300\n","2020-05-22 00:21:18,399 Example #0\n","2020-05-22 00:21:18,399 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-22 00:21:18,399 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-22 00:21:18,399 \tHypothesis: Nsɛm a ɛtete saa maa tete apontow no yɛɛ den sɛ wɔbɛyɛ anibiannaso na wɔabu wɔn ani agu so .\n","2020-05-22 00:21:18,399 Example #1\n","2020-05-22 00:21:18,399 \tSource:     If so , you would be worthy of death .\n","2020-05-22 00:21:18,399 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-22 00:21:18,399 \tHypothesis: Sɛ saa a , ɛnde na ɛfata sɛ wuwu .\n","2020-05-22 00:21:18,400 Example #2\n","2020-05-22 00:21:18,400 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-22 00:21:18,400 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-22 00:21:18,400 \tHypothesis: Oo , hwɛ anigye ara a ɔsomafo Yohane nyae bere a ohui sɛ nnipakuw kɛse no anisoadehu a ɛyɛ nwonwa yi !\n","2020-05-22 00:21:18,400 Example #3\n","2020-05-22 00:21:18,400 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-22 00:21:18,400 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-22 00:21:18,400 \tHypothesis: Ná Yesu wɔ nkate fam haw ne hia mmoa , nanso Petro ne afoforo no daa .\n","2020-05-22 00:21:18,400 Validation result (greedy) at epoch  23, step   138000: bleu:  28.54, loss: 39057.5625, ppl:   4.3817, duration: 12.5130s\n","2020-05-22 00:21:29,295 Epoch  23 Step:   138100 Batch Loss:     1.614396 Tokens per Sec:    21767, Lr: 0.000300\n","2020-05-22 00:21:40,305 Epoch  23 Step:   138200 Batch Loss:     1.483781 Tokens per Sec:    21929, Lr: 0.000300\n","2020-05-22 00:21:51,184 Epoch  23 Step:   138300 Batch Loss:     1.625588 Tokens per Sec:    21774, Lr: 0.000300\n","2020-05-22 00:22:02,140 Epoch  23 Step:   138400 Batch Loss:     1.637649 Tokens per Sec:    21665, Lr: 0.000300\n","2020-05-22 00:22:13,029 Epoch  23 Step:   138500 Batch Loss:     1.717964 Tokens per Sec:    21940, Lr: 0.000300\n","2020-05-22 00:22:23,985 Epoch  23 Step:   138600 Batch Loss:     1.793856 Tokens per Sec:    22302, Lr: 0.000300\n","2020-05-22 00:22:34,878 Epoch  23 Step:   138700 Batch Loss:     1.513410 Tokens per Sec:    22016, Lr: 0.000300\n","2020-05-22 00:22:45,784 Epoch  23 Step:   138800 Batch Loss:     1.606913 Tokens per Sec:    21784, Lr: 0.000300\n","2020-05-22 00:22:56,778 Epoch  23 Step:   138900 Batch Loss:     1.769432 Tokens per Sec:    21701, Lr: 0.000300\n","2020-05-22 00:23:07,619 Epoch  23 Step:   139000 Batch Loss:     1.556150 Tokens per Sec:    21880, Lr: 0.000300\n","2020-05-22 00:23:20,794 Example #0\n","2020-05-22 00:23:20,794 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-22 00:23:20,794 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-22 00:23:20,794 \tHypothesis: Nsɛm a ɛtete saa maa tete aguadi ahorow no hui sɛ ɛyɛ aniwu na ɛyɛ anibiannaso .\n","2020-05-22 00:23:20,794 Example #1\n","2020-05-22 00:23:20,794 \tSource:     If so , you would be worthy of death .\n","2020-05-22 00:23:20,794 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-22 00:23:20,794 \tHypothesis: Sɛ saa a , ɛnde na ɛfata sɛ wuwu .\n","2020-05-22 00:23:20,794 Example #2\n","2020-05-22 00:23:20,795 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-22 00:23:20,795 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-22 00:23:20,795 \tHypothesis: Oo , hwɛ sɛnea ɔsomafo Yohane ani gyei bere a ohuu nnipakuw kɛse no anisoadehu a ɛyɛ hu yi !\n","2020-05-22 00:23:20,795 Example #3\n","2020-05-22 00:23:20,795 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-22 00:23:20,795 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-22 00:23:20,795 \tHypothesis: Ná Yesu wɔ nkate fam yaw , na na ohia mmoa , nanso Petro ne afoforo no daa .\n","2020-05-22 00:23:20,795 Validation result (greedy) at epoch  23, step   139000: bleu:  28.48, loss: 38880.6836, ppl:   4.3525, duration: 13.1760s\n","2020-05-22 00:23:31,787 Epoch  23 Step:   139100 Batch Loss:     1.596373 Tokens per Sec:    21910, Lr: 0.000210\n","2020-05-22 00:23:42,270 Epoch  23: total training loss 9913.02\n","2020-05-22 00:23:42,270 EPOCH 24\n","2020-05-22 00:23:43,454 Epoch  24 Step:   139200 Batch Loss:     1.777226 Tokens per Sec:     8462, Lr: 0.000210\n","2020-05-22 00:23:54,278 Epoch  24 Step:   139300 Batch Loss:     1.801991 Tokens per Sec:    21682, Lr: 0.000210\n","2020-05-22 00:24:05,170 Epoch  24 Step:   139400 Batch Loss:     1.512262 Tokens per Sec:    22223, Lr: 0.000210\n","2020-05-22 00:24:16,108 Epoch  24 Step:   139500 Batch Loss:     1.622513 Tokens per Sec:    22011, Lr: 0.000210\n","2020-05-22 00:24:26,989 Epoch  24 Step:   139600 Batch Loss:     1.656562 Tokens per Sec:    21570, Lr: 0.000210\n","2020-05-22 00:24:37,841 Epoch  24 Step:   139700 Batch Loss:     1.381406 Tokens per Sec:    21611, Lr: 0.000210\n","2020-05-22 00:24:48,615 Epoch  24 Step:   139800 Batch Loss:     1.757693 Tokens per Sec:    21727, Lr: 0.000210\n","2020-05-22 00:24:59,495 Epoch  24 Step:   139900 Batch Loss:     1.288940 Tokens per Sec:    21708, Lr: 0.000210\n","2020-05-22 00:25:10,445 Epoch  24 Step:   140000 Batch Loss:     1.760092 Tokens per Sec:    21809, Lr: 0.000210\n","2020-05-22 00:25:23,231 Hooray! New best validation result [ppl]!\n","2020-05-22 00:25:23,231 Saving new checkpoint.\n","2020-05-22 00:25:23,522 Example #0\n","2020-05-22 00:25:23,522 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-22 00:25:23,522 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-22 00:25:23,522 \tHypothesis: Nsɛm a ɛtete saa maa tete apɔwmuden yɛɛ den sɛ wɔbɛbɔ wɔn ho ban na wɔabɔ wɔn ho ban .\n","2020-05-22 00:25:23,522 Example #1\n","2020-05-22 00:25:23,522 \tSource:     If so , you would be worthy of death .\n","2020-05-22 00:25:23,523 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-22 00:25:23,523 \tHypothesis: Sɛ saa a , anka wobɛfata sɛ wuwu .\n","2020-05-22 00:25:23,523 Example #2\n","2020-05-22 00:25:23,523 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-22 00:25:23,523 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-22 00:25:23,523 \tHypothesis: Hwɛ sɛnea ɔsomafo Yohane ani gyei bere a ohuu nnipakuw kɛse no anisoadehu a ɛyɛ nwonwa yi !\n","2020-05-22 00:25:23,523 Example #3\n","2020-05-22 00:25:23,523 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-22 00:25:23,523 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-22 00:25:23,523 \tHypothesis: Ná Yesu wɔ nkate fam yaw , na na ohia mmoa , nanso Petro ne afoforo no daa .\n","2020-05-22 00:25:23,523 Validation result (greedy) at epoch  24, step   140000: bleu:  28.65, loss: 38595.6523, ppl:   4.3058, duration: 13.0784s\n","2020-05-22 00:25:34,386 Epoch  24 Step:   140100 Batch Loss:     1.728412 Tokens per Sec:    21634, Lr: 0.000210\n","2020-05-22 00:25:45,358 Epoch  24 Step:   140200 Batch Loss:     1.585757 Tokens per Sec:    21839, Lr: 0.000210\n","2020-05-22 00:25:56,160 Epoch  24 Step:   140300 Batch Loss:     1.649651 Tokens per Sec:    22584, Lr: 0.000210\n","2020-05-22 00:26:06,912 Epoch  24 Step:   140400 Batch Loss:     1.559812 Tokens per Sec:    21802, Lr: 0.000210\n","2020-05-22 00:26:17,756 Epoch  24 Step:   140500 Batch Loss:     1.673169 Tokens per Sec:    21667, Lr: 0.000210\n","2020-05-22 00:26:28,577 Epoch  24 Step:   140600 Batch Loss:     1.385435 Tokens per Sec:    22273, Lr: 0.000210\n","2020-05-22 00:26:39,404 Epoch  24 Step:   140700 Batch Loss:     1.696369 Tokens per Sec:    22155, Lr: 0.000210\n","2020-05-22 00:26:50,176 Epoch  24 Step:   140800 Batch Loss:     1.572109 Tokens per Sec:    21930, Lr: 0.000210\n","2020-05-22 00:27:01,181 Epoch  24 Step:   140900 Batch Loss:     1.405273 Tokens per Sec:    22087, Lr: 0.000210\n","2020-05-22 00:27:12,091 Epoch  24 Step:   141000 Batch Loss:     1.600268 Tokens per Sec:    21923, Lr: 0.000210\n","2020-05-22 00:27:24,767 Hooray! New best validation result [ppl]!\n","2020-05-22 00:27:24,767 Saving new checkpoint.\n","2020-05-22 00:27:25,008 Example #0\n","2020-05-22 00:27:25,009 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-22 00:27:25,009 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-22 00:27:25,009 \tHypothesis: Nsɛm a ɛtete saa maa tete apɔnkɔ no huu sɛ na ɛyɛ den na ɛyɛ anibiannaso .\n","2020-05-22 00:27:25,009 Example #1\n","2020-05-22 00:27:25,009 \tSource:     If so , you would be worthy of death .\n","2020-05-22 00:27:25,009 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-22 00:27:25,009 \tHypothesis: Sɛ saa a , anka wobɛfata owu .\n","2020-05-22 00:27:25,009 Example #2\n","2020-05-22 00:27:25,009 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-22 00:27:25,010 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-22 00:27:25,010 \tHypothesis: Oo , hwɛ sɛnea ɔsomafo Yohane ani gyei bere a ohuu nnipakuw kɛse no anisoadehu a ɛyɛ anigye yi !\n","2020-05-22 00:27:25,010 Example #3\n","2020-05-22 00:27:25,010 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-22 00:27:25,010 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-22 00:27:25,010 \tHypothesis: Ná Yesu wɔ nkate fam yaw , na na ohia mmoa , nanso Petro ne afoforo no daa .\n","2020-05-22 00:27:25,010 Validation result (greedy) at epoch  24, step   141000: bleu:  29.08, loss: 38571.0078, ppl:   4.3018, duration: 12.9193s\n","2020-05-22 00:27:35,865 Epoch  24 Step:   141100 Batch Loss:     1.759729 Tokens per Sec:    21833, Lr: 0.000210\n","2020-05-22 00:27:46,732 Epoch  24 Step:   141200 Batch Loss:     1.533082 Tokens per Sec:    22243, Lr: 0.000210\n","2020-05-22 00:27:57,585 Epoch  24 Step:   141300 Batch Loss:     1.681782 Tokens per Sec:    22088, Lr: 0.000210\n","2020-05-22 00:28:08,447 Epoch  24 Step:   141400 Batch Loss:     1.556079 Tokens per Sec:    22216, Lr: 0.000210\n","2020-05-22 00:28:19,400 Epoch  24 Step:   141500 Batch Loss:     1.483196 Tokens per Sec:    22170, Lr: 0.000210\n","2020-05-22 00:28:30,228 Epoch  24 Step:   141600 Batch Loss:     1.408984 Tokens per Sec:    21856, Lr: 0.000210\n","2020-05-22 00:28:41,046 Epoch  24 Step:   141700 Batch Loss:     1.534622 Tokens per Sec:    22479, Lr: 0.000210\n","2020-05-22 00:28:51,819 Epoch  24 Step:   141800 Batch Loss:     1.491255 Tokens per Sec:    22301, Lr: 0.000210\n","2020-05-22 00:29:02,525 Epoch  24 Step:   141900 Batch Loss:     1.794251 Tokens per Sec:    22212, Lr: 0.000210\n","2020-05-22 00:29:13,353 Epoch  24 Step:   142000 Batch Loss:     1.602216 Tokens per Sec:    22062, Lr: 0.000210\n","2020-05-22 00:29:25,567 Hooray! New best validation result [ppl]!\n","2020-05-22 00:29:25,567 Saving new checkpoint.\n","2020-05-22 00:29:25,831 Example #0\n","2020-05-22 00:29:25,832 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-22 00:29:25,832 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-22 00:29:25,832 \tHypothesis: Nsɛm a ɛtete saa maa tete apɔwmuden yɛɛ den sɛ wɔbɛbɔ wɔn ho ban na wɔabu wɔn ani agu so .\n","2020-05-22 00:29:25,832 Example #1\n","2020-05-22 00:29:25,832 \tSource:     If so , you would be worthy of death .\n","2020-05-22 00:29:25,832 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-22 00:29:25,832 \tHypothesis: Sɛ saa a , anka wobɛfata owu .\n","2020-05-22 00:29:25,832 Example #2\n","2020-05-22 00:29:25,832 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-22 00:29:25,832 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-22 00:29:25,832 \tHypothesis: Hwɛ anigye ara a ɔsomafo Yohane hui sɛ nnipakuw kɛse no anisoadehu a ɛyɛ nwonwa yi !\n","2020-05-22 00:29:25,833 Example #3\n","2020-05-22 00:29:25,833 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-22 00:29:25,833 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-22 00:29:25,833 \tHypothesis: Ná Yesu wɔ nkate fam yaw , na na ohia mmoa , nanso Petro ne afoforo no daa .\n","2020-05-22 00:29:25,833 Validation result (greedy) at epoch  24, step   142000: bleu:  28.59, loss: 38395.8711, ppl:   4.2734, duration: 12.4794s\n","2020-05-22 00:29:36,921 Epoch  24 Step:   142100 Batch Loss:     1.647952 Tokens per Sec:    21483, Lr: 0.000210\n","2020-05-22 00:29:47,912 Epoch  24 Step:   142200 Batch Loss:     1.688575 Tokens per Sec:    21529, Lr: 0.000210\n","2020-05-22 00:29:59,032 Epoch  24 Step:   142300 Batch Loss:     1.561135 Tokens per Sec:    21475, Lr: 0.000210\n","2020-05-22 00:30:10,159 Epoch  24 Step:   142400 Batch Loss:     1.590754 Tokens per Sec:    21086, Lr: 0.000210\n","2020-05-22 00:30:21,247 Epoch  24 Step:   142500 Batch Loss:     1.584048 Tokens per Sec:    21657, Lr: 0.000210\n","2020-05-22 00:30:32,162 Epoch  24 Step:   142600 Batch Loss:     1.411711 Tokens per Sec:    21880, Lr: 0.000210\n","2020-05-22 00:30:43,224 Epoch  24 Step:   142700 Batch Loss:     1.575768 Tokens per Sec:    22266, Lr: 0.000210\n","2020-05-22 00:30:54,078 Epoch  24 Step:   142800 Batch Loss:     1.536496 Tokens per Sec:    21838, Lr: 0.000210\n","2020-05-22 00:31:04,943 Epoch  24 Step:   142900 Batch Loss:     1.637653 Tokens per Sec:    21650, Lr: 0.000210\n","2020-05-22 00:31:15,878 Epoch  24 Step:   143000 Batch Loss:     1.786953 Tokens per Sec:    21779, Lr: 0.000210\n","2020-05-22 00:31:28,721 Example #0\n","2020-05-22 00:31:28,721 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-22 00:31:28,721 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-22 00:31:28,721 \tHypothesis: Nsɛm a ɛtete saa maa tete apɔwmuden yɛɛ den sɛ wɔbɛhyɛ wɔn so na wɔabu wɔn ani agu so .\n","2020-05-22 00:31:28,721 Example #1\n","2020-05-22 00:31:28,721 \tSource:     If so , you would be worthy of death .\n","2020-05-22 00:31:28,721 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-22 00:31:28,721 \tHypothesis: Sɛ saa a , ɛnde na wobɛfata owu .\n","2020-05-22 00:31:28,722 Example #2\n","2020-05-22 00:31:28,722 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-22 00:31:28,722 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-22 00:31:28,722 \tHypothesis: Hwɛ anigye ara a ɔsomafo Yohane hui sɛ nnipakuw kɛse no anisoadehu a ɛyɛ nwonwa yi !\n","2020-05-22 00:31:28,722 Example #3\n","2020-05-22 00:31:28,722 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-22 00:31:28,722 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-22 00:31:28,722 \tHypothesis: Ná Yesu wɔ nkate fam yaw , na na ohia mmoa , nanso Petro ne afoforo no daa .\n","2020-05-22 00:31:28,722 Validation result (greedy) at epoch  24, step   143000: bleu:  28.57, loss: 38399.6289, ppl:   4.2740, duration: 12.8442s\n","2020-05-22 00:31:39,675 Epoch  24 Step:   143100 Batch Loss:     1.732286 Tokens per Sec:    21972, Lr: 0.000210\n","2020-05-22 00:31:50,537 Epoch  24 Step:   143200 Batch Loss:     1.581338 Tokens per Sec:    21543, Lr: 0.000210\n","2020-05-22 00:32:01,398 Epoch  24 Step:   143300 Batch Loss:     1.617969 Tokens per Sec:    22094, Lr: 0.000210\n","2020-05-22 00:32:12,376 Epoch  24 Step:   143400 Batch Loss:     1.510088 Tokens per Sec:    21625, Lr: 0.000210\n","2020-05-22 00:32:23,410 Epoch  24 Step:   143500 Batch Loss:     1.551834 Tokens per Sec:    22317, Lr: 0.000210\n","2020-05-22 00:32:34,352 Epoch  24 Step:   143600 Batch Loss:     1.629992 Tokens per Sec:    22313, Lr: 0.000210\n","2020-05-22 00:32:45,127 Epoch  24 Step:   143700 Batch Loss:     1.555912 Tokens per Sec:    22062, Lr: 0.000210\n","2020-05-22 00:32:56,094 Epoch  24 Step:   143800 Batch Loss:     1.797425 Tokens per Sec:    22578, Lr: 0.000210\n","2020-05-22 00:33:06,992 Epoch  24 Step:   143900 Batch Loss:     1.884526 Tokens per Sec:    22348, Lr: 0.000210\n","2020-05-22 00:33:17,718 Epoch  24 Step:   144000 Batch Loss:     1.535221 Tokens per Sec:    21729, Lr: 0.000210\n","2020-05-22 00:33:30,063 Example #0\n","2020-05-22 00:33:30,064 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-22 00:33:30,064 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-22 00:33:30,064 \tHypothesis: Nsɛm a ɛtete saa maa tete ahoni no hui sɛ ɛyɛ den sɛ wɔbɛbɔ wɔn ho ban na wɔabɔ wɔn ho ban .\n","2020-05-22 00:33:30,064 Example #1\n","2020-05-22 00:33:30,064 \tSource:     If so , you would be worthy of death .\n","2020-05-22 00:33:30,064 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-22 00:33:30,064 \tHypothesis: Sɛ saa a , anka wobɛfata owu .\n","2020-05-22 00:33:30,064 Example #2\n","2020-05-22 00:33:30,064 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-22 00:33:30,064 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-22 00:33:30,064 \tHypothesis: Oo , hwɛ sɛnea ɔsomafo Yohane ani gyei bere a ohui sɛ nnipakuw kɛse no anisoadehu a ɛyɛ nwonwa yi !\n","2020-05-22 00:33:30,064 Example #3\n","2020-05-22 00:33:30,065 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-22 00:33:30,065 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-22 00:33:30,065 \tHypothesis: Ná Yesu wɔ nkate fam yaw ne hia mmoa , nanso Petro ne afoforo no daa .\n","2020-05-22 00:33:30,065 Validation result (greedy) at epoch  24, step   144000: bleu:  28.43, loss: 38419.4648, ppl:   4.2772, duration: 12.3460s\n","2020-05-22 00:33:40,978 Epoch  24 Step:   144100 Batch Loss:     1.787541 Tokens per Sec:    22034, Lr: 0.000210\n","2020-05-22 00:33:51,943 Epoch  24 Step:   144200 Batch Loss:     1.978576 Tokens per Sec:    22052, Lr: 0.000210\n","2020-05-22 00:34:02,868 Epoch  24 Step:   144300 Batch Loss:     1.555943 Tokens per Sec:    21648, Lr: 0.000210\n","2020-05-22 00:34:13,780 Epoch  24 Step:   144400 Batch Loss:     1.641773 Tokens per Sec:    22053, Lr: 0.000210\n","2020-05-22 00:34:24,651 Epoch  24 Step:   144500 Batch Loss:     1.532910 Tokens per Sec:    22064, Lr: 0.000210\n","2020-05-22 00:34:35,670 Epoch  24 Step:   144600 Batch Loss:     1.600759 Tokens per Sec:    22363, Lr: 0.000210\n","2020-05-22 00:34:46,504 Epoch  24 Step:   144700 Batch Loss:     1.540413 Tokens per Sec:    21776, Lr: 0.000210\n","2020-05-22 00:34:57,525 Epoch  24 Step:   144800 Batch Loss:     1.663303 Tokens per Sec:    22277, Lr: 0.000210\n","2020-05-22 00:35:08,412 Epoch  24 Step:   144900 Batch Loss:     1.586184 Tokens per Sec:    21984, Lr: 0.000210\n","2020-05-22 00:35:19,333 Epoch  24 Step:   145000 Batch Loss:     1.524398 Tokens per Sec:    22492, Lr: 0.000210\n","2020-05-22 00:35:32,327 Example #0\n","2020-05-22 00:35:32,327 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-22 00:35:32,327 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-22 00:35:32,327 \tHypothesis: Nsɛm a ɛtete saa maa tete nneɛma a na ɛyɛ hu sɛ na ɛyɛ aniwu na ɛyɛ anibiannaso .\n","2020-05-22 00:35:32,327 Example #1\n","2020-05-22 00:35:32,327 \tSource:     If so , you would be worthy of death .\n","2020-05-22 00:35:32,327 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-22 00:35:32,328 \tHypothesis: Sɛ saa a , ɛnde na wobɛfata owu .\n","2020-05-22 00:35:32,328 Example #2\n","2020-05-22 00:35:32,328 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-22 00:35:32,328 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-22 00:35:32,328 \tHypothesis: Oo , hwɛ anigye ara a ɔsomafo Yohane hui sɛ nnipakuw kɛse no anisoadehu a ɛyɛ anigye yi !\n","2020-05-22 00:35:32,328 Example #3\n","2020-05-22 00:35:32,328 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-22 00:35:32,328 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-22 00:35:32,328 \tHypothesis: Ná Yesu wɔ nkate fam ahokyere ne mmoa , nanso Petro ne afoforo no daa .\n","2020-05-22 00:35:32,328 Validation result (greedy) at epoch  24, step   145000: bleu:  28.99, loss: 38447.7461, ppl:   4.2818, duration: 12.9956s\n","2020-05-22 00:35:43,085 Epoch  24 Step:   145100 Batch Loss:     1.342517 Tokens per Sec:    21431, Lr: 0.000210\n","2020-05-22 00:35:54,016 Epoch  24 Step:   145200 Batch Loss:     1.655242 Tokens per Sec:    22314, Lr: 0.000210\n","2020-05-22 00:35:58,655 Epoch  24: total training loss 9753.75\n","2020-05-22 00:35:58,655 EPOCH 25\n","2020-05-22 00:36:05,735 Epoch  25 Step:   145300 Batch Loss:     1.723515 Tokens per Sec:    19915, Lr: 0.000210\n","2020-05-22 00:36:16,588 Epoch  25 Step:   145400 Batch Loss:     1.440329 Tokens per Sec:    22065, Lr: 0.000210\n","2020-05-22 00:36:27,558 Epoch  25 Step:   145500 Batch Loss:     1.404988 Tokens per Sec:    22013, Lr: 0.000210\n","2020-05-22 00:36:38,543 Epoch  25 Step:   145600 Batch Loss:     1.595168 Tokens per Sec:    21851, Lr: 0.000210\n","2020-05-22 00:36:49,588 Epoch  25 Step:   145700 Batch Loss:     1.492526 Tokens per Sec:    22134, Lr: 0.000210\n","2020-05-22 00:37:00,475 Epoch  25 Step:   145800 Batch Loss:     1.449785 Tokens per Sec:    22184, Lr: 0.000210\n","2020-05-22 00:37:11,411 Epoch  25 Step:   145900 Batch Loss:     1.313527 Tokens per Sec:    22120, Lr: 0.000210\n","2020-05-22 00:37:22,297 Epoch  25 Step:   146000 Batch Loss:     1.464510 Tokens per Sec:    21954, Lr: 0.000210\n","2020-05-22 00:37:34,912 Hooray! New best validation result [ppl]!\n","2020-05-22 00:37:34,913 Saving new checkpoint.\n","2020-05-22 00:37:35,175 Example #0\n","2020-05-22 00:37:35,176 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-22 00:37:35,176 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-22 00:37:35,176 \tHypothesis: Nsɛm a ɛtete saa no maa tete ahoni no hui sɛ ɛyɛ aniwu na ɛyɛ anika .\n","2020-05-22 00:37:35,176 Example #1\n","2020-05-22 00:37:35,176 \tSource:     If so , you would be worthy of death .\n","2020-05-22 00:37:35,176 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-22 00:37:35,176 \tHypothesis: Sɛ saa a , ɛnde na wobɛfata owu .\n","2020-05-22 00:37:35,176 Example #2\n","2020-05-22 00:37:35,176 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-22 00:37:35,176 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-22 00:37:35,176 \tHypothesis: Oo , hwɛ anigye ara a ɔsomafo Yohane nyae bere a ohui sɛ nnipakuw kɛse no anisoadehu a ɛyɛ nwonwa yi !\n","2020-05-22 00:37:35,177 Example #3\n","2020-05-22 00:37:35,177 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-22 00:37:35,177 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-22 00:37:35,177 \tHypothesis: Ná Yesu wɔ nkate fam yaw , na na ohia mmoa , nanso Petro ne afoforo no daa .\n","2020-05-22 00:37:35,177 Validation result (greedy) at epoch  25, step   146000: bleu:  28.65, loss: 38309.4805, ppl:   4.2595, duration: 12.8799s\n","2020-05-22 00:37:46,058 Epoch  25 Step:   146100 Batch Loss:     1.404357 Tokens per Sec:    21697, Lr: 0.000210\n","2020-05-22 00:37:56,848 Epoch  25 Step:   146200 Batch Loss:     1.631071 Tokens per Sec:    21469, Lr: 0.000210\n","2020-05-22 00:38:07,676 Epoch  25 Step:   146300 Batch Loss:     1.341168 Tokens per Sec:    21927, Lr: 0.000210\n","2020-05-22 00:38:18,499 Epoch  25 Step:   146400 Batch Loss:     1.610088 Tokens per Sec:    22246, Lr: 0.000210\n","2020-05-22 00:38:29,374 Epoch  25 Step:   146500 Batch Loss:     1.778432 Tokens per Sec:    21695, Lr: 0.000210\n","2020-05-22 00:38:40,355 Epoch  25 Step:   146600 Batch Loss:     2.254109 Tokens per Sec:    22583, Lr: 0.000210\n","2020-05-22 00:38:51,088 Epoch  25 Step:   146700 Batch Loss:     1.675943 Tokens per Sec:    21533, Lr: 0.000210\n","2020-05-22 00:39:02,024 Epoch  25 Step:   146800 Batch Loss:     1.676635 Tokens per Sec:    21930, Lr: 0.000210\n","2020-05-22 00:39:12,914 Epoch  25 Step:   146900 Batch Loss:     1.354892 Tokens per Sec:    21981, Lr: 0.000210\n","2020-05-22 00:39:23,795 Epoch  25 Step:   147000 Batch Loss:     1.537552 Tokens per Sec:    21473, Lr: 0.000210\n","2020-05-22 00:39:36,263 Hooray! New best validation result [ppl]!\n","2020-05-22 00:39:36,263 Saving new checkpoint.\n","2020-05-22 00:39:36,548 Example #0\n","2020-05-22 00:39:36,549 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-22 00:39:36,549 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-22 00:39:36,549 \tHypothesis: Nsɛm a ɛtete saa maa tete apontow no yɛɛ hu sɛ na ɛyɛ aniwu na ɛyɛ aniwu .\n","2020-05-22 00:39:36,549 Example #1\n","2020-05-22 00:39:36,549 \tSource:     If so , you would be worthy of death .\n","2020-05-22 00:39:36,549 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-22 00:39:36,549 \tHypothesis: Sɛ saa a , anka wobɛfata owu .\n","2020-05-22 00:39:36,549 Example #2\n","2020-05-22 00:39:36,549 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-22 00:39:36,549 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-22 00:39:36,549 \tHypothesis: Oo , hwɛ anigye ara a ɔsomafo Yohane hui sɛ nnipakuw kɛse no anisoadehu a ɛyɛ nwonwa yi !\n","2020-05-22 00:39:36,549 Example #3\n","2020-05-22 00:39:36,550 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-22 00:39:36,550 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-22 00:39:36,550 \tHypothesis: Ná Yesu wɔ nkate fam yaw , na na ohia mmoa , nanso Petro ne afoforo no daa .\n","2020-05-22 00:39:36,550 Validation result (greedy) at epoch  25, step   147000: bleu:  28.92, loss: 38190.5625, ppl:   4.2403, duration: 12.7543s\n","2020-05-22 00:39:47,406 Epoch  25 Step:   147100 Batch Loss:     1.484263 Tokens per Sec:    22040, Lr: 0.000210\n","2020-05-22 00:39:58,206 Epoch  25 Step:   147200 Batch Loss:     1.647846 Tokens per Sec:    21666, Lr: 0.000210\n","2020-05-22 00:40:09,136 Epoch  25 Step:   147300 Batch Loss:     1.520897 Tokens per Sec:    21828, Lr: 0.000210\n","2020-05-22 00:40:20,059 Epoch  25 Step:   147400 Batch Loss:     1.429662 Tokens per Sec:    22134, Lr: 0.000210\n","2020-05-22 00:40:30,994 Epoch  25 Step:   147500 Batch Loss:     1.519973 Tokens per Sec:    21543, Lr: 0.000210\n","2020-05-22 00:40:41,937 Epoch  25 Step:   147600 Batch Loss:     1.514701 Tokens per Sec:    21825, Lr: 0.000210\n","2020-05-22 00:40:52,908 Epoch  25 Step:   147700 Batch Loss:     1.742529 Tokens per Sec:    22155, Lr: 0.000210\n","2020-05-22 00:41:03,861 Epoch  25 Step:   147800 Batch Loss:     1.684614 Tokens per Sec:    21939, Lr: 0.000210\n","2020-05-22 00:41:14,812 Epoch  25 Step:   147900 Batch Loss:     1.691443 Tokens per Sec:    21725, Lr: 0.000210\n","2020-05-22 00:41:25,732 Epoch  25 Step:   148000 Batch Loss:     1.521034 Tokens per Sec:    22048, Lr: 0.000210\n","2020-05-22 00:41:37,967 Example #0\n","2020-05-22 00:41:37,967 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-22 00:41:37,967 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-22 00:41:37,967 \tHypothesis: Nsɛm a ɛtete saa maa tete apontow no yɛɛ den sɛ wɔbɛyɛ anibiannaso na wɔabu wɔn ani agu so .\n","2020-05-22 00:41:37,967 Example #1\n","2020-05-22 00:41:37,967 \tSource:     If so , you would be worthy of death .\n","2020-05-22 00:41:37,967 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-22 00:41:37,967 \tHypothesis: Sɛ saa a , ɛnde na wobɛfata owu .\n","2020-05-22 00:41:37,968 Example #2\n","2020-05-22 00:41:37,968 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-22 00:41:37,968 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-22 00:41:37,968 \tHypothesis: Oo , hwɛ anigye ara a ɔsomafo Yohane hui sɛ nnipakuw kɛse no anisoadehu a ɛyɛ anigye yi renya !\n","2020-05-22 00:41:37,968 Example #3\n","2020-05-22 00:41:37,968 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-22 00:41:37,968 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-22 00:41:37,968 \tHypothesis: Ná Yesu wɔ nkate fam yaw na ohia mmoa , nanso Petro ne afoforo no daa .\n","2020-05-22 00:41:37,968 Validation result (greedy) at epoch  25, step   148000: bleu:  28.80, loss: 38353.0000, ppl:   4.2665, duration: 12.2363s\n","2020-05-22 00:41:48,869 Epoch  25 Step:   148100 Batch Loss:     1.558746 Tokens per Sec:    21851, Lr: 0.000210\n","2020-05-22 00:41:59,760 Epoch  25 Step:   148200 Batch Loss:     1.439239 Tokens per Sec:    21840, Lr: 0.000210\n","2020-05-22 00:42:10,616 Epoch  25 Step:   148300 Batch Loss:     1.517245 Tokens per Sec:    22214, Lr: 0.000210\n","2020-05-22 00:42:21,569 Epoch  25 Step:   148400 Batch Loss:     1.457807 Tokens per Sec:    22121, Lr: 0.000210\n","2020-05-22 00:42:32,602 Epoch  25 Step:   148500 Batch Loss:     1.587327 Tokens per Sec:    21735, Lr: 0.000210\n","2020-05-22 00:42:43,597 Epoch  25 Step:   148600 Batch Loss:     1.479242 Tokens per Sec:    21832, Lr: 0.000210\n","2020-05-22 00:42:54,500 Epoch  25 Step:   148700 Batch Loss:     1.662676 Tokens per Sec:    22001, Lr: 0.000210\n","2020-05-22 00:43:05,394 Epoch  25 Step:   148800 Batch Loss:     1.713144 Tokens per Sec:    21590, Lr: 0.000210\n","2020-05-22 00:43:16,282 Epoch  25 Step:   148900 Batch Loss:     1.375336 Tokens per Sec:    22179, Lr: 0.000210\n","2020-05-22 00:43:27,176 Epoch  25 Step:   149000 Batch Loss:     1.799025 Tokens per Sec:    22200, Lr: 0.000210\n","2020-05-22 00:43:39,718 Example #0\n","2020-05-22 00:43:39,718 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-22 00:43:39,718 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-22 00:43:39,718 \tHypothesis: Nsɛm a ɛtete saa maa tete ahoni no huu sɛ na ɛyɛ den sɛ wɔbɛbɔ wɔn ho ban na wɔabɔ wɔn ho ban .\n","2020-05-22 00:43:39,719 Example #1\n","2020-05-22 00:43:39,719 \tSource:     If so , you would be worthy of death .\n","2020-05-22 00:43:39,719 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-22 00:43:39,719 \tHypothesis: Sɛ saa a , ɛnde na ɛsɛ sɛ wuwu .\n","2020-05-22 00:43:39,719 Example #2\n","2020-05-22 00:43:39,719 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-22 00:43:39,719 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-22 00:43:39,719 \tHypothesis: Oo , hwɛ anigye ara a ɔsomafo Yohane hui sɛ nnipakuw kɛse no anisoadehu a ɛyɛ hu yi !\n","2020-05-22 00:43:39,719 Example #3\n","2020-05-22 00:43:39,719 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-22 00:43:39,719 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-22 00:43:39,719 \tHypothesis: Ná Yesu wɔ nkate fam yaw , na na ohia mmoa , nanso Petro ne afoforo no daa .\n","2020-05-22 00:43:39,720 Validation result (greedy) at epoch  25, step   149000: bleu:  28.83, loss: 38206.9141, ppl:   4.2430, duration: 12.5430s\n","2020-05-22 00:43:50,640 Epoch  25 Step:   149100 Batch Loss:     1.477675 Tokens per Sec:    22238, Lr: 0.000210\n","2020-05-22 00:44:01,509 Epoch  25 Step:   149200 Batch Loss:     1.425099 Tokens per Sec:    22130, Lr: 0.000210\n","2020-05-22 00:44:12,390 Epoch  25 Step:   149300 Batch Loss:     1.937625 Tokens per Sec:    22414, Lr: 0.000210\n","2020-05-22 00:44:23,416 Epoch  25 Step:   149400 Batch Loss:     1.489257 Tokens per Sec:    21746, Lr: 0.000210\n","2020-05-22 00:44:34,380 Epoch  25 Step:   149500 Batch Loss:     1.553550 Tokens per Sec:    21734, Lr: 0.000210\n","2020-05-22 00:44:45,240 Epoch  25 Step:   149600 Batch Loss:     1.815023 Tokens per Sec:    22060, Lr: 0.000210\n","2020-05-22 00:44:56,052 Epoch  25 Step:   149700 Batch Loss:     1.625992 Tokens per Sec:    21675, Lr: 0.000210\n","2020-05-22 00:45:06,961 Epoch  25 Step:   149800 Batch Loss:     1.758867 Tokens per Sec:    22391, Lr: 0.000210\n","2020-05-22 00:45:17,780 Epoch  25 Step:   149900 Batch Loss:     1.484312 Tokens per Sec:    22196, Lr: 0.000210\n","2020-05-22 00:45:28,703 Epoch  25 Step:   150000 Batch Loss:     1.634493 Tokens per Sec:    22245, Lr: 0.000210\n","2020-05-22 00:45:41,078 Hooray! New best validation result [ppl]!\n","2020-05-22 00:45:41,078 Saving new checkpoint.\n","2020-05-22 00:45:41,320 Example #0\n","2020-05-22 00:45:41,321 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-22 00:45:41,321 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-22 00:45:41,321 \tHypothesis: Nsɛm a ɛtete saa maa tete ahemfo huu sɛ wɔn ho yɛ den na wɔyɛ anibiannaso .\n","2020-05-22 00:45:41,321 Example #1\n","2020-05-22 00:45:41,321 \tSource:     If so , you would be worthy of death .\n","2020-05-22 00:45:41,321 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-22 00:45:41,321 \tHypothesis: Sɛ saa a , ɛnde na ɛsɛ sɛ wuwu .\n","2020-05-22 00:45:41,321 Example #2\n","2020-05-22 00:45:41,321 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-22 00:45:41,321 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-22 00:45:41,321 \tHypothesis: Hwɛ anigye ara a ɔsomafo Yohane hui sɛ nnipakuw kɛse no anisoadehu a ɛyɛ nwonwa yi !\n","2020-05-22 00:45:41,322 Example #3\n","2020-05-22 00:45:41,322 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-22 00:45:41,322 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-22 00:45:41,322 \tHypothesis: Ná Yesu wɔ nkate fam yaw , na na ohia mmoa , nanso Petro ne afoforo no daa .\n","2020-05-22 00:45:41,322 Validation result (greedy) at epoch  25, step   150000: bleu:  28.75, loss: 38072.3828, ppl:   4.2214, duration: 12.6182s\n","2020-05-22 00:45:52,244 Epoch  25 Step:   150100 Batch Loss:     1.519263 Tokens per Sec:    22410, Lr: 0.000210\n","2020-05-22 00:46:03,036 Epoch  25 Step:   150200 Batch Loss:     1.717921 Tokens per Sec:    21900, Lr: 0.000210\n","2020-05-22 00:46:13,837 Epoch  25 Step:   150300 Batch Loss:     1.625125 Tokens per Sec:    21824, Lr: 0.000210\n","2020-05-22 00:46:24,658 Epoch  25 Step:   150400 Batch Loss:     1.569497 Tokens per Sec:    22338, Lr: 0.000210\n","2020-05-22 00:46:35,416 Epoch  25 Step:   150500 Batch Loss:     1.467157 Tokens per Sec:    21865, Lr: 0.000210\n","2020-05-22 00:46:46,244 Epoch  25 Step:   150600 Batch Loss:     1.694809 Tokens per Sec:    22094, Lr: 0.000210\n","2020-05-22 00:46:57,177 Epoch  25 Step:   150700 Batch Loss:     1.458932 Tokens per Sec:    21974, Lr: 0.000210\n","2020-05-22 00:47:08,058 Epoch  25 Step:   150800 Batch Loss:     1.576777 Tokens per Sec:    21914, Lr: 0.000210\n","2020-05-22 00:47:18,885 Epoch  25 Step:   150900 Batch Loss:     1.492381 Tokens per Sec:    22193, Lr: 0.000210\n","2020-05-22 00:47:29,681 Epoch  25 Step:   151000 Batch Loss:     1.347760 Tokens per Sec:    22313, Lr: 0.000210\n","2020-05-22 00:47:42,190 Example #0\n","2020-05-22 00:47:42,190 \tSource:     Such cases made ancient oracles notorious for being vague and enigmatic .\n","2020-05-22 00:47:42,190 \tReference:  Nsɛm a ɛtete saa maa tete abosonkɔm gyee dimmɔne sɛ ɛyɛ nea emu nna hɔ .\n","2020-05-22 00:47:42,190 \tHypothesis: Nsɛm a ɛtete saa no maa tete anyinam ahoɔden a na ɛyɛ hu sɛ na ɛyɛ anika na ɛyɛ anika .\n","2020-05-22 00:47:42,190 Example #1\n","2020-05-22 00:47:42,190 \tSource:     If so , you would be worthy of death .\n","2020-05-22 00:47:42,190 \tReference:  Sɛ ɛte saa a , ɛnde na wofata owu .\n","2020-05-22 00:47:42,190 \tHypothesis: Sɛ saa a , anka wobɛfata owu .\n","2020-05-22 00:47:42,191 Example #2\n","2020-05-22 00:47:42,191 \tSource:     Oh , what a thrill the apostle John experienced in seeing this stirring vision of the great crowd !\n","2020-05-22 00:47:42,191 \tReference:  Oo , hwɛ anigye a ɔsomafo Yohane nyae sɛ onyaa nnipakuw kɛse no ho anisoadehu a ɛkanyan anigye yi !\n","2020-05-22 00:47:42,191 \tHypothesis: Oo , hwɛ sɛnea ɔsomafo Yohane ani gyei bere a ohuu nnipakuw kɛse no anisoadehu a ɛyɛ nwonwa yi !\n","2020-05-22 00:47:42,191 Example #3\n","2020-05-22 00:47:42,191 \tSource:     Jesus was in emotional agony and in need of support , but Peter and the others fell asleep repeatedly .\n","2020-05-22 00:47:42,191 \tReference:  Ná Yesu ho yeraw no , na na ohia mmoa , nanso Petro ne asuafo afoforo a na wɔka ne ho no dae mpɛn pii .\n","2020-05-22 00:47:42,191 \tHypothesis: Ná Yesu wɔ nkate fam yaw , na na ohia mmoa , nanso Petro ne afoforo no daa .\n","2020-05-22 00:47:42,191 Validation result (greedy) at epoch  25, step   151000: bleu:  28.97, loss: 38127.9570, ppl:   4.2303, duration: 12.5103s\n","2020-05-22 00:47:53,053 Epoch  25 Step:   151100 Batch Loss:     1.341317 Tokens per Sec:    21938, Lr: 0.000210\n","2020-05-22 00:48:03,846 Epoch  25 Step:   151200 Batch Loss:     1.600121 Tokens per Sec:    22201, Lr: 0.000210\n","2020-05-22 00:48:12,953 Epoch  25: total training loss 9684.20\n","2020-05-22 00:48:12,953 Training ended after  25 epochs.\n","2020-05-22 00:48:12,953 Best validation result (greedy) at step   150000:   4.22 ppl.\n","/pytorch/aten/src/ATen/native/BinaryOps.cpp:81: UserWarning: Integer division of tensors using div or / is deprecated, and in a future release div will perform true division as in Python 3. Use true_divide or floor_divide (// in Python) instead.\n","2020-05-22 00:48:38,951  dev bleu:  29.72 [Beam search decoding with beam size = 5 and alpha = 1.0]\n","2020-05-22 00:48:38,952 Translations saved to: models/entw_transformer/00150000.hyps.dev\n","2020-05-22 00:49:10,755 test bleu:  34.57 [Beam search decoding with beam size = 5 and alpha = 1.0]\n","2020-05-22 00:49:10,756 Translations saved to: models/entw_transformer/00150000.hyps.test\n","time: 5h 8min 46s\n"],"name":"stdout"}]},{"cell_type":"code","metadata":{"id":"sKKowPWL4V4S","colab_type":"code","colab":{"base_uri":"https://localhost:8080/","height":51},"outputId":"fb0c6f6b-b19b-41c3-d1b8-bebf80864efb","executionInfo":{"status":"ok","timestamp":1590109039913,"user_tz":0,"elapsed":4141,"user":{"displayName":"Salomey Osei","photoUrl":"","userId":"06221058988152607684"}}},"source":["# ! ls \"$gdrive_path/models/${src}${tgt}_transformer/\""],"execution_count":28,"outputs":[{"output_type":"stream","text":["ls: cannot access '/content/drive/My Drive/masakhane/en-tw-baseline/models/entw_transformer/': No such file or directory\n","time: 3.09 s\n"],"name":"stdout"}]},{"cell_type":"code","metadata":{"colab_type":"code","id":"MBoDS09JM807","colab":{"base_uri":"https://localhost:8080/","height":71},"outputId":"488a52ee-781a-45d3-9ace-d090dfb2bee4","executionInfo":{"status":"ok","timestamp":1590109181814,"user_tz":0,"elapsed":7870,"user":{"displayName":"Salomey Osei","photoUrl":"","userId":"06221058988152607684"}}},"source":["# Copy the created models from the notebook storage to google drive for persistant storage \n","!cp -r joeynmt/models/${src}${tgt}_transformer/* \"$gdrive_path/models/${src}${tgt}_transformer/\""],"execution_count":29,"outputs":[{"output_type":"stream","text":["cp: cannot create symbolic link '/content/drive/My Drive/masakhane/en-tw-baseline/models/entw_transformer/best.ckpt': Operation not supported\n","time: 6.65 s\n"],"name":"stdout"}]},{"cell_type":"code","metadata":{"colab_type":"code","id":"n94wlrCjVc17","colab":{"base_uri":"https://localhost:8080/","height":1000},"outputId":"d527f2b4-496f-4b58-f0d3-a67693feafe3","executionInfo":{"status":"ok","timestamp":1590109194199,"user_tz":0,"elapsed":4463,"user":{"displayName":"Salomey Osei","photoUrl":"","userId":"06221058988152607684"}}},"source":["# Output our validation accuracy\n","! cat \"$gdrive_path/models/${src}${tgt}_transformer/validations.txt\""],"execution_count":30,"outputs":[{"output_type":"stream","text":["Steps: 1000\tLoss: 109860.85938\tPPL: 63.79848\tbleu: 1.16087\tLR: 0.00030000\t*\n","Steps: 2000\tLoss: 95330.92188\tPPL: 36.82225\tbleu: 2.88280\tLR: 0.00030000\t*\n","Steps: 3000\tLoss: 86224.48438\tPPL: 26.09207\tbleu: 4.41620\tLR: 0.00030000\t*\n","Steps: 4000\tLoss: 80323.14062\tPPL: 20.87182\tbleu: 5.56210\tLR: 0.00030000\t*\n","Steps: 5000\tLoss: 75845.74219\tPPL: 17.61996\tbleu: 7.05899\tLR: 0.00030000\t*\n","Steps: 6000\tLoss: 72087.57031\tPPL: 15.28499\tbleu: 8.73496\tLR: 0.00030000\t*\n","Steps: 7000\tLoss: 68820.29688\tPPL: 13.50797\tbleu: 10.11460\tLR: 0.00030000\t*\n","Steps: 8000\tLoss: 66377.24219\tPPL: 12.31558\tbleu: 11.49296\tLR: 0.00030000\t*\n","Steps: 9000\tLoss: 64206.80469\tPPL: 11.34485\tbleu: 12.07445\tLR: 0.00030000\t*\n","Steps: 10000\tLoss: 62063.46094\tPPL: 10.46135\tbleu: 12.97361\tLR: 0.00030000\t*\n","Steps: 11000\tLoss: 60652.78906\tPPL: 9.91775\tbleu: 13.71834\tLR: 0.00030000\t*\n","Steps: 12000\tLoss: 59153.05859\tPPL: 9.37077\tbleu: 14.68732\tLR: 0.00030000\t*\n","Steps: 13000\tLoss: 58085.83984\tPPL: 9.00000\tbleu: 15.08894\tLR: 0.00030000\t*\n","Steps: 14000\tLoss: 56943.12500\tPPL: 8.61926\tbleu: 15.92625\tLR: 0.00030000\t*\n","Steps: 15000\tLoss: 55890.43359\tPPL: 8.28278\tbleu: 16.43676\tLR: 0.00030000\t*\n","Steps: 16000\tLoss: 54738.51172\tPPL: 7.92962\tbleu: 17.31161\tLR: 0.00030000\t*\n","Steps: 17000\tLoss: 54238.69922\tPPL: 7.78111\tbleu: 17.58451\tLR: 0.00030000\t*\n","Steps: 18000\tLoss: 53437.94531\tPPL: 7.54895\tbleu: 18.23502\tLR: 0.00030000\t*\n","Steps: 19000\tLoss: 52919.95703\tPPL: 7.40247\tbleu: 18.16734\tLR: 0.00030000\t*\n","Steps: 20000\tLoss: 52087.83594\tPPL: 7.17310\tbleu: 18.97346\tLR: 0.00030000\t*\n","Steps: 21000\tLoss: 51602.27344\tPPL: 7.04255\tbleu: 19.49282\tLR: 0.00030000\t*\n","Steps: 22000\tLoss: 51046.27344\tPPL: 6.89597\tbleu: 20.18313\tLR: 0.00030000\t*\n","Steps: 23000\tLoss: 50586.93750\tPPL: 6.77719\tbleu: 20.31719\tLR: 0.00030000\t*\n","Steps: 24000\tLoss: 50214.29297\tPPL: 6.68233\tbleu: 20.12025\tLR: 0.00030000\t*\n","Steps: 25000\tLoss: 49788.15234\tPPL: 6.57547\tbleu: 21.20197\tLR: 0.00030000\t*\n","Steps: 26000\tLoss: 49435.96094\tPPL: 6.48845\tbleu: 20.61039\tLR: 0.00030000\t*\n","Steps: 27000\tLoss: 49078.21875\tPPL: 6.40124\tbleu: 21.55727\tLR: 0.00030000\t*\n","Steps: 28000\tLoss: 48415.01172\tPPL: 6.24265\tbleu: 22.01150\tLR: 0.00030000\t*\n","Steps: 29000\tLoss: 48288.69922\tPPL: 6.21289\tbleu: 22.07347\tLR: 0.00030000\t*\n","Steps: 30000\tLoss: 47960.46875\tPPL: 6.13623\tbleu: 22.14050\tLR: 0.00030000\t*\n","Steps: 31000\tLoss: 47794.85547\tPPL: 6.09791\tbleu: 22.25916\tLR: 0.00030000\t*\n","Steps: 32000\tLoss: 47344.05078\tPPL: 5.99480\tbleu: 22.56217\tLR: 0.00030000\t*\n","Steps: 33000\tLoss: 47036.36719\tPPL: 5.92544\tbleu: 22.80059\tLR: 0.00030000\t*\n","Steps: 34000\tLoss: 46815.85547\tPPL: 5.87622\tbleu: 22.91385\tLR: 0.00030000\t*\n","Steps: 35000\tLoss: 46446.91406\tPPL: 5.79478\tbleu: 23.03060\tLR: 0.00030000\t*\n","Steps: 36000\tLoss: 46170.69141\tPPL: 5.73454\tbleu: 23.28469\tLR: 0.00030000\t*\n","Steps: 37000\tLoss: 46064.51172\tPPL: 5.71156\tbleu: 23.30764\tLR: 0.00030000\t*\n","Steps: 38000\tLoss: 45972.44922\tPPL: 5.69170\tbleu: 23.45203\tLR: 0.00030000\t*\n","Steps: 39000\tLoss: 45646.36719\tPPL: 5.62193\tbleu: 23.19590\tLR: 0.00030000\t*\n","Steps: 40000\tLoss: 45530.07422\tPPL: 5.59725\tbleu: 23.83184\tLR: 0.00030000\t*\n","Steps: 41000\tLoss: 45320.12891\tPPL: 5.55297\tbleu: 24.05443\tLR: 0.00030000\t*\n","Steps: 42000\tLoss: 45291.03125\tPPL: 5.54687\tbleu: 23.95032\tLR: 0.00030000\t*\n","Steps: 43000\tLoss: 45072.32422\tPPL: 5.50117\tbleu: 24.01709\tLR: 0.00030000\t*\n","Steps: 44000\tLoss: 44780.23828\tPPL: 5.44072\tbleu: 24.07221\tLR: 0.00030000\t*\n","Steps: 45000\tLoss: 44677.62109\tPPL: 5.41964\tbleu: 24.25126\tLR: 0.00030000\t*\n","Steps: 46000\tLoss: 44496.13672\tPPL: 5.38256\tbleu: 24.59385\tLR: 0.00030000\t*\n","Steps: 47000\tLoss: 44567.11719\tPPL: 5.39703\tbleu: 24.31773\tLR: 0.00030000\t\n","Steps: 48000\tLoss: 44194.85156\tPPL: 5.32157\tbleu: 24.60332\tLR: 0.00030000\t*\n","Steps: 49000\tLoss: 44017.55469\tPPL: 5.28600\tbleu: 24.87387\tLR: 0.00030000\t*\n","Steps: 50000\tLoss: 43836.61328\tPPL: 5.24994\tbleu: 24.86829\tLR: 0.00030000\t*\n","Steps: 51000\tLoss: 43881.33984\tPPL: 5.25883\tbleu: 24.98661\tLR: 0.00030000\t\n","Steps: 52000\tLoss: 43733.86328\tPPL: 5.22957\tbleu: 24.51259\tLR: 0.00030000\t*\n","Steps: 53000\tLoss: 43552.92578\tPPL: 5.19390\tbleu: 24.67414\tLR: 0.00030000\t*\n","Steps: 54000\tLoss: 43563.52734\tPPL: 5.19599\tbleu: 24.76077\tLR: 0.00030000\t\n","Steps: 55000\tLoss: 43322.52734\tPPL: 5.14883\tbleu: 25.24733\tLR: 0.00030000\t*\n","Steps: 56000\tLoss: 43293.60156\tPPL: 5.14320\tbleu: 24.94730\tLR: 0.00030000\t*\n","Steps: 57000\tLoss: 43352.19141\tPPL: 5.15461\tbleu: 25.27352\tLR: 0.00030000\t\n","Steps: 58000\tLoss: 43042.32812\tPPL: 5.09455\tbleu: 25.23045\tLR: 0.00030000\t*\n","Steps: 59000\tLoss: 43045.07031\tPPL: 5.09508\tbleu: 25.49793\tLR: 0.00030000\t\n","Steps: 60000\tLoss: 42705.03516\tPPL: 5.02996\tbleu: 25.59941\tLR: 0.00030000\t*\n","Steps: 61000\tLoss: 42700.70312\tPPL: 5.02914\tbleu: 25.75874\tLR: 0.00030000\t*\n","Steps: 62000\tLoss: 42574.29297\tPPL: 5.00515\tbleu: 25.87328\tLR: 0.00030000\t*\n","Steps: 63000\tLoss: 42475.92969\tPPL: 4.98656\tbleu: 25.95982\tLR: 0.00030000\t*\n","Steps: 64000\tLoss: 42353.16406\tPPL: 4.96345\tbleu: 25.95557\tLR: 0.00030000\t*\n","Steps: 65000\tLoss: 42330.46094\tPPL: 4.95919\tbleu: 25.53954\tLR: 0.00030000\t*\n","Steps: 66000\tLoss: 42035.45703\tPPL: 4.90416\tbleu: 25.58189\tLR: 0.00030000\t*\n","Steps: 67000\tLoss: 42130.27734\tPPL: 4.92178\tbleu: 25.84658\tLR: 0.00030000\t\n","Steps: 68000\tLoss: 42154.22656\tPPL: 4.92624\tbleu: 26.37654\tLR: 0.00030000\t\n","Steps: 69000\tLoss: 41889.39844\tPPL: 4.87714\tbleu: 26.27554\tLR: 0.00030000\t*\n","Steps: 70000\tLoss: 41850.42578\tPPL: 4.86996\tbleu: 26.00508\tLR: 0.00030000\t*\n","Steps: 71000\tLoss: 41709.23828\tPPL: 4.84402\tbleu: 26.03188\tLR: 0.00030000\t*\n","Steps: 72000\tLoss: 41678.94922\tPPL: 4.83847\tbleu: 26.44786\tLR: 0.00030000\t*\n","Steps: 73000\tLoss: 41674.26953\tPPL: 4.83761\tbleu: 26.30641\tLR: 0.00030000\t*\n","Steps: 74000\tLoss: 41626.07812\tPPL: 4.82880\tbleu: 26.05812\tLR: 0.00030000\t*\n","Steps: 75000\tLoss: 41343.68750\tPPL: 4.77749\tbleu: 26.66109\tLR: 0.00030000\t*\n","Steps: 76000\tLoss: 41534.37109\tPPL: 4.81208\tbleu: 26.23050\tLR: 0.00030000\t\n","Steps: 77000\tLoss: 41426.35938\tPPL: 4.79246\tbleu: 26.69887\tLR: 0.00030000\t\n","Steps: 78000\tLoss: 41517.64453\tPPL: 4.80904\tbleu: 26.55968\tLR: 0.00030000\t\n","Steps: 79000\tLoss: 41268.49219\tPPL: 4.76392\tbleu: 26.62992\tLR: 0.00030000\t*\n","Steps: 80000\tLoss: 41280.38281\tPPL: 4.76607\tbleu: 26.96569\tLR: 0.00030000\t\n","Steps: 81000\tLoss: 41320.26172\tPPL: 4.77326\tbleu: 26.44191\tLR: 0.00030000\t\n","Steps: 82000\tLoss: 41146.32422\tPPL: 4.74196\tbleu: 26.93031\tLR: 0.00030000\t*\n","Steps: 83000\tLoss: 41016.72656\tPPL: 4.71877\tbleu: 27.15384\tLR: 0.00030000\t*\n","Steps: 84000\tLoss: 41055.05469\tPPL: 4.72562\tbleu: 26.80484\tLR: 0.00030000\t\n","Steps: 85000\tLoss: 40960.78516\tPPL: 4.70880\tbleu: 27.22547\tLR: 0.00030000\t*\n","Steps: 86000\tLoss: 40844.44531\tPPL: 4.68812\tbleu: 26.64659\tLR: 0.00030000\t*\n","Steps: 87000\tLoss: 40887.74609\tPPL: 4.69580\tbleu: 27.03646\tLR: 0.00030000\t\n","Steps: 88000\tLoss: 40820.63672\tPPL: 4.68390\tbleu: 26.74422\tLR: 0.00030000\t*\n","Steps: 89000\tLoss: 40767.55859\tPPL: 4.67450\tbleu: 26.72004\tLR: 0.00030000\t*\n","Steps: 90000\tLoss: 40813.35547\tPPL: 4.68261\tbleu: 26.72847\tLR: 0.00030000\t\n","Steps: 91000\tLoss: 40692.90234\tPPL: 4.66132\tbleu: 26.49499\tLR: 0.00030000\t*\n","Steps: 92000\tLoss: 40595.41016\tPPL: 4.64416\tbleu: 27.17610\tLR: 0.00030000\t*\n","Steps: 93000\tLoss: 40498.67188\tPPL: 4.62720\tbleu: 26.91161\tLR: 0.00030000\t*\n","Steps: 94000\tLoss: 40470.02344\tPPL: 4.62219\tbleu: 27.54934\tLR: 0.00030000\t*\n","Steps: 95000\tLoss: 40204.17578\tPPL: 4.57594\tbleu: 27.26871\tLR: 0.00030000\t*\n","Steps: 96000\tLoss: 40466.09766\tPPL: 4.62150\tbleu: 27.33716\tLR: 0.00030000\t\n","Steps: 97000\tLoss: 40309.43750\tPPL: 4.59419\tbleu: 26.95324\tLR: 0.00030000\t\n","Steps: 98000\tLoss: 40214.08594\tPPL: 4.57765\tbleu: 27.27039\tLR: 0.00030000\t\n","Steps: 99000\tLoss: 40220.38281\tPPL: 4.57874\tbleu: 27.16213\tLR: 0.00030000\t\n","Steps: 100000\tLoss: 40407.34766\tPPL: 4.61124\tbleu: 27.08808\tLR: 0.00030000\t\n","Steps: 101000\tLoss: 40170.73828\tPPL: 4.57015\tbleu: 27.57661\tLR: 0.00030000\t*\n","Steps: 102000\tLoss: 39969.62109\tPPL: 4.53552\tbleu: 27.26296\tLR: 0.00030000\t*\n","Steps: 103000\tLoss: 39943.88672\tPPL: 4.53110\tbleu: 27.57128\tLR: 0.00030000\t*\n","Steps: 104000\tLoss: 39999.43750\tPPL: 4.54063\tbleu: 27.73437\tLR: 0.00030000\t\n","Steps: 105000\tLoss: 39984.07422\tPPL: 4.53800\tbleu: 27.80008\tLR: 0.00030000\t\n","Steps: 106000\tLoss: 39857.99609\tPPL: 4.51641\tbleu: 27.58880\tLR: 0.00030000\t*\n","Steps: 107000\tLoss: 39776.58594\tPPL: 4.50252\tbleu: 27.44173\tLR: 0.00030000\t*\n","Steps: 108000\tLoss: 39722.57812\tPPL: 4.49333\tbleu: 27.54758\tLR: 0.00030000\t*\n","Steps: 109000\tLoss: 39863.85938\tPPL: 4.51741\tbleu: 27.89135\tLR: 0.00030000\t\n","Steps: 110000\tLoss: 39727.18359\tPPL: 4.49411\tbleu: 27.57073\tLR: 0.00030000\t\n","Steps: 111000\tLoss: 39679.64453\tPPL: 4.48604\tbleu: 27.83125\tLR: 0.00030000\t*\n","Steps: 112000\tLoss: 39545.80859\tPPL: 4.46338\tbleu: 27.84191\tLR: 0.00030000\t*\n","Steps: 113000\tLoss: 39665.88281\tPPL: 4.48370\tbleu: 27.85594\tLR: 0.00030000\t\n","Steps: 114000\tLoss: 39423.54688\tPPL: 4.44279\tbleu: 27.95347\tLR: 0.00030000\t*\n","Steps: 115000\tLoss: 39439.51172\tPPL: 4.44547\tbleu: 27.93730\tLR: 0.00030000\t\n","Steps: 116000\tLoss: 39461.19922\tPPL: 4.44912\tbleu: 28.23924\tLR: 0.00030000\t\n","Steps: 117000\tLoss: 39426.83203\tPPL: 4.44334\tbleu: 28.55447\tLR: 0.00030000\t\n","Steps: 118000\tLoss: 39500.12500\tPPL: 4.45568\tbleu: 28.08246\tLR: 0.00030000\t\n","Steps: 119000\tLoss: 39432.98438\tPPL: 4.44438\tbleu: 28.03362\tLR: 0.00030000\t\n","Steps: 120000\tLoss: 39235.50391\tPPL: 4.41130\tbleu: 27.92296\tLR: 0.00030000\t*\n","Steps: 121000\tLoss: 39249.70312\tPPL: 4.41367\tbleu: 28.12895\tLR: 0.00030000\t\n","Steps: 122000\tLoss: 39545.42188\tPPL: 4.46332\tbleu: 27.44171\tLR: 0.00030000\t\n","Steps: 123000\tLoss: 39366.34375\tPPL: 4.43319\tbleu: 28.38928\tLR: 0.00030000\t\n","Steps: 124000\tLoss: 39260.67969\tPPL: 4.41550\tbleu: 27.85191\tLR: 0.00030000\t\n","Steps: 125000\tLoss: 39296.58984\tPPL: 4.42150\tbleu: 28.25766\tLR: 0.00030000\t\n","Steps: 126000\tLoss: 39071.32422\tPPL: 4.38399\tbleu: 27.99353\tLR: 0.00030000\t*\n","Steps: 127000\tLoss: 39090.17578\tPPL: 4.38712\tbleu: 28.13892\tLR: 0.00030000\t\n","Steps: 128000\tLoss: 39310.87109\tPPL: 4.42389\tbleu: 28.28530\tLR: 0.00030000\t\n","Steps: 129000\tLoss: 39037.03516\tPPL: 4.37831\tbleu: 28.17923\tLR: 0.00030000\t*\n","Steps: 130000\tLoss: 39034.68750\tPPL: 4.37792\tbleu: 27.83480\tLR: 0.00030000\t*\n","Steps: 131000\tLoss: 38922.85938\tPPL: 4.35944\tbleu: 28.11597\tLR: 0.00030000\t*\n","Steps: 132000\tLoss: 39091.46094\tPPL: 4.38733\tbleu: 28.38958\tLR: 0.00030000\t\n","Steps: 133000\tLoss: 38773.98828\tPPL: 4.33496\tbleu: 28.55294\tLR: 0.00030000\t*\n","Steps: 134000\tLoss: 38901.68750\tPPL: 4.35595\tbleu: 28.31536\tLR: 0.00030000\t\n","Steps: 135000\tLoss: 39047.96484\tPPL: 4.38012\tbleu: 28.17555\tLR: 0.00030000\t\n","Steps: 136000\tLoss: 38899.51172\tPPL: 4.35559\tbleu: 28.25831\tLR: 0.00030000\t\n","Steps: 137000\tLoss: 38947.98047\tPPL: 4.36358\tbleu: 28.54352\tLR: 0.00030000\t\n","Steps: 138000\tLoss: 39057.56250\tPPL: 4.38171\tbleu: 28.54284\tLR: 0.00030000\t\n","Steps: 139000\tLoss: 38880.68359\tPPL: 4.35249\tbleu: 28.47631\tLR: 0.00021000\t\n","Steps: 140000\tLoss: 38595.65234\tPPL: 4.30581\tbleu: 28.64533\tLR: 0.00021000\t*\n","Steps: 141000\tLoss: 38571.00781\tPPL: 4.30180\tbleu: 29.08379\tLR: 0.00021000\t*\n","Steps: 142000\tLoss: 38395.87109\tPPL: 4.27339\tbleu: 28.59285\tLR: 0.00021000\t*\n","Steps: 143000\tLoss: 38399.62891\tPPL: 4.27400\tbleu: 28.56664\tLR: 0.00021000\t\n","Steps: 144000\tLoss: 38419.46484\tPPL: 4.27721\tbleu: 28.42608\tLR: 0.00021000\t\n","Steps: 145000\tLoss: 38447.74609\tPPL: 4.28179\tbleu: 28.98545\tLR: 0.00021000\t\n","Steps: 146000\tLoss: 38309.48047\tPPL: 4.25945\tbleu: 28.65318\tLR: 0.00021000\t*\n","Steps: 147000\tLoss: 38190.56250\tPPL: 4.24033\tbleu: 28.92299\tLR: 0.00021000\t*\n","Steps: 148000\tLoss: 38353.00000\tPPL: 4.26647\tbleu: 28.80297\tLR: 0.00021000\t\n","Steps: 149000\tLoss: 38206.91406\tPPL: 4.24296\tbleu: 28.83223\tLR: 0.00021000\t\n","Steps: 150000\tLoss: 38072.38281\tPPL: 4.22142\tbleu: 28.74643\tLR: 0.00021000\t*\n","Steps: 151000\tLoss: 38127.95703\tPPL: 4.23031\tbleu: 28.96503\tLR: 0.00021000\t\n","time: 3.32 s\n"],"name":"stdout"}]},{"cell_type":"code","metadata":{"colab_type":"code","id":"66WhRE9lIhoD","colab":{"base_uri":"https://localhost:8080/","height":122},"outputId":"aa54d51f-717e-4d1c-ea6f-d0e1deac5392","executionInfo":{"status":"ok","timestamp":1590109264558,"user_tz":0,"elapsed":66889,"user":{"displayName":"Salomey Osei","photoUrl":"","userId":"06221058988152607684"}}},"source":["# Test our model\n","! cd joeynmt; python3 -m joeynmt test \"$gdrive_path/models/${src}${tgt}_transformer/config.yaml\""],"execution_count":31,"outputs":[{"output_type":"stream","text":["2020-05-22 01:00:00,491 Hello! This is Joey-NMT.\n","/pytorch/aten/src/ATen/native/BinaryOps.cpp:81: UserWarning: Integer division of tensors using div or / is deprecated, and in a future release div will perform true division as in Python 3. Use true_divide or floor_divide (// in Python) instead.\n","2020-05-22 01:00:30,322  dev bleu:  29.72 [Beam search decoding with beam size = 5 and alpha = 1.0]\n","2020-05-22 01:01:02,207 test bleu:  34.57 [Beam search decoding with beam size = 5 and alpha = 1.0]\n","time: 1min 5s\n"],"name":"stdout"}]},{"cell_type":"code","metadata":{"id":"cXS9dLQLdOY-","colab_type":"code","colab":{}},"source":[""],"execution_count":0,"outputs":[]}]}