File size: 11,474 Bytes
78aa4ee |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 |
Steps: 1000 Loss: 109860.85938 PPL: 63.79848 bleu: 1.16087 LR: 0.00030000 * Steps: 2000 Loss: 95330.92188 PPL: 36.82225 bleu: 2.88280 LR: 0.00030000 * Steps: 3000 Loss: 86224.48438 PPL: 26.09207 bleu: 4.41620 LR: 0.00030000 * Steps: 4000 Loss: 80323.14062 PPL: 20.87182 bleu: 5.56210 LR: 0.00030000 * Steps: 5000 Loss: 75845.74219 PPL: 17.61996 bleu: 7.05899 LR: 0.00030000 * Steps: 6000 Loss: 72087.57031 PPL: 15.28499 bleu: 8.73496 LR: 0.00030000 * Steps: 7000 Loss: 68820.29688 PPL: 13.50797 bleu: 10.11460 LR: 0.00030000 * Steps: 8000 Loss: 66377.24219 PPL: 12.31558 bleu: 11.49296 LR: 0.00030000 * Steps: 9000 Loss: 64206.80469 PPL: 11.34485 bleu: 12.07445 LR: 0.00030000 * Steps: 10000 Loss: 62063.46094 PPL: 10.46135 bleu: 12.97361 LR: 0.00030000 * Steps: 11000 Loss: 60652.78906 PPL: 9.91775 bleu: 13.71834 LR: 0.00030000 * Steps: 12000 Loss: 59153.05859 PPL: 9.37077 bleu: 14.68732 LR: 0.00030000 * Steps: 13000 Loss: 58085.83984 PPL: 9.00000 bleu: 15.08894 LR: 0.00030000 * Steps: 14000 Loss: 56943.12500 PPL: 8.61926 bleu: 15.92625 LR: 0.00030000 * Steps: 15000 Loss: 55890.43359 PPL: 8.28278 bleu: 16.43676 LR: 0.00030000 * Steps: 16000 Loss: 54738.51172 PPL: 7.92962 bleu: 17.31161 LR: 0.00030000 * Steps: 17000 Loss: 54238.69922 PPL: 7.78111 bleu: 17.58451 LR: 0.00030000 * Steps: 18000 Loss: 53437.94531 PPL: 7.54895 bleu: 18.23502 LR: 0.00030000 * Steps: 19000 Loss: 52919.95703 PPL: 7.40247 bleu: 18.16734 LR: 0.00030000 * Steps: 20000 Loss: 52087.83594 PPL: 7.17310 bleu: 18.97346 LR: 0.00030000 * Steps: 21000 Loss: 51602.27344 PPL: 7.04255 bleu: 19.49282 LR: 0.00030000 * Steps: 22000 Loss: 51046.27344 PPL: 6.89597 bleu: 20.18313 LR: 0.00030000 * Steps: 23000 Loss: 50586.93750 PPL: 6.77719 bleu: 20.31719 LR: 0.00030000 * Steps: 24000 Loss: 50214.29297 PPL: 6.68233 bleu: 20.12025 LR: 0.00030000 * Steps: 25000 Loss: 49788.15234 PPL: 6.57547 bleu: 21.20197 LR: 0.00030000 * Steps: 26000 Loss: 49435.96094 PPL: 6.48845 bleu: 20.61039 LR: 0.00030000 * Steps: 27000 Loss: 49078.21875 PPL: 6.40124 bleu: 21.55727 LR: 0.00030000 * Steps: 28000 Loss: 48415.01172 PPL: 6.24265 bleu: 22.01150 LR: 0.00030000 * Steps: 29000 Loss: 48288.69922 PPL: 6.21289 bleu: 22.07347 LR: 0.00030000 * Steps: 30000 Loss: 47960.46875 PPL: 6.13623 bleu: 22.14050 LR: 0.00030000 * Steps: 31000 Loss: 47794.85547 PPL: 6.09791 bleu: 22.25916 LR: 0.00030000 * Steps: 32000 Loss: 47344.05078 PPL: 5.99480 bleu: 22.56217 LR: 0.00030000 * Steps: 33000 Loss: 47036.36719 PPL: 5.92544 bleu: 22.80059 LR: 0.00030000 * Steps: 34000 Loss: 46815.85547 PPL: 5.87622 bleu: 22.91385 LR: 0.00030000 * Steps: 35000 Loss: 46446.91406 PPL: 5.79478 bleu: 23.03060 LR: 0.00030000 * Steps: 36000 Loss: 46170.69141 PPL: 5.73454 bleu: 23.28469 LR: 0.00030000 * Steps: 37000 Loss: 46064.51172 PPL: 5.71156 bleu: 23.30764 LR: 0.00030000 * Steps: 38000 Loss: 45972.44922 PPL: 5.69170 bleu: 23.45203 LR: 0.00030000 * Steps: 39000 Loss: 45646.36719 PPL: 5.62193 bleu: 23.19590 LR: 0.00030000 * Steps: 40000 Loss: 45530.07422 PPL: 5.59725 bleu: 23.83184 LR: 0.00030000 * Steps: 41000 Loss: 45320.12891 PPL: 5.55297 bleu: 24.05443 LR: 0.00030000 * Steps: 42000 Loss: 45291.03125 PPL: 5.54687 bleu: 23.95032 LR: 0.00030000 * Steps: 43000 Loss: 45072.32422 PPL: 5.50117 bleu: 24.01709 LR: 0.00030000 * Steps: 44000 Loss: 44780.23828 PPL: 5.44072 bleu: 24.07221 LR: 0.00030000 * Steps: 45000 Loss: 44677.62109 PPL: 5.41964 bleu: 24.25126 LR: 0.00030000 * Steps: 46000 Loss: 44496.13672 PPL: 5.38256 bleu: 24.59385 LR: 0.00030000 * Steps: 47000 Loss: 44567.11719 PPL: 5.39703 bleu: 24.31773 LR: 0.00030000 Steps: 48000 Loss: 44194.85156 PPL: 5.32157 bleu: 24.60332 LR: 0.00030000 * Steps: 49000 Loss: 44017.55469 PPL: 5.28600 bleu: 24.87387 LR: 0.00030000 * Steps: 50000 Loss: 43836.61328 PPL: 5.24994 bleu: 24.86829 LR: 0.00030000 * Steps: 51000 Loss: 43881.33984 PPL: 5.25883 bleu: 24.98661 LR: 0.00030000 Steps: 52000 Loss: 43733.86328 PPL: 5.22957 bleu: 24.51259 LR: 0.00030000 * Steps: 53000 Loss: 43552.92578 PPL: 5.19390 bleu: 24.67414 LR: 0.00030000 * Steps: 54000 Loss: 43563.52734 PPL: 5.19599 bleu: 24.76077 LR: 0.00030000 Steps: 55000 Loss: 43322.52734 PPL: 5.14883 bleu: 25.24733 LR: 0.00030000 * Steps: 56000 Loss: 43293.60156 PPL: 5.14320 bleu: 24.94730 LR: 0.00030000 * Steps: 57000 Loss: 43352.19141 PPL: 5.15461 bleu: 25.27352 LR: 0.00030000 Steps: 58000 Loss: 43042.32812 PPL: 5.09455 bleu: 25.23045 LR: 0.00030000 * Steps: 59000 Loss: 43045.07031 PPL: 5.09508 bleu: 25.49793 LR: 0.00030000 Steps: 60000 Loss: 42705.03516 PPL: 5.02996 bleu: 25.59941 LR: 0.00030000 * Steps: 61000 Loss: 42700.70312 PPL: 5.02914 bleu: 25.75874 LR: 0.00030000 * Steps: 62000 Loss: 42574.29297 PPL: 5.00515 bleu: 25.87328 LR: 0.00030000 * Steps: 63000 Loss: 42475.92969 PPL: 4.98656 bleu: 25.95982 LR: 0.00030000 * Steps: 64000 Loss: 42353.16406 PPL: 4.96345 bleu: 25.95557 LR: 0.00030000 * Steps: 65000 Loss: 42330.46094 PPL: 4.95919 bleu: 25.53954 LR: 0.00030000 * Steps: 66000 Loss: 42035.45703 PPL: 4.90416 bleu: 25.58189 LR: 0.00030000 * Steps: 67000 Loss: 42130.27734 PPL: 4.92178 bleu: 25.84658 LR: 0.00030000 Steps: 68000 Loss: 42154.22656 PPL: 4.92624 bleu: 26.37654 LR: 0.00030000 Steps: 69000 Loss: 41889.39844 PPL: 4.87714 bleu: 26.27554 LR: 0.00030000 * Steps: 70000 Loss: 41850.42578 PPL: 4.86996 bleu: 26.00508 LR: 0.00030000 * Steps: 71000 Loss: 41709.23828 PPL: 4.84402 bleu: 26.03188 LR: 0.00030000 * Steps: 72000 Loss: 41678.94922 PPL: 4.83847 bleu: 26.44786 LR: 0.00030000 * Steps: 73000 Loss: 41674.26953 PPL: 4.83761 bleu: 26.30641 LR: 0.00030000 * Steps: 74000 Loss: 41626.07812 PPL: 4.82880 bleu: 26.05812 LR: 0.00030000 * Steps: 75000 Loss: 41343.68750 PPL: 4.77749 bleu: 26.66109 LR: 0.00030000 * Steps: 76000 Loss: 41534.37109 PPL: 4.81208 bleu: 26.23050 LR: 0.00030000 Steps: 77000 Loss: 41426.35938 PPL: 4.79246 bleu: 26.69887 LR: 0.00030000 Steps: 78000 Loss: 41517.64453 PPL: 4.80904 bleu: 26.55968 LR: 0.00030000 Steps: 79000 Loss: 41268.49219 PPL: 4.76392 bleu: 26.62992 LR: 0.00030000 * Steps: 80000 Loss: 41280.38281 PPL: 4.76607 bleu: 26.96569 LR: 0.00030000 Steps: 81000 Loss: 41320.26172 PPL: 4.77326 bleu: 26.44191 LR: 0.00030000 Steps: 82000 Loss: 41146.32422 PPL: 4.74196 bleu: 26.93031 LR: 0.00030000 * Steps: 83000 Loss: 41016.72656 PPL: 4.71877 bleu: 27.15384 LR: 0.00030000 * Steps: 84000 Loss: 41055.05469 PPL: 4.72562 bleu: 26.80484 LR: 0.00030000 Steps: 85000 Loss: 40960.78516 PPL: 4.70880 bleu: 27.22547 LR: 0.00030000 * Steps: 86000 Loss: 40844.44531 PPL: 4.68812 bleu: 26.64659 LR: 0.00030000 * Steps: 87000 Loss: 40887.74609 PPL: 4.69580 bleu: 27.03646 LR: 0.00030000 Steps: 88000 Loss: 40820.63672 PPL: 4.68390 bleu: 26.74422 LR: 0.00030000 * Steps: 89000 Loss: 40767.55859 PPL: 4.67450 bleu: 26.72004 LR: 0.00030000 * Steps: 90000 Loss: 40813.35547 PPL: 4.68261 bleu: 26.72847 LR: 0.00030000 Steps: 91000 Loss: 40692.90234 PPL: 4.66132 bleu: 26.49499 LR: 0.00030000 * Steps: 92000 Loss: 40595.41016 PPL: 4.64416 bleu: 27.17610 LR: 0.00030000 * Steps: 93000 Loss: 40498.67188 PPL: 4.62720 bleu: 26.91161 LR: 0.00030000 * Steps: 94000 Loss: 40470.02344 PPL: 4.62219 bleu: 27.54934 LR: 0.00030000 * Steps: 95000 Loss: 40204.17578 PPL: 4.57594 bleu: 27.26871 LR: 0.00030000 * Steps: 96000 Loss: 40466.09766 PPL: 4.62150 bleu: 27.33716 LR: 0.00030000 Steps: 97000 Loss: 40309.43750 PPL: 4.59419 bleu: 26.95324 LR: 0.00030000 Steps: 98000 Loss: 40214.08594 PPL: 4.57765 bleu: 27.27039 LR: 0.00030000 Steps: 99000 Loss: 40220.38281 PPL: 4.57874 bleu: 27.16213 LR: 0.00030000 Steps: 100000 Loss: 40407.34766 PPL: 4.61124 bleu: 27.08808 LR: 0.00030000 Steps: 101000 Loss: 40170.73828 PPL: 4.57015 bleu: 27.57661 LR: 0.00030000 * Steps: 102000 Loss: 39969.62109 PPL: 4.53552 bleu: 27.26296 LR: 0.00030000 * Steps: 103000 Loss: 39943.88672 PPL: 4.53110 bleu: 27.57128 LR: 0.00030000 * Steps: 104000 Loss: 39999.43750 PPL: 4.54063 bleu: 27.73437 LR: 0.00030000 Steps: 105000 Loss: 39984.07422 PPL: 4.53800 bleu: 27.80008 LR: 0.00030000 Steps: 106000 Loss: 39857.99609 PPL: 4.51641 bleu: 27.58880 LR: 0.00030000 * Steps: 107000 Loss: 39776.58594 PPL: 4.50252 bleu: 27.44173 LR: 0.00030000 * Steps: 108000 Loss: 39722.57812 PPL: 4.49333 bleu: 27.54758 LR: 0.00030000 * Steps: 109000 Loss: 39863.85938 PPL: 4.51741 bleu: 27.89135 LR: 0.00030000 Steps: 110000 Loss: 39727.18359 PPL: 4.49411 bleu: 27.57073 LR: 0.00030000 Steps: 111000 Loss: 39679.64453 PPL: 4.48604 bleu: 27.83125 LR: 0.00030000 * Steps: 112000 Loss: 39545.80859 PPL: 4.46338 bleu: 27.84191 LR: 0.00030000 * Steps: 113000 Loss: 39665.88281 PPL: 4.48370 bleu: 27.85594 LR: 0.00030000 Steps: 114000 Loss: 39423.54688 PPL: 4.44279 bleu: 27.95347 LR: 0.00030000 * Steps: 115000 Loss: 39439.51172 PPL: 4.44547 bleu: 27.93730 LR: 0.00030000 Steps: 116000 Loss: 39461.19922 PPL: 4.44912 bleu: 28.23924 LR: 0.00030000 Steps: 117000 Loss: 39426.83203 PPL: 4.44334 bleu: 28.55447 LR: 0.00030000 Steps: 118000 Loss: 39500.12500 PPL: 4.45568 bleu: 28.08246 LR: 0.00030000 Steps: 119000 Loss: 39432.98438 PPL: 4.44438 bleu: 28.03362 LR: 0.00030000 Steps: 120000 Loss: 39235.50391 PPL: 4.41130 bleu: 27.92296 LR: 0.00030000 * Steps: 121000 Loss: 39249.70312 PPL: 4.41367 bleu: 28.12895 LR: 0.00030000 Steps: 122000 Loss: 39545.42188 PPL: 4.46332 bleu: 27.44171 LR: 0.00030000 Steps: 123000 Loss: 39366.34375 PPL: 4.43319 bleu: 28.38928 LR: 0.00030000 Steps: 124000 Loss: 39260.67969 PPL: 4.41550 bleu: 27.85191 LR: 0.00030000 Steps: 125000 Loss: 39296.58984 PPL: 4.42150 bleu: 28.25766 LR: 0.00030000 Steps: 126000 Loss: 39071.32422 PPL: 4.38399 bleu: 27.99353 LR: 0.00030000 * Steps: 127000 Loss: 39090.17578 PPL: 4.38712 bleu: 28.13892 LR: 0.00030000 Steps: 128000 Loss: 39310.87109 PPL: 4.42389 bleu: 28.28530 LR: 0.00030000 Steps: 129000 Loss: 39037.03516 PPL: 4.37831 bleu: 28.17923 LR: 0.00030000 * Steps: 130000 Loss: 39034.68750 PPL: 4.37792 bleu: 27.83480 LR: 0.00030000 * Steps: 131000 Loss: 38922.85938 PPL: 4.35944 bleu: 28.11597 LR: 0.00030000 * Steps: 132000 Loss: 39091.46094 PPL: 4.38733 bleu: 28.38958 LR: 0.00030000 Steps: 133000 Loss: 38773.98828 PPL: 4.33496 bleu: 28.55294 LR: 0.00030000 * Steps: 134000 Loss: 38901.68750 PPL: 4.35595 bleu: 28.31536 LR: 0.00030000 Steps: 135000 Loss: 39047.96484 PPL: 4.38012 bleu: 28.17555 LR: 0.00030000 Steps: 136000 Loss: 38899.51172 PPL: 4.35559 bleu: 28.25831 LR: 0.00030000 Steps: 137000 Loss: 38947.98047 PPL: 4.36358 bleu: 28.54352 LR: 0.00030000 Steps: 138000 Loss: 39057.56250 PPL: 4.38171 bleu: 28.54284 LR: 0.00030000 Steps: 139000 Loss: 38880.68359 PPL: 4.35249 bleu: 28.47631 LR: 0.00021000 Steps: 140000 Loss: 38595.65234 PPL: 4.30581 bleu: 28.64533 LR: 0.00021000 * Steps: 141000 Loss: 38571.00781 PPL: 4.30180 bleu: 29.08379 LR: 0.00021000 * Steps: 142000 Loss: 38395.87109 PPL: 4.27339 bleu: 28.59285 LR: 0.00021000 * Steps: 143000 Loss: 38399.62891 PPL: 4.27400 bleu: 28.56664 LR: 0.00021000 Steps: 144000 Loss: 38419.46484 PPL: 4.27721 bleu: 28.42608 LR: 0.00021000 Steps: 145000 Loss: 38447.74609 PPL: 4.28179 bleu: 28.98545 LR: 0.00021000 Steps: 146000 Loss: 38309.48047 PPL: 4.25945 bleu: 28.65318 LR: 0.00021000 * Steps: 147000 Loss: 38190.56250 PPL: 4.24033 bleu: 28.92299 LR: 0.00021000 * Steps: 148000 Loss: 38353.00000 PPL: 4.26647 bleu: 28.80297 LR: 0.00021000 Steps: 149000 Loss: 38206.91406 PPL: 4.24296 bleu: 28.83223 LR: 0.00021000 Steps: 150000 Loss: 38072.38281 PPL: 4.22142 bleu: 28.74643 LR: 0.00021000 * Steps: 151000 Loss: 38127.95703 PPL: 4.23031 bleu: 28.96503 LR: 0.00021000 |