ARG=i ARG=d ARG=v ARG=o ARG=p INITIAL PASS .................................................. [50000] .................................................. [100000] .................................................. [150000] .................................................. [200000] .................................................. [250000] .................................................. [300000] .................................................. [350000] .................................................. [400000] .................................................. [450000] .................................................. [500000] .................................................. [550000] .................................................. [600000] .................................................. [650000] .................................................. [700000] .................................................. [750000] .................................................. [800000] .................................................. [850000] .................................................. [900000] .................................................. [950000] .................................................. [1000000] .................................................. [1050000] .................................................. [1100000] .................................................. [1150000] .................................................. [1200000] .................................................. [1250000] .................................................. [1300000] .................................................. [1350000] .................................................. [1400000] .................................................. [1450000] .................................................. [1500000] .................................................. [1550000] .................................................. [1600000] .................................................. [1650000] .................................................. [1700000] .................................................. [1750000] .................................................. [1800000] .................................................. [1850000] .................................................. [1900000] .................................................. [1950000] .................................................. [2000000] .................................................. [2050000] .................................................. [2100000] .................................................. [2150000] .................................................. [2200000] .................................................. [2250000] .................................................. [2300000] .................................................. [2350000] .................................................. [2400000] .................................................. [2450000] .................................................. [2500000] .................................................. [2550000] .................................................. [2600000] .................................................. [2650000] .................................................. [2700000] .................................................. [2750000] .................................................. [2800000] .................................................. [2850000] .................................................. [2900000] .................................................. [2950000] .................................................. [3000000] .................................................. [3050000] .................................................. [3100000] .................................................. [3150000] .................................................. [3200000] .................................................. [3250000] .................................................. [3300000] .................................................. [3350000] .................................................. [3400000] .................................................. [3450000] .................................................. [3500000] .................................................. [3550000] .................................................. [3600000] .................................................. [3650000] .................................................. [3700000] .................................................. [3750000] .................................................. [3800000] .................................................. [3850000] .................................................. [3900000] .................................................. [3950000] .................................................. [4000000] .................................................. [4050000] .................................................. [4100000] .................................................. [4150000] .................................................. [4200000] .................................................. [4250000] .................................................. [4300000] .................................................. [4350000] .................................................. [4400000] .................................................. [4450000] .................................................. [4500000] .................................................. [4550000] .................................................. [4600000] .................................................. [4650000] .................................................. [4700000] .................................................. [4750000] .................................................. [4800000] .................................................. [4850000] .................................................. [4900000] .................................................. [4950000] .................................................. [5000000] .................................................. [5050000] .................................................. [5100000] .................................................. [5150000] .................................................. [5200000] .................................................. [5250000] .................................................. [5300000] .................................................. [5350000] .................................................. [5400000] .................................................. [5450000] .................................................. [5500000] .................................................. [5550000] .................................................. [5600000] .................................................. [5650000] .................................................. [5700000] .................................................. [5750000] .................................................. [5800000] .................................................. [5850000] .................................................. [5900000] .................................................. [5950000] .................................................. [6000000] .................................................. [6050000] .................................................. [6100000] .................................................. [6150000] .................................................. [6200000] .................................................. [6250000] .................................................. [6300000] .................................................. [6350000] .................................................. [6400000] .................................................. [6450000] .................................................. [6500000] .................................................. [6550000] .................................................. [6600000] .................................................. [6650000] .................................................. [6700000] .................................................. [6750000] .................................................. [6800000] .................................................. [6850000] .................................................. [6900000] .................................................. [6950000] .................................................. [7000000] .................................................. [7050000] .................................................. [7100000] .................................................. [7150000] .................................................. [7200000] .................................................. [7250000] .................................................. [7300000] .................................................. [7350000] .................................................. [7400000] .................................................. [7450000] .................................................. [7500000] .................................................. [7550000] .................................................. [7600000] .................................................. [7650000] .................................................. [7700000] .................................................. [7750000] .................................................. [7800000] .................................................. [7850000] .................................................. [7900000] .................................................. [7950000] .................................................. [8000000] .................................................. [8050000] .................................................. [8100000] .................................................. [8150000] .................................................. [8200000] .................................................. [8250000] .................................................. [8300000] .................................................. [8350000] .................................................. [8400000] .................................................. [8450000] .................................................. [8500000] .................................................. [8550000] .................................................. [8600000] .................................................. [8650000] .................................................. [8700000] .................................................. [8750000] .................................................. [8800000] .................................................. [8850000] .................................................. [8900000] .................................................. [8950000] .................................................. [9000000] .................................................. [9050000] .................................................. [9100000] .................................................. [9150000] .................................................. [9200000] .................................................. [9250000] .................................................. [9300000] .................................................. [9350000] .................................................. [9400000] .................................................. [9450000] .................................................. [9500000] .................................................. [9550000] .................................................. [9600000] .................................................. [9650000] .................................................. [9700000] .................................................. [9750000] .................................................. [9800000] .................................................. [9850000] .................................................. [9900000] .................................................. [9950000] .................................................. [10000000] .................................................. [10050000] .................................................. [10100000] .................................................. [10150000] .................................................. [10200000] .................................................. [10250000] .................................................. [10300000] .................................................. [10350000] .................................................. [10400000] .................................................. [10450000] .................................................. [10500000] .................................................. [10550000] .................................................. [10600000] .................................................. [10650000] .................................................. [10700000] .................................................. [10750000] .................................................. [10800000] .................................................. [10850000] .................................................. [10900000] .................................................. [10950000] .................................................. [11000000] .................................................. [11050000] .................................................. [11100000] .................................................. [11150000] .................................................. [11200000] .................................................. [11250000] .................................................. [11300000] .................................................. [11350000] .................................................. [11400000] .................................................. [11450000] .................................................. [11500000] .................................................. [11550000] .................................................. [11600000] .................................................. [11650000] .................................................. [11700000] .................................................. [11750000] .................................................. [11800000] .................................................. [11850000] .................................................. [11900000] .................................................. [11950000] .................................................. [12000000] .................................................. [12050000] .................................................. [12100000] .................................................. [12150000] .................................................. [12200000] .................................................. [12250000] .................................................. [12300000] .................................................. [12350000] .................................................. [12400000] .................................................. [12450000] .................................................. [12500000] .................................................. [12550000] .................................................. [12600000] .................................................. [12650000] .................................................. [12700000] .................................................. [12750000] .................................................. [12800000] .................................................. [12850000] .................................................. [12900000] .................................................. [12950000] .................................................. [13000000] .................................................. [13050000] .................................................. [13100000] .................................................. [13150000] .................................................. [13200000] .................................................. [13250000] .................................................. [13300000] .................................................. [13350000] .................................................. [13400000] .................................................. [13450000] .................................................. [13500000] .................................................. [13550000] .................................................. [13600000] .................................................. [13650000] .................................................. [13700000] .................................................. [13750000] .................................................. [13800000] .................................................. [13850000] .................................................. [13900000] .................................................. [13950000] .................................................. [14000000] .................................................. [14050000] .................................................. [14100000] .................................................. [14150000] .................................................. [14200000] .................................................. [14250000] .................................................. [14300000] .................................................. [14350000] .................................................. [14400000] .................................................. [14450000] .................................................. [14500000] .................................................. [14550000] .................................................. [14600000] .................................................. [14650000] .................................................. [14700000] .................................................. [14750000] .................................................. [14800000] .................................................. [14850000] .................................................. [14900000] .................................................. [14950000] ................. expected target length = source length * 0.954273 ITERATION 1 .................................................. [50000] .................................................. [100000] .................................................. [150000] .................................................. [200000] .................................................. [250000] .................................................. [300000] .................................................. [350000] .................................................. [400000] .................................................. [450000] .................................................. [500000] .................................................. [550000] .................................................. [600000] .................................................. [650000] .................................................. [700000] .................................................. [750000] .................................................. [800000] .................................................. [850000] .................................................. [900000] .................................................. [950000] .................................................. [1000000] .................................................. [1050000] .................................................. [1100000] .................................................. [1150000] .................................................. [1200000] .................................................. [1250000] .................................................. [1300000] .................................................. [1350000] .................................................. [1400000] .................................................. [1450000] .................................................. [1500000] .................................................. [1550000] .................................................. [1600000] .................................................. [1650000] .................................................. [1700000] .................................................. [1750000] .................................................. [1800000] .................................................. [1850000] .................................................. [1900000] .................................................. [1950000] .................................................. [2000000] .................................................. [2050000] .................................................. [2100000] .................................................. [2150000] .................................................. [2200000] .................................................. [2250000] .................................................. [2300000] .................................................. [2350000] .................................................. [2400000] .................................................. [2450000] .................................................. [2500000] .................................................. [2550000] .................................................. [2600000] .................................................. [2650000] .................................................. [2700000] .................................................. [2750000] .................................................. [2800000] .................................................. [2850000] .................................................. [2900000] .................................................. [2950000] .................................................. [3000000] .................................................. [3050000] .................................................. [3100000] .................................................. [3150000] .................................................. [3200000] .................................................. [3250000] .................................................. [3300000] .................................................. [3350000] .................................................. [3400000] .................................................. [3450000] .................................................. [3500000] .................................................. [3550000] .................................................. [3600000] .................................................. [3650000] .................................................. [3700000] .................................................. [3750000] .................................................. [3800000] .................................................. [3850000] .................................................. [3900000] .................................................. [3950000] .................................................. [4000000] .................................................. [4050000] .................................................. [4100000] .................................................. [4150000] .................................................. [4200000] .................................................. [4250000] .................................................. [4300000] .................................................. [4350000] .................................................. [4400000] .................................................. [4450000] .................................................. [4500000] .................................................. [4550000] .................................................. [4600000] .................................................. [4650000] .................................................. [4700000] .................................................. [4750000] .................................................. [4800000] .................................................. [4850000] .................................................. [4900000] .................................................. [4950000] .................................................. [5000000] .................................................. [5050000] .................................................. [5100000] .................................................. [5150000] .................................................. [5200000] .................................................. [5250000] .................................................. [5300000] .................................................. [5350000] .................................................. [5400000] .................................................. [5450000] .................................................. [5500000] .................................................. [5550000] .................................................. [5600000] .................................................. [5650000] .................................................. [5700000] .................................................. [5750000] .................................................. [5800000] .................................................. [5850000] .................................................. [5900000] .................................................. [5950000] .................................................. [6000000] .................................................. [6050000] .................................................. [6100000] .................................................. [6150000] .................................................. [6200000] .................................................. [6250000] .................................................. [6300000] .................................................. [6350000] .................................................. [6400000] .................................................. [6450000] .................................................. [6500000] .................................................. [6550000] .................................................. [6600000] .................................................. [6650000] .................................................. [6700000] .................................................. [6750000] .................................................. [6800000] .................................................. [6850000] .................................................. [6900000] .................................................. [6950000] .................................................. [7000000] .................................................. [7050000] .................................................. [7100000] .................................................. [7150000] .................................................. [7200000] .................................................. [7250000] .................................................. [7300000] .................................................. [7350000] .................................................. [7400000] .................................................. [7450000] .................................................. [7500000] .................................................. [7550000] .................................................. [7600000] .................................................. [7650000] .................................................. [7700000] .................................................. [7750000] .................................................. [7800000] .................................................. [7850000] .................................................. [7900000] .................................................. [7950000] .................................................. [8000000] .................................................. [8050000] .................................................. [8100000] .................................................. [8150000] .................................................. [8200000] .................................................. [8250000] .................................................. [8300000] .................................................. [8350000] .................................................. [8400000] .................................................. [8450000] .................................................. [8500000] .................................................. [8550000] .................................................. [8600000] .................................................. [8650000] .................................................. [8700000] .................................................. [8750000] .................................................. [8800000] .................................................. [8850000] .................................................. [8900000] .................................................. [8950000] .................................................. [9000000] .................................................. [9050000] .................................................. [9100000] .................................................. [9150000] .................................................. [9200000] .................................................. [9250000] .................................................. [9300000] .................................................. [9350000] .................................................. [9400000] .................................................. [9450000] .................................................. [9500000] .................................................. [9550000] .................................................. [9600000] .................................................. [9650000] .................................................. [9700000] .................................................. [9750000] .................................................. [9800000] .................................................. [9850000] .................................................. [9900000] .................................................. [9950000] .................................................. [10000000] .................................................. [10050000] .................................................. [10100000] .................................................. [10150000] .................................................. [10200000] .................................................. [10250000] .................................................. [10300000] .................................................. [10350000] .................................................. [10400000] .................................................. [10450000] .................................................. [10500000] .................................................. [10550000] .................................................. [10600000] .................................................. [10650000] .................................................. [10700000] .................................................. [10750000] .................................................. [10800000] .................................................. [10850000] .................................................. [10900000] .................................................. [10950000] .................................................. [11000000] .................................................. [11050000] .................................................. [11100000] .................................................. [11150000] .................................................. [11200000] .................................................. [11250000] .................................................. [11300000] .................................................. [11350000] .................................................. [11400000] .................................................. [11450000] .................................................. [11500000] .................................................. [11550000] .................................................. [11600000] .................................................. [11650000] .................................................. [11700000] .................................................. [11750000] .................................................. [11800000] .................................................. [11850000] .................................................. [11900000] .................................................. [11950000] .................................................. [12000000] .................................................. [12050000] .................................................. [12100000] .................................................. [12150000] .................................................. [12200000] .................................................. [12250000] .................................................. [12300000] .................................................. [12350000] .................................................. [12400000] .................................................. [12450000] .................................................. [12500000] .................................................. [12550000] .................................................. [12600000] .................................................. [12650000] .................................................. [12700000] .................................................. [12750000] .................................................. [12800000] .................................................. [12850000] .................................................. [12900000] .................................................. [12950000] .................................................. [13000000] .................................................. [13050000] .................................................. [13100000] .................................................. [13150000] .................................................. [13200000] .................................................. [13250000] .................................................. [13300000] .................................................. [13350000] .................................................. [13400000] .................................................. [13450000] .................................................. [13500000] .................................................. [13550000] .................................................. [13600000] .................................................. [13650000] .................................................. [13700000] .................................................. [13750000] .................................................. [13800000] .................................................. [13850000] .................................................. [13900000] .................................................. [13950000] .................................................. [14000000] .................................................. [14050000] .................................................. [14100000] .................................................. [14150000] .................................................. [14200000] .................................................. [14250000] .................................................. [14300000] .................................................. [14350000] .................................................. [14400000] .................................................. [14450000] .................................................. [14500000] .................................................. [14550000] .................................................. [14600000] .................................................. [14650000] .................................................. [14700000] .................................................. [14750000] .................................................. [14800000] .................................................. [14850000] .................................................. [14900000] .................................................. [14950000] ................. log_e likelihood: -6.1851e+09 log_2 likelihood: -8.92321e+09 cross entropy: 29.8974 perplexity: 1e+09 posterior p0: 0.08 posterior al-feat: -0.168775 size counts: 4289 ITERATION 2 .................................................. [50000] .................................................. [100000] .................................................. [150000] .................................................. [200000] .................................................. [250000] .................................................. [300000] .................................................. [350000] .................................................. [400000] .................................................. [450000] .................................................. [500000] .................................................. [550000] .................................................. [600000] .................................................. [650000] .................................................. [700000] .................................................. [750000] .................................................. [800000] .................................................. [850000] .................................................. [900000] .................................................. [950000] .................................................. [1000000] .................................................. [1050000] .................................................. [1100000] .................................................. [1150000] .................................................. [1200000] .................................................. [1250000] .................................................. [1300000] .................................................. [1350000] .................................................. [1400000] .................................................. [1450000] .................................................. [1500000] .................................................. [1550000] .................................................. [1600000] .................................................. [1650000] .................................................. [1700000] .................................................. [1750000] .................................................. [1800000] .................................................. [1850000] .................................................. [1900000] .................................................. [1950000] .................................................. [2000000] .................................................. [2050000] .................................................. [2100000] .................................................. [2150000] .................................................. [2200000] .................................................. [2250000] .................................................. [2300000] .................................................. [2350000] .................................................. [2400000] .................................................. [2450000] .................................................. [2500000] .................................................. [2550000] .................................................. [2600000] .................................................. [2650000] .................................................. [2700000] .................................................. [2750000] .................................................. [2800000] .................................................. [2850000] .................................................. [2900000] .................................................. [2950000] .................................................. [3000000] .................................................. [3050000] .................................................. [3100000] .................................................. [3150000] .................................................. [3200000] .................................................. [3250000] .................................................. [3300000] .................................................. [3350000] .................................................. [3400000] .................................................. [3450000] .................................................. [3500000] .................................................. [3550000] .................................................. [3600000] .................................................. [3650000] .................................................. [3700000] .................................................. [3750000] .................................................. [3800000] .................................................. [3850000] .................................................. [3900000] .................................................. [3950000] .................................................. [4000000] .................................................. [4050000] .................................................. [4100000] .................................................. [4150000] .................................................. [4200000] .................................................. [4250000] .................................................. [4300000] .................................................. [4350000] .................................................. [4400000] .................................................. [4450000] .................................................. [4500000] .................................................. [4550000] .................................................. [4600000] .................................................. [4650000] .................................................. [4700000] .................................................. [4750000] .................................................. [4800000] .................................................. [4850000] .................................................. [4900000] .................................................. [4950000] .................................................. [5000000] .................................................. [5050000] .................................................. [5100000] .................................................. [5150000] .................................................. [5200000] .................................................. [5250000] .................................................. [5300000] .................................................. [5350000] .................................................. [5400000] .................................................. [5450000] .................................................. [5500000] .................................................. [5550000] .................................................. [5600000] .................................................. [5650000] .................................................. [5700000] .................................................. [5750000] .................................................. [5800000] .................................................. [5850000] .................................................. [5900000] .................................................. [5950000] .................................................. [6000000] .................................................. [6050000] .................................................. [6100000] .................................................. [6150000] .................................................. [6200000] .................................................. [6250000] .................................................. [6300000] .................................................. [6350000] .................................................. [6400000] .................................................. [6450000] .................................................. [6500000] .................................................. [6550000] .................................................. [6600000] .................................................. [6650000] .................................................. [6700000] .................................................. [6750000] .................................................. [6800000] .................................................. [6850000] .................................................. [6900000] .................................................. [6950000] .................................................. [7000000] .................................................. [7050000] .................................................. [7100000] .................................................. [7150000] .................................................. [7200000] .................................................. [7250000] .................................................. [7300000] .................................................. [7350000] .................................................. [7400000] .................................................. [7450000] .................................................. [7500000] .................................................. [7550000] .................................................. [7600000] .................................................. [7650000] .................................................. [7700000] .................................................. [7750000] .................................................. [7800000] .................................................. [7850000] .................................................. [7900000] .................................................. [7950000] .................................................. [8000000] .................................................. [8050000] .................................................. [8100000] .................................................. [8150000] .................................................. [8200000] .................................................. [8250000] .................................................. [8300000] .................................................. [8350000] .................................................. [8400000] .................................................. [8450000] .................................................. [8500000] .................................................. [8550000] .................................................. [8600000] .................................................. [8650000] .................................................. [8700000] .................................................. [8750000] .................................................. [8800000] .................................................. [8850000] .................................................. [8900000] .................................................. [8950000] .................................................. [9000000] .................................................. [9050000] .................................................. [9100000] .................................................. [9150000] .................................................. [9200000] .................................................. [9250000] .................................................. [9300000] .................................................. [9350000] .................................................. [9400000] .................................................. [9450000] .................................................. [9500000] .................................................. [9550000] .................................................. [9600000] .................................................. [9650000] .................................................. [9700000] .................................................. [9750000] .................................................. [9800000] .................................................. [9850000] .................................................. [9900000] .................................................. [9950000] .................................................. [10000000] .................................................. [10050000] .................................................. [10100000] .................................................. [10150000] .................................................. [10200000] .................................................. [10250000] .................................................. [10300000] .................................................. [10350000] .................................................. [10400000] .................................................. [10450000] .................................................. [10500000] .................................................. [10550000] .................................................. [10600000] .................................................. [10650000] .................................................. [10700000] .................................................. [10750000] .................................................. [10800000] .................................................. [10850000] .................................................. [10900000] .................................................. [10950000] .................................................. [11000000] .................................................. [11050000] .................................................. [11100000] .................................................. [11150000] .................................................. [11200000] .................................................. [11250000] .................................................. [11300000] .................................................. [11350000] .................................................. [11400000] .................................................. [11450000] .................................................. [11500000] .................................................. [11550000] .................................................. [11600000] .................................................. [11650000] .................................................. [11700000] .................................................. [11750000] .................................................. [11800000] .................................................. [11850000] .................................................. [11900000] .................................................. [11950000] .................................................. [12000000] .................................................. [12050000] .................................................. [12100000] .................................................. [12150000] .................................................. [12200000] .................................................. [12250000] .................................................. [12300000] .................................................. [12350000] .................................................. [12400000] .................................................. [12450000] .................................................. [12500000] .................................................. [12550000] .................................................. [12600000] .................................................. [12650000] .................................................. [12700000] .................................................. [12750000] .................................................. [12800000] .................................................. [12850000] .................................................. [12900000] .................................................. [12950000] .................................................. [13000000] .................................................. [13050000] .................................................. [13100000] .................................................. [13150000] .................................................. [13200000] .................................................. [13250000] .................................................. [13300000] .................................................. [13350000] .................................................. [13400000] .................................................. [13450000] .................................................. [13500000] .................................................. [13550000] .................................................. [13600000] .................................................. [13650000] .................................................. [13700000] .................................................. [13750000] .................................................. [13800000] .................................................. [13850000] .................................................. [13900000] .................................................. [13950000] .................................................. [14000000] .................................................. [14050000] .................................................. [14100000] .................................................. [14150000] .................................................. [14200000] .................................................. [14250000] .................................................. [14300000] .................................................. [14350000] .................................................. [14400000] .................................................. [14450000] .................................................. [14500000] .................................................. [14550000] .................................................. [14600000] .................................................. [14650000] .................................................. [14700000] .................................................. [14750000] .................................................. [14800000] .................................................. [14850000] .................................................. [14900000] .................................................. [14950000] ................. log_e likelihood: -1.47069e+09 log_2 likelihood: -2.12175e+09 cross entropy: 7.10897 perplexity: 138.042 posterior p0: 0.0297757 posterior al-feat: -0.109922 size counts: 4289 1 model al-feat: -0.182864 (tension=4) 2 model al-feat: -0.149115 (tension=5.45884) 3 model al-feat: -0.135056 (tension=6.24269) 4 model al-feat: -0.127221 (tension=6.74537) 5 model al-feat: -0.122291 (tension=7.09135) 6 model al-feat: -0.118976 (tension=7.33872) 7 model al-feat: -0.116653 (tension=7.51979) 8 model al-feat: -0.114979 (tension=7.6544) final tension: 7.75553 ITERATION 3 .................................................. [50000] .................................................. [100000] .................................................. [150000] .................................................. [200000] .................................................. [250000] .................................................. [300000] .................................................. [350000] .................................................. [400000] .................................................. [450000] .................................................. [500000] .................................................. [550000] .................................................. [600000] .................................................. [650000] .................................................. [700000] .................................................. [750000] .................................................. [800000] .................................................. [850000] .................................................. [900000] .................................................. [950000] .................................................. [1000000] .................................................. [1050000] .................................................. [1100000] .................................................. [1150000] .................................................. [1200000] .................................................. [1250000] .................................................. [1300000] .................................................. [1350000] .................................................. [1400000] .................................................. [1450000] .................................................. [1500000] .................................................. [1550000] .................................................. [1600000] .................................................. [1650000] .................................................. [1700000] .................................................. [1750000] .................................................. [1800000] .................................................. [1850000] .................................................. [1900000] .................................................. [1950000] .................................................. [2000000] .................................................. [2050000] .................................................. [2100000] .................................................. [2150000] .................................................. [2200000] .................................................. [2250000] .................................................. [2300000] .................................................. [2350000] .................................................. [2400000] .................................................. [2450000] .................................................. [2500000] .................................................. [2550000] .................................................. [2600000] .................................................. [2650000] .................................................. [2700000] .................................................. [2750000] .................................................. [2800000] .................................................. [2850000] .................................................. [2900000] .................................................. [2950000] .................................................. [3000000] .................................................. [3050000] .................................................. [3100000] .................................................. [3150000] .................................................. [3200000] .................................................. [3250000] .................................................. [3300000] .................................................. [3350000] .................................................. [3400000] .................................................. [3450000] .................................................. [3500000] .................................................. [3550000] .................................................. [3600000] .................................................. [3650000] .................................................. [3700000] .................................................. [3750000] .................................................. [3800000] .................................................. [3850000] .................................................. [3900000] .................................................. [3950000] .................................................. [4000000] .................................................. [4050000] .................................................. [4100000] .................................................. [4150000] .................................................. [4200000] .................................................. [4250000] .................................................. [4300000] .................................................. [4350000] .................................................. [4400000] .................................................. [4450000] .................................................. [4500000] .................................................. [4550000] .................................................. [4600000] .................................................. [4650000] .................................................. [4700000] .................................................. [4750000] .................................................. [4800000] .................................................. [4850000] .................................................. [4900000] .................................................. [4950000] .................................................. [5000000] .................................................. [5050000] .................................................. [5100000] .................................................. [5150000] .................................................. [5200000] .................................................. [5250000] .................................................. [5300000] .................................................. [5350000] .................................................. [5400000] .................................................. [5450000] .................................................. [5500000] .................................................. [5550000] .................................................. [5600000] .................................................. [5650000] .................................................. [5700000] .................................................. [5750000] .................................................. [5800000] .................................................. [5850000] .................................................. [5900000] .................................................. [5950000] .................................................. [6000000] .................................................. [6050000] .................................................. [6100000] .................................................. [6150000] .................................................. [6200000] .................................................. [6250000] .................................................. [6300000] .................................................. [6350000] .................................................. [6400000] .................................................. [6450000] .................................................. [6500000] .................................................. [6550000] .................................................. [6600000] .................................................. [6650000] .................................................. [6700000] .................................................. [6750000] .................................................. [6800000] .................................................. [6850000] .................................................. [6900000] .................................................. [6950000] .................................................. [7000000] .................................................. [7050000] .................................................. [7100000] .................................................. [7150000] .................................................. [7200000] .................................................. [7250000] .................................................. [7300000] .................................................. [7350000] .................................................. [7400000] .................................................. [7450000] .................................................. [7500000] .................................................. [7550000] .................................................. [7600000] .................................................. [7650000] .................................................. [7700000] .................................................. [7750000] .................................................. [7800000] .................................................. [7850000] .................................................. [7900000] .................................................. [7950000] .................................................. [8000000] .................................................. [8050000] .................................................. [8100000] .................................................. [8150000] .................................................. [8200000] .................................................. [8250000] .................................................. [8300000] .................................................. [8350000] .................................................. [8400000] .................................................. [8450000] .................................................. [8500000] .................................................. [8550000] .................................................. [8600000] .................................................. [8650000] .................................................. [8700000] .................................................. [8750000] .................................................. [8800000] .................................................. [8850000] .................................................. [8900000] .................................................. [8950000] .................................................. [9000000] .................................................. [9050000] .................................................. [9100000] .................................................. [9150000] .................................................. [9200000] .................................................. [9250000] .................................................. [9300000] .................................................. [9350000] .................................................. [9400000] .................................................. [9450000] .................................................. [9500000] .................................................. [9550000] .................................................. [9600000] .................................................. [9650000] .................................................. [9700000] .................................................. [9750000] .................................................. [9800000] .................................................. [9850000] .................................................. [9900000] .................................................. [9950000] .................................................. [10000000] .................................................. [10050000] .................................................. [10100000] .................................................. [10150000] .................................................. [10200000] .................................................. [10250000] .................................................. [10300000] .................................................. [10350000] .................................................. [10400000] .................................................. [10450000] .................................................. [10500000] .................................................. [10550000] .................................................. [10600000] .................................................. [10650000] .................................................. [10700000] .................................................. [10750000] .................................................. [10800000] .................................................. [10850000] .................................................. [10900000] .................................................. [10950000] .................................................. [11000000] .................................................. [11050000] .................................................. [11100000] .................................................. [11150000] .................................................. [11200000] .................................................. [11250000] .................................................. [11300000] .................................................. [11350000] .................................................. [11400000] .................................................. [11450000] .................................................. [11500000] .................................................. [11550000] .................................................. [11600000] .................................................. [11650000] .................................................. [11700000] .................................................. [11750000] .................................................. [11800000] .................................................. [11850000] .................................................. [11900000] .................................................. [11950000] .................................................. [12000000] .................................................. [12050000] .................................................. [12100000] .................................................. [12150000] .................................................. [12200000] .................................................. [12250000] .................................................. [12300000] .................................................. [12350000] .................................................. [12400000] .................................................. [12450000] .................................................. [12500000] .................................................. [12550000] .................................................. [12600000] .................................................. [12650000] .................................................. [12700000] .................................................. [12750000] .................................................. [12800000] .................................................. [12850000] .................................................. [12900000] .................................................. [12950000] .................................................. [13000000] .................................................. [13050000] .................................................. [13100000] .................................................. [13150000] .................................................. [13200000] .................................................. [13250000] .................................................. [13300000] .................................................. [13350000] .................................................. [13400000] .................................................. [13450000] .................................................. [13500000] .................................................. [13550000] .................................................. [13600000] .................................................. [13650000] .................................................. [13700000] .................................................. [13750000] .................................................. [13800000] .................................................. [13850000] .................................................. [13900000] .................................................. [13950000] .................................................. [14000000] .................................................. [14050000] .................................................. [14100000] .................................................. [14150000] .................................................. [14200000] .................................................. [14250000] .................................................. [14300000] .................................................. [14350000] .................................................. [14400000] .................................................. [14450000] .................................................. [14500000] .................................................. [14550000] .................................................. [14600000] .................................................. [14650000] .................................................. [14700000] .................................................. [14750000] .................................................. [14800000] .................................................. [14850000] .................................................. [14900000] .................................................. [14950000] ................. log_e likelihood: -1.0132e+09 log_2 likelihood: -1.46174e+09 cross entropy: 4.89757 perplexity: 29.8069 posterior p0: 0.0286732 posterior al-feat: -0.0796959 size counts: 4289 1 model al-feat: -0.113751 (tension=7.75553) 2 model al-feat: -0.106079 (tension=8.43663) 3 model al-feat: -0.100777 (tension=8.9643) 4 model al-feat: -0.0968901 (tension=9.38593) 5 model al-feat: -0.093926 (tension=9.72981) 6 model al-feat: -0.0916014 (tension=10.0144) 7 model al-feat: -0.0897399 (tension=10.2525) 8 model al-feat: -0.0882252 (tension=10.4534) final tension: 10.624 ITERATION 4 .................................................. [50000] .................................................. [100000] .................................................. [150000] .................................................. [200000] .................................................. [250000] .................................................. [300000] .................................................. [350000] .................................................. [400000] .................................................. [450000] .................................................. [500000] .................................................. [550000] .................................................. [600000] .................................................. [650000] .................................................. [700000] .................................................. [750000] .................................................. [800000] .................................................. [850000] .................................................. [900000] .................................................. [950000] .................................................. [1000000] .................................................. [1050000] .................................................. [1100000] .................................................. [1150000] .................................................. [1200000] .................................................. [1250000] .................................................. [1300000] .................................................. [1350000] .................................................. [1400000] .................................................. [1450000] .................................................. [1500000] .................................................. [1550000] .................................................. [1600000] .................................................. [1650000] .................................................. [1700000] .................................................. [1750000] .................................................. [1800000] .................................................. [1850000] .................................................. [1900000] .................................................. [1950000] .................................................. [2000000] .................................................. [2050000] .................................................. [2100000] .................................................. [2150000] .................................................. [2200000] .................................................. [2250000] .................................................. [2300000] .................................................. [2350000] .................................................. [2400000] .................................................. [2450000] .................................................. [2500000] .................................................. [2550000] .................................................. [2600000] .................................................. [2650000] .................................................. [2700000] .................................................. [2750000] .................................................. [2800000] .................................................. [2850000] .................................................. [2900000] .................................................. [2950000] .................................................. [3000000] .................................................. [3050000] .................................................. [3100000] .................................................. [3150000] .................................................. [3200000] .................................................. [3250000] .................................................. [3300000] .................................................. [3350000] .................................................. [3400000] .................................................. [3450000] .................................................. [3500000] .................................................. [3550000] .................................................. [3600000] .................................................. [3650000] .................................................. [3700000] .................................................. [3750000] .................................................. [3800000] .................................................. [3850000] .................................................. [3900000] .................................................. [3950000] .................................................. [4000000] .................................................. [4050000] .................................................. [4100000] .................................................. [4150000] .................................................. [4200000] .................................................. [4250000] .................................................. [4300000] .................................................. [4350000] .................................................. [4400000] .................................................. [4450000] .................................................. [4500000] .................................................. [4550000] .................................................. [4600000] .................................................. [4650000] .................................................. [4700000] .................................................. [4750000] .................................................. [4800000] .................................................. [4850000] .................................................. [4900000] .................................................. [4950000] .................................................. [5000000] .................................................. [5050000] .................................................. [5100000] .................................................. [5150000] .................................................. [5200000] .................................................. [5250000] .................................................. [5300000] .................................................. [5350000] .................................................. [5400000] .................................................. [5450000] .................................................. [5500000] .................................................. [5550000] .................................................. [5600000] .................................................. [5650000] .................................................. [5700000] .................................................. [5750000] .................................................. [5800000] .................................................. [5850000] .................................................. [5900000] .................................................. [5950000] .................................................. [6000000] .................................................. [6050000] .................................................. [6100000] .................................................. [6150000] .................................................. [6200000] .................................................. [6250000] .................................................. [6300000] .................................................. [6350000] .................................................. [6400000] .................................................. [6450000] .................................................. [6500000] .................................................. [6550000] .................................................. [6600000] .................................................. [6650000] .................................................. [6700000] .................................................. [6750000] .................................................. [6800000] .................................................. [6850000] .................................................. [6900000] .................................................. [6950000] .................................................. [7000000] .................................................. [7050000] .................................................. [7100000] .................................................. [7150000] .................................................. [7200000] .................................................. [7250000] .................................................. [7300000] .................................................. [7350000] .................................................. [7400000] .................................................. [7450000] .................................................. [7500000] .................................................. [7550000] .................................................. [7600000] .................................................. [7650000] .................................................. [7700000] .................................................. [7750000] .................................................. [7800000] .................................................. [7850000] .................................................. [7900000] .................................................. [7950000] .................................................. [8000000] .................................................. [8050000] .................................................. [8100000] .................................................. [8150000] .................................................. [8200000] .................................................. [8250000] .................................................. [8300000] .................................................. [8350000] .................................................. [8400000] .................................................. [8450000] .................................................. [8500000] .................................................. [8550000] .................................................. [8600000] .................................................. [8650000] .................................................. [8700000] .................................................. [8750000] .................................................. [8800000] .................................................. [8850000] .................................................. [8900000] .................................................. [8950000] .................................................. [9000000] .................................................. [9050000] .................................................. [9100000] .................................................. [9150000] .................................................. [9200000] .................................................. [9250000] .................................................. [9300000] .................................................. [9350000] .................................................. [9400000] .................................................. [9450000] .................................................. [9500000] .................................................. [9550000] .................................................. [9600000] .................................................. [9650000] .................................................. [9700000] .................................................. [9750000] .................................................. [9800000] .................................................. [9850000] .................................................. [9900000] .................................................. [9950000] .................................................. [10000000] .................................................. [10050000] .................................................. [10100000] .................................................. [10150000] .................................................. [10200000] .................................................. [10250000] .................................................. [10300000] .................................................. [10350000] .................................................. [10400000] .................................................. [10450000] .................................................. [10500000] .................................................. [10550000] .................................................. [10600000] .................................................. [10650000] .................................................. [10700000] .................................................. [10750000] .................................................. [10800000] .................................................. [10850000] .................................................. [10900000] .................................................. [10950000] .................................................. [11000000] .................................................. [11050000] .................................................. [11100000] .................................................. [11150000] .................................................. [11200000] .................................................. [11250000] .................................................. [11300000] .................................................. [11350000] .................................................. [11400000] .................................................. [11450000] .................................................. [11500000] .................................................. [11550000] .................................................. [11600000] .................................................. [11650000] .................................................. [11700000] .................................................. [11750000] .................................................. [11800000] .................................................. [11850000] .................................................. [11900000] .................................................. [11950000] .................................................. [12000000] .................................................. [12050000] .................................................. [12100000] .................................................. [12150000] .................................................. [12200000] .................................................. [12250000] .................................................. [12300000] .................................................. [12350000] .................................................. [12400000] .................................................. [12450000] .................................................. [12500000] .................................................. [12550000] .................................................. [12600000] .................................................. [12650000] .................................................. [12700000] .................................................. [12750000] .................................................. [12800000] .................................................. [12850000] .................................................. [12900000] .................................................. [12950000] .................................................. [13000000] .................................................. [13050000] .................................................. [13100000] .................................................. [13150000] .................................................. [13200000] .................................................. [13250000] .................................................. [13300000] .................................................. [13350000] .................................................. [13400000] .................................................. [13450000] .................................................. [13500000] .................................................. [13550000] .................................................. [13600000] .................................................. [13650000] .................................................. [13700000] .................................................. [13750000] .................................................. [13800000] .................................................. [13850000] .................................................. [13900000] .................................................. [13950000] .................................................. [14000000] .................................................. [14050000] .................................................. [14100000] .................................................. [14150000] .................................................. [14200000] .................................................. [14250000] .................................................. [14300000] .................................................. [14350000] .................................................. [14400000] .................................................. [14450000] .................................................. [14500000] .................................................. [14550000] .................................................. [14600000] .................................................. [14650000] .................................................. [14700000] .................................................. [14750000] .................................................. [14800000] .................................................. [14850000] .................................................. [14900000] .................................................. [14950000] ................. log_e likelihood: -9.28007e+08 log_2 likelihood: -1.33883e+09 cross entropy: 4.48577 perplexity: 22.4054 posterior p0: 0.0305011 posterior al-feat: -0.0726484 size counts: 4289 1 model al-feat: -0.0869772 (tension=10.624) 2 model al-feat: -0.0849557 (tension=10.9106) 3 model al-feat: -0.0832906 (tension=11.1567) 4 model al-feat: -0.0819009 (tension=11.3696) 5 model al-feat: -0.0807288 (tension=11.5546) 6 model al-feat: -0.0797315 (tension=11.7162) 7 model al-feat: -0.0788767 (tension=11.8579) 8 model al-feat: -0.0781397 (tension=11.9824) final tension: 12.0923 ITERATION 5 (FINAL) .................................................. [50000] .................................................. [100000] .................................................. [150000] .................................................. [200000] .................................................. [250000] .................................................. [300000] .................................................. [350000] .................................................. [400000] .................................................. [450000] .................................................. [500000] .................................................. [550000] .................................................. [600000] .................................................. [650000] .................................................. [700000] .................................................. [750000] .................................................. [800000] .................................................. [850000] .................................................. [900000] .................................................. [950000] .................................................. [1000000] .................................................. [1050000] .................................................. [1100000] .................................................. [1150000] .................................................. [1200000] .................................................. [1250000] .................................................. [1300000] .................................................. [1350000] .................................................. [1400000] .................................................. [1450000] .................................................. [1500000] .................................................. [1550000] .................................................. [1600000] .................................................. [1650000] .................................................. [1700000] .................................................. [1750000] .................................................. [1800000] .................................................. [1850000] .................................................. [1900000] .................................................. [1950000] .................................................. [2000000] .................................................. [2050000] .................................................. [2100000] .................................................. [2150000] .................................................. [2200000] .................................................. [2250000] .................................................. [2300000] .................................................. [2350000] .................................................. [2400000] .................................................. [2450000] .................................................. [2500000] .................................................. [2550000] .................................................. [2600000] .................................................. [2650000] .................................................. [2700000] .................................................. [2750000] .................................................. [2800000] .................................................. [2850000] .................................................. [2900000] .................................................. [2950000] .................................................. [3000000] .................................................. [3050000] .................................................. [3100000] .................................................. [3150000] .................................................. [3200000] .................................................. [3250000] .................................................. [3300000] .................................................. [3350000] .................................................. [3400000] .................................................. [3450000] .................................................. [3500000] .................................................. [3550000] .................................................. [3600000] .................................................. [3650000] .................................................. [3700000] .................................................. [3750000] .................................................. [3800000] .................................................. [3850000] .................................................. [3900000] .................................................. [3950000] .................................................. [4000000] .................................................. [4050000] .................................................. [4100000] .................................................. [4150000] .................................................. [4200000] .................................................. [4250000] .................................................. [4300000] .................................................. [4350000] .................................................. [4400000] .................................................. [4450000] .................................................. [4500000] .................................................. [4550000] .................................................. [4600000] .................................................. [4650000] .................................................. [4700000] .................................................. [4750000] .................................................. [4800000] .................................................. [4850000] .................................................. [4900000] .................................................. [4950000] .................................................. [5000000] .................................................. [5050000] .................................................. [5100000] .................................................. [5150000] .................................................. [5200000] .................................................. [5250000] .................................................. [5300000] .................................................. [5350000] .................................................. [5400000] .................................................. [5450000] .................................................. [5500000] .................................................. [5550000] .................................................. [5600000] .................................................. [5650000] .................................................. [5700000] .................................................. [5750000] .................................................. [5800000] .................................................. [5850000] .................................................. [5900000] .................................................. [5950000] .................................................. [6000000] .................................................. [6050000] .................................................. [6100000] .................................................. [6150000] .................................................. [6200000] .................................................. [6250000] .................................................. [6300000] .................................................. [6350000] .................................................. [6400000] .................................................. [6450000] .................................................. [6500000] .................................................. [6550000] .................................................. [6600000] .................................................. [6650000] .................................................. [6700000] .................................................. [6750000] .................................................. [6800000] .................................................. [6850000] .................................................. [6900000] .................................................. [6950000] .................................................. [7000000] .................................................. [7050000] .................................................. [7100000] .................................................. [7150000] .................................................. [7200000] .................................................. [7250000] .................................................. [7300000] .................................................. [7350000] .................................................. [7400000] .................................................. [7450000] .................................................. [7500000] .................................................. [7550000] .................................................. [7600000] .................................................. [7650000] .................................................. [7700000] .................................................. [7750000] .................................................. [7800000] .................................................. [7850000] .................................................. [7900000] .................................................. [7950000] .................................................. [8000000] .................................................. [8050000] .................................................. [8100000] .................................................. [8150000] .................................................. [8200000] .................................................. [8250000] .................................................. [8300000] .................................................. [8350000] .................................................. [8400000] .................................................. [8450000] .................................................. [8500000] .................................................. [8550000] .................................................. [8600000] .................................................. [8650000] .................................................. [8700000] .................................................. [8750000] .................................................. [8800000] .................................................. [8850000] .................................................. [8900000] .................................................. [8950000] .................................................. [9000000] .................................................. [9050000] .................................................. [9100000] .................................................. [9150000] .................................................. [9200000] .................................................. [9250000] .................................................. [9300000] .................................................. [9350000] .................................................. [9400000] .................................................. [9450000] .................................................. [9500000] .................................................. [9550000] .................................................. [9600000] .................................................. [9650000] .................................................. [9700000] .................................................. [9750000] .................................................. [9800000] .................................................. [9850000] .................................................. [9900000] .................................................. [9950000] .................................................. [10000000] .................................................. [10050000] .................................................. [10100000] .................................................. [10150000] .................................................. [10200000] .................................................. [10250000] .................................................. [10300000] .................................................. [10350000] .................................................. [10400000] .................................................. [10450000] .................................................. [10500000] .................................................. [10550000] .................................................. [10600000] .................................................. [10650000] .................................................. [10700000] .................................................. [10750000] .................................................. [10800000] .................................................. [10850000] .................................................. [10900000] .................................................. [10950000] .................................................. [11000000] .................................................. [11050000] .................................................. [11100000] .................................................. [11150000] .................................................. [11200000] .................................................. [11250000] .................................................. [11300000] .................................................. [11350000] .................................................. [11400000] .................................................. [11450000] .................................................. [11500000] .................................................. [11550000] .................................................. [11600000] .................................................. [11650000] .................................................. [11700000] .................................................. [11750000] .................................................. [11800000] .................................................. [11850000] .................................................. [11900000] .................................................. [11950000] .................................................. [12000000] .................................................. [12050000] .................................................. [12100000] .................................................. [12150000] .................................................. [12200000] .................................................. [12250000] .................................................. [12300000] .................................................. [12350000] .................................................. [12400000] .................................................. [12450000] .................................................. [12500000] .................................................. [12550000] .................................................. [12600000] .................................................. [12650000] .................................................. [12700000] .................................................. [12750000] .................................................. [12800000] .................................................. [12850000] .................................................. [12900000] .................................................. [12950000] .................................................. [13000000] .................................................. [13050000] .................................................. [13100000] .................................................. [13150000] .................................................. [13200000] .................................................. [13250000] .................................................. [13300000] .................................................. [13350000] .................................................. [13400000] .................................................. [13450000] .................................................. [13500000] .................................................. [13550000] .................................................. [13600000] .................................................. [13650000] .................................................. [13700000] .................................................. [13750000] .................................................. [13800000] .................................................. [13850000] .................................................. [13900000] .................................................. [13950000] .................................................. [14000000] .................................................. [14050000] .................................................. [14100000] .................................................. [14150000] .................................................. [14200000] .................................................. [14250000] .................................................. [14300000] .................................................. [14350000] .................................................. [14400000] .................................................. [14450000] .................................................. [14500000] .................................................. [14550000] .................................................. [14600000] .................................................. [14650000] .................................................. [14700000] .................................................. [14750000] .................................................. [14800000] .................................................. [14850000] .................................................. [14900000] .................................................. [14950000] ................. log_e likelihood: -9.03498e+08 log_2 likelihood: -1.30347e+09 cross entropy: 4.3673 perplexity: 20.639 posterior p0: 0 posterior al-feat: 0 size counts: 4289 conditional probabilities: ca-en.params