File size: 190,055 Bytes
9785a9d |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 801 802 803 804 805 806 807 808 809 810 811 812 813 814 815 816 817 818 819 820 821 822 823 824 825 826 827 828 829 830 831 832 833 834 835 836 837 838 839 840 841 842 843 844 845 846 847 848 849 850 851 852 853 854 855 856 857 858 859 860 861 862 863 864 865 866 867 868 869 870 871 872 873 874 875 876 877 878 879 880 881 882 883 884 885 886 887 888 889 890 891 892 893 894 895 896 897 898 899 900 901 902 903 904 905 906 907 908 909 910 911 912 913 914 915 916 917 918 919 920 921 922 923 924 925 926 927 928 929 930 931 932 933 934 935 936 937 938 939 940 941 942 943 944 945 946 947 948 949 950 951 952 953 954 955 956 957 958 959 960 961 962 963 964 965 966 967 968 969 970 971 972 973 974 975 976 977 978 979 980 981 982 983 984 985 986 987 988 989 990 991 992 993 994 995 996 997 998 999 1000 1001 1002 1003 1004 1005 1006 1007 1008 1009 1010 1011 1012 1013 1014 1015 1016 1017 1018 1019 1020 1021 1022 1023 1024 1025 1026 1027 1028 1029 1030 1031 1032 1033 1034 1035 1036 1037 1038 1039 1040 1041 1042 1043 1044 1045 1046 1047 1048 1049 1050 1051 1052 1053 1054 1055 1056 1057 1058 1059 1060 1061 1062 1063 1064 1065 1066 1067 1068 1069 1070 1071 1072 1073 1074 1075 1076 1077 1078 1079 1080 1081 1082 1083 1084 1085 1086 1087 1088 1089 1090 1091 1092 1093 1094 1095 1096 1097 1098 1099 1100 1101 1102 1103 1104 1105 1106 1107 1108 1109 1110 1111 1112 1113 1114 1115 1116 1117 1118 1119 1120 1121 1122 1123 1124 1125 1126 1127 1128 1129 1130 1131 1132 1133 1134 1135 1136 1137 1138 1139 1140 1141 1142 1143 1144 1145 1146 1147 1148 1149 1150 1151 1152 1153 1154 1155 1156 1157 1158 1159 1160 1161 1162 1163 1164 1165 1166 1167 1168 1169 1170 1171 1172 1173 1174 1175 1176 1177 1178 1179 1180 1181 1182 1183 1184 1185 1186 1187 1188 1189 1190 1191 1192 1193 1194 1195 1196 1197 1198 1199 1200 1201 1202 1203 1204 1205 1206 1207 1208 1209 1210 1211 1212 1213 1214 1215 1216 1217 1218 1219 1220 1221 1222 1223 1224 1225 1226 1227 1228 1229 1230 1231 1232 1233 1234 1235 1236 1237 1238 1239 1240 1241 1242 1243 1244 1245 1246 1247 1248 1249 1250 1251 1252 1253 1254 1255 1256 1257 1258 1259 1260 1261 1262 1263 1264 1265 1266 1267 1268 1269 1270 1271 1272 1273 1274 1275 1276 1277 1278 1279 1280 1281 1282 1283 1284 1285 1286 1287 1288 1289 1290 1291 1292 1293 1294 1295 1296 1297 1298 1299 1300 1301 1302 1303 1304 1305 1306 1307 1308 1309 1310 1311 1312 1313 1314 1315 1316 1317 1318 1319 1320 1321 1322 1323 1324 1325 1326 1327 1328 1329 1330 1331 1332 1333 1334 1335 1336 1337 1338 1339 1340 1341 1342 1343 1344 1345 1346 1347 1348 1349 1350 1351 1352 1353 1354 1355 1356 1357 1358 1359 1360 1361 1362 1363 1364 1365 1366 1367 1368 1369 1370 1371 1372 1373 1374 1375 1376 1377 1378 1379 1380 1381 1382 1383 1384 1385 1386 1387 1388 1389 1390 1391 1392 1393 1394 1395 1396 1397 1398 1399 1400 1401 1402 1403 1404 1405 1406 1407 1408 1409 1410 1411 1412 1413 1414 1415 1416 1417 1418 1419 1420 1421 1422 1423 1424 1425 1426 1427 1428 1429 1430 1431 1432 1433 1434 1435 1436 1437 1438 1439 1440 1441 1442 1443 1444 1445 1446 1447 1448 1449 1450 1451 1452 1453 1454 1455 1456 1457 1458 1459 1460 1461 1462 1463 1464 1465 1466 1467 1468 1469 1470 1471 1472 1473 1474 1475 1476 1477 1478 1479 1480 1481 1482 1483 1484 1485 1486 1487 1488 1489 1490 1491 1492 1493 1494 1495 1496 1497 1498 1499 1500 1501 1502 1503 1504 1505 1506 1507 1508 1509 1510 1511 1512 1513 1514 1515 1516 1517 1518 1519 1520 1521 1522 1523 1524 1525 1526 1527 1528 1529 1530 1531 1532 1533 1534 1535 1536 1537 1538 1539 1540 1541 1542 1543 1544 1545 1546 1547 1548 1549 1550 1551 1552 1553 1554 1555 1556 1557 1558 1559 1560 1561 1562 1563 1564 1565 1566 1567 1568 1569 1570 1571 1572 1573 1574 1575 1576 1577 1578 1579 1580 1581 1582 1583 1584 1585 1586 1587 1588 1589 1590 1591 1592 1593 1594 1595 1596 1597 1598 1599 1600 1601 1602 1603 1604 1605 1606 1607 1608 1609 1610 1611 1612 1613 1614 1615 1616 1617 1618 1619 1620 1621 1622 1623 1624 1625 1626 1627 1628 1629 1630 1631 1632 1633 1634 1635 1636 1637 1638 1639 1640 1641 1642 1643 1644 1645 1646 1647 1648 1649 1650 1651 1652 1653 1654 1655 1656 1657 1658 1659 1660 1661 1662 1663 1664 1665 1666 1667 1668 1669 1670 1671 1672 1673 1674 1675 1676 1677 1678 1679 1680 1681 1682 1683 1684 1685 1686 1687 1688 1689 1690 1691 1692 1693 1694 1695 1696 1697 1698 1699 1700 1701 1702 1703 1704 1705 1706 1707 1708 1709 1710 1711 1712 1713 1714 1715 1716 1717 1718 1719 1720 1721 1722 1723 1724 1725 1726 1727 1728 1729 1730 1731 1732 1733 1734 1735 1736 1737 1738 1739 1740 1741 1742 1743 1744 1745 1746 1747 1748 1749 1750 1751 1752 1753 1754 1755 1756 1757 1758 1759 1760 1761 1762 1763 1764 1765 1766 1767 1768 1769 1770 1771 1772 1773 1774 1775 1776 1777 1778 1779 1780 1781 1782 1783 1784 1785 1786 1787 1788 1789 1790 1791 1792 1793 1794 1795 1796 1797 1798 1799 1800 1801 1802 1803 1804 1805 1806 1807 1808 1809 1810 1811 1812 1813 1814 1815 1816 1817 1818 1819 1820 1821 1822 1823 1824 1825 1826 1827 1828 1829 1830 1831 1832 1833 1834 1835 1836 1837 1838 1839 1840 1841 1842 1843 1844 1845 1846 1847 1848 1849 1850 1851 1852 1853 1854 1855 1856 1857 1858 1859 1860 1861 1862 1863 1864 1865 1866 1867 1868 1869 1870 1871 1872 1873 1874 1875 1876 1877 1878 1879 1880 1881 1882 1883 1884 1885 1886 1887 1888 1889 1890 1891 1892 1893 1894 1895 1896 1897 1898 1899 1900 1901 1902 1903 1904 1905 1906 1907 1908 1909 1910 1911 1912 1913 1914 1915 1916 1917 1918 1919 1920 1921 1922 1923 1924 1925 1926 1927 1928 1929 1930 1931 1932 1933 1934 1935 1936 1937 1938 1939 1940 1941 1942 1943 1944 1945 1946 1947 1948 1949 1950 1951 1952 1953 1954 1955 1956 1957 1958 1959 1960 1961 1962 1963 1964 1965 1966 1967 1968 1969 1970 1971 1972 1973 1974 1975 1976 1977 1978 1979 1980 |
2019-08-13 12:32:04,635 ----------------------------------------------------------------------------------------------------
2019-08-13 12:32:04,635 Model: "SequenceTagger(
(embeddings): StackedEmbeddings(
(list_embedding_0): WordEmbeddings('de')
(list_embedding_1): FlairEmbeddings(
(lm): LanguageModel(
(drop): Dropout(p=0.25)
(encoder): Embedding(275, 100)
(rnn): LSTM(100, 2048)
(decoder): Linear(in_features=2048, out_features=275, bias=True)
)
)
(list_embedding_2): FlairEmbeddings(
(lm): LanguageModel(
(drop): Dropout(p=0.25)
(encoder): Embedding(275, 100)
(rnn): LSTM(100, 2048)
(decoder): Linear(in_features=2048, out_features=275, bias=True)
)
)
)
(word_dropout): WordDropout(p=0.05)
(locked_dropout): LockedDropout(p=0.5)
(embedding2nn): Linear(in_features=4396, out_features=4396, bias=True)
(rnn): LSTM(4396, 256, bidirectional=True)
(linear): Linear(in_features=512, out_features=20, bias=True)
)"
2019-08-13 12:32:04,635 ----------------------------------------------------------------------------------------------------
2019-08-13 12:32:04,635 Corpus: "Corpus: 12705 train + 3068 dev + 3160 test sentences"
2019-08-13 12:32:04,635 ----------------------------------------------------------------------------------------------------
2019-08-13 12:32:04,636 Parameters:
2019-08-13 12:32:04,636 - learning_rate: "0.1"
2019-08-13 12:32:04,636 - mini_batch_size: "32"
2019-08-13 12:32:04,636 - patience: "3"
2019-08-13 12:32:04,636 - anneal_factor: "0.5"
2019-08-13 12:32:04,636 - max_epochs: "150"
2019-08-13 12:32:04,636 - shuffle: "True"
2019-08-13 12:32:04,636 - train_with_dev: "True"
2019-08-13 12:32:04,636 ----------------------------------------------------------------------------------------------------
2019-08-13 12:32:04,636 Model training base path: "resources/taggers/release-de-ner-0"
2019-08-13 12:32:04,636 ----------------------------------------------------------------------------------------------------
2019-08-13 12:32:04,636 Device: cuda:0
2019-08-13 12:32:04,636 ----------------------------------------------------------------------------------------------------
2019-08-13 12:32:04,636 Embeddings storage mode: cpu
2019-08-13 12:32:04,637 ----------------------------------------------------------------------------------------------------
2019-08-13 12:32:05,002 epoch 1 - iter 0/493 - loss 54.26176834 throughput (samples/sec): 4310.35
2019-08-13 12:32:22,722 epoch 1 - iter 49/493 - loss 7.45197087 throughput (samples/sec): 88.63
2019-08-13 12:32:39,642 epoch 1 - iter 98/493 - loss 5.35501018 throughput (samples/sec): 92.81
2019-08-13 12:32:56,921 epoch 1 - iter 147/493 - loss 4.46123171 throughput (samples/sec): 90.88
2019-08-13 12:33:15,161 epoch 1 - iter 196/493 - loss 3.99668761 throughput (samples/sec): 86.08
2019-08-13 12:33:32,264 epoch 1 - iter 245/493 - loss 3.62682699 throughput (samples/sec): 91.81
2019-08-13 12:33:49,212 epoch 1 - iter 294/493 - loss 3.36890697 throughput (samples/sec): 92.65
2019-08-13 12:34:06,778 epoch 1 - iter 343/493 - loss 3.13436045 throughput (samples/sec): 89.39
2019-08-13 12:34:23,850 epoch 1 - iter 392/493 - loss 2.95560552 throughput (samples/sec): 91.98
2019-08-13 12:34:41,648 epoch 1 - iter 441/493 - loss 2.80974939 throughput (samples/sec): 88.23
2019-08-13 12:34:58,255 epoch 1 - iter 490/493 - loss 2.67589358 throughput (samples/sec): 94.56
2019-08-13 12:34:58,930 ----------------------------------------------------------------------------------------------------
2019-08-13 12:34:58,930 EPOCH 1 done: loss 2.6698 - lr 0.1000
2019-08-13 12:34:58,930 BAD EPOCHS (no improvement): 0
2019-08-13 12:34:58,930 ----------------------------------------------------------------------------------------------------
2019-08-13 12:34:59,091 epoch 2 - iter 0/493 - loss 0.76706958 throughput (samples/sec): 9829.99
2019-08-13 12:35:07,690 epoch 2 - iter 49/493 - loss 1.51093387 throughput (samples/sec): 182.85
2019-08-13 12:35:15,948 epoch 2 - iter 98/493 - loss 1.41661072 throughput (samples/sec): 190.44
2019-08-13 12:35:24,418 epoch 2 - iter 147/493 - loss 1.41566149 throughput (samples/sec): 185.65
2019-08-13 12:35:33,280 epoch 2 - iter 196/493 - loss 1.37155719 throughput (samples/sec): 177.43
2019-08-13 12:35:41,834 epoch 2 - iter 245/493 - loss 1.33758969 throughput (samples/sec): 183.83
2019-08-13 12:35:50,704 epoch 2 - iter 294/493 - loss 1.31382119 throughput (samples/sec): 177.25
2019-08-13 12:35:59,355 epoch 2 - iter 343/493 - loss 1.31247403 throughput (samples/sec): 181.77
2019-08-13 12:36:07,940 epoch 2 - iter 392/493 - loss 1.30388578 throughput (samples/sec): 183.18
2019-08-13 12:36:16,363 epoch 2 - iter 441/493 - loss 1.28779204 throughput (samples/sec): 186.68
2019-08-13 12:36:24,816 epoch 2 - iter 490/493 - loss 1.27199390 throughput (samples/sec): 186.05
2019-08-13 12:36:25,139 ----------------------------------------------------------------------------------------------------
2019-08-13 12:36:25,140 EPOCH 2 done: loss 1.2692 - lr 0.1000
2019-08-13 12:36:25,140 BAD EPOCHS (no improvement): 0
2019-08-13 12:36:25,140 ----------------------------------------------------------------------------------------------------
2019-08-13 12:36:25,379 epoch 3 - iter 0/493 - loss 1.37894988 throughput (samples/sec): 6594.35
2019-08-13 12:36:33,697 epoch 3 - iter 49/493 - loss 0.92803166 throughput (samples/sec): 189.06
2019-08-13 12:36:42,319 epoch 3 - iter 98/493 - loss 0.97919962 throughput (samples/sec): 182.37
2019-08-13 12:36:50,881 epoch 3 - iter 147/493 - loss 0.99783048 throughput (samples/sec): 183.67
2019-08-13 12:36:59,507 epoch 3 - iter 196/493 - loss 1.01397427 throughput (samples/sec): 182.27
2019-08-13 12:37:07,794 epoch 3 - iter 245/493 - loss 1.02722099 throughput (samples/sec): 189.78
2019-08-13 12:37:16,226 epoch 3 - iter 294/493 - loss 1.03641229 throughput (samples/sec): 186.51
2019-08-13 12:37:25,391 epoch 3 - iter 343/493 - loss 1.04012836 throughput (samples/sec): 171.53
2019-08-13 12:37:33,858 epoch 3 - iter 392/493 - loss 1.04728730 throughput (samples/sec): 185.74
2019-08-13 12:37:42,325 epoch 3 - iter 441/493 - loss 1.04028466 throughput (samples/sec): 185.72
2019-08-13 12:37:50,538 epoch 3 - iter 490/493 - loss 1.02819106 throughput (samples/sec): 191.48
2019-08-13 12:37:50,939 ----------------------------------------------------------------------------------------------------
2019-08-13 12:37:50,939 EPOCH 3 done: loss 1.0290 - lr 0.1000
2019-08-13 12:37:50,940 BAD EPOCHS (no improvement): 0
2019-08-13 12:37:50,940 ----------------------------------------------------------------------------------------------------
2019-08-13 12:37:51,199 epoch 4 - iter 0/493 - loss 0.95010042 throughput (samples/sec): 6067.17
2019-08-13 12:37:59,555 epoch 4 - iter 49/493 - loss 0.97231739 throughput (samples/sec): 188.21
2019-08-13 12:38:07,891 epoch 4 - iter 98/493 - loss 0.94843789 throughput (samples/sec): 188.65
2019-08-13 12:38:16,163 epoch 4 - iter 147/493 - loss 0.95005666 throughput (samples/sec): 190.13
2019-08-13 12:38:24,360 epoch 4 - iter 196/493 - loss 0.95267116 throughput (samples/sec): 191.85
2019-08-13 12:38:32,910 epoch 4 - iter 245/493 - loss 0.94003162 throughput (samples/sec): 183.93
2019-08-13 12:38:41,576 epoch 4 - iter 294/493 - loss 0.93568471 throughput (samples/sec): 181.45
2019-08-13 12:38:50,284 epoch 4 - iter 343/493 - loss 0.94381094 throughput (samples/sec): 180.57
2019-08-13 12:38:59,150 epoch 4 - iter 392/493 - loss 0.93796248 throughput (samples/sec): 177.34
2019-08-13 12:39:07,813 epoch 4 - iter 441/493 - loss 0.93034963 throughput (samples/sec): 181.52
2019-08-13 12:39:16,118 epoch 4 - iter 490/493 - loss 0.91713963 throughput (samples/sec): 189.36
2019-08-13 12:39:16,442 ----------------------------------------------------------------------------------------------------
2019-08-13 12:39:16,442 EPOCH 4 done: loss 0.9181 - lr 0.1000
2019-08-13 12:39:16,442 BAD EPOCHS (no improvement): 0
2019-08-13 12:39:16,442 ----------------------------------------------------------------------------------------------------
2019-08-13 12:39:16,676 epoch 5 - iter 0/493 - loss 0.40530181 throughput (samples/sec): 6732.90
2019-08-13 12:39:25,166 epoch 5 - iter 49/493 - loss 0.77617888 throughput (samples/sec): 185.23
2019-08-13 12:39:33,691 epoch 5 - iter 98/493 - loss 0.82141250 throughput (samples/sec): 184.49
2019-08-13 12:39:41,947 epoch 5 - iter 147/493 - loss 0.81687266 throughput (samples/sec): 190.50
2019-08-13 12:39:50,711 epoch 5 - iter 196/493 - loss 0.83791401 throughput (samples/sec): 179.41
2019-08-13 12:39:59,161 epoch 5 - iter 245/493 - loss 0.83181124 throughput (samples/sec): 186.11
2019-08-13 12:40:07,719 epoch 5 - iter 294/493 - loss 0.81843559 throughput (samples/sec): 183.77
2019-08-13 12:40:16,298 epoch 5 - iter 343/493 - loss 0.82653269 throughput (samples/sec): 183.30
2019-08-13 12:40:25,060 epoch 5 - iter 392/493 - loss 0.82926182 throughput (samples/sec): 179.46
2019-08-13 12:40:33,458 epoch 5 - iter 441/493 - loss 0.82673526 throughput (samples/sec): 187.27
2019-08-13 12:40:42,591 epoch 5 - iter 490/493 - loss 0.82241585 throughput (samples/sec): 172.16
2019-08-13 12:40:42,969 ----------------------------------------------------------------------------------------------------
2019-08-13 12:40:42,969 EPOCH 5 done: loss 0.8248 - lr 0.1000
2019-08-13 12:40:42,969 BAD EPOCHS (no improvement): 0
2019-08-13 12:40:42,969 ----------------------------------------------------------------------------------------------------
2019-08-13 12:40:43,143 epoch 6 - iter 0/493 - loss 0.50501120 throughput (samples/sec): 9049.59
2019-08-13 12:40:51,763 epoch 6 - iter 49/493 - loss 0.71407561 throughput (samples/sec): 182.45
2019-08-13 12:41:00,057 epoch 6 - iter 98/493 - loss 0.73086807 throughput (samples/sec): 189.62
2019-08-13 12:41:08,922 epoch 6 - iter 147/493 - loss 0.73413194 throughput (samples/sec): 177.37
2019-08-13 12:41:17,507 epoch 6 - iter 196/493 - loss 0.73058960 throughput (samples/sec): 183.17
2019-08-13 12:41:26,334 epoch 6 - iter 245/493 - loss 0.74032093 throughput (samples/sec): 178.15
2019-08-13 12:41:34,903 epoch 6 - iter 294/493 - loss 0.74352049 throughput (samples/sec): 183.52
2019-08-13 12:41:43,879 epoch 6 - iter 343/493 - loss 0.74494216 throughput (samples/sec): 175.17
2019-08-13 12:41:52,321 epoch 6 - iter 392/493 - loss 0.73976617 throughput (samples/sec): 186.29
2019-08-13 12:42:00,804 epoch 6 - iter 441/493 - loss 0.73865017 throughput (samples/sec): 185.39
2019-08-13 12:42:09,205 epoch 6 - iter 490/493 - loss 0.74375257 throughput (samples/sec): 187.20
2019-08-13 12:42:09,642 ----------------------------------------------------------------------------------------------------
2019-08-13 12:42:09,642 EPOCH 6 done: loss 0.7447 - lr 0.1000
2019-08-13 12:42:09,642 BAD EPOCHS (no improvement): 0
2019-08-13 12:42:09,642 ----------------------------------------------------------------------------------------------------
2019-08-13 12:42:09,819 epoch 7 - iter 0/493 - loss 0.44779930 throughput (samples/sec): 8906.90
2019-08-13 12:42:18,149 epoch 7 - iter 49/493 - loss 0.63027719 throughput (samples/sec): 188.80
2019-08-13 12:42:26,706 epoch 7 - iter 98/493 - loss 0.65525659 throughput (samples/sec): 183.77
2019-08-13 12:42:35,406 epoch 7 - iter 147/493 - loss 0.65087047 throughput (samples/sec): 180.75
2019-08-13 12:42:44,303 epoch 7 - iter 196/493 - loss 0.65720450 throughput (samples/sec): 176.74
2019-08-13 12:42:52,987 epoch 7 - iter 245/493 - loss 0.67852709 throughput (samples/sec): 181.09
2019-08-13 12:43:01,680 epoch 7 - iter 294/493 - loss 0.69685003 throughput (samples/sec): 180.88
2019-08-13 12:43:10,552 epoch 7 - iter 343/493 - loss 0.70726457 throughput (samples/sec): 177.24
2019-08-13 12:43:19,337 epoch 7 - iter 392/493 - loss 0.71650480 throughput (samples/sec): 178.99
2019-08-13 12:43:27,661 epoch 7 - iter 441/493 - loss 0.71506937 throughput (samples/sec): 188.94
2019-08-13 12:43:36,245 epoch 7 - iter 490/493 - loss 0.71004307 throughput (samples/sec): 183.19
2019-08-13 12:43:36,605 ----------------------------------------------------------------------------------------------------
2019-08-13 12:43:36,605 EPOCH 7 done: loss 0.7093 - lr 0.1000
2019-08-13 12:43:36,605 BAD EPOCHS (no improvement): 0
2019-08-13 12:43:36,606 ----------------------------------------------------------------------------------------------------
2019-08-13 12:43:36,806 epoch 8 - iter 0/493 - loss 0.55670226 throughput (samples/sec): 7841.44
2019-08-13 12:43:45,371 epoch 8 - iter 49/493 - loss 0.71507860 throughput (samples/sec): 183.61
2019-08-13 12:43:53,980 epoch 8 - iter 98/493 - loss 0.69736152 throughput (samples/sec): 182.68
2019-08-13 12:44:02,630 epoch 8 - iter 147/493 - loss 0.66287554 throughput (samples/sec): 181.79
2019-08-13 12:44:11,021 epoch 8 - iter 196/493 - loss 0.66621195 throughput (samples/sec): 187.44
2019-08-13 12:44:19,903 epoch 8 - iter 245/493 - loss 0.66964139 throughput (samples/sec): 177.01
2019-08-13 12:44:28,241 epoch 8 - iter 294/493 - loss 0.65612812 throughput (samples/sec): 188.62
2019-08-13 12:44:36,554 epoch 8 - iter 343/493 - loss 0.66197763 throughput (samples/sec): 189.17
2019-08-13 12:44:45,299 epoch 8 - iter 392/493 - loss 0.65967419 throughput (samples/sec): 179.81
2019-08-13 12:44:53,926 epoch 8 - iter 441/493 - loss 0.65645194 throughput (samples/sec): 182.27
2019-08-13 12:45:02,536 epoch 8 - iter 490/493 - loss 0.65698342 throughput (samples/sec): 182.65
2019-08-13 12:45:02,932 ----------------------------------------------------------------------------------------------------
2019-08-13 12:45:02,932 EPOCH 8 done: loss 0.6563 - lr 0.1000
2019-08-13 12:45:02,932 BAD EPOCHS (no improvement): 0
2019-08-13 12:45:02,933 ----------------------------------------------------------------------------------------------------
2019-08-13 12:45:03,116 epoch 9 - iter 0/493 - loss 0.34088182 throughput (samples/sec): 8588.87
2019-08-13 12:45:11,911 epoch 9 - iter 49/493 - loss 0.57577198 throughput (samples/sec): 178.80
2019-08-13 12:45:20,420 epoch 9 - iter 98/493 - loss 0.63099662 throughput (samples/sec): 184.80
2019-08-13 12:45:28,576 epoch 9 - iter 147/493 - loss 0.66182153 throughput (samples/sec): 192.83
2019-08-13 12:45:37,338 epoch 9 - iter 196/493 - loss 0.65840089 throughput (samples/sec): 179.45
2019-08-13 12:45:45,872 epoch 9 - iter 245/493 - loss 0.65015057 throughput (samples/sec): 184.26
2019-08-13 12:45:54,660 epoch 9 - iter 294/493 - loss 0.64066794 throughput (samples/sec): 178.93
2019-08-13 12:46:02,897 epoch 9 - iter 343/493 - loss 0.63354588 throughput (samples/sec): 190.92
2019-08-13 12:46:11,736 epoch 9 - iter 392/493 - loss 0.63328888 throughput (samples/sec): 177.90
2019-08-13 12:46:20,071 epoch 9 - iter 441/493 - loss 0.62852250 throughput (samples/sec): 188.69
2019-08-13 12:46:28,853 epoch 9 - iter 490/493 - loss 0.63639676 throughput (samples/sec): 179.04
2019-08-13 12:46:29,164 ----------------------------------------------------------------------------------------------------
2019-08-13 12:46:29,164 EPOCH 9 done: loss 0.6375 - lr 0.1000
2019-08-13 12:46:29,164 BAD EPOCHS (no improvement): 0
2019-08-13 12:46:29,164 ----------------------------------------------------------------------------------------------------
2019-08-13 12:46:29,378 epoch 10 - iter 0/493 - loss 1.17763615 throughput (samples/sec): 7388.65
2019-08-13 12:46:37,576 epoch 10 - iter 49/493 - loss 0.61343721 throughput (samples/sec): 191.83
2019-08-13 12:46:46,521 epoch 10 - iter 98/493 - loss 0.65214093 throughput (samples/sec): 175.78
2019-08-13 12:46:54,978 epoch 10 - iter 147/493 - loss 0.64992781 throughput (samples/sec): 185.95
2019-08-13 12:47:03,348 epoch 10 - iter 196/493 - loss 0.62276273 throughput (samples/sec): 187.89
2019-08-13 12:47:12,369 epoch 10 - iter 245/493 - loss 0.60576585 throughput (samples/sec): 174.29
2019-08-13 12:47:21,007 epoch 10 - iter 294/493 - loss 0.60374692 throughput (samples/sec): 182.05
2019-08-13 12:47:29,640 epoch 10 - iter 343/493 - loss 0.60941950 throughput (samples/sec): 182.14
2019-08-13 12:47:38,468 epoch 10 - iter 392/493 - loss 0.61041994 throughput (samples/sec): 178.11
2019-08-13 12:47:46,474 epoch 10 - iter 441/493 - loss 0.60177990 throughput (samples/sec): 196.44
2019-08-13 12:47:54,821 epoch 10 - iter 490/493 - loss 0.59856470 throughput (samples/sec): 188.42
2019-08-13 12:47:55,257 ----------------------------------------------------------------------------------------------------
2019-08-13 12:47:55,257 EPOCH 10 done: loss 0.5986 - lr 0.1000
2019-08-13 12:47:55,257 BAD EPOCHS (no improvement): 0
2019-08-13 12:47:55,257 ----------------------------------------------------------------------------------------------------
2019-08-13 12:47:55,459 epoch 11 - iter 0/493 - loss 0.40001374 throughput (samples/sec): 7806.47
2019-08-13 12:48:03,706 epoch 11 - iter 49/493 - loss 0.61267841 throughput (samples/sec): 190.69
2019-08-13 12:48:11,890 epoch 11 - iter 98/493 - loss 0.56157616 throughput (samples/sec): 192.18
2019-08-13 12:48:20,381 epoch 11 - iter 147/493 - loss 0.58428185 throughput (samples/sec): 185.21
2019-08-13 12:48:28,835 epoch 11 - iter 196/493 - loss 0.57925224 throughput (samples/sec): 185.99
2019-08-13 12:48:37,697 epoch 11 - iter 245/493 - loss 0.58093671 throughput (samples/sec): 177.42
2019-08-13 12:48:46,098 epoch 11 - iter 294/493 - loss 0.57312300 throughput (samples/sec): 187.21
2019-08-13 12:48:55,173 epoch 11 - iter 343/493 - loss 0.56952645 throughput (samples/sec): 173.25
2019-08-13 12:49:03,757 epoch 11 - iter 392/493 - loss 0.57265007 throughput (samples/sec): 183.18
2019-08-13 12:49:12,226 epoch 11 - iter 441/493 - loss 0.56983325 throughput (samples/sec): 185.68
2019-08-13 12:49:20,590 epoch 11 - iter 490/493 - loss 0.57083138 throughput (samples/sec): 188.02
2019-08-13 12:49:21,030 ----------------------------------------------------------------------------------------------------
2019-08-13 12:49:21,030 EPOCH 11 done: loss 0.5703 - lr 0.1000
2019-08-13 12:49:21,031 BAD EPOCHS (no improvement): 0
2019-08-13 12:49:21,031 ----------------------------------------------------------------------------------------------------
2019-08-13 12:49:21,191 epoch 12 - iter 0/493 - loss 0.30076072 throughput (samples/sec): 9864.91
2019-08-13 12:49:29,450 epoch 12 - iter 49/493 - loss 0.52239391 throughput (samples/sec): 190.41
2019-08-13 12:49:38,341 epoch 12 - iter 98/493 - loss 0.50880695 throughput (samples/sec): 176.85
2019-08-13 12:49:47,117 epoch 12 - iter 147/493 - loss 0.51691063 throughput (samples/sec): 179.16
2019-08-13 12:49:55,510 epoch 12 - iter 196/493 - loss 0.51442245 throughput (samples/sec): 187.36
2019-08-13 12:50:03,606 epoch 12 - iter 245/493 - loss 0.51535880 throughput (samples/sec): 194.26
2019-08-13 12:50:12,164 epoch 12 - iter 294/493 - loss 0.51586441 throughput (samples/sec): 183.75
2019-08-13 12:50:20,795 epoch 12 - iter 343/493 - loss 0.53167867 throughput (samples/sec): 182.18
2019-08-13 12:50:29,016 epoch 12 - iter 392/493 - loss 0.52993897 throughput (samples/sec): 191.29
2019-08-13 12:50:37,835 epoch 12 - iter 441/493 - loss 0.53592643 throughput (samples/sec): 178.30
2019-08-13 12:50:46,242 epoch 12 - iter 490/493 - loss 0.53424985 throughput (samples/sec): 187.05
2019-08-13 12:50:46,557 ----------------------------------------------------------------------------------------------------
2019-08-13 12:50:46,557 EPOCH 12 done: loss 0.5344 - lr 0.1000
2019-08-13 12:50:46,557 BAD EPOCHS (no improvement): 0
2019-08-13 12:50:46,557 ----------------------------------------------------------------------------------------------------
2019-08-13 12:50:46,716 epoch 13 - iter 0/493 - loss 0.26164722 throughput (samples/sec): 9960.11
2019-08-13 12:50:55,432 epoch 13 - iter 49/493 - loss 0.51347062 throughput (samples/sec): 180.40
2019-08-13 12:51:03,731 epoch 13 - iter 98/493 - loss 0.48566931 throughput (samples/sec): 189.50
2019-08-13 12:51:12,031 epoch 13 - iter 147/493 - loss 0.49598219 throughput (samples/sec): 189.46
2019-08-13 12:51:20,615 epoch 13 - iter 196/493 - loss 0.50574423 throughput (samples/sec): 183.19
2019-08-13 12:51:28,946 epoch 13 - iter 245/493 - loss 0.51728363 throughput (samples/sec): 188.77
2019-08-13 12:51:37,467 epoch 13 - iter 294/493 - loss 0.51348137 throughput (samples/sec): 184.54
2019-08-13 12:51:45,928 epoch 13 - iter 343/493 - loss 0.51554829 throughput (samples/sec): 185.85
2019-08-13 12:51:54,550 epoch 13 - iter 392/493 - loss 0.50950089 throughput (samples/sec): 182.39
2019-08-13 12:52:03,104 epoch 13 - iter 441/493 - loss 0.50970429 throughput (samples/sec): 183.81
2019-08-13 12:52:11,967 epoch 13 - iter 490/493 - loss 0.50798532 throughput (samples/sec): 177.41
2019-08-13 12:52:12,289 ----------------------------------------------------------------------------------------------------
2019-08-13 12:52:12,289 EPOCH 13 done: loss 0.5080 - lr 0.1000
2019-08-13 12:52:12,289 BAD EPOCHS (no improvement): 0
2019-08-13 12:52:12,290 ----------------------------------------------------------------------------------------------------
2019-08-13 12:52:12,461 epoch 14 - iter 0/493 - loss 0.25025496 throughput (samples/sec): 9204.06
2019-08-13 12:52:20,833 epoch 14 - iter 49/493 - loss 0.49328938 throughput (samples/sec): 187.82
2019-08-13 12:52:29,257 epoch 14 - iter 98/493 - loss 0.51575155 throughput (samples/sec): 186.67
2019-08-13 12:52:37,941 epoch 14 - iter 147/493 - loss 0.51655991 throughput (samples/sec): 181.08
2019-08-13 12:52:46,385 epoch 14 - iter 196/493 - loss 0.51616147 throughput (samples/sec): 186.23
2019-08-13 12:52:55,673 epoch 14 - iter 245/493 - loss 0.52890858 throughput (samples/sec): 169.25
2019-08-13 12:53:04,148 epoch 14 - iter 294/493 - loss 0.51594853 throughput (samples/sec): 185.56
2019-08-13 12:53:12,600 epoch 14 - iter 343/493 - loss 0.51501712 throughput (samples/sec): 186.04
2019-08-13 12:53:21,118 epoch 14 - iter 392/493 - loss 0.51036988 throughput (samples/sec): 184.61
2019-08-13 12:53:29,778 epoch 14 - iter 441/493 - loss 0.50188980 throughput (samples/sec): 181.58
2019-08-13 12:53:37,973 epoch 14 - iter 490/493 - loss 0.50366245 throughput (samples/sec): 191.90
2019-08-13 12:53:38,310 ----------------------------------------------------------------------------------------------------
2019-08-13 12:53:38,310 EPOCH 14 done: loss 0.5055 - lr 0.1000
2019-08-13 12:53:38,310 BAD EPOCHS (no improvement): 0
2019-08-13 12:53:38,311 ----------------------------------------------------------------------------------------------------
2019-08-13 12:53:38,497 epoch 15 - iter 0/493 - loss 0.65806317 throughput (samples/sec): 8455.69
2019-08-13 12:53:46,838 epoch 15 - iter 49/493 - loss 0.45747295 throughput (samples/sec): 188.54
2019-08-13 12:53:55,103 epoch 15 - iter 98/493 - loss 0.47279819 throughput (samples/sec): 190.27
2019-08-13 12:54:03,639 epoch 15 - iter 147/493 - loss 0.47034463 throughput (samples/sec): 184.21
2019-08-13 12:54:12,500 epoch 15 - iter 196/493 - loss 0.47543002 throughput (samples/sec): 177.45
2019-08-13 12:54:20,793 epoch 15 - iter 245/493 - loss 0.47646426 throughput (samples/sec): 189.63
2019-08-13 12:54:29,529 epoch 15 - iter 294/493 - loss 0.48043800 throughput (samples/sec): 179.98
2019-08-13 12:54:38,246 epoch 15 - iter 343/493 - loss 0.48243843 throughput (samples/sec): 180.38
2019-08-13 12:54:47,186 epoch 15 - iter 392/493 - loss 0.48056209 throughput (samples/sec): 175.87
2019-08-13 12:54:55,434 epoch 15 - iter 441/493 - loss 0.47781509 throughput (samples/sec): 190.68
2019-08-13 12:55:03,749 epoch 15 - iter 490/493 - loss 0.48123861 throughput (samples/sec): 189.12
2019-08-13 12:55:04,132 ----------------------------------------------------------------------------------------------------
2019-08-13 12:55:04,133 EPOCH 15 done: loss 0.4813 - lr 0.1000
2019-08-13 12:55:04,133 BAD EPOCHS (no improvement): 0
2019-08-13 12:55:04,133 ----------------------------------------------------------------------------------------------------
2019-08-13 12:55:04,284 epoch 16 - iter 0/493 - loss 0.32113385 throughput (samples/sec): 10463.07
2019-08-13 12:55:12,708 epoch 16 - iter 49/493 - loss 0.42261627 throughput (samples/sec): 186.68
2019-08-13 12:55:21,294 epoch 16 - iter 98/493 - loss 0.44550598 throughput (samples/sec): 183.16
2019-08-13 12:55:29,794 epoch 16 - iter 147/493 - loss 0.45848858 throughput (samples/sec): 185.00
2019-08-13 12:55:38,239 epoch 16 - iter 196/493 - loss 0.45489328 throughput (samples/sec): 186.20
2019-08-13 12:55:46,948 epoch 16 - iter 245/493 - loss 0.44736206 throughput (samples/sec): 180.57
2019-08-13 12:55:55,667 epoch 16 - iter 294/493 - loss 0.44605506 throughput (samples/sec): 180.32
2019-08-13 12:56:04,091 epoch 16 - iter 343/493 - loss 0.44256951 throughput (samples/sec): 186.68
2019-08-13 12:56:12,362 epoch 16 - iter 392/493 - loss 0.45432907 throughput (samples/sec): 190.14
2019-08-13 12:56:21,196 epoch 16 - iter 441/493 - loss 0.45926406 throughput (samples/sec): 177.99
2019-08-13 12:56:30,036 epoch 16 - iter 490/493 - loss 0.46217313 throughput (samples/sec): 177.87
2019-08-13 12:56:30,339 ----------------------------------------------------------------------------------------------------
2019-08-13 12:56:30,339 EPOCH 16 done: loss 0.4617 - lr 0.1000
2019-08-13 12:56:30,339 BAD EPOCHS (no improvement): 0
2019-08-13 12:56:30,339 ----------------------------------------------------------------------------------------------------
2019-08-13 12:56:30,479 epoch 17 - iter 0/493 - loss 0.45685747 throughput (samples/sec): 11265.08
2019-08-13 12:56:39,201 epoch 17 - iter 49/493 - loss 0.45634410 throughput (samples/sec): 180.28
2019-08-13 12:56:47,752 epoch 17 - iter 98/493 - loss 0.45014080 throughput (samples/sec): 183.90
2019-08-13 12:56:56,485 epoch 17 - iter 147/493 - loss 0.44057460 throughput (samples/sec): 180.04
2019-08-13 12:57:05,508 epoch 17 - iter 196/493 - loss 0.44643217 throughput (samples/sec): 174.25
2019-08-13 12:57:13,826 epoch 17 - iter 245/493 - loss 0.45872864 throughput (samples/sec): 189.06
2019-08-13 12:57:22,073 epoch 17 - iter 294/493 - loss 0.45752462 throughput (samples/sec): 190.70
2019-08-13 12:57:30,289 epoch 17 - iter 343/493 - loss 0.45096910 throughput (samples/sec): 191.42
2019-08-13 12:57:38,794 epoch 17 - iter 392/493 - loss 0.44406229 throughput (samples/sec): 184.88
2019-08-13 12:57:47,307 epoch 17 - iter 441/493 - loss 0.44404171 throughput (samples/sec): 184.73
2019-08-13 12:57:55,599 epoch 17 - iter 490/493 - loss 0.44512019 throughput (samples/sec): 189.64
2019-08-13 12:57:55,977 ----------------------------------------------------------------------------------------------------
2019-08-13 12:57:55,977 EPOCH 17 done: loss 0.4455 - lr 0.1000
2019-08-13 12:57:55,977 BAD EPOCHS (no improvement): 0
2019-08-13 12:57:55,977 ----------------------------------------------------------------------------------------------------
2019-08-13 12:57:56,138 epoch 18 - iter 0/493 - loss 0.83245289 throughput (samples/sec): 9807.36
2019-08-13 12:58:04,769 epoch 18 - iter 49/493 - loss 0.43407969 throughput (samples/sec): 182.18
2019-08-13 12:58:13,572 epoch 18 - iter 98/493 - loss 0.41251757 throughput (samples/sec): 178.62
2019-08-13 12:58:21,956 epoch 18 - iter 147/493 - loss 0.41424506 throughput (samples/sec): 187.56
2019-08-13 12:58:30,889 epoch 18 - iter 196/493 - loss 0.39679573 throughput (samples/sec): 176.02
2019-08-13 12:58:39,360 epoch 18 - iter 245/493 - loss 0.41381138 throughput (samples/sec): 185.62
2019-08-13 12:58:47,827 epoch 18 - iter 294/493 - loss 0.42376393 throughput (samples/sec): 185.73
2019-08-13 12:58:56,084 epoch 18 - iter 343/493 - loss 0.42191917 throughput (samples/sec): 190.46
2019-08-13 12:59:04,895 epoch 18 - iter 392/493 - loss 0.42249173 throughput (samples/sec): 178.46
2019-08-13 12:59:13,104 epoch 18 - iter 441/493 - loss 0.42190314 throughput (samples/sec): 191.58
2019-08-13 12:59:21,436 epoch 18 - iter 490/493 - loss 0.42838264 throughput (samples/sec): 188.74
2019-08-13 12:59:21,750 ----------------------------------------------------------------------------------------------------
2019-08-13 12:59:21,751 EPOCH 18 done: loss 0.4287 - lr 0.1000
2019-08-13 12:59:21,751 BAD EPOCHS (no improvement): 0
2019-08-13 12:59:21,751 ----------------------------------------------------------------------------------------------------
2019-08-13 12:59:21,906 epoch 19 - iter 0/493 - loss 0.32538933 throughput (samples/sec): 10170.31
2019-08-13 12:59:30,553 epoch 19 - iter 49/493 - loss 0.43862224 throughput (samples/sec): 181.87
2019-08-13 12:59:39,195 epoch 19 - iter 98/493 - loss 0.40404903 throughput (samples/sec): 181.95
2019-08-13 12:59:47,506 epoch 19 - iter 147/493 - loss 0.40339020 throughput (samples/sec): 189.21
2019-08-13 12:59:56,230 epoch 19 - iter 196/493 - loss 0.40988937 throughput (samples/sec): 180.23
2019-08-13 13:00:04,481 epoch 19 - iter 245/493 - loss 0.41370059 throughput (samples/sec): 190.60
2019-08-13 13:00:13,266 epoch 19 - iter 294/493 - loss 0.41817647 throughput (samples/sec): 179.00
2019-08-13 13:00:21,587 epoch 19 - iter 343/493 - loss 0.41435126 throughput (samples/sec): 188.99
2019-08-13 13:00:30,016 epoch 19 - iter 392/493 - loss 0.41686264 throughput (samples/sec): 186.56
2019-08-13 13:00:38,613 epoch 19 - iter 441/493 - loss 0.41744207 throughput (samples/sec): 182.90
2019-08-13 13:00:47,305 epoch 19 - iter 490/493 - loss 0.41547419 throughput (samples/sec): 180.90
2019-08-13 13:00:47,698 ----------------------------------------------------------------------------------------------------
2019-08-13 13:00:47,698 EPOCH 19 done: loss 0.4173 - lr 0.1000
2019-08-13 13:00:47,698 BAD EPOCHS (no improvement): 0
2019-08-13 13:00:47,699 ----------------------------------------------------------------------------------------------------
2019-08-13 13:00:47,906 epoch 20 - iter 0/493 - loss 0.37347433 throughput (samples/sec): 7602.44
2019-08-13 13:00:56,391 epoch 20 - iter 49/493 - loss 0.44384164 throughput (samples/sec): 185.33
2019-08-13 13:01:05,284 epoch 20 - iter 98/493 - loss 0.41577730 throughput (samples/sec): 176.80
2019-08-13 13:01:13,693 epoch 20 - iter 147/493 - loss 0.39876110 throughput (samples/sec): 187.00
2019-08-13 13:01:22,157 epoch 20 - iter 196/493 - loss 0.38109033 throughput (samples/sec): 185.79
2019-08-13 13:01:30,654 epoch 20 - iter 245/493 - loss 0.38249509 throughput (samples/sec): 185.06
2019-08-13 13:01:39,264 epoch 20 - iter 294/493 - loss 0.37667877 throughput (samples/sec): 182.63
2019-08-13 13:01:47,989 epoch 20 - iter 343/493 - loss 0.38357111 throughput (samples/sec): 180.21
2019-08-13 13:01:56,767 epoch 20 - iter 392/493 - loss 0.39134447 throughput (samples/sec): 179.14
2019-08-13 13:02:05,338 epoch 20 - iter 441/493 - loss 0.39523744 throughput (samples/sec): 183.46
2019-08-13 13:02:14,015 epoch 20 - iter 490/493 - loss 0.39552516 throughput (samples/sec): 181.20
2019-08-13 13:02:14,395 ----------------------------------------------------------------------------------------------------
2019-08-13 13:02:14,395 EPOCH 20 done: loss 0.3959 - lr 0.1000
2019-08-13 13:02:14,396 BAD EPOCHS (no improvement): 0
2019-08-13 13:02:14,396 ----------------------------------------------------------------------------------------------------
2019-08-13 13:02:14,609 epoch 21 - iter 0/493 - loss 0.15595460 throughput (samples/sec): 7374.41
2019-08-13 13:02:22,910 epoch 21 - iter 49/493 - loss 0.40143904 throughput (samples/sec): 189.45
2019-08-13 13:02:31,462 epoch 21 - iter 98/493 - loss 0.37842845 throughput (samples/sec): 183.88
2019-08-13 13:02:39,642 epoch 21 - iter 147/493 - loss 0.38100905 throughput (samples/sec): 192.26
2019-08-13 13:02:48,215 epoch 21 - iter 196/493 - loss 0.37830083 throughput (samples/sec): 183.41
2019-08-13 13:02:56,474 epoch 21 - iter 245/493 - loss 0.37267664 throughput (samples/sec): 190.43
2019-08-13 13:03:05,541 epoch 21 - iter 294/493 - loss 0.36998370 throughput (samples/sec): 173.39
2019-08-13 13:03:14,453 epoch 21 - iter 343/493 - loss 0.37208267 throughput (samples/sec): 176.44
2019-08-13 13:03:22,885 epoch 21 - iter 392/493 - loss 0.37520443 throughput (samples/sec): 186.50
2019-08-13 13:03:31,538 epoch 21 - iter 441/493 - loss 0.37833698 throughput (samples/sec): 181.71
2019-08-13 13:03:40,169 epoch 21 - iter 490/493 - loss 0.38408806 throughput (samples/sec): 182.19
2019-08-13 13:03:40,580 ----------------------------------------------------------------------------------------------------
2019-08-13 13:03:40,580 EPOCH 21 done: loss 0.3835 - lr 0.1000
2019-08-13 13:03:40,580 BAD EPOCHS (no improvement): 0
2019-08-13 13:03:40,580 ----------------------------------------------------------------------------------------------------
2019-08-13 13:03:40,773 epoch 22 - iter 0/493 - loss 0.38031760 throughput (samples/sec): 8171.53
2019-08-13 13:03:49,158 epoch 22 - iter 49/493 - loss 0.40760530 throughput (samples/sec): 187.56
2019-08-13 13:03:58,171 epoch 22 - iter 98/493 - loss 0.37243043 throughput (samples/sec): 174.45
2019-08-13 13:04:07,200 epoch 22 - iter 147/493 - loss 0.37348899 throughput (samples/sec): 174.13
2019-08-13 13:04:15,717 epoch 22 - iter 196/493 - loss 0.36647534 throughput (samples/sec): 184.62
2019-08-13 13:04:24,123 epoch 22 - iter 245/493 - loss 0.36709750 throughput (samples/sec): 187.08
2019-08-13 13:04:32,431 epoch 22 - iter 294/493 - loss 0.37094147 throughput (samples/sec): 189.28
2019-08-13 13:04:41,066 epoch 22 - iter 343/493 - loss 0.37385356 throughput (samples/sec): 182.11
2019-08-13 13:04:49,091 epoch 22 - iter 392/493 - loss 0.37620894 throughput (samples/sec): 195.97
2019-08-13 13:04:57,781 epoch 22 - iter 441/493 - loss 0.37425201 throughput (samples/sec): 180.96
2019-08-13 13:05:06,163 epoch 22 - iter 490/493 - loss 0.37290107 throughput (samples/sec): 187.62
2019-08-13 13:05:06,522 ----------------------------------------------------------------------------------------------------
2019-08-13 13:05:06,523 EPOCH 22 done: loss 0.3729 - lr 0.1000
2019-08-13 13:05:06,523 BAD EPOCHS (no improvement): 0
2019-08-13 13:05:06,523 ----------------------------------------------------------------------------------------------------
2019-08-13 13:05:06,690 epoch 23 - iter 0/493 - loss 0.16041324 throughput (samples/sec): 9430.01
2019-08-13 13:05:15,480 epoch 23 - iter 49/493 - loss 0.34254282 throughput (samples/sec): 178.90
2019-08-13 13:05:23,959 epoch 23 - iter 98/493 - loss 0.34425312 throughput (samples/sec): 185.46
2019-08-13 13:05:32,099 epoch 23 - iter 147/493 - loss 0.35516957 throughput (samples/sec): 193.20
2019-08-13 13:05:40,887 epoch 23 - iter 196/493 - loss 0.36130304 throughput (samples/sec): 178.92
2019-08-13 13:05:49,580 epoch 23 - iter 245/493 - loss 0.37018444 throughput (samples/sec): 180.91
2019-08-13 13:05:58,195 epoch 23 - iter 294/493 - loss 0.36306766 throughput (samples/sec): 182.54
2019-08-13 13:06:07,247 epoch 23 - iter 343/493 - loss 0.37175198 throughput (samples/sec): 173.68
2019-08-13 13:06:15,441 epoch 23 - iter 392/493 - loss 0.36892259 throughput (samples/sec): 191.93
2019-08-13 13:06:23,741 epoch 23 - iter 441/493 - loss 0.36688239 throughput (samples/sec): 189.49
2019-08-13 13:06:32,394 epoch 23 - iter 490/493 - loss 0.36939711 throughput (samples/sec): 181.73
2019-08-13 13:06:32,769 ----------------------------------------------------------------------------------------------------
2019-08-13 13:06:32,769 EPOCH 23 done: loss 0.3696 - lr 0.1000
2019-08-13 13:06:32,769 BAD EPOCHS (no improvement): 0
2019-08-13 13:06:32,770 ----------------------------------------------------------------------------------------------------
2019-08-13 13:06:32,917 epoch 24 - iter 0/493 - loss 0.15900993 throughput (samples/sec): 10696.85
2019-08-13 13:06:41,202 epoch 24 - iter 49/493 - loss 0.30137997 throughput (samples/sec): 189.83
2019-08-13 13:06:49,526 epoch 24 - iter 98/493 - loss 0.31547144 throughput (samples/sec): 188.92
2019-08-13 13:06:57,759 epoch 24 - iter 147/493 - loss 0.32688311 throughput (samples/sec): 191.02
2019-08-13 13:07:06,430 epoch 24 - iter 196/493 - loss 0.32212229 throughput (samples/sec): 181.35
2019-08-13 13:07:15,543 epoch 24 - iter 245/493 - loss 0.32785766 throughput (samples/sec): 172.51
2019-08-13 13:07:24,136 epoch 24 - iter 294/493 - loss 0.32802132 throughput (samples/sec): 182.99
2019-08-13 13:07:32,580 epoch 24 - iter 343/493 - loss 0.32963013 throughput (samples/sec): 186.25
2019-08-13 13:07:41,267 epoch 24 - iter 392/493 - loss 0.33033821 throughput (samples/sec): 181.01
2019-08-13 13:07:49,952 epoch 24 - iter 441/493 - loss 0.33495684 throughput (samples/sec): 181.06
2019-08-13 13:07:58,343 epoch 24 - iter 490/493 - loss 0.33732090 throughput (samples/sec): 187.42
2019-08-13 13:07:58,648 ----------------------------------------------------------------------------------------------------
2019-08-13 13:07:58,648 EPOCH 24 done: loss 0.3377 - lr 0.1000
2019-08-13 13:07:58,648 BAD EPOCHS (no improvement): 0
2019-08-13 13:07:58,648 ----------------------------------------------------------------------------------------------------
2019-08-13 13:07:58,850 epoch 25 - iter 0/493 - loss 0.38993293 throughput (samples/sec): 7809.98
2019-08-13 13:08:07,305 epoch 25 - iter 49/493 - loss 0.30823894 throughput (samples/sec): 185.98
2019-08-13 13:08:16,134 epoch 25 - iter 98/493 - loss 0.30308885 throughput (samples/sec): 178.11
2019-08-13 13:08:24,466 epoch 25 - iter 147/493 - loss 0.31463880 throughput (samples/sec): 188.72
2019-08-13 13:08:33,351 epoch 25 - iter 196/493 - loss 0.31648569 throughput (samples/sec): 176.99
2019-08-13 13:08:41,788 epoch 25 - iter 245/493 - loss 0.32293284 throughput (samples/sec): 186.37
2019-08-13 13:08:50,598 epoch 25 - iter 294/493 - loss 0.32578427 throughput (samples/sec): 178.49
2019-08-13 13:08:59,155 epoch 25 - iter 343/493 - loss 0.32463334 throughput (samples/sec): 183.77
2019-08-13 13:09:07,786 epoch 25 - iter 392/493 - loss 0.33402222 throughput (samples/sec): 182.18
2019-08-13 13:09:16,434 epoch 25 - iter 441/493 - loss 0.33875732 throughput (samples/sec): 181.85
2019-08-13 13:09:24,948 epoch 25 - iter 490/493 - loss 0.34109263 throughput (samples/sec): 184.68
2019-08-13 13:09:25,307 ----------------------------------------------------------------------------------------------------
2019-08-13 13:09:25,307 EPOCH 25 done: loss 0.3409 - lr 0.1000
2019-08-13 13:09:25,307 BAD EPOCHS (no improvement): 1
2019-08-13 13:09:25,307 ----------------------------------------------------------------------------------------------------
2019-08-13 13:09:25,459 epoch 26 - iter 0/493 - loss 0.36861834 throughput (samples/sec): 10404.15
2019-08-13 13:09:34,194 epoch 26 - iter 49/493 - loss 0.33155598 throughput (samples/sec): 180.02
2019-08-13 13:09:42,498 epoch 26 - iter 98/493 - loss 0.34441156 throughput (samples/sec): 189.38
2019-08-13 13:09:51,165 epoch 26 - iter 147/493 - loss 0.34093977 throughput (samples/sec): 181.42
2019-08-13 13:09:59,790 epoch 26 - iter 196/493 - loss 0.33815420 throughput (samples/sec): 182.32
2019-08-13 13:10:08,239 epoch 26 - iter 245/493 - loss 0.34072901 throughput (samples/sec): 186.11
2019-08-13 13:10:16,949 epoch 26 - iter 294/493 - loss 0.34246755 throughput (samples/sec): 180.53
2019-08-13 13:10:25,472 epoch 26 - iter 343/493 - loss 0.33219704 throughput (samples/sec): 184.52
2019-08-13 13:10:33,891 epoch 26 - iter 392/493 - loss 0.33225220 throughput (samples/sec): 186.79
2019-08-13 13:10:43,059 epoch 26 - iter 441/493 - loss 0.33442864 throughput (samples/sec): 171.49
2019-08-13 13:10:51,275 epoch 26 - iter 490/493 - loss 0.33863137 throughput (samples/sec): 191.44
2019-08-13 13:10:51,632 ----------------------------------------------------------------------------------------------------
2019-08-13 13:10:51,633 EPOCH 26 done: loss 0.3401 - lr 0.1000
2019-08-13 13:10:51,633 BAD EPOCHS (no improvement): 2
2019-08-13 13:10:51,633 ----------------------------------------------------------------------------------------------------
2019-08-13 13:10:51,855 epoch 27 - iter 0/493 - loss 0.56846982 throughput (samples/sec): 7078.52
2019-08-13 13:11:00,447 epoch 27 - iter 49/493 - loss 0.35116105 throughput (samples/sec): 183.03
2019-08-13 13:11:08,763 epoch 27 - iter 98/493 - loss 0.33265639 throughput (samples/sec): 189.13
2019-08-13 13:11:17,576 epoch 27 - iter 147/493 - loss 0.32163946 throughput (samples/sec): 178.43
2019-08-13 13:11:26,085 epoch 27 - iter 196/493 - loss 0.32551415 throughput (samples/sec): 184.81
2019-08-13 13:11:34,712 epoch 27 - iter 245/493 - loss 0.32038006 throughput (samples/sec): 182.30
2019-08-13 13:11:43,096 epoch 27 - iter 294/493 - loss 0.32331425 throughput (samples/sec): 187.56
2019-08-13 13:11:51,706 epoch 27 - iter 343/493 - loss 0.31820772 throughput (samples/sec): 182.66
2019-08-13 13:12:00,242 epoch 27 - iter 392/493 - loss 0.31900627 throughput (samples/sec): 184.22
2019-08-13 13:12:09,050 epoch 27 - iter 441/493 - loss 0.32291329 throughput (samples/sec): 178.53
2019-08-13 13:12:17,821 epoch 27 - iter 490/493 - loss 0.32174085 throughput (samples/sec): 179.27
2019-08-13 13:12:18,233 ----------------------------------------------------------------------------------------------------
2019-08-13 13:12:18,233 EPOCH 27 done: loss 0.3214 - lr 0.1000
2019-08-13 13:12:18,233 BAD EPOCHS (no improvement): 0
2019-08-13 13:12:18,233 ----------------------------------------------------------------------------------------------------
2019-08-13 13:12:18,451 epoch 28 - iter 0/493 - loss 0.10151005 throughput (samples/sec): 7241.90
2019-08-13 13:12:26,903 epoch 28 - iter 49/493 - loss 0.25486740 throughput (samples/sec): 186.07
2019-08-13 13:12:35,591 epoch 28 - iter 98/493 - loss 0.27592506 throughput (samples/sec): 180.99
2019-08-13 13:12:44,215 epoch 28 - iter 147/493 - loss 0.28980302 throughput (samples/sec): 182.35
2019-08-13 13:12:52,597 epoch 28 - iter 196/493 - loss 0.28903667 throughput (samples/sec): 187.63
2019-08-13 13:13:01,365 epoch 28 - iter 245/493 - loss 0.29752108 throughput (samples/sec): 179.36
2019-08-13 13:13:10,061 epoch 28 - iter 294/493 - loss 0.30172152 throughput (samples/sec): 180.83
2019-08-13 13:13:18,662 epoch 28 - iter 343/493 - loss 0.30002782 throughput (samples/sec): 182.83
2019-08-13 13:13:27,334 epoch 28 - iter 392/493 - loss 0.30447476 throughput (samples/sec): 181.35
2019-08-13 13:13:35,702 epoch 28 - iter 441/493 - loss 0.30991827 throughput (samples/sec): 187.93
2019-08-13 13:13:44,142 epoch 28 - iter 490/493 - loss 0.31534626 throughput (samples/sec): 186.33
2019-08-13 13:13:44,514 ----------------------------------------------------------------------------------------------------
2019-08-13 13:13:44,514 EPOCH 28 done: loss 0.3147 - lr 0.1000
2019-08-13 13:13:44,514 BAD EPOCHS (no improvement): 0
2019-08-13 13:13:44,514 ----------------------------------------------------------------------------------------------------
2019-08-13 13:13:44,704 epoch 29 - iter 0/493 - loss 0.58358979 throughput (samples/sec): 8322.22
2019-08-13 13:13:53,879 epoch 29 - iter 49/493 - loss 0.30902729 throughput (samples/sec): 171.36
2019-08-13 13:14:02,446 epoch 29 - iter 98/493 - loss 0.30786715 throughput (samples/sec): 183.57
2019-08-13 13:14:11,101 epoch 29 - iter 147/493 - loss 0.31258818 throughput (samples/sec): 181.69
2019-08-13 13:14:19,613 epoch 29 - iter 196/493 - loss 0.30883840 throughput (samples/sec): 184.73
2019-08-13 13:14:28,156 epoch 29 - iter 245/493 - loss 0.30905582 throughput (samples/sec): 184.10
2019-08-13 13:14:36,955 epoch 29 - iter 294/493 - loss 0.30890569 throughput (samples/sec): 178.69
2019-08-13 13:14:45,384 epoch 29 - iter 343/493 - loss 0.30893863 throughput (samples/sec): 186.59
2019-08-13 13:14:53,702 epoch 29 - iter 392/493 - loss 0.31119523 throughput (samples/sec): 189.07
2019-08-13 13:15:01,885 epoch 29 - iter 441/493 - loss 0.30868978 throughput (samples/sec): 192.20
2019-08-13 13:15:10,519 epoch 29 - iter 490/493 - loss 0.31141302 throughput (samples/sec): 182.13
2019-08-13 13:15:10,831 ----------------------------------------------------------------------------------------------------
2019-08-13 13:15:10,831 EPOCH 29 done: loss 0.3113 - lr 0.1000
2019-08-13 13:15:10,831 BAD EPOCHS (no improvement): 0
2019-08-13 13:15:10,831 ----------------------------------------------------------------------------------------------------
2019-08-13 13:15:10,977 epoch 30 - iter 0/493 - loss 0.21257666 throughput (samples/sec): 10806.33
2019-08-13 13:15:19,583 epoch 30 - iter 49/493 - loss 0.24154660 throughput (samples/sec): 182.73
2019-08-13 13:15:27,869 epoch 30 - iter 98/493 - loss 0.25621088 throughput (samples/sec): 189.80
2019-08-13 13:15:36,593 epoch 30 - iter 147/493 - loss 0.26019654 throughput (samples/sec): 180.26
2019-08-13 13:15:45,234 epoch 30 - iter 196/493 - loss 0.27470920 throughput (samples/sec): 181.98
2019-08-13 13:15:53,770 epoch 30 - iter 245/493 - loss 0.27231044 throughput (samples/sec): 184.23
2019-08-13 13:16:02,469 epoch 30 - iter 294/493 - loss 0.28895769 throughput (samples/sec): 180.77
2019-08-13 13:16:11,557 epoch 30 - iter 343/493 - loss 0.29721795 throughput (samples/sec): 173.01
2019-08-13 13:16:20,072 epoch 30 - iter 392/493 - loss 0.30228754 throughput (samples/sec): 184.67
2019-08-13 13:16:28,420 epoch 30 - iter 441/493 - loss 0.30274320 throughput (samples/sec): 188.39
2019-08-13 13:16:37,034 epoch 30 - iter 490/493 - loss 0.30512158 throughput (samples/sec): 182.56
2019-08-13 13:16:37,429 ----------------------------------------------------------------------------------------------------
2019-08-13 13:16:37,429 EPOCH 30 done: loss 0.3056 - lr 0.1000
2019-08-13 13:16:37,429 BAD EPOCHS (no improvement): 0
2019-08-13 13:16:37,430 ----------------------------------------------------------------------------------------------------
2019-08-13 13:16:37,597 epoch 31 - iter 0/493 - loss 0.42581978 throughput (samples/sec): 9436.25
2019-08-13 13:16:46,336 epoch 31 - iter 49/493 - loss 0.27120700 throughput (samples/sec): 179.93
2019-08-13 13:16:55,011 epoch 31 - iter 98/493 - loss 0.28992774 throughput (samples/sec): 181.27
2019-08-13 13:17:03,462 epoch 31 - iter 147/493 - loss 0.30485076 throughput (samples/sec): 186.09
2019-08-13 13:17:12,177 epoch 31 - iter 196/493 - loss 0.31276080 throughput (samples/sec): 180.45
2019-08-13 13:17:20,773 epoch 31 - iter 245/493 - loss 0.30976130 throughput (samples/sec): 182.93
2019-08-13 13:17:29,333 epoch 31 - iter 294/493 - loss 0.31058574 throughput (samples/sec): 183.72
2019-08-13 13:17:37,684 epoch 31 - iter 343/493 - loss 0.30488883 throughput (samples/sec): 188.33
2019-08-13 13:17:46,305 epoch 31 - iter 392/493 - loss 0.30453494 throughput (samples/sec): 182.41
2019-08-13 13:17:55,060 epoch 31 - iter 441/493 - loss 0.30579607 throughput (samples/sec): 179.60
2019-08-13 13:18:03,626 epoch 31 - iter 490/493 - loss 0.30464687 throughput (samples/sec): 183.60
2019-08-13 13:18:03,986 ----------------------------------------------------------------------------------------------------
2019-08-13 13:18:03,986 EPOCH 31 done: loss 0.3041 - lr 0.1000
2019-08-13 13:18:03,986 BAD EPOCHS (no improvement): 0
2019-08-13 13:18:03,987 ----------------------------------------------------------------------------------------------------
2019-08-13 13:18:04,143 epoch 32 - iter 0/493 - loss 0.51433909 throughput (samples/sec): 10078.46
2019-08-13 13:18:12,850 epoch 32 - iter 49/493 - loss 0.33752194 throughput (samples/sec): 180.60
2019-08-13 13:18:21,205 epoch 32 - iter 98/493 - loss 0.29868747 throughput (samples/sec): 188.24
2019-08-13 13:18:29,854 epoch 32 - iter 147/493 - loss 0.29511956 throughput (samples/sec): 181.82
2019-08-13 13:18:38,327 epoch 32 - iter 196/493 - loss 0.29091224 throughput (samples/sec): 185.60
2019-08-13 13:18:47,158 epoch 32 - iter 245/493 - loss 0.29001353 throughput (samples/sec): 178.08
2019-08-13 13:18:55,885 epoch 32 - iter 294/493 - loss 0.28295410 throughput (samples/sec): 180.18
2019-08-13 13:19:04,516 epoch 32 - iter 343/493 - loss 0.28561890 throughput (samples/sec): 182.19
2019-08-13 13:19:13,234 epoch 32 - iter 392/493 - loss 0.28432568 throughput (samples/sec): 180.39
2019-08-13 13:19:21,271 epoch 32 - iter 441/493 - loss 0.28732165 throughput (samples/sec): 195.69
2019-08-13 13:19:30,284 epoch 32 - iter 490/493 - loss 0.28772223 throughput (samples/sec): 174.45
2019-08-13 13:19:30,646 ----------------------------------------------------------------------------------------------------
2019-08-13 13:19:30,646 EPOCH 32 done: loss 0.2886 - lr 0.1000
2019-08-13 13:19:30,646 BAD EPOCHS (no improvement): 0
2019-08-13 13:19:30,647 ----------------------------------------------------------------------------------------------------
2019-08-13 13:19:30,807 epoch 33 - iter 0/493 - loss 0.23711374 throughput (samples/sec): 9820.29
2019-08-13 13:19:39,427 epoch 33 - iter 49/493 - loss 0.25960778 throughput (samples/sec): 182.43
2019-08-13 13:19:47,997 epoch 33 - iter 98/493 - loss 0.26672792 throughput (samples/sec): 183.50
2019-08-13 13:19:56,679 epoch 33 - iter 147/493 - loss 0.27107936 throughput (samples/sec): 181.12
2019-08-13 13:20:05,432 epoch 33 - iter 196/493 - loss 0.27098579 throughput (samples/sec): 179.65
2019-08-13 13:20:14,150 epoch 33 - iter 245/493 - loss 0.27501836 throughput (samples/sec): 180.38
2019-08-13 13:20:22,952 epoch 33 - iter 294/493 - loss 0.27872276 throughput (samples/sec): 178.64
2019-08-13 13:20:31,440 epoch 33 - iter 343/493 - loss 0.27780728 throughput (samples/sec): 185.28
2019-08-13 13:20:39,935 epoch 33 - iter 392/493 - loss 0.28116317 throughput (samples/sec): 185.12
2019-08-13 13:20:48,583 epoch 33 - iter 441/493 - loss 0.28705013 throughput (samples/sec): 181.84
2019-08-13 13:20:57,106 epoch 33 - iter 490/493 - loss 0.29157583 throughput (samples/sec): 184.51
2019-08-13 13:20:57,456 ----------------------------------------------------------------------------------------------------
2019-08-13 13:20:57,456 EPOCH 33 done: loss 0.2917 - lr 0.1000
2019-08-13 13:20:57,456 BAD EPOCHS (no improvement): 1
2019-08-13 13:20:57,456 ----------------------------------------------------------------------------------------------------
2019-08-13 13:20:57,611 epoch 34 - iter 0/493 - loss 0.37360695 throughput (samples/sec): 10213.92
2019-08-13 13:21:06,288 epoch 34 - iter 49/493 - loss 0.25804191 throughput (samples/sec): 181.22
2019-08-13 13:21:14,625 epoch 34 - iter 98/493 - loss 0.27329150 throughput (samples/sec): 188.65
2019-08-13 13:21:23,093 epoch 34 - iter 147/493 - loss 0.27029744 throughput (samples/sec): 185.71
2019-08-13 13:21:31,882 epoch 34 - iter 196/493 - loss 0.27303168 throughput (samples/sec): 178.92
2019-08-13 13:21:40,814 epoch 34 - iter 245/493 - loss 0.26437437 throughput (samples/sec): 176.05
2019-08-13 13:21:49,499 epoch 34 - iter 294/493 - loss 0.26782224 throughput (samples/sec): 181.06
2019-08-13 13:21:58,193 epoch 34 - iter 343/493 - loss 0.27095409 throughput (samples/sec): 180.88
2019-08-13 13:22:06,624 epoch 34 - iter 392/493 - loss 0.27822504 throughput (samples/sec): 186.52
2019-08-13 13:22:15,045 epoch 34 - iter 441/493 - loss 0.27567254 throughput (samples/sec): 186.75
2019-08-13 13:22:23,600 epoch 34 - iter 490/493 - loss 0.27717298 throughput (samples/sec): 183.84
2019-08-13 13:22:23,972 ----------------------------------------------------------------------------------------------------
2019-08-13 13:22:23,972 EPOCH 34 done: loss 0.2765 - lr 0.1000
2019-08-13 13:22:23,972 BAD EPOCHS (no improvement): 0
2019-08-13 13:22:23,972 ----------------------------------------------------------------------------------------------------
2019-08-13 13:22:24,135 epoch 35 - iter 0/493 - loss 0.45720294 throughput (samples/sec): 9671.78
2019-08-13 13:22:32,645 epoch 35 - iter 49/493 - loss 0.26099602 throughput (samples/sec): 184.80
2019-08-13 13:22:41,079 epoch 35 - iter 98/493 - loss 0.25000722 throughput (samples/sec): 186.46
2019-08-13 13:22:50,094 epoch 35 - iter 147/493 - loss 0.25258292 throughput (samples/sec): 174.41
2019-08-13 13:22:59,208 epoch 35 - iter 196/493 - loss 0.25386540 throughput (samples/sec): 172.51
2019-08-13 13:23:07,949 epoch 35 - iter 245/493 - loss 0.26040775 throughput (samples/sec): 179.90
2019-08-13 13:23:16,339 epoch 35 - iter 294/493 - loss 0.26710596 throughput (samples/sec): 187.46
2019-08-13 13:23:24,638 epoch 35 - iter 343/493 - loss 0.26637860 throughput (samples/sec): 189.50
2019-08-13 13:23:33,420 epoch 35 - iter 392/493 - loss 0.26808618 throughput (samples/sec): 179.05
2019-08-13 13:23:42,076 epoch 35 - iter 441/493 - loss 0.27056497 throughput (samples/sec): 181.68
2019-08-13 13:23:50,795 epoch 35 - iter 490/493 - loss 0.27051968 throughput (samples/sec): 180.35
2019-08-13 13:23:51,142 ----------------------------------------------------------------------------------------------------
2019-08-13 13:23:51,142 EPOCH 35 done: loss 0.2702 - lr 0.1000
2019-08-13 13:23:51,142 BAD EPOCHS (no improvement): 0
2019-08-13 13:23:51,142 ----------------------------------------------------------------------------------------------------
2019-08-13 13:23:51,320 epoch 36 - iter 0/493 - loss 0.43819594 throughput (samples/sec): 8893.95
2019-08-13 13:23:59,636 epoch 36 - iter 49/493 - loss 0.29495765 throughput (samples/sec): 189.11
2019-08-13 13:24:08,501 epoch 36 - iter 98/493 - loss 0.28028682 throughput (samples/sec): 177.38
2019-08-13 13:24:17,524 epoch 36 - iter 147/493 - loss 0.27867891 throughput (samples/sec): 174.26
2019-08-13 13:24:26,136 epoch 36 - iter 196/493 - loss 0.27760053 throughput (samples/sec): 182.60
2019-08-13 13:24:34,494 epoch 36 - iter 245/493 - loss 0.27643387 throughput (samples/sec): 188.16
2019-08-13 13:24:43,042 epoch 36 - iter 294/493 - loss 0.26476608 throughput (samples/sec): 183.96
2019-08-13 13:24:52,006 epoch 36 - iter 343/493 - loss 0.27202004 throughput (samples/sec): 175.42
2019-08-13 13:25:00,367 epoch 36 - iter 392/493 - loss 0.26888030 throughput (samples/sec): 188.10
2019-08-13 13:25:08,938 epoch 36 - iter 441/493 - loss 0.27220951 throughput (samples/sec): 183.47
2019-08-13 13:25:17,518 epoch 36 - iter 490/493 - loss 0.27387796 throughput (samples/sec): 183.28
2019-08-13 13:25:17,852 ----------------------------------------------------------------------------------------------------
2019-08-13 13:25:17,852 EPOCH 36 done: loss 0.2729 - lr 0.1000
2019-08-13 13:25:17,852 BAD EPOCHS (no improvement): 1
2019-08-13 13:25:17,852 ----------------------------------------------------------------------------------------------------
2019-08-13 13:25:18,033 epoch 37 - iter 0/493 - loss 0.23242295 throughput (samples/sec): 8741.85
2019-08-13 13:25:26,682 epoch 37 - iter 49/493 - loss 0.25393972 throughput (samples/sec): 181.80
2019-08-13 13:25:35,483 epoch 37 - iter 98/493 - loss 0.25715930 throughput (samples/sec): 178.68
2019-08-13 13:25:44,218 epoch 37 - iter 147/493 - loss 0.25147262 throughput (samples/sec): 180.02
2019-08-13 13:25:53,126 epoch 37 - iter 196/493 - loss 0.24523397 throughput (samples/sec): 176.51
2019-08-13 13:26:01,693 epoch 37 - iter 245/493 - loss 0.24946296 throughput (samples/sec): 183.57
2019-08-13 13:26:10,434 epoch 37 - iter 294/493 - loss 0.25385495 throughput (samples/sec): 179.90
2019-08-13 13:26:18,916 epoch 37 - iter 343/493 - loss 0.25248900 throughput (samples/sec): 185.42
2019-08-13 13:26:27,237 epoch 37 - iter 392/493 - loss 0.25415011 throughput (samples/sec): 189.00
2019-08-13 13:26:35,744 epoch 37 - iter 441/493 - loss 0.25217384 throughput (samples/sec): 184.86
2019-08-13 13:26:44,091 epoch 37 - iter 490/493 - loss 0.25218345 throughput (samples/sec): 188.42
2019-08-13 13:26:44,576 ----------------------------------------------------------------------------------------------------
2019-08-13 13:26:44,576 EPOCH 37 done: loss 0.2516 - lr 0.1000
2019-08-13 13:26:44,576 BAD EPOCHS (no improvement): 0
2019-08-13 13:26:44,577 ----------------------------------------------------------------------------------------------------
2019-08-13 13:26:44,733 epoch 38 - iter 0/493 - loss 0.14609179 throughput (samples/sec): 10092.74
2019-08-13 13:26:53,115 epoch 38 - iter 49/493 - loss 0.28419751 throughput (samples/sec): 187.62
2019-08-13 13:27:02,053 epoch 38 - iter 98/493 - loss 0.26515254 throughput (samples/sec): 175.94
2019-08-13 13:27:10,648 epoch 38 - iter 147/493 - loss 0.25568470 throughput (samples/sec): 182.96
2019-08-13 13:27:19,325 epoch 38 - iter 196/493 - loss 0.25271590 throughput (samples/sec): 181.22
2019-08-13 13:27:27,786 epoch 38 - iter 245/493 - loss 0.25176335 throughput (samples/sec): 185.88
2019-08-13 13:27:36,192 epoch 38 - iter 294/493 - loss 0.24419705 throughput (samples/sec): 187.07
2019-08-13 13:27:44,981 epoch 38 - iter 343/493 - loss 0.24721059 throughput (samples/sec): 178.92
2019-08-13 13:27:53,316 epoch 38 - iter 392/493 - loss 0.24840939 throughput (samples/sec): 188.69
2019-08-13 13:28:02,351 epoch 38 - iter 441/493 - loss 0.24899780 throughput (samples/sec): 174.03
2019-08-13 13:28:10,878 epoch 38 - iter 490/493 - loss 0.24811893 throughput (samples/sec): 184.42
2019-08-13 13:28:11,198 ----------------------------------------------------------------------------------------------------
2019-08-13 13:28:11,198 EPOCH 38 done: loss 0.2478 - lr 0.1000
2019-08-13 13:28:11,198 BAD EPOCHS (no improvement): 0
2019-08-13 13:28:11,199 ----------------------------------------------------------------------------------------------------
2019-08-13 13:28:11,388 epoch 39 - iter 0/493 - loss 0.69354898 throughput (samples/sec): 8322.74
2019-08-13 13:28:19,979 epoch 39 - iter 49/493 - loss 0.24778159 throughput (samples/sec): 183.05
2019-08-13 13:28:28,443 epoch 39 - iter 98/493 - loss 0.24094343 throughput (samples/sec): 185.79
2019-08-13 13:28:37,102 epoch 39 - iter 147/493 - loss 0.24673668 throughput (samples/sec): 181.61
2019-08-13 13:28:45,950 epoch 39 - iter 196/493 - loss 0.24925890 throughput (samples/sec): 177.72
2019-08-13 13:28:54,507 epoch 39 - iter 245/493 - loss 0.24767995 throughput (samples/sec): 183.76
2019-08-13 13:29:03,156 epoch 39 - iter 294/493 - loss 0.24924776 throughput (samples/sec): 181.84
2019-08-13 13:29:11,401 epoch 39 - iter 343/493 - loss 0.24912652 throughput (samples/sec): 190.75
2019-08-13 13:29:20,265 epoch 39 - iter 392/493 - loss 0.24690468 throughput (samples/sec): 177.39
2019-08-13 13:29:29,198 epoch 39 - iter 441/493 - loss 0.25304322 throughput (samples/sec): 176.02
2019-08-13 13:29:37,623 epoch 39 - iter 490/493 - loss 0.25633785 throughput (samples/sec): 186.68
2019-08-13 13:29:37,940 ----------------------------------------------------------------------------------------------------
2019-08-13 13:29:37,940 EPOCH 39 done: loss 0.2567 - lr 0.1000
2019-08-13 13:29:37,940 BAD EPOCHS (no improvement): 1
2019-08-13 13:29:37,941 ----------------------------------------------------------------------------------------------------
2019-08-13 13:29:38,184 epoch 40 - iter 0/493 - loss 0.23012710 throughput (samples/sec): 6461.66
2019-08-13 13:29:46,929 epoch 40 - iter 49/493 - loss 0.24773637 throughput (samples/sec): 179.82
2019-08-13 13:29:55,457 epoch 40 - iter 98/493 - loss 0.22714260 throughput (samples/sec): 184.41
2019-08-13 13:30:04,342 epoch 40 - iter 147/493 - loss 0.22817360 throughput (samples/sec): 176.95
2019-08-13 13:30:12,627 epoch 40 - iter 196/493 - loss 0.23369204 throughput (samples/sec): 189.83
2019-08-13 13:30:21,309 epoch 40 - iter 245/493 - loss 0.24687028 throughput (samples/sec): 181.12
2019-08-13 13:30:29,910 epoch 40 - iter 294/493 - loss 0.24656931 throughput (samples/sec): 182.82
2019-08-13 13:30:38,211 epoch 40 - iter 343/493 - loss 0.24374586 throughput (samples/sec): 189.46
2019-08-13 13:30:46,760 epoch 40 - iter 392/493 - loss 0.23747550 throughput (samples/sec): 183.92
2019-08-13 13:30:55,043 epoch 40 - iter 441/493 - loss 0.23867609 throughput (samples/sec): 189.88
2019-08-13 13:31:03,827 epoch 40 - iter 490/493 - loss 0.23744767 throughput (samples/sec): 179.00
2019-08-13 13:31:04,167 ----------------------------------------------------------------------------------------------------
2019-08-13 13:31:04,167 EPOCH 40 done: loss 0.2371 - lr 0.1000
2019-08-13 13:31:04,167 BAD EPOCHS (no improvement): 0
2019-08-13 13:31:04,167 ----------------------------------------------------------------------------------------------------
2019-08-13 13:31:04,329 epoch 41 - iter 0/493 - loss 0.26353076 throughput (samples/sec): 9771.64
2019-08-13 13:31:12,929 epoch 41 - iter 49/493 - loss 0.24544868 throughput (samples/sec): 182.83
2019-08-13 13:31:21,433 epoch 41 - iter 98/493 - loss 0.24071392 throughput (samples/sec): 184.92
2019-08-13 13:31:30,263 epoch 41 - iter 147/493 - loss 0.23822908 throughput (samples/sec): 178.07
2019-08-13 13:31:38,950 epoch 41 - iter 196/493 - loss 0.25722413 throughput (samples/sec): 181.01
2019-08-13 13:31:47,562 epoch 41 - iter 245/493 - loss 0.25703082 throughput (samples/sec): 182.59
2019-08-13 13:31:56,042 epoch 41 - iter 294/493 - loss 0.25082908 throughput (samples/sec): 185.42
2019-08-13 13:32:04,471 epoch 41 - iter 343/493 - loss 0.24703262 throughput (samples/sec): 186.58
2019-08-13 13:32:12,714 epoch 41 - iter 392/493 - loss 0.24214273 throughput (samples/sec): 190.78
2019-08-13 13:32:21,094 epoch 41 - iter 441/493 - loss 0.24329319 throughput (samples/sec): 187.66
2019-08-13 13:32:29,626 epoch 41 - iter 490/493 - loss 0.24644695 throughput (samples/sec): 184.30
2019-08-13 13:32:30,064 ----------------------------------------------------------------------------------------------------
2019-08-13 13:32:30,064 EPOCH 41 done: loss 0.2472 - lr 0.1000
2019-08-13 13:32:30,064 BAD EPOCHS (no improvement): 1
2019-08-13 13:32:30,064 ----------------------------------------------------------------------------------------------------
2019-08-13 13:32:30,206 epoch 42 - iter 0/493 - loss 0.14465764 throughput (samples/sec): 11142.57
2019-08-13 13:32:38,708 epoch 42 - iter 49/493 - loss 0.22819171 throughput (samples/sec): 184.96
2019-08-13 13:32:47,333 epoch 42 - iter 98/493 - loss 0.22396815 throughput (samples/sec): 182.31
2019-08-13 13:32:55,952 epoch 42 - iter 147/493 - loss 0.23819072 throughput (samples/sec): 182.46
2019-08-13 13:33:05,035 epoch 42 - iter 196/493 - loss 0.24381560 throughput (samples/sec): 173.09
2019-08-13 13:33:13,709 epoch 42 - iter 245/493 - loss 0.24589754 throughput (samples/sec): 181.28
2019-08-13 13:33:22,267 epoch 42 - iter 294/493 - loss 0.24882664 throughput (samples/sec): 183.74
2019-08-13 13:33:30,969 epoch 42 - iter 343/493 - loss 0.24690578 throughput (samples/sec): 180.69
2019-08-13 13:33:39,184 epoch 42 - iter 392/493 - loss 0.24810100 throughput (samples/sec): 191.44
2019-08-13 13:33:47,442 epoch 42 - iter 441/493 - loss 0.24478427 throughput (samples/sec): 190.44
2019-08-13 13:33:56,098 epoch 42 - iter 490/493 - loss 0.24172878 throughput (samples/sec): 181.64
2019-08-13 13:33:56,456 ----------------------------------------------------------------------------------------------------
2019-08-13 13:33:56,456 EPOCH 42 done: loss 0.2423 - lr 0.1000
2019-08-13 13:33:56,456 BAD EPOCHS (no improvement): 2
2019-08-13 13:33:56,457 ----------------------------------------------------------------------------------------------------
2019-08-13 13:33:56,606 epoch 43 - iter 0/493 - loss 0.02929825 throughput (samples/sec): 10599.61
2019-08-13 13:34:04,953 epoch 43 - iter 49/493 - loss 0.19514494 throughput (samples/sec): 188.39
2019-08-13 13:34:13,605 epoch 43 - iter 98/493 - loss 0.21832304 throughput (samples/sec): 181.74
2019-08-13 13:34:21,998 epoch 43 - iter 147/493 - loss 0.21828803 throughput (samples/sec): 187.37
2019-08-13 13:34:30,513 epoch 43 - iter 196/493 - loss 0.22134843 throughput (samples/sec): 184.67
2019-08-13 13:34:38,880 epoch 43 - iter 245/493 - loss 0.22202311 throughput (samples/sec): 187.97
2019-08-13 13:34:47,118 epoch 43 - iter 294/493 - loss 0.22644072 throughput (samples/sec): 190.90
2019-08-13 13:34:55,894 epoch 43 - iter 343/493 - loss 0.22727654 throughput (samples/sec): 179.16
2019-08-13 13:35:04,409 epoch 43 - iter 392/493 - loss 0.23028358 throughput (samples/sec): 184.68
2019-08-13 13:35:13,632 epoch 43 - iter 441/493 - loss 0.23183110 throughput (samples/sec): 170.46
2019-08-13 13:35:22,144 epoch 43 - iter 490/493 - loss 0.23277271 throughput (samples/sec): 184.75
2019-08-13 13:35:22,445 ----------------------------------------------------------------------------------------------------
2019-08-13 13:35:22,445 EPOCH 43 done: loss 0.2326 - lr 0.1000
2019-08-13 13:35:22,445 BAD EPOCHS (no improvement): 0
2019-08-13 13:35:22,445 ----------------------------------------------------------------------------------------------------
2019-08-13 13:35:22,653 epoch 44 - iter 0/493 - loss 0.08769709 throughput (samples/sec): 7575.77
2019-08-13 13:35:31,111 epoch 44 - iter 49/493 - loss 0.20275163 throughput (samples/sec): 185.93
2019-08-13 13:35:39,929 epoch 44 - iter 98/493 - loss 0.22389514 throughput (samples/sec): 178.31
2019-08-13 13:35:48,338 epoch 44 - iter 147/493 - loss 0.21321526 throughput (samples/sec): 187.01
2019-08-13 13:35:56,741 epoch 44 - iter 196/493 - loss 0.20585991 throughput (samples/sec): 187.13
2019-08-13 13:36:05,064 epoch 44 - iter 245/493 - loss 0.20506668 throughput (samples/sec): 188.95
2019-08-13 13:36:13,566 epoch 44 - iter 294/493 - loss 0.21181616 throughput (samples/sec): 184.97
2019-08-13 13:36:21,903 epoch 44 - iter 343/493 - loss 0.21571163 throughput (samples/sec): 188.62
2019-08-13 13:36:30,410 epoch 44 - iter 392/493 - loss 0.21838385 throughput (samples/sec): 184.84
2019-08-13 13:36:38,817 epoch 44 - iter 441/493 - loss 0.22281854 throughput (samples/sec): 187.07
2019-08-13 13:36:48,017 epoch 44 - iter 490/493 - loss 0.22299195 throughput (samples/sec): 170.88
2019-08-13 13:36:48,341 ----------------------------------------------------------------------------------------------------
2019-08-13 13:36:48,342 EPOCH 44 done: loss 0.2228 - lr 0.1000
2019-08-13 13:36:48,342 BAD EPOCHS (no improvement): 0
2019-08-13 13:36:48,342 ----------------------------------------------------------------------------------------------------
2019-08-13 13:36:48,485 epoch 45 - iter 0/493 - loss 0.07462400 throughput (samples/sec): 11063.94
2019-08-13 13:36:56,868 epoch 45 - iter 49/493 - loss 0.23709719 throughput (samples/sec): 187.57
2019-08-13 13:37:05,408 epoch 45 - iter 98/493 - loss 0.21681044 throughput (samples/sec): 184.15
2019-08-13 13:37:14,215 epoch 45 - iter 147/493 - loss 0.22977275 throughput (samples/sec): 178.53
2019-08-13 13:37:22,501 epoch 45 - iter 196/493 - loss 0.22693101 throughput (samples/sec): 189.79
2019-08-13 13:37:30,811 epoch 45 - iter 245/493 - loss 0.23278961 throughput (samples/sec): 189.26
2019-08-13 13:37:39,153 epoch 45 - iter 294/493 - loss 0.23071546 throughput (samples/sec): 188.50
2019-08-13 13:37:47,803 epoch 45 - iter 343/493 - loss 0.23153426 throughput (samples/sec): 181.78
2019-08-13 13:37:56,324 epoch 45 - iter 392/493 - loss 0.22947047 throughput (samples/sec): 184.54
2019-08-13 13:38:05,198 epoch 45 - iter 441/493 - loss 0.22343307 throughput (samples/sec): 177.19
2019-08-13 13:38:14,107 epoch 45 - iter 490/493 - loss 0.22274655 throughput (samples/sec): 176.49
2019-08-13 13:38:14,479 ----------------------------------------------------------------------------------------------------
2019-08-13 13:38:14,479 EPOCH 45 done: loss 0.2223 - lr 0.1000
2019-08-13 13:38:14,479 BAD EPOCHS (no improvement): 0
2019-08-13 13:38:14,480 ----------------------------------------------------------------------------------------------------
2019-08-13 13:38:14,636 epoch 46 - iter 0/493 - loss 0.16420591 throughput (samples/sec): 10082.00
2019-08-13 13:38:23,037 epoch 46 - iter 49/493 - loss 0.19822553 throughput (samples/sec): 187.19
2019-08-13 13:38:31,660 epoch 46 - iter 98/493 - loss 0.21284257 throughput (samples/sec): 182.36
2019-08-13 13:38:39,960 epoch 46 - iter 147/493 - loss 0.20702680 throughput (samples/sec): 189.47
2019-08-13 13:38:48,840 epoch 46 - iter 196/493 - loss 0.20927286 throughput (samples/sec): 177.07
2019-08-13 13:38:57,074 epoch 46 - iter 245/493 - loss 0.20759362 throughput (samples/sec): 191.01
2019-08-13 13:39:05,579 epoch 46 - iter 294/493 - loss 0.21157774 throughput (samples/sec): 184.91
2019-08-13 13:39:14,223 epoch 46 - iter 343/493 - loss 0.20912233 throughput (samples/sec): 181.92
2019-08-13 13:39:22,838 epoch 46 - iter 392/493 - loss 0.21419702 throughput (samples/sec): 182.53
2019-08-13 13:39:31,276 epoch 46 - iter 441/493 - loss 0.21709244 throughput (samples/sec): 186.36
2019-08-13 13:39:40,018 epoch 46 - iter 490/493 - loss 0.22093786 throughput (samples/sec): 179.88
2019-08-13 13:39:40,384 ----------------------------------------------------------------------------------------------------
2019-08-13 13:39:40,384 EPOCH 46 done: loss 0.2206 - lr 0.1000
2019-08-13 13:39:40,384 BAD EPOCHS (no improvement): 0
2019-08-13 13:39:40,384 ----------------------------------------------------------------------------------------------------
2019-08-13 13:39:40,669 epoch 47 - iter 0/493 - loss 0.33604783 throughput (samples/sec): 5532.97
2019-08-13 13:39:49,037 epoch 47 - iter 49/493 - loss 0.22631970 throughput (samples/sec): 187.92
2019-08-13 13:39:57,400 epoch 47 - iter 98/493 - loss 0.22299204 throughput (samples/sec): 188.06
2019-08-13 13:40:06,328 epoch 47 - iter 147/493 - loss 0.20262379 throughput (samples/sec): 176.10
2019-08-13 13:40:15,128 epoch 47 - iter 196/493 - loss 0.20256662 throughput (samples/sec): 178.69
2019-08-13 13:40:23,301 epoch 47 - iter 245/493 - loss 0.20202292 throughput (samples/sec): 192.42
2019-08-13 13:40:31,792 epoch 47 - iter 294/493 - loss 0.20003346 throughput (samples/sec): 185.19
2019-08-13 13:40:40,065 epoch 47 - iter 343/493 - loss 0.20134074 throughput (samples/sec): 190.11
2019-08-13 13:40:48,866 epoch 47 - iter 392/493 - loss 0.20490537 throughput (samples/sec): 178.65
2019-08-13 13:40:57,419 epoch 47 - iter 441/493 - loss 0.20791655 throughput (samples/sec): 183.85
2019-08-13 13:41:06,009 epoch 47 - iter 490/493 - loss 0.20857130 throughput (samples/sec): 183.07
2019-08-13 13:41:06,364 ----------------------------------------------------------------------------------------------------
2019-08-13 13:41:06,365 EPOCH 47 done: loss 0.2085 - lr 0.1000
2019-08-13 13:41:06,365 BAD EPOCHS (no improvement): 0
2019-08-13 13:41:06,365 ----------------------------------------------------------------------------------------------------
2019-08-13 13:41:06,516 epoch 48 - iter 0/493 - loss 0.27528796 throughput (samples/sec): 10466.09
2019-08-13 13:41:15,009 epoch 48 - iter 49/493 - loss 0.18596754 throughput (samples/sec): 185.14
2019-08-13 13:41:23,589 epoch 48 - iter 98/493 - loss 0.19655749 throughput (samples/sec): 183.27
2019-08-13 13:41:32,039 epoch 48 - iter 147/493 - loss 0.19467149 throughput (samples/sec): 186.10
2019-08-13 13:41:40,887 epoch 48 - iter 196/493 - loss 0.19249502 throughput (samples/sec): 177.70
2019-08-13 13:41:49,751 epoch 48 - iter 245/493 - loss 0.19436551 throughput (samples/sec): 177.39
2019-08-13 13:41:58,050 epoch 48 - iter 294/493 - loss 0.19710409 throughput (samples/sec): 189.49
2019-08-13 13:42:06,437 epoch 48 - iter 343/493 - loss 0.19999715 throughput (samples/sec): 187.50
2019-08-13 13:42:14,986 epoch 48 - iter 392/493 - loss 0.20673300 throughput (samples/sec): 183.94
2019-08-13 13:42:23,547 epoch 48 - iter 441/493 - loss 0.21448544 throughput (samples/sec): 183.67
2019-08-13 13:42:31,858 epoch 48 - iter 490/493 - loss 0.21761146 throughput (samples/sec): 189.22
2019-08-13 13:42:32,264 ----------------------------------------------------------------------------------------------------
2019-08-13 13:42:32,265 EPOCH 48 done: loss 0.2170 - lr 0.1000
2019-08-13 13:42:32,265 BAD EPOCHS (no improvement): 1
2019-08-13 13:42:32,265 ----------------------------------------------------------------------------------------------------
2019-08-13 13:42:32,420 epoch 49 - iter 0/493 - loss 0.44328868 throughput (samples/sec): 10183.80
2019-08-13 13:42:41,008 epoch 49 - iter 49/493 - loss 0.20675680 throughput (samples/sec): 183.11
2019-08-13 13:42:49,647 epoch 49 - iter 98/493 - loss 0.20979611 throughput (samples/sec): 182.01
2019-08-13 13:42:58,415 epoch 49 - iter 147/493 - loss 0.19889925 throughput (samples/sec): 179.34
2019-08-13 13:43:06,798 epoch 49 - iter 196/493 - loss 0.19156934 throughput (samples/sec): 187.58
2019-08-13 13:43:15,111 epoch 49 - iter 245/493 - loss 0.18982234 throughput (samples/sec): 189.18
2019-08-13 13:43:23,674 epoch 49 - iter 294/493 - loss 0.19309803 throughput (samples/sec): 183.64
2019-08-13 13:43:32,105 epoch 49 - iter 343/493 - loss 0.19187686 throughput (samples/sec): 186.53
2019-08-13 13:43:40,693 epoch 49 - iter 392/493 - loss 0.19128661 throughput (samples/sec): 183.10
2019-08-13 13:43:49,212 epoch 49 - iter 441/493 - loss 0.19433984 throughput (samples/sec): 184.58
2019-08-13 13:43:57,877 epoch 49 - iter 490/493 - loss 0.19614039 throughput (samples/sec): 181.48
2019-08-13 13:43:58,218 ----------------------------------------------------------------------------------------------------
2019-08-13 13:43:58,218 EPOCH 49 done: loss 0.1964 - lr 0.1000
2019-08-13 13:43:58,218 BAD EPOCHS (no improvement): 0
2019-08-13 13:43:58,218 ----------------------------------------------------------------------------------------------------
2019-08-13 13:43:58,451 epoch 50 - iter 0/493 - loss 0.17841551 throughput (samples/sec): 6778.99
2019-08-13 13:44:07,242 epoch 50 - iter 49/493 - loss 0.16457466 throughput (samples/sec): 178.86
2019-08-13 13:44:15,473 epoch 50 - iter 98/493 - loss 0.17386461 throughput (samples/sec): 191.06
2019-08-13 13:44:24,295 epoch 50 - iter 147/493 - loss 0.18079607 throughput (samples/sec): 178.22
2019-08-13 13:44:32,931 epoch 50 - iter 196/493 - loss 0.18753052 throughput (samples/sec): 182.09
2019-08-13 13:44:41,176 epoch 50 - iter 245/493 - loss 0.18842114 throughput (samples/sec): 190.74
2019-08-13 13:44:49,347 epoch 50 - iter 294/493 - loss 0.18932797 throughput (samples/sec): 192.47
2019-08-13 13:44:57,972 epoch 50 - iter 343/493 - loss 0.18917586 throughput (samples/sec): 182.31
2019-08-13 13:45:06,768 epoch 50 - iter 392/493 - loss 0.19018867 throughput (samples/sec): 178.76
2019-08-13 13:45:15,349 epoch 50 - iter 441/493 - loss 0.19230708 throughput (samples/sec): 183.25
2019-08-13 13:45:24,101 epoch 50 - iter 490/493 - loss 0.19322786 throughput (samples/sec): 179.66
2019-08-13 13:45:24,398 ----------------------------------------------------------------------------------------------------
2019-08-13 13:45:24,398 EPOCH 50 done: loss 0.1929 - lr 0.1000
2019-08-13 13:45:24,399 BAD EPOCHS (no improvement): 0
2019-08-13 13:45:24,399 ----------------------------------------------------------------------------------------------------
2019-08-13 13:45:24,566 epoch 51 - iter 0/493 - loss 0.08613881 throughput (samples/sec): 9449.60
2019-08-13 13:45:33,103 epoch 51 - iter 49/493 - loss 0.20912389 throughput (samples/sec): 184.20
2019-08-13 13:45:41,378 epoch 51 - iter 98/493 - loss 0.19870644 throughput (samples/sec): 190.04
2019-08-13 13:45:50,374 epoch 51 - iter 147/493 - loss 0.20314390 throughput (samples/sec): 174.78
2019-08-13 13:45:58,292 epoch 51 - iter 196/493 - loss 0.20445490 throughput (samples/sec): 198.64
2019-08-13 13:46:06,749 epoch 51 - iter 245/493 - loss 0.20142859 throughput (samples/sec): 185.94
2019-08-13 13:46:14,982 epoch 51 - iter 294/493 - loss 0.19783331 throughput (samples/sec): 191.02
2019-08-13 13:46:23,745 epoch 51 - iter 343/493 - loss 0.20238963 throughput (samples/sec): 179.43
2019-08-13 13:46:32,458 epoch 51 - iter 392/493 - loss 0.20181119 throughput (samples/sec): 180.47
2019-08-13 13:46:41,261 epoch 51 - iter 441/493 - loss 0.20114972 throughput (samples/sec): 178.61
2019-08-13 13:46:49,882 epoch 51 - iter 490/493 - loss 0.19762465 throughput (samples/sec): 182.40
2019-08-13 13:46:50,198 ----------------------------------------------------------------------------------------------------
2019-08-13 13:46:50,198 EPOCH 51 done: loss 0.1973 - lr 0.1000
2019-08-13 13:46:50,198 BAD EPOCHS (no improvement): 1
2019-08-13 13:46:50,198 ----------------------------------------------------------------------------------------------------
2019-08-13 13:46:50,455 epoch 52 - iter 0/493 - loss 0.20600307 throughput (samples/sec): 6126.04
2019-08-13 13:46:58,872 epoch 52 - iter 49/493 - loss 0.20216907 throughput (samples/sec): 186.83
2019-08-13 13:47:07,277 epoch 52 - iter 98/493 - loss 0.18704792 throughput (samples/sec): 187.11
2019-08-13 13:47:15,737 epoch 52 - iter 147/493 - loss 0.19110908 throughput (samples/sec): 185.86
2019-08-13 13:47:24,425 epoch 52 - iter 196/493 - loss 0.19409071 throughput (samples/sec): 181.01
2019-08-13 13:47:33,072 epoch 52 - iter 245/493 - loss 0.20139150 throughput (samples/sec): 181.84
2019-08-13 13:47:41,831 epoch 52 - iter 294/493 - loss 0.20002864 throughput (samples/sec): 179.51
2019-08-13 13:47:50,732 epoch 52 - iter 343/493 - loss 0.20000024 throughput (samples/sec): 176.64
2019-08-13 13:47:59,068 epoch 52 - iter 392/493 - loss 0.19786069 throughput (samples/sec): 188.66
2019-08-13 13:48:07,825 epoch 52 - iter 441/493 - loss 0.20118994 throughput (samples/sec): 179.58
2019-08-13 13:48:16,417 epoch 52 - iter 490/493 - loss 0.20527906 throughput (samples/sec): 183.02
2019-08-13 13:48:16,768 ----------------------------------------------------------------------------------------------------
2019-08-13 13:48:16,768 EPOCH 52 done: loss 0.2048 - lr 0.1000
2019-08-13 13:48:16,768 BAD EPOCHS (no improvement): 2
2019-08-13 13:48:16,768 ----------------------------------------------------------------------------------------------------
2019-08-13 13:48:16,928 epoch 53 - iter 0/493 - loss 0.43876529 throughput (samples/sec): 9878.93
2019-08-13 13:48:25,208 epoch 53 - iter 49/493 - loss 0.20075739 throughput (samples/sec): 189.95
2019-08-13 13:48:33,724 epoch 53 - iter 98/493 - loss 0.20603170 throughput (samples/sec): 184.66
2019-08-13 13:48:42,545 epoch 53 - iter 147/493 - loss 0.19917689 throughput (samples/sec): 178.27
2019-08-13 13:48:51,184 epoch 53 - iter 196/493 - loss 0.18847527 throughput (samples/sec): 182.02
2019-08-13 13:48:59,943 epoch 53 - iter 245/493 - loss 0.18759137 throughput (samples/sec): 179.52
2019-08-13 13:49:08,313 epoch 53 - iter 294/493 - loss 0.19134202 throughput (samples/sec): 187.89
2019-08-13 13:49:16,904 epoch 53 - iter 343/493 - loss 0.19202214 throughput (samples/sec): 183.04
2019-08-13 13:49:25,454 epoch 53 - iter 392/493 - loss 0.18954289 throughput (samples/sec): 183.95
2019-08-13 13:49:34,228 epoch 53 - iter 441/493 - loss 0.19141205 throughput (samples/sec): 179.22
2019-08-13 13:49:43,015 epoch 53 - iter 490/493 - loss 0.19276253 throughput (samples/sec): 178.94
2019-08-13 13:49:43,417 ----------------------------------------------------------------------------------------------------
2019-08-13 13:49:43,418 EPOCH 53 done: loss 0.1928 - lr 0.1000
2019-08-13 13:49:43,418 BAD EPOCHS (no improvement): 0
2019-08-13 13:49:43,418 ----------------------------------------------------------------------------------------------------
2019-08-13 13:49:43,605 epoch 54 - iter 0/493 - loss 0.05410907 throughput (samples/sec): 8426.07
2019-08-13 13:49:52,417 epoch 54 - iter 49/493 - loss 0.17829184 throughput (samples/sec): 178.45
2019-08-13 13:50:00,893 epoch 54 - iter 98/493 - loss 0.18906935 throughput (samples/sec): 185.55
2019-08-13 13:50:09,746 epoch 54 - iter 147/493 - loss 0.18482968 throughput (samples/sec): 177.61
2019-08-13 13:50:18,546 epoch 54 - iter 196/493 - loss 0.18601380 throughput (samples/sec): 178.67
2019-08-13 13:50:27,027 epoch 54 - iter 245/493 - loss 0.17703706 throughput (samples/sec): 185.44
2019-08-13 13:50:35,524 epoch 54 - iter 294/493 - loss 0.18352570 throughput (samples/sec): 185.08
2019-08-13 13:50:44,230 epoch 54 - iter 343/493 - loss 0.18551989 throughput (samples/sec): 180.61
2019-08-13 13:50:52,846 epoch 54 - iter 392/493 - loss 0.18625803 throughput (samples/sec): 182.52
2019-08-13 13:51:01,660 epoch 54 - iter 441/493 - loss 0.18831141 throughput (samples/sec): 178.41
2019-08-13 13:51:10,056 epoch 54 - iter 490/493 - loss 0.18547113 throughput (samples/sec): 187.31
2019-08-13 13:51:10,358 ----------------------------------------------------------------------------------------------------
2019-08-13 13:51:10,358 EPOCH 54 done: loss 0.1853 - lr 0.1000
2019-08-13 13:51:10,359 BAD EPOCHS (no improvement): 0
2019-08-13 13:51:10,359 ----------------------------------------------------------------------------------------------------
2019-08-13 13:51:10,535 epoch 55 - iter 0/493 - loss 0.27022129 throughput (samples/sec): 8931.54
2019-08-13 13:51:19,028 epoch 55 - iter 49/493 - loss 0.19575577 throughput (samples/sec): 185.18
2019-08-13 13:51:27,291 epoch 55 - iter 98/493 - loss 0.18202834 throughput (samples/sec): 190.34
2019-08-13 13:51:35,855 epoch 55 - iter 147/493 - loss 0.19668895 throughput (samples/sec): 183.62
2019-08-13 13:51:44,473 epoch 55 - iter 196/493 - loss 0.19697697 throughput (samples/sec): 182.46
2019-08-13 13:51:52,779 epoch 55 - iter 245/493 - loss 0.19922227 throughput (samples/sec): 189.35
2019-08-13 13:52:01,141 epoch 55 - iter 294/493 - loss 0.20250797 throughput (samples/sec): 188.07
2019-08-13 13:52:10,206 epoch 55 - iter 343/493 - loss 0.20198044 throughput (samples/sec): 173.46
2019-08-13 13:52:18,880 epoch 55 - iter 392/493 - loss 0.19773541 throughput (samples/sec): 181.28
2019-08-13 13:52:27,342 epoch 55 - iter 441/493 - loss 0.19474941 throughput (samples/sec): 185.87
2019-08-13 13:52:36,238 epoch 55 - iter 490/493 - loss 0.19598700 throughput (samples/sec): 176.75
2019-08-13 13:52:36,582 ----------------------------------------------------------------------------------------------------
2019-08-13 13:52:36,582 EPOCH 55 done: loss 0.1958 - lr 0.1000
2019-08-13 13:52:36,582 BAD EPOCHS (no improvement): 1
2019-08-13 13:52:36,583 ----------------------------------------------------------------------------------------------------
2019-08-13 13:52:36,736 epoch 56 - iter 0/493 - loss 0.14742017 throughput (samples/sec): 10298.61
2019-08-13 13:52:45,504 epoch 56 - iter 49/493 - loss 0.15460273 throughput (samples/sec): 179.34
2019-08-13 13:52:54,302 epoch 56 - iter 98/493 - loss 0.17379424 throughput (samples/sec): 178.72
2019-08-13 13:53:02,978 epoch 56 - iter 147/493 - loss 0.16406477 throughput (samples/sec): 181.26
2019-08-13 13:53:11,431 epoch 56 - iter 196/493 - loss 0.16871137 throughput (samples/sec): 186.04
2019-08-13 13:53:19,897 epoch 56 - iter 245/493 - loss 0.17114755 throughput (samples/sec): 185.76
2019-08-13 13:53:28,764 epoch 56 - iter 294/493 - loss 0.17264912 throughput (samples/sec): 177.33
2019-08-13 13:53:37,274 epoch 56 - iter 343/493 - loss 0.18014659 throughput (samples/sec): 184.80
2019-08-13 13:53:45,763 epoch 56 - iter 392/493 - loss 0.17702290 throughput (samples/sec): 185.26
2019-08-13 13:53:54,417 epoch 56 - iter 441/493 - loss 0.17767964 throughput (samples/sec): 181.70
2019-08-13 13:54:02,587 epoch 56 - iter 490/493 - loss 0.17781591 throughput (samples/sec): 192.51
2019-08-13 13:54:02,957 ----------------------------------------------------------------------------------------------------
2019-08-13 13:54:02,957 EPOCH 56 done: loss 0.1773 - lr 0.1000
2019-08-13 13:54:02,957 BAD EPOCHS (no improvement): 0
2019-08-13 13:54:02,958 ----------------------------------------------------------------------------------------------------
2019-08-13 13:54:03,125 epoch 57 - iter 0/493 - loss 0.17734194 throughput (samples/sec): 9405.72
2019-08-13 13:54:11,734 epoch 57 - iter 49/493 - loss 0.20601394 throughput (samples/sec): 182.67
2019-08-13 13:54:20,494 epoch 57 - iter 98/493 - loss 0.17690941 throughput (samples/sec): 179.51
2019-08-13 13:54:29,349 epoch 57 - iter 147/493 - loss 0.17618170 throughput (samples/sec): 177.58
2019-08-13 13:54:37,915 epoch 57 - iter 196/493 - loss 0.17091835 throughput (samples/sec): 183.59
2019-08-13 13:54:46,341 epoch 57 - iter 245/493 - loss 0.17664622 throughput (samples/sec): 186.63
2019-08-13 13:54:54,887 epoch 57 - iter 294/493 - loss 0.17630082 throughput (samples/sec): 184.03
2019-08-13 13:55:03,641 epoch 57 - iter 343/493 - loss 0.17546327 throughput (samples/sec): 179.62
2019-08-13 13:55:12,050 epoch 57 - iter 392/493 - loss 0.17806788 throughput (samples/sec): 187.02
2019-08-13 13:55:20,959 epoch 57 - iter 441/493 - loss 0.18386903 throughput (samples/sec): 176.49
2019-08-13 13:55:29,415 epoch 57 - iter 490/493 - loss 0.18620315 throughput (samples/sec): 185.98
2019-08-13 13:55:29,779 ----------------------------------------------------------------------------------------------------
2019-08-13 13:55:29,780 EPOCH 57 done: loss 0.1871 - lr 0.1000
2019-08-13 13:55:29,780 BAD EPOCHS (no improvement): 1
2019-08-13 13:55:29,780 ----------------------------------------------------------------------------------------------------
2019-08-13 13:55:29,971 epoch 58 - iter 0/493 - loss 0.24860367 throughput (samples/sec): 8263.05
2019-08-13 13:55:38,556 epoch 58 - iter 49/493 - loss 0.18496217 throughput (samples/sec): 183.17
2019-08-13 13:55:46,947 epoch 58 - iter 98/493 - loss 0.17463885 throughput (samples/sec): 187.42
2019-08-13 13:55:55,332 epoch 58 - iter 147/493 - loss 0.18375687 throughput (samples/sec): 187.56
2019-08-13 13:56:03,803 epoch 58 - iter 196/493 - loss 0.18381316 throughput (samples/sec): 185.66
2019-08-13 13:56:12,558 epoch 58 - iter 245/493 - loss 0.18155176 throughput (samples/sec): 179.61
2019-08-13 13:56:21,045 epoch 58 - iter 294/493 - loss 0.18492559 throughput (samples/sec): 185.30
2019-08-13 13:56:29,774 epoch 58 - iter 343/493 - loss 0.18356461 throughput (samples/sec): 180.13
2019-08-13 13:56:38,258 epoch 58 - iter 392/493 - loss 0.17814990 throughput (samples/sec): 185.37
2019-08-13 13:56:47,427 epoch 58 - iter 441/493 - loss 0.17974223 throughput (samples/sec): 171.47
2019-08-13 13:56:55,919 epoch 58 - iter 490/493 - loss 0.18011574 throughput (samples/sec): 185.19
2019-08-13 13:56:56,404 ----------------------------------------------------------------------------------------------------
2019-08-13 13:56:56,404 EPOCH 58 done: loss 0.1807 - lr 0.1000
2019-08-13 13:56:56,404 BAD EPOCHS (no improvement): 2
2019-08-13 13:56:56,404 ----------------------------------------------------------------------------------------------------
2019-08-13 13:56:56,580 epoch 59 - iter 0/493 - loss 0.14894944 throughput (samples/sec): 8991.46
2019-08-13 13:57:05,160 epoch 59 - iter 49/493 - loss 0.16639755 throughput (samples/sec): 183.27
2019-08-13 13:57:13,550 epoch 59 - iter 98/493 - loss 0.16645714 throughput (samples/sec): 187.46
2019-08-13 13:57:21,827 epoch 59 - iter 147/493 - loss 0.16323380 throughput (samples/sec): 190.01
2019-08-13 13:57:30,368 epoch 59 - iter 196/493 - loss 0.15858471 throughput (samples/sec): 184.12
2019-08-13 13:57:38,987 epoch 59 - iter 245/493 - loss 0.16219947 throughput (samples/sec): 182.46
2019-08-13 13:57:48,105 epoch 59 - iter 294/493 - loss 0.16399589 throughput (samples/sec): 172.43
2019-08-13 13:57:56,643 epoch 59 - iter 343/493 - loss 0.16721037 throughput (samples/sec): 184.20
2019-08-13 13:58:05,708 epoch 59 - iter 392/493 - loss 0.16794018 throughput (samples/sec): 173.44
2019-08-13 13:58:14,195 epoch 59 - iter 441/493 - loss 0.16722767 throughput (samples/sec): 185.31
2019-08-13 13:58:22,465 epoch 59 - iter 490/493 - loss 0.16664719 throughput (samples/sec): 190.17
2019-08-13 13:58:22,826 ----------------------------------------------------------------------------------------------------
2019-08-13 13:58:22,826 EPOCH 59 done: loss 0.1668 - lr 0.1000
2019-08-13 13:58:22,826 BAD EPOCHS (no improvement): 0
2019-08-13 13:58:22,826 ----------------------------------------------------------------------------------------------------
2019-08-13 13:58:22,990 epoch 60 - iter 0/493 - loss 0.08807170 throughput (samples/sec): 9593.61
2019-08-13 13:58:31,313 epoch 60 - iter 49/493 - loss 0.13402895 throughput (samples/sec): 188.98
2019-08-13 13:58:39,994 epoch 60 - iter 98/493 - loss 0.13253379 throughput (samples/sec): 181.13
2019-08-13 13:58:48,292 epoch 60 - iter 147/493 - loss 0.14651745 throughput (samples/sec): 189.53
2019-08-13 13:58:56,730 epoch 60 - iter 196/493 - loss 0.15001050 throughput (samples/sec): 186.40
2019-08-13 13:59:05,211 epoch 60 - iter 245/493 - loss 0.15826376 throughput (samples/sec): 185.41
2019-08-13 13:59:14,328 epoch 60 - iter 294/493 - loss 0.16099535 throughput (samples/sec): 172.47
2019-08-13 13:59:23,253 epoch 60 - iter 343/493 - loss 0.16364460 throughput (samples/sec): 176.19
2019-08-13 13:59:31,719 epoch 60 - iter 392/493 - loss 0.16454670 throughput (samples/sec): 185.77
2019-08-13 13:59:40,486 epoch 60 - iter 441/493 - loss 0.16697537 throughput (samples/sec): 179.37
2019-08-13 13:59:49,095 epoch 60 - iter 490/493 - loss 0.16910700 throughput (samples/sec): 182.66
2019-08-13 13:59:49,434 ----------------------------------------------------------------------------------------------------
2019-08-13 13:59:49,434 EPOCH 60 done: loss 0.1688 - lr 0.1000
2019-08-13 13:59:49,434 BAD EPOCHS (no improvement): 1
2019-08-13 13:59:49,434 ----------------------------------------------------------------------------------------------------
2019-08-13 13:59:49,608 epoch 61 - iter 0/493 - loss 0.06532961 throughput (samples/sec): 9079.21
2019-08-13 13:59:58,108 epoch 61 - iter 49/493 - loss 0.13690905 throughput (samples/sec): 185.01
2019-08-13 14:00:06,998 epoch 61 - iter 98/493 - loss 0.17322578 throughput (samples/sec): 176.87
2019-08-13 14:00:15,426 epoch 61 - iter 147/493 - loss 0.16897484 throughput (samples/sec): 186.59
2019-08-13 14:00:23,754 epoch 61 - iter 196/493 - loss 0.16537393 throughput (samples/sec): 188.85
2019-08-13 14:00:32,480 epoch 61 - iter 245/493 - loss 0.16748502 throughput (samples/sec): 180.22
2019-08-13 14:00:41,411 epoch 61 - iter 294/493 - loss 0.17041871 throughput (samples/sec): 176.05
2019-08-13 14:00:49,793 epoch 61 - iter 343/493 - loss 0.16482247 throughput (samples/sec): 187.62
2019-08-13 14:00:58,549 epoch 61 - iter 392/493 - loss 0.16570040 throughput (samples/sec): 179.60
2019-08-13 14:01:07,385 epoch 61 - iter 441/493 - loss 0.16407899 throughput (samples/sec): 177.97
2019-08-13 14:01:15,967 epoch 61 - iter 490/493 - loss 0.17190961 throughput (samples/sec): 183.23
2019-08-13 14:01:16,300 ----------------------------------------------------------------------------------------------------
2019-08-13 14:01:16,301 EPOCH 61 done: loss 0.1715 - lr 0.1000
2019-08-13 14:01:16,301 BAD EPOCHS (no improvement): 2
2019-08-13 14:01:16,301 ----------------------------------------------------------------------------------------------------
2019-08-13 14:01:16,448 epoch 62 - iter 0/493 - loss 0.00582600 throughput (samples/sec): 10706.23
2019-08-13 14:01:24,876 epoch 62 - iter 49/493 - loss 0.12428242 throughput (samples/sec): 186.60
2019-08-13 14:01:33,573 epoch 62 - iter 98/493 - loss 0.15464350 throughput (samples/sec): 180.82
2019-08-13 14:01:42,265 epoch 62 - iter 147/493 - loss 0.16740625 throughput (samples/sec): 180.90
2019-08-13 14:01:50,600 epoch 62 - iter 196/493 - loss 0.16783225 throughput (samples/sec): 188.68
2019-08-13 14:01:59,344 epoch 62 - iter 245/493 - loss 0.17183657 throughput (samples/sec): 179.83
2019-08-13 14:02:07,733 epoch 62 - iter 294/493 - loss 0.17501722 throughput (samples/sec): 187.47
2019-08-13 14:02:16,557 epoch 62 - iter 343/493 - loss 0.17717036 throughput (samples/sec): 178.21
2019-08-13 14:02:25,308 epoch 62 - iter 392/493 - loss 0.17777706 throughput (samples/sec): 179.69
2019-08-13 14:02:33,769 epoch 62 - iter 441/493 - loss 0.17667191 throughput (samples/sec): 185.87
2019-08-13 14:02:42,446 epoch 62 - iter 490/493 - loss 0.17572807 throughput (samples/sec): 181.23
2019-08-13 14:02:42,806 ----------------------------------------------------------------------------------------------------
2019-08-13 14:02:42,806 EPOCH 62 done: loss 0.1758 - lr 0.1000
2019-08-13 14:02:42,806 BAD EPOCHS (no improvement): 3
2019-08-13 14:02:42,806 ----------------------------------------------------------------------------------------------------
2019-08-13 14:02:43,012 epoch 63 - iter 0/493 - loss 0.19633782 throughput (samples/sec): 7657.65
2019-08-13 14:02:51,379 epoch 63 - iter 49/493 - loss 0.19679528 throughput (samples/sec): 187.95
2019-08-13 14:02:59,999 epoch 63 - iter 98/493 - loss 0.18658040 throughput (samples/sec): 182.43
2019-08-13 14:03:08,544 epoch 63 - iter 147/493 - loss 0.18034645 throughput (samples/sec): 184.05
2019-08-13 14:03:17,046 epoch 63 - iter 196/493 - loss 0.17601248 throughput (samples/sec): 184.96
2019-08-13 14:03:25,435 epoch 63 - iter 245/493 - loss 0.17392074 throughput (samples/sec): 187.48
2019-08-13 14:03:34,630 epoch 63 - iter 294/493 - loss 0.17099954 throughput (samples/sec): 171.00
2019-08-13 14:03:43,421 epoch 63 - iter 343/493 - loss 0.16896377 throughput (samples/sec): 178.86
2019-08-13 14:03:51,893 epoch 63 - iter 392/493 - loss 0.17123750 throughput (samples/sec): 185.65
2019-08-13 14:04:00,798 epoch 63 - iter 441/493 - loss 0.16952163 throughput (samples/sec): 176.57
2019-08-13 14:04:09,197 epoch 63 - iter 490/493 - loss 0.16858163 throughput (samples/sec): 187.25
2019-08-13 14:04:09,539 ----------------------------------------------------------------------------------------------------
2019-08-13 14:04:09,539 EPOCH 63 done: loss 0.1684 - lr 0.1000
2019-08-13 14:04:09,540 BAD EPOCHS (no improvement): 4
2019-08-13 14:04:09,540 ----------------------------------------------------------------------------------------------------
2019-08-13 14:04:09,684 epoch 64 - iter 0/493 - loss 0.14104852 throughput (samples/sec): 10957.12
2019-08-13 14:04:18,019 epoch 64 - iter 49/493 - loss 0.14252550 throughput (samples/sec): 188.68
2019-08-13 14:04:26,549 epoch 64 - iter 98/493 - loss 0.14073285 throughput (samples/sec): 184.36
2019-08-13 14:04:34,923 epoch 64 - iter 147/493 - loss 0.14650798 throughput (samples/sec): 187.82
2019-08-13 14:04:43,683 epoch 64 - iter 196/493 - loss 0.14778361 throughput (samples/sec): 179.50
2019-08-13 14:04:52,702 epoch 64 - iter 245/493 - loss 0.14923975 throughput (samples/sec): 174.33
2019-08-13 14:05:01,231 epoch 64 - iter 294/493 - loss 0.15117273 throughput (samples/sec): 184.38
2019-08-13 14:05:09,773 epoch 64 - iter 343/493 - loss 0.15371011 throughput (samples/sec): 184.12
2019-08-13 14:05:18,143 epoch 64 - iter 392/493 - loss 0.15171335 throughput (samples/sec): 187.90
2019-08-13 14:05:27,344 epoch 64 - iter 441/493 - loss 0.14882477 throughput (samples/sec): 170.88
2019-08-13 14:05:35,761 epoch 64 - iter 490/493 - loss 0.15272743 throughput (samples/sec): 186.84
2019-08-13 14:05:36,174 ----------------------------------------------------------------------------------------------------
2019-08-13 14:05:36,174 EPOCH 64 done: loss 0.1530 - lr 0.0500
2019-08-13 14:05:36,174 BAD EPOCHS (no improvement): 0
2019-08-13 14:05:36,174 ----------------------------------------------------------------------------------------------------
2019-08-13 14:05:36,358 epoch 65 - iter 0/493 - loss 0.05908602 throughput (samples/sec): 8597.23
2019-08-13 14:05:45,110 epoch 65 - iter 49/493 - loss 0.14518051 throughput (samples/sec): 179.68
2019-08-13 14:05:53,654 epoch 65 - iter 98/493 - loss 0.14007788 throughput (samples/sec): 184.04
2019-08-13 14:06:02,450 epoch 65 - iter 147/493 - loss 0.14495020 throughput (samples/sec): 178.77
2019-08-13 14:06:11,030 epoch 65 - iter 196/493 - loss 0.14878727 throughput (samples/sec): 183.29
2019-08-13 14:06:19,545 epoch 65 - iter 245/493 - loss 0.14485525 throughput (samples/sec): 184.69
2019-08-13 14:06:27,979 epoch 65 - iter 294/493 - loss 0.14221352 throughput (samples/sec): 186.47
2019-08-13 14:06:36,240 epoch 65 - iter 343/493 - loss 0.14170649 throughput (samples/sec): 190.37
2019-08-13 14:06:44,745 epoch 65 - iter 392/493 - loss 0.14303634 throughput (samples/sec): 184.91
2019-08-13 14:06:53,225 epoch 65 - iter 441/493 - loss 0.14535102 throughput (samples/sec): 185.47
2019-08-13 14:07:02,422 epoch 65 - iter 490/493 - loss 0.14401212 throughput (samples/sec): 170.95
2019-08-13 14:07:02,725 ----------------------------------------------------------------------------------------------------
2019-08-13 14:07:02,725 EPOCH 65 done: loss 0.1444 - lr 0.0500
2019-08-13 14:07:02,726 BAD EPOCHS (no improvement): 0
2019-08-13 14:07:02,726 ----------------------------------------------------------------------------------------------------
2019-08-13 14:07:02,889 epoch 66 - iter 0/493 - loss 0.04337835 throughput (samples/sec): 9687.44
2019-08-13 14:07:11,412 epoch 66 - iter 49/493 - loss 0.14125566 throughput (samples/sec): 184.52
2019-08-13 14:07:19,983 epoch 66 - iter 98/493 - loss 0.13216875 throughput (samples/sec): 183.47
2019-08-13 14:07:28,737 epoch 66 - iter 147/493 - loss 0.13878778 throughput (samples/sec): 179.63
2019-08-13 14:07:37,457 epoch 66 - iter 196/493 - loss 0.14309951 throughput (samples/sec): 180.32
2019-08-13 14:07:45,817 epoch 66 - iter 245/493 - loss 0.13591532 throughput (samples/sec): 188.12
2019-08-13 14:07:54,439 epoch 66 - iter 294/493 - loss 0.13617079 throughput (samples/sec): 182.40
2019-08-13 14:08:03,462 epoch 66 - iter 343/493 - loss 0.13500133 throughput (samples/sec): 174.26
2019-08-13 14:08:12,130 epoch 66 - iter 392/493 - loss 0.13363425 throughput (samples/sec): 181.41
2019-08-13 14:08:20,482 epoch 66 - iter 441/493 - loss 0.13348304 throughput (samples/sec): 188.30
2019-08-13 14:08:29,019 epoch 66 - iter 490/493 - loss 0.13920046 throughput (samples/sec): 184.21
2019-08-13 14:08:29,347 ----------------------------------------------------------------------------------------------------
2019-08-13 14:08:29,347 EPOCH 66 done: loss 0.1392 - lr 0.0500
2019-08-13 14:08:29,347 BAD EPOCHS (no improvement): 0
2019-08-13 14:08:29,347 ----------------------------------------------------------------------------------------------------
2019-08-13 14:08:29,538 epoch 67 - iter 0/493 - loss 0.01409811 throughput (samples/sec): 8274.93
2019-08-13 14:08:37,928 epoch 67 - iter 49/493 - loss 0.14478586 throughput (samples/sec): 187.45
2019-08-13 14:08:46,373 epoch 67 - iter 98/493 - loss 0.13696950 throughput (samples/sec): 186.21
2019-08-13 14:08:55,277 epoch 67 - iter 147/493 - loss 0.14291842 throughput (samples/sec): 176.61
2019-08-13 14:09:03,919 epoch 67 - iter 196/493 - loss 0.14367563 throughput (samples/sec): 181.96
2019-08-13 14:09:12,605 epoch 67 - iter 245/493 - loss 0.14302778 throughput (samples/sec): 181.04
2019-08-13 14:09:21,451 epoch 67 - iter 294/493 - loss 0.13991513 throughput (samples/sec): 177.75
2019-08-13 14:09:29,984 epoch 67 - iter 343/493 - loss 0.13771244 throughput (samples/sec): 184.30
2019-08-13 14:09:38,673 epoch 67 - iter 392/493 - loss 0.13750911 throughput (samples/sec): 180.98
2019-08-13 14:09:47,153 epoch 67 - iter 441/493 - loss 0.13765153 throughput (samples/sec): 185.46
2019-08-13 14:09:55,632 epoch 67 - iter 490/493 - loss 0.13899216 throughput (samples/sec): 185.48
2019-08-13 14:09:55,940 ----------------------------------------------------------------------------------------------------
2019-08-13 14:09:55,940 EPOCH 67 done: loss 0.1389 - lr 0.0500
2019-08-13 14:09:55,940 BAD EPOCHS (no improvement): 0
2019-08-13 14:09:55,940 ----------------------------------------------------------------------------------------------------
2019-08-13 14:09:56,114 epoch 68 - iter 0/493 - loss 0.13803786 throughput (samples/sec): 9068.84
2019-08-13 14:10:05,290 epoch 68 - iter 49/493 - loss 0.15958914 throughput (samples/sec): 171.34
2019-08-13 14:10:13,913 epoch 68 - iter 98/493 - loss 0.14773254 throughput (samples/sec): 182.38
2019-08-13 14:10:22,517 epoch 68 - iter 147/493 - loss 0.14099311 throughput (samples/sec): 182.77
2019-08-13 14:10:30,820 epoch 68 - iter 196/493 - loss 0.13922652 throughput (samples/sec): 189.42
2019-08-13 14:10:39,322 epoch 68 - iter 245/493 - loss 0.13404154 throughput (samples/sec): 184.97
2019-08-13 14:10:48,072 epoch 68 - iter 294/493 - loss 0.13659344 throughput (samples/sec): 179.71
2019-08-13 14:10:56,776 epoch 68 - iter 343/493 - loss 0.13629619 throughput (samples/sec): 180.66
2019-08-13 14:11:05,215 epoch 68 - iter 392/493 - loss 0.13664670 throughput (samples/sec): 186.36
2019-08-13 14:11:14,020 epoch 68 - iter 441/493 - loss 0.13295689 throughput (samples/sec): 178.59
2019-08-13 14:11:22,551 epoch 68 - iter 490/493 - loss 0.13671381 throughput (samples/sec): 184.34
2019-08-13 14:11:22,892 ----------------------------------------------------------------------------------------------------
2019-08-13 14:11:22,893 EPOCH 68 done: loss 0.1365 - lr 0.0500
2019-08-13 14:11:22,893 BAD EPOCHS (no improvement): 0
2019-08-13 14:11:22,893 ----------------------------------------------------------------------------------------------------
2019-08-13 14:11:23,042 epoch 69 - iter 0/493 - loss 0.15433574 throughput (samples/sec): 10583.92
2019-08-13 14:11:31,310 epoch 69 - iter 49/493 - loss 0.10142608 throughput (samples/sec): 190.21
2019-08-13 14:11:39,977 epoch 69 - iter 98/493 - loss 0.11662814 throughput (samples/sec): 181.45
2019-08-13 14:11:48,655 epoch 69 - iter 147/493 - loss 0.12749814 throughput (samples/sec): 181.21
2019-08-13 14:11:56,870 epoch 69 - iter 196/493 - loss 0.12634154 throughput (samples/sec): 191.45
2019-08-13 14:12:05,260 epoch 69 - iter 245/493 - loss 0.12275177 throughput (samples/sec): 187.45
2019-08-13 14:12:14,125 epoch 69 - iter 294/493 - loss 0.12645979 throughput (samples/sec): 177.36
2019-08-13 14:12:22,936 epoch 69 - iter 343/493 - loss 0.13263801 throughput (samples/sec): 178.46
2019-08-13 14:12:31,695 epoch 69 - iter 392/493 - loss 0.13103346 throughput (samples/sec): 179.52
2019-08-13 14:12:40,432 epoch 69 - iter 441/493 - loss 0.13247717 throughput (samples/sec): 179.99
2019-08-13 14:12:49,052 epoch 69 - iter 490/493 - loss 0.13413542 throughput (samples/sec): 182.44
2019-08-13 14:12:49,494 ----------------------------------------------------------------------------------------------------
2019-08-13 14:12:49,494 EPOCH 69 done: loss 0.1342 - lr 0.0500
2019-08-13 14:12:49,494 BAD EPOCHS (no improvement): 0
2019-08-13 14:12:49,494 ----------------------------------------------------------------------------------------------------
2019-08-13 14:12:49,645 epoch 70 - iter 0/493 - loss 0.12874922 throughput (samples/sec): 10444.49
2019-08-13 14:12:58,205 epoch 70 - iter 49/493 - loss 0.13110073 throughput (samples/sec): 183.71
2019-08-13 14:13:07,018 epoch 70 - iter 98/493 - loss 0.12928193 throughput (samples/sec): 178.43
2019-08-13 14:13:15,388 epoch 70 - iter 147/493 - loss 0.12220742 throughput (samples/sec): 187.90
2019-08-13 14:13:24,282 epoch 70 - iter 196/493 - loss 0.12458057 throughput (samples/sec): 176.80
2019-08-13 14:13:32,617 epoch 70 - iter 245/493 - loss 0.12413980 throughput (samples/sec): 188.70
2019-08-13 14:13:41,199 epoch 70 - iter 294/493 - loss 0.12610418 throughput (samples/sec): 183.24
2019-08-13 14:13:49,924 epoch 70 - iter 343/493 - loss 0.12673930 throughput (samples/sec): 180.22
2019-08-13 14:13:58,543 epoch 70 - iter 392/493 - loss 0.12766043 throughput (samples/sec): 182.47
2019-08-13 14:14:07,351 epoch 70 - iter 441/493 - loss 0.13067307 throughput (samples/sec): 178.51
2019-08-13 14:14:15,831 epoch 70 - iter 490/493 - loss 0.13069815 throughput (samples/sec): 185.47
2019-08-13 14:14:16,267 ----------------------------------------------------------------------------------------------------
2019-08-13 14:14:16,267 EPOCH 70 done: loss 0.1309 - lr 0.0500
2019-08-13 14:14:16,267 BAD EPOCHS (no improvement): 0
2019-08-13 14:14:16,267 ----------------------------------------------------------------------------------------------------
2019-08-13 14:14:16,449 epoch 71 - iter 0/493 - loss 0.04841250 throughput (samples/sec): 8671.25
2019-08-13 14:14:25,550 epoch 71 - iter 49/493 - loss 0.13030074 throughput (samples/sec): 172.77
2019-08-13 14:14:33,999 epoch 71 - iter 98/493 - loss 0.12417500 throughput (samples/sec): 186.12
2019-08-13 14:14:42,422 epoch 71 - iter 147/493 - loss 0.12871574 throughput (samples/sec): 186.70
2019-08-13 14:14:50,942 epoch 71 - iter 196/493 - loss 0.13056458 throughput (samples/sec): 184.58
2019-08-13 14:14:59,693 epoch 71 - iter 245/493 - loss 0.12850430 throughput (samples/sec): 179.70
2019-08-13 14:15:08,125 epoch 71 - iter 294/493 - loss 0.13301173 throughput (samples/sec): 186.50
2019-08-13 14:15:17,026 epoch 71 - iter 343/493 - loss 0.13236315 throughput (samples/sec): 176.66
2019-08-13 14:15:25,748 epoch 71 - iter 392/493 - loss 0.12862294 throughput (samples/sec): 180.29
2019-08-13 14:15:34,077 epoch 71 - iter 441/493 - loss 0.12793844 throughput (samples/sec): 188.82
2019-08-13 14:15:42,319 epoch 71 - iter 490/493 - loss 0.12727322 throughput (samples/sec): 190.83
2019-08-13 14:15:42,718 ----------------------------------------------------------------------------------------------------
2019-08-13 14:15:42,719 EPOCH 71 done: loss 0.1272 - lr 0.0500
2019-08-13 14:15:42,719 BAD EPOCHS (no improvement): 0
2019-08-13 14:15:42,719 ----------------------------------------------------------------------------------------------------
2019-08-13 14:15:42,916 epoch 72 - iter 0/493 - loss 0.05543905 throughput (samples/sec): 7994.57
2019-08-13 14:15:51,540 epoch 72 - iter 49/493 - loss 0.12594792 throughput (samples/sec): 182.34
2019-08-13 14:16:00,153 epoch 72 - iter 98/493 - loss 0.13488134 throughput (samples/sec): 182.59
2019-08-13 14:16:08,910 epoch 72 - iter 147/493 - loss 0.12516541 throughput (samples/sec): 179.57
2019-08-13 14:16:17,506 epoch 72 - iter 196/493 - loss 0.12571737 throughput (samples/sec): 182.95
2019-08-13 14:16:26,009 epoch 72 - iter 245/493 - loss 0.12534870 throughput (samples/sec): 184.96
2019-08-13 14:16:34,909 epoch 72 - iter 294/493 - loss 0.12724307 throughput (samples/sec): 176.68
2019-08-13 14:16:43,315 epoch 72 - iter 343/493 - loss 0.12647760 throughput (samples/sec): 187.09
2019-08-13 14:16:51,608 epoch 72 - iter 392/493 - loss 0.12866807 throughput (samples/sec): 189.64
2019-08-13 14:17:00,540 epoch 72 - iter 441/493 - loss 0.13070508 throughput (samples/sec): 176.03
2019-08-13 14:17:08,950 epoch 72 - iter 490/493 - loss 0.13041367 throughput (samples/sec): 186.99
2019-08-13 14:17:09,267 ----------------------------------------------------------------------------------------------------
2019-08-13 14:17:09,267 EPOCH 72 done: loss 0.1302 - lr 0.0500
2019-08-13 14:17:09,268 BAD EPOCHS (no improvement): 1
2019-08-13 14:17:09,268 ----------------------------------------------------------------------------------------------------
2019-08-13 14:17:09,432 epoch 73 - iter 0/493 - loss 0.02451068 throughput (samples/sec): 9621.33
2019-08-13 14:17:18,246 epoch 73 - iter 49/493 - loss 0.14299687 throughput (samples/sec): 178.40
2019-08-13 14:17:26,948 epoch 73 - iter 98/493 - loss 0.13719838 throughput (samples/sec): 180.72
2019-08-13 14:17:35,702 epoch 73 - iter 147/493 - loss 0.13177209 throughput (samples/sec): 179.62
2019-08-13 14:17:44,322 epoch 73 - iter 196/493 - loss 0.12323476 throughput (samples/sec): 182.43
2019-08-13 14:17:52,997 epoch 73 - iter 245/493 - loss 0.12520199 throughput (samples/sec): 181.29
2019-08-13 14:18:01,773 epoch 73 - iter 294/493 - loss 0.12384841 throughput (samples/sec): 179.17
2019-08-13 14:18:10,774 epoch 73 - iter 343/493 - loss 0.13068991 throughput (samples/sec): 174.70
2019-08-13 14:18:19,211 epoch 73 - iter 392/493 - loss 0.12805902 throughput (samples/sec): 186.41
2019-08-13 14:18:27,234 epoch 73 - iter 441/493 - loss 0.12831151 throughput (samples/sec): 196.03
2019-08-13 14:18:35,637 epoch 73 - iter 490/493 - loss 0.12913829 throughput (samples/sec): 187.16
2019-08-13 14:18:35,979 ----------------------------------------------------------------------------------------------------
2019-08-13 14:18:35,980 EPOCH 73 done: loss 0.1289 - lr 0.0500
2019-08-13 14:18:35,980 BAD EPOCHS (no improvement): 2
2019-08-13 14:18:35,980 ----------------------------------------------------------------------------------------------------
2019-08-13 14:18:36,140 epoch 74 - iter 0/493 - loss 0.07412499 throughput (samples/sec): 9873.48
2019-08-13 14:18:44,783 epoch 74 - iter 49/493 - loss 0.12037854 throughput (samples/sec): 181.95
2019-08-13 14:18:53,175 epoch 74 - iter 98/493 - loss 0.12943130 throughput (samples/sec): 187.40
2019-08-13 14:19:01,691 epoch 74 - iter 147/493 - loss 0.13307981 throughput (samples/sec): 184.67
2019-08-13 14:19:10,354 epoch 74 - iter 196/493 - loss 0.13025313 throughput (samples/sec): 181.52
2019-08-13 14:19:18,878 epoch 74 - iter 245/493 - loss 0.12507085 throughput (samples/sec): 184.49
2019-08-13 14:19:27,628 epoch 74 - iter 294/493 - loss 0.12539609 throughput (samples/sec): 179.72
2019-08-13 14:19:35,992 epoch 74 - iter 343/493 - loss 0.12517776 throughput (samples/sec): 188.03
2019-08-13 14:19:44,480 epoch 74 - iter 392/493 - loss 0.12660615 throughput (samples/sec): 185.28
2019-08-13 14:19:53,842 epoch 74 - iter 441/493 - loss 0.12327867 throughput (samples/sec): 167.94
2019-08-13 14:20:02,236 epoch 74 - iter 490/493 - loss 0.12323734 throughput (samples/sec): 187.36
2019-08-13 14:20:02,630 ----------------------------------------------------------------------------------------------------
2019-08-13 14:20:02,630 EPOCH 74 done: loss 0.1230 - lr 0.0500
2019-08-13 14:20:02,630 BAD EPOCHS (no improvement): 0
2019-08-13 14:20:02,630 ----------------------------------------------------------------------------------------------------
2019-08-13 14:20:02,805 epoch 75 - iter 0/493 - loss 0.10929412 throughput (samples/sec): 9027.80
2019-08-13 14:20:11,833 epoch 75 - iter 49/493 - loss 0.12905306 throughput (samples/sec): 174.17
2019-08-13 14:20:20,412 epoch 75 - iter 98/493 - loss 0.11864185 throughput (samples/sec): 183.31
2019-08-13 14:20:28,880 epoch 75 - iter 147/493 - loss 0.11787230 throughput (samples/sec): 185.72
2019-08-13 14:20:37,403 epoch 75 - iter 196/493 - loss 0.12428484 throughput (samples/sec): 184.51
2019-08-13 14:20:46,288 epoch 75 - iter 245/493 - loss 0.11891050 throughput (samples/sec): 176.96
2019-08-13 14:20:54,775 epoch 75 - iter 294/493 - loss 0.12019204 throughput (samples/sec): 185.32
2019-08-13 14:21:03,173 epoch 75 - iter 343/493 - loss 0.12050509 throughput (samples/sec): 187.25
2019-08-13 14:21:11,822 epoch 75 - iter 392/493 - loss 0.12025060 throughput (samples/sec): 181.82
2019-08-13 14:21:20,332 epoch 75 - iter 441/493 - loss 0.11801601 throughput (samples/sec): 184.80
2019-08-13 14:21:28,855 epoch 75 - iter 490/493 - loss 0.11705725 throughput (samples/sec): 184.51
2019-08-13 14:21:29,202 ----------------------------------------------------------------------------------------------------
2019-08-13 14:21:29,202 EPOCH 75 done: loss 0.1168 - lr 0.0500
2019-08-13 14:21:29,202 BAD EPOCHS (no improvement): 0
2019-08-13 14:21:29,203 ----------------------------------------------------------------------------------------------------
2019-08-13 14:21:29,380 epoch 76 - iter 0/493 - loss 0.07475102 throughput (samples/sec): 8881.35
2019-08-13 14:21:38,275 epoch 76 - iter 49/493 - loss 0.13076539 throughput (samples/sec): 176.78
2019-08-13 14:21:47,017 epoch 76 - iter 98/493 - loss 0.12161269 throughput (samples/sec): 179.87
2019-08-13 14:21:55,380 epoch 76 - iter 147/493 - loss 0.11121851 throughput (samples/sec): 188.05
2019-08-13 14:22:03,895 epoch 76 - iter 196/493 - loss 0.11856514 throughput (samples/sec): 184.69
2019-08-13 14:22:12,461 epoch 76 - iter 245/493 - loss 0.11614218 throughput (samples/sec): 183.59
2019-08-13 14:22:20,834 epoch 76 - iter 294/493 - loss 0.11941647 throughput (samples/sec): 187.83
2019-08-13 14:22:29,445 epoch 76 - iter 343/493 - loss 0.11785895 throughput (samples/sec): 182.63
2019-08-13 14:22:38,373 epoch 76 - iter 392/493 - loss 0.11976947 throughput (samples/sec): 176.12
2019-08-13 14:22:46,954 epoch 76 - iter 441/493 - loss 0.12183257 throughput (samples/sec): 183.26
2019-08-13 14:22:55,700 epoch 76 - iter 490/493 - loss 0.12336961 throughput (samples/sec): 179.79
2019-08-13 14:22:56,103 ----------------------------------------------------------------------------------------------------
2019-08-13 14:22:56,103 EPOCH 76 done: loss 0.1232 - lr 0.0500
2019-08-13 14:22:56,103 BAD EPOCHS (no improvement): 1
2019-08-13 14:22:56,104 ----------------------------------------------------------------------------------------------------
2019-08-13 14:22:56,298 epoch 77 - iter 0/493 - loss 0.00865248 throughput (samples/sec): 8090.78
2019-08-13 14:23:05,360 epoch 77 - iter 49/493 - loss 0.11264164 throughput (samples/sec): 173.52
2019-08-13 14:23:13,784 epoch 77 - iter 98/493 - loss 0.10445335 throughput (samples/sec): 186.68
2019-08-13 14:23:22,368 epoch 77 - iter 147/493 - loss 0.10323484 throughput (samples/sec): 183.19
2019-08-13 14:23:30,739 epoch 77 - iter 196/493 - loss 0.10944856 throughput (samples/sec): 187.88
2019-08-13 14:23:39,097 epoch 77 - iter 245/493 - loss 0.10895774 throughput (samples/sec): 188.17
2019-08-13 14:23:47,796 epoch 77 - iter 294/493 - loss 0.10802982 throughput (samples/sec): 180.76
2019-08-13 14:23:55,852 epoch 77 - iter 343/493 - loss 0.10832131 throughput (samples/sec): 195.23
2019-08-13 14:24:04,456 epoch 77 - iter 392/493 - loss 0.10934658 throughput (samples/sec): 182.78
2019-08-13 14:24:13,036 epoch 77 - iter 441/493 - loss 0.10987452 throughput (samples/sec): 183.28
2019-08-13 14:24:21,833 epoch 77 - iter 490/493 - loss 0.11196654 throughput (samples/sec): 178.75
2019-08-13 14:24:22,573 ----------------------------------------------------------------------------------------------------
2019-08-13 14:24:22,573 EPOCH 77 done: loss 0.1122 - lr 0.0500
2019-08-13 14:24:22,573 BAD EPOCHS (no improvement): 0
2019-08-13 14:24:22,573 ----------------------------------------------------------------------------------------------------
2019-08-13 14:24:22,741 epoch 78 - iter 0/493 - loss 0.05090839 throughput (samples/sec): 9423.21
2019-08-13 14:24:31,152 epoch 78 - iter 49/493 - loss 0.12558413 throughput (samples/sec): 186.96
2019-08-13 14:24:39,810 epoch 78 - iter 98/493 - loss 0.12415632 throughput (samples/sec): 181.63
2019-08-13 14:24:48,280 epoch 78 - iter 147/493 - loss 0.11654910 throughput (samples/sec): 185.68
2019-08-13 14:24:57,106 epoch 78 - iter 196/493 - loss 0.12253626 throughput (samples/sec): 178.18
2019-08-13 14:25:06,001 epoch 78 - iter 245/493 - loss 0.12436433 throughput (samples/sec): 176.77
2019-08-13 14:25:14,722 epoch 78 - iter 294/493 - loss 0.12446803 throughput (samples/sec): 180.31
2019-08-13 14:25:23,227 epoch 78 - iter 343/493 - loss 0.12161946 throughput (samples/sec): 184.91
2019-08-13 14:25:31,869 epoch 78 - iter 392/493 - loss 0.11885826 throughput (samples/sec): 181.98
2019-08-13 14:25:40,574 epoch 78 - iter 441/493 - loss 0.11634240 throughput (samples/sec): 180.64
2019-08-13 14:25:48,935 epoch 78 - iter 490/493 - loss 0.11521450 throughput (samples/sec): 188.10
2019-08-13 14:25:49,275 ----------------------------------------------------------------------------------------------------
2019-08-13 14:25:49,276 EPOCH 78 done: loss 0.1152 - lr 0.0500
2019-08-13 14:25:49,276 BAD EPOCHS (no improvement): 1
2019-08-13 14:25:49,276 ----------------------------------------------------------------------------------------------------
2019-08-13 14:25:49,455 epoch 79 - iter 0/493 - loss 0.01661217 throughput (samples/sec): 8811.08
2019-08-13 14:25:57,932 epoch 79 - iter 49/493 - loss 0.12590038 throughput (samples/sec): 185.51
2019-08-13 14:26:06,574 epoch 79 - iter 98/493 - loss 0.12127228 throughput (samples/sec): 181.97
2019-08-13 14:26:15,139 epoch 79 - iter 147/493 - loss 0.12219668 throughput (samples/sec): 183.61
2019-08-13 14:26:23,470 epoch 79 - iter 196/493 - loss 0.12705651 throughput (samples/sec): 188.78
2019-08-13 14:26:32,398 epoch 79 - iter 245/493 - loss 0.12999329 throughput (samples/sec): 176.12
2019-08-13 14:26:40,765 epoch 79 - iter 294/493 - loss 0.12876909 throughput (samples/sec): 187.97
2019-08-13 14:26:49,214 epoch 79 - iter 343/493 - loss 0.13297090 throughput (samples/sec): 186.14
2019-08-13 14:26:57,628 epoch 79 - iter 392/493 - loss 0.13606221 throughput (samples/sec): 186.91
2019-08-13 14:27:06,381 epoch 79 - iter 441/493 - loss 0.13150275 throughput (samples/sec): 179.65
2019-08-13 14:27:15,341 epoch 79 - iter 490/493 - loss 0.13021771 throughput (samples/sec): 175.49
2019-08-13 14:27:15,697 ----------------------------------------------------------------------------------------------------
2019-08-13 14:27:15,698 EPOCH 79 done: loss 0.1300 - lr 0.0500
2019-08-13 14:27:15,698 BAD EPOCHS (no improvement): 2
2019-08-13 14:27:15,698 ----------------------------------------------------------------------------------------------------
2019-08-13 14:27:15,868 epoch 80 - iter 0/493 - loss 0.09872293 throughput (samples/sec): 9294.87
2019-08-13 14:27:24,237 epoch 80 - iter 49/493 - loss 0.12905185 throughput (samples/sec): 187.91
2019-08-13 14:27:32,820 epoch 80 - iter 98/493 - loss 0.13812296 throughput (samples/sec): 183.23
2019-08-13 14:27:41,691 epoch 80 - iter 147/493 - loss 0.13219716 throughput (samples/sec): 177.26
2019-08-13 14:27:49,897 epoch 80 - iter 196/493 - loss 0.12247885 throughput (samples/sec): 191.66
2019-08-13 14:27:58,581 epoch 80 - iter 245/493 - loss 0.12334596 throughput (samples/sec): 181.08
2019-08-13 14:28:06,994 epoch 80 - iter 294/493 - loss 0.12527446 throughput (samples/sec): 186.94
2019-08-13 14:28:15,983 epoch 80 - iter 343/493 - loss 0.12561508 throughput (samples/sec): 174.92
2019-08-13 14:28:24,607 epoch 80 - iter 392/493 - loss 0.12483221 throughput (samples/sec): 182.34
2019-08-13 14:28:32,863 epoch 80 - iter 441/493 - loss 0.12252756 throughput (samples/sec): 190.51
2019-08-13 14:28:41,382 epoch 80 - iter 490/493 - loss 0.12193188 throughput (samples/sec): 184.59
2019-08-13 14:28:41,714 ----------------------------------------------------------------------------------------------------
2019-08-13 14:28:41,715 EPOCH 80 done: loss 0.1218 - lr 0.0500
2019-08-13 14:28:41,715 BAD EPOCHS (no improvement): 3
2019-08-13 14:28:41,715 ----------------------------------------------------------------------------------------------------
2019-08-13 14:28:41,871 epoch 81 - iter 0/493 - loss 0.05725813 throughput (samples/sec): 10121.80
2019-08-13 14:28:50,470 epoch 81 - iter 49/493 - loss 0.11927916 throughput (samples/sec): 182.88
2019-08-13 14:28:59,201 epoch 81 - iter 98/493 - loss 0.11019794 throughput (samples/sec): 180.10
2019-08-13 14:29:07,808 epoch 81 - iter 147/493 - loss 0.11306850 throughput (samples/sec): 182.70
2019-08-13 14:29:16,877 epoch 81 - iter 196/493 - loss 0.11893307 throughput (samples/sec): 173.37
2019-08-13 14:29:25,235 epoch 81 - iter 245/493 - loss 0.12002630 throughput (samples/sec): 188.18
2019-08-13 14:29:33,482 epoch 81 - iter 294/493 - loss 0.11996450 throughput (samples/sec): 190.71
2019-08-13 14:29:42,215 epoch 81 - iter 343/493 - loss 0.11645748 throughput (samples/sec): 180.07
2019-08-13 14:29:50,562 epoch 81 - iter 392/493 - loss 0.11660789 throughput (samples/sec): 188.41
2019-08-13 14:29:59,498 epoch 81 - iter 441/493 - loss 0.11851549 throughput (samples/sec): 175.96
2019-08-13 14:30:07,860 epoch 81 - iter 490/493 - loss 0.11575036 throughput (samples/sec): 188.09
2019-08-13 14:30:08,221 ----------------------------------------------------------------------------------------------------
2019-08-13 14:30:08,221 EPOCH 81 done: loss 0.1157 - lr 0.0500
2019-08-13 14:30:08,221 BAD EPOCHS (no improvement): 4
2019-08-13 14:30:08,221 ----------------------------------------------------------------------------------------------------
2019-08-13 14:30:08,396 epoch 82 - iter 0/493 - loss 0.02588487 throughput (samples/sec): 9030.83
2019-08-13 14:30:17,181 epoch 82 - iter 49/493 - loss 0.07747845 throughput (samples/sec): 178.99
2019-08-13 14:30:25,410 epoch 82 - iter 98/493 - loss 0.08659739 throughput (samples/sec): 191.13
2019-08-13 14:30:34,070 epoch 82 - iter 147/493 - loss 0.10336804 throughput (samples/sec): 181.60
2019-08-13 14:30:42,468 epoch 82 - iter 196/493 - loss 0.10228812 throughput (samples/sec): 187.26
2019-08-13 14:30:51,500 epoch 82 - iter 245/493 - loss 0.10162311 throughput (samples/sec): 174.08
2019-08-13 14:31:00,096 epoch 82 - iter 294/493 - loss 0.10086260 throughput (samples/sec): 182.95
2019-08-13 14:31:08,633 epoch 82 - iter 343/493 - loss 0.10134978 throughput (samples/sec): 184.21
2019-08-13 14:31:17,189 epoch 82 - iter 392/493 - loss 0.10371354 throughput (samples/sec): 183.80
2019-08-13 14:31:26,081 epoch 82 - iter 441/493 - loss 0.10046498 throughput (samples/sec): 176.84
2019-08-13 14:31:34,554 epoch 82 - iter 490/493 - loss 0.10007221 throughput (samples/sec): 185.62
2019-08-13 14:31:34,911 ----------------------------------------------------------------------------------------------------
2019-08-13 14:31:34,912 EPOCH 82 done: loss 0.1001 - lr 0.0250
2019-08-13 14:31:34,912 BAD EPOCHS (no improvement): 0
2019-08-13 14:31:34,912 ----------------------------------------------------------------------------------------------------
2019-08-13 14:31:35,076 epoch 83 - iter 0/493 - loss 0.02372706 throughput (samples/sec): 9592.29
2019-08-13 14:31:43,754 epoch 83 - iter 49/493 - loss 0.12213796 throughput (samples/sec): 181.22
2019-08-13 14:31:52,268 epoch 83 - iter 98/493 - loss 0.12081178 throughput (samples/sec): 184.70
2019-08-13 14:32:00,400 epoch 83 - iter 147/493 - loss 0.10977439 throughput (samples/sec): 193.40
2019-08-13 14:32:09,146 epoch 83 - iter 196/493 - loss 0.11588317 throughput (samples/sec): 179.80
2019-08-13 14:32:17,730 epoch 83 - iter 245/493 - loss 0.11218601 throughput (samples/sec): 183.20
2019-08-13 14:32:26,727 epoch 83 - iter 294/493 - loss 0.11112680 throughput (samples/sec): 174.76
2019-08-13 14:32:35,150 epoch 83 - iter 343/493 - loss 0.10706347 throughput (samples/sec): 186.73
2019-08-13 14:32:43,893 epoch 83 - iter 392/493 - loss 0.10885047 throughput (samples/sec): 179.86
2019-08-13 14:32:52,499 epoch 83 - iter 441/493 - loss 0.10906311 throughput (samples/sec): 182.72
2019-08-13 14:33:00,927 epoch 83 - iter 490/493 - loss 0.10996847 throughput (samples/sec): 186.59
2019-08-13 14:33:01,454 ----------------------------------------------------------------------------------------------------
2019-08-13 14:33:01,454 EPOCH 83 done: loss 0.1101 - lr 0.0250
2019-08-13 14:33:01,454 BAD EPOCHS (no improvement): 1
2019-08-13 14:33:01,454 ----------------------------------------------------------------------------------------------------
2019-08-13 14:33:01,660 epoch 84 - iter 0/493 - loss 0.13409317 throughput (samples/sec): 7673.50
2019-08-13 14:33:10,380 epoch 84 - iter 49/493 - loss 0.11849903 throughput (samples/sec): 180.34
2019-08-13 14:33:18,749 epoch 84 - iter 98/493 - loss 0.10890091 throughput (samples/sec): 187.91
2019-08-13 14:33:27,404 epoch 84 - iter 147/493 - loss 0.10735587 throughput (samples/sec): 181.70
2019-08-13 14:33:35,872 epoch 84 - iter 196/493 - loss 0.10333306 throughput (samples/sec): 185.70
2019-08-13 14:33:44,490 epoch 84 - iter 245/493 - loss 0.10640074 throughput (samples/sec): 182.47
2019-08-13 14:33:53,347 epoch 84 - iter 294/493 - loss 0.10526007 throughput (samples/sec): 177.55
2019-08-13 14:34:01,675 epoch 84 - iter 343/493 - loss 0.10397685 throughput (samples/sec): 188.85
2019-08-13 14:34:10,412 epoch 84 - iter 392/493 - loss 0.10308617 throughput (samples/sec): 179.98
2019-08-13 14:34:19,245 epoch 84 - iter 441/493 - loss 0.10288272 throughput (samples/sec): 178.02
2019-08-13 14:34:27,773 epoch 84 - iter 490/493 - loss 0.10327477 throughput (samples/sec): 184.40
2019-08-13 14:34:28,124 ----------------------------------------------------------------------------------------------------
2019-08-13 14:34:28,124 EPOCH 84 done: loss 0.1031 - lr 0.0250
2019-08-13 14:34:28,124 BAD EPOCHS (no improvement): 2
2019-08-13 14:34:28,125 ----------------------------------------------------------------------------------------------------
2019-08-13 14:34:28,298 epoch 85 - iter 0/493 - loss 0.08955121 throughput (samples/sec): 9067.74
2019-08-13 14:34:36,593 epoch 85 - iter 49/493 - loss 0.08371199 throughput (samples/sec): 189.61
2019-08-13 14:34:45,190 epoch 85 - iter 98/493 - loss 0.09611509 throughput (samples/sec): 182.91
2019-08-13 14:34:53,533 epoch 85 - iter 147/493 - loss 0.10493437 throughput (samples/sec): 188.52
2019-08-13 14:35:01,862 epoch 85 - iter 196/493 - loss 0.10853505 throughput (samples/sec): 188.82
2019-08-13 14:35:10,904 epoch 85 - iter 245/493 - loss 0.10902344 throughput (samples/sec): 173.89
2019-08-13 14:35:19,782 epoch 85 - iter 294/493 - loss 0.11021483 throughput (samples/sec): 177.12
2019-08-13 14:35:28,123 epoch 85 - iter 343/493 - loss 0.10943437 throughput (samples/sec): 188.55
2019-08-13 14:35:36,689 epoch 85 - iter 392/493 - loss 0.11071907 throughput (samples/sec): 183.58
2019-08-13 14:35:45,439 epoch 85 - iter 441/493 - loss 0.11213809 throughput (samples/sec): 179.72
2019-08-13 14:35:53,948 epoch 85 - iter 490/493 - loss 0.11360883 throughput (samples/sec): 184.83
2019-08-13 14:35:54,320 ----------------------------------------------------------------------------------------------------
2019-08-13 14:35:54,320 EPOCH 85 done: loss 0.1133 - lr 0.0250
2019-08-13 14:35:54,320 BAD EPOCHS (no improvement): 3
2019-08-13 14:35:54,320 ----------------------------------------------------------------------------------------------------
2019-08-13 14:35:54,486 epoch 86 - iter 0/493 - loss 0.21013439 throughput (samples/sec): 9553.09
2019-08-13 14:36:03,043 epoch 86 - iter 49/493 - loss 0.10986072 throughput (samples/sec): 183.78
2019-08-13 14:36:11,574 epoch 86 - iter 98/493 - loss 0.08931731 throughput (samples/sec): 184.32
2019-08-13 14:36:20,117 epoch 86 - iter 147/493 - loss 0.09965009 throughput (samples/sec): 184.09
2019-08-13 14:36:28,885 epoch 86 - iter 196/493 - loss 0.09863684 throughput (samples/sec): 179.32
2019-08-13 14:36:37,413 epoch 86 - iter 245/493 - loss 0.10209567 throughput (samples/sec): 184.40
2019-08-13 14:36:46,154 epoch 86 - iter 294/493 - loss 0.09903859 throughput (samples/sec): 179.89
2019-08-13 14:36:54,631 epoch 86 - iter 343/493 - loss 0.09626342 throughput (samples/sec): 185.51
2019-08-13 14:37:02,832 epoch 86 - iter 392/493 - loss 0.09775238 throughput (samples/sec): 191.79
2019-08-13 14:37:11,497 epoch 86 - iter 441/493 - loss 0.10013404 throughput (samples/sec): 181.48
2019-08-13 14:37:20,157 epoch 86 - iter 490/493 - loss 0.10107684 throughput (samples/sec): 181.58
2019-08-13 14:37:20,615 ----------------------------------------------------------------------------------------------------
2019-08-13 14:37:20,616 EPOCH 86 done: loss 0.1021 - lr 0.0250
2019-08-13 14:37:20,616 BAD EPOCHS (no improvement): 4
2019-08-13 14:37:20,616 ----------------------------------------------------------------------------------------------------
2019-08-13 14:37:20,767 epoch 87 - iter 0/493 - loss 0.09399718 throughput (samples/sec): 10470.92
2019-08-13 14:37:29,218 epoch 87 - iter 49/493 - loss 0.12654075 throughput (samples/sec): 186.08
2019-08-13 14:37:37,634 epoch 87 - iter 98/493 - loss 0.11482414 throughput (samples/sec): 186.86
2019-08-13 14:37:46,363 epoch 87 - iter 147/493 - loss 0.11087506 throughput (samples/sec): 180.13
2019-08-13 14:37:54,939 epoch 87 - iter 196/493 - loss 0.10298807 throughput (samples/sec): 183.37
2019-08-13 14:38:03,975 epoch 87 - iter 245/493 - loss 0.11588833 throughput (samples/sec): 174.01
2019-08-13 14:38:12,428 epoch 87 - iter 294/493 - loss 0.11209602 throughput (samples/sec): 186.05
2019-08-13 14:38:21,032 epoch 87 - iter 343/493 - loss 0.11401893 throughput (samples/sec): 182.76
2019-08-13 14:38:29,721 epoch 87 - iter 392/493 - loss 0.11093620 throughput (samples/sec): 180.97
2019-08-13 14:38:38,048 epoch 87 - iter 441/493 - loss 0.10931241 throughput (samples/sec): 188.85
2019-08-13 14:38:46,592 epoch 87 - iter 490/493 - loss 0.10797298 throughput (samples/sec): 184.06
2019-08-13 14:38:46,942 ----------------------------------------------------------------------------------------------------
2019-08-13 14:38:46,942 EPOCH 87 done: loss 0.1083 - lr 0.0125
2019-08-13 14:38:46,943 BAD EPOCHS (no improvement): 1
2019-08-13 14:38:46,943 ----------------------------------------------------------------------------------------------------
2019-08-13 14:38:47,151 epoch 88 - iter 0/493 - loss 0.13987434 throughput (samples/sec): 7561.08
2019-08-13 14:38:56,102 epoch 88 - iter 49/493 - loss 0.09391599 throughput (samples/sec): 175.66
2019-08-13 14:39:04,706 epoch 88 - iter 98/493 - loss 0.09470037 throughput (samples/sec): 182.77
2019-08-13 14:39:13,158 epoch 88 - iter 147/493 - loss 0.09529360 throughput (samples/sec): 186.06
2019-08-13 14:39:21,535 epoch 88 - iter 196/493 - loss 0.09206748 throughput (samples/sec): 187.71
2019-08-13 14:39:30,574 epoch 88 - iter 245/493 - loss 0.09452911 throughput (samples/sec): 173.94
2019-08-13 14:39:38,998 epoch 88 - iter 294/493 - loss 0.09642692 throughput (samples/sec): 186.69
2019-08-13 14:39:47,559 epoch 88 - iter 343/493 - loss 0.10001238 throughput (samples/sec): 183.69
2019-08-13 14:39:55,714 epoch 88 - iter 392/493 - loss 0.10157899 throughput (samples/sec): 192.84
2019-08-13 14:40:04,263 epoch 88 - iter 441/493 - loss 0.10154617 throughput (samples/sec): 183.94
2019-08-13 14:40:12,855 epoch 88 - iter 490/493 - loss 0.10197414 throughput (samples/sec): 183.02
2019-08-13 14:40:13,180 ----------------------------------------------------------------------------------------------------
2019-08-13 14:40:13,181 EPOCH 88 done: loss 0.1021 - lr 0.0125
2019-08-13 14:40:13,181 BAD EPOCHS (no improvement): 2
2019-08-13 14:40:13,181 ----------------------------------------------------------------------------------------------------
2019-08-13 14:40:13,375 epoch 89 - iter 0/493 - loss 0.11079550 throughput (samples/sec): 8107.23
2019-08-13 14:40:21,734 epoch 89 - iter 49/493 - loss 0.11450938 throughput (samples/sec): 188.15
2019-08-13 14:40:30,376 epoch 89 - iter 98/493 - loss 0.10912788 throughput (samples/sec): 181.94
2019-08-13 14:40:38,984 epoch 89 - iter 147/493 - loss 0.11232777 throughput (samples/sec): 182.69
2019-08-13 14:40:47,789 epoch 89 - iter 196/493 - loss 0.11463517 throughput (samples/sec): 178.58
2019-08-13 14:40:56,235 epoch 89 - iter 245/493 - loss 0.11082146 throughput (samples/sec): 186.19
2019-08-13 14:41:04,394 epoch 89 - iter 294/493 - loss 0.11151577 throughput (samples/sec): 192.76
2019-08-13 14:41:12,892 epoch 89 - iter 343/493 - loss 0.10750066 throughput (samples/sec): 185.07
2019-08-13 14:41:21,476 epoch 89 - iter 392/493 - loss 0.10324256 throughput (samples/sec): 183.17
2019-08-13 14:41:30,275 epoch 89 - iter 441/493 - loss 0.10287727 throughput (samples/sec): 178.71
2019-08-13 14:41:38,844 epoch 89 - iter 490/493 - loss 0.10575462 throughput (samples/sec): 183.51
2019-08-13 14:41:39,170 ----------------------------------------------------------------------------------------------------
2019-08-13 14:41:39,170 EPOCH 89 done: loss 0.1058 - lr 0.0125
2019-08-13 14:41:39,170 BAD EPOCHS (no improvement): 3
2019-08-13 14:41:39,170 ----------------------------------------------------------------------------------------------------
2019-08-13 14:41:39,342 epoch 90 - iter 0/493 - loss 0.10459915 throughput (samples/sec): 9184.44
2019-08-13 14:41:47,469 epoch 90 - iter 49/493 - loss 0.09283458 throughput (samples/sec): 193.53
2019-08-13 14:41:56,078 epoch 90 - iter 98/493 - loss 0.11295318 throughput (samples/sec): 182.66
2019-08-13 14:42:04,492 epoch 90 - iter 147/493 - loss 0.10547867 throughput (samples/sec): 186.90
2019-08-13 14:42:12,971 epoch 90 - iter 196/493 - loss 0.10846027 throughput (samples/sec): 185.48
2019-08-13 14:42:21,594 epoch 90 - iter 245/493 - loss 0.10560272 throughput (samples/sec): 182.34
2019-08-13 14:42:29,977 epoch 90 - iter 294/493 - loss 0.10039493 throughput (samples/sec): 187.59
2019-08-13 14:42:38,629 epoch 90 - iter 343/493 - loss 0.10234349 throughput (samples/sec): 181.75
2019-08-13 14:42:46,953 epoch 90 - iter 392/493 - loss 0.10080553 throughput (samples/sec): 188.94
2019-08-13 14:42:55,914 epoch 90 - iter 441/493 - loss 0.10148199 throughput (samples/sec): 175.47
2019-08-13 14:43:04,832 epoch 90 - iter 490/493 - loss 0.10038426 throughput (samples/sec): 176.30
2019-08-13 14:43:05,189 ----------------------------------------------------------------------------------------------------
2019-08-13 14:43:05,189 EPOCH 90 done: loss 0.1004 - lr 0.0125
2019-08-13 14:43:05,190 BAD EPOCHS (no improvement): 4
2019-08-13 14:43:05,190 ----------------------------------------------------------------------------------------------------
2019-08-13 14:43:05,332 epoch 91 - iter 0/493 - loss 0.04527986 throughput (samples/sec): 11115.30
2019-08-13 14:43:13,771 epoch 91 - iter 49/493 - loss 0.09324182 throughput (samples/sec): 186.34
2019-08-13 14:43:22,267 epoch 91 - iter 98/493 - loss 0.08831755 throughput (samples/sec): 185.09
2019-08-13 14:43:30,717 epoch 91 - iter 147/493 - loss 0.08698582 throughput (samples/sec): 186.10
2019-08-13 14:43:39,152 epoch 91 - iter 196/493 - loss 0.08803397 throughput (samples/sec): 186.44
2019-08-13 14:43:47,568 epoch 91 - iter 245/493 - loss 0.09003739 throughput (samples/sec): 186.85
2019-08-13 14:43:56,279 epoch 91 - iter 294/493 - loss 0.09705508 throughput (samples/sec): 180.50
2019-08-13 14:44:05,346 epoch 91 - iter 343/493 - loss 0.09963512 throughput (samples/sec): 173.41
2019-08-13 14:44:14,256 epoch 91 - iter 392/493 - loss 0.09717630 throughput (samples/sec): 176.47
2019-08-13 14:44:22,637 epoch 91 - iter 441/493 - loss 0.10005169 throughput (samples/sec): 187.62
2019-08-13 14:44:31,100 epoch 91 - iter 490/493 - loss 0.10173890 throughput (samples/sec): 185.82
2019-08-13 14:44:31,497 ----------------------------------------------------------------------------------------------------
2019-08-13 14:44:31,498 EPOCH 91 done: loss 0.1015 - lr 0.0063
2019-08-13 14:44:31,498 BAD EPOCHS (no improvement): 1
2019-08-13 14:44:31,498 ----------------------------------------------------------------------------------------------------
2019-08-13 14:44:31,703 epoch 92 - iter 0/493 - loss 0.32615161 throughput (samples/sec): 7672.87
2019-08-13 14:44:40,107 epoch 92 - iter 49/493 - loss 0.10792381 throughput (samples/sec): 187.13
2019-08-13 14:44:48,568 epoch 92 - iter 98/493 - loss 0.09363183 throughput (samples/sec): 185.85
2019-08-13 14:44:57,077 epoch 92 - iter 147/493 - loss 0.09268637 throughput (samples/sec): 184.81
2019-08-13 14:45:05,873 epoch 92 - iter 196/493 - loss 0.09057758 throughput (samples/sec): 178.76
2019-08-13 14:45:14,695 epoch 92 - iter 245/493 - loss 0.09148513 throughput (samples/sec): 178.23
2019-08-13 14:45:23,166 epoch 92 - iter 294/493 - loss 0.09737721 throughput (samples/sec): 185.64
2019-08-13 14:45:31,778 epoch 92 - iter 343/493 - loss 0.09869899 throughput (samples/sec): 182.60
2019-08-13 14:45:40,426 epoch 92 - iter 392/493 - loss 0.09914598 throughput (samples/sec): 181.83
2019-08-13 14:45:48,885 epoch 92 - iter 441/493 - loss 0.09960431 throughput (samples/sec): 185.89
2019-08-13 14:45:57,419 epoch 92 - iter 490/493 - loss 0.09879224 throughput (samples/sec): 184.27
2019-08-13 14:45:57,738 ----------------------------------------------------------------------------------------------------
2019-08-13 14:45:57,738 EPOCH 92 done: loss 0.0988 - lr 0.0063
2019-08-13 14:45:57,738 BAD EPOCHS (no improvement): 0
2019-08-13 14:45:57,738 ----------------------------------------------------------------------------------------------------
2019-08-13 14:45:57,893 epoch 93 - iter 0/493 - loss 0.21409404 throughput (samples/sec): 10177.80
2019-08-13 14:46:06,801 epoch 93 - iter 49/493 - loss 0.09546279 throughput (samples/sec): 176.51
2019-08-13 14:46:15,416 epoch 93 - iter 98/493 - loss 0.08754082 throughput (samples/sec): 182.52
2019-08-13 14:46:24,202 epoch 93 - iter 147/493 - loss 0.08560989 throughput (samples/sec): 178.96
2019-08-13 14:46:32,928 epoch 93 - iter 196/493 - loss 0.09820085 throughput (samples/sec): 180.20
2019-08-13 14:46:41,081 epoch 93 - iter 245/493 - loss 0.09917202 throughput (samples/sec): 192.90
2019-08-13 14:46:49,325 epoch 93 - iter 294/493 - loss 0.09727259 throughput (samples/sec): 190.78
2019-08-13 14:46:57,672 epoch 93 - iter 343/493 - loss 0.09660668 throughput (samples/sec): 188.40
2019-08-13 14:47:06,646 epoch 93 - iter 392/493 - loss 0.09493009 throughput (samples/sec): 175.21
2019-08-13 14:47:15,017 epoch 93 - iter 441/493 - loss 0.09532600 throughput (samples/sec): 187.86
2019-08-13 14:47:23,597 epoch 93 - iter 490/493 - loss 0.09409639 throughput (samples/sec): 183.26
2019-08-13 14:47:23,955 ----------------------------------------------------------------------------------------------------
2019-08-13 14:47:23,955 EPOCH 93 done: loss 0.0939 - lr 0.0063
2019-08-13 14:47:23,955 BAD EPOCHS (no improvement): 0
2019-08-13 14:47:23,956 ----------------------------------------------------------------------------------------------------
2019-08-13 14:47:24,141 epoch 94 - iter 0/493 - loss 0.06752709 throughput (samples/sec): 8488.04
2019-08-13 14:47:32,546 epoch 94 - iter 49/493 - loss 0.10571156 throughput (samples/sec): 187.11
2019-08-13 14:47:41,161 epoch 94 - iter 98/493 - loss 0.09829229 throughput (samples/sec): 182.52
2019-08-13 14:47:49,632 epoch 94 - iter 147/493 - loss 0.10357284 throughput (samples/sec): 185.65
2019-08-13 14:47:58,626 epoch 94 - iter 196/493 - loss 0.10197707 throughput (samples/sec): 174.81
2019-08-13 14:48:07,078 epoch 94 - iter 245/493 - loss 0.09730104 throughput (samples/sec): 186.05
2019-08-13 14:48:15,501 epoch 94 - iter 294/493 - loss 0.09996888 throughput (samples/sec): 186.70
2019-08-13 14:48:23,953 epoch 94 - iter 343/493 - loss 0.10036176 throughput (samples/sec): 186.06
2019-08-13 14:48:32,514 epoch 94 - iter 392/493 - loss 0.09741441 throughput (samples/sec): 183.68
2019-08-13 14:48:41,140 epoch 94 - iter 441/493 - loss 0.09896915 throughput (samples/sec): 182.29
2019-08-13 14:48:49,670 epoch 94 - iter 490/493 - loss 0.10079158 throughput (samples/sec): 184.35
2019-08-13 14:48:50,020 ----------------------------------------------------------------------------------------------------
2019-08-13 14:48:50,020 EPOCH 94 done: loss 0.1007 - lr 0.0063
2019-08-13 14:48:50,020 BAD EPOCHS (no improvement): 1
2019-08-13 14:48:50,020 ----------------------------------------------------------------------------------------------------
2019-08-13 14:48:50,177 epoch 95 - iter 0/493 - loss 0.33335775 throughput (samples/sec): 10057.74
2019-08-13 14:48:58,349 epoch 95 - iter 49/493 - loss 0.10825989 throughput (samples/sec): 192.47
2019-08-13 14:49:06,755 epoch 95 - iter 98/493 - loss 0.11415332 throughput (samples/sec): 187.06
2019-08-13 14:49:15,423 epoch 95 - iter 147/493 - loss 0.11174673 throughput (samples/sec): 181.42
2019-08-13 14:49:23,995 epoch 95 - iter 196/493 - loss 0.11439564 throughput (samples/sec): 183.44
2019-08-13 14:49:32,423 epoch 95 - iter 245/493 - loss 0.11023898 throughput (samples/sec): 186.58
2019-08-13 14:49:40,840 epoch 95 - iter 294/493 - loss 0.11301280 throughput (samples/sec): 186.84
2019-08-13 14:49:49,300 epoch 95 - iter 343/493 - loss 0.11383106 throughput (samples/sec): 185.89
2019-08-13 14:49:58,079 epoch 95 - iter 392/493 - loss 0.11444363 throughput (samples/sec): 179.11
2019-08-13 14:50:06,556 epoch 95 - iter 441/493 - loss 0.11289278 throughput (samples/sec): 185.50
2019-08-13 14:50:15,734 epoch 95 - iter 490/493 - loss 0.10951264 throughput (samples/sec): 171.30
2019-08-13 14:50:16,072 ----------------------------------------------------------------------------------------------------
2019-08-13 14:50:16,072 EPOCH 95 done: loss 0.1094 - lr 0.0063
2019-08-13 14:50:16,072 BAD EPOCHS (no improvement): 2
2019-08-13 14:50:16,072 ----------------------------------------------------------------------------------------------------
2019-08-13 14:50:16,227 epoch 96 - iter 0/493 - loss 0.01523057 throughput (samples/sec): 10203.55
2019-08-13 14:50:24,844 epoch 96 - iter 49/493 - loss 0.09390311 throughput (samples/sec): 182.49
2019-08-13 14:50:33,448 epoch 96 - iter 98/493 - loss 0.09972270 throughput (samples/sec): 182.76
2019-08-13 14:50:42,231 epoch 96 - iter 147/493 - loss 0.10534545 throughput (samples/sec): 179.03
2019-08-13 14:50:50,646 epoch 96 - iter 196/493 - loss 0.10731248 throughput (samples/sec): 186.87
2019-08-13 14:50:59,740 epoch 96 - iter 245/493 - loss 0.10967708 throughput (samples/sec): 172.88
2019-08-13 14:51:07,999 epoch 96 - iter 294/493 - loss 0.10860633 throughput (samples/sec): 190.42
2019-08-13 14:51:16,350 epoch 96 - iter 343/493 - loss 0.10375679 throughput (samples/sec): 188.31
2019-08-13 14:51:24,890 epoch 96 - iter 392/493 - loss 0.10445308 throughput (samples/sec): 184.14
2019-08-13 14:51:33,527 epoch 96 - iter 441/493 - loss 0.10566275 throughput (samples/sec): 182.06
2019-08-13 14:51:42,228 epoch 96 - iter 490/493 - loss 0.10851965 throughput (samples/sec): 180.72
2019-08-13 14:51:42,578 ----------------------------------------------------------------------------------------------------
2019-08-13 14:51:42,578 EPOCH 96 done: loss 0.1088 - lr 0.0063
2019-08-13 14:51:42,579 BAD EPOCHS (no improvement): 3
2019-08-13 14:51:42,579 ----------------------------------------------------------------------------------------------------
2019-08-13 14:51:42,748 epoch 97 - iter 0/493 - loss 0.22050321 throughput (samples/sec): 9334.34
2019-08-13 14:51:51,397 epoch 97 - iter 49/493 - loss 0.09270862 throughput (samples/sec): 181.80
2019-08-13 14:51:59,846 epoch 97 - iter 98/493 - loss 0.08723867 throughput (samples/sec): 186.12
2019-08-13 14:52:08,356 epoch 97 - iter 147/493 - loss 0.08433042 throughput (samples/sec): 184.79
2019-08-13 14:52:16,718 epoch 97 - iter 196/493 - loss 0.08685081 throughput (samples/sec): 188.06
2019-08-13 14:52:25,572 epoch 97 - iter 245/493 - loss 0.09292080 throughput (samples/sec): 177.58
2019-08-13 14:52:33,851 epoch 97 - iter 294/493 - loss 0.08991256 throughput (samples/sec): 189.96
2019-08-13 14:52:42,622 epoch 97 - iter 343/493 - loss 0.08908446 throughput (samples/sec): 179.27
2019-08-13 14:52:51,209 epoch 97 - iter 392/493 - loss 0.08927000 throughput (samples/sec): 183.13
2019-08-13 14:52:59,573 epoch 97 - iter 441/493 - loss 0.08939263 throughput (samples/sec): 188.01
2019-08-13 14:53:08,523 epoch 97 - iter 490/493 - loss 0.09077525 throughput (samples/sec): 175.69
2019-08-13 14:53:08,861 ----------------------------------------------------------------------------------------------------
2019-08-13 14:53:08,861 EPOCH 97 done: loss 0.0906 - lr 0.0063
2019-08-13 14:53:08,861 BAD EPOCHS (no improvement): 0
2019-08-13 14:53:08,861 ----------------------------------------------------------------------------------------------------
2019-08-13 14:53:09,056 epoch 98 - iter 0/493 - loss 0.02575123 throughput (samples/sec): 8074.29
2019-08-13 14:53:17,501 epoch 98 - iter 49/493 - loss 0.09421305 throughput (samples/sec): 186.23
2019-08-13 14:53:26,142 epoch 98 - iter 98/493 - loss 0.09482027 throughput (samples/sec): 181.96
2019-08-13 14:53:34,886 epoch 98 - iter 147/493 - loss 0.09634293 throughput (samples/sec): 179.82
2019-08-13 14:53:43,419 epoch 98 - iter 196/493 - loss 0.09581905 throughput (samples/sec): 184.28
2019-08-13 14:53:52,175 epoch 98 - iter 245/493 - loss 0.09871383 throughput (samples/sec): 179.59
2019-08-13 14:54:00,840 epoch 98 - iter 294/493 - loss 0.10081506 throughput (samples/sec): 181.47
2019-08-13 14:54:09,150 epoch 98 - iter 343/493 - loss 0.09827209 throughput (samples/sec): 189.23
2019-08-13 14:54:17,597 epoch 98 - iter 392/493 - loss 0.09766903 throughput (samples/sec): 186.18
2019-08-13 14:54:26,073 epoch 98 - iter 441/493 - loss 0.09947300 throughput (samples/sec): 185.53
2019-08-13 14:54:34,734 epoch 98 - iter 490/493 - loss 0.09675675 throughput (samples/sec): 181.54
2019-08-13 14:54:35,136 ----------------------------------------------------------------------------------------------------
2019-08-13 14:54:35,136 EPOCH 98 done: loss 0.0968 - lr 0.0063
2019-08-13 14:54:35,137 BAD EPOCHS (no improvement): 1
2019-08-13 14:54:35,137 ----------------------------------------------------------------------------------------------------
2019-08-13 14:54:35,339 epoch 99 - iter 0/493 - loss 0.08614630 throughput (samples/sec): 7798.23
2019-08-13 14:54:43,659 epoch 99 - iter 49/493 - loss 0.09744664 throughput (samples/sec): 189.01
2019-08-13 14:54:52,370 epoch 99 - iter 98/493 - loss 0.09477426 throughput (samples/sec): 180.50
2019-08-13 14:55:00,838 epoch 99 - iter 147/493 - loss 0.09908608 throughput (samples/sec): 185.70
2019-08-13 14:55:09,328 epoch 99 - iter 196/493 - loss 0.10179733 throughput (samples/sec): 185.21
2019-08-13 14:55:18,112 epoch 99 - iter 245/493 - loss 0.10036535 throughput (samples/sec): 179.01
2019-08-13 14:55:26,340 epoch 99 - iter 294/493 - loss 0.10101216 throughput (samples/sec): 191.13
2019-08-13 14:55:35,228 epoch 99 - iter 343/493 - loss 0.09911740 throughput (samples/sec): 176.90
2019-08-13 14:55:43,698 epoch 99 - iter 392/493 - loss 0.10158950 throughput (samples/sec): 185.66
2019-08-13 14:55:52,132 epoch 99 - iter 441/493 - loss 0.10146295 throughput (samples/sec): 186.46
2019-08-13 14:56:00,653 epoch 99 - iter 490/493 - loss 0.10214850 throughput (samples/sec): 184.55
2019-08-13 14:56:01,043 ----------------------------------------------------------------------------------------------------
2019-08-13 14:56:01,044 EPOCH 99 done: loss 0.1023 - lr 0.0063
2019-08-13 14:56:01,044 BAD EPOCHS (no improvement): 2
2019-08-13 14:56:01,044 ----------------------------------------------------------------------------------------------------
2019-08-13 14:56:01,203 epoch 100 - iter 0/493 - loss 0.21559682 throughput (samples/sec): 9938.07
2019-08-13 14:56:09,793 epoch 100 - iter 49/493 - loss 0.11515455 throughput (samples/sec): 183.06
2019-08-13 14:56:18,399 epoch 100 - iter 98/493 - loss 0.12005325 throughput (samples/sec): 182.70
2019-08-13 14:56:27,046 epoch 100 - iter 147/493 - loss 0.10573691 throughput (samples/sec): 181.86
2019-08-13 14:56:35,577 epoch 100 - iter 196/493 - loss 0.10729453 throughput (samples/sec): 184.34
2019-08-13 14:56:43,914 epoch 100 - iter 245/493 - loss 0.10287504 throughput (samples/sec): 188.64
2019-08-13 14:56:52,928 epoch 100 - iter 294/493 - loss 0.09952003 throughput (samples/sec): 174.42
2019-08-13 14:57:01,100 epoch 100 - iter 343/493 - loss 0.09737282 throughput (samples/sec): 192.46
2019-08-13 14:57:09,771 epoch 100 - iter 392/493 - loss 0.10063449 throughput (samples/sec): 181.34
2019-08-13 14:57:18,347 epoch 100 - iter 441/493 - loss 0.10051317 throughput (samples/sec): 183.37
2019-08-13 14:57:26,757 epoch 100 - iter 490/493 - loss 0.09988318 throughput (samples/sec): 186.98
2019-08-13 14:57:27,114 ----------------------------------------------------------------------------------------------------
2019-08-13 14:57:27,115 EPOCH 100 done: loss 0.0996 - lr 0.0063
2019-08-13 14:57:27,115 BAD EPOCHS (no improvement): 3
2019-08-13 14:57:27,115 ----------------------------------------------------------------------------------------------------
2019-08-13 14:57:27,293 epoch 101 - iter 0/493 - loss 0.08125275 throughput (samples/sec): 8876.10
2019-08-13 14:57:35,708 epoch 101 - iter 49/493 - loss 0.09051991 throughput (samples/sec): 186.87
2019-08-13 14:57:44,591 epoch 101 - iter 98/493 - loss 0.08881230 throughput (samples/sec): 177.00
2019-08-13 14:57:52,869 epoch 101 - iter 147/493 - loss 0.08678255 throughput (samples/sec): 189.99
2019-08-13 14:58:01,627 epoch 101 - iter 196/493 - loss 0.08727867 throughput (samples/sec): 179.53
2019-08-13 14:58:10,558 epoch 101 - iter 245/493 - loss 0.09298128 throughput (samples/sec): 176.07
2019-08-13 14:58:18,792 epoch 101 - iter 294/493 - loss 0.09429368 throughput (samples/sec): 190.97
2019-08-13 14:58:27,100 epoch 101 - iter 343/493 - loss 0.09044516 throughput (samples/sec): 189.29
2019-08-13 14:58:35,874 epoch 101 - iter 392/493 - loss 0.09212841 throughput (samples/sec): 179.21
2019-08-13 14:58:44,278 epoch 101 - iter 441/493 - loss 0.09005405 throughput (samples/sec): 187.12
2019-08-13 14:58:52,729 epoch 101 - iter 490/493 - loss 0.08905683 throughput (samples/sec): 186.07
2019-08-13 14:58:53,063 ----------------------------------------------------------------------------------------------------
2019-08-13 14:58:53,063 EPOCH 101 done: loss 0.0891 - lr 0.0063
2019-08-13 14:58:53,063 BAD EPOCHS (no improvement): 0
2019-08-13 14:58:53,064 ----------------------------------------------------------------------------------------------------
2019-08-13 14:58:53,199 epoch 102 - iter 0/493 - loss 0.13412762 throughput (samples/sec): 11649.15
2019-08-13 14:59:02,077 epoch 102 - iter 49/493 - loss 0.10531912 throughput (samples/sec): 177.10
2019-08-13 14:59:10,657 epoch 102 - iter 98/493 - loss 0.09143284 throughput (samples/sec): 183.27
2019-08-13 14:59:19,327 epoch 102 - iter 147/493 - loss 0.09384328 throughput (samples/sec): 181.36
2019-08-13 14:59:27,577 epoch 102 - iter 196/493 - loss 0.10153000 throughput (samples/sec): 190.64
2019-08-13 14:59:36,235 epoch 102 - iter 245/493 - loss 0.09951774 throughput (samples/sec): 181.60
2019-08-13 14:59:44,671 epoch 102 - iter 294/493 - loss 0.09873201 throughput (samples/sec): 186.41
2019-08-13 14:59:53,581 epoch 102 - iter 343/493 - loss 0.09975570 throughput (samples/sec): 176.47
2019-08-13 15:00:01,978 epoch 102 - iter 392/493 - loss 0.09695119 throughput (samples/sec): 187.26
2019-08-13 15:00:10,464 epoch 102 - iter 441/493 - loss 0.09693691 throughput (samples/sec): 185.31
2019-08-13 15:00:19,050 epoch 102 - iter 490/493 - loss 0.09587926 throughput (samples/sec): 183.15
2019-08-13 15:00:19,438 ----------------------------------------------------------------------------------------------------
2019-08-13 15:00:19,438 EPOCH 102 done: loss 0.0963 - lr 0.0063
2019-08-13 15:00:19,439 BAD EPOCHS (no improvement): 1
2019-08-13 15:00:19,439 ----------------------------------------------------------------------------------------------------
2019-08-13 15:00:19,604 epoch 103 - iter 0/493 - loss 0.06903970 throughput (samples/sec): 9529.25
2019-08-13 15:00:28,291 epoch 103 - iter 49/493 - loss 0.09490624 throughput (samples/sec): 181.01
2019-08-13 15:00:37,136 epoch 103 - iter 98/493 - loss 0.08441674 throughput (samples/sec): 177.77
2019-08-13 15:00:45,330 epoch 103 - iter 147/493 - loss 0.09019976 throughput (samples/sec): 191.93
2019-08-13 15:00:54,044 epoch 103 - iter 196/493 - loss 0.09826225 throughput (samples/sec): 180.46
2019-08-13 15:01:02,458 epoch 103 - iter 245/493 - loss 0.09607366 throughput (samples/sec): 186.90
2019-08-13 15:01:10,762 epoch 103 - iter 294/493 - loss 0.09872685 throughput (samples/sec): 189.39
2019-08-13 15:01:19,458 epoch 103 - iter 343/493 - loss 0.09953812 throughput (samples/sec): 180.82
2019-08-13 15:01:27,842 epoch 103 - iter 392/493 - loss 0.09742371 throughput (samples/sec): 187.56
2019-08-13 15:01:36,419 epoch 103 - iter 441/493 - loss 0.09860834 throughput (samples/sec): 183.34
2019-08-13 15:01:45,197 epoch 103 - iter 490/493 - loss 0.10070759 throughput (samples/sec): 179.13
2019-08-13 15:01:45,536 ----------------------------------------------------------------------------------------------------
2019-08-13 15:01:45,536 EPOCH 103 done: loss 0.1008 - lr 0.0063
2019-08-13 15:01:45,536 BAD EPOCHS (no improvement): 2
2019-08-13 15:01:45,536 ----------------------------------------------------------------------------------------------------
2019-08-13 15:01:45,682 epoch 104 - iter 0/493 - loss 0.03075659 throughput (samples/sec): 10820.40
2019-08-13 15:01:54,383 epoch 104 - iter 49/493 - loss 0.08818966 throughput (samples/sec): 180.71
2019-08-13 15:02:02,817 epoch 104 - iter 98/493 - loss 0.08310341 throughput (samples/sec): 186.47
2019-08-13 15:02:11,177 epoch 104 - iter 147/493 - loss 0.09678153 throughput (samples/sec): 188.10
2019-08-13 15:02:19,835 epoch 104 - iter 196/493 - loss 0.09097300 throughput (samples/sec): 181.60
2019-08-13 15:02:28,259 epoch 104 - iter 245/493 - loss 0.09162769 throughput (samples/sec): 186.67
2019-08-13 15:02:36,962 epoch 104 - iter 294/493 - loss 0.09102045 throughput (samples/sec): 180.68
2019-08-13 15:02:45,306 epoch 104 - iter 343/493 - loss 0.08841693 throughput (samples/sec): 188.46
2019-08-13 15:02:53,837 epoch 104 - iter 392/493 - loss 0.09123137 throughput (samples/sec): 184.33
2019-08-13 15:03:02,186 epoch 104 - iter 441/493 - loss 0.08858908 throughput (samples/sec): 188.37
2019-08-13 15:03:11,093 epoch 104 - iter 490/493 - loss 0.08664966 throughput (samples/sec): 176.53
2019-08-13 15:03:11,448 ----------------------------------------------------------------------------------------------------
2019-08-13 15:03:11,448 EPOCH 104 done: loss 0.0864 - lr 0.0063
2019-08-13 15:03:11,448 BAD EPOCHS (no improvement): 0
2019-08-13 15:03:11,448 ----------------------------------------------------------------------------------------------------
2019-08-13 15:03:11,590 epoch 105 - iter 0/493 - loss 0.05595046 throughput (samples/sec): 11177.57
2019-08-13 15:03:20,296 epoch 105 - iter 49/493 - loss 0.08809429 throughput (samples/sec): 180.61
2019-08-13 15:03:28,607 epoch 105 - iter 98/493 - loss 0.09476045 throughput (samples/sec): 189.23
2019-08-13 15:03:37,703 epoch 105 - iter 147/493 - loss 0.08591894 throughput (samples/sec): 172.83
2019-08-13 15:03:45,954 epoch 105 - iter 196/493 - loss 0.08406118 throughput (samples/sec): 190.61
2019-08-13 15:03:55,045 epoch 105 - iter 245/493 - loss 0.08914766 throughput (samples/sec): 172.96
2019-08-13 15:04:03,403 epoch 105 - iter 294/493 - loss 0.09031575 throughput (samples/sec): 188.15
2019-08-13 15:04:12,057 epoch 105 - iter 343/493 - loss 0.09198294 throughput (samples/sec): 181.70
2019-08-13 15:04:20,537 epoch 105 - iter 392/493 - loss 0.09467238 throughput (samples/sec): 185.44
2019-08-13 15:04:29,009 epoch 105 - iter 441/493 - loss 0.09398716 throughput (samples/sec): 185.61
2019-08-13 15:04:37,623 epoch 105 - iter 490/493 - loss 0.09627306 throughput (samples/sec): 182.55
2019-08-13 15:04:37,984 ----------------------------------------------------------------------------------------------------
2019-08-13 15:04:37,984 EPOCH 105 done: loss 0.0963 - lr 0.0063
2019-08-13 15:04:37,984 BAD EPOCHS (no improvement): 1
2019-08-13 15:04:37,984 ----------------------------------------------------------------------------------------------------
2019-08-13 15:04:38,171 epoch 106 - iter 0/493 - loss 0.12710166 throughput (samples/sec): 8425.18
2019-08-13 15:04:46,782 epoch 106 - iter 49/493 - loss 0.12971163 throughput (samples/sec): 182.61
2019-08-13 15:04:55,601 epoch 106 - iter 98/493 - loss 0.11553847 throughput (samples/sec): 178.29
2019-08-13 15:05:04,043 epoch 106 - iter 147/493 - loss 0.10912237 throughput (samples/sec): 186.28
2019-08-13 15:05:12,525 epoch 106 - iter 196/493 - loss 0.11400276 throughput (samples/sec): 185.38
2019-08-13 15:05:21,239 epoch 106 - iter 245/493 - loss 0.11664249 throughput (samples/sec): 180.47
2019-08-13 15:05:30,251 epoch 106 - iter 294/493 - loss 0.11366650 throughput (samples/sec): 174.46
2019-08-13 15:05:38,500 epoch 106 - iter 343/493 - loss 0.11214905 throughput (samples/sec): 190.64
2019-08-13 15:05:47,178 epoch 106 - iter 392/493 - loss 0.10860876 throughput (samples/sec): 181.20
2019-08-13 15:05:55,564 epoch 106 - iter 441/493 - loss 0.10880597 throughput (samples/sec): 187.52
2019-08-13 15:06:04,011 epoch 106 - iter 490/493 - loss 0.10752811 throughput (samples/sec): 186.17
2019-08-13 15:06:04,428 ----------------------------------------------------------------------------------------------------
2019-08-13 15:06:04,428 EPOCH 106 done: loss 0.1073 - lr 0.0063
2019-08-13 15:06:04,428 BAD EPOCHS (no improvement): 2
2019-08-13 15:06:04,428 ----------------------------------------------------------------------------------------------------
2019-08-13 15:06:04,595 epoch 107 - iter 0/493 - loss 0.05328560 throughput (samples/sec): 9475.42
2019-08-13 15:06:13,178 epoch 107 - iter 49/493 - loss 0.09484026 throughput (samples/sec): 183.20
2019-08-13 15:06:21,597 epoch 107 - iter 98/493 - loss 0.09217745 throughput (samples/sec): 186.78
2019-08-13 15:06:29,995 epoch 107 - iter 147/493 - loss 0.08379630 throughput (samples/sec): 187.25
2019-08-13 15:06:38,357 epoch 107 - iter 196/493 - loss 0.08738156 throughput (samples/sec): 188.08
2019-08-13 15:06:46,671 epoch 107 - iter 245/493 - loss 0.08940872 throughput (samples/sec): 189.14
2019-08-13 15:06:55,305 epoch 107 - iter 294/493 - loss 0.09501636 throughput (samples/sec): 182.12
2019-08-13 15:07:04,222 epoch 107 - iter 343/493 - loss 0.09373443 throughput (samples/sec): 176.33
2019-08-13 15:07:12,824 epoch 107 - iter 392/493 - loss 0.09743436 throughput (samples/sec): 182.80
2019-08-13 15:07:21,346 epoch 107 - iter 441/493 - loss 0.09598938 throughput (samples/sec): 184.54
2019-08-13 15:07:30,158 epoch 107 - iter 490/493 - loss 0.09786048 throughput (samples/sec): 178.42
2019-08-13 15:07:30,504 ----------------------------------------------------------------------------------------------------
2019-08-13 15:07:30,504 EPOCH 107 done: loss 0.0976 - lr 0.0063
2019-08-13 15:07:30,504 BAD EPOCHS (no improvement): 3
2019-08-13 15:07:30,504 ----------------------------------------------------------------------------------------------------
2019-08-13 15:07:30,698 epoch 108 - iter 0/493 - loss 0.09357727 throughput (samples/sec): 8132.26
2019-08-13 15:07:39,313 epoch 108 - iter 49/493 - loss 0.10320001 throughput (samples/sec): 182.51
2019-08-13 15:07:48,002 epoch 108 - iter 98/493 - loss 0.09442427 throughput (samples/sec): 180.97
2019-08-13 15:07:56,427 epoch 108 - iter 147/493 - loss 0.09113419 throughput (samples/sec): 186.66
2019-08-13 15:08:04,990 epoch 108 - iter 196/493 - loss 0.09373098 throughput (samples/sec): 183.63
2019-08-13 15:08:14,104 epoch 108 - iter 245/493 - loss 0.09903709 throughput (samples/sec): 172.50
2019-08-13 15:08:22,522 epoch 108 - iter 294/493 - loss 0.10068797 throughput (samples/sec): 186.82
2019-08-13 15:08:30,864 epoch 108 - iter 343/493 - loss 0.10035962 throughput (samples/sec): 188.52
2019-08-13 15:08:39,484 epoch 108 - iter 392/493 - loss 0.10076638 throughput (samples/sec): 182.41
2019-08-13 15:08:47,870 epoch 108 - iter 441/493 - loss 0.10101501 throughput (samples/sec): 187.52
2019-08-13 15:08:56,430 epoch 108 - iter 490/493 - loss 0.09920663 throughput (samples/sec): 183.71
2019-08-13 15:08:56,823 ----------------------------------------------------------------------------------------------------
2019-08-13 15:08:56,823 EPOCH 108 done: loss 0.0989 - lr 0.0063
2019-08-13 15:08:56,823 BAD EPOCHS (no improvement): 4
2019-08-13 15:08:56,824 ----------------------------------------------------------------------------------------------------
2019-08-13 15:08:56,973 epoch 109 - iter 0/493 - loss 0.01245594 throughput (samples/sec): 10562.57
2019-08-13 15:09:05,513 epoch 109 - iter 49/493 - loss 0.08830234 throughput (samples/sec): 184.16
2019-08-13 15:09:13,845 epoch 109 - iter 98/493 - loss 0.08090097 throughput (samples/sec): 188.74
2019-08-13 15:09:22,457 epoch 109 - iter 147/493 - loss 0.08930578 throughput (samples/sec): 182.58
2019-08-13 15:09:30,888 epoch 109 - iter 196/493 - loss 0.08982941 throughput (samples/sec): 186.53
2019-08-13 15:09:39,741 epoch 109 - iter 245/493 - loss 0.09223187 throughput (samples/sec): 177.60
2019-08-13 15:09:48,551 epoch 109 - iter 294/493 - loss 0.08914799 throughput (samples/sec): 178.47
2019-08-13 15:09:56,713 epoch 109 - iter 343/493 - loss 0.08888367 throughput (samples/sec): 192.70
2019-08-13 15:10:05,286 epoch 109 - iter 392/493 - loss 0.08982309 throughput (samples/sec): 183.41
2019-08-13 15:10:14,027 epoch 109 - iter 441/493 - loss 0.09164401 throughput (samples/sec): 179.90
2019-08-13 15:10:22,384 epoch 109 - iter 490/493 - loss 0.09361804 throughput (samples/sec): 188.18
2019-08-13 15:10:22,817 ----------------------------------------------------------------------------------------------------
2019-08-13 15:10:22,817 EPOCH 109 done: loss 0.0937 - lr 0.0031
2019-08-13 15:10:22,817 BAD EPOCHS (no improvement): 1
2019-08-13 15:10:22,817 ----------------------------------------------------------------------------------------------------
2019-08-13 15:10:23,002 epoch 110 - iter 0/493 - loss 0.00755867 throughput (samples/sec): 8545.52
2019-08-13 15:10:31,702 epoch 110 - iter 49/493 - loss 0.09999630 throughput (samples/sec): 180.73
2019-08-13 15:10:40,245 epoch 110 - iter 98/493 - loss 0.09025306 throughput (samples/sec): 184.06
2019-08-13 15:10:48,902 epoch 110 - iter 147/493 - loss 0.08883111 throughput (samples/sec): 181.64
2019-08-13 15:10:57,492 epoch 110 - iter 196/493 - loss 0.09813093 throughput (samples/sec): 183.04
2019-08-13 15:11:05,895 epoch 110 - iter 245/493 - loss 0.09658159 throughput (samples/sec): 187.15
2019-08-13 15:11:14,373 epoch 110 - iter 294/493 - loss 0.09479339 throughput (samples/sec): 185.48
2019-08-13 15:11:22,865 epoch 110 - iter 343/493 - loss 0.09368994 throughput (samples/sec): 185.17
2019-08-13 15:11:31,293 epoch 110 - iter 392/493 - loss 0.09569613 throughput (samples/sec): 186.58
2019-08-13 15:11:40,115 epoch 110 - iter 441/493 - loss 0.09481037 throughput (samples/sec): 178.24
2019-08-13 15:11:48,584 epoch 110 - iter 490/493 - loss 0.09527567 throughput (samples/sec): 185.69
2019-08-13 15:11:48,991 ----------------------------------------------------------------------------------------------------
2019-08-13 15:11:48,991 EPOCH 110 done: loss 0.0950 - lr 0.0031
2019-08-13 15:11:48,991 BAD EPOCHS (no improvement): 2
2019-08-13 15:11:48,991 ----------------------------------------------------------------------------------------------------
2019-08-13 15:11:49,144 epoch 111 - iter 0/493 - loss 0.02912006 throughput (samples/sec): 10363.44
2019-08-13 15:11:58,049 epoch 111 - iter 49/493 - loss 0.09183539 throughput (samples/sec): 176.56
2019-08-13 15:12:06,595 epoch 111 - iter 98/493 - loss 0.09006233 throughput (samples/sec): 184.00
2019-08-13 15:12:14,855 epoch 111 - iter 147/493 - loss 0.09019538 throughput (samples/sec): 190.39
2019-08-13 15:12:23,268 epoch 111 - iter 196/493 - loss 0.09803956 throughput (samples/sec): 186.92
2019-08-13 15:12:31,731 epoch 111 - iter 245/493 - loss 0.09717574 throughput (samples/sec): 185.82
2019-08-13 15:12:40,443 epoch 111 - iter 294/493 - loss 0.09440217 throughput (samples/sec): 180.49
2019-08-13 15:12:48,955 epoch 111 - iter 343/493 - loss 0.09530707 throughput (samples/sec): 184.72
2019-08-13 15:12:57,626 epoch 111 - iter 392/493 - loss 0.09760833 throughput (samples/sec): 181.35
2019-08-13 15:13:06,687 epoch 111 - iter 441/493 - loss 0.10017406 throughput (samples/sec): 173.50
2019-08-13 15:13:15,129 epoch 111 - iter 490/493 - loss 0.09950334 throughput (samples/sec): 186.28
2019-08-13 15:13:15,455 ----------------------------------------------------------------------------------------------------
2019-08-13 15:13:15,456 EPOCH 111 done: loss 0.0993 - lr 0.0031
2019-08-13 15:13:15,456 BAD EPOCHS (no improvement): 3
2019-08-13 15:13:15,456 ----------------------------------------------------------------------------------------------------
2019-08-13 15:13:15,642 epoch 112 - iter 0/493 - loss 0.02837771 throughput (samples/sec): 8466.48
2019-08-13 15:13:24,233 epoch 112 - iter 49/493 - loss 0.08268090 throughput (samples/sec): 183.04
2019-08-13 15:13:32,679 epoch 112 - iter 98/493 - loss 0.08937687 throughput (samples/sec): 186.18
2019-08-13 15:13:41,192 epoch 112 - iter 147/493 - loss 0.08830570 throughput (samples/sec): 184.72
2019-08-13 15:13:49,386 epoch 112 - iter 196/493 - loss 0.08790021 throughput (samples/sec): 191.94
2019-08-13 15:13:58,278 epoch 112 - iter 245/493 - loss 0.08800352 throughput (samples/sec): 176.83
2019-08-13 15:14:06,704 epoch 112 - iter 294/493 - loss 0.08484016 throughput (samples/sec): 186.63
2019-08-13 15:14:15,582 epoch 112 - iter 343/493 - loss 0.09044392 throughput (samples/sec): 177.11
2019-08-13 15:14:23,960 epoch 112 - iter 392/493 - loss 0.08739951 throughput (samples/sec): 187.69
2019-08-13 15:14:32,403 epoch 112 - iter 441/493 - loss 0.09236113 throughput (samples/sec): 186.27
2019-08-13 15:14:40,981 epoch 112 - iter 490/493 - loss 0.09341018 throughput (samples/sec): 183.30
2019-08-13 15:14:41,315 ----------------------------------------------------------------------------------------------------
2019-08-13 15:14:41,315 EPOCH 112 done: loss 0.0934 - lr 0.0031
2019-08-13 15:14:41,315 BAD EPOCHS (no improvement): 4
2019-08-13 15:14:41,315 ----------------------------------------------------------------------------------------------------
2019-08-13 15:14:41,479 epoch 113 - iter 0/493 - loss 0.03967896 throughput (samples/sec): 9609.17
2019-08-13 15:14:50,215 epoch 113 - iter 49/493 - loss 0.08194337 throughput (samples/sec): 180.01
2019-08-13 15:14:58,722 epoch 113 - iter 98/493 - loss 0.09404452 throughput (samples/sec): 184.83
2019-08-13 15:15:07,792 epoch 113 - iter 147/493 - loss 0.10030696 throughput (samples/sec): 173.36
2019-08-13 15:15:16,362 epoch 113 - iter 196/493 - loss 0.10011387 throughput (samples/sec): 183.46
2019-08-13 15:15:24,751 epoch 113 - iter 245/493 - loss 0.09977362 throughput (samples/sec): 187.46
2019-08-13 15:15:33,323 epoch 113 - iter 294/493 - loss 0.09688171 throughput (samples/sec): 183.44
2019-08-13 15:15:41,951 epoch 113 - iter 343/493 - loss 0.09956502 throughput (samples/sec): 182.26
2019-08-13 15:15:50,293 epoch 113 - iter 392/493 - loss 0.09922967 throughput (samples/sec): 188.51
2019-08-13 15:15:58,388 epoch 113 - iter 441/493 - loss 0.09939048 throughput (samples/sec): 194.30
2019-08-13 15:16:06,925 epoch 113 - iter 490/493 - loss 0.09887773 throughput (samples/sec): 184.20
2019-08-13 15:16:07,290 ----------------------------------------------------------------------------------------------------
2019-08-13 15:16:07,291 EPOCH 113 done: loss 0.0987 - lr 0.0016
2019-08-13 15:16:07,291 BAD EPOCHS (no improvement): 1
2019-08-13 15:16:07,291 ----------------------------------------------------------------------------------------------------
2019-08-13 15:16:07,464 epoch 114 - iter 0/493 - loss 0.05978882 throughput (samples/sec): 9128.89
2019-08-13 15:16:15,796 epoch 114 - iter 49/493 - loss 0.08597652 throughput (samples/sec): 188.73
2019-08-13 15:16:24,080 epoch 114 - iter 98/493 - loss 0.09327857 throughput (samples/sec): 189.84
2019-08-13 15:16:32,621 epoch 114 - iter 147/493 - loss 0.09364932 throughput (samples/sec): 184.12
2019-08-13 15:16:41,097 epoch 114 - iter 196/493 - loss 0.09572620 throughput (samples/sec): 185.52
2019-08-13 15:16:49,915 epoch 114 - iter 245/493 - loss 0.09577161 throughput (samples/sec): 178.31
2019-08-13 15:16:58,441 epoch 114 - iter 294/493 - loss 0.09520740 throughput (samples/sec): 184.44
2019-08-13 15:17:07,033 epoch 114 - iter 343/493 - loss 0.09375111 throughput (samples/sec): 183.02
2019-08-13 15:17:15,525 epoch 114 - iter 392/493 - loss 0.09299538 throughput (samples/sec): 185.17
2019-08-13 15:17:23,964 epoch 114 - iter 441/493 - loss 0.09570415 throughput (samples/sec): 186.35
2019-08-13 15:17:33,017 epoch 114 - iter 490/493 - loss 0.09629453 throughput (samples/sec): 173.67
2019-08-13 15:17:33,367 ----------------------------------------------------------------------------------------------------
2019-08-13 15:17:33,368 EPOCH 114 done: loss 0.0966 - lr 0.0016
2019-08-13 15:17:33,368 BAD EPOCHS (no improvement): 2
2019-08-13 15:17:33,368 ----------------------------------------------------------------------------------------------------
2019-08-13 15:17:33,536 epoch 115 - iter 0/493 - loss 0.11487782 throughput (samples/sec): 9381.41
2019-08-13 15:17:41,770 epoch 115 - iter 49/493 - loss 0.08079770 throughput (samples/sec): 191.00
2019-08-13 15:17:50,801 epoch 115 - iter 98/493 - loss 0.08637283 throughput (samples/sec): 174.08
2019-08-13 15:17:58,948 epoch 115 - iter 147/493 - loss 0.09209629 throughput (samples/sec): 193.04
2019-08-13 15:18:07,281 epoch 115 - iter 196/493 - loss 0.09113014 throughput (samples/sec): 188.72
2019-08-13 15:18:15,894 epoch 115 - iter 245/493 - loss 0.09502574 throughput (samples/sec): 182.57
2019-08-13 15:18:24,615 epoch 115 - iter 294/493 - loss 0.09292758 throughput (samples/sec): 180.31
2019-08-13 15:18:33,500 epoch 115 - iter 343/493 - loss 0.08912681 throughput (samples/sec): 176.97
2019-08-13 15:18:41,794 epoch 115 - iter 392/493 - loss 0.09004670 throughput (samples/sec): 189.60
2019-08-13 15:18:50,081 epoch 115 - iter 441/493 - loss 0.09029769 throughput (samples/sec): 189.77
2019-08-13 15:18:58,447 epoch 115 - iter 490/493 - loss 0.09119456 throughput (samples/sec): 187.97
2019-08-13 15:18:58,869 ----------------------------------------------------------------------------------------------------
2019-08-13 15:18:58,869 EPOCH 115 done: loss 0.0913 - lr 0.0016
2019-08-13 15:18:58,869 BAD EPOCHS (no improvement): 3
2019-08-13 15:18:58,870 ----------------------------------------------------------------------------------------------------
2019-08-13 15:18:59,023 epoch 116 - iter 0/493 - loss 0.28783396 throughput (samples/sec): 10259.34
2019-08-13 15:19:07,616 epoch 116 - iter 49/493 - loss 0.10501418 throughput (samples/sec): 182.99
2019-08-13 15:19:16,393 epoch 116 - iter 98/493 - loss 0.10138879 throughput (samples/sec): 179.16
2019-08-13 15:19:24,705 epoch 116 - iter 147/493 - loss 0.09486732 throughput (samples/sec): 189.20
2019-08-13 15:19:33,794 epoch 116 - iter 196/493 - loss 0.09356082 throughput (samples/sec): 172.97
2019-08-13 15:19:42,457 epoch 116 - iter 245/493 - loss 0.09439362 throughput (samples/sec): 181.51
2019-08-13 15:19:50,720 epoch 116 - iter 294/493 - loss 0.09255274 throughput (samples/sec): 190.31
2019-08-13 15:19:59,564 epoch 116 - iter 343/493 - loss 0.09317334 throughput (samples/sec): 177.80
2019-08-13 15:20:08,095 epoch 116 - iter 392/493 - loss 0.09301687 throughput (samples/sec): 184.31
2019-08-13 15:20:16,332 epoch 116 - iter 441/493 - loss 0.09386896 throughput (samples/sec): 190.94
2019-08-13 15:20:24,807 epoch 116 - iter 490/493 - loss 0.09380335 throughput (samples/sec): 185.55
2019-08-13 15:20:25,228 ----------------------------------------------------------------------------------------------------
2019-08-13 15:20:25,228 EPOCH 116 done: loss 0.0935 - lr 0.0016
2019-08-13 15:20:25,228 BAD EPOCHS (no improvement): 4
2019-08-13 15:20:25,228 ----------------------------------------------------------------------------------------------------
2019-08-13 15:20:25,466 epoch 117 - iter 0/493 - loss 0.01579219 throughput (samples/sec): 6620.86
2019-08-13 15:20:33,715 epoch 117 - iter 49/493 - loss 0.07178715 throughput (samples/sec): 190.65
2019-08-13 15:20:42,664 epoch 117 - iter 98/493 - loss 0.09345584 throughput (samples/sec): 175.71
2019-08-13 15:20:51,328 epoch 117 - iter 147/493 - loss 0.09810403 throughput (samples/sec): 181.49
2019-08-13 15:20:59,949 epoch 117 - iter 196/493 - loss 0.09682829 throughput (samples/sec): 182.42
2019-08-13 15:21:08,563 epoch 117 - iter 245/493 - loss 0.09810225 throughput (samples/sec): 182.55
2019-08-13 15:21:17,138 epoch 117 - iter 294/493 - loss 0.09409086 throughput (samples/sec): 183.39
2019-08-13 15:21:25,585 epoch 117 - iter 343/493 - loss 0.09182780 throughput (samples/sec): 186.17
2019-08-13 15:21:34,219 epoch 117 - iter 392/493 - loss 0.09336362 throughput (samples/sec): 182.14
2019-08-13 15:21:42,612 epoch 117 - iter 441/493 - loss 0.09196420 throughput (samples/sec): 187.38
2019-08-13 15:21:51,693 epoch 117 - iter 490/493 - loss 0.09017648 throughput (samples/sec): 173.16
2019-08-13 15:21:52,046 ----------------------------------------------------------------------------------------------------
2019-08-13 15:21:52,047 EPOCH 117 done: loss 0.0903 - lr 0.0008
2019-08-13 15:21:52,047 BAD EPOCHS (no improvement): 1
2019-08-13 15:21:52,047 ----------------------------------------------------------------------------------------------------
2019-08-13 15:21:52,236 epoch 118 - iter 0/493 - loss 0.05304426 throughput (samples/sec): 8329.08
2019-08-13 15:22:01,004 epoch 118 - iter 49/493 - loss 0.08418267 throughput (samples/sec): 179.34
2019-08-13 15:22:09,386 epoch 118 - iter 98/493 - loss 0.09409550 throughput (samples/sec): 187.64
2019-08-13 15:22:17,515 epoch 118 - iter 147/493 - loss 0.08946177 throughput (samples/sec): 193.47
2019-08-13 15:22:26,325 epoch 118 - iter 196/493 - loss 0.09163628 throughput (samples/sec): 178.48
2019-08-13 15:22:35,055 epoch 118 - iter 245/493 - loss 0.09365191 throughput (samples/sec): 180.11
2019-08-13 15:22:43,631 epoch 118 - iter 294/493 - loss 0.09217070 throughput (samples/sec): 183.37
2019-08-13 15:22:52,079 epoch 118 - iter 343/493 - loss 0.09220224 throughput (samples/sec): 186.13
2019-08-13 15:23:00,785 epoch 118 - iter 392/493 - loss 0.09228383 throughput (samples/sec): 180.62
2019-08-13 15:23:09,180 epoch 118 - iter 441/493 - loss 0.09303523 throughput (samples/sec): 187.32
2019-08-13 15:23:17,893 epoch 118 - iter 490/493 - loss 0.09587882 throughput (samples/sec): 180.47
2019-08-13 15:23:18,280 ----------------------------------------------------------------------------------------------------
2019-08-13 15:23:18,280 EPOCH 118 done: loss 0.0956 - lr 0.0008
2019-08-13 15:23:18,280 BAD EPOCHS (no improvement): 2
2019-08-13 15:23:18,280 ----------------------------------------------------------------------------------------------------
2019-08-13 15:23:18,434 epoch 119 - iter 0/493 - loss 0.17674640 throughput (samples/sec): 10281.81
2019-08-13 15:23:26,663 epoch 119 - iter 49/493 - loss 0.08770498 throughput (samples/sec): 191.11
2019-08-13 15:23:35,601 epoch 119 - iter 98/493 - loss 0.09942442 throughput (samples/sec): 175.90
2019-08-13 15:23:44,033 epoch 119 - iter 147/493 - loss 0.09638686 throughput (samples/sec): 186.51
2019-08-13 15:23:52,443 epoch 119 - iter 196/493 - loss 0.09056683 throughput (samples/sec): 186.99
2019-08-13 15:24:00,928 epoch 119 - iter 245/493 - loss 0.08969975 throughput (samples/sec): 185.33
2019-08-13 15:24:09,576 epoch 119 - iter 294/493 - loss 0.08941957 throughput (samples/sec): 181.82
2019-08-13 15:24:18,115 epoch 119 - iter 343/493 - loss 0.08781007 throughput (samples/sec): 184.16
2019-08-13 15:24:26,609 epoch 119 - iter 392/493 - loss 0.08791352 throughput (samples/sec): 185.12
2019-08-13 15:24:35,078 epoch 119 - iter 441/493 - loss 0.08870057 throughput (samples/sec): 185.69
2019-08-13 15:24:44,068 epoch 119 - iter 490/493 - loss 0.08922071 throughput (samples/sec): 174.90
2019-08-13 15:24:44,423 ----------------------------------------------------------------------------------------------------
2019-08-13 15:24:44,424 EPOCH 119 done: loss 0.0890 - lr 0.0008
2019-08-13 15:24:44,424 BAD EPOCHS (no improvement): 3
2019-08-13 15:24:44,424 ----------------------------------------------------------------------------------------------------
2019-08-13 15:24:44,562 epoch 120 - iter 0/493 - loss 0.06040365 throughput (samples/sec): 11416.80
2019-08-13 15:24:53,132 epoch 120 - iter 49/493 - loss 0.06979885 throughput (samples/sec): 183.49
2019-08-13 15:25:01,519 epoch 120 - iter 98/493 - loss 0.08312178 throughput (samples/sec): 187.51
2019-08-13 15:25:10,257 epoch 120 - iter 147/493 - loss 0.07780736 throughput (samples/sec): 179.95
2019-08-13 15:25:18,917 epoch 120 - iter 196/493 - loss 0.08481575 throughput (samples/sec): 181.57
2019-08-13 15:25:27,248 epoch 120 - iter 245/493 - loss 0.08384681 throughput (samples/sec): 188.76
2019-08-13 15:25:35,932 epoch 120 - iter 294/493 - loss 0.08961811 throughput (samples/sec): 181.08
2019-08-13 15:25:44,483 epoch 120 - iter 343/493 - loss 0.08972313 throughput (samples/sec): 183.88
2019-08-13 15:25:53,575 epoch 120 - iter 392/493 - loss 0.09212537 throughput (samples/sec): 172.93
2019-08-13 15:26:01,913 epoch 120 - iter 441/493 - loss 0.09457654 throughput (samples/sec): 188.61
2019-08-13 15:26:10,427 epoch 120 - iter 490/493 - loss 0.09562244 throughput (samples/sec): 184.71
2019-08-13 15:26:10,743 ----------------------------------------------------------------------------------------------------
2019-08-13 15:26:10,743 EPOCH 120 done: loss 0.0955 - lr 0.0008
2019-08-13 15:26:10,743 BAD EPOCHS (no improvement): 4
2019-08-13 15:26:10,744 ----------------------------------------------------------------------------------------------------
2019-08-13 15:26:10,920 epoch 121 - iter 0/493 - loss 0.03243092 throughput (samples/sec): 8950.50
2019-08-13 15:26:19,337 epoch 121 - iter 49/493 - loss 0.09409705 throughput (samples/sec): 186.82
2019-08-13 15:26:27,849 epoch 121 - iter 98/493 - loss 0.09316757 throughput (samples/sec): 184.73
2019-08-13 15:26:36,787 epoch 121 - iter 147/493 - loss 0.09026791 throughput (samples/sec): 175.91
2019-08-13 15:26:45,709 epoch 121 - iter 196/493 - loss 0.08757131 throughput (samples/sec): 176.23
2019-08-13 15:26:54,518 epoch 121 - iter 245/493 - loss 0.08711587 throughput (samples/sec): 178.50
2019-08-13 15:27:03,059 epoch 121 - iter 294/493 - loss 0.08780127 throughput (samples/sec): 184.11
2019-08-13 15:27:11,813 epoch 121 - iter 343/493 - loss 0.08990621 throughput (samples/sec): 179.61
2019-08-13 15:27:20,253 epoch 121 - iter 392/493 - loss 0.09303890 throughput (samples/sec): 186.33
2019-08-13 15:27:28,588 epoch 121 - iter 441/493 - loss 0.09561999 throughput (samples/sec): 188.68
2019-08-13 15:27:36,987 epoch 121 - iter 490/493 - loss 0.09387077 throughput (samples/sec): 187.24
2019-08-13 15:27:37,297 ----------------------------------------------------------------------------------------------------
2019-08-13 15:27:37,297 EPOCH 121 done: loss 0.0946 - lr 0.0004
2019-08-13 15:27:37,297 BAD EPOCHS (no improvement): 1
2019-08-13 15:27:37,298 ----------------------------------------------------------------------------------------------------
2019-08-13 15:27:37,457 epoch 122 - iter 0/493 - loss 0.10086432 throughput (samples/sec): 9917.89
2019-08-13 15:27:46,217 epoch 122 - iter 49/493 - loss 0.12220089 throughput (samples/sec): 179.48
2019-08-13 15:27:54,498 epoch 122 - iter 98/493 - loss 0.10395977 throughput (samples/sec): 189.91
2019-08-13 15:28:02,895 epoch 122 - iter 147/493 - loss 0.09775957 throughput (samples/sec): 187.27
2019-08-13 15:28:11,398 epoch 122 - iter 196/493 - loss 0.09884024 throughput (samples/sec): 184.95
2019-08-13 15:28:19,834 epoch 122 - iter 245/493 - loss 0.09727751 throughput (samples/sec): 186.41
2019-08-13 15:28:28,992 epoch 122 - iter 294/493 - loss 0.09600240 throughput (samples/sec): 171.66
2019-08-13 15:28:37,383 epoch 122 - iter 343/493 - loss 0.09431318 throughput (samples/sec): 187.40
2019-08-13 15:28:45,750 epoch 122 - iter 392/493 - loss 0.09602316 throughput (samples/sec): 187.96
2019-08-13 15:28:54,024 epoch 122 - iter 441/493 - loss 0.09311198 throughput (samples/sec): 190.06
2019-08-13 15:29:02,938 epoch 122 - iter 490/493 - loss 0.09424445 throughput (samples/sec): 176.40
2019-08-13 15:29:03,252 ----------------------------------------------------------------------------------------------------
2019-08-13 15:29:03,253 EPOCH 122 done: loss 0.0943 - lr 0.0004
2019-08-13 15:29:03,253 BAD EPOCHS (no improvement): 2
2019-08-13 15:29:03,253 ----------------------------------------------------------------------------------------------------
2019-08-13 15:29:03,416 epoch 123 - iter 0/493 - loss 0.22405833 throughput (samples/sec): 9636.10
2019-08-13 15:29:11,688 epoch 123 - iter 49/493 - loss 0.11712514 throughput (samples/sec): 190.13
2019-08-13 15:29:20,492 epoch 123 - iter 98/493 - loss 0.12024924 throughput (samples/sec): 178.60
2019-08-13 15:29:28,843 epoch 123 - iter 147/493 - loss 0.11075948 throughput (samples/sec): 188.30
2019-08-13 15:29:37,427 epoch 123 - iter 196/493 - loss 0.10659515 throughput (samples/sec): 183.20
2019-08-13 15:29:46,102 epoch 123 - iter 245/493 - loss 0.10415486 throughput (samples/sec): 181.25
2019-08-13 15:29:54,528 epoch 123 - iter 294/493 - loss 0.10398171 throughput (samples/sec): 186.62
2019-08-13 15:30:02,989 epoch 123 - iter 343/493 - loss 0.09893709 throughput (samples/sec): 185.86
2019-08-13 15:30:11,880 epoch 123 - iter 392/493 - loss 0.09556753 throughput (samples/sec): 176.84
2019-08-13 15:30:20,606 epoch 123 - iter 441/493 - loss 0.09457201 throughput (samples/sec): 180.20
2019-08-13 15:30:29,337 epoch 123 - iter 490/493 - loss 0.09273720 throughput (samples/sec): 180.11
2019-08-13 15:30:29,691 ----------------------------------------------------------------------------------------------------
2019-08-13 15:30:29,692 EPOCH 123 done: loss 0.0927 - lr 0.0004
2019-08-13 15:30:29,692 BAD EPOCHS (no improvement): 3
2019-08-13 15:30:29,692 ----------------------------------------------------------------------------------------------------
2019-08-13 15:30:29,846 epoch 124 - iter 0/493 - loss 0.01049644 throughput (samples/sec): 10243.57
2019-08-13 15:30:38,409 epoch 124 - iter 49/493 - loss 0.12221716 throughput (samples/sec): 183.63
2019-08-13 15:30:46,811 epoch 124 - iter 98/493 - loss 0.10358732 throughput (samples/sec): 187.16
2019-08-13 15:30:55,405 epoch 124 - iter 147/493 - loss 0.09828427 throughput (samples/sec): 182.97
2019-08-13 15:31:03,728 epoch 124 - iter 196/493 - loss 0.09402642 throughput (samples/sec): 188.95
2019-08-13 15:31:12,443 epoch 124 - iter 245/493 - loss 0.09173565 throughput (samples/sec): 180.43
2019-08-13 15:31:21,141 epoch 124 - iter 294/493 - loss 0.08995409 throughput (samples/sec): 180.77
2019-08-13 15:31:29,897 epoch 124 - iter 343/493 - loss 0.09021509 throughput (samples/sec): 179.60
2019-08-13 15:31:38,646 epoch 124 - iter 392/493 - loss 0.08972928 throughput (samples/sec): 179.72
2019-08-13 15:31:47,515 epoch 124 - iter 441/493 - loss 0.08823929 throughput (samples/sec): 177.31
2019-08-13 15:31:56,036 epoch 124 - iter 490/493 - loss 0.08967212 throughput (samples/sec): 184.56
2019-08-13 15:31:56,354 ----------------------------------------------------------------------------------------------------
2019-08-13 15:31:56,355 EPOCH 124 done: loss 0.0900 - lr 0.0004
2019-08-13 15:31:56,355 BAD EPOCHS (no improvement): 4
2019-08-13 15:31:56,355 ----------------------------------------------------------------------------------------------------
2019-08-13 15:31:56,507 epoch 125 - iter 0/493 - loss 0.03781831 throughput (samples/sec): 10398.62
2019-08-13 15:32:05,497 epoch 125 - iter 49/493 - loss 0.09734734 throughput (samples/sec): 174.90
2019-08-13 15:32:14,252 epoch 125 - iter 98/493 - loss 0.09008048 throughput (samples/sec): 179.61
2019-08-13 15:32:22,573 epoch 125 - iter 147/493 - loss 0.10003969 throughput (samples/sec): 189.01
2019-08-13 15:32:31,218 epoch 125 - iter 196/493 - loss 0.09675115 throughput (samples/sec): 181.88
2019-08-13 15:32:39,645 epoch 125 - iter 245/493 - loss 0.09548232 throughput (samples/sec): 186.63
2019-08-13 15:32:48,605 epoch 125 - iter 294/493 - loss 0.09381926 throughput (samples/sec): 175.49
2019-08-13 15:32:57,412 epoch 125 - iter 343/493 - loss 0.09490828 throughput (samples/sec): 178.56
2019-08-13 15:33:06,159 epoch 125 - iter 392/493 - loss 0.09475375 throughput (samples/sec): 179.77
2019-08-13 15:33:14,721 epoch 125 - iter 441/493 - loss 0.09565349 throughput (samples/sec): 183.68
2019-08-13 15:33:23,357 epoch 125 - iter 490/493 - loss 0.09710780 throughput (samples/sec): 182.11
2019-08-13 15:33:23,714 ----------------------------------------------------------------------------------------------------
2019-08-13 15:33:23,714 EPOCH 125 done: loss 0.0971 - lr 0.0002
2019-08-13 15:33:23,714 BAD EPOCHS (no improvement): 1
2019-08-13 15:33:23,714 ----------------------------------------------------------------------------------------------------
2019-08-13 15:33:23,893 epoch 126 - iter 0/493 - loss 0.12386203 throughput (samples/sec): 8790.33
2019-08-13 15:33:32,460 epoch 126 - iter 49/493 - loss 0.07719148 throughput (samples/sec): 183.56
2019-08-13 15:33:41,137 epoch 126 - iter 98/493 - loss 0.07424758 throughput (samples/sec): 181.23
2019-08-13 15:33:49,472 epoch 126 - iter 147/493 - loss 0.08256353 throughput (samples/sec): 188.71
2019-08-13 15:33:58,259 epoch 126 - iter 196/493 - loss 0.08429360 throughput (samples/sec): 178.95
2019-08-13 15:34:07,033 epoch 126 - iter 245/493 - loss 0.08836743 throughput (samples/sec): 179.22
2019-08-13 15:34:15,256 epoch 126 - iter 294/493 - loss 0.08734651 throughput (samples/sec): 191.27
2019-08-13 15:34:24,215 epoch 126 - iter 343/493 - loss 0.09072667 throughput (samples/sec): 175.51
2019-08-13 15:34:32,818 epoch 126 - iter 392/493 - loss 0.09261866 throughput (samples/sec): 182.80
2019-08-13 15:34:42,049 epoch 126 - iter 441/493 - loss 0.09188262 throughput (samples/sec): 170.31
2019-08-13 15:34:50,814 epoch 126 - iter 490/493 - loss 0.09180908 throughput (samples/sec): 179.41
2019-08-13 15:34:51,173 ----------------------------------------------------------------------------------------------------
2019-08-13 15:34:51,173 EPOCH 126 done: loss 0.0916 - lr 0.0002
2019-08-13 15:34:51,173 BAD EPOCHS (no improvement): 2
2019-08-13 15:34:51,174 ----------------------------------------------------------------------------------------------------
2019-08-13 15:34:51,355 epoch 127 - iter 0/493 - loss 0.05825290 throughput (samples/sec): 8713.67
2019-08-13 15:35:00,236 epoch 127 - iter 49/493 - loss 0.08469846 throughput (samples/sec): 177.06
2019-08-13 15:35:08,896 epoch 127 - iter 98/493 - loss 0.09319009 throughput (samples/sec): 181.59
2019-08-13 15:35:17,238 epoch 127 - iter 147/493 - loss 0.09420480 throughput (samples/sec): 188.54
2019-08-13 15:35:25,820 epoch 127 - iter 196/493 - loss 0.08974214 throughput (samples/sec): 183.25
2019-08-13 15:35:34,588 epoch 127 - iter 245/493 - loss 0.08633705 throughput (samples/sec): 179.35
2019-08-13 15:35:42,956 epoch 127 - iter 294/493 - loss 0.09103740 throughput (samples/sec): 187.94
2019-08-13 15:35:51,352 epoch 127 - iter 343/493 - loss 0.08985914 throughput (samples/sec): 187.32
2019-08-13 15:36:00,109 epoch 127 - iter 392/493 - loss 0.09022029 throughput (samples/sec): 179.57
2019-08-13 15:36:08,781 epoch 127 - iter 441/493 - loss 0.08878405 throughput (samples/sec): 181.33
2019-08-13 15:36:17,620 epoch 127 - iter 490/493 - loss 0.09285819 throughput (samples/sec): 177.89
2019-08-13 15:36:18,003 ----------------------------------------------------------------------------------------------------
2019-08-13 15:36:18,004 EPOCH 127 done: loss 0.0928 - lr 0.0002
2019-08-13 15:36:18,004 BAD EPOCHS (no improvement): 3
2019-08-13 15:36:18,004 ----------------------------------------------------------------------------------------------------
2019-08-13 15:36:18,178 epoch 128 - iter 0/493 - loss 0.03650999 throughput (samples/sec): 9061.22
2019-08-13 15:36:26,408 epoch 128 - iter 49/493 - loss 0.08690073 throughput (samples/sec): 191.10
2019-08-13 15:36:35,447 epoch 128 - iter 98/493 - loss 0.09707096 throughput (samples/sec): 173.96
2019-08-13 15:36:44,198 epoch 128 - iter 147/493 - loss 0.09368953 throughput (samples/sec): 179.70
2019-08-13 15:36:52,620 epoch 128 - iter 196/493 - loss 0.09638063 throughput (samples/sec): 186.72
2019-08-13 15:37:01,215 epoch 128 - iter 245/493 - loss 0.09534180 throughput (samples/sec): 182.98
2019-08-13 15:37:09,884 epoch 128 - iter 294/493 - loss 0.09598167 throughput (samples/sec): 181.40
2019-08-13 15:37:18,592 epoch 128 - iter 343/493 - loss 0.09570799 throughput (samples/sec): 180.59
2019-08-13 15:37:27,185 epoch 128 - iter 392/493 - loss 0.09354465 throughput (samples/sec): 183.02
2019-08-13 15:37:35,826 epoch 128 - iter 441/493 - loss 0.09218864 throughput (samples/sec): 181.99
2019-08-13 15:37:44,711 epoch 128 - iter 490/493 - loss 0.09191915 throughput (samples/sec): 176.97
2019-08-13 15:37:45,144 ----------------------------------------------------------------------------------------------------
2019-08-13 15:37:45,145 EPOCH 128 done: loss 0.0925 - lr 0.0002
2019-08-13 15:37:45,145 BAD EPOCHS (no improvement): 4
2019-08-13 15:37:45,145 ----------------------------------------------------------------------------------------------------
2019-08-13 15:37:45,145 ----------------------------------------------------------------------------------------------------
2019-08-13 15:37:45,145 learning rate too small - quitting training!
2019-08-13 15:37:45,145 ----------------------------------------------------------------------------------------------------
2019-08-13 15:37:56,106 ----------------------------------------------------------------------------------------------------
2019-08-13 15:37:56,106 Testing using best model ...
2019-08-13 15:38:55,856 0.8996 0.86 0.8794
2019-08-13 15:38:55,856
MICRO_AVG: acc 0.7847 - f1-score 0.8794
MACRO_AVG: acc 0.7001 - f1-score 0.810675
LOC tp: 934 - fp: 99 - fn: 117 - tn: 934 - precision: 0.9042 - recall: 0.8887 - accuracy: 0.8122 - f1-score: 0.8964
MISC tp: 103 - fp: 28 - fn: 103 - tn: 103 - precision: 0.7863 - recall: 0.5000 - accuracy: 0.4402 - f1-score: 0.6113
ORG tp: 448 - fp: 99 - fn: 136 - tn: 448 - precision: 0.8190 - recall: 0.7671 - accuracy: 0.6559 - f1-score: 0.7922
PER tp: 1139 - fp: 67 - fn: 71 - tn: 1139 - precision: 0.9444 - recall: 0.9413 - accuracy: 0.8919 - f1-score: 0.9428
2019-08-13 15:38:55,856 ----------------------------------------------------------------------------------------------------
|