Saving weights and logs of step 0k

flax_model.msgpack

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:bc1811b821c9a1145200e14d92a3c11f1545d413e2f6d069eef5ce2624b079b2
+oid sha256:30b33ab13a8051166cc0dd0b3ce2cf48b5881786a73df29f38dadd36b14b0010
 size 218688

wandb/run-20220507_182604-jtmmbwaj/files/media/table/eval/step_0k_10_92ae240f2472ae79ad31.table.json

@@ -0,0 +1 @@
+{"columns": ["id", "label_str", "beam_1"], "data": [["1272-128104-0000", "mister quilter is the apostle of the middle classes and we are glad to welcome his gospel", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-128104-0001", "nor is mister quilter's manner less interesting than his matter", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-128104-0002", "he tells us that at this festive season of the year with christmas and roast beef looming before us similes drawn from eating and its results occur most readily to the mind", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-128104-0003", "he has grave doubts whether sir frederick leighton's work is really greek after all and can discover in it but little of rocky ithaca", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-128104-0005", "it is obviously unnecessary for us to point out how luminous these criticisms are how delicate in expression", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-128104-0006", "on the general principles of art mister quilter writes with equal lucidity", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-128104-0007", "painting he tells us is of a different quality to mathematics and finish in art is adding more fact", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-128104-0008", "as for etchings they are of two kinds british and foreign", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-128104-0010", "near the fire and the ornaments fred brought home from india on the mantel board", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-128104-0012", "only unfortunately his own work never does get good", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-128104-0013", "mister quilter has missed his chance for he has failed even to make himself the tupper of painting", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-128104-0014", "by harry quilter m a", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0000", "because you were sleeping instead of conquering the lovely rose princess has become a fiddle without a bow while poor shaggy sits there a cooing dove", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0001", "he has gone and gone for good answered polychrome who had managed to squeeze into the room beside the dragon and had witnessed the occurrences with much interest", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0002", "i have remained a prisoner only because i wished to be one and with this he stepped forward and burst the stout chains as easily as if they had been threads", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0003", "the little girl had been asleep but she heard the raps and opened the door", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0004", "the king has fled in disgrace and your friends are asking for you", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0005", "i begged ruggedo long ago to send him away but he would not do so", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0006", "i also offered to help your brother to escape but he would not go", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0007", "he eats and sleeps very steadily replied the new king", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0008", "i hope he doesn't work too hard said shaggy", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0009", "he doesn't work at all", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0010", "in fact there is nothing he can do in these dominions as well as our nomes whose numbers are so great that it worries us to keep them all busy", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0011", "not exactly returned kaliko", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0012", "where is my brother now", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0013", "inquired shaggy in the metal forest", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0014", "where is that", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0015", "the metal forest is in the great domed cavern the largest in all our dominions replied kaliko", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0016", "kaliko hesitated", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0017", "however if we look sharp we may be able to discover one of these secret ways", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0018", "oh no i'm quite sure he didn't", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0019", "that's funny remarked betsy thoughtfully", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0020", "i don't believe ann knew any magic or she'd have worked it before", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0021", "i do not know confessed shaggy", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0022", "true agreed kaliko", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0023", "kaliko went to the big gong and pounded on it just as ruggedo used to do but no one answered the summons", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0000", "a man said to the universe sir i exist", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0001", "sweat covered brion's body trickling into the tight loincloth that was the only garment he wore", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0003", "his instant of panic was followed by a small sharp blow high on his chest", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0004", "one minute a voice said and the time buzzer sounded", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0005", "a minute is not a very large measure of time and his body needed every fraction of it", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0006", "the buzzer's whirr triggered his muscles into complete relaxation", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0007", "only his heart and lungs worked on at a strong measured rate", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0008", "he was in reverie sliding along the borders of consciousness", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0009", "the contestants in the twenties needed undisturbed rest therefore nights in the dormitories were as quiet as death", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0010", "particularly so on this last night when only two of the little cubicles were occupied the thousands of others standing with dark empty doors", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0011", "the other voice snapped with a harsh urgency clearly used to command", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0012", "i'm here because the matter is of utmost importance and brandd is the one i must see now stand aside", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0013", "the twenties", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0014", "he must have drawn his gun because the intruder said quickly put that away you're being a fool out", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"]]}

wandb/run-20220507_182604-jtmmbwaj/files/media/table/eval/step_0k_incorrect_10_b30e6671cbaaf5c82b6d.table.json

@@ -0,0 +1 @@
+{"columns": ["id", "label_str", "beam_1"], "data": [["1272-128104-0000", "mister quilter is the apostle of the middle classes and we are glad to welcome his gospel", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-128104-0001", "nor is mister quilter's manner less interesting than his matter", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-128104-0002", "he tells us that at this festive season of the year with christmas and roast beef looming before us similes drawn from eating and its results occur most readily to the mind", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-128104-0003", "he has grave doubts whether sir frederick leighton's work is really greek after all and can discover in it but little of rocky ithaca", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-128104-0005", "it is obviously unnecessary for us to point out how luminous these criticisms are how delicate in expression", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-128104-0006", "on the general principles of art mister quilter writes with equal lucidity", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-128104-0007", "painting he tells us is of a different quality to mathematics and finish in art is adding more fact", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-128104-0008", "as for etchings they are of two kinds british and foreign", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-128104-0010", "near the fire and the ornaments fred brought home from india on the mantel board", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-128104-0012", "only unfortunately his own work never does get good", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-128104-0013", "mister quilter has missed his chance for he has failed even to make himself the tupper of painting", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-128104-0014", "by harry quilter m a", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0000", "because you were sleeping instead of conquering the lovely rose princess has become a fiddle without a bow while poor shaggy sits there a cooing dove", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0001", "he has gone and gone for good answered polychrome who had managed to squeeze into the room beside the dragon and had witnessed the occurrences with much interest", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0002", "i have remained a prisoner only because i wished to be one and with this he stepped forward and burst the stout chains as easily as if they had been threads", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0003", "the little girl had been asleep but she heard the raps and opened the door", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0004", "the king has fled in disgrace and your friends are asking for you", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0005", "i begged ruggedo long ago to send him away but he would not do so", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0006", "i also offered to help your brother to escape but he would not go", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0007", "he eats and sleeps very steadily replied the new king", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0008", "i hope he doesn't work too hard said shaggy", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0009", "he doesn't work at all", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0010", "in fact there is nothing he can do in these dominions as well as our nomes whose numbers are so great that it worries us to keep them all busy", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0011", "not exactly returned kaliko", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0012", "where is my brother now", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0013", "inquired shaggy in the metal forest", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0014", "where is that", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0015", "the metal forest is in the great domed cavern the largest in all our dominions replied kaliko", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0016", "kaliko hesitated", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0017", "however if we look sharp we may be able to discover one of these secret ways", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0018", "oh no i'm quite sure he didn't", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0019", "that's funny remarked betsy thoughtfully", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0020", "i don't believe ann knew any magic or she'd have worked it before", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0021", "i do not know confessed shaggy", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0022", "true agreed kaliko", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0023", "kaliko went to the big gong and pounded on it just as ruggedo used to do but no one answered the summons", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0000", "a man said to the universe sir i exist", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0001", "sweat covered brion's body trickling into the tight loincloth that was the only garment he wore", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0003", "his instant of panic was followed by a small sharp blow high on his chest", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0004", "one minute a voice said and the time buzzer sounded", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0005", "a minute is not a very large measure of time and his body needed every fraction of it", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0006", "the buzzer's whirr triggered his muscles into complete relaxation", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0007", "only his heart and lungs worked on at a strong measured rate", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0008", "he was in reverie sliding along the borders of consciousness", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0009", "the contestants in the twenties needed undisturbed rest therefore nights in the dormitories were as quiet as death", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0010", "particularly so on this last night when only two of the little cubicles were occupied the thousands of others standing with dark empty doors", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0011", "the other voice snapped with a harsh urgency clearly used to command", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0012", "i'm here because the matter is of utmost importance and brandd is the one i must see now stand aside", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0013", "the twenties", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0014", "he must have drawn his gun because the intruder said quickly put that away you're being a fool out", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0015", "there was silence then and still wondering brion was once more asleep", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0016", "ten seconds", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0017", "he asked the handler who was kneading his aching muscles", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0018", "a red haired mountain of a man with an apparently inexhaustible store of energy", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0019", "there could be little art in this last and final round of fencing", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0020", "just thrust and parry and victory to the stronger", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0021", "every man who entered the twenties had his own training tricks", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0022", "there appeared to be an immediate association with the death trauma as if the two were inextricably linked into one", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0023", "the strength that enables someone in a trance to hold his body stiff and unsupported except at two points the head and heels", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0024", "this is physically impossible when conscious", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0025", "others had died before during the twenties and death during the last round was in some ways easier than defeat", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0026", "breathing deeply brion softly spoke the auto hypnotic phrases that triggered the process", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0027", "when the buzzer sounded he pulled his foil from his second's startled grasp and ran forward", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0028", "irolg looked amazed at the sudden fury of the attack then smiled", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"]]}

wandb/run-20220507_182604-jtmmbwaj/files/output.log

@@ -684,3 +684,17 @@ Step... (4 | Loss: 6.902615070343018, Learning Rate: 2.400018274784088e-06, Grad
 
 
 
+Evaluating ...:  75%|███████████████████████████████████████████████████▊                 | 3/4 [01:07<00:22, 22.22s/it]
+Model weights saved in /home/sanchitgandhi/flax-dummy/flax_model.msgpack                  | 1/4 [01:09<00:02,  1.43it/s]
+tokenizer config file saved in ./tokenizer_config.json
+Special tokens file saved in ./special_tokens_map.json
+Training...:  50%|████████████████████████████████████                                    | 2/4 [01:13<01:26, 43.07s/it]
+Step... (6 | Loss: 6.901852607727051, Learning Rate: 3.5999983083456755e-06, Gradient Norm: 0.30425846576690674)
+Epoch... (2/3 | Eval Loss: 6.897060394287109 | Eval wer: 1.2724137931034483 |):  67%|███▎ | 2/3 [02:23<01:11, 71.87s/it]
+Training...:  25%|██████████████████                                                      | 1/4 [00:00<00:02,  1.49it/s]
+Step... (8 | Loss: 6.903735160827637, Learning Rate: 4.799978341907263e-06, Gradient Norm: 0.29388272762298584)
+Step... (9 | Loss: 6.9003190994262695, Learning Rate: 5.4000120144337416e-06, Gradient Norm: 0.26453110575675964)
+Training...:  50%|████████████████████████████████████                                    | 2/4 [00:01<00:01,  1.47it/s]
+
+
+

wandb/run-20220507_182604-jtmmbwaj/files/wandb-summary.json

@@ -1 +1 @@
-{"train/decoder_grad_norm": 0.2681843340396881, "train/decoder_param_norm": 10.987308502197266, "train/encoder_grad_norm": 5.215159762883559e-05, "train/encoder_param_norm": 21.97297477722168, "train/grad_norm": 0.2681843340396881, "layer_grad_norm/": {"decoder": {"model": {"decoder": {"embed_positions": {"embedding": 0.13019102811813354}, "embed_tokens": {"embedding": 0.23307092487812042}, "layernorm_embedding": {"bias": 0.005440065637230873, "scale": 0.004160936456173658}, "layers": {"FlaxBartDecoderLayers": {"encoder_attn": {"k_proj": {"bias": 3.241078466807018e-13, "kernel": 9.277729409382096e-13}, "out_proj": {"bias": 0.008914541453123093, "kernel": 4.4008887925883755e-05}, "q_proj": {"bias": 6.479329334348194e-13, "kernel": 9.201536017508505e-13}, "v_proj": {"bias": 0.001009665080346167, "kernel": 3.907786322088214e-06}}, "encoder_attn_layer_norm": {"bias": 0.009093240834772587, "scale": 0.005864849779754877}, "fc1": {"bias": 0.00013779630535282195, "kernel": 0.00037643039831891656}, "fc2": {"bias": 0.008857807144522667, "kernel": 0.000335609947796911}, "final_layer_norm": {"bias": 0.009552594274282455, "scale": 0.0060695563443005085}, "self_attn": {"k_proj": {"bias": 1.0063173627727906e-09, "kernel": 3.8422240322688594e-06}, "out_proj": {"bias": 0.009011783637106419, "kernel": 0.0007192231132648885}, "q_proj": {"bias": 1.410111622135446e-06, "kernel": 4.439060830918606e-06}, "v_proj": {"bias": 0.0006737391231581569, "kernel": 0.0006772780325263739}}, "self_attn_layer_norm": {"bias": 0.009094683453440666, "scale": 0.005866193678230047}}}}}}, "encoder": {"adapter": {"layers": {"0": {"conv": {"bias": 2.5814267701207427e-07, "kernel": 1.2365622978904867e-06}}, "1": {"conv": {"bias": 3.0718340440216707e-06, "kernel": 1.3853882592229638e-06}}, "2": {"conv": {"bias": 5.195090488996357e-05, "kernel": 2.528876166252303e-06}}}}, "encoder": {"layer_norm": {"bias": 4.200019532163424e-08, "scale": 4.295658229125365e-08}, "layers": {"FlaxWav2Vec2EncoderLayers": {"attention": {"k_proj": {"bias": 1.4866074086935252e-15, "kernel": 1.2133823112936426e-10}, "out_proj": {"bias": 6.935447913747339e-07, "kernel": 1.1620355166996887e-07}, "q_proj": {"bias": 4.556995406024278e-11, "kernel": 1.1936587829275425e-10}, "v_proj": {"bias": 5.2707189723832926e-08, "kernel": 1.1697017043843516e-07}}, "feed_forward": {"intermediate_dense": {"bias": 2.9468106177432674e-08, "kernel": 8.333873324772867e-08}, "output_dense": {"bias": 6.715945914947952e-07, "kernel": 9.472834960888576e-08}}, "final_layer_norm": {"bias": 2.068675897248795e-09, "scale": 1.3903508344625948e-09}, "layer_norm": {"bias": 4.099741879315388e-09, "scale": 2.446022273616677e-09}}}, "pos_conv_embed": {"conv": {"bias": 2.4324705805156555e-07, "weight_g": 5.952928372465749e-09, "weight_v": 6.691659848456766e-08}}}, "feature_extractor": {"conv_layers": {"0": {"conv": {"kernel": 0.0}, "layer_norm": {"bias": 0.0, "scale": 0.0}}, "1": {"conv": {"kernel": 0.0}, "layer_norm": {"bias": 0.0, "scale": 0.0}}, "2": {"conv": {"kernel": 0.0}, "layer_norm": {"bias": 0.0, "scale": 0.0}}}}, "feature_projection": {"layer_norm": {"bias": 4.796107333504551e-08, "scale": 6.9013936787598595e-09}, "projection": {"bias": 5.284446729092451e-07, "kernel": 4.6746677639930567e-07}}, "masked_spec_embed": 0.0}}, "layer_param_norm/": {"decoder": {"model": {"decoder": {"embed_positions": {"embedding": 0.7995857000350952}, "embed_tokens": {"embedding": 2.508484125137329}, "layernorm_embedding": {"bias": 0.0044089145958423615, "scale": 4.000093936920166}, "layers": {"FlaxBartDecoderLayers": {"encoder_attn": {"k_proj": {"bias": 2.6241984141250896e-09, "kernel": 0.43237069249153137}, "out_proj": {"bias": 0.006208351813256741, "kernel": 0.46708208322525024}, "q_proj": {"bias": 3.36700978209592e-08, "kernel": 0.4763868451118469}, "v_proj": {"bias": 0.006663716863840818, "kernel": 0.46299299597740173}}, "encoder_attn_layer_norm": {"bias": 0.006329583004117012, "scale": 5.656974792480469}, "fc1": {"bias": 0.0031577576883137226, "kernel": 0.2302737683057785}, "fc2": {"bias": 0.0062227933667600155, "kernel": 0.22851601243019104}, "final_layer_norm": {"bias": 0.006091490387916565, "scale": 5.657162189483643}, "self_attn": {"k_proj": {"bias": 1.347113629890373e-05, "kernel": 0.4489072561264038}, "out_proj": {"bias": 0.006212137173861265, "kernel": 0.4596090614795685}, "q_proj": {"bias": 0.005390589125454426, "kernel": 0.43899983167648315}, "v_proj": {"bias": 0.005982028320431709, "kernel": 0.47396859526634216}}, "self_attn_layer_norm": {"bias": 0.006329756695777178, "scale": 5.656975269317627}}}}}}, "encoder": {"adapter": {"layers": {"0": {"conv": {"bias": 0.0037867689970880747, "kernel": 0.7979688048362732}}, "1": {"conv": {"bias": 0.00473013473674655, "kernel": 0.7824119925498962}}, "2": {"conv": {"bias": 0.004608336370438337, "kernel": 0.7934591174125671}}}}, "encoder": {"layer_norm": {"bias": 0.0014159531565383077, "scale": 4.000493049621582}, "layers": {"FlaxWav2Vec2EncoderLayers": {"attention": {"k_proj": {"bias": 1.1637950325660285e-10, "kernel": 0.6511669158935547}, "out_proj": {"bias": 0.004414305556565523, "kernel": 0.6515696048736572}, "q_proj": {"bias": 9.045841579791158e-06, "kernel": 0.636457085609436}, "v_proj": {"bias": 0.0028330215718597174, "kernel": 0.6421413421630859}}, "feed_forward": {"intermediate_dense": {"bias": 0.0022769507486373186, "kernel": 0.706342339515686}, "output_dense": {"bias": 0.00466313399374485, "kernel": 0.7153216004371643}}, "final_layer_norm": {"bias": 0.0003239295328967273, "scale": 7.999977111816406}, "layer_norm": {"bias": 0.0006316141225397587, "scale": 8.000049591064453}}}, "pos_conv_embed": {"conv": {"bias": 0.0019426605431362987, "weight_g": 2.277707099914551, "weight_v": 2.2775826454162598}}}, "feature_extractor": {"conv_layers": {"0": {"conv": {"kernel": 7.867799758911133}, "layer_norm": {"bias": 0.0, "scale": 5.656854152679443}}, "1": {"conv": {"kernel": 8.025212287902832}, "layer_norm": {"bias": 0.0, "scale": 5.656854152679443}}, "2": {"conv": {"kernel": 7.975250720977783}, "layer_norm": {"bias": 0.0, "scale": 5.656854152679443}}}}, "feature_projection": {"layer_norm": {"bias": 0.0016079015331342816, "scale": 5.656806945800781}, "projection": {"bias": 0.0019150938605889678, "kernel": 0.4300815463066101}}, "masked_spec_embed": 2.404470205307007}}, "train/learning_rate": 2.400018274784088e-06, "train/loss": 6.902615070343018, "train/param_norm": 24.56690216064453, "_timestamp": 1651948051, "_runtime": 87, "_step": 4}
+{"train/decoder_grad_norm": 0.26453110575675964, "train/decoder_param_norm": 10.987306594848633, "train/encoder_grad_norm": 5.18148772243876e-05, "train/encoder_param_norm": 21.972984313964844, "train/grad_norm": 0.26453110575675964, "layer_grad_norm/": {"decoder": {"model": {"decoder": {"embed_positions": {"embedding": 0.13333000242710114}, "embed_tokens": {"embedding": 0.227036252617836}, "layernorm_embedding": {"bias": 0.00637953681871295, "scale": 0.004036674741655588}, "layers": {"FlaxBartDecoderLayers": {"encoder_attn": {"k_proj": {"bias": 3.7407571614953006e-13, "kernel": 8.183233821471014e-13}, "out_proj": {"bias": 0.00924411229789257, "kernel": 4.5885488361818716e-05}, "q_proj": {"bias": 6.498273598908033e-13, "kernel": 9.20138097659784e-13}, "v_proj": {"bias": 0.0010276876855641603, "kernel": 3.753163582587149e-06}}, "encoder_attn_layer_norm": {"bias": 0.008945539593696594, "scale": 0.005678807385265827}, "fc1": {"bias": 0.00016932463040575385, "kernel": 0.00043169219861738384}, "fc2": {"bias": 0.009121513925492764, "kernel": 0.0003878716961480677}, "final_layer_norm": {"bias": 0.009716921485960484, "scale": 0.005678168497979641}, "self_attn": {"k_proj": {"bias": 8.786574801078473e-10, "kernel": 3.6653138977271738e-06}, "out_proj": {"bias": 0.008601952344179153, "kernel": 0.0008318223408423364}, "q_proj": {"bias": 1.634633122193918e-06, "kernel": 3.7823299408046296e-06}, "v_proj": {"bias": 0.0007478533079847693, "kernel": 0.0009300732635892928}}, "self_attn_layer_norm": {"bias": 0.008945669047534466, "scale": 0.005675553809851408}}}}}}, "encoder": {"adapter": {"layers": {"0": {"conv": {"bias": 2.535704766160052e-07, "kernel": 1.124351570069848e-06}}, "1": {"conv": {"bias": 3.1028996545501286e-06, "kernel": 1.1931376775464742e-06}}, "2": {"conv": {"bias": 5.1621496822917834e-05, "kernel": 2.111855337716406e-06}}}}, "encoder": {"layer_norm": {"bias": 4.121615759800079e-08, "scale": 4.017002197542752e-08}, "layers": {"FlaxWav2Vec2EncoderLayers": {"attention": {"k_proj": {"bias": 2.4371426999046176e-15, "kernel": 1.8055959505325347e-10}, "out_proj": {"bias": 9.689325679573813e-07, "kernel": 1.4633050682277826e-07}, "q_proj": {"bias": 7.726132233987215e-11, "kernel": 2.0390449051443937e-10}, "v_proj": {"bias": 8.068035128871998e-08, "kernel": 1.698563210084103e-07}}, "feed_forward": {"intermediate_dense": {"bias": 4.291293365099591e-08, "kernel": 1.1058417470621862e-07}, "output_dense": {"bias": 8.554996497878165e-07, "kernel": 1.1721822090748901e-07}}, "final_layer_norm": {"bias": 2.9891225050704406e-09, "scale": 2.179626257259315e-09}, "layer_norm": {"bias": 7.093929443868774e-09, "scale": 3.6882075171718043e-09}}}, "pos_conv_embed": {"conv": {"bias": 4.5296749817680393e-07, "weight_g": 8.017462249654272e-09, "weight_v": 8.597221068384897e-08}}}, "feature_extractor": {"conv_layers": {"0": {"conv": {"kernel": 0.0}, "layer_norm": {"bias": 0.0, "scale": 0.0}}, "1": {"conv": {"kernel": 0.0}, "layer_norm": {"bias": 0.0, "scale": 0.0}}, "2": {"conv": {"kernel": 0.0}, "layer_norm": {"bias": 0.0, "scale": 0.0}}}}, "feature_projection": {"layer_norm": {"bias": 8.964173048298107e-08, "scale": 8.722928157567367e-09}, "projection": {"bias": 9.033700507643516e-07, "kernel": 6.058419330656761e-07}}, "masked_spec_embed": 0.0}}, "layer_param_norm/": {"decoder": {"model": {"decoder": {"embed_positions": {"embedding": 0.7995898723602295}, "embed_tokens": {"embedding": 2.5084078311920166}, "layernorm_embedding": {"bias": 0.00447498494759202, "scale": 4.000092506408691}, "layers": {"FlaxBartDecoderLayers": {"encoder_attn": {"k_proj": {"bias": 2.6472568581681344e-09, "kernel": 0.43237069249153137}, "out_proj": {"bias": 0.006300929002463818, "kernel": 0.46718600392341614}, "q_proj": {"bias": 3.506927015450856e-08, "kernel": 0.4763868451118469}, "v_proj": {"bias": 0.006763896904885769, "kernel": 0.46305426955223083}}, "encoder_attn_layer_norm": {"bias": 0.0064230733551084995, "scale": 5.6569719314575195}, "fc1": {"bias": 0.003207920119166374, "kernel": 0.2302629053592682}, "fc2": {"bias": 0.0063160983845591545, "kernel": 0.22850406169891357}, "final_layer_norm": {"bias": 0.006180679891258478, "scale": 5.6571760177612305}, "self_attn": {"k_proj": {"bias": 1.3502713954949286e-05, "kernel": 0.4489299952983856}, "out_proj": {"bias": 0.006303939037024975, "kernel": 0.45963284373283386}, "q_proj": {"bias": 0.005469853058457375, "kernel": 0.43901684880256653}, "v_proj": {"bias": 0.006069101393222809, "kernel": 0.473983496427536}}, "self_attn_layer_norm": {"bias": 0.0064232503063976765, "scale": 5.656972885131836}}}}}}, "encoder": {"adapter": {"layers": {"0": {"conv": {"bias": 0.0038520051166415215, "kernel": 0.7979947328567505}}, "1": {"conv": {"bias": 0.004805084317922592, "kernel": 0.7824404239654541}}, "2": {"conv": {"bias": 0.004687825683504343, "kernel": 0.7934887409210205}}}}, "encoder": {"layer_norm": {"bias": 0.0014521583216264844, "scale": 4.000512599945068}, "layers": {"FlaxWav2Vec2EncoderLayers": {"attention": {"k_proj": {"bias": 1.1632900198677021e-10, "kernel": 0.6511669158935547}, "out_proj": {"bias": 0.00448406720533967, "kernel": 0.6515817642211914}, "q_proj": {"bias": 9.086466889129952e-06, "kernel": 0.636457085609436}, "v_proj": {"bias": 0.0028681184630841017, "kernel": 0.6421532034873962}}, "feed_forward": {"intermediate_dense": {"bias": 0.002305160043761134, "kernel": 0.7063438892364502}, "output_dense": {"bias": 0.0047332108952105045, "kernel": 0.7153226733207703}}, "final_layer_norm": {"bias": 0.0003268542350269854, "scale": 7.999977111816406}, "layer_norm": {"bias": 0.0006366657325997949, "scale": 8.00005054473877}}}, "pos_conv_embed": {"conv": {"bias": 0.001976386411115527, "weight_g": 2.277710199356079, "weight_v": 2.2775821685791016}}}, "feature_extractor": {"conv_layers": {"0": {"conv": {"kernel": 7.867799758911133}, "layer_norm": {"bias": 0.0, "scale": 5.656854152679443}}, "1": {"conv": {"kernel": 8.025212287902832}, "layer_norm": {"bias": 0.0, "scale": 5.656854152679443}}, "2": {"conv": {"kernel": 7.975250720977783}, "layer_norm": {"bias": 0.0, "scale": 5.656854152679443}}}}, "feature_projection": {"layer_norm": {"bias": 0.0016328232595697045, "scale": 5.65680456161499}, "projection": {"bias": 0.0019516688771545887, "kernel": 0.4300649166107178}}, "masked_spec_embed": 2.404470205307007}}, "train/learning_rate": 5.4000120144337416e-06, "train/loss": 6.9003190994262695, "train/param_norm": 24.56690788269043, "_timestamp": 1651948126, "_runtime": 162, "_step": 9, "eval/loss": 6.897060394287109, "eval/wer": 1.2724137931034483, "eval/step_0k": {"_type": "table-file", "path": "media/table/eval/step_0k_5_f901d5b4b0d1263be066.table.json", "sha256": "f901d5b4b0d1263be066c7f7b5a69ee57c111da571490164fd2001f31ec47a98", "size": 12070, "artifact_path": "wandb-client-artifact://ijyyl8n3wnmab8kfjmo80ocuba9q20quef7fz6cy74pjb1bs5itgah7iompp8pv1fpfiz07w6m15z297vxd6vhbj23dxy7rmasq7bf0fe15yi18gxrjwicv3r9jwnyfl:latest/eval/step_0k.table.json", "_latest_artifact_path": "wandb-client-artifact://ijyyl8n3wnmab8kfjmo80ocuba9q20quef7fz6cy74pjb1bs5itgah7iompp8pv1fpfiz07w6m15z297vxd6vhbj23dxy7rmasq7bf0fe15yi18gxrjwicv3r9jwnyfl:latest/eval/step_0k.table.json", "ncols": 3, "nrows": 50}}

wandb/run-20220507_182604-jtmmbwaj/logs/debug-internal.log

@@ -100,3 +100,62 @@
 2022-05-07 18:28:41,237 INFO    Thread-7  :40892 [dir_watcher.py:_on_file_created():217] file/dir created: /home/sanchitgandhi/flax-dummy/wandb/run-20220507_182604-jtmmbwaj/files/media
 2022-05-07 18:28:41,237 INFO    Thread-7  :40892 [dir_watcher.py:_on_file_created():217] file/dir created: /home/sanchitgandhi/flax-dummy/wandb/run-20220507_182604-jtmmbwaj/files/media/table/eval
 2022-05-07 18:28:41,237 INFO    Thread-7  :40892 [dir_watcher.py:_on_file_created():217] file/dir created: /home/sanchitgandhi/flax-dummy/wandb/run-20220507_182604-jtmmbwaj/files/media/table
+2022-05-07 18:28:41,511 INFO    SenderThread:40892 [sender.py:send_request_log_artifact():976] logged artifact run-jtmmbwaj-evalstep_0k - {'id': 'QXJ0aWZhY3Q6MTI0MzY3MzA4', 'digest': '09cd3e1bb1acaad4dedb25cceeb39f06', 'state': 'PENDING', 'aliases': [], 'artifactSequence': {'id': 'QXJ0aWZhY3RDb2xsZWN0aW9uOjE5OTAwNDI2', 'latestArtifact': None}, 'version': 'latest'}
+2022-05-07 18:28:41,511 DEBUG   SenderThread:40892 [sender.py:send():235] send: files
+2022-05-07 18:28:41,511 INFO    SenderThread:40892 [sender.py:_save_file():947] saving file media/table/eval/step_0k_5_f901d5b4b0d1263be066.table.json with policy now
+2022-05-07 18:28:41,764 INFO    Thread-14 :40892 [upload_job.py:push():137] Uploaded file /tmp/tmp_3bt5snxwandb/2ulitnez-media/table/eval/step_0k_5_f901d5b4b0d1263be066.table.json
+2022-05-07 18:28:42,237 INFO    Thread-7  :40892 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchitgandhi/flax-dummy/wandb/run-20220507_182604-jtmmbwaj/files/output.log
+2022-05-07 18:28:43,237 INFO    Thread-7  :40892 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchitgandhi/flax-dummy/wandb/run-20220507_182604-jtmmbwaj/files/output.log
+2022-05-07 18:28:44,580 DEBUG   HandlerThread:40892 [handler.py:handle_request():141] handle_request: partial_history
+2022-05-07 18:28:44,584 DEBUG   SenderThread:40892 [sender.py:send():235] send: history
+2022-05-07 18:28:44,585 DEBUG   SenderThread:40892 [sender.py:send():235] send: summary
+2022-05-07 18:28:44,586 INFO    SenderThread:40892 [sender.py:_save_file():947] saving file wandb-summary.json with policy end
+2022-05-07 18:28:44,628 DEBUG   HandlerThread:40892 [handler.py:handle_request():141] handle_request: partial_history
+2022-05-07 18:28:45,238 INFO    Thread-7  :40892 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchitgandhi/flax-dummy/wandb/run-20220507_182604-jtmmbwaj/files/wandb-summary.json
+2022-05-07 18:28:45,239 INFO    Thread-7  :40892 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchitgandhi/flax-dummy/wandb/run-20220507_182604-jtmmbwaj/files/output.log
+2022-05-07 18:28:45,243 DEBUG   HandlerThread:40892 [handler.py:handle_request():141] handle_request: partial_history
+2022-05-07 18:28:45,245 DEBUG   SenderThread:40892 [sender.py:send():235] send: history
+2022-05-07 18:28:45,246 DEBUG   SenderThread:40892 [sender.py:send():235] send: summary
+2022-05-07 18:28:45,247 INFO    SenderThread:40892 [sender.py:_save_file():947] saving file wandb-summary.json with policy end
+2022-05-07 18:28:45,307 DEBUG   HandlerThread:40892 [handler.py:handle_request():141] handle_request: partial_history
+2022-05-07 18:28:45,930 DEBUG   HandlerThread:40892 [handler.py:handle_request():141] handle_request: partial_history
+2022-05-07 18:28:45,932 DEBUG   SenderThread:40892 [sender.py:send():235] send: history
+2022-05-07 18:28:45,933 DEBUG   SenderThread:40892 [sender.py:send():235] send: summary
+2022-05-07 18:28:45,933 INFO    SenderThread:40892 [sender.py:_save_file():947] saving file wandb-summary.json with policy end
+2022-05-07 18:28:45,988 DEBUG   HandlerThread:40892 [handler.py:handle_request():141] handle_request: partial_history
+2022-05-07 18:28:46,239 INFO    Thread-7  :40892 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchitgandhi/flax-dummy/wandb/run-20220507_182604-jtmmbwaj/files/wandb-summary.json
+2022-05-07 18:28:46,239 INFO    Thread-7  :40892 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchitgandhi/flax-dummy/wandb/run-20220507_182604-jtmmbwaj/files/output.log
+2022-05-07 18:28:46,625 DEBUG   HandlerThread:40892 [handler.py:handle_request():141] handle_request: partial_history
+2022-05-07 18:28:46,627 DEBUG   SenderThread:40892 [sender.py:send():235] send: history
+2022-05-07 18:28:46,628 DEBUG   SenderThread:40892 [sender.py:send():235] send: summary
+2022-05-07 18:28:46,629 INFO    SenderThread:40892 [sender.py:_save_file():947] saving file wandb-summary.json with policy end
+2022-05-07 18:28:46,674 DEBUG   HandlerThread:40892 [handler.py:handle_request():141] handle_request: partial_history
+2022-05-07 18:28:47,192 DEBUG   HandlerThread:40892 [handler.py:handle_request():141] handle_request: partial_history
+2022-05-07 18:28:47,194 DEBUG   SenderThread:40892 [sender.py:send():235] send: history
+2022-05-07 18:28:47,194 DEBUG   SenderThread:40892 [sender.py:send():235] send: summary
+2022-05-07 18:28:47,195 INFO    SenderThread:40892 [sender.py:_save_file():947] saving file wandb-summary.json with policy end
+2022-05-07 18:28:47,239 INFO    Thread-7  :40892 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchitgandhi/flax-dummy/wandb/run-20220507_182604-jtmmbwaj/files/wandb-summary.json
+2022-05-07 18:28:47,239 INFO    Thread-7  :40892 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchitgandhi/flax-dummy/wandb/run-20220507_182604-jtmmbwaj/files/output.log
+2022-05-07 18:28:47,242 DEBUG   HandlerThread:40892 [handler.py:handle_request():141] handle_request: partial_history
+2022-05-07 18:28:48,240 INFO    Thread-7  :40892 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchitgandhi/flax-dummy/wandb/run-20220507_182604-jtmmbwaj/files/output.log
+2022-05-07 18:28:49,240 INFO    Thread-7  :40892 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchitgandhi/flax-dummy/wandb/run-20220507_182604-jtmmbwaj/files/output.log
+2022-05-07 18:28:55,585 DEBUG   HandlerThread:40892 [handler.py:handle_request():141] handle_request: stop_status
+2022-05-07 18:28:55,585 DEBUG   SenderThread:40892 [sender.py:send_request():249] send_request: stop_status
+2022-05-07 18:29:03,247 INFO    Thread-7  :40892 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchitgandhi/flax-dummy/wandb/run-20220507_182604-jtmmbwaj/files/output.log
+2022-05-07 18:29:05,718 DEBUG   SenderThread:40892 [sender.py:send():235] send: stats
+2022-05-07 18:29:10,622 DEBUG   HandlerThread:40892 [handler.py:handle_request():141] handle_request: stop_status
+2022-05-07 18:29:10,622 DEBUG   SenderThread:40892 [sender.py:send_request():249] send_request: stop_status
+2022-05-07 18:29:15,252 INFO    Thread-7  :40892 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchitgandhi/flax-dummy/wandb/run-20220507_182604-jtmmbwaj/files/output.log
+2022-05-07 18:29:25,663 DEBUG   HandlerThread:40892 [handler.py:handle_request():141] handle_request: stop_status
+2022-05-07 18:29:25,664 DEBUG   SenderThread:40892 [sender.py:send_request():249] send_request: stop_status
+2022-05-07 18:29:26,530 DEBUG   HandlerThread:40892 [handler.py:handle_request():141] handle_request: partial_history
+2022-05-07 18:29:26,594 DEBUG   HandlerThread:40892 [handler.py:handle_request():141] handle_request: log_artifact
+2022-05-07 18:29:26,594 DEBUG   SenderThread:40892 [sender.py:send_request():249] send_request: log_artifact
+2022-05-07 18:29:26,671 DEBUG   HandlerThread:40892 [handler.py:handle_request():141] handle_request: partial_history
+2022-05-07 18:29:26,721 DEBUG   HandlerThread:40892 [handler.py:handle_request():141] handle_request: log_artifact
+2022-05-07 18:29:26,797 DEBUG   HandlerThread:40892 [handler.py:handle_request():141] handle_request: partial_history
+2022-05-07 18:29:26,999 INFO    Thread-16 :40892 [upload_job.py:push():95] Uploaded file /home/sanchitgandhi/.cache/wandb/artifacts/obj/md5/00/66783abbd98b29e02682346c82293a
+2022-05-07 18:29:27,258 INFO    Thread-7  :40892 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchitgandhi/flax-dummy/wandb/run-20220507_182604-jtmmbwaj/files/output.log
+2022-05-07 18:29:27,259 INFO    Thread-7  :40892 [dir_watcher.py:_on_file_created():217] file/dir created: /home/sanchitgandhi/flax-dummy/wandb/run-20220507_182604-jtmmbwaj/files/media/table/eval/step_0k_incorrect_10_b30e6671cbaaf5c82b6d.table.json
+2022-05-07 18:29:27,259 INFO    Thread-7  :40892 [dir_watcher.py:_on_file_created():217] file/dir created: /home/sanchitgandhi/flax-dummy/wandb/run-20220507_182604-jtmmbwaj/files/media/table/eval/step_0k_10_92ae240f2472ae79ad31.table.json
+2022-05-07 18:29:27,259 INFO    Thread-7  :40892 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchitgandhi/flax-dummy/wandb/run-20220507_182604-jtmmbwaj/files/media/table/eval