qf2iwkac: saving weights and logs of step 0k

.gitattributes

@@ -25,3 +25,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zstandard filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+*.wandb filter=lfs diff=lfs merge=lfs -text

events.out.tfevents.1653825915.t1v-n-4eb331dd-w-0.1720934.0.v2

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:611808cc427646dd912828e114124e8bb080a2ba008da8736f91e2dc33af0e4b
+size 40

flax_model.msgpack

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:30b33ab13a8051166cc0dd0b3ce2cf48b5881786a73df29f38dadd36b14b0010
+oid sha256:48ae4ecf95a1c43c77baa282af96d82c8f123e860ab7354c6a1e9114fdd3ae58
 size 218688

wandb/debug-internal.log

@@ -0,0 +1 @@
+run-20220529_120458-qf2iwkac/logs/debug-internal.log

wandb/debug.log

@@ -0,0 +1 @@
+run-20220529_120458-qf2iwkac/logs/debug.log

wandb/latest-run

@@ -0,0 +1 @@
+run-20220529_120458-qf2iwkac

wandb/run-20220529_120458-qf2iwkac/files/config.yaml

@@ -0,0 +1,27 @@
+wandb_version: 1
+
+_wandb:
+  desc: null
+  value:
+    cli_version: 0.12.11
+    framework: huggingface
+    huggingface_version: 4.18.0.dev0
+    is_jupyter_run: false
+    is_kaggle_kernel: false
+    python_version: 3.8.10
+    start_time: 1653825898
+    t:
+      1:
+      - 1
+      - 2
+      - 3
+      - 11
+      - 12
+      - 45
+      - 49
+      - 51
+      4: 3.8.10
+      5: 0.12.11
+      6: 4.18.0.dev0
+      8:
+      - 5

wandb/run-20220529_120458-qf2iwkac/files/media/table/eval/step_0k_5_92ae240f2472ae79ad31.table.json

@@ -0,0 +1 @@
+{"columns": ["id", "label_str", "beam_1"], "data": [["1272-128104-0000", "mister quilter is the apostle of the middle classes and we are glad to welcome his gospel", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-128104-0001", "nor is mister quilter's manner less interesting than his matter", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-128104-0002", "he tells us that at this festive season of the year with christmas and roast beef looming before us similes drawn from eating and its results occur most readily to the mind", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-128104-0003", "he has grave doubts whether sir frederick leighton's work is really greek after all and can discover in it but little of rocky ithaca", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-128104-0005", "it is obviously unnecessary for us to point out how luminous these criticisms are how delicate in expression", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-128104-0006", "on the general principles of art mister quilter writes with equal lucidity", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-128104-0007", "painting he tells us is of a different quality to mathematics and finish in art is adding more fact", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-128104-0008", "as for etchings they are of two kinds british and foreign", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-128104-0010", "near the fire and the ornaments fred brought home from india on the mantel board", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-128104-0012", "only unfortunately his own work never does get good", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-128104-0013", "mister quilter has missed his chance for he has failed even to make himself the tupper of painting", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-128104-0014", "by harry quilter m a", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0000", "because you were sleeping instead of conquering the lovely rose princess has become a fiddle without a bow while poor shaggy sits there a cooing dove", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0001", "he has gone and gone for good answered polychrome who had managed to squeeze into the room beside the dragon and had witnessed the occurrences with much interest", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0002", "i have remained a prisoner only because i wished to be one and with this he stepped forward and burst the stout chains as easily as if they had been threads", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0003", "the little girl had been asleep but she heard the raps and opened the door", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0004", "the king has fled in disgrace and your friends are asking for you", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0005", "i begged ruggedo long ago to send him away but he would not do so", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0006", "i also offered to help your brother to escape but he would not go", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0007", "he eats and sleeps very steadily replied the new king", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0008", "i hope he doesn't work too hard said shaggy", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0009", "he doesn't work at all", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0010", "in fact there is nothing he can do in these dominions as well as our nomes whose numbers are so great that it worries us to keep them all busy", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0011", "not exactly returned kaliko", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0012", "where is my brother now", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0013", "inquired shaggy in the metal forest", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0014", "where is that", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0015", "the metal forest is in the great domed cavern the largest in all our dominions replied kaliko", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0016", "kaliko hesitated", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0017", "however if we look sharp we may be able to discover one of these secret ways", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0018", "oh no i'm quite sure he didn't", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0019", "that's funny remarked betsy thoughtfully", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0020", "i don't believe ann knew any magic or she'd have worked it before", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0021", "i do not know confessed shaggy", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0022", "true agreed kaliko", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0023", "kaliko went to the big gong and pounded on it just as ruggedo used to do but no one answered the summons", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0000", "a man said to the universe sir i exist", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0001", "sweat covered brion's body trickling into the tight loincloth that was the only garment he wore", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0003", "his instant of panic was followed by a small sharp blow high on his chest", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0004", "one minute a voice said and the time buzzer sounded", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0005", "a minute is not a very large measure of time and his body needed every fraction of it", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0006", "the buzzer's whirr triggered his muscles into complete relaxation", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0007", "only his heart and lungs worked on at a strong measured rate", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0008", "he was in reverie sliding along the borders of consciousness", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0009", "the contestants in the twenties needed undisturbed rest therefore nights in the dormitories were as quiet as death", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0010", "particularly so on this last night when only two of the little cubicles were occupied the thousands of others standing with dark empty doors", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0011", "the other voice snapped with a harsh urgency clearly used to command", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0012", "i'm here because the matter is of utmost importance and brandd is the one i must see now stand aside", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0013", "the twenties", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0014", "he must have drawn his gun because the intruder said quickly put that away you're being a fool out", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"]]}

wandb/run-20220529_120458-qf2iwkac/files/media/table/eval/step_0k_incorrect_5_b30e6671cbaaf5c82b6d.table.json

@@ -0,0 +1 @@
+{"columns": ["id", "label_str", "beam_1"], "data": [["1272-128104-0000", "mister quilter is the apostle of the middle classes and we are glad to welcome his gospel", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-128104-0001", "nor is mister quilter's manner less interesting than his matter", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-128104-0002", "he tells us that at this festive season of the year with christmas and roast beef looming before us similes drawn from eating and its results occur most readily to the mind", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-128104-0003", "he has grave doubts whether sir frederick leighton's work is really greek after all and can discover in it but little of rocky ithaca", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-128104-0005", "it is obviously unnecessary for us to point out how luminous these criticisms are how delicate in expression", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-128104-0006", "on the general principles of art mister quilter writes with equal lucidity", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-128104-0007", "painting he tells us is of a different quality to mathematics and finish in art is adding more fact", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-128104-0008", "as for etchings they are of two kinds british and foreign", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-128104-0010", "near the fire and the ornaments fred brought home from india on the mantel board", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-128104-0012", "only unfortunately his own work never does get good", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-128104-0013", "mister quilter has missed his chance for he has failed even to make himself the tupper of painting", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-128104-0014", "by harry quilter m a", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0000", "because you were sleeping instead of conquering the lovely rose princess has become a fiddle without a bow while poor shaggy sits there a cooing dove", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0001", "he has gone and gone for good answered polychrome who had managed to squeeze into the room beside the dragon and had witnessed the occurrences with much interest", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0002", "i have remained a prisoner only because i wished to be one and with this he stepped forward and burst the stout chains as easily as if they had been threads", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0003", "the little girl had been asleep but she heard the raps and opened the door", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0004", "the king has fled in disgrace and your friends are asking for you", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0005", "i begged ruggedo long ago to send him away but he would not do so", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0006", "i also offered to help your brother to escape but he would not go", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0007", "he eats and sleeps very steadily replied the new king", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0008", "i hope he doesn't work too hard said shaggy", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0009", "he doesn't work at all", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0010", "in fact there is nothing he can do in these dominions as well as our nomes whose numbers are so great that it worries us to keep them all busy", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0011", "not exactly returned kaliko", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0012", "where is my brother now", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0013", "inquired shaggy in the metal forest", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0014", "where is that", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0015", "the metal forest is in the great domed cavern the largest in all our dominions replied kaliko", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0016", "kaliko hesitated", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0017", "however if we look sharp we may be able to discover one of these secret ways", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0018", "oh no i'm quite sure he didn't", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0019", "that's funny remarked betsy thoughtfully", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0020", "i don't believe ann knew any magic or she'd have worked it before", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0021", "i do not know confessed shaggy", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0022", "true agreed kaliko", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-135031-0023", "kaliko went to the big gong and pounded on it just as ruggedo used to do but no one answered the summons", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0000", "a man said to the universe sir i exist", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0001", "sweat covered brion's body trickling into the tight loincloth that was the only garment he wore", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0003", "his instant of panic was followed by a small sharp blow high on his chest", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0004", "one minute a voice said and the time buzzer sounded", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0005", "a minute is not a very large measure of time and his body needed every fraction of it", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0006", "the buzzer's whirr triggered his muscles into complete relaxation", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0007", "only his heart and lungs worked on at a strong measured rate", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0008", "he was in reverie sliding along the borders of consciousness", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0009", "the contestants in the twenties needed undisturbed rest therefore nights in the dormitories were as quiet as death", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0010", "particularly so on this last night when only two of the little cubicles were occupied the thousands of others standing with dark empty doors", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0011", "the other voice snapped with a harsh urgency clearly used to command", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0012", "i'm here because the matter is of utmost importance and brandd is the one i must see now stand aside", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0013", "the twenties", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0014", "he must have drawn his gun because the intruder said quickly put that away you're being a fool out", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0015", "there was silence then and still wondering brion was once more asleep", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0016", "ten seconds", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0017", "he asked the handler who was kneading his aching muscles", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0018", "a red haired mountain of a man with an apparently inexhaustible store of energy", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0019", "there could be little art in this last and final round of fencing", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0020", "just thrust and parry and victory to the stronger", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0021", "every man who entered the twenties had his own training tricks", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0022", "there appeared to be an immediate association with the death trauma as if the two were inextricably linked into one", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0023", "the strength that enables someone in a trance to hold his body stiff and unsupported except at two points the head and heels", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0024", "this is physically impossible when conscious", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0025", "others had died before during the twenties and death during the last round was in some ways easier than defeat", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0026", "breathing deeply brion softly spoke the auto hypnotic phrases that triggered the process", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0027", "when the buzzer sounded he pulled his foil from his second's startled grasp and ran forward", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"], ["1272-141231-0028", "irolg looked amazed at the sudden fury of the attack then smiled", " Mar MarSSSersersersersersersersersersi hist hist hist hist hist hist hist hist hist hist hist histepepepepep\ufffdhenhenhenhen pl pl"]]}

wandb/run-20220529_120458-qf2iwkac/files/output.log

@@ -0,0 +1,690 @@
+05/29/2022 12:05:01 - INFO - __main__ - Training/evaluation parameters FlaxSeq2SeqTrainingArguments(
+_n_gpu=-1,
+adafactor=False,
+adam_beta1=0.9,
+adam_beta2=0.999,
+adam_epsilon=1e-08,
+bf16=False,
+bf16_full_eval=False,
+data_seed=None,
+dataloader_drop_last=False,
+dataloader_num_workers=0,
+dataloader_pin_memory=True,
+ddp_bucket_cap_mb=None,
+ddp_find_unused_parameters=None,
+debug=,
+deepspeed=None,
+disable_tqdm=None,
+do_eval=True,
+do_predict=True,
+do_train=True,
+eval_accumulation_steps=None,
+eval_delay=0,
+eval_steps=5,
+evaluation_strategy=no,
+final_generation_max_length=40,
+final_generation_num_beams=1,
+fp16=False,
+fp16_backend=auto,
+fp16_full_eval=False,
+fp16_opt_level=O1,
+generation_length_penalty=1,
+generation_max_length=40,
+generation_num_beams=1,
+gradient_accumulation_steps=1,
+gradient_checkpointing=False,
+greater_is_better=None,
+group_by_length=False,
+half_precision_backend=auto,
+hub_model_id=None,
+hub_strategy=every_save,
+hub_token=<HUB_TOKEN>,
+ignore_data_skip=False,
+label_names=None,
+label_smoothing_factor=0.0,
+learning_rate=0.0003,
+length_column_name=input_length,
+load_best_model_at_end=False,
+local_rank=-1,
+log_level=passive,
+log_level_replica=passive,
+log_on_each_node=True,
+logging_dir=None,
+logging_first_step=False,
+logging_nan_inf_filter=True,
+logging_steps=1,
+logging_strategy=steps,
+lr_scheduler_type=linear,
+matmul_precision=default,
+max_grad_norm=1.0,
+max_steps=10,
+metric_for_best_model=None,
+mp_parameters=,
+no_cuda=False,
+num_train_epochs=3.0,
+optim=adamw_hf,
+output_dir=./,
+overwrite_output_dir=True,
+past_index=-1,
+per_device_eval_batch_size=2,
+per_device_train_batch_size=2,
+precision=full,
+predict_with_generate=True,
+prediction_loss_only=False,
+push_to_hub=True,
+push_to_hub_model_id=None,
+push_to_hub_organization=None,
+push_to_hub_token=<PUSH_TO_HUB_TOKEN>,
+remove_unused_columns=True,
+report_to=None,
+resume_from_checkpoint=None,
+run_name=None,
+save_on_each_node=False,
+save_steps=5,
+save_strategy=steps,
+save_total_limit=1,
+seed=42,
+sharded_ddp=,
+skip_memory_metrics=True,
+sortish_sampler=False,
+tf32=None,
+tpu_metrics_debug=False,
+tpu_num_cores=None,
+use_legacy_prediction_loop=False,
+warmup_ratio=0.0,
+warmup_steps=500,
+weight_decay=0.0,
+xpu_backend=None,
+)
+05/29/2022 12:05:01 - INFO - __main__ - JAX devices: 8, matmul precision: default
+05/29/2022 12:05:02 - WARNING - datasets.builder - Reusing dataset librispeech_asr (/home/sanchitgandhi/cache/huggingface/datasets/hf-internal-testing___librispeech_asr/clean/2.1.0/d3bc4c2bc2078fcde3ad0f0f635862e4c0fef78ba94c4a34c4c250a097af240b)
+05/29/2022 12:05:02 - WARNING - datasets.builder - Reusing dataset librispeech_asr (/home/sanchitgandhi/cache/huggingface/datasets/hf-internal-testing___librispeech_asr/clean/2.1.0/d3bc4c2bc2078fcde3ad0f0f635862e4c0fef78ba94c4a34c4c250a097af240b)
+loading configuration file ./config.json
+You passed along `num_labels=3` with an incompatible id to label map: {'0': 'LABEL_0', '1': 'LABEL_1'}. The number of labels wil be overwritten to 2.
+Model config SpeechEncoderDecoderConfig {
+  "_name_or_path": "./",
+  "architectures": [
+    "SpeechEncoderDecoderModel"
+  ],
+  "decoder": {
+    "_name_or_path": "",
+    "activation_dropout": 0.0,
+    "activation_function": "gelu",
+    "add_cross_attention": true,
+    "architectures": null,
+    "attention_dropout": 0.1,
+    "bad_words_ids": null,
+    "bos_token_id": 0,
+    "chunk_size_feed_forward": 0,
+    "classifier_dropout": 0.0,
+    "cross_attention_hidden_size": null,
+    "d_model": 16,
+    "decoder_attention_heads": 4,
+    "decoder_ffn_dim": 4,
+    "decoder_layerdrop": 0.0,
+    "decoder_layers": 2,
+    "decoder_start_token_id": 2,
+    "diversity_penalty": 0.0,
+    "do_sample": false,
+    "dropout": 0.1,
+    "early_stopping": false,
+    "encoder_attention_heads": 4,
+    "encoder_ffn_dim": 4,
+    "encoder_layerdrop": 0.0,
+    "encoder_layers": 2,
+    "encoder_no_repeat_ngram_size": 0,
+    "eos_token_id": 2,
+    "exponential_decay_length_penalty": null,
+    "finetuning_task": null,
+    "forced_bos_token_id": null,
+    "forced_eos_token_id": 2,
+    "fuse_matmuls": false,
+    "gradient_checkpointing": false,
+    "id2label": {
+      "0": "LABEL_0",
+      "1": "LABEL_1"
+    },
+    "init_std": 0.02,
+    "is_decoder": true,
+    "is_encoder_decoder": false,
+    "label2id": {
+      "LABEL_0": 0,
+      "LABEL_1": 1
+    },
+    "length_penalty": 1.0,
+    "max_length": 20,
+    "max_position_embeddings": 100,
+    "min_length": 0,
+    "model_type": "bart",
+    "no_repeat_ngram_size": 0,
+    "num_beam_groups": 1,
+    "num_beams": 1,
+    "num_hidden_layers": 2,
+    "num_return_sequences": 1,
+    "output_attentions": false,
+    "output_hidden_states": false,
+    "output_scores": false,
+    "pad_token_id": 1,
+    "prefix": null,
+    "problem_type": null,
+    "pruned_heads": {},
+    "remove_invalid_values": false,
+    "repetition_penalty": 1.0,
+    "return_dict": true,
+    "return_dict_in_generate": false,
+    "scale_embedding": false,
+    "sep_token_id": null,
+    "task_specific_params": null,
+    "temperature": 1.0,
+    "tie_encoder_decoder": false,
+    "tie_word_embeddings": true,
+    "tokenizer_class": null,
+    "top_k": 50,
+    "top_p": 1.0,
+    "torch_dtype": null,
+    "torchscript": false,
+    "transformers_version": "4.18.0.dev0",
+    "typical_p": 1.0,
+    "use_bfloat16": false,
+    "use_cache": true,
+    "use_scan": true,
+    "vocab_size": 1000
+  },
+  "decoder_start_token_id": 0,
+  "encoder": {
+    "_name_or_path": "",
+    "activation_dropout": 0.1,
+    "adapter_kernel_size": 3,
+    "adapter_stride": 2,
+    "add_adapter": true,
+    "add_cross_attention": false,
+    "apply_spec_augment": true,
+    "architectures": null,
+    "attention_dropout": 0.1,
+    "bad_words_ids": null,
+    "bos_token_id": 1,
+    "chunk_size_feed_forward": 0,
+    "classifier_proj_size": 256,
+    "codevector_dim": 256,
+    "contrastive_logits_temperature": 0.1,
+    "conv_bias": false,
+    "conv_dim": [
+      32,
+      32,
+      32
+    ],
+    "conv_kernel": [
+      8,
+      8,
+      8
+    ],
+    "conv_stride": [
+      4,
+      4,
+      4
+    ],
+    "cross_attention_hidden_size": null,
+    "ctc_loss_reduction": "sum",
+    "ctc_zero_infinity": false,
+    "decoder_start_token_id": null,
+    "diversity_loss_weight": 0.1,
+    "diversity_penalty": 0.0,
+    "do_sample": false,
+    "do_stable_layer_norm": true,
+    "early_stopping": false,
+    "encoder_no_repeat_ngram_size": 0,
+    "eos_token_id": 2,
+    "exponential_decay_length_penalty": null,
+    "feat_extract_activation": "gelu",
+    "feat_extract_dropout": 0.0,
+    "feat_extract_norm": "layer",
+    "feat_proj_dropout": 0.0,
+    "feat_quantizer_dropout": 0.0,
+    "final_dropout": 0.0,
+    "finetuning_task": null,
+    "forced_bos_token_id": null,
+    "forced_eos_token_id": null,
+    "fuse_matmuls": false,
+    "gradient_checkpointing": false,
+    "hidden_act": "gelu",
+    "hidden_dropout": 0.1,
+    "hidden_dropout_prob": 0.1,
+    "hidden_size": 16,
+    "id2label": {
+      "0": "LABEL_0",
+      "1": "LABEL_1"
+    },
+    "initializer_range": 0.02,
+    "intermediate_size": 20,
+    "is_decoder": false,
+    "is_encoder_decoder": false,
+    "label2id": {
+      "LABEL_0": 0,
+      "LABEL_1": 1
+    },
+    "layer_norm_eps": 1e-05,
+    "layerdrop": 0.0,
+    "length_penalty": 1.0,
+    "mask_feature_length": 10,
+    "mask_feature_min_masks": 0,
+    "mask_feature_prob": 0.0,
+    "mask_time_length": 10,
+    "mask_time_min_masks": 2,
+    "mask_time_prob": 0.1,
+    "max_length": 20,
+    "min_length": 0,
+    "model_type": "wav2vec2",
+    "no_repeat_ngram_size": 0,
+    "num_adapter_layers": 3,
+    "num_attention_heads": 2,
+    "num_beam_groups": 1,
+    "num_beams": 1,
+    "num_codevector_groups": 2,
+    "num_codevectors_per_group": 320,
+    "num_conv_pos_embedding_groups": 2,
+    "num_conv_pos_embeddings": 16,
+    "num_feat_extract_layers": 3,
+    "num_hidden_layers": 4,
+    "num_negatives": 10,
+    "num_return_sequences": 1,
+    "output_attentions": false,
+    "output_hidden_size": 16,
+    "output_hidden_states": false,
+    "output_scores": false,
+    "pad_token_id": 0,
+    "prefix": null,
+    "problem_type": null,
+    "proj_codevector_dim": 256,
+    "pruned_heads": {},
+    "remove_invalid_values": false,
+    "repetition_penalty": 1.0,
+    "return_dict": true,
+    "return_dict_in_generate": false,
+    "sep_token_id": null,
+    "task_specific_params": null,
+    "tdnn_dilation": [
+      1,
+      2,
+      3,
+      1,
+      1
+    ],
+    "tdnn_dim": [
+      512,
+      512,
+      512,
+      512,
+      1500
+    ],
+    "tdnn_kernel": [
+      5,
+      3,
+      3,
+      1,
+      1
+    ],
+    "temperature": 1.0,
+    "tie_encoder_decoder": false,
+    "tie_word_embeddings": true,
+    "tokenizer_class": null,
+    "top_k": 50,
+    "top_p": 1.0,
+    "torch_dtype": null,
+    "torchscript": false,
+    "transformers_version": "4.18.0.dev0",
+    "typical_p": 1.0,
+    "use_bfloat16": false,
+    "use_scan": true,
+    "use_weighted_layer_sum": false,
+    "vocab_size": 32,
+    "xvector_output_dim": 512
+  },
+  "eos_token_id": 2,
+  "is_encoder_decoder": true,
+  "max_length": 40,
+  "model_type": "speech-encoder-decoder",
+  "pad_token_id": 1,
+  "processor_class": "Wav2Vec2Processor",
+  "tie_word_embeddings": false,
+  "transformers_version": null,
+  "use_cache": false
+}
+loading feature extractor configuration file ./preprocessor_config.json
+Feature extractor Wav2Vec2FeatureExtractor {
+  "do_normalize": true,
+  "feature_extractor_type": "Wav2Vec2FeatureExtractor",
+  "feature_size": 1,
+  "padding_side": "right",
+  "padding_value": 0.0,
+  "return_attention_mask": false,
+  "sampling_rate": 16000
+}
+Didn't find file ./added_tokens.json. We won't load it.
+loading file ./vocab.json
+loading file ./merges.txt
+loading file ./tokenizer.json
+loading file None
+loading file ./special_tokens_map.json
+loading file ./tokenizer_config.json
+loading weights file ./flax_model.msgpack
+05/29/2022 12:05:03 - WARNING - datasets.builder - Reusing dataset librispeech_asr (/home/sanchitgandhi/cache/huggingface/datasets/hf-internal-testing___librispeech_asr/clean/2.1.0/d3bc4c2bc2078fcde3ad0f0f635862e4c0fef78ba94c4a34c4c250a097af240b)
+05/29/2022 12:05:04 - WARNING - datasets.builder - Reusing dataset librispeech_asr (/home/sanchitgandhi/cache/huggingface/datasets/hf-internal-testing___librispeech_asr/clean/2.1.0/d3bc4c2bc2078fcde3ad0f0f635862e4c0fef78ba94c4a34c4c250a097af240b)
+All model checkpoint weights were used when initializing FlaxSpeechEncoderDecoderModel.
+All the weights of FlaxSpeechEncoderDecoderModel were initialized from the model checkpoint at ./.
+If your task is similar to the task the model of the checkpoint was trained on, you can already use FlaxSpeechEncoderDecoderModel for predictions without further training.
+05/29/2022 12:05:14 - WARNING - datasets.arrow_dataset - Loading cached processed dataset at /home/sanchitgandhi/cache/huggingface/datasets/hf-internal-testing___librispeech_asr/clean/2.1.0/d3bc4c2bc2078fcde3ad0f0f635862e4c0fef78ba94c4a34c4c250a097af240b/cache-c95b537ee89f995b.arrow
+05/29/2022 12:05:14 - WARNING - datasets.arrow_dataset - Loading cached processed dataset at /home/sanchitgandhi/cache/huggingface/datasets/hf-internal-testing___librispeech_asr/clean/2.1.0/d3bc4c2bc2078fcde3ad0f0f635862e4c0fef78ba94c4a34c4c250a097af240b/cache-c95b537ee89f995b.arrow
+05/29/2022 12:05:14 - WARNING - datasets.arrow_dataset - Loading cached processed dataset at /home/sanchitgandhi/cache/huggingface/datasets/hf-internal-testing___librispeech_asr/clean/2.1.0/d3bc4c2bc2078fcde3ad0f0f635862e4c0fef78ba94c4a34c4c250a097af240b/cache-19130a8d7ad2d887.arrow
+05/29/2022 12:05:14 - WARNING - datasets.arrow_dataset - Loading cached processed dataset at /home/sanchitgandhi/cache/huggingface/datasets/hf-internal-testing___librispeech_asr/clean/2.1.0/d3bc4c2bc2078fcde3ad0f0f635862e4c0fef78ba94c4a34c4c250a097af240b/cache-e60ab7f8cad7e7f8.arrow
+05/29/2022 12:05:14 - WARNING - datasets.arrow_dataset - Loading cached processed dataset at /home/sanchitgandhi/cache/huggingface/datasets/hf-internal-testing___librispeech_asr/clean/2.1.0/d3bc4c2bc2078fcde3ad0f0f635862e4c0fef78ba94c4a34c4c250a097af240b/cache-3eb89567438f0a88.arrow
+05/29/2022 12:05:14 - WARNING - datasets.arrow_dataset - Loading cached processed dataset at /home/sanchitgandhi/cache/huggingface/datasets/hf-internal-testing___librispeech_asr/clean/2.1.0/d3bc4c2bc2078fcde3ad0f0f635862e4c0fef78ba94c4a34c4c250a097af240b/cache-3eb89567438f0a88.arrow
+05/29/2022 12:05:14 - WARNING - datasets.arrow_dataset - Loading cached processed dataset at /home/sanchitgandhi/cache/huggingface/datasets/hf-internal-testing___librispeech_asr/clean/2.1.0/d3bc4c2bc2078fcde3ad0f0f635862e4c0fef78ba94c4a34c4c250a097af240b/cache-59ebfc33c650e7fb.arrow
+05/29/2022 12:05:14 - WARNING - datasets.arrow_dataset - Loading cached processed dataset at /home/sanchitgandhi/cache/huggingface/datasets/hf-internal-testing___librispeech_asr/clean/2.1.0/d3bc4c2bc2078fcde3ad0f0f635862e4c0fef78ba94c4a34c4c250a097af240b/cache-ba50e9f3ac5dbfae.arrow
+05/29/2022 12:05:14 - WARNING - datasets.arrow_dataset - Loading cached processed dataset at /home/sanchitgandhi/cache/huggingface/datasets/hf-internal-testing___librispeech_asr/clean/2.1.0/d3bc4c2bc2078fcde3ad0f0f635862e4c0fef78ba94c4a34c4c250a097af240b/cache-8426f0fa10476a9c.arrow
+05/29/2022 12:05:14 - WARNING - datasets.arrow_dataset - Loading cached processed dataset at /home/sanchitgandhi/cache/huggingface/datasets/hf-internal-testing___librispeech_asr/clean/2.1.0/d3bc4c2bc2078fcde3ad0f0f635862e4c0fef78ba94c4a34c4c250a097af240b/cache-8426f0fa10476a9c.arrow
+05/29/2022 12:05:14 - WARNING - datasets.arrow_dataset - Loading cached processed dataset at /home/sanchitgandhi/cache/huggingface/datasets/hf-internal-testing___librispeech_asr/clean/2.1.0/d3bc4c2bc2078fcde3ad0f0f635862e4c0fef78ba94c4a34c4c250a097af240b/cache-8c7436c2e47ec832.arrow
+05/29/2022 12:05:14 - WARNING - datasets.arrow_dataset - Loading cached processed dataset at /home/sanchitgandhi/cache/huggingface/datasets/hf-internal-testing___librispeech_asr/clean/2.1.0/d3bc4c2bc2078fcde3ad0f0f635862e4c0fef78ba94c4a34c4c250a097af240b/cache-85fa3b40218279d5.arrow
+05/29/2022 12:05:14 - WARNING - datasets.arrow_dataset - Loading cached processed dataset at /home/sanchitgandhi/cache/huggingface/datasets/hf-internal-testing___librispeech_asr/clean/2.1.0/d3bc4c2bc2078fcde3ad0f0f635862e4c0fef78ba94c4a34c4c250a097af240b/cache-a8160ccb9fa21e31.arrow
+05/29/2022 12:05:14 - WARNING - datasets.arrow_dataset - Loading cached processed dataset at /home/sanchitgandhi/cache/huggingface/datasets/hf-internal-testing___librispeech_asr/clean/2.1.0/d3bc4c2bc2078fcde3ad0f0f635862e4c0fef78ba94c4a34c4c250a097af240b/cache-a8160ccb9fa21e31.arrow
+05/29/2022 12:05:14 - WARNING - datasets.arrow_dataset - Loading cached processed dataset at /home/sanchitgandhi/cache/huggingface/datasets/hf-internal-testing___librispeech_asr/clean/2.1.0/d3bc4c2bc2078fcde3ad0f0f635862e4c0fef78ba94c4a34c4c250a097af240b/cache-895a5734fe2db613.arrow
+05/29/2022 12:05:14 - WARNING - datasets.arrow_dataset - Loading cached processed dataset at /home/sanchitgandhi/cache/huggingface/datasets/hf-internal-testing___librispeech_asr/clean/2.1.0/d3bc4c2bc2078fcde3ad0f0f635862e4c0fef78ba94c4a34c4c250a097af240b/cache-f3e16e20d9ec29fb.arrow
+Feature extractor saved in ./preprocessor_config.json
+tokenizer config file saved in ./tokenizer_config.json
+Special tokens file saved in ./special_tokens_map.json
+Configuration saved in ./config.json
+loading feature extractor configuration file ./preprocessor_config.json
+loading configuration file ./config.json
+You passed along `num_labels=3` with an incompatible id to label map: {'0': 'LABEL_0', '1': 'LABEL_1'}. The number of labels wil be overwritten to 2.
+Model config SpeechEncoderDecoderConfig {
+  "_name_or_path": "./",
+  "architectures": [
+    "SpeechEncoderDecoderModel"
+  ],
+  "decoder": {
+    "_name_or_path": "",
+    "activation_dropout": 0.0,
+    "activation_function": "gelu",
+    "add_cross_attention": true,
+    "architectures": null,
+    "attention_dropout": 0.1,
+    "bad_words_ids": null,
+    "bos_token_id": 0,
+    "chunk_size_feed_forward": 0,
+    "classifier_dropout": 0.0,
+    "cross_attention_hidden_size": null,
+    "d_model": 16,
+    "decoder_attention_heads": 4,
+    "decoder_ffn_dim": 4,
+    "decoder_layerdrop": 0.0,
+    "decoder_layers": 2,
+    "decoder_start_token_id": 2,
+    "diversity_penalty": 0.0,
+    "do_sample": false,
+    "dropout": 0.1,
+    "early_stopping": false,
+    "encoder_attention_heads": 4,
+    "encoder_ffn_dim": 4,
+    "encoder_layerdrop": 0.0,
+    "encoder_layers": 2,
+    "encoder_no_repeat_ngram_size": 0,
+    "eos_token_id": 2,
+    "exponential_decay_length_penalty": null,
+    "finetuning_task": null,
+    "forced_bos_token_id": null,
+    "forced_eos_token_id": 2,
+    "fuse_matmuls": false,
+    "gradient_checkpointing": false,
+    "id2label": {
+      "0": "LABEL_0",
+      "1": "LABEL_1"
+    },
+    "init_std": 0.02,
+    "is_decoder": true,
+    "is_encoder_decoder": false,
+    "label2id": {
+      "LABEL_0": 0,
+      "LABEL_1": 1
+    },
+    "length_penalty": 1.0,
+    "max_length": 20,
+    "max_position_embeddings": 100,
+    "min_length": 0,
+    "model_type": "bart",
+    "no_repeat_ngram_size": 0,
+    "num_beam_groups": 1,
+    "num_beams": 1,
+    "num_hidden_layers": 2,
+    "num_return_sequences": 1,
+    "output_attentions": false,
+    "output_hidden_states": false,
+    "output_scores": false,
+    "pad_token_id": 1,
+    "prefix": null,
+    "problem_type": null,
+    "pruned_heads": {},
+    "remove_invalid_values": false,
+    "repetition_penalty": 1.0,
+    "return_dict": true,
+    "return_dict_in_generate": false,
+    "scale_embedding": false,
+    "sep_token_id": null,
+    "task_specific_params": null,
+    "temperature": 1.0,
+    "tie_encoder_decoder": false,
+    "tie_word_embeddings": true,
+    "tokenizer_class": null,
+    "top_k": 50,
+    "top_p": 1.0,
+    "torch_dtype": null,
+    "torchscript": false,
+    "transformers_version": "4.18.0.dev0",
+    "typical_p": 1.0,
+    "use_bfloat16": false,
+    "use_cache": true,
+    "use_scan": true,
+    "vocab_size": 1000
+  },
+  "decoder_start_token_id": 0,
+  "encoder": {
+    "_name_or_path": "",
+    "activation_dropout": 0.1,
+    "adapter_kernel_size": 3,
+    "adapter_stride": 2,
+    "add_adapter": true,
+    "add_cross_attention": false,
+    "apply_spec_augment": true,
+    "architectures": null,
+    "attention_dropout": 0.1,
+    "bad_words_ids": null,
+    "bos_token_id": 1,
+    "chunk_size_feed_forward": 0,
+    "classifier_proj_size": 256,
+    "codevector_dim": 256,
+    "contrastive_logits_temperature": 0.1,
+    "conv_bias": false,
+    "conv_dim": [
+      32,
+      32,
+      32
+    ],
+    "conv_kernel": [
+      8,
+      8,
+      8
+    ],
+    "conv_stride": [
+      4,
+      4,
+      4
+    ],
+    "cross_attention_hidden_size": null,
+    "ctc_loss_reduction": "sum",
+    "ctc_zero_infinity": false,
+    "decoder_start_token_id": null,
+    "diversity_loss_weight": 0.1,
+    "diversity_penalty": 0.0,
+    "do_sample": false,
+    "do_stable_layer_norm": true,
+    "early_stopping": false,
+    "encoder_no_repeat_ngram_size": 0,
+    "eos_token_id": 2,
+    "exponential_decay_length_penalty": null,
+    "feat_extract_activation": "gelu",
+    "feat_extract_dropout": 0.0,
+    "feat_extract_norm": "layer",
+    "feat_proj_dropout": 0.0,
+    "feat_quantizer_dropout": 0.0,
+    "final_dropout": 0.0,
+    "finetuning_task": null,
+    "forced_bos_token_id": null,
+    "forced_eos_token_id": null,
+    "fuse_matmuls": false,
+    "gradient_checkpointing": false,
+    "hidden_act": "gelu",
+    "hidden_dropout": 0.1,
+    "hidden_dropout_prob": 0.1,
+    "hidden_size": 16,
+    "id2label": {
+      "0": "LABEL_0",
+      "1": "LABEL_1"
+    },
+    "initializer_range": 0.02,
+    "intermediate_size": 20,
+    "is_decoder": false,
+    "is_encoder_decoder": false,
+    "label2id": {
+      "LABEL_0": 0,
+      "LABEL_1": 1
+    },
+    "layer_norm_eps": 1e-05,
+    "layerdrop": 0.0,
+    "length_penalty": 1.0,
+    "mask_feature_length": 10,
+    "mask_feature_min_masks": 0,
+    "mask_feature_prob": 0.0,
+    "mask_time_length": 10,
+    "mask_time_min_masks": 2,
+    "mask_time_prob": 0.1,
+    "max_length": 20,
+    "min_length": 0,
+    "model_type": "wav2vec2",
+    "no_repeat_ngram_size": 0,
+    "num_adapter_layers": 3,
+    "num_attention_heads": 2,
+    "num_beam_groups": 1,
+    "num_beams": 1,
+    "num_codevector_groups": 2,
+    "num_codevectors_per_group": 320,
+    "num_conv_pos_embedding_groups": 2,
+    "num_conv_pos_embeddings": 16,
+    "num_feat_extract_layers": 3,
+    "num_hidden_layers": 4,
+    "num_negatives": 10,
+    "num_return_sequences": 1,
+    "output_attentions": false,
+    "output_hidden_size": 16,
+    "output_hidden_states": false,
+    "output_scores": false,
+    "pad_token_id": 0,
+    "prefix": null,
+    "problem_type": null,
+    "proj_codevector_dim": 256,
+    "pruned_heads": {},
+    "remove_invalid_values": false,
+    "repetition_penalty": 1.0,
+    "return_dict": true,
+    "return_dict_in_generate": false,
+    "sep_token_id": null,
+    "task_specific_params": null,
+    "tdnn_dilation": [
+      1,
+      2,
+      3,
+      1,
+      1
+    ],
+    "tdnn_dim": [
+      512,
+      512,
+      512,
+      512,
+      1500
+    ],
+    "tdnn_kernel": [
+      5,
+      3,
+      3,
+      1,
+      1
+    ],
+    "temperature": 1.0,
+    "tie_encoder_decoder": false,
+    "tie_word_embeddings": true,
+    "tokenizer_class": null,
+    "top_k": 50,
+    "top_p": 1.0,
+    "torch_dtype": null,
+    "torchscript": false,
+    "transformers_version": "4.18.0.dev0",
+    "typical_p": 1.0,
+    "use_bfloat16": false,
+    "use_scan": true,
+    "use_weighted_layer_sum": false,
+    "vocab_size": 32,
+    "xvector_output_dim": 512
+  },
+  "eos_token_id": 2,
+  "is_encoder_decoder": true,
+  "max_length": 40,
+  "model_type": "speech-encoder-decoder",
+  "pad_token_id": 1,
+  "processor_class": "Wav2Vec2Processor",
+  "tie_word_embeddings": false,
+  "transformers_version": null,
+  "use_cache": false
+}
+loading feature extractor configuration file ./preprocessor_config.json
+Feature extractor Wav2Vec2FeatureExtractor {
+  "do_normalize": true,
+  "feature_extractor_type": "Wav2Vec2FeatureExtractor",
+  "feature_size": 1,
+  "padding_side": "right",
+  "padding_value": 0.0,
+  "return_attention_mask": false,
+  "sampling_rate": 16000
+}
+Didn't find file ./added_tokens.json. We won't load it.
+loading file ./vocab.json
+loading file ./merges.txt
+loading file ./tokenizer.json
+loading file None
+loading file ./special_tokens_map.json
+loading file ./tokenizer_config.json
+2022-05-29 12:05:15.311076: W tensorflow/stream_executor/platform/default/dso_loader.cc:64] Could not load dynamic library 'libcuda.so.1'; dlerror: libcuda.so.1: cannot open shared object file: No such file or directory
+2022-05-29 12:05:15.311124: W tensorflow/stream_executor/cuda/cuda_driver.cc:269] failed call to cuInit: UNKNOWN ERROR (303)
+/home/sanchitgandhi/flax-dummy/./ is already a clone of https://huggingface.co/sanchit-gandhi/flax-dummy. Make sure you pull the latest changes with `repo.git_pull()`.
+05/29/2022 12:05:16 - WARNING - huggingface_hub.repository - /home/sanchitgandhi/flax-dummy/./ is already a clone of https://huggingface.co/sanchit-gandhi/flax-dummy. Make sure you pull the latest changes with `repo.git_pull()`.
+Epoch ... (1/3):   0%|                                                                            | 0/3 [00:00<?, ?it/s]
+Training...:   0%|                                                                                | 0/4 [00:00<?, ?it/s]
+05/29/2022 12:05:17 - INFO - __main__ - ***** Running training *****
+05/29/2022 12:05:17 - INFO - __main__ -   Num examples = 68
+05/29/2022 12:05:17 - INFO - __main__ -   Num Epochs = 3
+05/29/2022 12:05:17 - INFO - __main__ -   Instantaneous batch size per device = 2
+05/29/2022 12:05:17 - INFO - __main__ -   Num gradient accumulation steps = 1
+05/29/2022 12:05:17 - INFO - __main__ -   Total train batch size (w. parallel & distributed) = 16
+05/29/2022 12:05:17 - INFO - __main__ -   Total optimization steps = 10
+05/29/2022 12:05:17 - INFO - __main__ -   Gradient checkpointing: False
+05/29/2022 12:05:17 - INFO - __main__ -   Use scan: True
+
+Training...:  25%|██████████████████                                                      | 1/4 [00:24<01:14, 24.71s/it]
+
+Training...:  50%|████████████████████████████████████                                    | 2/4 [00:46<00:45, 22.72s/it]
+Step... (2 | Loss: 6.890774726867676, Learning Rate: 6.00004568696022e-07, Gradient Norm: 0.3177940249443054)
+Step... (3 | Loss: 6.900632858276367, Learning Rate: 1.200009137392044e-06, Gradient Norm: 0.26289182901382446)
+Step... (4 | Loss: 6.901595592498779, Learning Rate: 1.7999846022576094e-06, Gradient Norm: 0.28948840498924255)
+Epoch ... (1/3):  33%|██████████████████████▋                                             | 1/3 [01:10<02:18, 69.35s/it]
+Training...:   0%|                                                                                | 0/4 [00:00<?, ?it/s]
+
+
+Evaluating ...:  50%|██████████████████████████████████▌                                  | 2/4 [00:44<00:43, 21.55s/it]
+

wandb/run-20220529_120458-qf2iwkac/files/requirements.txt

@@ -0,0 +1,187 @@
+absl-py==1.0.0
+aiohttp==3.8.1
+aiosignal==1.2.0
+anyio==3.5.0
+appdirs==1.4.4
+argon2-cffi-bindings==21.2.0
+argon2-cffi==21.3.0
+asttokens==2.0.5
+astunparse==1.6.3
+async-timeout==4.0.2
+attrs==21.4.0
+audioread==2.1.9
+babel==2.9.1
+backcall==0.2.0
+beautifulsoup4==4.10.0
+bleach==4.1.0
+cachetools==5.0.0
+certifi==2021.10.8
+cffi==1.15.0
+charset-normalizer==2.0.12
+chex==0.1.1
+click==8.1.0
+cycler==0.11.0
+datasets==2.1.1.dev0
+debugpy==1.6.0
+decorator==5.1.1
+defusedxml==0.7.1
+dill==0.3.4
+dm-tree==0.1.6
+docker-pycreds==0.4.0
+entrypoints==0.4
+executing==0.8.3
+filelock==3.6.0
+flatbuffers==2.0
+flax==0.4.1
+fonttools==4.31.2
+frozenlist==1.3.0
+fsspec==2022.2.0
+gast==0.5.3
+gitdb==4.0.9
+gitpython==3.1.27
+google-auth-oauthlib==0.4.6
+google-auth==2.6.2
+google-pasta==0.2.0
+grpcio==1.44.0
+h5py==3.6.0
+huggingface-hub==0.4.0
+hypothesis==6.46.7
+idna==3.3
+importlib-metadata==4.11.3
+importlib-resources==5.6.0
+iniconfig==1.1.1
+ipdb==0.13.9
+ipykernel==6.10.0
+ipython-genutils==0.2.0
+ipython==8.2.0
+jax==0.3.4
+jaxlib==0.3.2
+jedi==0.18.1
+jinja2==3.1.1
+jiwer==2.3.0
+joblib==1.1.0
+json5==0.9.6
+jsonschema==4.4.0
+jupyter-client==7.2.1
+jupyter-core==4.9.2
+jupyter-server==1.16.0
+jupyterlab-pygments==0.1.2
+jupyterlab-server==2.12.0
+jupyterlab==3.3.2
+kenlm==0.0.0
+keras-preprocessing==1.1.2
+keras==2.8.0
+kiwisolver==1.4.2
+libclang==13.0.0
+librosa==0.9.1
+libtpu-nightly==0.1.dev20220315
+llvmlite==0.38.0
+markdown==3.3.6
+markupsafe==2.1.1
+matplotlib-inline==0.1.3
+matplotlib==3.5.1
+mistune==0.8.4
+msgpack==1.0.3
+multidict==6.0.2
+multiprocess==0.70.12.2
+nbclassic==0.3.7
+nbclient==0.5.13
+nbconvert==6.4.5
+nbformat==5.2.0
+nest-asyncio==1.5.4
+notebook-shim==0.1.0
+notebook==6.4.10
+numba==0.55.1
+numpy==1.21.0
+oauthlib==3.2.0
+opt-einsum==3.3.0
+optax==0.1.1
+packaging==21.3
+pandas==1.4.1
+pandocfilters==1.5.0
+parso==0.8.3
+pathtools==0.1.2
+pexpect==4.8.0
+pickleshare==0.7.5
+pillow==9.0.1
+pip==20.0.2
+pkg-resources==0.0.0
+pluggy==1.0.0
+pooch==1.6.0
+prometheus-client==0.13.1
+promise==2.3
+prompt-toolkit==3.0.28
+protobuf==3.19.4
+psutil==5.9.0
+ptyprocess==0.7.0
+pure-eval==0.2.2
+py==1.11.0
+pyarrow==7.0.0
+pyasn1-modules==0.2.8
+pyasn1==0.4.8
+pycparser==2.21
+pyctcdecode==0.3.0
+pygments==2.11.2
+pygtrie==2.4.2
+pyparsing==3.0.7
+pyrsistent==0.18.1
+pytest==7.1.2
+python-dateutil==2.8.2
+python-levenshtein==0.12.2
+pytz==2022.1
+pyyaml==6.0
+pyzmq==22.3.0
+regex==2022.3.15
+requests-oauthlib==1.3.1
+requests==2.27.1
+resampy==0.2.2
+responses==0.18.0
+rsa==4.8
+sacremoses==0.0.49
+scikit-learn==1.0.2
+scipy==1.8.0
+send2trash==1.8.0
+sentry-sdk==1.5.8
+setproctitle==1.2.2
+setuptools==44.0.0
+shortuuid==1.0.8
+six==1.16.0
+smmap==5.0.0
+sniffio==1.2.0
+sortedcontainers==2.4.0
+soundfile==0.10.3.post1
+soupsieve==2.3.1
+stack-data==0.2.0
+tensorboard-data-server==0.6.1
+tensorboard-plugin-wit==1.8.1
+tensorboard==2.8.0
+tensorflow-io-gcs-filesystem==0.24.0
+tensorflow==2.8.0
+termcolor==1.1.0
+terminado==0.13.3
+testpath==0.6.0
+tf-estimator-nightly==2.8.0.dev2021122109
+threadpoolctl==3.1.0
+tokenizers==0.11.6
+toml==0.10.2
+tomli==2.0.1
+toolz==0.11.2
+torch==1.11.0+cpu
+torchaudio==0.11.0+cpu
+tornado==6.1
+tqdm==4.63.1
+traitlets==5.1.1
+transformers==4.18.0.dev0
+typing-extensions==4.1.1
+urllib3==1.26.9
+wandb==0.12.11
+wcwidth==0.2.5
+webencodings==0.5.1
+websocket-client==1.3.2
+werkzeug==2.1.0
+wheel==0.37.1
+wrapt==1.14.0
+xxhash==3.0.0
+yarl==1.7.2
+yaspin==2.1.0
+zipp==3.7.0

wandb/run-20220529_120458-qf2iwkac/files/wandb-metadata.json

@@ -0,0 +1,58 @@
+{
+    "os": "Linux-5.4.0-1043-gcp-x86_64-with-glibc2.29",
+    "python": "3.8.10",
+    "heartbeatAt": "2022-05-29T12:05:01.566960",
+    "startedAt": "2022-05-29T12:04:58.499121",
+    "docker": null,
+    "cpu_count": 96,
+    "cuda": null,
+    "args": [
+        "--dataset_name=hf-internal-testing/librispeech_asr_dummy",
+        "--model_name_or_path=./",
+        "--dataset_config_name=clean",
+        "--train_split_name=validation",
+        "--eval_split_name=validation",
+        "--test_split_name=validation[:90%]+validation[:95%]",
+        "--output_dir=./",
+        "--dataset_cache_dir=/home/sanchitgandhi/cache/huggingface/datasets",
+        "--preprocessing_num_workers=1",
+        "--length_column_name=input_length",
+        "--overwrite_output_dir",
+        "--max_steps=10",
+        "--eval_steps=5",
+        "--save_steps=5",
+        "--per_device_train_batch_size=2",
+        "--per_device_eval_batch_size=2",
+        "--logging_steps=1",
+        "--max_duration_in_seconds=15",
+        "--max_target_length=64",
+        "--generation_max_length=40",
+        "--generation_num_beams=1",
+        "--final_generation_max_length=40",
+        "--final_generation_num_beams=1",
+        "--learning_rate=3e-4",
+        "--warmup_steps=500",
+        "--text_column_name=text",
+        "--save_total_limit=1",
+        "--wandb_project=flax-wav2vec2-2-bart-dummy",
+        "--freeze_feature_encoder",
+        "--predict_with_generate",
+        "--do_lower_case",
+        "--do_train",
+        "--do_eval",
+        "--do_predict",
+        "--push_to_hub"
+    ],
+    "state": "running",
+    "program": "run_flax_speech_recognition_seq2seq.py",
+    "codePath": "run_flax_speech_recognition_seq2seq.py",
+    "git": {
+        "remote": "https://huggingface.co/sanchit-gandhi/flax-dummy",
+        "commit": "f6cca39fc53952ef9f6e2aaf1b660ddf4161b05d"
+    },
+    "email": "sanchit@huggingface.co",
+    "root": "/home/sanchitgandhi/flax-dummy",
+    "host": "t1v-n-4eb331dd-w-0",
+    "username": "sanchitgandhi",
+    "executable": "/home/sanchitgandhi/venv/bin/python"
+}

wandb/run-20220529_120458-qf2iwkac/files/wandb-summary.json

@@ -0,0 +1 @@
+{"train/decoder_grad_norm": 0.28948837518692017, "train/decoder_param_norm": 10.9873046875, "train/encoder_grad_norm": 6.325928552541882e-05, "train/encoder_param_norm": 21.972986221313477, "train/grad_norm": 0.28948840498924255, "layer_grad_norm/": {"decoder": {"model": {"decoder": {"embed_positions": {"embedding": 0.1468065232038498}, "embed_tokens": {"embedding": 0.24802552163600922}, "layernorm_embedding": {"bias": 0.006764871999621391, "scale": 0.0036919426638633013}, "layers": {"FlaxBartDecoderLayers": {"encoder_attn": {"k_proj": {"bias": 3.328560029599442e-13, "kernel": 9.95582847933274e-13}, "out_proj": {"bias": 0.009623706340789795, "kernel": 4.8367015551775694e-05}, "q_proj": {"bias": 7.838640760787774e-13, "kernel": 1.0103118428667068e-12}, "v_proj": {"bias": 0.00114067189861089, "kernel": 4.325820555095561e-06}}, "encoder_attn_layer_norm": {"bias": 0.00958589930087328, "scale": 0.005416943226009607}, "fc1": {"bias": 0.00019959310884587467, "kernel": 0.0004716127004940063}, "fc2": {"bias": 0.00993743073195219, "kernel": 0.0003652443701867014}, "final_layer_norm": {"bias": 0.010846015997231007, "scale": 0.005791571922600269}, "self_attn": {"k_proj": {"bias": 1.3708134627421487e-09, "kernel": 4.577025265461998e-06}, "out_proj": {"bias": 0.009274601936340332, "kernel": 0.000999519252218306}, "q_proj": {"bias": 1.7297755903200596e-06, "kernel": 4.314425950724399e-06}, "v_proj": {"bias": 0.0008124791202135384, "kernel": 0.0009584471699781716}}, "self_attn_layer_norm": {"bias": 0.009586097672581673, "scale": 0.005415966734290123}}}}}}, "encoder": {"adapter": {"layers": {"0": {"conv": {"bias": 2.977989197461284e-07, "kernel": 1.3835579011356458e-06}}, "1": {"conv": {"bias": 3.6216874832462054e-06, "kernel": 1.5065093066368718e-06}}, "2": {"conv": {"bias": 6.303114059846848e-05, "kernel": 2.8466049570852192e-06}}}}, "encoder": {"layer_norm": {"bias": 4.9153292991377384e-08, "scale": 4.927479935190604e-08}, "layers": {"FlaxWav2Vec2EncoderLayers": {"attention": {"k_proj": {"bias": 1.459917082888187e-15, "kernel": 1.90472235206407e-10}, "out_proj": {"bias": 1.0287843679179787e-06, "kernel": 1.619392975271694e-07}, "q_proj": {"bias": 8.26251983498949e-11, "kernel": 2.237984936259707e-10}, "v_proj": {"bias": 7.108157973334528e-08, "kernel": 1.6080137754670432e-07}}, "feed_forward": {"intermediate_dense": {"bias": 4.810428322343796e-08, "kernel": 1.3616384819670202e-07}, "output_dense": {"bias": 9.441144470656582e-07, "kernel": 1.3445610136386676e-07}}, "final_layer_norm": {"bias": 3.294326367253575e-09, "scale": 2.245429175928848e-09}, "layer_norm": {"bias": 5.97741944829977e-09, "scale": 3.64200114510993e-09}}}, "pos_conv_embed": {"conv": {"bias": 3.8169284266587056e-07, "weight_g": 7.756315589801943e-09, "weight_v": 8.743172230651908e-08}}}, "feature_extractor": {"conv_layers": {"0": {"conv": {"kernel": 0.0}, "layer_norm": {"bias": 0.0, "scale": 0.0}}, "1": {"conv": {"kernel": 0.0}, "layer_norm": {"bias": 0.0, "scale": 0.0}}, "2": {"conv": {"kernel": 0.0}, "layer_norm": {"bias": 0.0, "scale": 0.0}}}}, "feature_projection": {"layer_norm": {"bias": 8.516661864632624e-08, "scale": 9.493159147666574e-09}, "projection": {"bias": 8.456348723484552e-07, "kernel": 6.272103405535745e-07}}, "masked_spec_embed": 0.0}}, "layer_param_norm/": {"decoder": {"model": {"decoder": {"embed_positions": {"embedding": 0.7995925545692444}, "embed_tokens": {"embedding": 2.5083723068237305}, "layernorm_embedding": {"bias": 0.004505096934735775, "scale": 4.000091552734375}, "layers": {"FlaxBartDecoderLayers": {"encoder_attn": {"k_proj": {"bias": 2.66487765188117e-09, "kernel": 0.43237069249153137}, "out_proj": {"bias": 0.006343331653624773, "kernel": 0.46723419427871704}, "q_proj": {"bias": 3.573997986450195e-08, "kernel": 0.4763868451118469}, "v_proj": {"bias": 0.0068108439445495605, "kernel": 0.4630829691886902}}, "encoder_attn_layer_norm": {"bias": 0.006466111168265343, "scale": 5.656971454620361}, "fc1": {"bias": 0.0032308774534612894, "kernel": 0.2302577644586563}, "fc2": {"bias": 0.00635903887450695, "kernel": 0.228498175740242}, "final_layer_norm": {"bias": 0.00622177729383111, "scale": 5.6571831703186035}, "self_attn": {"k_proj": {"bias": 1.3586953173216898e-05, "kernel": 0.4489402174949646}, "out_proj": {"bias": 0.006346424575895071, "kernel": 0.4596422016620636}, "q_proj": {"bias": 0.005505683831870556, "kernel": 0.43902429938316345}, "v_proj": {"bias": 0.0061093042604625225, "kernel": 0.47398924827575684}}, "self_attn_layer_norm": {"bias": 0.006466289050877094, "scale": 5.6569719314575195}}}}}}, "encoder": {"adapter": {"layers": {"0": {"conv": {"bias": 0.003881996963173151, "kernel": 0.7980067133903503}}, "1": {"conv": {"bias": 0.004839896224439144, "kernel": 0.7824534177780151}}, "2": {"conv": {"bias": 0.0047243074513971806, "kernel": 0.793502151966095}}}}, "encoder": {"layer_norm": {"bias": 0.0014691534452140331, "scale": 4.000521659851074}, "layers": {"FlaxWav2Vec2EncoderLayers": {"attention": {"k_proj": {"bias": 1.1641312219756728e-10, "kernel": 0.6511669158935547}, "out_proj": {"bias": 0.004517045803368092, "kernel": 0.6515875458717346}, "q_proj": {"bias": 9.10918606678024e-06, "kernel": 0.636457085609436}, "v_proj": {"bias": 0.00288462289609015, "kernel": 0.6421586871147156}}, "feed_forward": {"intermediate_dense": {"bias": 0.0023183180019259453, "kernel": 0.7063446640968323}, "output_dense": {"bias": 0.004766375757753849, "kernel": 0.7153233885765076}}, "final_layer_norm": {"bias": 0.00032824758091010153, "scale": 7.999977111816406}, "layer_norm": {"bias": 0.0006391080096364021, "scale": 8.000051498413086}}}, "pos_conv_embed": {"conv": {"bias": 0.0019932836294174194, "weight_g": 2.2777116298675537, "weight_v": 2.2775819301605225}}}, "feature_extractor": {"conv_layers": {"0": {"conv": {"kernel": 7.867799758911133}, "layer_norm": {"bias": 0.0, "scale": 5.656854152679443}}, "1": {"conv": {"kernel": 8.025212287902832}, "layer_norm": {"bias": 0.0, "scale": 5.656854152679443}}, "2": {"conv": {"kernel": 7.975250720977783}, "layer_norm": {"bias": 0.0, "scale": 5.656854152679443}}}}, "feature_projection": {"layer_norm": {"bias": 0.0016454723663628101, "scale": 5.656803131103516}, "projection": {"bias": 0.0019700622651726007, "kernel": 0.4300574064254761}}, "masked_spec_embed": 2.404470205307007}}, "train/learning_rate": 1.7999846022576094e-06, "train/loss": 6.901595592498779, "train/param_norm": 24.56690788269043, "_timestamp": 1653825986, "_runtime": 88, "_step": 4}

wandb/run-20220529_120458-qf2iwkac/logs/debug-internal.log

@@ -0,0 +1,108 @@
+2022-05-29 12:04:59,324 INFO    MainThread:1721989 [internal.py:wandb_internal():92] W&B internal server running at pid: 1721989, started at: 2022-05-29 12:04:59.324307
+2022-05-29 12:04:59,326 INFO    WriterThread:1721989 [datastore.py:open_for_write():77] open: /home/sanchitgandhi/flax-dummy/wandb/run-20220529_120458-qf2iwkac/run-qf2iwkac.wandb
+2022-05-29 12:04:59,327 DEBUG   SenderThread:1721989 [sender.py:send():235] send: header
+2022-05-29 12:04:59,327 DEBUG   SenderThread:1721989 [sender.py:send():235] send: run
+2022-05-29 12:04:59,384 DEBUG   HandlerThread:1721989 [handler.py:handle_request():141] handle_request: check_version
+2022-05-29 12:04:59,385 INFO    SenderThread:1721989 [dir_watcher.py:__init__():169] watching files in: /home/sanchitgandhi/flax-dummy/wandb/run-20220529_120458-qf2iwkac/files
+2022-05-29 12:04:59,385 INFO    SenderThread:1721989 [sender.py:_start_run_threads():812] run started: qf2iwkac with start time 1653825898
+2022-05-29 12:04:59,385 DEBUG   SenderThread:1721989 [sender.py:send():235] send: summary
+2022-05-29 12:04:59,385 INFO    SenderThread:1721989 [sender.py:_save_file():947] saving file wandb-summary.json with policy end
+2022-05-29 12:04:59,385 DEBUG   SenderThread:1721989 [sender.py:send_request():249] send_request: check_version
+2022-05-29 12:04:59,447 DEBUG   HandlerThread:1721989 [handler.py:handle_request():141] handle_request: run_start
+2022-05-29 12:05:00,436 INFO    Thread-7  :1721989 [dir_watcher.py:_on_file_created():217] file/dir created: /home/sanchitgandhi/flax-dummy/wandb/run-20220529_120458-qf2iwkac/files/wandb-summary.json
+2022-05-29 12:05:01,566 DEBUG   HandlerThread:1721989 [meta.py:__init__():37] meta init
+2022-05-29 12:05:01,566 DEBUG   HandlerThread:1721989 [meta.py:__init__():51] meta init done
+2022-05-29 12:05:01,566 DEBUG   HandlerThread:1721989 [meta.py:probe():211] probe
+2022-05-29 12:05:01,568 DEBUG   HandlerThread:1721989 [meta.py:_setup_git():201] setup git
+2022-05-29 12:05:01,597 DEBUG   HandlerThread:1721989 [meta.py:_setup_git():208] setup git done
+2022-05-29 12:05:01,597 DEBUG   HandlerThread:1721989 [meta.py:_save_pip():55] save pip
+2022-05-29 12:05:01,598 DEBUG   HandlerThread:1721989 [meta.py:_save_pip():69] save pip done
+2022-05-29 12:05:01,598 DEBUG   HandlerThread:1721989 [meta.py:probe():249] probe done
+2022-05-29 12:05:01,601 DEBUG   SenderThread:1721989 [sender.py:send():235] send: files
+2022-05-29 12:05:01,601 INFO    SenderThread:1721989 [sender.py:_save_file():947] saving file wandb-metadata.json with policy now
+2022-05-29 12:05:01,608 DEBUG   HandlerThread:1721989 [handler.py:handle_request():141] handle_request: stop_status
+2022-05-29 12:05:01,608 DEBUG   SenderThread:1721989 [sender.py:send_request():249] send_request: stop_status
+2022-05-29 12:05:01,639 DEBUG   SenderThread:1721989 [sender.py:send():235] send: telemetry
+2022-05-29 12:05:01,849 INFO    Thread-11 :1721989 [upload_job.py:push():137] Uploaded file /tmp/tmpl7u6xxw8wandb/12iwbaqf-wandb-metadata.json
+2022-05-29 12:05:02,475 INFO    Thread-7  :1721989 [dir_watcher.py:_on_file_created():217] file/dir created: /home/sanchitgandhi/flax-dummy/wandb/run-20220529_120458-qf2iwkac/files/wandb-metadata.json
+2022-05-29 12:05:02,475 INFO    Thread-7  :1721989 [dir_watcher.py:_on_file_created():217] file/dir created: /home/sanchitgandhi/flax-dummy/wandb/run-20220529_120458-qf2iwkac/files/requirements.txt
+2022-05-29 12:05:02,475 INFO    Thread-7  :1721989 [dir_watcher.py:_on_file_created():217] file/dir created: /home/sanchitgandhi/flax-dummy/wandb/run-20220529_120458-qf2iwkac/files/output.log
+2022-05-29 12:05:04,476 INFO    Thread-7  :1721989 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchitgandhi/flax-dummy/wandb/run-20220529_120458-qf2iwkac/files/output.log
+2022-05-29 12:05:06,476 INFO    Thread-7  :1721989 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchitgandhi/flax-dummy/wandb/run-20220529_120458-qf2iwkac/files/output.log
+2022-05-29 12:05:16,479 INFO    Thread-7  :1721989 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchitgandhi/flax-dummy/wandb/run-20220529_120458-qf2iwkac/files/output.log
+2022-05-29 12:05:16,641 DEBUG   HandlerThread:1721989 [handler.py:handle_request():141] handle_request: stop_status
+2022-05-29 12:05:16,641 DEBUG   SenderThread:1721989 [sender.py:send_request():249] send_request: stop_status
+2022-05-29 12:05:18,480 INFO    Thread-7  :1721989 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchitgandhi/flax-dummy/wandb/run-20220529_120458-qf2iwkac/files/output.log
+2022-05-29 12:05:20,481 INFO    Thread-7  :1721989 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchitgandhi/flax-dummy/wandb/run-20220529_120458-qf2iwkac/files/output.log
+2022-05-29 12:05:29,648 DEBUG   SenderThread:1721989 [sender.py:send():235] send: stats
+2022-05-29 12:05:30,485 INFO    Thread-7  :1721989 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchitgandhi/flax-dummy/wandb/run-20220529_120458-qf2iwkac/files/config.yaml
+2022-05-29 12:05:31,669 DEBUG   HandlerThread:1721989 [handler.py:handle_request():141] handle_request: stop_status
+2022-05-29 12:05:31,669 DEBUG   SenderThread:1721989 [sender.py:send_request():249] send_request: stop_status
+2022-05-29 12:05:42,516 DEBUG   HandlerThread:1721989 [handler.py:handle_request():141] handle_request: partial_history
+2022-05-29 12:05:42,573 DEBUG   HandlerThread:1721989 [handler.py:handle_request():141] handle_request: partial_history
+2022-05-29 12:05:44,489 INFO    Thread-7  :1721989 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchitgandhi/flax-dummy/wandb/run-20220529_120458-qf2iwkac/files/output.log
+2022-05-29 12:05:46,714 DEBUG   HandlerThread:1721989 [handler.py:handle_request():141] handle_request: stop_status
+2022-05-29 12:05:46,715 DEBUG   SenderThread:1721989 [sender.py:send_request():249] send_request: stop_status
+2022-05-29 12:05:59,724 DEBUG   SenderThread:1721989 [sender.py:send():235] send: stats
+2022-05-29 12:06:01,767 DEBUG   HandlerThread:1721989 [handler.py:handle_request():141] handle_request: stop_status
+2022-05-29 12:06:01,767 DEBUG   SenderThread:1721989 [sender.py:send_request():249] send_request: stop_status
+2022-05-29 12:06:03,840 DEBUG   HandlerThread:1721989 [handler.py:handle_request():141] handle_request: partial_history
+2022-05-29 12:06:03,845 DEBUG   SenderThread:1721989 [sender.py:send():235] send: history
+2022-05-29 12:06:03,846 DEBUG   SenderThread:1721989 [sender.py:send():235] send: summary
+2022-05-29 12:06:03,847 INFO    SenderThread:1721989 [sender.py:_save_file():947] saving file wandb-summary.json with policy end
+2022-05-29 12:06:03,899 DEBUG   HandlerThread:1721989 [handler.py:handle_request():141] handle_request: partial_history
+2022-05-29 12:06:04,497 INFO    Thread-7  :1721989 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchitgandhi/flax-dummy/wandb/run-20220529_120458-qf2iwkac/files/wandb-summary.json
+2022-05-29 12:06:06,497 INFO    Thread-7  :1721989 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchitgandhi/flax-dummy/wandb/run-20220529_120458-qf2iwkac/files/output.log
+2022-05-29 12:06:16,816 DEBUG   HandlerThread:1721989 [handler.py:handle_request():141] handle_request: stop_status
+2022-05-29 12:06:16,816 DEBUG   SenderThread:1721989 [sender.py:send_request():249] send_request: stop_status
+2022-05-29 12:06:26,186 DEBUG   HandlerThread:1721989 [handler.py:handle_request():141] handle_request: partial_history
+2022-05-29 12:06:26,188 DEBUG   SenderThread:1721989 [sender.py:send():235] send: history
+2022-05-29 12:06:26,189 DEBUG   SenderThread:1721989 [sender.py:send():235] send: summary
+2022-05-29 12:06:26,191 INFO    SenderThread:1721989 [sender.py:_save_file():947] saving file wandb-summary.json with policy end
+2022-05-29 12:06:26,256 DEBUG   HandlerThread:1721989 [handler.py:handle_request():141] handle_request: partial_history
+2022-05-29 12:06:26,505 INFO    Thread-7  :1721989 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchitgandhi/flax-dummy/wandb/run-20220529_120458-qf2iwkac/files/wandb-summary.json
+2022-05-29 12:06:26,834 DEBUG   HandlerThread:1721989 [handler.py:handle_request():141] handle_request: partial_history
+2022-05-29 12:06:26,836 DEBUG   SenderThread:1721989 [sender.py:send():235] send: history
+2022-05-29 12:06:26,837 DEBUG   SenderThread:1721989 [sender.py:send():235] send: summary
+2022-05-29 12:06:26,838 INFO    SenderThread:1721989 [sender.py:_save_file():947] saving file wandb-summary.json with policy end
+2022-05-29 12:06:26,884 DEBUG   HandlerThread:1721989 [handler.py:handle_request():141] handle_request: partial_history
+2022-05-29 12:06:27,505 INFO    Thread-7  :1721989 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchitgandhi/flax-dummy/wandb/run-20220529_120458-qf2iwkac/files/wandb-summary.json
+2022-05-29 12:06:27,513 DEBUG   HandlerThread:1721989 [handler.py:handle_request():141] handle_request: partial_history
+2022-05-29 12:06:27,515 DEBUG   SenderThread:1721989 [sender.py:send():235] send: history
+2022-05-29 12:06:27,515 DEBUG   SenderThread:1721989 [sender.py:send():235] send: summary
+2022-05-29 12:06:27,516 INFO    SenderThread:1721989 [sender.py:_save_file():947] saving file wandb-summary.json with policy end
+2022-05-29 12:06:27,570 DEBUG   HandlerThread:1721989 [handler.py:handle_request():141] handle_request: partial_history
+2022-05-29 12:06:28,506 INFO    Thread-7  :1721989 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchitgandhi/flax-dummy/wandb/run-20220529_120458-qf2iwkac/files/wandb-summary.json
+2022-05-29 12:06:28,506 INFO    Thread-7  :1721989 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchitgandhi/flax-dummy/wandb/run-20220529_120458-qf2iwkac/files/output.log
+2022-05-29 12:06:29,794 DEBUG   SenderThread:1721989 [sender.py:send():235] send: stats
+2022-05-29 12:06:31,871 DEBUG   HandlerThread:1721989 [handler.py:handle_request():141] handle_request: stop_status
+2022-05-29 12:06:31,871 DEBUG   SenderThread:1721989 [sender.py:send_request():249] send_request: stop_status
+2022-05-29 12:06:46,902 DEBUG   HandlerThread:1721989 [handler.py:handle_request():141] handle_request: stop_status
+2022-05-29 12:06:46,903 DEBUG   SenderThread:1721989 [sender.py:send_request():249] send_request: stop_status
+2022-05-29 12:06:54,515 INFO    Thread-7  :1721989 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchitgandhi/flax-dummy/wandb/run-20220529_120458-qf2iwkac/files/output.log
+2022-05-29 12:06:59,870 DEBUG   SenderThread:1721989 [sender.py:send():235] send: stats
+2022-05-29 12:07:01,952 DEBUG   HandlerThread:1721989 [handler.py:handle_request():141] handle_request: stop_status
+2022-05-29 12:07:01,952 DEBUG   SenderThread:1721989 [sender.py:send_request():249] send_request: stop_status
+2022-05-29 12:07:12,521 INFO    Thread-7  :1721989 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchitgandhi/flax-dummy/wandb/run-20220529_120458-qf2iwkac/files/output.log
+2022-05-29 12:07:17,016 DEBUG   HandlerThread:1721989 [handler.py:handle_request():141] handle_request: stop_status
+2022-05-29 12:07:17,016 DEBUG   SenderThread:1721989 [sender.py:send_request():249] send_request: stop_status
+2022-05-29 12:07:29,946 DEBUG   SenderThread:1721989 [sender.py:send():235] send: stats
+2022-05-29 12:07:32,044 DEBUG   HandlerThread:1721989 [handler.py:handle_request():141] handle_request: stop_status
+2022-05-29 12:07:32,044 DEBUG   SenderThread:1721989 [sender.py:send_request():249] send_request: stop_status
+2022-05-29 12:07:35,982 DEBUG   HandlerThread:1721989 [handler.py:handle_request():141] handle_request: partial_history
+2022-05-29 12:07:36,081 DEBUG   HandlerThread:1721989 [handler.py:handle_request():141] handle_request: log_artifact
+2022-05-29 12:07:36,081 DEBUG   SenderThread:1721989 [sender.py:send_request():249] send_request: log_artifact
+2022-05-29 12:07:36,280 DEBUG   HandlerThread:1721989 [handler.py:handle_request():141] handle_request: partial_history
+2022-05-29 12:07:36,354 DEBUG   HandlerThread:1721989 [handler.py:handle_request():141] handle_request: log_artifact
+2022-05-29 12:07:36,453 DEBUG   HandlerThread:1721989 [handler.py:handle_request():141] handle_request: partial_history
+2022-05-29 12:07:36,530 INFO    Thread-7  :1721989 [dir_watcher.py:_on_file_modified():230] file/dir modified: /home/sanchitgandhi/flax-dummy/wandb/run-20220529_120458-qf2iwkac/files/output.log
+2022-05-29 12:07:36,530 INFO    Thread-7  :1721989 [dir_watcher.py:_on_file_created():217] file/dir created: /home/sanchitgandhi/flax-dummy/wandb/run-20220529_120458-qf2iwkac/files/media/table/eval/step_0k_5_92ae240f2472ae79ad31.table.json
+2022-05-29 12:07:36,530 INFO    Thread-7  :1721989 [dir_watcher.py:_on_file_created():217] file/dir created: /home/sanchitgandhi/flax-dummy/wandb/run-20220529_120458-qf2iwkac/files/media/table/eval/step_0k_incorrect_5_b30e6671cbaaf5c82b6d.table.json
+2022-05-29 12:07:36,530 INFO    Thread-7  :1721989 [dir_watcher.py:_on_file_created():217] file/dir created: /home/sanchitgandhi/flax-dummy/wandb/run-20220529_120458-qf2iwkac/files/media
+2022-05-29 12:07:36,530 INFO    Thread-7  :1721989 [dir_watcher.py:_on_file_created():217] file/dir created: /home/sanchitgandhi/flax-dummy/wandb/run-20220529_120458-qf2iwkac/files/media/table
+2022-05-29 12:07:36,530 INFO    Thread-7  :1721989 [dir_watcher.py:_on_file_created():217] file/dir created: /home/sanchitgandhi/flax-dummy/wandb/run-20220529_120458-qf2iwkac/files/media/table/eval
+2022-05-29 12:07:36,589 INFO    Thread-13 :1721989 [upload_job.py:push():95] Uploaded file /home/sanchitgandhi/.cache/wandb/artifacts/obj/md5/00/66783abbd98b29e02682346c82293a
+2022-05-29 12:07:36,995 INFO    SenderThread:1721989 [sender.py:send_request_log_artifact():976] logged artifact run-qf2iwkac-evalstep_0k - {'id': 'QXJ0aWZhY3Q6MTM1NjQyNTgy', 'digest': '1fc9411295ac28c0df16aa1f68611033', 'state': 'PENDING', 'aliases': [], 'artifactSequence': {'id': 'QXJ0aWZhY3RDb2xsZWN0aW9uOjIxNTAwMTY3', 'latestArtifact': None}, 'version': 'latest'}
+2022-05-29 12:07:36,995 DEBUG   SenderThread:1721989 [sender.py:send():235] send: files
+2022-05-29 12:07:36,995 INFO    SenderThread:1721989 [sender.py:_save_file():947] saving file media/table/eval/step_0k_5_92ae240f2472ae79ad31.table.json with policy now
+2022-05-29 12:07:36,996 DEBUG   SenderThread:1721989 [sender.py:send_request():249] send_request: log_artifact

wandb/run-20220529_120458-qf2iwkac/logs/debug.log

@@ -0,0 +1,25 @@
+2022-05-29 12:04:58,500 INFO    MainThread:1720934 [wandb_setup.py:_flush():75] Loading settings from /home/sanchitgandhi/.config/wandb/settings
+2022-05-29 12:04:58,500 INFO    MainThread:1720934 [wandb_setup.py:_flush():75] Loading settings from /home/sanchitgandhi/flax-dummy/wandb/settings
+2022-05-29 12:04:58,500 INFO    MainThread:1720934 [wandb_setup.py:_flush():75] Loading settings from environment variables: {}
+2022-05-29 12:04:58,500 INFO    MainThread:1720934 [wandb_setup.py:_flush():75] Inferring run settings from compute environment: {'program_relpath': 'run_flax_speech_recognition_seq2seq.py', 'program': 'run_flax_speech_recognition_seq2seq.py'}
+2022-05-29 12:04:58,500 INFO    MainThread:1720934 [wandb_init.py:_log_setup():405] Logging user logs to /home/sanchitgandhi/flax-dummy/wandb/run-20220529_120458-qf2iwkac/logs/debug.log
+2022-05-29 12:04:58,500 INFO    MainThread:1720934 [wandb_init.py:_log_setup():406] Logging internal logs to /home/sanchitgandhi/flax-dummy/wandb/run-20220529_120458-qf2iwkac/logs/debug-internal.log
+2022-05-29 12:04:58,501 INFO    MainThread:1720934 [wandb_init.py:init():439] calling init triggers
+2022-05-29 12:04:58,501 INFO    MainThread:1720934 [wandb_init.py:init():442] wandb.init called with sweep_config: {}
+config: {}
+2022-05-29 12:04:58,501 INFO    MainThread:1720934 [wandb_init.py:init():492] starting backend
+2022-05-29 12:04:58,501 INFO    MainThread:1720934 [backend.py:_multiprocessing_setup():99] multiprocessing start_methods=fork,spawn,forkserver, using: spawn
+2022-05-29 12:04:58,525 INFO    MainThread:1720934 [backend.py:ensure_launched():219] starting backend process...
+2022-05-29 12:04:58,550 INFO    MainThread:1720934 [backend.py:ensure_launched():224] started backend process with pid: 1721989
+2022-05-29 12:04:58,552 INFO    MainThread:1720934 [wandb_init.py:init():501] backend started and connected
+2022-05-29 12:04:58,565 INFO    MainThread:1720934 [wandb_init.py:init():565] updated telemetry
+2022-05-29 12:04:58,625 INFO    MainThread:1720934 [wandb_init.py:init():596] communicating run to backend with 30 second timeout
+2022-05-29 12:04:59,384 INFO    MainThread:1720934 [wandb_run.py:_on_init():1759] communicating current version
+2022-05-29 12:04:59,446 INFO    MainThread:1720934 [wandb_run.py:_on_init():1763] got version response upgrade_message: "wandb version 0.12.17 is available!  To upgrade, please run:\n $ pip install wandb --upgrade"
+
+2022-05-29 12:04:59,446 INFO    MainThread:1720934 [wandb_init.py:init():625] starting run threads in backend
+2022-05-29 12:05:01,606 INFO    MainThread:1720934 [wandb_run.py:_console_start():1733] atexit reg
+2022-05-29 12:05:01,606 INFO    MainThread:1720934 [wandb_run.py:_redirect():1606] redirect: SettingsConsole.REDIRECT
+2022-05-29 12:05:01,607 INFO    MainThread:1720934 [wandb_run.py:_redirect():1611] Redirecting console.
+2022-05-29 12:05:01,609 INFO    MainThread:1720934 [wandb_run.py:_redirect():1667] Redirects installed.
+2022-05-29 12:05:01,609 INFO    MainThread:1720934 [wandb_init.py:init():664] run started, returning control to user process

wandb/run-20220529_120458-qf2iwkac/run-qf2iwkac.wandb

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:41e927d4ed171d350275f4ae49605fcc773813f7805542baaaf99fa5fcebe420
+size 52033